KR20230015268A - Method and apparatus for creating a user's preferences photo through collaboration between an image stored in a user terminal and an image captured through a shooting room kiosk - Google Patents

Abstract

According to various embodiments, a photograph studio operating system linked with a capturing room kiosk and a user terminal includes: a capturing room kiosk provided in a photograph studio to receive an input of a user and display an image captured by using a built-in camera to the user through a display; an operating server that transmits a device control signal to the capturing room kiosk and obtains the captured image obtained through the camera of the capturing room kiosk; and a user terminal operatively connected to the operating server and obtaining the captured image through the operating server. The operating server includes: a capturing concept control unit for receiving capturing concept data from the user terminal to control a capturing concept; a sharing service provision unit configured to set an image captured through a first capturing room kiosk as a shared image and share the set shared image with a second user terminal or a second capturing room kiosk; and an image synthesis unit for synthesizing a first image obtained in real time through a camera of the first capturing room kiosk and a second image obtained in real time through a camera of a second capturing room kiosk. The present invention can extract a desired filter effect of a user from another image and apply the effect to a captured image.

Description

A method and apparatus for creating a user's preference photo through collaboration between an image stored in a user terminal and an image captured through a shooting room kiosk IMAGE CAPTURED THROUGH A SHOOTING ROOM KIOSK}

The present invention relates to a method and apparatus for generating a user's favorite photo through collaboration between an image stored in a user terminal and an image captured through a photo shoot room kiosk, and more particularly, through an image to which a filter effect is applied stored in a user terminal A method and apparatus for extracting a filter effect and allowing the extracted filter effect to be applied to an image photographed through a photographing room kiosk.

In the case of an existing photo studio, a photographer directly takes a picture and outputs the photographed picture to provide a photo frame. In other words, the production of commemorative photo albums in the past was done in a way that they were taken in a photo studio, completed on their own, and provided to users.

However, due to the spread of the Internet and the development of digital technology, when a user directly takes a picture in a photo studio and requests an album to be produced, the photo file to be used in the album is viewed using the photo studio's website or web hard. The service has been improved so that the digital files can be downloaded. That is, unmanned photo studios are being created according to the demand of users, and accordingly, users can conveniently visit, select the shooting concept they want, take a photo, and directly output the photo.

As described above, in recent years, it is a trend that studies on studio environments are continuously conducted in order to improve users' shooting accessibility and to provide convenient services to users.

According to the research on the studio environment, users' demand is increasing, and there is a trend to take pictures with their precious people in a shooting concept they want as well as a picture of themselves alone. However, due to the busy lives of modern people or issues such as viruses, it may be difficult to meet and take pictures with important people. For example, it may be difficult to make a time appointment between users, or a studio photoshoot cannot be performed together due to a long distance between users.

In addition, while it is often difficult to take a natural look desired by a user in taking a photo, in the case of taking a video, since numerous image frames are obtained, it is highly likely that the desired image is contained in the video. However, currently, shooting in a studio provides only a photo shooting function and does not provide a video shooting function, which is inconvenient.

In addition, a filter effect or a background effect may be limitedly stored in a photo studio or a photo studio kiosk. In addition, there may occur a case in which a filter effect or a background effect desired by the user cannot be selected even though there is a filter effect or a background effect desired by the user. Accordingly, various methods are required to satisfy the user's needs by acquiring an image that the user wants to apply an effect to from the user terminal and applying a filter effect applied to the image to the image captured through the photocopying room kiosk.

Matters described in this background art section are prepared to enhance understanding of the background of the invention, and may include matters other than prior art already known to those skilled in the art to which this technique belongs.

The following embodiments are devised to solve the above-mentioned problems, and even when users are not at the same time or in the same place, the shooting room kiosk is interlocked to provide the effect of shooting together, and through the shooting room kiosk An object of the present invention is to configure a photo frame through a user terminal even when a video rather than a picture is acquired.

In addition, the filter effect is extracted through the image with the filter effect stored in the user terminal, and the extracted filter effect can be applied to the image taken through the shooting room kiosk, so that the user's taste can be created. do.

Problems to be solved by one embodiment are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

One aspect of the present invention for achieving the above object provides a photo studio operating system linked with a photo studio kiosk and a user terminal.

The photo studio operating system may include: a shooting room kiosk provided in a shooting room to receive an input from a user of a user terminal and display an image captured using a built-in camera to the user through a display; an operating server that transmits device control signals for controlling lighting, music, and the camera of the recording room to the recording room kiosk, and obtains the image captured by the camera from the recording room kiosk; and the user terminal acquiring the image by communicating with the operation server.

The operation server may include: a shooting concept control unit generating the device control signal based on a shooting concept selected by the user from the shooting room kiosk; a sharing service providing unit that sets the captured image as a shared image and shares the set shared image with the user terminal or the photographing room kiosk; and an image synthesis unit synthesizing a first image and a second image acquired in real time through the cameras of the first and second shooting room kiosks, which are different from each other.

The user terminal composes a photo frame based on the acquired image, and determines the thickness, color, and number of photos that can be arranged in the photo frame.

The recording room kiosk captures a video, and the user terminal acquires the captured video through an operation server, and displays the photo frame based on at least one image frame among a plurality of image frames constituting the acquired video. Decide which photos to compose.

The image compositing unit generates a third image using the first image and the second image, and displays the generated third image on the display of the first shooting room kiosk and the display of the second shooting room kiosk. and acquires an image frame of the third image corresponding to a time point at which the capturing input is obtained in response to acquiring the capturing input while the third image is displayed.

The user terminal obtains a source image to which a filter effect is applied from an internal storage, estimates an original image without the filter effect from the source image, compares the source image and the original image to extract the filter effect, The extracted filter effect is applied to the acquired image.

The user terminal determines a first object having the largest area occupied in the source image among objects recognized in the source image, and determines color values of pixels corresponding to the first object in the source image and in the original image. Color values of pixels corresponding to the first object are compared, and based on the comparison, change values of R (red), G (green), and B (blue) of pixels corresponding to the first object are calculated. and extracts a color value corresponding to an average of R (red) change values, an average of G (green) change values, and an average of B (blue) change values in the area corresponding to the first object, and extracts the extracted color. A value is stored as the filter effect, and the stored filter effect is applied to the obtained image.

The user terminal generates a photo frame based on the video in response to a user's input for selecting a video obtained through the operation server, and provides an interface capable of adjusting the generated photo frame through a display, The shape of the photo frame, the photos constituting the photo frame, and the number of photos are determined according to the user's drag input acquired within the interface.

When the user's drag input for resizing the photo frame is not obtained for a first time, the user terminal determines the size at a time when the drag input is not obtained as the size of the photo frame, and the drag The photos included in the photo frame are configured as a x b to correspond to the shape and size of the photo frame determined according to the input.

The user terminal determines, as a real video, a video excluding the first 2nd time and the last 3rd time of the video, except for the 2nd time and the 3rd time, and the video within the determined length of the real video. Photos to compose a photo frame are determined, and when the determined number of photos is M, the length of the real video is equally divided by (M-1), and the first image frame of the real video is a first picture, the length of the real video. An image frame corresponding to part N-1/(M-1) of is determined as the Nth picture, and the maximum value of N is equal to the M.

The user terminal detects a user's pose in the video, determines a first image frame including a first pose as a first picture, and determines a second image frame including a second pose as a second picture, , When a third image frame including a third pose is determined as a third photo, and the number of the detected poses is less than the number of determined photos, an image including the first pose detected first among the detected poses. A frame is determined as the remaining photos constituting the photo frame.

The image synthesis unit obtains the first image and the second image in response to a request for a remote execution mode from a first user terminal, detects a second user from the second image, and generates the first image. When a pixel area corresponding to the second user is synthesized in a plurality of image frames, and the pixel area corresponding to the first user and the pixel area corresponding to the second user of the first image overlap, The depth value of the first user and the depth value of the second user are compared, the pixel area of the user with the high depth value is deleted, and the pixel area of the user with the low depth value is maintained to obtain the third image. generate

Another aspect of the present invention for achieving the above object provides a method of operating an operating server interlocked with a shooting room kiosk and a user terminal.

The operating method may include generating a device control signal based on a photographing concept selected by a user of the user terminal from the photographing room kiosk; setting an image photographed using the photographing room kiosk as a shared image according to the device control signal, and sharing the set shared image with the user terminal or the photographing room kiosk; and synthesizing a first image and a second image acquired in real time through the cameras of the first and second shooting room kiosks, which are different from each other.

The recording room kiosk is provided in the recording room to receive an input from the user of the user terminal and display the image captured using a built-in camera to the user through a display.

The user terminal acquires the image by communicating with the operation server.

Another aspect of the present invention for achieving the above object is to provide a non-transitory recording medium in which a program for executing the operating method is recorded and can be read by a computer.

Another aspect of the present invention for achieving the above object, in the operating server, provides a computer program recorded on a non-transitory recording medium to execute the operating method.

Another aspect of the present invention for achieving the above object provides an operating server interlocked with a shooting room kiosk and a user terminal.

The operation server may include: a shooting concept control unit generating a device control signal based on a shooting concept selected by a user of the user terminal from the shooting room kiosk; a sharing service provider configured to set an image captured using the photographing room kiosk as a shared image according to the device control signal and to share the set shared image with the user terminal or the photographing room kiosk; and an image synthesis unit synthesizing a first image and a second image acquired in real time through the cameras of the first and second shooting room kiosks, which are different from each other.

The recording room kiosk is provided in the recording room to receive an input from the user of the user terminal and display the image captured using a built-in camera to the user through a display.

The user terminal acquires the image by communicating with the operation server.

According to various embodiments disclosed in this document, a photo frame may be configured based on a captured video without the need to take multiple photos, providing convenience to the user.

In addition, according to various embodiments, even when it is difficult to photograph together due to time mismatch or distance between users, the effect of photographing together may be provided.

Also, according to various embodiments, a filter effect desired by a user may be extracted from another image and applied to the captured image.

In addition to this, various effects identified directly or indirectly through this document may be provided.

1 is a diagram illustrating a photo studio operating system according to an exemplary embodiment.
2 is a diagram showing the configuration of an operation server according to an embodiment.
3 is a diagram illustrating a configuration of a shooting concept control unit according to an exemplary embodiment.
4 is a diagram illustrating an example of a concept mapping table according to an embodiment.
5 is a flowchart of a shooting concept control method according to an exemplary embodiment.
6 is a diagram showing the configuration of a recording room server according to an embodiment.
7 is a diagram illustrating a recording room kiosk according to an exemplary embodiment.
8 is a diagram illustrating an example of photo concept data according to an exemplary embodiment.
9 is a flowchart illustrating a process of extracting a filter effect from a source image to which a filter effect desired by a user is applied and applying the extracted filter effect to an image obtained through an operation server.
FIG. 10 is a diagram for explaining an example of using an image captured by at least one user as a background image when two or more users cannot photograph together in one photographing room kiosk due to inconsistent time or distance from each other. .
FIG. 11 is a diagram for explaining an example of using an image captured by at least one user as a background image when two or more users cannot be photographed together in one photographing room kiosk due to inconsistent timing or distance from each other.
12 is a diagram illustrating remotely taking pictures together by a first user and a second user by interlocking a first and second recording room kiosks.
13 is a diagram for explaining the construction of a photo frame based on a video obtained through an operating server.
14 is a diagram for explaining the construction of a photo frame based on an acquired video.
FIG. 15 is a diagram for explaining the composition of photo frames in various forms based on a user's drag input with respect to an acquired video.
16 is a diagram illustrating a configuration of a user terminal 300 according to an embodiment.
17 is a diagram illustrating a wireless communication system that can be applied in a communication process according to an embodiment of the present invention.
18 is a diagram illustrating a base station in the wireless communication system according to FIG. 17;
19 is a diagram illustrating a terminal in the wireless communication system according to FIG. 17 .
20 is a diagram illustrating a communication interface in the wireless communication system according to FIG. 17;

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. Like reference numerals have been used for like elements throughout the description of each figure.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention. The terms and/or include any combination of a plurality of related recited items or any of a plurality of related recited items.

It is understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle. It should be. On the other hand, when an element is referred to as “directly connected” or “directly connected” to another element, it should be understood that no other element exists in the middle.

Terms used in this application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a photo studio operating system 10 according to an exemplary embodiment.

Referring to FIG. 1 , the photo studio operating system 10 according to an embodiment includes an operation server 100, a shooting room server 200, a camera (eg, the camera 610 of FIG. 6) 210, a speaker ( 220), a light 230, a sensor 240, a display (eg, the displays 620 and 630 of FIG. 7) 250, a user terminal 300, and a creator terminal 400.

Communication between various entities included in the photo studio operating system 10 may be performed through a wired/wireless network. Wired/wireless networks may use standard communication technologies and/or protocols.

The operating server 100, the shooting room server 200, the user terminal 300, and the creator terminal 400 in the photo studio operating system 10 include, for example, a computer, an ultra mobile PC (UMPC), a workstation, and a netbook. (net-book), PDA (Personal Digital Assistants), portable computer, web tablet, wireless phone, mobile phone, smart phone, PMP (portable) multimedia player), and may include all electronic devices capable of installing and executing applications related to an embodiment. The electronic device may perform overall service operations, such as composition of a service screen, data input, data transmission/reception, and data storage, under the control of an application.

The shooting room server 200, the camera 210, and the display 250 in the photo studio operating system 10 may be configured as a shooting room kiosk 600. The shooting room kiosk 600 will be described in detail with reference to FIG. 6 below.

The operation server 100 is a server that provides various functions related to photo studio operation.

The operation server 100 may control the lighting, music, and camera of the shooting room according to the shooting concept selected by the user.

The operation server 100 may receive photo concept data from a user, control lighting, music, and a camera of a photo shoot room according to the photo concept data, and change a photo frame of an output photo.

The operation server 100 may provide advertisements to users by providing advertisements to the shooting room kiosk 600 having a display. The shooting room kiosk 600 may generate and transmit advertisement response data including user identification information, advertisement identification information, and user response type in response to the advertisement to the operation server 100 .

The operation server 100 may transmit a device control signal to the recording room server 200 to control various devices provided in the recording room.

The operation server 100 may transmit photos and/or videos taken by the camera 210 to the user terminal 300 and may receive a photo concept from the user terminal 300 .

The operation server 100 may receive and store the design of the photo frame pre-made in the creator terminal 400 . The operation server 100 may provide the design of the provided photo frame to the photographing room server 200 and/or the user terminal 300 . The design of the photo frame may include a color of the photo frame, a pattern of the photo frame, and the like.

The specific configuration and function of the operation server 100 will be described in detail in FIG. 2 below.

The shooting room server 200 is a server provided in the shooting room and providing various functions necessary for taking pictures to users. The recording room server 200 may provide the captured photos and/or captured videos to the operation server 100 .

The shooting room server 200 may control the camera 210, the speaker 220, the lighting 230 and the sensor 240 provided in the shooting room using the device control signal received from the operation server 100. there is.

The shooting room server 200 may receive a sensor value from the sensor 240 and transmit the received sensor value to the operation server 100 .

The shooting room server 200 may include input means such as a touch screen, keyboard, mouse, and microphone, and the shooting room server 200 receives shooting setting information, device control information, and photo frame information from a user through the input means. can be input.

The shooting setting information of an embodiment may include a shooting concept, photo size, number of shots, etc., device control information may include camera parameters, lighting intensity, lighting color, shooting music, speaker volume, etc., and photo frame information may include frame design information of an output photo.

The shooting room server 200 may include output means such as a display device and a speaker, and the shooting room server 200 may output various information necessary for taking a picture to a user through the output means. For example, the shooting room server 200 may output a shooting concept selectable by the user and a photo taken by the user.

The shooting room server 200 may receive an advertisement from the operation server 100 and output the advertisement to a user through an output means. When the user responds to the advertisement, the shooting room server 200 may generate user response information and transmit it to the operation server 100 .

The shooting room server 200 may provide a user with a payment function necessary for taking a photo.

The shooting room server 200 may provide a photo printing function for outputting a photo taken by a user.

The shooting room server 200 may receive a specific advertisement from the operation server 100 and provide the advertisement to a user through the display 250 . The shooting room server 200 may generate and transmit advertisement response data including user identification information, advertisement identification information, and user response type in response to the advertisement to the operation server 100 .

The camera 210 is provided in the recording room, and a user can directly take a picture using the camera 210 .

The camera 210 may take a picture by applying a camera parameter input by a user through the recording room server 200 .

The camera 210 may take a video as well as take a photo. The video recording function may be controlled through the recording room kiosk 600 and/or the user terminal 300 .

Camera parameters according to an embodiment may include values such as image quality, size, camera sensitivity (ISO), filter, aperture, shutter speed, and the like.

As described above, the recording room server 200, the camera 210, the speaker 220, and the display 250 may be configured as the recording room kiosk 600. That is, the recording room server 200, the camera 210, the speaker 220, and the display 250 may be integrated to form a single recording room kiosk 600.

In this specification, the photographing room server 200 and the photographing room kiosk 600 will be described with the same configuration. That is, all functions implemented in the recording room server 200 can be equally implemented in the recording room kiosk 600 .

The speaker 220 is provided in the recording room and can reproduce recording music.

The lighting 230 may include a plurality of lighting devices provided in the recording room, and may output light according to a device control signal.

The sensor 240 may include a motion sensor 241, a voice sensor 242, and an illuminance sensor 243 provided in the recording room.

The motion sensor 241 may detect a motion signal generated according to a user's motion. The voice sensor 242 may detect a sound signal generated according to the user's motion and a voice command signal that may be issued according to the user's specific situation. The illuminance sensor 243 may recognize an illuminance value at the user's location.

The user terminal 300 may display images and/or videos obtained from the operation server 100 to the user. The user terminal 300 may edit images and/or videos obtained from the operating server 100 . The user terminal 300 may generate a photo frame based on images and/or videos obtained from the operating server 100 .

The user terminal 300 may transmit photo concept data created by a user to the operation server 100 .

The specific configuration and functions of the user terminal 300 will be described in detail with reference to FIGS. 9 to 15 below.

Figure 2 is a diagram showing the configuration of the operation server 100 according to an embodiment.

Referring to FIG. 2, the operation server 100 according to an embodiment includes a communication unit 110, an input unit 120, an output unit 130, a memory 140, a power supply unit 150, and a control unit 160. can do. The controller 160 may include a shooting concept controller 161, a sharing service provider 162, and an image synthesizer 163.

The configurations shown in FIG. 2 are exemplary diagrams for implementing the embodiments of the present invention, and appropriate hardware/software configurations that are obvious to those skilled in the art may be additionally included in the operating server 100.

The communication unit 110 may communicate with an external device through various communication methods. For example, the communication unit 110 may transmit and receive various data by communicating with the recording room server 200 and the user terminal 300 .

The input unit 120 may receive various inputs of an operator who is a user of the operation server 100 and transmit them to the control unit 160 . In particular, the input unit 120 may include a touch sensor, a (digital) pen sensor, a pressure sensor, a key, and a microphone. The touch sensor may use, for example, at least one of a capacitive type, a pressure-sensitive type, an infrared type, or an ultrasonic type. The (digital) pen sensor may be, for example, a part of the touch panel or may include a separate recognition sheet. Keys may include, for example, physical buttons, optical keys, or keypads. The microphone is a configuration for receiving operator voice and may be provided inside the operation server 100, but this is only one embodiment, and is provided outside the operation server 100 to be electrically connected to the operation server 100. can

The output unit 130 may provide various screens. For example, the output unit 130 may output a concept mapping table and photo concept data to an operator.

The memory 140 may store commands or data related to at least one other component of the operating server 100 . In particular, the memory 140 may be implemented as a non-volatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). The memory 140 is accessed by the control unit 160, and reading/writing/modification/deleting/updating of data by the control unit 160 can be performed. In the present invention, the term memory refers to a memory 140, a ROM (not shown) in the control unit 160, a RAM (not shown), or a memory card (not shown) mounted on the operating server 100 (eg, micro SD). card, memory stick). In addition, the memory 140 may store programs and data for configuring various screens to be displayed on the display area of the output unit 130 .

The power supply unit 150 receives external power and internal power under the control of the control unit 160 and supplies power necessary for the operation of each component.

The controller 160 is electrically connected to the communication unit 110, the input unit 120, the output unit 130, the memory 140, and the power supply unit 150 to control the overall operation and functions of the operation server 100. can In particular, the controller 160 may provide functions described later using various modules stored in the memory 140 .

It will be apparent that various operations on the operating server 100 described below may be performed under the control of the control unit 160 .

As described above, the controller 160 may include a shooting concept controller 161, a sharing service provider 162, and an image synthesizer 163.

The shooting concept controller 161 may control the lighting, music, and camera of the shooting room according to the shooting concept selected by the user.

The shooting concept controller 161 may use the shooting concept received from the shooting room server 200 to generate control signals for lighting, a speaker, and a camera in the shooting room. The shooting concept control unit 161 may generate device control signals including control signals of lighting, a speaker, and a camera in the shooting room by using the concept mapping table. Here, the control signal of the camera is the same signal as the camera parameter described above. The shooting concept may also be understood as a photo concept and/or a video concept.

The shooting concept controller 161 may receive photo concept data from a user, control lighting, music, and a camera in a shooting room according to the photo concept data, and change a photo frame of an output photo. The photo frame information may include frame design information of an output photo.

The shooting concept control unit 161 uses the photo concept data included in the creator information when another user uses the photo concept data to apply the shooting concept to the shooting room or outputs a taken photo. The photo concept data may be updated by increasing the number of times.

Photo concept data according to an embodiment may include a concept mapping table, photo frame information, and creator information. The user may generate photo concept data through the photo room kiosk 600 or the user terminal 300, and the photo room kiosk 600 or the user terminal 300 transfers the created photo concept data to the operation server 100. can be sent to To this end, the photography room kiosk 600 or the user terminal 300 may provide the user with an interface capable of generating photo concept data. The creator information may include identification information of a user who created the photo concept data and the number of uses of the photo concept data.

A specific configuration and function of the shooting concept control unit 161 will be described in detail with reference to FIG. 3 below.

The photo room kiosk 600 may include a plurality of photo room kiosks, and the sharing service provider 162 may provide a sharing service for allowing a second user to use an image captured by a first user. The operation of the sharing service provider 162 will be described in detail with reference to FIGS. 10 and 11 below.

The image synthesis unit 163 may synthesize images obtained through each camera of the plurality of photographing room kiosks and provide the synthesized image to the plurality of photographing room kiosks. The operation of the image synthesis unit 163 will be described in detail with reference to FIG. 12 below.

The control unit 160 may control the communication unit 110 to transmit a device control signal to the recording room server 200 to control various devices provided in the recording room.

Device control signals of an embodiment are light, speaker and camera control signals (camera parameters) generated by the shooting concept control unit 161, lighting control signals generated by the sharing service provider 162, and generated by the video synthesis unit 163. may include camera parameters.

The controller 160 may control the communication unit 110 to transmit a picture taken by the camera 210 to the user terminal 300 .

The controller 160 may receive data related to the shooting concept mapping table from an operator through the input unit 120 .

3 is a diagram illustrating a configuration of a shooting concept control unit 161 according to an exemplary embodiment.

Referring to FIG. 3 , a shooting concept controller 161 according to an embodiment may include a concept mapping table generator 171 , a concept mapping table DB 172 , and a device control signal generator 173 .

The concept mapping table generation unit 171 may receive data from an operator, generate a shooting concept mapping table 174 , and store the generated concept mapping table 174 in the concept mapping DB 172 . The device control signal generation unit 173 may generate a device control signal for a shooting concept selected by the user using the concept mapping table 174 .

4 is a diagram showing an example of a concept mapping table 174 according to an embodiment.

Referring to FIG. 4 , the concept mapping table 174 according to an embodiment has a data structure including a shooting concept name, a shooting concept image, music, a background image, light color and illuminance information of a lighting device provided in a shooting room, and camera parameters. am.

The shooting concept control unit 161 transmits the generated concept mapping table 174 to the shooting room server 200, and the shooting room server 200 may output and select a shooting concept selectable by a user.

The shooting concept controller 161 may receive a shooting concept selected by the user from the shooting room server 200 .

The shooting concept control unit 161 may use the concept mapping table 174 to generate device control signals for the shooting concept selected by the user.

The shooting concept control unit 161 uses the concept mapping table 174 to use the concept mapping table 174 to include music corresponding to the shooting concept selected by the user, a background image, light color and illuminance information of lighting devices provided in the shooting room, and camera parameters. data can be extracted.

The shooting concept controller 161 may generate control signals for the lighting 230 , the speaker 220 , and the camera 210 using the extracted concept data. As described above, the control signal of the camera here is the same signal as the camera parameter described above.

For example, when the user selects the shooting concept of 'Concept A', the shooting concept control unit 161 determines the music, background image, and lighting devices provided in the shooting room corresponding to 'Concept A' in the concept mapping table 174. A device control signal including light color and illuminance information and camera parameters may be generated.

5 is a flowchart of a shooting concept control method according to an exemplary embodiment.

Referring to FIG. 5 , the method for controlling a shooting concept according to an exemplary embodiment may include receiving a shooting concept ( S100 ), extracting concept data ( S110 ), and generating a device control signal ( S120 ).

The shooting concept control method may be performed by the shooting concept control unit 161 .

First, in the shooting concept receiving step ( S100 ), the shooting concept control unit 161 may receive a shooting concept selected by the user from the shooting room server 200 .

Then, in the concept data extraction step (S110), the shooting concept control unit 161 uses the concept mapping table 174 to provide music, background images, and light of lighting devices provided in the shooting room corresponding to the shooting concept selected by the user. Concept data including color and illuminance information and camera parameters can be extracted.

In the device control signal generation step (S120), the shooting concept controller 161 may generate control signals for the lighting 230, the speaker 220, and the camera 210 using the extracted concept data.

Accordingly, the shooting concept controller 161 may control the lighting, music, and camera of the shooting room according to the shooting concept selected by the user, thereby providing an environment in which the user may take a photo according to a desired concept.

6 is a diagram showing the configuration of a recording room server according to an embodiment.

Referring to FIG. 6 , the shooting room server 200 according to an embodiment includes a kiosk communication unit 201, a kiosk input unit 202, a kiosk output unit 203, a kiosk memory 204, a kiosk power supply unit 205, It may include a kiosk control unit 206 and a camera 210 .

The configurations shown in FIG. 6 are exemplary diagrams for implementing the embodiments of the present invention, and appropriate hardware/software configurations that are obvious to those skilled in the art may be additionally included in the photography room kiosk 600 .

The kiosk communication unit 201 may communicate with external devices through various communication methods. For example, the kiosk communication unit 201 may transmit and receive various data by performing communication with the operation server 100 and the user terminal 300 .

The kiosk input unit 202 may receive various user inputs and transfer them to the kiosk control unit 206 . In particular, the kiosk input unit 202 may include a touch sensor, a (digital) pen sensor, a pressure sensor, a key, and a microphone. The touch sensor may use, for example, at least one of a capacitive type, a pressure-sensitive type, an infrared type, or an ultrasonic type. The microphone is configured to receive user voice and may be provided inside the recording room kiosk 600, but this is only one embodiment, and is provided outside the recording room kiosk 600 and can be electrically connected.

The kiosk output unit 203 may provide various screens. For example, the kiosk output unit 203 may output an image of the camera 210, a captured photo, a shooting concept, a photo frame, payment information, advertisements, and the like to the user.

The kiosk memory 204 may store commands or data related to at least one other component of the imaging room kiosk 600 . In particular, the kiosk memory 204 may be implemented as a non-volatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). The kiosk memory 204 is accessed by the kiosk control unit 206, and reading/writing/modifying/deleting/updating of data by the kiosk control unit 206 can be performed. In addition, the kiosk memory 204 may store programs and data for configuring various screens to be displayed on the display area of the kiosk output unit 203 .

The kiosk power supply unit 205 receives external power and internal power under the control of the kiosk controller 206 and supplies power required for operation of each component.

The kiosk control unit 206 is electrically connected to the kiosk communication unit 201, the kiosk input unit 202, the kiosk output unit 203, the kiosk memory 204, the kiosk power supply unit 205, the kiosk control unit 206, and the camera 210. Connected to, it is possible to control the overall operation and function of the shooting room kiosk 600. In particular, the kiosk controller 206 may provide functions described below using various modules stored in the kiosk memory 204 .

Meanwhile, components of the above-described photographing room server 200 may be integrally configured as a part (ie, as part of hardware) of the photographing room kiosk 600 to be described later. That is, the photographing room kiosk 600 to be described below may be interpreted as a configuration capable of including all components of the photographing room server 200 and performing all operations of the photographing room server 200 .

FIG. 7 is a view showing a recording room kiosk 600 according to an embodiment.

Referring to FIG. 7 , a shooting room kiosk 600 according to an embodiment includes displays 620 and 630 performing functions of a kiosk input unit 602 and a kiosk output unit 603 and at least two cameras 210-1, 601-2) can be composed of a housing.

The displays 620 and 630 display and output information processed in the shooting room kiosk 600 . For example, when the photography room kiosk 600 is in a photographing mode, a user interface (UI) or graphic user interface (GUI) related to photographing may be displayed. In addition, when the shooting room kiosk 600 is in a photo output mode or a payment mode, a UI or GUI related to a captured photo or/and a photo frame may be displayed. The displays 620 and 630 may be configured as touch screens by forming a mutually layered structure of touch pads, and the displays 620 and 630 may be used as input devices as well as output devices. The displays 620 and 630 include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a 3D display. (3D display) may include at least one. In addition, depending on the implementation form of the shooting room kiosk 600, two or more displays 620 and 630 may exist.

At least two cameras 210-1 and 210-2 in the shooting room kiosk 600 may be provided on both upper and lower sides of the displays 620 and 630, and the first camera 210-1 is a full-body camera, The second camera 210-2 may be used as a half-body camera, or vice versa. In another embodiment, the at least two cameras 210-1 and 210-2 may be disposed left and right instead of up and down. The at least two cameras 210-1 and 210-2 may be cameras of the same type having the same specifications (eg, pixels), but the first camera 210-1 and the second camera 210-2 have different specifications. can be implemented as a camera of The shooting room kiosk 600 may support functions related to dual cameras (eg, 3D shooting, auto focus, etc.) through the two cameras 210-1 and 210-2. One of the at least two cameras may perform high-speed photography and the other may perform time-lapse photography.

As shown in the drawing, the photographing room kiosk 600 may include a card input port configured to allow a user to insert a card for payment and a photo output port configured to output an output photo.

The photo shoot room kiosk 600 may provide an interface through which photo concept data may be input to the user. A user may input photo concept data into the photo shoot room kiosk 600 through an interface, and the photo shoot room kiosk 600 may store and transmit the input photo concept data to the operating server 100 .

As described above, photo concept data according to an embodiment may include a concept mapping table, photo frame information, and creator information. The user may generate photo concept data through the photo room kiosk 600 or the user terminal 300, and the photo room kiosk 600 or the user terminal 300 transfers the created photo concept data to the operating server 100. can be sent to To this end, the photography room kiosk 600 or the user terminal 300 may provide the user with an interface capable of generating photo concept data.

8 is a diagram illustrating an example of photo concept data 175 according to an exemplary embodiment.

Referring to FIG. 8 , photo concept data 175 according to an embodiment is concept mapping including a photo concept name, a photo concept image, music, a background image, light color and illuminance information of a lighting device provided in a photo studio, and camera parameters. It is a data structure including a table 174, photo frame information 176, and creator information 177.

The photo frame information according to an embodiment may include design information of the photo frame. The photographing room kiosk 600 may output a photo frame according to the design information of the photo frame selected by the user. The photography room kiosk 600 may transmit photo concept data 175 input from the user to the operation server 100 .

The creator information 177 according to an embodiment may include identification information of a user who created the photo concept data and the number of uses of the photo concept data.

The photo concept data 175 may be generated in the photocopying room kiosk 600 or transmitted from the user terminal 300 based on a user's input received through the photocopying room kiosk 600 .

The photo shoot room kiosk 600 may store photo concept data 175, display photo concepts and photo frames selectable to the user, and receive a selection input accordingly.

The shooting concept control unit 161 of the operation server 100 may receive photo concept data 175 from the shooting room kiosk 600 .

The photographing concept controller 161 may use the photographic concept data 175 to generate a device control signal for a photographic concept selected by the user. The device control signal may be transmitted to the recording room server 200 (or the recording room kiosk 600) and used as a reference signal for controlling the device.

The photographing concept control unit 161 uses the photographic concept data 175 to include music corresponding to the photographic concept selected by the user, background image, light color and illuminance information of lighting devices provided in the photographing room, and camera parameters. data can be extracted.

The shooting concept controller 161 may generate control signals for the lighting 230 , the speaker 220 , and the camera 210 using the extracted concept data. As described above, the control signal of the camera here is the same signal as the camera parameter described above.

The photo room kiosk 600 may output a photo taken by using photo frame information 176 corresponding to a photo concept selected by the user.

9 is a flowchart illustrating a process of extracting a filter effect from a source image to which a filter effect desired by a user is applied and applying the extracted filter effect to an image obtained through the operation server 100.

In one embodiment, the user terminal 300 may apply a filter effect stored in the user terminal 300 to the image acquired through the operating server 100 . In addition, the user terminal 300 extracts a filter effect from an image to which a filter effect has been pre-applied among images stored in an album of the user terminal 300, and applies the extracted filter effect to the image obtained through the operation server 100. can be applied In another embodiment, filter effects stored in the user terminal 300 and/or filter effects extracted from the user terminal 300 are provided to the operating server 100 to provide images and videos captured in the shooting room kiosk 600. can be applied to Hereinafter, extracting the filter effect through S910 to S940 will be described.

The user terminal 300 may obtain an input for selecting a source image from the user (S910). The source image may be an image taken by a camera of the user terminal 300 or an image obtained from an external server. The source image may be an image to which a filter effect is applied. For example, the source image may be an image to which at least one filter effect among a filter giving a black and white effect, a filter giving a faded feeling, a filter giving a pastel color, and a filter emphasizing an outline is applied. The filter may include various filters in addition to the filters presented above. The source image may be an image from which a filter effect is to be extracted.

In one embodiment, the user terminal 300 may determine the original image from the source image (S920). In detail, the user terminal 300 may estimate an original image to which no filter effect is applied from a source image to which a filter effect is applied. The user terminal 300 may estimate an original image based on average characteristics of objects in the source image.

The user terminal 300 may recognize objects included in the source image and estimate the original image by estimating an average color of the recognized object. In other words, the user terminal 300 may estimate the original image based on color values of pixels corresponding to the recognized objects without considering an area other than the recognized objects in the source image. For example, the user terminal 300 may recognize an object (eg, grass or sea) included in the source image, and may recognize that the grass or sea has a gray color by applying a black and white filter to the source image. there is. If a black and white filter is applied to the source image so that the grass or sea has a gray color, the grass may have a green color on average and the sea may have a blue color on average, so in the original image, the grass is green and the sea is green. may have a blue color. That is, the user terminal 300 compares the color (eg, gray) of the object (eg, sea) included in the source image with a reference color (eg, blue) predefined for the object (eg, sea), The original image can be estimated.

On the other hand, it is common for filter effects to be applied to the entire image, but there may be cases in which filter effects are limitedly applied to specific objects (eg, a main person or object) or different filter effects are applied to each object in the image. .

In consideration of this case, the user terminal 300 according to an embodiment may assign different weights to objects recognized in the source image according to the area occupied by the object in the source image in order to increase accuracy when estimating the original image. there is. For example, the user terminal 300 may assign a higher estimation weight for estimating a filter effect from a corresponding object as the area occupied by the object in the source image increases.

The estimation method may be performed by applying machine learning, big data technology, and AI (artificial intelligence), and the data learned through the estimation is memory by at least one of machine learning, big data technology, and artificial intelligence (AI). can be stored in

In one embodiment, the user terminal 300 may compare the source image and the original image to extract a filter effect applied to the source image (S930). The user terminal 300 may determine a first object having the largest area in the source image among objects recognized in the source image. The user terminal 300 may extract a filter effect by comparing color values of pixels corresponding to the first object in the source image with color values of pixels corresponding to the first object in the estimated original image. Each of the pixels corresponding to the first object may include color components of R (red), G (green), and B (blue), and the user terminal 300 determines the R of each of the pixels corresponding to the first object. , the change values of G and B can be calculated. The user terminal 300 calculates the average of the R change values, the average of the G change values, and the average of the B change values in the region corresponding to the first object, and calculates the average of the calculated R change values, the average of the G change values, A color value corresponding to the average of B change values may be extracted.

The user terminal 300 may store the extracted color value as a filter effect and apply the stored filter effect to an image obtained from the operation server 100 .

FIG. 10 is a diagram for explaining an example of using an image captured by at least one user as a background image when two or more users cannot photograph together in one photographing room kiosk due to inconsistent time or distance from each other. .

The shooting room kiosk 600 takes a first image according to a first user's input, and the operation server 100 acquires the first image taken according to the first user's payment from the shooting room kiosk 600, The obtained first image may be provided to the first user terminal 300-1.

The operation server 100 may provide a sharing service for the first image, and may charge a sharing cost to the first user terminal 300-1 according to a period of the sharing service. The sharing service may include a temporary storage service. The first user terminal 300-1 may determine the first image as a shared image and set access information for the shared image to the determined shared image. Access information may include an access password, a range of accessible acquaintances, and the like. The first user terminal 300 - 1 may provide the operating server 100 with a shared image in which access information is set to the operating server 100 .

The operation server 100 may set a certain period from the date the first image was captured as a sharing period for the shared image. The operation server 100 may delete the shared image after the sharing period has elapsed.

The second user terminal 300-2 may be authorized to authenticate access to the shared image by communicating with the operation server 100 based on the access information set for the shared image within the sharing period. In this case, the second user terminal 300 - 2 may provide the operating server 100 with a unique identification symbol of the photo shoot room kiosk 600 , which wants to receive a shared image.

The operation server 100, after permitting the access authentication of the second user terminal 300-2, takes pictures corresponding to the unique identification symbol of the photography room kiosk 600 provided from the second user terminal 300-2. A shared image may be provided to the room kiosk 600 as a background image.

The photographing room kiosk 600 may generate a second image by taking a picture according to an input of a second user who is a user of the second user terminal 300 - 2 using the provided shared image as a background image.

The shooting room kiosk 600 may provide the captured second image to the operating server 100, and the operating server 100 may provide the second image to the second user terminal 300-2.

On the other hand, the operation server 100, after permitting the access authentication of the second user terminal 300-2, corresponds to the unique identification symbol of the photo shoot room kiosk 600 provided from the second user terminal 300-2. An object (eg, a first user) extracted from a shared image may be provided to the photo room kiosk 600 .

In this case, various known object recognition (or extraction) algorithms may be applied to extract the object. For example, convolutional neural network (CNN)-based object recognition algorithms may be applied.

The shooting room kiosk 600 may display the provided object to the second user along with pre-stored background images, and the second user, who is the user of the second user terminal 300-2, may use the pre-stored background images. When a desired background image is selected and a location of an object is selected in the selected background image, a background image including an object at the location of the selected object may be displayed to the second user through the photo room kiosk 600 . Thereafter, the second user may generate a second image by taking a picture using the photographing room kiosk 600 while viewing the displayed screen.

The shooting room kiosk 600 may provide the captured second image to the operating server 100, and the operating server 100 may provide the second image to the second user terminal 300-2.

After the sharing period has elapsed, the operation server 100 may provide the first user terminal 300-1 with a message asking whether to delete the first image and extend the sharing. When the operation server 100 obtains an input for extending the sharing service of the first image from the first user terminal 300-1, it may charge an additional cost to the first user terminal 300-1.

FIG. 11 is a diagram for explaining an example of using an image captured by at least one user as a background image when two or more users cannot be photographed together in one photographing room kiosk due to inconsistent timing or distance from each other.

The shooting room kiosk 600 may capture a first image according to a first user's input. The operation server 100 may provide a sharing service for the captured image, and may charge a sharing cost to the first user terminal 300-1 according to a period of the sharing service. The sharing service may include a temporary storage service. The operating server 100 may approve the payment of the first user through the shooting room kiosk 600, and temporarily store the first image captured according to the approval in the operating server 100 and the shooting room kiosk 600. can

In one embodiment, the operating server 100 may set access information for the first image to the stored first image. The operating server 100 may provide the first image as a background image to the shooting room kiosk 600 when permission for access to the access information is confirmed within the period of the sharing service.

Therefore, in the case of the present invention, when there is a situation where it is difficult for the first user and the second user to visit at the same time and take a picture together, the first user comes first and takes a picture through the recording room kiosk 600, where the picture is taken. Access information for the first image may be set and provided to the operation server 100, and the second user may use the first image based on the access information as a background image through the operation server 100. The shooting room kiosk 600 ), it is possible to take a picture with the first image as a background.

12 is a diagram illustrating remotely taking pictures together by a first user and a second user by interlocking a first and second recording room kiosks.

In an embodiment, a first user may take pictures through the first recording room kiosk 600-1, and a second user may take pictures through the second recording room kiosk 600-2. The first user terminal 300-1 may interwork with the first recording room kiosk 600-1, and the second user terminal 300-2 may interwork with the second recording room kiosk 600-2. there is.

The first user terminal 300-1 may request a remote execution mode with the second user terminal 300-2 from the operation server 100 as a host. In response to the request for the remote execution mode, the operation server 100 displays a first image (a kind of video) obtained through a camera of the first shooting room kiosk 600-1 and a second shooting room kiosk 600-2. A second image (a kind of video) obtained through the camera of may be obtained. The operating server 100 generates a third image based on the first image and the second image, and displays the generated third image on the display of the first shooting room kiosk 600-1 and the second shooting room kiosk 600-1. It can be displayed through the display of 2).

The first shooting room kiosk 600 - 1 may transmit the first image acquired in real time through the camera of the first shooting room kiosk 600 - 1 to the operation server 100 . The second shooting room kiosk 600 - 2 may transmit the second image acquired in real time through the camera of the second shooting room kiosk 600 - 2 to the operation server 100 . An image being acquired in real-time may include a plurality of image frames.

The operation server 100 may detect a second user from a second image obtained from the second shooting room kiosk 600-2. The operating server 100 may synthesize a pixel region corresponding to the second user to a plurality of image frames of the first image, and generate a third image based on the synthesis. In the process of generating the third image, the operating server 100, when the pixel area corresponding to the first user and the pixel area corresponding to the second user overlap, the first user's depth value of the overlapping portion and the second By comparing the user's depth value, the user's pixel region having a high depth value may be deleted, and the user's pixel region having a low depth value may be maintained. To this end, the shooting room kiosk 600 may further include a depth camera that obtains a depth value corresponding to each pixel of the captured image.

The operation server 100 may provide the generated third image to the first shooting room kiosk 600-1 and the second shooting room kiosk 600-2. The operation server 100 may display the third image to the first user and the second user through the first shooting room kiosk 600-1 and the second shooting room kiosk 600-2.

The operation server 100 obtains a photographing input of a first user, a host, through the first photographing room kiosk 600-1, and in response to the obtained photographing input, among a plurality of image frames constituting a third image. , An image frame of a third image corresponding to a point in time when a photographing input is acquired through the camera of the first photographic room kiosk 600-1 and the camera of the second photographic room kiosk 600-2 may be obtained.

At this time, the operation server 100 may further include a microphone in the shooting room kiosk 600 so that the first user and the second user at a distance can smoothly shoot, and the first shooting room kiosk 600-1 and the audio system (which may be composed of a speaker 220 and a microphone) of the second recording room kiosk 600-2 may be connected.

13 is a diagram for explaining configuring a photo frame based on a video obtained through the operation server 100. Referring to FIG.

In one embodiment, the recording room kiosk 600 may take a video as well as a picture through the camera 610 . The operating server 100 may obtain a photo and/or video taken through the recording room kiosk 600 and provide the obtained photo and/or video to the user terminal 300 .

The user terminal 300 may display a plurality of videos (eg, video 1, video 2, ...) obtained from the operation server 100 on a portion of the display. The user terminal 300 may determine one of a plurality of image frames constituting the video as a representative picture and display a video 1301 displaying the representative picture on the display. For example, the user terminal 300 may determine a photo corresponding to a first image frame constituting the obtained video as a representative picture, and display a video displaying the determined representative picture on a display.

In one embodiment, the user terminal 300 may create a photo frame based on a video selected by the user. The user terminal 300 may provide the user with an option to determine the shape of the photo frame, the number of photos constituting the photo frame, and/or the photos constituting the photo frame. For example, the user terminal 300 may provide the user with options for selecting various shapes such as a grid shape (1x3 shape, 1x4 shape, 2x2 shape, 4x1 shape, etc.) of a photo frame. The user terminal 300 may determine the number of photos, the shape of the photo frame, or the photos constituting the photo frame according to the user's input. In addition, the user terminal 300 may obtain the design of the photo frame generated by the creator terminal 400 through the operation server 100 and provide an option to select the design of the photo frame.

In an embodiment, the user terminal 300 may determine the shape of the photo frame, the number of photos constituting the photo frame, and the photos constituting the photo frame, based on the user's drag input on the video selected by the user. . A detailed description thereof will be described below with reference to FIGS. 14 and 15.

14 is a diagram for explaining the construction of a photo frame based on an acquired video.

The user terminal 300 may generate a photo frame 1420 based on the one video in response to an input for selecting one video (eg, video1 1) of FIG. 13 . The user terminal 300 may provide an interface 1410 capable of adjusting the configuration of the created photo frame 1420 through one area of the display. The photo frame 1420 generated in response to the input for selecting the one video may initially consist of one picture.

The user terminal 300 may change the configuration of the photo frame 1420 according to the user's drag input and/or touch input acquired within the interface. For example, the user terminal 300 may determine the shape of a photo frame, the type and number of photos constituting the photo frame, and the like according to a drag input.

FIG. 15 is a diagram for explaining the composition of photo frames in various forms based on a user's drag input with respect to an acquired video.

The user terminal 300 may adjust the size of the photo frame according to a drag input. The user terminal 300 may obtain a user's input of touching and dragging a corner portion of the photo frame.

The user terminal 300 may determine the size of the photo frame when the user's drag input for resizing the photo frame is not obtained for the first time. For example, when the user terminal 300 adjusts the size of the photo frame in real time in response to the user's drag input and the user's drag input is not obtained during the first time, the time point at which the user's drag input is not obtained The size can be determined by the size of the photo frame.

The user terminal 300 may determine the size and shape of the photo frame and the number of photos constituting the photo frame according to the drag input. The user terminal 300 may determine the number of photos included in the photo frame based on the size of the photo frame that changes according to the drag input. For example, when the size of the photo frame is a first size, the user terminal 300 determines the number of photos constituting the photo frame as one, and when the size of the photo frame is a second size larger than the first size, the photo The number of photos constituting the frame may be determined to be one or more.

For example, the user terminal 300 may enlarge the photo frame in a first direction (eg, horizontal direction) according to a user's drag input 1521 dragging the photo frame in a first direction (eg, horizontal direction). there is. The user terminal 300 may configure a photo frame as a grid composed of 1 x A photos according to a drag input of a user dragging in a first direction (eg, a horizontal direction).

For another example, the user terminal 300 may enlarge the photo frame in a second direction (eg, a vertical direction) according to the user's drag input 1522 dragging in a second direction (eg, a vertical direction). The user terminal 300 may configure a photo frame as a grid composed of A x 1 photos according to the drag input of the user dragging in the second direction (eg, the vertical direction).

For another example, the user terminal 300 may enlarge the photo frame in a third direction (eg, a diagonal direction) according to the user's drag input 1523 dragging in a third direction (eg, a diagonal direction). The user terminal 300 may configure a photo frame as a grid composed of A x B photos according to a drag input of a user dragging in a third direction (eg, a diagonal direction). A can be the same as B.

The user terminal 300 may determine the number of photos included in the photo frame as well as the photos constituting the photo frame based on the size of the photo frame that changes according to the drag input. The user terminal 300 may change photos constituting the photo frame in real time according to the drag input. In other words, the user terminal 300 may determine at least one image frame among image frames constituting the selected video as a photo constituting the photo frame, according to the determined number of photos.

In an embodiment, the user terminal 300 may determine a plurality of image frames selected at regular time intervals among image frames constituting the selected video as photos constituting the photo frame. For example, in a video of 10 seconds, the user terminal 300 determines a first image frame corresponding to 2 seconds as a first picture, a second image frame corresponding to 4 seconds as a second picture, and a 6 second picture. A corresponding third image frame may be determined as a third photo. The predetermined time interval may be determined according to the number of photos constituting the photo frame. In other words, the user terminal 300 may narrow the predetermined time interval as the number of photos constituting the photo frame increases, and may widen the predetermined time interval as the number of photos constituting the photo frame decreases.

When recording a video, there is a process in which the user holds a pose for a specific time by pressing the recording button, and there is a process in which the user releases the pause for a specific period of time before pressing the recording end button. Therefore, in order not to determine an image frame including an unnecessary pose as a picture constituting a photo frame, the user terminal 300 excludes a preset time interval at each of the first and last views of the selected video, and consists of the remaining times. Photos to compose a photo frame may be determined within the length of the actual video.

In one embodiment, the user terminal 300 may change the number of photos and photos constituting the photo frame as the size of the photo frame is changed. When the determined number of photos is M, the user terminal 300 may equally divide the actual video length by (M-1).

When the user terminal 300 configures the photo frame with M photos according to the user's drag input, the first image frame of the real video corresponds to the first photo and N-1/(M-1) part of the actual video length. An image frame may be determined as the Nth picture. The maximum value of N may be equal to M. In other words, when the user terminal 300 composes four pictures according to the user's drag input, the first image frame of the real video is the first picture, and the image frame corresponding to 1/3 of the actual video length is the second picture. An image frame corresponding to 2/3 of the photo or actual video length may be determined as a third photo and an image frame corresponding to 3/3 of the actual video length may be determined as a fourth photo.

In addition, when determining photos constituting the photo frame, the user terminal 300 may determine photos constituting the photo frame based on the user's pose and/or the user's facial expression in the selected video so as not to determine similar photos. there is. For example, the user terminal 300 determines a first image frame including a user's first pose (eg, hurrah pose) in a 10-second video as a first picture, and determines a second pose (eg, thumbs up pose). A second image frame including , may be determined as a second picture, and a third image frame including a third pose (eg, a pose with fists clenched) may be determined as a third picture.

When the number of detected poses and the number of detected facial expressions is smaller than the determined number of photos, the user terminal 300 converts an image frame including the pose and/or facial expression detected first among the detected poses and/or facial expressions into a photo frame. can be determined by the remaining photographs constituting the For example, when the number of selected photos is 4 and the detected poses and/or facial expressions are 3, a fourth image frame including a first pose (eg, a hurray pose) may be determined as the fourth photo. The fourth image frame may be different from the first image frame. The first to third poses may be poses detected in chronological order.

The user terminal 300 may detect the pose and/or the user's expression based on a plurality of pose data and/or a plurality of facial expression data previously stored in the operation server 100 or the user terminal 300 . The user terminal 300 may compare the plurality of pose data and/or facial expression data stored in advance with the user's pose and/or facial expression detected in the selected video, and as a result of the comparison, detect a pose determined to be the same. .

16 is a diagram illustrating a configuration of a user terminal 300 according to an embodiment. Hereinafter, components constituting the user terminal 300 shown in FIG. 16 will be sequentially described.

The wireless communication unit 310 may include one or more components that perform wireless communication between the user terminal 300 and a wireless communication system or between the user terminal 300 and a network in which the user terminal 300 is located. . For example, the wireless communication unit 310 may include a broadcast reception module 311, a mobile communication module 312, a wireless Internet module 313, a short-distance communication module 314, a location information module 315, and the like. .

The broadcast reception module 311 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. Meanwhile, broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 312 .

In addition, the mobile communication module 312 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include a voice call signal, a video call signal, or various types of data according to text/multimedia message transmission/reception.

The wireless Internet module 313 refers to a module for wireless Internet access, and may be built into or external to the user terminal 300 .

The short-distance communication module 314 refers to a module for short-distance communication. As a short-range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, or the like may be used.

Also, the location information module 115 is a module for confirming or obtaining the location of the user terminal 300 . One example is a Global Positioning System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude.

Meanwhile, an audio/video (A/V) input unit 320 is for inputting an audio signal or a video signal, and may include a camera 321 and a microphone 322. The camera 321 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. And, the processed image frame may be displayed on the display unit 351 .

An image frame processed by the camera 321 may be stored in the memory 360 or transmitted to the outside through the wireless communication unit 310 . Two or more cameras 321 may be provided according to configuration aspects of the user terminal 300 .

The microphone 322 receives an external sound signal through a microphone in a call mode, a recording mode, or a voice recognition mode, and processes it into electrical voice data. In addition, the processed voice data may be converted into a form transmittable to a mobile communication base station through the mobile communication module 312 and output in the case of a call mode. The microphone 322 may implement various noise cancellation algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 330 receives an input operation from the user and generates input data for controlling the operation of the user terminal 300 .

The sensing unit 340 detects the current state of the user terminal 300, such as the location of the user terminal 300, presence or absence of contact with the user, direction of the user terminal 300, acceleration/deceleration of the user terminal 300, etc. A sensing signal for controlling the operation of the terminal 300 is generated.

The interface unit 370 serves as an interface with all external devices connected to the user terminal 300 . For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I/O (Input/Output) port, A video I/O (Input/Output) port, an earphone port, and the like may be included.

The output unit 350 is for outputting an audio signal, video signal, or alarm signal, and may include a display unit 351, a sound output module 352, an alarm unit 353, and the like.

The display unit 351 displays and outputs information processed by the user terminal 300 . For example, when the terminal is in a call mode, a UI (User Interface) or GUI (Graphic User Interface) related to a call is displayed. And, when the user terminal 300 is in the video call mode or the shooting mode, it displays the captured or/and received video, UI, or GUI.

Meanwhile, as described above, when the display unit 351 and the touch pad form a mutual layer structure to form a touch screen, the display unit 351 may be used as an input device as well as an output device. The display unit 351 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display ( 3D display) may include at least one. Also, depending on the implementation form of the user terminal 300, two or more display units 351 may exist. For example, the user terminal 300 may include an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 352 outputs audio data received from the wireless communication unit 310 or stored in the memory 360 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 352 outputs sound signals related to functions performed by the user terminal 300 (eg, call signal reception sound, message reception sound, etc.). The sound output module 352 may include a speaker, a buzzer, and the like.

The alarm unit 353 outputs a signal for notifying the occurrence of an event in the user terminal 300 . Examples of events generated in the terminal include call signal reception, message reception, key signal input, and the like.

The memory 360 may store programs for processing and control of the controller 380, and provides a function for temporarily storing input/output data (eg, phonebook, message, still image, video, etc.). can also be done

The memory 360 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) magnetic memory, magnetic disk, It may include at least one type of storage medium among optical disks.

The control unit 380 typically controls overall operations of the terminal. For example, it performs related control and processing for voice calls, data communications, video calls, and the like. Also, the controller 380 may include a multimedia module 181 for playing multimedia. The multimedia module 381 may be implemented within the control unit 380 or may be implemented separately from the control unit 380.

The controller 380 controls various operations of the terminal to implement the photo studio operating method described above.

The power supply unit 290 receives external power and internal power under the control of the controller 280 and supplies power required for operation of each component.

On the other hand, at least some or all of the operations of the operation server 100 described above may be implemented in the user terminal 300 . At this time, the user terminal 300 may be pre-installed with an application for communicating with the operation server 100 to perform the operation of the operation server 100 described above.

17 is a diagram illustrating a wireless communication system that can be applied in a communication process according to an embodiment of the present invention. 18 is a diagram illustrating a base station in the wireless communication system according to FIG. 17; 19 is a diagram illustrating a terminal in the wireless communication system according to FIG. 17 . 20 is a diagram illustrating a communication interface in the wireless communication system according to FIG. 17;

Hereinafter, an example of a wireless communication network system supporting communication between various servers and terminals will be specifically described as an example. In the following description, a first node (device) may be an anchor/donor node or a centralized unit (CU) of an anchor/donor node, and a second node (device) may be an anchor/donor node or a distributed unit (DU) of a relay node can be

A base station (BS), terminal, server, etc. may be included as a part of a node using a radio channel in a wireless communication system.

A base station is a terminal and a network infrastructure that provides wireless access to terminals. A base station has a coverage defined as a predetermined geographic area according to a distance over which a signal can be transmitted.

A base station, like a "base station," is referred to as "access point (AP)", "enodeb (eNB)", "5th generation (5G) node", "wireless point", " It may be referred to as a transmission/reception point (TRP).

The base station, the terminal, and the terminal may transmit and receive wireless signals in a millimeter wave (mmWave) band (eg, 28 GHz, 30 GHz, 38 GHz, and 60 GHz). At this time, the base station, the terminal, and the terminal may perform beamforming to improve the channel gain. Beamforming may include transmit beamforming and receive beamforming. That is, the base station, the terminal, and the terminal can give directivity to the transmitted signal and the received signal. To this end, the base station, the terminal, and the terminal may select a serving beam through a beam search procedure or a beam management procedure. After that, communication may be performed using a resource carrying a serving beam and a resource having a quasi co-located relationship.

A first antenna port and a second antenna port are considered quasi-colocated if the large-scale properties of the channel through which the symbol of the first antenna port carries can be inferred from the channel through which the symbol of the second antenna port carries. The large-scale properties may include one or more of delay spread, Doppler spread, Doppler shift, average gain, average delay, and spatial Rx parameters.

Hereinafter, a base station in the wireless communication system described above is exemplified. The terms "-module", "-unit" or "-er" used below may mean a unit that processes at least one function or operation, and may include hardware, software, or both hardware and software. It can be implemented as a combination of

The base station may include a wireless communication interface, a backhaul communication interface, a storage unit and a controller.

The wireless communication interface performs a function of transmitting and receiving signals through a wireless channel. For example, the wireless communication interface may perform a conversion function between a baseband signal and a bit stream according to a physical layer standard of a system. For example, in data transmission, a radio communication interface compresses and modulates a transmitted bit stream to produce composite symbols. Also, upon receiving data, the wireless communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream.

The wireless communication interface performs a function of transmitting and receiving signals through a wireless channel. For example, the wireless communication interface may perform a conversion function between a baseband signal and a bit stream according to a system physical layer standard. For example, in data transmission, a radio communication interface compresses and modulates a transmitted bit stream to produce composite symbols. Also, upon receiving data, the wireless communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream.

In addition, the wireless communication interface up-converts a baseband signal into a radio frequency (RF) band signal, transmits the converted signal through an antenna, and down-converts the RF band signal received through the antenna into a baseband signal. To this end, the wireless communication interface includes a transmission filter, a reception filter, an amplifier, a mixer, an oscillator, a digital-to-analog converter (DAC), An analog-to-digital converter (ADC) and the like may be included. Also, the wireless communication interface may include a plurality of transmit/receive paths. Additionally, the wireless communication interface may include at least one antenna array comprising a plurality of antenna elements.

In terms of hardware, the wireless communication interface may include a digital unit and an analog unit, and the analog unit may include a plurality of sub-units according to operating power, operating frequency, and the like. A digital unit may be implemented with at least one processor (eg, a digital signal processor (DSP)).

The wireless communication interface transmits and receives signals as described above. Accordingly, a wireless communication interface may be referred to as a “transmitter”, “receiver” or “transceiver”. In addition, in the following description, transmission and reception performed through a wireless channel may be used as a meaning including processing performed in a wireless communication interface as described above.

The backhaul communication interface provides an interface for communicating with other nodes in the network. That is, the backhaul communication interface converts the bit stream transmitted to other nodes, for example, other access nodes, other base stations, upper nodes or core networks from base stations into physical signals, and the physical signals received from other nodes into bits. convert to stream

The storage unit stores data such as basic programs, applications, and setting information for operation of the base station. The storage unit may include volatile memory, non-volatile memory, or a combination of volatile and non-volatile memory.

The controller controls the overall operation of the base station. For example, the controller transmits and receives signals through a wireless communication interface or a backhaul communication interface. Also, the controller writes data to the storage unit and reads the recorded data. The controller can perform protocol stack functions required by communication standards. According to another implementation, a protocol stack may be included in a wireless communication interface. To this end, the controller may include at least one processor.

According to an embodiment, the controller may control the base station to perform an operation according to an embodiment of the present invention.

According to various embodiments, a donor node of a wireless communication system includes at least one processor, includes a transceiver operably coupled to the at least one processor, and includes a plurality of radio bearers for a terminal accessing the relay node. configured to transmit to a relay node a first message including first information related to the donor node about; receive a second message including second information related to the relay node regarding a plurality of radio bearers for the terminal from the relay node; Data for the terminal may be transmitted to the relay node. Data may be transmitted to the terminal through a plurality of radio bearers based on the first information and the second information.

According to various embodiments, a radio bearer among a plurality of radio bearers may integrate a plurality of radio bearers. the at least one processor is also configured to determine a radio bearer for a terminal accessing the relay node and multiple radio bearers aggregated by the radio bearer; Alternatively, a radio bearer for a UE accessing a relay node may be determined.

According to various embodiments, the first message may include one or more of: identification of a terminal accessing the relay node; display information indicating the type of terminal accessing the relay node; information about a radio bearer of a terminal accessing a relay node; information about a radio bearer transmitted by a terminal accessing a relay node; information about a tunnel established for a radio bearer between the donor node and the relay node; information about integrated multiple radio bearers; radio bearer mapping information; information about the address of the side of the donor node; information about the address of the relay node side; indication information corresponding to a radio bearer of a terminal accessing the relay node; indication information indicating the relay node to allocate a new address to a radio bearer for a terminal accessing the relay node; a list of address information that cannot be used by a relay node that transmits radio bearer data of a terminal accessing the relay node; and information related to security configuration.

According to various embodiments, the second message may include one or more of: identification of a terminal accessing the relay node; information about the radio bearer granted by the relay node; information about radio bearers not acknowledged by the relay node; information about radio bearers partially granted by the relay node; radio bearer mapping information; Configuration information of a terminal accessing the relay node created by the relay node; information about the address of the relay node side; and information related to security configuration.

According to various embodiments, the second message may further include information on integrated multiple radio bearers.

According to various embodiments, the donor node may include a central unit of the donor node, and the relay node may include a distribution unit of the donor node.

According to various embodiments, a relay node of a wireless communication system includes at least one processor, includes a transceiver operably coupled to the at least one processor, and provides a plurality of information from a donor node to a terminal accessing the relay node. configured to receive a first message including first information related to a donor node for a radio bearer of; transmit to the donor node a second message including second information related to the relay node for the plurality of radio bearers for the terminal; Data on the terminal may be received from the donor node. Data may be transmitted to the terminal through a plurality of radio bearers based on the first information and the second information.

According to various embodiments, a radio bearer among a plurality of radio bearers may integrate a plurality of radio bearers. the at least one processor is also configured to determine a radio bearer for a terminal accessing the relay node and multiple radio bearers aggregated by the radio bearer; Alternatively, multiple radio bearers integrated by radio bearer may be determined.

According to various embodiments, the first message may include one or more of: identification of a terminal accessing the relay node; display information indicating the type of terminal accessing the relay node; information about a radio bearer of a terminal accessing a relay node; information about a radio bearer transmitted by a terminal accessing a relay node; information about a tunnel established for a radio bearer between the donor node and the relay node; information about integrated multiple radio bearers; radio bearer mapping information; information about the address of the side of the donor node; information about the address of the relay node side; indication information corresponding to a radio bearer of a terminal accessing the relay node; indication information indicating the relay node to allocate a new address to a radio bearer for a terminal accessing the relay node; a list of address information that cannot be used by a relay node that transmits radio bearer data of a terminal accessing the relay node; and information related to security configuration.

According to various embodiments, the second message may include one or more of: identification of a terminal accessing the relay node; information about the radio bearer granted by the relay node; information about radio bearers not acknowledged by the relay node; information about radio bearers partially granted by the relay node; radio bearer mapping information; Configuration information of a terminal accessing the relay node created by the relay node; information about the address of the relay node side; and information related to security configuration.

According to various embodiments, the second message may further include information on integrated multiple radio bearers.

According to various embodiments, the donor node may include a central unit of the donor node, and the relay node may include a distribution unit of the donor node.

Hereinafter, components of a terminal in the wireless communication system described above are illustrated. Components of a terminal to be described below are components of a general-purpose terminal supported by a wireless communication system, and may be merged or integrated with components of a terminal according to the foregoing contents, and may overlap or conflict with the above drawings. It can be interpreted that the content described with reference takes precedence. The terms "-module", "-unit" or "-er" used below may mean a unit that processes at least one function.

The terminal includes a communication interface, a storage unit and a controller.

The communication interface performs a function of transmitting and receiving signals through a wireless channel. For example, the communication interface performs a conversion function between a baseband signal and a bit stream according to the physical layer standard of the system. For example, in data transmission, a communication interface compresses and modulates a transmission bit stream to generate composite symbols. Also, when receiving data, the communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream. Further, the communication interface up-converts the baseband signal to an RF-band signal, transmits the converted signal through an antenna, and down-converts the RF-band signal received through the antenna into a baseband signal. For example, the communication interface includes a transmission filter, a reception filter, an amplifier, a mixer, an oscillator, and a digital-to-analog converter (DAC). , an analog-to-digital converter (ADC), and the like.

Also, the communication interface may include a plurality of transmit/receive paths. Additionally, the communication interface may include at least one antenna array comprising a plurality of antenna elements. On the hardware side, the wireless communication interface may include a digital circuit and an analog circuit (eg, a radio frequency integrated circuit (RFIC)). A digital circuit may be implemented with at least one processor (eg, DSP). A communication interface may include multiple RF chains. The communication interface may perform beamforming.

The communication interface transmits and receives signals as described above. Accordingly, a communication interface may be referred to as a “transmitter”, “receiver” or “transceiver”. In addition, in the following description, transmission and reception performed through a radio channel may be used as a meaning including processing performed in a communication interface as described above.

The storage unit stores data such as basic programs for operation of the terminal, applications, and setting information. The storage unit may include volatile memory, non-volatile memory, or a combination of volatile and non-volatile memory. In addition, the storage unit provides stored data according to the request of the controller.

The controller controls the overall operation of the terminal. For example, the controller sends and receives signals through a communication interface. Also, the controller writes data to the storage unit and reads the recorded data. The controller can perform protocol stack functions required by communication standards. According to another implementation, a protocol stack may be included in the communication interface. To this end, the controller may include at least one processor or microprocessor or reproduce parts of a processor. Also, a part of the communication interface or controller may be referred to as a communication processor (CP).

According to an embodiment of the present invention, a controller may control a terminal to perform an operation according to an embodiment of the present invention.

Hereinafter, a communication interface in a wireless communication system is illustrated.

The communication interface includes compression and modulation circuitry, digital beamforming circuitry, a plurality of transmission paths, and analog beamforming circuitry.

Compression and modulation circuitry performs channel compression. At least one of a low-density parity check (LDPC) code, a convolution code, and a polar code may be used for channel compression. A compression and modulation circuit generates modulation symbols by performing constellation mapping.

A digital beamforming circuit performs beamforming on a digital signal (eg, a modulation symbol). To this end, a digital beamforming circuit multiplexes modulation symbols by beamforming weights. Beamforming weights can be used to change the size and phrase of a signal, and can be referred to as a "precoding matrix" or "precoder". The digital beamforming circuit outputs digital beamformed modulation symbols to a plurality of transmission paths. In this case, according to a multiple input multiple output (MIMO) transmission method, modulation symbols may be multiplexed or the same modulation symbol may be provided to a plurality of transmission paths.

The plurality of transmission paths convert digital beamformed digital signals into analog signals. To this end, each of the plurality of transmission paths may include an inverse fast fourier transform (IFFT) computation unit, a cyclic prefix (CP) insertion unit, a DAC, and an up conversion unit. The CP insertion unit is for an orthogonal frequency division multiplexing (OFDM) method and may be omitted when another physical layer method (eg, a filter bank multi-carrier: FBMC) is applied. That is, the plurality of transmission paths provide independent signal processing processes for a plurality of streams generated through digital beamforming. However, depending on the implementation, some elements of the plurality of transmission paths may be commonly used.

An analog beamforming circuit performs beamforming on an analog signal. To this end, the digital beamforming circuit multiplexes analog signals by beamforming weighting values. The beamformed weights are used to change the amplitude and phrase of the signal. More specifically, the analog beamforming circuit may be configured in various ways according to a connection structure between a plurality of transmission paths and an antenna. For example, each of a plurality of transmission paths may be connected to one antenna array. In another example, multiple transmission paths may be coupled to one antenna array. In another example, multiple transmission paths may be adaptively coupled to one antenna array or may be coupled to two or more antenna arrays.

Steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, implemented in a software module executed by hardware, or implemented by a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any form of computer readable recording medium well known in the art to which the present invention pertains.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features of the present invention. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

100: operation server 200: shooting room server
300: user terminal 400: creator terminal

Claims (1)

A photo studio operating system that provides a user-preferred shooting environment by linking a shooting room kiosk and a user terminal,
A recording room kiosk provided in the recording room to receive an input from a user of the user terminal and display an image captured using a built-in camera to the user through a display;
an operating server that transmits device control signals for controlling lighting, music, and the camera of the recording room to the recording room kiosk, and obtains the image captured by the camera from the recording room kiosk; and
Including the user terminal for acquiring the image by communicating with the operation server,
The operating server,
a photographing concept control unit generating the device control signal based on a photographing concept selected by the user from the photographing room kiosk;
a sharing service providing unit that sets the captured image as a shared image and shares the set shared image with the user terminal or the photographing room kiosk; and
An image synthesis unit for synthesizing a first image and a second image acquired in real time through cameras of the first and second shooting room kiosks, which are different from each other,
The video synthesis unit,
In response to a request for a remote execution mode from a first user terminal, the first image and the second image are obtained, a second user is detected from the second image, and a plurality of images constituting the first image are obtained. synthesizing a pixel area corresponding to the second user to frames;
When a pixel area corresponding to the first user of the first image and a pixel area corresponding to the second user overlap, a depth value of the first user and a depth value of the second user of the overlapped portion are compared; , Deleting a user's pixel area with a high depth value, maintaining a user's pixel area with a low depth value to generate a third image, and displaying the generated third image on a display of the first shooting room kiosk; ,
The first shooting room kiosk,
Taking a video corresponding to the third image in response to obtaining a shooting input while the third image is displayed;
The first user terminal,
Obtaining the captured video through the operation server, and determining a photo constituting a photo frame based on at least one image frame among a plurality of image frames constituting the obtained video,
In response to the first user's input for selecting the video, the photo frame based on the video is generated, and an interface capable of adjusting the generated photo frame is provided through a display mounted on the first user terminal, ,
determining the shape of the photo frame, photos constituting the photo frame, and the number of photos according to the first user's drag input acquired within the interface;
When the first user's drag input for resizing the photo frame is not obtained for a first time, determining a size at a time when the drag input is not obtained as the size of the photo frame;
Configuring photos included in the photo frame to correspond to the shape and size of the photo frame determined according to the drag input;
In the video, a video from which portions corresponding to the first second time and the last third time of the video are excluded is determined as a real video;
When the determined number of photos is M, the first photo among the determined M photos is determined as the first image frame of the first section among the (M-1) equal sections of the real video, and the photos after the first photo The N-th picture is determined as the last frame of the (N-1) th section among the (M-1) equally divided sections of the real video, M is a natural number greater than or equal to 2, and N is a natural number greater than or equal to 2 and less than or equal to M. ego,
The first user terminal,
Obtaining a source image to which a filter effect is applied from an internal storage of the first user terminal;
Detect objects included in the source image,
Estimating the original image without the filter effect by estimating the average color of the detected objects;
assigning an estimated weight according to the area of the object occupied by the objects in the source image, and assigning a higher estimated weight as the area occupied by the objects in the source image increases;
Extracting the filter effect by comparing the source image with the estimated original image;
determining a first object having the largest area occupied in the source image among the objects;
R value, G value, and B value of each of the first pixels included in the area corresponding to the first object included in the source image and each of the second pixels corresponding to each of the first pixels in the original image Calculate the change value, which is the difference between the R value, G value, and B value of
In the region corresponding to the first object, an average value of change values for R values, an average value of change values for G values, and an average value of change values for B values are calculated, and an average value of the calculated change values for R values , Extracting a color value corresponding to the average value of the change values for the G value and the average value of the change values for the B value,
A photo studio operating system for storing a filter effect based on the extracted color value and applying the stored filter effect to the image obtained from the operating server.

Images