KR102390838B1 - Apparatus and method for generating a picture frame based on images taken through a shooting room kiosk - Google Patents

Abstract

According to various embodiments, a photograph studio operating system linked with a capturing room kiosk and a user terminal includes: the capturing room kiosk provided in a photograph studio to receive an input of a user and display an image captured by using a built-in camera to the user through a display; an operating server that transmits a device control signal to the capturing room kiosk and obtains the captured image obtained through the camera of the capturing room kiosk; and the user terminal operatively connected to the operating server and configured to obtain the captured image through the operating server. The operating server includes: a capturing concept control unit for receiving capturing concept data from the user terminal to control a capturing concept; a sharing service provision unit configured to set an image captured through a first capturing room kiosk as a shared image and share the set shared image with a second user terminal or a second capturing room kiosk; and an image synthesis unit for synthesizing a first image obtained in real time through a camera of the first capturing room kiosk and a second image obtained in real time through a camera of a second capturing room kiosk.

Description

Apparatus and method for generating a photo frame based on images taken through a shooting room kiosk

The present invention relates to a method and an apparatus for generating a photo frame based on images captured through a shooting room kiosk, and more particularly, to a method and an apparatus for photographing a plurality of users at the same time and at the same place without restrictions It relates to a method and an apparatus for generating a photo frame by controlling them.

In the case of an existing photo studio, a photographer directly takes a picture, and outputs the photographed picture to provide a picture frame. In other words, the production of commemorative photo albums in the past was done in a way that was completed by itself and provided to users by shooting in a photo studio.

However, due to the spread of the Internet and the development of digital technology, when a user takes a photo directly in a photo studio and requests album production, the photo studio's website or web hard drive allows the user to browse the photo file to be used in the album, and also The service has been improved so that the digital file can be downloaded. In other words, unmanned photo studios are being created according to the demand of users, and accordingly, users can conveniently visit, select a desired shooting concept, take a picture, and directly print a picture.

As described above, in recent years, research on the studio environment has been continuously conducted in order to improve the user's accessibility to shooting and to conveniently provide services to users.

According to the study of the studio environment, the demand of users is increasing, and there is a trend of taking individual photos of the users themselves, as well as taking photos with their loved ones in the shooting concept they want. However, due to the busy life of modern people or issues such as viruses, it may be difficult to meet and take pictures with loved ones in person. For example, it may be difficult to schedule a time between users, or it may be impossible to perform studio photography together due to a long distance between users.

In addition, while it is often difficult to capture a natural appearance desired by a user in photographing, since numerous image frames are obtained when photographing a video, there is a high probability that the desired image is included in the video. However, currently shooting in the studio provides only a photo shooting function and does not provide a video shooting function. Accordingly, various methods for satisfying user needs as well as simply taking photos in an unmanned photo studio to form a photo frame are required.

Matters described in this background section are prepared to promote understanding of the background of the invention, and may include matters not already known to those of ordinary skill in the art to which this technology belongs.

The following embodiments have been devised to solve the above-described problems, and even when users are not at the same time or in the same place, the shooting room kiosk is interlocked to provide the effect of shooting together, and through the shooting room kiosk An object of the present invention is to enable a picture frame to be configured through a user terminal even when a video other than a picture is acquired.

Problems to be solved by one embodiment are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

One aspect of the present invention for achieving the above object provides a photo studio operating system interlocked with a shooting room kiosk and a user terminal.

The photo studio operating system may include: a photographing room kiosk provided in a photographing room to receive an input from a user of a user terminal, and to display an image photographed using a built-in camera to the user through a display; an operation server for transmitting a device control signal for controlling lighting, music, and the camera of the recording room to the photographing room kiosk, and acquiring the image photographed through the camera from the photographing room kiosk; and the user terminal communicating with the operation server to acquire the image.

The operation server may include: a photographing concept control unit configured to generate the device control signal based on the photographing concept selected by the user from the photographing room kiosk; a sharing service providing unit that sets the photographed image as a shared image and shares the set shared image with the user terminal or the recording room kiosk; and an image synthesizing unit for synthesizing the first image and the second image acquired in real time through the respective cameras of the first and second photographing room kiosks, which are different from each other.

The user terminal configures a photo frame based on the acquired image, and determines the thickness, color, and number of photos that can be arranged in the photo frame.

The shooting room kiosk shoots a video, the user terminal acquires the captured video through an operation server, and selects the photo frame based on at least one image frame among a plurality of image frames constituting the obtained video. Decide on the photos you make up.

The image synthesizing unit generates a third image by using the first image and the second image, and displays the generated third image on the display of the first recording room kiosk and the display of the second recording room kiosk and, in a state in which the third image is displayed, acquires an image frame of the third image corresponding to a point in time at which the capturing input is obtained in response to obtaining the capturing input.

The user terminal obtains a source image to which a filter effect is applied from an internal storage, estimates an original image without the filter effect from the source image, compares the source image with the original image to extract the filter effect, The extracted filter effect is applied to the obtained image.

The user terminal determines, among the objects recognized in the source image, a first object having the largest area in the source image, and sets color values of pixels corresponding to the first object in the source image and in the original image. Compare color values of pixels corresponding to the first object, and calculate change values of R (red), G (green), and B (blue) of each of the pixels corresponding to the first object based on the comparison and extracting a color value corresponding to an average of R (red) change values, an average of G (green) change values, and an average of B (blue) change values in the region corresponding to the first object, and the extracted color A value is stored as the filter effect, and the stored filter effect is applied to the obtained image.

The user terminal, in response to a user input for selecting a video obtained through the operation server, generates a photo frame based on the video, and provides an interface that can adjust the generated photo frame through a display, A shape of the picture frame, a picture constituting the picture frame, and the number of pictures are determined according to a user's drag input obtained in the interface.

When the user's drag input for adjusting the size of the photo frame is not obtained for a first time, the user terminal determines the size of the time point at which the drag input is not obtained as the size of the photo frame, and The pictures included in the picture frame are composed of a x b so as to correspond to the shape and size of the picture frame determined according to the input.

The user terminal, except for the first second time and the last third time of the moving picture, determines the moving picture from which the second time and the third time are excluded as the real moving picture, and within the determined length of the real moving image, the A picture constituting a picture frame is determined, and when the determined number of pictures is M, the length of the real video is divided into (M-1) equal parts, and the first image frame of the real video is the first picture and the length of the actual video An image frame corresponding to an N-1/(M-1) portion of is determined as an N-th picture, and the maximum value of N is the same as M.

The user terminal detects a pose of the user in the video, determines a first image frame including the first pose as a first photo, and determines a second image frame including a second pose as a second photo, , if the third image frame including the third pose is determined as the third photo, and the number of the detected poses is smaller than the determined number of the photos, the image including the first detected pose among the detected poses The frame is determined by the rest of the photos that make up the photo frame.

The image synthesizing unit, in response to receiving a request for a remote execution mode from a first user terminal, acquires the first image and the second image, detects a second user from the second image, and generates the first image When the pixel area corresponding to the second user is synthesized in the plurality of image frames constituting the image frame, and the pixel area corresponding to the first user and the pixel area corresponding to the second user of the first image overlap, the overlapping The third image by comparing the depth value of the first user and the depth value of the second user in a portion to be used, deleting the pixel area of the user having a high depth value, and maintaining the pixel area of the user having a low depth value create

Another aspect of the present invention for achieving the above object provides a method of operating a filming room kiosk and an operation server interlocked with a user terminal.

The operation method may include: generating a device control signal from the photographing room kiosk based on a photographing concept selected by a user of the user terminal; setting an image photographed using the photographing room kiosk as a shared image according to the device control signal, and sharing the set shared image with the user terminal or the photographing room kiosk; and synthesizing the first image and the second image acquired in real time through the respective cameras of the first and second photographing room kiosks, which are different from each other.

The photographing room kiosk is provided in the photographing room to receive an input from the user of the user terminal and display the image photographed using a built-in camera to the user through a display.

The user terminal acquires the image by communicating with the operation server.

Another aspect of the present invention for achieving the above object provides a non-transitory recording medium in which a program for executing the operating method is recorded and readable by a computer.

Another aspect of the present invention for achieving the above object provides a computer program recorded in a non-transitory recording medium in order to execute the operating method in an operating server.

Another aspect of the present invention for achieving the above object provides an operation server interworking with the shooting room kiosk and user terminal.

The operation server may include: a photographing concept control unit configured to generate a device control signal based on a photographing concept selected by a user of the user terminal from the photographing room kiosk; a sharing service providing unit that sets an image photographed using the photographing room kiosk as a shared image according to the device control signal, and shares the set shared image with the user terminal or the photographing room kiosk; and an image synthesizing unit for synthesizing the first image and the second image acquired in real time through the respective cameras of the first and second photographing room kiosks, which are different from each other.

The photographing room kiosk is provided in the photographing room to receive an input from the user of the user terminal and display the image photographed using a built-in camera to the user through a display.

The user terminal acquires the image by communicating with the operation server.

According to various embodiments disclosed in this document, it is possible to configure a photo frame based on a captured video without the need to take a photo multiple times, thereby providing convenience to the user.

In addition, according to various embodiments, it is possible to provide the effect of photographing together even when it is difficult for users to photograph together because the time does not match or the distance is far.

Also, according to various embodiments, a filter effect desired by the user may be extracted from another image and applied to the captured image.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a diagram illustrating a photo studio operating system according to an exemplary embodiment.
2 is a diagram illustrating the configuration of an operation server according to an embodiment.
3 is a diagram illustrating a configuration of a photographing concept control unit according to an exemplary embodiment.
4 is a diagram illustrating an example of a concept mapping table according to an embodiment.
5 is a flowchart of a method for controlling a shooting concept according to an exemplary embodiment.
6 is a diagram illustrating the configuration of a shooting room server according to an embodiment.
7 is a view showing a photographing room kiosk according to an embodiment.
8 is a diagram illustrating an example of photo concept data according to an embodiment.
9 is a flowchart illustrating a process of extracting a filter effect from a source image to which a user's desired filter effect is applied, and applying the extracted filter effect to an image obtained through an operation server.
FIG. 10 is a diagram for explaining an example of using an image photographed by at least one user as a background image when two or more users are unable to photograph together in one recording room kiosk because the time does not match or the distance is far from each other. .
11 is a view for explaining an example of using an image photographed by at least one user as a background image when two or more users cannot take pictures together in a single shooting room kiosk because the time does not match or the distance is far from each other.
12 is a diagram illustrating that the first user and the second user take a picture together remotely by linking the first shooting room kiosk and the second shooting room kiosk.
13 is a view for explaining the configuration of a photo frame based on a video acquired through an operation server.
14 is a diagram for explaining the construction of a photo frame based on an acquired video.
15 is a diagram for explaining how to configure a picture frame in various forms based on a user's drag input with respect to an acquired video.
16 is a diagram illustrating a configuration of a user terminal 300 according to an embodiment.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a photo studio operating system 10 according to an exemplary embodiment.

Referring to FIG. 1 , the photo studio operating system 10 according to an embodiment includes an operation server 100 , a shooting room server 200 , a camera (eg, the camera 610 of FIG. 6 ) 210 , and a speaker ( 220 ), a light 230 , a sensor 240 , a display (eg, the displays 620 and 630 of FIG. 7 ) 250 , a user terminal 300 , and a creator terminal 400 .

Communication between various entities included in the photo studio operating system 10 may be performed through a wired/wireless network. A wired/wireless network may use standard communication technologies and/or protocols.

In the photo studio operating system 10, the operating server 100, the shooting room server 200, the user terminal 300, and the creator terminal 400 are, for example, a computer, an Ultra Mobile PC (UMPC), a workstation, a netbook. (net-book), PDA (Personal Digital Assistants), portable computer, web tablet, wireless phone, mobile phone, smart phone, PMP (portable) multimedia player), and may include all electronic devices capable of installing and executing an application related to an embodiment. The electronic device may perform overall service operations such as, for example, configuration of a service screen, data input, data transmission/reception, data storage, and the like, under the control of the application.

The shooting room server 200 , the camera 210 , and the display 250 in the photo studio operating system 10 may be configured as a shooting room kiosk 600 . The photographing room kiosk 600 will be described in detail below with reference to FIG. 6 .

The operation server 100 is a server that provides various functions related to operation of the photo studio.

The operation server 100 may control the lighting, music, and camera of the shooting room according to the shooting concept selected by the user.

The operation server 100 may receive the photo concept data from the user, control the lighting, music, and camera of the shooting room according to the photo concept data, and change the photo frame of the output photo.

The operation server 100 may provide an advertisement to a user by providing an advertisement to the shooting room kiosk 600 having a display. The shooting room kiosk 600 may generate advertisement response data including identification information of a user who responded to an advertisement, advertisement identification information, and a user reaction type, and transmit it to the operation server 100 .

The operation server 100 may transmit a device control signal to the photographing room server 200 to control various devices provided in the photographing room.

The operation server 100 may transmit a photo and/or a video taken by the camera 210 to the user terminal 300 , and may receive a photo concept from the user terminal 300 .

The operation server 100 may receive and store the design of the photo frame pre-fabricated from the creator terminal 400 . The operation server 100 may provide the design of the provided photo frame to the shooting room server 200 and/or the user terminal 300 . The design of the photo frame may include a color of the photo frame, a pattern of the photo frame, and the like.

A detailed configuration and function of the operation server 100 will be described in detail below with reference to FIG. 2 .

The photographing room server 200 is a server provided in the photographing room to provide users with various functions necessary for photographing. The recording room server 200 may provide a photographed picture and/or a photographed video to the operation server 100 .

The shooting room server 200 can control the camera 210, the speaker 220, the lighting 230 and the sensor 240 provided in the shooting room by using the device control signal received from the operation server 100. there is.

The photographing room server 200 may receive a sensor value from the sensor 240 and transmit the received sensor value to the operation server 100 .

The shooting room server 200 may include input means such as a touch screen, a keyboard, a mouse and a microphone, and the shooting room server 200 receives shooting setting information, device control information, and photo frame information from the user through the input means. can be input.

In an embodiment, the shooting setting information may include a shooting concept, photo size, number of shots, and the like, and the device control information may include camera parameters, illumination intensity, lighting color, shooting music, speaker volume, etc., and photo frame information may include frame design information of the output photo.

The photographing room server 200 may include output means such as a display device and a speaker, and the photographing room server 200 may output various information necessary for photographing to the user through the output means. For example, the shooting room server 200 may output a shooting concept selectable by the user and a picture taken by the user.

The shooting room server 200 may receive an advertisement from the operation server 100 and output the advertisement to the user through an output means. When the user responds to the advertisement, the shooting room server 200 may generate user reaction information and transmit it to the operation server 100 .

The photographing room server 200 may provide a payment function necessary for photographing to the user.

The shooting room server 200 may provide a photo printing function for outputting a photo taken by the user.

The shooting room server 200 may receive a specific advertisement from the operation server 100 , and may provide an advertisement to the user through the display 250 . The shooting room server 200 may generate advertisement response data including identification information of a user who responded to the advertisement, advertisement identification information, and a user reaction type, and transmit it to the operation server 100 .

The camera 210 is provided in the photographing room, and a user can take a picture directly by using the camera 210 .

The camera 210 may take a picture by applying the camera parameter input by the user through the shooting room server 200 .

The camera 210 may take a picture as well as a video. The video recording function may be controlled through the recording room kiosk 600 and/or the user terminal 300 .

The camera parameter according to an exemplary embodiment may include values such as image quality, size, camera sensitivity (ISO), filter, aperture, shutter speed, and the like.

As described above, the shooting room server 200 , the camera 210 , the speaker 220 and the display 250 may be configured as the shooting room kiosk 600 . That is, the recording room server 200 , the camera 210 , the speaker 220 and the display 250 may be integrated to form a single recording room kiosk 600 .

In this specification, the shooting room server 200 and the shooting room kiosk 600 will be described in the same configuration. That is, all functions implemented in the shooting room server 200 can be implemented in the same way as the shooting room kiosk 600 .

The speaker 220 is provided in the shooting room, and can play shooting music.

The lighting 230 may include a plurality of lighting devices provided in the photographing room, and may output light according to a device control signal.

The sensor 240 may include a motion sensor 241 , a voice sensor 242 , and an illuminance sensor 243 provided in the photographing room.

The motion sensor 241 may detect a motion signal generated according to a user's motion. The voice sensor 242 may detect an acoustic signal generated according to a user's movement and a voice command signal that may be issued according to a specific situation of the user. The illuminance sensor 243 may recognize an illuminance value at the user's location.

The user terminal 300 may display the image and/or video obtained from the operation server 100 to the user. The user terminal 300 may edit an image and/or a video obtained from the operation server 100 . The user terminal 300 may generate a photo frame based on an image and/or a video obtained from the operation server 100 .

The user terminal 300 may transmit the photo concept data generated by the user to the operation server 100 .

A detailed configuration and function of the user terminal 300 will be described in detail below with reference to FIGS. 9 to 15 .

2 is a diagram showing the configuration of the operation server 100 according to an embodiment.

Referring to FIG. 2 , the operation server 100 according to an embodiment includes a communication unit 110 , an input unit 120 , an output unit 130 , a memory 140 , a power supply unit 150 , and a control unit 160 . can do. The control unit 160 may include a shooting concept control unit 161 , a sharing service providing unit 162 , and an image synthesis unit 163 .

The configurations shown in FIG. 2 are exemplary diagrams for implementing embodiments of the present invention, and appropriate hardware/software configurations at a level apparent to those skilled in the art may be additionally included in the operation server 100 .

The communication unit 110 may communicate with an external device through various communication methods. For example, the communication unit 110 may transmit and receive various data by performing communication with the shooting room server 200 and the user terminal 300 .

The input unit 120 may receive various inputs of an operator who is a user of the operation server 100 and transmit it to the control unit 160 . In particular, the input unit 120 may include a touch sensor, a (digital) pen sensor, a pressure sensor, a key, and a microphone. The touch sensor may use, for example, at least one of a capacitive type, a pressure sensitive type, an infrared type, and an ultrasonic type. The (digital) pen sensor may be, for example, a part of a touch panel or may include a separate recognition sheet. The key may include, for example, a physical button, an optical key, or a keypad. The microphone is a configuration for receiving an operator's voice, and may be provided inside the operation server 100, but this is only an example, and it is provided outside of the operation server 100 to be electrically connected to the operation server 100. can

The output unit 130 may provide various screens. For example, the output unit 130 may output a concept mapping table and photo concept data to the operator.

The memory 140 may store commands or data related to at least one other component of the operation server 100 . In particular, the memory 140 may be implemented as a non-volatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). The memory 140 is accessed by the controller 160 , and reading/writing/modification/deletion/update of data by the controller 160 may be performed. In the present invention, the term "memory" refers to a memory 140, a ROM (not shown) in the controller 160, a RAM (not shown), or a memory card (not shown) mounted in the operation server 100 (eg, micro SD). card, memory stick). In addition, programs and data for configuring various screens to be displayed on the display area of the output unit 130 may be stored in the memory 140 .

The power supply unit 150 receives external power and internal power under the control of the control unit 160 to supply power necessary for the operation of each component.

The control unit 160 is electrically connected to the communication unit 110 , the input unit 120 , the output unit 130 , the memory 140 , and the power supply unit 150 to control the overall operation and function of the operation server 100 . can In particular, the controller 160 may provide functions to be described later using various modules stored in the memory 140 .

It will be apparent that various operations on the operation server 100 described below may be performed under the control of the controller 160 .

As described above, the control unit 160 may include a shooting concept control unit 161 , a sharing service providing unit 162 , and an image synthesis unit 163 .

The shooting concept controller 161 may control the lighting, music, and camera of the shooting room according to the shooting concept selected by the user.

The shooting concept control unit 161 may use the shooting concept received from the shooting room server 200 to generate control signals for lighting, a speaker, and a camera of the shooting room. The photographing concept controller 161 may generate a device control signal including control signals of lighting, a speaker, and a camera of the photographing room by using the concept mapping table. Here, the control signal of the camera is the same signal as the above-described camera parameter. The shooting concept may also be understood as a photo concept and/or a video concept.

The photography concept control unit 161 may receive photo concept data from the user, control lighting, music, and a camera in the shooting room according to the photo concept data, and change a photo frame of an output photo. The photo frame information may include frame design information of an output photo.

When another user applies a photography concept to a photographing room or outputs a photographed picture using the photograph concept data, the photographing concept control unit 161 uses the photograph concept data included in the creator information. By increasing the number of times, the photo concept data can be updated.

The photo concept data according to an embodiment may include a concept mapping table, photo frame information, and creator information. The user may generate photo concept data through the shooting room kiosk 600 or the user terminal 300, and the shooting room kiosk 600 or the user terminal 300 operates the generated photo concept data to the operation server 100 can be sent to To this end, the shooting room kiosk 600 or the user terminal 300 may provide an interface for generating photo concept data to the user. The creator information may include identification information of a user who generated the photo concept data and the number of times the photo concept data is used.

A detailed configuration and function of the shooting concept control unit 161 will be described in detail below with reference to FIG. 3 .

The photographing room kiosk 600 may include a plurality of photographing room kiosks, and the sharing service providing unit 162 may provide a sharing service for allowing the second user to use the image photographed by the first user. The operation of the shared service providing unit 162 will be described in detail below with reference to FIGS. 10 and 11 .

The image synthesizing unit 163 may provide the synthesized images to the plurality of recording room kiosks by synthesizing the images obtained through the respective cameras of the plurality of photographing room kiosks. The operation of the image synthesis unit 163 will be described in detail below with reference to FIG. 12 .

The controller 160 may control the communication unit 110 to transmit a device control signal to the photographing room server 200 to control various devices provided in the photographing room.

The device control signal of an embodiment is generated by the lighting, speaker and camera control signal (camera parameter) generated by the shooting concept control unit 161, the lighting control signal generated by the sharing service providing unit 162, and the image synthesis unit 163 may include the specified camera parameters.

The controller 160 may control the communication unit 110 to transmit a picture taken by the camera 210 to the user terminal 300 .

The controller 160 may receive data related to the shooting concept mapping table from the operator through the input unit 120 .

3 is a diagram illustrating the configuration of the photographing concept control unit 161 according to an exemplary embodiment.

Referring to FIG. 3 , the photographing concept controller 161 according to an embodiment may include a concept mapping table generator 171 , a concept mapping table DB 172 , and a device control signal generator 173 .

The concept mapping table generation unit 171 may receive data from an operator, generate a photographing concept mapping table 174 , and store the generated concept mapping table 174 in the concept mapping DB 172 . The device control signal generator 173 may generate a device control signal for a shooting concept selected by the user by using the concept mapping table 174 .

4 is a diagram illustrating an example of a concept mapping table 174 according to an embodiment.

Referring to FIG. 4 , a concept mapping table 174 according to an embodiment is a data structure including a photographing concept name, a photographing concept image, music, a background image, light color and illuminance information of a lighting device provided in a photographing room, and camera parameters. am.

The shooting concept control unit 161 transmits the generated concept mapping table 174 to the shooting room server 200 , and the shooting room server 200 may output and select a shooting concept selectable by the user.

The shooting concept control unit 161 may receive the shooting concept selected by the user from the shooting room server 200 .

The shooting concept controller 161 may use the concept mapping table 174 to generate a device control signal for the shooting concept selected by the user.

The shooting concept control unit 161 uses the concept mapping table 174 to include music corresponding to the shooting concept selected by the user, a background image, light color and illuminance information of lighting equipment provided in the shooting room, and camera parameters. data can be extracted.

The photographing concept controller 161 may generate control signals for the lighting 230 , the speaker 220 , and the camera 210 by using the extracted concept data. As described above, here the control signal of the camera is the same signal as the above-mentioned camera parameter.

For example, when the user selects the shooting concept of 'Concept A', the shooting concept control unit 161 controls the music corresponding to 'Concept A' in the concept mapping table 174, the background image, and lighting equipment provided in the shooting room. A device control signal including light color and illuminance information and camera parameters may be generated.

5 is a flowchart of a method for controlling a shooting concept according to an exemplary embodiment.

Referring to FIG. 5 , the method for controlling a shooting concept according to an embodiment may include a step of receiving a shooting concept ( S100 ), a step of extracting concept data ( S110 ), and a step of generating a device control signal ( S120 ).

The shooting concept control method may be performed by the shooting concept controller 161 .

First, in the photographing concept receiving step ( S100 ), the photographing concept control unit 161 may receive the photographing concept selected by the user from the photographing room server 200 .

And, in the concept data extraction step (S110), the shooting concept control unit 161 uses the concept mapping table 174, music corresponding to the shooting concept selected by the user, the background image, and the light of the lighting equipment provided in the shooting room. Concept data including color and illuminance information and camera parameters can be extracted.

Then, in the device control signal generating step ( S120 ), the shooting concept controller 161 may generate control signals for the lighting 230 , the speaker 220 , and the camera 210 using the extracted concept data.

Accordingly, the shooting concept control unit 161 may control the lighting, music, and camera of the shooting room according to the shooting concept selected by the user, thereby providing an environment in which the user can take a picture according to the desired concept.

6 is a diagram illustrating the configuration of a shooting room server according to an embodiment.

6, the shooting room server 200 according to an embodiment includes a kiosk communication unit 201, a kiosk input unit 202, a kiosk output unit 203, a kiosk memory 204, a kiosk power supply unit 205, It may include a kiosk control unit 206 and a camera 210 .

The configurations shown in FIG. 6 are exemplary diagrams for implementing embodiments of the present invention, and appropriate hardware/software configurations at a level obvious to those skilled in the art may be additionally included in the shooting room kiosk 600 .

The kiosk communication unit 201 may communicate with an external device through various communication methods. For example, the kiosk communication unit 201 may transmit and receive various data by performing communication with the operation server 100 and the user terminal 300 .

The kiosk input unit 202 may receive various inputs from the user and transmit it to the kiosk control unit 206 . In particular, the kiosk input unit 202 may include a touch sensor, a (digital) pen sensor, a pressure sensor, a key, and a microphone. The touch sensor may use, for example, at least one of a capacitive type, a pressure sensitive type, an infrared type, and an ultrasonic type. The microphone is configured to receive a user's voice, and may be provided inside the recording room kiosk 600, but this is only an embodiment, and is provided outside the recording room kiosk 600 and may be electrically connected.

The kiosk output unit 203 may provide various screens. For example, the kiosk output unit 203 may output an image of the camera 210 , a photographed picture, a photographing concept, a picture frame, payment information, an advertisement, and the like to the user.

The kiosk memory 204 may store commands or data related to at least one other component of the shooting room kiosk 600 . In particular, the kiosk memory 204 may be implemented as a non-volatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). The kiosk memory 204 is accessed by the kiosk control unit 206 , and reading/writing/modification/deletion/update of data by the kiosk control unit 206 may be performed. In addition, the kiosk memory 204 may store programs and data for configuring various screens to be displayed on the display area of the kiosk output unit 203 .

The kiosk power supply unit 205 receives external power and internal power under the control of the kiosk control unit 206 to supply power required for operation of each component.

The kiosk control unit 206 includes a kiosk communication unit 201 , a kiosk input unit 202 , a kiosk output unit 203 , a kiosk memory 204 , a kiosk power supply unit 205 , a kiosk control unit 206 and a camera 210 and electrical to control the overall operation and function of the shooting room kiosk 600 . In particular, the kiosk control unit 206 may provide functions to be described later using various modules stored in the kiosk memory 204 .

On the other hand, the above-described components of the shooting room server 200 may be integrally configured as a part (ie, as a part of hardware) as a part of the shooting room kiosk 600 to be described later. That is, the photographing room kiosk 600 to be described later includes all the components of the photographing room server 200 and may be interpreted as a configuration capable of performing all the operations of the photographing room server 200 .

7 is a view showing a recording room kiosk 600 according to an embodiment.

Referring to FIG. 7 , the recording room kiosk 600 according to an embodiment includes displays 620 and 630 and at least two cameras 210-1, which perform functions of a kiosk input unit 602 and a kiosk output unit 603. 601-2) may be configured as a housing.

The displays 620 and 630 display and output information processed in the shooting room kiosk 600 . For example, when the photographing room kiosk 600 is in the photographing mode, a user interface (UI) or a graphical user interface (GUI) related to photographing may be displayed. In addition, when the shooting room kiosk 600 is in the photo output mode or the payment mode, the captured photo and/or photo frame related UI and GUI may be displayed. The displays 620 and 630 may be configured as a touch screen by forming a layered structure of touch pads, and the displays 620 and 630 may be used as input devices in addition to output devices. The displays 620 and 630 include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. (3D display) may include at least one of. And, depending on the implementation form of the shooting room kiosk 600, the display (620, 630) may exist two or more.

At least two cameras (210-1, 210-2) in the shooting room kiosk (600) may be provided on both upper and lower sides of the displays (620, 630), and the first camera (210-1) is a full-body camera, The second camera 210 - 2 may be used as a half-length camera, and vice versa. In another embodiment, the at least two cameras 210 - 1 and 210 - 2 may be arranged left and right instead of up and down. The at least two cameras 210-1 and 210-2 may be cameras of the same type having the same specifications (eg, pixels), but the first camera 210-1 and the second camera 210-2 have different specifications. It can be implemented with a camera of The shooting room kiosk 600 may support functions related to dual cameras (eg, 3D shooting, auto focus, etc.) through the two cameras 210 - 1 and 210 - 2 . One of the at least two cameras may perform high-speed imaging, and the other may perform time-lapse imaging.

As shown in the drawing, the shooting room kiosk 600 may include a card input hole configured to allow a user to insert a card for payment and a photo output hole configured to discharge the output photo.

The shooting room kiosk 600 may provide an interface for inputting photo concept data to the user. The user may input the photo concept data to the shooting room kiosk 600 through the interface, and the shooting room kiosk 600 may transmit the input photo concept data to the storage and operation server 100 .

As described above, the photo concept data according to an exemplary embodiment may include a concept mapping table, photo frame information, and creator information. The user may generate photo concept data through the shooting room kiosk 600 or the user terminal 300, and the shooting room kiosk 600 or the user terminal 300 operates the generated photo concept data to the operation server 100 can be sent to To this end, the shooting room kiosk 600 or the user terminal 300 may provide an interface for generating photo concept data to the user.

8 is a diagram illustrating an example of photo concept data 175 according to an embodiment.

Referring to FIG. 8 , the photo concept data 175 of an embodiment is a concept mapping including a photographing concept name, a photographing concept image, music, a background image, light color and illuminance information of a lighting device provided in a photographing room, and camera parameters. It is a data structure including a table 174 , photo frame information 176 , and creator information 177 .

The photo frame information according to an embodiment may include design information of the photo frame. The shooting room kiosk 600 may output a photo frame according to the design information of the photo frame selected by the user. The shooting room kiosk 600 may transmit the photo concept data 175 input from the user to the operation server 100 .

The creator information 177 according to an embodiment may include identification information of a user who has generated the photo concept data and the number of times the photo concept data is used.

The photo concept data 175 may be generated in the photographing room kiosk 600 based on a user's input received through the photographing room kiosk 600 or may be transmitted from the user terminal 300 .

The shooting room kiosk 600 may store photo concept data 175 , and the shooting room kiosk 600 may display a shooting concept and a photo frame selectable to the user to the user, and receive a selection input accordingly.

The photographing concept control unit 161 of the operation server 100 may receive the photographing concept data 175 from the photographing room kiosk 600 .

The photographing concept controller 161 may use the photograph concept data 175 to generate a device control signal for the photograph concept selected by the user. The device control signal may be transmitted to the shooting room server 200 (or to the shooting room kiosk 600) and used as a reference signal for controlling the device.

The photographing concept controller 161 uses the photographic concept data 175 to include music corresponding to the photographic concept selected by the user, a background image, light color and illuminance information of lighting equipment provided in the photographing room, and camera parameters. data can be extracted.

The photographing concept controller 161 may generate control signals for the lighting 230 , the speaker 220 , and the camera 210 by using the extracted concept data. As described above, here the control signal of the camera is the same signal as the above-mentioned camera parameter.

The photographing room kiosk 600 may output the photographed photograph by using the photograph frame information 176 corresponding to the photograph concept selected by the user.

9 is a flowchart illustrating a process of extracting a filter effect from a source image to which a user's desired filter effect is applied, and applying the extracted filter effect to an image obtained through the operation server 100 .

In an embodiment, the user terminal 300 may apply a filter effect stored in the user terminal 300 to the image obtained through the operation server 100 . In addition, the user terminal 300 extracts a filter effect from an image to which the filter effect has been previously applied among images stored in the album of the user terminal 300 , and applies the extracted filter effect to the image obtained through the operation server 100 . can be applied In another embodiment, by providing the filter effect stored in the user terminal 300 and / or the filter effect extracted from the user terminal 300 to the operation server 100, the image and video taken in the recording room kiosk (600) can be applied to Hereinafter, extracting the filter effect through S910 to S940 will be described.

The user terminal 300 may obtain an input for selecting a source image from the user (S910). The source image may be an image captured by the camera of the user terminal 300 or an image obtained from an external server. The source image may be an image to which a filter effect is applied. For example, the source image may be an image to which at least one filter effect of a filter giving a black and white effect, a filter giving a faded feeling, a filter giving a pastel color, and a filter emphasizing an outline is applied. As for the filter, various filters may exist in addition to the filter presented above. The source image may be an image from which a filter effect is to be extracted.

In an embodiment, the user terminal 300 may determine an original image from the source image (S920). Specifically, the user terminal 300 may estimate the original image to which the filter effect is not applied from the source image to which the filter effect is applied. The user terminal 300 may estimate the original image based on average characteristics of objects in the source image.

The user terminal 300 may recognize objects included in the source image, and estimate the original image by estimating an average color of the recognized object. In other words, the user terminal 300 may estimate the original image based on the color values of pixels corresponding to the recognized objects without considering regions excluding recognized objects from the source image. For example, the user terminal 300 may recognize an object (eg, pool or sea) included in the source image, and recognize that the pool or sea has a gray color by applying a black and white filter to the source image. there is. If a black and white filter is applied to the source image so that the grass or sea has a gray color, the grass may contain green color on average and the sea may contain blue color on average, so in the original image the grass will be green and sea may have a blue color. That is, the user terminal 300 compares the color (eg. gray) of the object (eg, the sea) included in the source image with the reference color (eg, blue) predefined for the object (eg. the sea). The original image can be estimated.

On the other hand, although the filter effect is generally applied to the entire image, there may be cases where the filter effect is limitedly applied only to a specific object (eg, a main person or object), or the filter effect is applied differently to each object in the image. .

In consideration of this case, the user terminal 300 according to an embodiment may give different weights according to the area of the object occupied by the objects recognized in the source image in order to increase the accuracy when estimating the original image. there is. For example, the user terminal 300 may give a higher estimation weight for estimating the filter effect from the object as the area occupied by the object in the source image increases.

The estimation method may be performed by applying machine learning, big data technology, and artificial intelligence (AI), and the data learned through the estimation is memory by at least one of machine learning, big data technology, or artificial intelligence (AI). can be stored in

In an embodiment, the user terminal 300 may extract a filter effect applied to the source image by comparing the source image with the original image (S930). The user terminal 300 may determine a first object having the largest area in the source image among the objects recognized in the source image. The user terminal 300 may extract the filter effect by comparing the color values of pixels corresponding to the first object in the source image with the color values of pixels corresponding to the first object in the estimated original image. The pixels corresponding to the first object may include color elements of R (red), G (green), and B (blue), respectively, and the user terminal 300 sets each R of the pixels corresponding to the first object. , G, and B can be calculated. The user terminal 300 calculates the average of the R change values, the average of the G change values, and the average of the B change values in the region corresponding to the first object, and the average of the calculated R change values, the average of the G change values, A color value corresponding to the average of the B change values may be extracted.

The user terminal 300 may store the extracted color value as a filter effect, and apply the stored filter effect to the image obtained from the operation server 100 .

10 is a diagram for explaining an example of using an image photographed by at least one user as a background image when two or more users are unable to photograph together in one recording room kiosk because the time does not match or the distance is far from each other. .

The shooting room kiosk 600 takes a first image according to the input of the first user, and the operation server 100 obtains the first image taken according to the payment of the first user from the shooting room kiosk 600, The acquired first image may be provided to the first user terminal 300 - 1 .

The operation server 100 may provide a sharing service for the first image, and may charge a sharing cost to the first user terminal 300-1 according to the period of the sharing service. The shared service may include a temporary storage service. The first user terminal 300 - 1 may determine the first image as the shared image, and set access information on the shared image to the determined shared image. The access information may include an access password, a range of accessible acquaintances, and the like. The first user terminal 300 - 1 may provide the operation server 100 with a shared image in which access information is set to the operation server 100 .

The operation server 100 may set a certain period from the day the first image was taken as the sharing period for the shared image. The operation server 100 may delete the shared image after the sharing period has elapsed.

The second user terminal 300 - 2 may be authorized to access the shared image by communicating with the operation server 100 based on the access information set on the shared image within the sharing period. In this case, the second user terminal 300 - 2 may provide the operation server 100 with a unique identification symbol of the shooting room kiosk 600 that wants to receive the shared image.

The operation server 100, after permitting the access authentication of the second user terminal 300-2, the photographing corresponding to the unique identification symbol of the photographing room kiosk 600 provided from the second user terminal 300-2 A shared image may be provided to the room kiosk 600 as a background image.

The shooting room kiosk 600 may generate a second image by taking a picture according to an input of a second user who is a user of the second user terminal 300 - 2 using the shared image as a background image.

The shooting room kiosk 600 may provide the second image photographed in this way to the operation server 100 , and the operation server 100 may provide the second image to the second user terminal 300 - 2 .

On the other hand, the operation server 100, after permitting the access authentication of the second user terminal 300-2, corresponds to the unique identification symbol of the shooting room kiosk 600 provided from the second user terminal 300-2 The object (eg, the first user) extracted from the shared image may be provided to the shooting room kiosk 600 .

In this case, various types of known object recognition (or extraction) algorithms may be applied to extract the object. For example, convolutional neural network (CNN)-based object recognition algorithms may be applied.

The shooting room kiosk 600 may display the provided object to the second user together with pre-stored background images, and the second user, who is the user of the second user terminal 300 - 2, uses the pre-stored background images. When a desired background image is selected among the selected background images and the position of an object is selected from the selected background image, a background image including the object at the position of the selected object may be displayed to the second user through the shooting room kiosk 600 . Thereafter, the second user may create a second image by taking a picture using the shooting room kiosk 600 while looking at the displayed screen.

The shooting room kiosk 600 may provide the second image photographed in this way to the operation server 100 , and the operation server 100 may provide the second image to the second user terminal 300 - 2 .

After the sharing period has elapsed, the operation server 100 may provide a message to the first user terminal 300-1 asking whether to delete the first image and extend the sharing. When the operation server 100 obtains an input for extending the sharing service of the first image from the first user terminal 300-1, it may charge an additional cost to the first user terminal 300-1.

11 is a diagram for explaining an example of using an image photographed by at least one user as a background image when two or more users are unable to photograph together in one recording room kiosk because the time does not match or the distance is far from each other.

The shooting room kiosk 600 may take a first image according to a first user's input. The operation server 100 may provide a sharing service for the captured image, and may charge the sharing cost to the first user terminal 300-1 according to the period of the sharing service. The shared service may include a temporary storage service. The operation server 100 may approve the payment of the first user through the recording room kiosk 600 , and temporarily store the first image photographed according to the approval in the operation server 100 and the photographing room kiosk 600 . can

In an embodiment, the operation server 100 may set access information for the first image to the stored first image. The operation server 100 may provide the first image as a background image to the recording room kiosk 600 when the permission to access the access information is confirmed within the period of the sharing service.

Therefore, in the case of the present invention, if there is a situation in which the first user and the second user visit at the same time and it is difficult to photograph together, the first user comes first and proceeds to photograph through the photographing room kiosk 600 , and photographing there The access information for the first image can be set and provided to the operation server 100, and the second user provides the first image based on the access information as a background image through the operation server 100 in the shooting room kiosk 600 ) to take a photo with the first image as the background.

12 is a diagram illustrating that the first user and the second user take a picture together remotely by linking the first shooting room kiosk and the second shooting room kiosk.

In an embodiment, the first user may photograph through the first photographing room kiosk 600-1, and the second user may photograph through the second photographing room kiosk 600-2. The first user terminal 300-1 may be linked with the first shooting room kiosk 600-1, and the second user terminal 300-2 may be linked with the second shooting room kiosk 600-2. there is.

The first user terminal 300 - 1 may request the operation server 100 as a host for a remote execution mode with the second user terminal 300 - 2 . The operation server 100 responds to the request for the remote execution mode, the first image (a kind of video) acquired through the camera of the first recording room kiosk 600-1 and the second recording room kiosk 600-2 A second image (a kind of video) acquired through the camera of . The operation server 100 generates a third image based on the first image and the second image, and displays the generated third image of the first recording room kiosk 600-1 and the second recording room kiosk 600- 2) can be displayed through the display.

The first recording room kiosk 600 - 1 may transmit the first image acquired in real time through the camera of the first photographing room kiosk 600 - 1 to the operation server 100 . The second recording room kiosk 600 - 2 may transmit the second image acquired in real time through the camera of the second photographing room kiosk 600 - 2 to the operation server 100 . In practice, the image being acquired may include a plurality of image frames.

The operation server 100 may detect the second user from the second image obtained from the second recording room kiosk 600 - 2 . The operation server 100 may synthesize a pixel region corresponding to the second user in a plurality of image frames of the first image, and generate a third image based on the synthesis. When the operation server 100 overlaps the pixel area corresponding to the first user and the pixel area corresponding to the second user in the process of generating the third image, the depth value of the first user and the second By comparing the depth value of the user, the pixel area of the user having the high depth value may be deleted, and the pixel area of the user having the low depth value may be maintained. To this end, the recording room kiosk 600 may further include a depth camera for obtaining a depth value corresponding to each pixel of the photographed image.

The operation server 100 may provide the generated third image to the first recording room kiosk 600-1 and the second photographing room kiosk 600-2. The operation server 100 may display the third image to the first user and the second user through the first recording room kiosk 600-1 and the second photographing room kiosk 600-2.

The operation server 100 obtains a photographing input of the first user as a host through the first photographing room kiosk 600-1, and in response to the obtained photographing input, from among a plurality of image frames constituting the third image , an image frame of the third image corresponding to a point in time at which a photographing input is obtained through the camera of the first photographing room kiosk 600-1 and the camera of the second photographing room kiosk 600-2 may be obtained.

At this time, the operation server 100 may further include a microphone in the recording room kiosk 600 so that the first user and the second user at a distance can shoot smoothly, and the first recording room kiosk 600-1 and the audio system (which may consist of a speaker 220 and a microphone) of the second recording room kiosk 600-2 may be connected.

13 is a view for explaining the configuration of a photo frame based on the video obtained through the operation server (100).

In one embodiment, the shooting room kiosk 600 may take a picture as well as a video through the camera 610 . The operation server 100 may obtain a photograph and/or a video taken through the recording room kiosk 600 , and may provide the obtained photograph and/or video to the user terminal 300 .

The user terminal 300 may display a plurality of videos (eg, video 1, video 2, ...) obtained from the operation server 100 on a portion of the display. The user terminal 300 may determine one of a plurality of image frames constituting the moving picture as a representative photo, and display the moving picture 1301 displaying the representative photo on the display. For example, the user terminal 300 may determine a photo corresponding to the first image frame constituting the obtained moving picture as a representative photo, and display a moving picture in which the determined representative photo is displayed on the display.

In an embodiment, the user terminal 300 may generate a photo frame based on a video selected by the user. The user terminal 300 may provide the user with an option to determine the shape of the photo frame, the number of photos constituting the photo frame, and/or the photos constituting the photo frame. For example, the user terminal 300 may provide the user with an option to select various shapes such as a grid shape (1x3 shape, 1x4 shape, 2x2 shape, 4x1 shape, etc.) of the photo frame. The user terminal 300 may determine the number of photos, determine a shape of a photo frame, or determine photos constituting a photo frame according to a user's input. In addition, the user terminal 300 may provide an option to obtain the design of the photo frame generated by the creator terminal 400 through the operation server 100, and to select the design of the photo frame.

In an embodiment, the user terminal 300 may determine the shape of the photo frame, the number of photos constituting the photo frame, and the photos constituting the photo frame, based on the user's drag input for the video selected by the user. . A detailed description thereof will be described below with reference to FIGS. 14 and 15 .

14 is a diagram for explaining the construction of a photo frame based on an acquired video.

In response to an input for selecting one video (eg, video1 1 ) of FIG. 13 , the user terminal 300 may generate a photo frame 1420 based on the single video. The user terminal 300 may provide an interface 1410 for adjusting the configuration of the generated photo frame 1420 through one area of the display. The photo frame 1420 generated in response to the input for selecting one moving picture may initially consist of one photo.

The user terminal 300 may change the configuration of the photo frame 1420 according to a user's drag input and/or touch input obtained within the interface. For example, the user terminal 300 may determine a shape of a photo frame, a type of photos constituting the photo frame, the number of photos, and the like according to a drag input.

15 is a diagram for explaining how to configure a picture frame in various forms based on a user's drag input with respect to an acquired video.

The user terminal 300 may adjust the size of the photo frame according to a drag input. The user terminal 300 may obtain a user input of touching and dragging a portion of a corner of the photo frame.

When the user's drag input for adjusting the size of the photo frame is not obtained for the first time, the user terminal 300 may determine the size of the photo frame. For example, when the user terminal 300 adjusts the size of the photo frame in real time in response to the user's drag input and the user's drag input is not obtained for the first time, the time point at which the user's drag input is not obtained The size can be determined by the size of the photo frame.

The user terminal 300 may determine the size and shape of the photo frame and the number of photos constituting the photo frame according to the drag input. The user terminal 300 may determine the number of photos included in the photo frame based on the size of the photo frame that is changed according to the drag input. For example, when the size of the photo frame is the first size, the user terminal 300 determines the number of photos constituting the photo frame to be one, and when the size of the photo frame is the second size larger than the first size, the photo frame The number of pictures constituting the frame may be determined to be one or more.

For example, the user terminal 300 may enlarge the photo frame in the first direction (eg, horizontal direction) according to the user's drag input 1521 for dragging the photo frame in the first direction (eg, horizontal direction). there is. The user terminal 300 may configure the photo frame as a grid composed of 1 x A photos according to a user's drag input for dragging in the first direction (eg, horizontal direction).

As another example, the user terminal 300 may enlarge the photo frame in the second direction (eg, vertical direction) according to the user's drag input 1522 dragging in the second direction (eg, vertical direction). The user terminal 300 may configure the photo frame as a grid composed of A x 1 photos according to a user's drag input for dragging in the second direction (eg, in the vertical direction).

As another example, the user terminal 300 may enlarge the photo frame in the third direction (eg, diagonal direction) according to the user's drag input 1523 dragging in the third direction (eg, diagonal direction). The user terminal 300 may configure the photo frame as a grid composed of A x B photos according to a user's drag input for dragging in a third direction (eg, in a diagonal direction). A can be the same as B.

The user terminal 300 may determine the number of photos included in the photo frame as well as photos constituting the photo frame based on the size of the photo frame that is changed according to the drag input. The user terminal 300 may change the photos constituting the photo frame in real time according to the drag input. In other words, according to the determined number of photos, the user terminal 300 may determine at least one image frame among image frames constituting the selected moving picture as a photo constituting the photo frame.

In an embodiment, the user terminal 300 may determine a plurality of image frames selected at regular time intervals among image frames constituting the selected moving picture as photos constituting the photo frame. For example, in a 10-second video, the user terminal 300 determines a first image frame corresponding to 2 seconds as a first photo, a second image frame corresponding to 4 seconds as a second photo, and at 6 seconds The corresponding third image frame may be determined as the third photo. The predetermined time interval may be determined according to the number of pictures constituting the picture frame. In other words, the user terminal 300 may narrow the predetermined time interval as the number of pictures constituting the picture frame increases, and may widen the predetermined time interval as the number of pictures constituting the picture frame decreases.

When shooting a video, there is a process in which the user holds a pose for a specific time after pressing the shooting button, and there is a process in which the user releases the pose for a specific time before pressing the shooting end button. Therefore, in order not to determine the image frame including the unnecessary pose as the photo constituting the photo frame, the user terminal 300 excludes a preset time interval at each of the first and last views of the selected video, and consists of the remaining times. It is possible to determine the photos to compose a photo frame within the length of the actual video.

In an embodiment, the user terminal 300 may change the number of photos and photos constituting the photo frame as the size of the photo frame is changed. When the determined number of pictures is M, the user terminal 300 may divide the actual video length into (M-1) equal parts.

The user terminal 300 corresponds to the N-1/(M-1) part of the first picture and the length of the actual video when the picture frame is composed of M pictures according to the user's drag input. An image frame to be used may be determined as the N-th picture. The maximum value of N may be equal to M. In other words, when the user terminal 300 composes four photos according to the user's drag input, the first image frame of the real video is set to the first photo, and the image frame corresponding to 1/3 of the length of the real video is set to the second image. An image frame corresponding to 2/3 of the length of the photo and the actual moving picture may be determined as the third photo and an image frame corresponding to 3/3 of the length of the actual moving picture may be determined as the fourth photo.

In addition, the user terminal 300 may determine the photo composing the photo frame based on the user's pose and/or the user's facial expression in the selected video so as not to determine similar photos when determining the photo constituting the photo frame. there is. For example, the user terminal 300 determines the first image frame including the user's first pose (eg, hurray pose) in the 10-second video as the first photo, and the second pose (eg, thumbs up pose) A second image frame including , may be determined as a second photo, and a third image frame including a third pose (eg, clenched fist) may be determined as the third photo.

When the number of detected poses and the number of detected facial expressions is smaller than the determined number of pictures, the user terminal 300 displays an image frame including the first detected pose and/or facial expression among the detected poses and/or facial expressions as a picture frame. It can be determined by the rest of the photos that make up . For example, when the number of selected photos is four and the detected poses and/or facial expressions are three, the fourth image frame including the first pose (eg, hurray pose) may be determined as the fourth photo. The fourth image frame may be different from the first image frame. The first to third poses may be poses detected in chronological order.

The user terminal 300 may detect the pose and/or the user's facial expression based on a plurality of pose data and/or a plurality of facial expression data stored in advance in the operation server 100 or the user terminal 300 . The user terminal 300 may compare the plurality of pre-stored pose data and/or facial expression data with the pose and/or facial expression of the user detected in the selected video, and as a result of the comparison, detect a pose determined to be the same. .

16 is a diagram illustrating a configuration of a user terminal 300 according to an embodiment. Hereinafter, components constituting the user terminal 300 shown in FIG. 16 will be described in turn.

The wireless communication unit 310 may include one or more components that perform wireless communication between the user terminal 300 and the wireless communication system or wireless communication between the user terminal 300 and the network in which the user terminal 300 is located. . For example, the wireless communication unit 310 may include a broadcast reception module 311 , a mobile communication module 312 , a wireless Internet module 313 , a short-range communication module 314 , and a location information module 315 , etc. .

The broadcast reception module 311 receives a broadcast signal and/or broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. Meanwhile, broadcast-related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 312 .

In addition, the mobile communication module 312 transmits and receives a wireless signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 313 refers to a module for wireless Internet access, and may be built-in or external to the user terminal 300 .

The short-range communication module 314 refers to a module for short-range communication. As the short-distance communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used.

Also, the location information module 115 is a module for confirming or obtaining the location of the user terminal 300 . An example is a Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude.

Meanwhile, the A/V (Audio/Video) input unit 320 is for inputting an audio signal or a video signal, and may include a camera 321 , a microphone 322 , and the like. The camera 321 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a shooting mode. Then, the processed image frame may be displayed on the display unit 351 .

The image frame processed by the camera 321 may be stored in the memory 360 or transmitted to the outside through the wireless communication unit 310 . Two or more cameras 321 may be provided according to the configuration of the user terminal 300 .

The microphone 322 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data. In addition, the processed voice data may be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 312 and output in the call mode. The microphone 322 may implement various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 330 receives an input operation from the user and generates input data for controlling the operation of the user terminal 300 .

The sensing unit 340 detects the current state of the user terminal 300 , such as the location of the user terminal 300 , the presence of user contact, the orientation of the user terminal 300 , and acceleration/deceleration of the user terminal 300 . A sensing signal for controlling the operation of the terminal 300 is generated.

The interface unit 370 serves as an interface with all external devices connected to the user terminal 300 . For example, wired/wireless headset ports, external charger ports, wired/wireless data ports, memory card ports, ports for connecting devices equipped with identification modules, audio input/output (I/O) ports, It may include a video input/output (I/O) port, an earphone port, and the like.

The output unit 350 is for outputting an audio signal, a video signal, or an alarm signal, and may include a display unit 351 , a sound output module 352 , an alarm unit 353 , and the like.

The display unit 351 displays and outputs information processed by the user terminal 300 . For example, when the terminal is in a call mode, a user interface (UI) or graphic user interface (GUI) related to a call is displayed. And, when the user terminal 300 is in the video call mode or the shooting mode, the captured and/or received image or UI and GUI are displayed.

Meanwhile, as described above, when the display unit 351 and the touch pad form a layer structure to form a touch screen, the display unit 351 may be used as an input device in addition to an output device. The display unit 351 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display ( 3D display). In addition, two or more display units 351 may exist according to an implementation form of the user terminal 300 . For example, the user terminal 300 may be provided with an external display unit (not shown) and an internal display unit (not shown) at the same time.

The sound output module 352 outputs audio data received from the wireless communication unit 310 or stored in the memory 360 in call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, and the like. In addition, the sound output module 352 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the user terminal 300 . The sound output module 352 may include a speaker, a buzzer, and the like.

The alarm unit 353 outputs a signal for notifying the occurrence of an event in the user terminal 300 . Examples of events occurring in the terminal include call signal reception, message reception, and key signal input.

The memory 360 may store a program for processing and control of the controller 380, and provides a function for temporary storage of input/output data (eg, phonebook, message, still image, video, etc.). can also be done

The memory 360 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), a RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) magnetic memory, magnetic disk, It may include at least one type of storage medium among optical disks.

The controller 380 generally controls the overall operation of the terminal. For example, it performs related control and processing for voice calls, data communications, video calls, and the like. Also, the controller 380 may include a multimedia module 181 for playing multimedia. The multimedia module 381 may be implemented within the control unit 380 or may be implemented separately from the control unit 380 .

The controller 380 controls various operations of the terminal for implementing the above-described photo studio operating method.

The power supply unit 290 receives external power and internal power under the control of the control unit 280 to supply power required for operation of each component.

On the other hand, at least some or all of the operation of the above-described operation server 100 may be implemented in the user terminal (300). In this case, an application for communicating with the operation server 100 and performing the operation of the operation server 100 described above may be installed in the user terminal 300 in advance.

17 is a diagram illustrating a wireless communication system that can be applied in a communication process according to an embodiment of the present invention. 18 is a diagram illustrating a base station in the wireless communication system according to FIG. 17 . 19 is a diagram illustrating a terminal in the wireless communication system of FIG. 17 . 20 is a diagram illustrating a communication interface in the wireless communication system according to FIG. 17 .

Hereinafter, an example of a wireless communication network system supporting communication between various servers and terminals will be described in detail as an example. In the following description, a first node (device) may be an anchor/donor node or a centralized unit (CU) of an anchor/donor node, and a second node (device) may be an anchor/donor node or a distributed unit (DU) of a relay node. can be

As a part of a node using a radio channel in a wireless communication system, a base station (BS), a terminal, a server, and the like may be included.

A base station is a network infrastructure that provides wireless access to terminals and terminals. A base station has coverage defined as a certain geographic area according to the distance over which signals can be transmitted.

A base station is an "access point (AP)", "enodeb (eNB)", "5th generation (5G) node", "wireless point", " It may be referred to as a "transmission/reception point (TRP)".

The base station, the terminal, and the terminal may transmit and receive radio signals in millimeter wave (mmWave) bands (eg, 28 GHz, 30 GHz, 38 GHz, 60 GHz). In this case, the base station, the terminal, and the terminal may perform beamforming to improve the channel gain. Beamforming may include transmit beamforming and receive beamforming. That is, the base station, the terminal, and the terminal may impart directivity to the transmitted signal and the received signal. To this end, the base station, the terminal, and the terminal may select a serving beam through a beam discovery procedure or a beam management procedure. Thereafter, communication may be performed using a resource that is in a quasi co-located relationship with a resource carrying the serving beam.

The first antenna port and the second antenna port are considered quasi-co-located if the large-scale properties of the channel through which the symbol of the first antenna port is carried can be inferred from the channel through which the symbol of the second antenna port is carried. The large-scale attribute may include one or more of delay spread, Doppler spread, Doppler shift, average gain, average delay, and spatial Rx parameters.

Hereinafter, a base station is exemplified in the above-described wireless communication system. The terms “-module”, “-unit” or “-er” used hereinafter may mean a unit that processes at least one function or operation, and includes hardware, software, or hardware and software. It can be implemented as a combination of

The base station may include a wireless communication interface, a backhaul communication interface, a storage unit and a controller.

The wireless communication interface performs a function of transmitting and receiving signals through a wireless channel. For example, the wireless communication interface may perform a conversion function between a baseband signal and a bit stream according to a physical layer standard of the system. For example, in data transmission, a wireless communication interface compresses and modulates a transmitted bit stream to produce a complex symbol. In addition, upon data reception, the wireless communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream.

The wireless communication interface performs a function of transmitting and receiving signals through a wireless channel. For example, the wireless communication interface may perform a conversion function between a baseband signal and a bit stream according to a physical layer standard of the system. For example, in data transmission, a wireless communication interface compresses and modulates a transmitted bit stream to produce a complex symbol. In addition, upon data reception, the wireless communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream.

In addition, the wireless communication interface up-converts the base band signal into a radio frequency (RF) band signal, transmits the converted signal through the antenna, and then down-converts the RF band signal received through the antenna into a base band signal. To this end, the wireless communication interface includes a transmission filter, a reception filter, an amplifier, a mixer, an oscillator, a digital-to-analog converter (DAC), It may include an analog-to-digital converter (ADC) and the like. Also, the wireless communication interface may include a plurality of transmission/reception paths. Further, the wireless communication interface may include at least one antenna array including a plurality of antenna elements.

In terms of hardware, the wireless communication interface may include a digital unit and an analog unit, and the analog unit may include a plurality of sub-units according to operating power, operating frequency, and the like. The digital unit may be implemented with at least one processor (eg, a digital signal processor (DSP)).

The wireless communication interface transmits and receives signals as described above. Accordingly, a wireless communication interface may be referred to as a "transmitter", "receiver" or "transceiver". In addition, in the following description, transmission/reception performed through a wireless channel may be used to include processing performed in a wireless communication interface as described above.

The backhaul communication interface provides an interface for performing communication with other nodes in the network. That is, the backhaul communication interface converts the bit stream transmitted to another node, for example, another access node, another base station, a higher node or a core network from a base station converts the physical signal received from the other node into a physical signal. Convert to stream.

The storage unit stores data such as basic programs, applications, and setting information for operation of the base station. The storage unit may include a volatile memory, a non-volatile memory, or a combination of a volatile memory and a non-volatile memory.

The controller controls the overall operation of the base station. For example, the controller transmits and receives signals through a wireless communication interface or a backhaul communication interface. In addition, the controller writes data to the storage and reads the recorded data. The controller can perform the function of the protocol stack required by the communication standard. According to another implementation, the protocol stack may be included in a wireless communication interface. To this end, the controller may include at least one processor.

According to an embodiment, the controller may control the base station to perform an operation according to an embodiment of the present invention.

According to various embodiments, a donor node of a wireless communication system includes at least one processor, a transceiver operatively coupled to the at least one processor, and a plurality of radio bearers for a terminal accessing the relay node. and send to the relay node a first message including first information related to the donor node regarding receive, from the relay node, a second message including second information related to the relay node regarding a plurality of radio bearers for the terminal; Data for the terminal may be transmitted to the relay node. Data may be transmitted to the terminal through a plurality of radio bearers based on the first information and the second information.

According to various embodiments, a radio bearer among a plurality of radio bearers may aggregate a plurality of radio bearers. the at least one processor is further configured to determine a radio bearer for the terminal accessing the relay node and a multiple radio bearer aggregated by the radio bearer; Alternatively, a radio bearer for a terminal accessing the relay node may be determined.

According to various embodiments, the first message may include one or more of the following: identification of a terminal accessing the relay node; display information indicating the type of terminal accessing the relay node; information on a radio bearer of a terminal accessing a relay node; information on the radio bearer delivered by the terminal accessing the relay node; information on the tunnel established for the radio bearer between the donor node and the relay node; information on the aggregated multiple radio bearers; radio bearer mapping information; information about the address of the side of the donor node; information on the address of the relay node side; indication information corresponding to a radio bearer of a terminal accessing a relay node; indication information indicating the relay node to allocate a new address to a radio bearer for a terminal accessing the relay node; a list of address information that cannot be used by a relay node that transmits data of a radio bearer of a terminal accessing the relay node; and information related to security configuration.

According to various embodiments, the second message may include one or more of the following: identification of a terminal accessing the relay node; information on radio bearers accepted by the relay node; information on radio bearers not acknowledged by the relay node; information on radio bearers partially granted by the relay node; radio bearer mapping information; configuration information of a terminal accessing the relay node generated by the relay node; information on the address of the relay node side; and information related to security configuration.

According to various embodiments, the second message may further include information on the integrated multi-radio bearer.

According to various embodiments, the donor node may include a central unit of the donor node, and the relay node may include a distributed unit of the donor node.

According to various embodiments, a relay node of a wireless communication system includes at least one processor, a transceiver operatively coupled to the at least one processor, and a plurality of terminals accessing the relay node from a donor node. configured to receive a first message comprising first information related to a donor node regarding a radio bearer of ; transmit a second message including second information related to the relay node regarding the plurality of radio bearers to the terminal to the donor node; It is possible to receive data for the terminal from the donor node. Data may be transmitted to the terminal through a plurality of radio bearers based on the first information and the second information.

According to various embodiments, a radio bearer among a plurality of radio bearers may aggregate a plurality of radio bearers. the at least one processor is further configured to determine a radio bearer for the terminal accessing the relay node and a multi-radio bearer united by the radio bearer; Alternatively, multiple radio bearers integrated by the radio bearer may be determined.

According to various embodiments, the first message may include one or more of the following: identification of a terminal accessing the relay node; display information indicating the type of terminal accessing the relay node; information on a radio bearer of a terminal accessing a relay node; information on the radio bearer delivered by the terminal accessing the relay node; information on the tunnel established for the radio bearer between the donor node and the relay node; information on the aggregated multiple radio bearers; radio bearer mapping information; information about the address of the side of the donor node; information on the address of the relay node side; indication information corresponding to a radio bearer of a terminal accessing a relay node; indication information indicating the relay node to allocate a new address to a radio bearer for a terminal accessing the relay node; a list of address information that cannot be used by a relay node that transmits data of a radio bearer of a terminal accessing the relay node; and information related to security configuration.

According to various embodiments, the second message may include one or more of the following: identification of a terminal accessing the relay node; information on radio bearers accepted by the relay node; information on radio bearers not acknowledged by the relay node; information on radio bearers partially granted by the relay node; radio bearer mapping information; configuration information of a terminal accessing the relay node generated by the relay node; information on the address of the relay node side; and information related to security configuration.

According to various embodiments, the second message may further include information on the integrated multi-radio bearer.

According to various embodiments, the donor node may include a central unit of the donor node, and the relay node may include a distributed unit of the donor node.

Hereinafter, components of a terminal in the above-described wireless communication system are illustrated. The components of the terminal to be described below are components of a universal terminal supported by the wireless communication system, and may be merged or integrated with the components of the terminal according to the above-described contents. Contents described with reference may be interpreted as having priority. The terms “-module”, “-unit” or “-er” used below may refer to a unit that processes at least one function.

The terminal includes a communication interface, a storage unit and a controller.

The communication interface performs a function of transmitting and receiving signals through a wireless channel. For example, the communication interface performs a function of converting between a baseband signal and a bit stream according to the physical layer standard of the system. For example, in data transmission, a communication interface compresses and modulates a transport bit stream to produce a complex symbol. In addition, upon data reception, the communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream. In addition, the communication interface up-converts the base band signal into an RF band signal, transmits the converted signal through the antenna, and then down-converts the RF band signal received through the antenna into a base band signal. For example, the communication interface may include a transmission filter, a reception filter, an amplifier, a mixer, an oscillator, and a digital-to-analog converter (DAC). , an analog-to-digital converter (ADC), and the like.

Also, the communication interface may include a plurality of transmission/reception paths. Further, the communication interface may include at least one antenna array including a plurality of antenna elements. On the hardware side, the wireless communication interface may include a digital circuit and an analog circuit (eg, a radio frequency integrated circuit, RFIC). The digital circuit may be implemented by at least one processor (eg, DSP). The communication interface may include a plurality of RF chains. The communication interface may perform beamforming.

The communication interface transmits and receives signals as described above. Accordingly, a communication interface may be referred to as a "transmitter", "receiver" or "transceiver". In addition, in the following description, transmission and reception performed through a wireless channel may be used to include processing performed in a communication interface as described above.

The storage unit stores data such as basic programs, applications, and setting information for the operation of the terminal. The storage unit may include a volatile memory, a non-volatile memory, or a combination of a volatile memory and a non-volatile memory. In addition, the storage unit provides the stored data according to the request of the controller.

The controller controls the overall operation of the terminal. For example, the controller sends and receives signals through a communication interface. In addition, the controller writes data to the storage and reads the recorded data. The controller can perform the function of the protocol stack required by the communication standard. According to another implementation, the protocol stack may be included in the communication interface. To this end, the controller may include at least one processor or microprocessor or regenerate a part of the processor. In addition, a part of the communication interface or controller may be referred to as a communication processor (CP).

According to an embodiment of the present invention, the controller may control the terminal to perform the operation according to the embodiment of the present invention.

Hereinafter, a communication interface in a wireless communication system is exemplified.

The communication interface includes compression and modulation circuitry, digital beamforming circuitry, a plurality of transmission paths, and analog beamforming circuitry.

The compression and modulation circuitry performs channel compression. At least one of a low-density parity check (LDPC) code, a convolutional code, and a polar code may be used for channel compression. The compression and modulation circuitry generates modulation symbols by performing constellation mapping.

The digital beamforming circuit performs beamforming on a digital signal (eg, a modulation symbol). To this end, the digital beamforming circuit multiplexes the modulation symbols by the beamforming weight value. The beamforming weight may be used to change the size and phrase of a signal, and may be referred to as a “precoding matrix” or a “precoder”. The digital beamforming circuit outputs digital beamformed modulation symbols to a plurality of transmission paths. In this case, modulation symbols may be multiplexed according to a multiple input multiple output (MIMO) transmission method, or the same modulation symbol may be provided to a plurality of transmission paths.

The plurality of transmission paths converts the digital beamformed digital signal into an analog signal. To this end, each of the plurality of transmission paths may include an inverse fast Fourier transform (IFFT) calculation unit, a cyclic prefix (CP) insertion unit, a DAC, and an up-conversion unit. The CP insertion unit is for an orthogonal frequency division multiplexing (OFDM) method and may be omitted when other physical layer methods (eg, a filter bank multi-carrier: FBMC) are applied. That is, the plurality of transmission paths provide independent signal processing processes for a plurality of streams generated through digital beamforming. However, depending on the implementation, some elements of a plurality of transmission paths may be used in common.

The analog beamforming circuit performs beamforming on an analog signal. To this end, the digital beamforming circuit multiplexes the analog signal by the beamforming weight value. Beamformed weights are used to change the size and text of the signal. More specifically, according to a connection structure between the plurality of transmission paths and the antenna, the analog beamforming circuit may be configured in various ways. For example, each of the plurality of transmission paths may be connected to one antenna array. In another example, a plurality of transmission paths may be coupled to one antenna array. In another example, the plurality of transmission paths may be adaptively coupled to one antenna array or may be coupled to two or more antenna arrays.

The steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, as a software module executed by hardware, or by a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present invention pertains.

In the above, embodiments of the present invention have been described with reference to the accompanying drawings, but those of ordinary skill in the art to which the present invention pertains can realize that the present invention can be embodied in other specific forms without changing the technical spirit or essential features thereof. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

100: operation server 200: shooting room server
300: user terminal 400: creator terminal

Claims (9)

As a photo studio operating system interlocked with a shooting room kiosk and a user terminal,
a photographing room kiosk provided in a photographing room to receive an input from a user of the user terminal and display an image photographed using a built-in camera to the user through a display;
an operation server for transmitting a device control signal for controlling lighting, music, and the camera of the recording room to the photographing room kiosk, and acquiring the image photographed through the camera from the photographing room kiosk; and
Comprising the user terminal to obtain the image by communicating with the operation server,
The operating server is
a shooting concept control unit for generating the device control signal based on the shooting concept selected by the user from the shooting room kiosk;
a sharing service providing unit that sets the photographed image as a shared image and shares the set shared image with the user terminal or the recording room kiosk; and
Comprising an image synthesizing unit for synthesizing the first image and the second image acquired in real time through the respective cameras of the first and second photographing room kiosks, which are different from each other,
The image synthesizing unit,
In response to receiving a request for a remote execution mode from a first user terminal, the first image and the second image are acquired, a second user is detected from the second image, and a plurality of images constituting the first image A pixel area corresponding to the second user is synthesized in frames,
When the pixel area corresponding to the first user and the pixel area corresponding to the second user of the first image overlap, comparing the depth value of the first user and the depth value of the second user in the overlapping portion; , the pixel area of the user having a high depth value is deleted, the pixel area of the user having a low depth value is maintained to generate a third image, and the generated third image is displayed on the display of the first recording room kiosk, ,
The first shooting room kiosk,
In response to obtaining a shooting input in a state in which the third image is displayed, taking a video corresponding to the third image,
The first user terminal,
Obtaining the captured video through the operation server, and determining a photo constituting a photo frame based on at least one image frame among a plurality of image frames constituting the obtained video,
In response to the first user's input for selecting the moving picture, generating the photo frame based on the moving image, and providing an interface for adjusting the generated photo frame through a display mounted on the first user terminal, ,
determining the shape of the picture frame, pictures constituting the picture frame, and the number of pictures according to the drag input of the first user obtained in the interface;
When the drag input of the first user for adjusting the size of the photo frame is not obtained for a first time, the size of the time at which the drag input is not obtained is determined as the size of the photo frame,
composing photos included in the photo frame to correspond to the shape and size of the photo frame determined according to the drag input;
In the video, a video in which a portion corresponding to each of the first second time and the last third time of the video is excluded is determined as a real video,
When the determined number of pictures is M, the first picture among the determined M pictures is determined as the first image frame of the first section among the (M-1) equalized sections of the real video, and the pictures after the first picture The N-th picture is determined as the last frame of the (N-1)-th section among the (M-1) equally divided sections of the real video, wherein M is a natural number greater than or equal to 2, and N is a natural number greater than or equal to 2 and less than or equal to M. In, the photo studio operating system. In claim 1,
The first user terminal,
A photo studio operating system for determining the thickness, color and number of photos that can be placed in the photo frame. delete delete In claim 1,
The first user terminal,
Acquire the source image with the filter effect applied from the internal storage,
estimating an original image without the filter effect from the source image;
comparing the source image with the original image to extract the filter effect,
Applying the extracted filter effect to the obtained image, a photo studio operating system. As a method of operating a shooting room kiosk and an operation server interlocked with a user terminal,
generating a device control signal from the shooting room kiosk based on a shooting concept selected by a user of the user terminal;
setting an image photographed using the photographing room kiosk as a shared image according to the device control signal, and sharing the set shared image with the user terminal or the photographing room kiosk;
synthesizing the first image and the second image acquired in real time through the respective cameras of the first and second photographing room kiosks, which are different from each other; and
obtaining the first image and the second image in response to a request for a remote execution mode from a first user terminal;
detecting a second user from the second image and synthesizing a pixel region corresponding to the second user with a plurality of image frames constituting the first image;
When the pixel area corresponding to the first user and the pixel area corresponding to the second user of the first image overlap, comparing the depth value of the first user and the depth value of the second user in the overlapping portion movement;
generating a third image by deleting a pixel region of a user having a high depth value and maintaining a pixel region of a user having a low depth value; and
Comprising the operation of displaying the generated third image on the display of the first recording room kiosk,
The first shooting room kiosk,
It is provided in a recording room to receive an input from the first user of the first user terminal, and to display the image photographed using a built-in camera to the user through the display of the first recording room kiosk,
In response to obtaining a shooting input in a state in which the third image is displayed, taking a video corresponding to the third image,
The first user terminal,
acquiring the image by communicating with the operation server;
Obtaining the captured video through the operation server, and determining a photo constituting a photo frame based on at least one image frame among a plurality of image frames constituting the obtained video,
In response to the first user's input for selecting the moving picture, generating the photo frame based on the moving image, and providing an interface for adjusting the generated photo frame through a display mounted on the first user terminal, ,
determining the shape of the picture frame, pictures constituting the picture frame, and the number of pictures according to the drag input of the first user obtained in the interface;
When the drag input of the first user for adjusting the size of the photo frame is not obtained for a first time, the size of the time point at which the drag input is not obtained is determined as the size of the photo frame,
composing photos included in the photo frame to correspond to the shape and size of the photo frame determined according to the drag input;
In the video, a video in which a portion corresponding to each of the first second time and the last third time of the video is excluded is determined as a real video,
When the determined number of pictures is M, the first picture among the determined M pictures is determined as the first image frame of the first section among the (M-1) equalized sections of the real video, and the pictures after the first picture The N-th picture is determined as the last frame of the (N-1)-th section among the (M-1) equally divided sections of the real video, wherein M is a natural number greater than or equal to 2, and N is a natural number greater than or equal to 2 and less than or equal to M. In, how the operation server works. A non-transitory recording medium in which a program for executing the method according to claim 6 is recorded and readable by a computer. A computer program recorded in a non-transitory recording medium in order to execute the method according to claim 6 in the operating server. As an operation server interlocked with the shooting room kiosk and user terminal,
a photographing concept control unit for generating a device control signal from the photographing room kiosk based on a photographing concept selected by the user of the user terminal;
a sharing service providing unit that sets an image photographed using the photographing room kiosk as a shared image according to the device control signal, and shares the set shared image with the user terminal or the photographing room kiosk; and
Comprising an image synthesizing unit for synthesizing the first image and the second image acquired in real time through the respective cameras of the first and second filming room kiosks, which are different from each other,
The photographing room kiosk is provided in the photographing room to receive an input from the user of the user terminal, and to display the image photographed using a built-in camera to the user through a display,
The user terminal acquires the image by communicating with the operation server,
The image synthesizing unit,
In response to receiving a request for a remote execution mode from a first user terminal, the first image and the second image are acquired, a second user is detected from the second image, and a plurality of images constituting the first image A pixel area corresponding to the second user is synthesized in frames,
When the pixel area corresponding to the first user and the pixel area corresponding to the second user of the first image overlap, comparing the depth value of the first user and the depth value of the second user in the overlapping portion; , the pixel area of the user having a high depth value is deleted, the pixel area of the user having a low depth value is maintained to generate a third image, and the generated third image is displayed on the display of the first recording room kiosk, ,
The first shooting room kiosk,
In response to obtaining a shooting input in a state in which the third image is displayed, taking a video corresponding to the third image,
The first user terminal,
Obtaining the captured video through the operation server, and determining a photo constituting a photo frame based on at least one image frame among a plurality of image frames constituting the obtained video,
In response to the first user's input for selecting the moving picture, generating the photo frame based on the moving image, and providing an interface for adjusting the generated photo frame through a display mounted on the first user terminal, ,
determining the shape of the picture frame, pictures constituting the picture frame, and the number of pictures according to the drag input of the first user obtained in the interface;
When the drag input of the first user for adjusting the size of the photo frame is not obtained for a first time, the size of the time point at which the drag input is not obtained is determined as the size of the photo frame,
composing photos included in the photo frame to correspond to the shape and size of the photo frame determined according to the drag input;
In the video, a video in which a portion corresponding to each of the first second time and the last third time of the video is excluded is determined as a real video,
When the determined number of pictures is M, the first picture among the determined M pictures is determined as the first image frame of the first section among the (M-1) equalized sections of the real video, and the pictures after the first picture The N-th picture is determined as the last frame of the (N-1)-th section among the (M-1) equally divided sections of the real video, wherein M is a natural number greater than or equal to 2, and N is a natural number greater than or equal to 2 and less than or equal to M. In, operational server.

Images