KR102388317B1 - The method and system for operating photo studio - Google Patents

Abstract

A photo studio operating method and a system thereof are disclosed. Embodiments relate to the photo studio operating method and the system thereof. Specifically, the method and the system thereof control a lamp, music and a camera of a photographing room according to a photographing concept selected by a user, analyze behavior of the user to control the lamp of the photographing room, and set an optimum camera parameter that the user wants from a test picture of the user based on machine learning.

Description

Photo studio operation method and system {THE METHOD AND SYSTEM FOR OPERATING PHOTO STUDIO}

The following embodiments relate to a photo studio operating method and system, specifically, according to the shooting concept selected by the user, controlling the lighting, music and camera of the shooting room, analyzing the user's behavior to control the lighting of the shooting room, To a method and system for setting an optimal camera parameter desired by a user from a user's test photo based on running.

General photography is one of the sensitive tasks that is affected by light. Accordingly, advertisement photos that can provide accurate information about a specific subject, including commemorative photos such as 100 days photo, stone photo, and wedding photo, are being taken by professional photographers.

On the other hand, as photography is required to be able to shoot while controlling interference caused by light, it is required to shoot in a closed studio where light control is easy. These studios require operator accessibility to adjust the light in a static position that maintains an appropriate height and distance from the subject.

Accordingly, in recent years, research has been continuously conducted to conveniently provide various studio environments in order to improve the shooting accessibility of workers.

In the past, the production of commemorative photo albums was completed in a photo studio, completed by itself, and provided to consumers (users). However, due to the spread of the Internet and the development of digital technology, when a user takes a photo in a photo studio and requests for album production, the photo file to be used in the album is read using the photo studio's website or web hard drive, and also The service has been improved so that digital files can be downloaded.

However, it is not an easy task to set various parameters of the camera or the lighting of the subject or shooting environment to take the desired picture. In most cases,

Therefore, various methods are required to take high-quality photos with the lighting and atmosphere that users want, even if they do not have professional knowledge about photography.

Matters described in this background section are prepared to promote understanding of the background of the invention, and may include matters not already known to those of ordinary skill in the art to which this technology belongs.

The following embodiments have been devised to solve the above problems, and according to the shooting concept selected by the user, the lighting, music and camera of the shooting room are controlled, the lighting of the shooting room is controlled by analyzing the user's behavior, and machine learning The purpose of this is to derive a photo studio operating method and system that sets the optimal camera parameters desired by the user from the user's test photos based on

Problems to be solved by one embodiment are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

One embodiment for achieving the above object is an operating method of a photo studio operation server, comprising: receiving a photographing concept selected by a user from a photographing room server; extracting concept data corresponding to the shooting concept selected by the user by using the concept mapping table; generating a device control signal including a control signal of at least one of a lighting device, a speaker, and a camera by using the concept data; and transmitting the device control signal to the shooting room server to control at least one of the lighting, a speaker, and a camera, wherein the concept data includes music corresponding to the shooting concept selected by the user, a background image, and the It provides an operating method of a photo studio operation server including at least one of a light color of a lighting device, illuminance information of the lighting device, and a camera parameter,

In one embodiment, when a preset determination period arrives, a detection signal according to a user action prior to each of a plurality of pattern periods is analyzed based on each of the plurality of pattern periods based on the arrival time of the determination period, and the plurality of patterns extracting a behavior pattern for each cycle; determining the behavior of the user by comparing the behavior pattern of each of the plurality of pattern periods with at least one standard behavior pattern provided for each of the plurality of pattern periods; and generating the device control signal including the control signal of the lighting device according to the determined user action, wherein the analysis is a three-sided analysis in consideration of time attributes based on each of a plurality of pattern periods Including, wherein the three-sided analysis includes a first surface of the amount of motion according to the plurality of pattern periods, and a second surface of the amount of sound according to the plurality of pattern periods, and the second surface of the amount of movement according to the sound amount Includes 3 sides.

In one embodiment, receiving a test picture from the user; predicting the camera parameters by inputting the test picture into a parameter prediction model; and generating the device control signal including a control signal of the camera by using the predicted camera parameter.

In one embodiment, when there are a plurality of predicted camera parameters, the device determines a final camera parameter by comparing it with a camera parameter of a shooting concept selected by the user, and includes a control signal of the camera using the final camera parameter The method further comprises generating a control signal.

One embodiment includes at least one processor; and a memory (memory) for storing instructions instructing the at least one processor to perform at least one operation, as a photo studio operation server, wherein the at least one operation is photographed receiving the shooting concept selected by the user from the room server; extracting concept data corresponding to the shooting concept selected by the user by using the concept mapping table; generating a device control signal including a control signal of at least one of a lighting device, a speaker, and a camera by using the concept data; and transmitting the device control signal to the shooting room server to control at least one of the lighting, a speaker, and a camera, wherein the concept data includes music corresponding to the shooting concept selected by the user, a background image, and the It provides a photo studio operation server including at least one of a light color of a lighting device, illuminance information of the lighting device, and a camera parameter.

One embodiment provides a photo studio operating system.

The photo studio operating system includes: a camera, a speaker, a light, and a sensor provided in a recording room; a photographing room server provided in the photographing room to control the camera, the speaker, the lighting, and the sensor based on a device control signal; and the operation server for transmitting the device control signal to the recording room server.

The operation server, at least one processor (processor); and a memory for storing instructions instructing the at least one processor to perform at least one operation.

The at least one operation may include: receiving a shooting concept selected by a user from a shooting room server; extracting concept data corresponding to the shooting concept selected by the user by using the concept mapping table; generating a device control signal including a control signal of at least one of a lighting device, a speaker, and a camera by using the concept data; and transmitting the device control signal to the recording room server to control at least one of the lighting, a speaker, and a camera.

The concept data includes at least one of music corresponding to the shooting concept selected by the user, a background image, a light color of the lighting device, illuminance information of the lighting device, and camera parameters.

According to the exemplary embodiments as described above, it is possible to provide an environment in which the user can take a picture according to the desired concept by controlling the lighting, music, and camera of the shooting room according to the shooting concept selected by the user.

In addition, by detecting the user's behavior in real time and determining the user's behavior in consideration of the time attribute, it is possible to provide a lighting environment of the shooting room suitable for various behaviors of the user according to time change.

In addition, by setting the lighting environment of the photographing room suitable for the user's action in consideration of the illuminance of the user's location, the user's desired photographing environment may be provided.

In addition, by using machine learning, it is possible to extract the optimal camera parameters desired by the user from the user's test photo and apply it to the camera in the shooting room.

Effects of one embodiment are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram illustrating a photo studio operating system according to an exemplary embodiment.
2 is a diagram illustrating a configuration of a photo studio operating server according to an exemplary embodiment.
3 is a diagram illustrating a configuration of a photographing concept control unit according to an exemplary embodiment.
4 is a diagram illustrating an example of a photographing concept table according to an embodiment.
5 is a flowchart of a method for controlling a shooting concept according to an exemplary embodiment.
6 is a diagram illustrating a configuration of a lighting control unit according to an embodiment.
7 is a diagram for explaining a user behavior analysis method according to an embodiment.
8 and 9 are diagrams for explaining three-sided analysis of the behavior pattern extractor according to an embodiment.
10 is a flowchart of a lighting control method according to an embodiment.
11 is a diagram for describing a parameter prediction model according to an embodiment.
12 is a diagram illustrating a configuration of a user terminal according to an embodiment.
13 is a diagram illustrating a wireless communication system that can be applied in a communication process according to an embodiment of the present invention.
14 is a diagram illustrating a base station in the wireless communication system according to FIG. 13 .
15 is a diagram illustrating a terminal in the wireless communication system according to FIG. 13 .
16 is a diagram illustrating a communication interface in the wireless communication system according to FIG. 13 .

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present invention to be complete, and those of ordinary skill in the art to which the present invention pertains. It is provided to fully understand the scope of the present invention to those skilled in the art, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein will have the meaning commonly understood by those of ordinary skill in the art to which this invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

Hereinafter, an embodiment will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a photo studio operating system 10 according to an exemplary embodiment.

Referring to FIG. 1 , a photo studio operating system 10 according to an embodiment includes an operating server 100 , a shooting room server 200 , a camera 210 , a speaker 220 , a light 230 , and a sensor 240 . ) and the user terminal 300 .

Communication between various entities included in the photo studio operating system 10 may be performed through a wired/wireless network. A wired/wireless network may use standard communication technologies and/or protocols.

In the photo studio operating system 10, the operating server 100, the shooting room server 200, and the user terminal 300 are, for example, a computer, an Ultra Mobile PC (UMPC), a workstation, a net-book, Electronic devices such as personal digital assistants (PDAs), portable computers, web tablets, wireless phones, mobile phones, smart phones, and portable multimedia players (PMPs) As one of them, all electronic devices capable of installing and executing an application related to an embodiment may be included. The electronic device may perform overall service operations such as, for example, configuration of a service screen, data input, data transmission/reception, data storage, and the like, under the control of the application.

The operation server 100 is a server that provides various functions related to operation of the photo studio.

The operation server 100 may control the lighting, music, and camera of the shooting room according to the shooting concept selected by the user.

The operation server 100 may analyze the user's behavior and control the lighting of the shooting room according to the user's behavior pattern.

The operation server 100 may set the optimal camera parameters desired by the user from the user's test photos based on machine learning, and may control the camera 210 according to the set camera parameters.

The operation server 100 may transmit a device control signal to the photographing room server 200 to control various devices provided in the photographing room.

The operation server 100 may transmit a photograph taken by the camera 210 to the user terminal 300 , and may receive a test photograph from the user terminal 300 .

A detailed configuration and function of the operation server 100 will be described in detail below with reference to FIG. 2 .

The photographing room server 200 is a server provided in the photographing room to provide users with various functions necessary for photographing.

The shooting room server 200 can control the camera 210, the speaker 220, the lighting 230 and the sensor 240 provided in the shooting room by using the device control signal received from the operation server 100. there is.

The photographing room server 200 may receive a sensor value from the sensor 240 and transmit the received sensor value to the operation server 100 .

The shooting room server 200 may be provided with input means such as a touch screen, a keyboard, a mouse, and a microphone, and the shooting room server 200 may receive shooting setting information and device control information from the user through the input means. . According to an embodiment, the shooting setting information may include a shooting concept, photo size, number of shots, and the like, and the device control information may include camera parameters, illumination intensity, lighting color, shooting music, speaker volume, and the like.

The photographing room server 200 may include output means such as a display device and a speaker, and the photographing room server 200 may output various information necessary for photographing to the user through the output means. For example, the shooting room server 200 may output a shooting concept selectable by the user and a picture taken by the user.

The photographing room server 200 may provide a payment function necessary for photographing to the user.

The camera 210 is provided in the photographing room, and a user can take a picture directly by using the camera 210 .

The camera 210 may be learned and set in the operation server 100 or may take a picture by applying a camera parameter input by a user through the shooting room server 200 .

The camera parameter according to an embodiment may include values such as picture quality, size, camera sensitivity (ISO), filter, aperture, shutter speed, and the like.

The speaker 220 is provided in the shooting room, and can play shooting music.

The lighting 230 may include a plurality of lighting devices provided in the photographing room, and may output light according to a device control signal.

The sensor 240 may include a motion sensor 241 , a voice sensor 242 , and an illuminance sensor 243 provided in the photographing room.

The motion sensor 241 may detect a motion signal generated according to a user's motion. The voice sensor 242 may detect an acoustic signal generated according to a user's movement and a voice command signal that may be issued according to a specific situation of the user. The illuminance sensor 243 may recognize an illuminance value at the user's location.

The user terminal 300 may output the photographed picture received from the operation server 100 to the user.

The user terminal 300 may transmit a test photo as learning data to the operation server 100 .

A detailed configuration and function of the user terminal 300 will be described in detail below with reference to FIG. 12 .

2 is a diagram showing the configuration of the operation server 100 according to an embodiment.

Referring to FIG. 2 , the operation server 100 according to an embodiment includes a communication unit 110 , an input unit 120 , an output unit 130 , a memory 140 , a power supply unit 150 , and a control unit 160 . can do. The control unit 160 may include a shooting concept control unit 170 , a lighting control unit 180 , and a parameter setting unit 190 .

The configurations shown in FIG. 2 are exemplary diagrams for implementing embodiments of the present invention, and appropriate hardware/software configurations at a level apparent to those skilled in the art may be additionally included in the operation server 100 .

The communication unit 110 may communicate with an external device through various communication methods. For example, the communication unit 110 may transmit and receive various data by performing communication with the shooting room server 200 and the user terminal 300 .

The input unit 120 may receive various inputs of an administrator who is a user of the operation server 100 and transmit it to the control unit 160 . In particular, the input unit 120 may include a touch sensor, a (digital) pen sensor, a pressure sensor, a key, or a microphone. The touch sensor may use, for example, at least one of a capacitive type, a pressure sensitive type, an infrared type, and an ultrasonic type. The (digital) pen sensor may be, for example, a part of a touch panel or may include a separate recognition sheet. The key may include, for example, a physical button, an optical key, or a keypad. The microphone is a configuration for receiving the manager's voice, and may be provided inside the operation server 100 , but this is only an example, and it is provided outside of the operation server 100 to be electrically connected to the operation server 100 . can

The output unit 130 may provide various screens. For example, the output unit 130 may output a concept mapping table to the manager.

The memory 140 may store commands or data related to at least one other component of the operation server 100 . In particular, the memory 140 may be implemented as a non-volatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). The memory 140 is accessed by the controller 160 , and reading/writing/modification/deletion/update of data by the controller 160 may be performed. In the present invention, the term "memory" refers to a memory 140, a ROM (not shown) in the controller 160, a RAM (not shown), or a memory card (not shown) mounted in the operation server 100 (eg, micro SD). card, memory stick). In addition, programs and data for configuring various screens to be displayed on the display area of the output unit 130 may be stored in the memory 140 .

The power supply unit 150 receives external power and internal power under the control of the control unit 160 to supply power necessary for the operation of each component.

The control unit 160 is electrically connected to the communication unit 110 , the input unit 120 , the output unit 130 , the memory 140 , and the power supply unit 150 to control the overall operation and function of the operation server 100 . can In particular, the controller 160 may provide functions to be described later using various modules stored in the memory 140 .

It will be apparent that various operations on the operation server 100 described below may be performed under the control of the controller 160 .

As described above, the control unit 160 may be configured to include a shooting concept control unit 170 , a lighting control unit 180 , and a parameter setting unit 190 .

The shooting concept controller 170 may control lighting, music, and a camera in the shooting room according to the shooting concept selected by the user.

The shooting concept control unit 170 may use the shooting concept received from the shooting room server 200 to generate control signals for lighting, a speaker, and a camera of the shooting room. The photographing concept controller 170 may generate a device control signal including control signals of lighting, a speaker, and a camera of the photographing room by using the concept mapping table. Here, the control signal of the camera is the same signal as the above-described camera parameter.

A detailed configuration and function of the shooting concept control unit 170 will be described in detail below with reference to FIG. 3 .

The lighting controller 180 may analyze the user's behavior and control the lighting of the shooting room according to the user's behavior pattern.

The lighting control unit 180 may analyze the user's behavior obtained from the sensor 240 and the illuminance of the user's location to determine the user's behavioral pattern. The lighting controller 180 may generate a device control signal including a lighting control signal of a photographing room according to the identified user's behavior pattern.

A detailed configuration and function of the lighting control unit 180 will be described in detail below with reference to FIG. 6 .

The parameter setting unit 190 may predict the optimal camera parameter desired by the user from the test photo input by the user based on machine learning, and may control the camera 210 according to the predicted camera parameter.

A method of predicting camera parameters of the parameter setting unit 190 will be described in detail below with reference to FIG. 11 .

The controller 160 may control the communication unit 110 to transmit a device control signal to the photographing room server 200 to control various devices provided in the photographing room.

The device control signal of an embodiment includes the lighting, speaker and camera control signals (camera parameters) generated by the shooting concept control unit 170 , the lighting control signal generated by the lighting control unit 180 , and the camera generated by the parameter setting unit 190 . It may contain parameters.

The controller 160 may control the communication unit 110 to transmit a picture taken by the camera 210 to the user terminal 300 , and may receive a test picture from the user terminal 300 .

The control unit 160 may receive, through the input unit 120 , data related to the shooting concept mapping table and a learning picture from the manager.

3 is a diagram illustrating the configuration of the photographing concept control unit 170 according to an exemplary embodiment.

Referring to FIG. 3 , the photographing concept controller 170 according to an embodiment may include a concept mapping table generator 171 , a concept mapping table DB 172 , and a device control signal generator 173 .

The concept mapping table generation unit 171 may receive data from the manager, generate the photographing concept mapping table 174 , and store the generated concept mapping table 174 in the concept mapping DB 172 . The device control signal generator 173 may generate a device control signal for a shooting concept selected by the user by using the concept mapping table 174 .

4 is a diagram illustrating an example of a concept mapping table 174 according to an embodiment.

Referring to FIG. 4 , a concept mapping table 174 according to an embodiment is a data structure including a photographing concept name, a photographing concept image, music, a background image, light color and illuminance information of a lighting device provided in a photographing room, and camera parameters. am.

The shooting concept control unit 170 transmits the generated concept mapping table 174 to the shooting room server 200 , and the shooting room server 200 may output and select a shooting concept selectable by the user.

The shooting concept control unit 170 may receive the shooting concept selected by the user from the shooting room server 200 .

The shooting concept controller 170 may generate a device control signal for the shooting concept selected by the user by using the concept mapping table 174 .

The shooting concept control unit 170 uses the concept mapping table 174 to include music corresponding to the shooting concept selected by the user, a background image, light color and illuminance information of lighting equipment provided in the shooting room, and camera parameters. data can be extracted.

The photographing concept control unit 170 may generate control signals of the lighting 230 , the speaker 220 , and the camera 21 by using the extracted concept data. As described above, here the control signal of the camera is the same signal as the above-mentioned camera parameter.

For example, when the user selects the shooting concept of 'Concept A', the shooting concept control unit 170 controls the music corresponding to 'Concept A' in the concept mapping table 174, the background image, and the lighting equipment provided in the shooting room. A device control signal including light color and illuminance information and camera parameters may be generated.

5 is a flowchart of a method for controlling a shooting concept according to an exemplary embodiment.

Referring to FIG. 5 , the method for controlling a shooting concept according to an embodiment may include a step of receiving a shooting concept ( S100 ), a step of extracting concept data ( S110 ), and a step of generating a device control signal ( S120 ).

First, in the photographing concept receiving step S100 , the photographing concept control unit 170 may receive the photographing concept selected by the user from the photographing room server 200 .

And, in the concept data extraction step ( S110 ), the shooting concept control unit 170 uses the concept mapping table 174 , music corresponding to the shooting concept selected by the user, the background image, and the light of the lighting equipment provided in the shooting room. Concept data including color and illuminance information and camera parameters can be extracted.

Then, in the device control signal generation step ( S120 ), the shooting concept controller 170 may generate control signals for the lighting 230 , the speaker 220 , and the camera 21 using the extracted concept data.

Accordingly, the shooting concept control unit 170 may control the lighting, music, and camera of the shooting room according to the shooting concept selected by the user, thereby providing an environment in which the user can take a picture according to the desired concept.

6 is a diagram illustrating the configuration of the lighting control unit 180 according to an embodiment.

Referring to FIG. 6 , the lighting control unit 180 may include a sensing unit 181 , a control unit 182 , a service providing unit 183 , and a template DB 184 .

The detection unit 181 may detect a user action and provide a detection signal corresponding to the sensed action to the control unit 182 , and the detection unit 181 may include a motion sensor 241 , a voice sensor 120 and Corresponding sensor data may be received from the illuminance sensor 130 .

As described above, the motion sensor 241 may detect a motion signal generated according to the user's motion, and the voice sensor 242 may emit an acoustic signal generated according to the user's motion and a specific situation of the user. A voice command signal may be detected, and the illuminance sensor 243 may recognize an illuminance value of natural light at the user's location.

When the preset determination period arrives, the control unit 182 analyzes the detection signals prior to each of the plurality of pattern periods based on the arrival time of the determination period on the basis of each of the plurality of pattern periods to perform a behavior pattern for each of the plurality of pattern periods A service providing unit to extract and compare the behavior pattern of each of the plurality of pattern periods with at least one standard behavior pattern provided for each of the plurality of pattern periods to determine the user's behavior and provide a service suitable for the determined user's behavior (183) can be controlled.

The control unit 182 may be configured to include an analysis unit 182-1, a behavior pattern extraction unit 182-2, a comparison determination unit 182-3, and a service providing unit control unit 182-4.

The analysis unit 182-1 analyzes the detection signals up to each of the plurality of pattern periods prior to each of the plurality of pattern periods based on the arrival time of the determination period when a preset determination period arrives, based on each of the plurality of pattern periods, and analyzes the behavior pattern extraction unit 182- 2), and may include a plurality of pattern cycles.

A plurality of pattern periods can each be analyzed in consideration of the temporal properties of the sensing signal, including a short-term pattern period (eg, 5 seconds), a medium-term pattern period (eg, 1 minute) and a long-term pattern period (eg, 1 minute). , 5 min) may be included.

7 is a diagram for explaining a user behavior analysis method according to an embodiment.

Referring to FIG. 7 , the short-term pattern period may be used as reference data for extracting behavior patterns during a medium-term pattern period and a long-term pattern period other than the short-term pattern period among a plurality of pattern periods. Specifically, the analysis process can be minimized by using the average and standard deviation of the data signals derived by analyzing the previous detection signal based on the short-term pattern period as the behavior pattern extraction data for each of a plurality of pattern periods. The point of arrival of the judgment cycle (for example, 2.5 seconds) may be a time point at which the preset judgment cycle overlaps by 50%, and data cutoff can be prevented by overlapping and analyzing the preset judgment cycle by overlapping 50%. there is.

The behavior pattern extraction unit 182-2 extracts a behavior pattern for each of a plurality of pattern periods through three-sided analysis (yz, xy, xz) and provides the extracted behavior pattern to the comparison determination unit 182-3. can

8 and 9 are diagrams for explaining three-sided analysis of the behavior pattern extractor according to an embodiment.

Referring to FIG. 9 , the three-sided analysis considers the time properties of the detection signal based on each of a plurality of pattern periods, the size of the acoustic signal (x-axis), the plurality of pattern periods (y-axis), and the magnitude of the motion signal (z-axis). ) and extracting a plurality of behavior patterns, it is possible to more accurately grasp the behavior of various users over time by considering the temporal attribute for a specific behavior, and the first side (yz), the second side (xy) and It may include a third surface (xz).

Referring to FIG. 8A , the first side obtains a time average of a motion signal using a plurality of pattern periods as one axis, determines a section on one axis through the standard deviation of the time average, and uses the motion signal size as the other axis to determine the size of the motion signal. By obtaining the size average and determining the section of the rudder axis through the standard deviation of the size average to determine the characteristics of the motion signals for each of a plurality of pattern periods according to time, the user's behavior with respect to various user movements over time can be grasped.

Referring to FIG. 8A , the second side obtains the time average of the acoustic signal with a plurality of pattern periods as one axis, determines a section on one axis through the standard deviation of the time average, and uses the acoustic signal size as the other axis to determine the sound signal level. By obtaining the size average, determining the section of the rudder axis through the standard deviation of the size average, and identifying the characteristics of the acoustic signal for each period of a plurality of patterns according to time, it is possible to grasp the user's behavior toward the sound of various users over time.

Referring to FIG. 8B , the third side obtains the average amplitude of the sound signal with the amplitude of the sound signal as one axis, determines a section on one axis through the standard deviation of the average, and sets the amplitude of the motion signal as the other axis. Various user behaviors can be identified by comparing the ratio between the motion signal and the sound signal by obtaining the average and determining the section of the rudder axis through the standard deviation of the size average.

The plurality of behavior patterns may be a user's life pattern in consideration of a time attribute, and may include a short-term behavior pattern, a medium-term behavior pattern, and a long-term behavior pattern. The short-term behavior pattern may be a pattern for a user's voice command, and may include an illuminance control command. The illuminance control command may be a voice command such as illuminance increase/decrease control and ON/OFF according to the user's need. The medium-term behavior pattern may be a pattern for a sudden change in behavior, such as a change in a user's gesture. The long-term behavior pattern may be a pattern for a gentle temporal behavior change, such as moving a user's location. The comparison determination unit 182-3 compares the behavior pattern obtained through three-sided analysis of each of the plurality of pattern periods with at least a standard behavior pattern provided for each of the plurality of pattern periods to determine the user's behavior in real time, and the service providing unit control unit (182-4) may be provided. Here, the standard behavior pattern may be in the same format as the behavior pattern obtained through the three-sided analysis.

On the other hand, the comparison determination unit 182-3 synchronizes the time-series measurement data of the motion and sound amplitude signal with the time-series measurement data of the motion and sound amplitude signal, and calculates the correlation coefficient using Equation 1 below. It is possible to determine the user's behavior in real time based on the standard behavior pattern with the highest similarity.

Here, rxy is a correlation coefficient, n is the number of data, xi is time-series measurement data of the motion amplitude signal, yi is time-series measurement data of the sound amplitude signal, ^x is time-series standard data of the movement amplitude signal, and ^y is This is time-series standard data for the loudness signal, and a method using a correlation coefficient may be useful in determining the behavior of a short-term periodic pattern.

The service providing unit control unit 182-4 may control the service providing unit 183 to provide a service suitable for the determined user's behavior, and may include a voice command recognition type mode and an intelligent mode.

The voice command recognition type mode may provide illuminance control suitable for the user's behavior by giving priority to a voice command, and the illuminance control by the voice command may be maintained until another voice command or a preset time elapses.

The intelligent mode may control the illuminance of the user's location to an illuminance suitable for the user's behavior.

Intelligent mode and voice command recognition mode can perform complementary functions.

The service providing unit 183 may be equipped with at least one preset service function, and may include a lighting control signal generating unit 183-1.

The lighting control signal generation unit 183-1 may include a light emitting means to generate a device control signal capable of providing, turning on and off an illuminance suitable for a user's behavior under the control of the service providing unit control unit 182-4. there is.

The template DB 184 may store at least one standard behavior pattern provided for each of a plurality of pattern periods, and a behavior pattern DB 184-1, a voice command DB 184-2, and a voice command DB 184-2 for each of the plurality of pattern periods. It may include an illuminance DB (184-3).

The behavior pattern DB 184-1 may be pre-stored data by classifying the behavior based on a detection signal that can be detected when the user performs a specific behavior in consideration of the time attribute.

The voice command DB 184-2 may be pre-stored data by classifying voices such as illuminance increase/decrease control and ON/OFF according to the user's need in consideration of the time attribute.

The illuminance DB 184 - 3 may be data in which a numerical value of a standard illuminance value suitable for a specific action by the user is pre-stored.

10 is a flowchart of a lighting control method according to an embodiment.

Referring to FIG. 10 , the smart lighting control unit 180 may detect the user's movement, sound, and illuminance in real time using the detection unit 100 ( S201 ), and analyze the detected signal by the analysis unit 182-1 . can be used for analysis based on each of a plurality of pattern periods (S202).

Next, the behavior pattern extraction unit 182-2 may extract a behavior pattern for each of a plurality of pattern periods (S203).

Next, the comparison determination unit 182-3 may determine the user's behavior in real time by comparing the behavior pattern of each of the plurality of pattern periods with at least one standard behavior pattern provided for each of the plurality of pattern periods (S204) .

Next, the service providing unit control unit 182-4 may determine whether a voice command is made (S205), and in the case of a voice command, it may determine an illuminance suitable for the user's action in consideration of the illuminance of the user's location (S206) .

Next, the service providing unit 183 may increase/decrease the illuminance value to an illuminance suitable for the determined user action (S207).

The service providing unit control unit 182-4, in S205, when it is determined that the user's behavior pattern is a pattern for a voice command, it can determine whether the lighting control command for the voice command (S208).

The service providing unit control unit 182-4 may increase/decrease the illuminance value with the illuminance according to the user's voice command using the service providing unit 183 in the case of a lighting control command in S208 (S209).

Next, it can be determined whether another voice command or a preset time has elapsed when controlling the increase/decrease of the illuminance value with the illuminance by the user's voice command (S210), and if other voice commands are not recognized or the preset time has elapsed, the illuminance value is maintained can be (S211).

Accordingly, the lighting control unit 180 detects the user's behavior in real time and determines the user's behavior in consideration of the time attribute, thereby providing a lighting environment of the shooting room suitable for the user's various behaviors according to time changes, and By setting the lighting environment of the photographing room suitable for the user's behavior in consideration of the illuminance, the user's desired photographing environment may be provided.

Hereinafter, the parameter setting unit 190 will be described.

The parameter setting unit 190 may predict an optimal camera parameter desired by the user based on the test photo input by the user, and may control the camera 210 according to the predicted camera parameter.

To this end, the parameter setting unit 190 may generate learning data from the learning picture received from the manager. As an example, the parameter setting unit 190 may generate the training photo as it is as the learning data, detect a color change section from the learning photo, and divide and compress the learning photo according to the detected color change section, thereby converting the learning data. can create

The parameter setting unit 190 may extract a characteristic value from the training data. The characteristic value of an embodiment may include a representative color, representative saturation, or representative subject of the photo.

The parameter setting unit 190 may generate camera parameters of the training data. As described above, the camera parameter of an embodiment may include values such as picture quality, size, camera sensitivity (ISO), filter, aperture, shutter speed, etc., and the parameter setting unit 190 learns from the learning data. By extracting the image quality, size, and sensitivity (ISO), filter, aperture, shutter speed, etc. of the camera that took the training picture, camera parameters of the training data can be created.

The parameter setting unit 190 may predict the optimal camera parameter desired by the user through machine learning by using the characteristic value of the training data and the camera parameter.

First, the parameter setting unit 190 may learn the parameter prediction model 191 by using the training picture input from the manager, and input the test picture input from the user into the learned parameter prediction model, and the camera optimized for the user parameters can be predicted.

11 is a diagram for describing a parameter prediction model 192 according to an embodiment.

Referring to FIG. 11 , the parameter setting unit 190 may include a parameter prediction model learning unit 191 and a parameter prediction model 192 . The parameter prediction model learning unit 191 and the parameter prediction model 192 are configured according to the functions of the parameter setting unit 190 , and it is obvious that the parameter setting unit 190 can implement all the corresponding functions.

An artificial neural network may be used as the parameter prediction model 192 according to an embodiment. An artificial neural network is a predictive model implemented in software or hardware that mimics the computational power of a biological system using a large number of artificial neurons (or nodes).

The parameter prediction model 192 may be supervised by the parameter prediction model learning unit 191 using characteristic values of training data and camera parameters. In this case, supervised learning means learning to find an output value according to a given input value by using data having an input value and an output value according to it as learning data, and it means learning performed in a state where the correct answer is known. The set of input and output values given to supervised learning is called training data. That is, the above-described characteristic value of the training data is an input value, and the camera parameter of the training data is an output value, which may be used as training data for supervised learning of the parameter prediction model 192 .

For example, the parameter prediction model learning unit 191 converts a characteristic value of the training data into a unique first one-hot vector to generate an input value, and sets the camera parameter of the training data to a unique value. After generating an output value by converting it into a second one-hot vector, the parameter prediction model 192 may be supervised using the generated input and output values. Here, the first one-hot vector and the second one-hot vector may be vectors in which one of component values constituting the vector is '1' and the other component values are configured as '0'.

In one example, the parameter prediction model 192 receives an input value and multiplies a connection strength (or weight) for each output value of the input layer and the input layer having nodes corresponding to the number of components of the first one-hot vector, and , one or more hidden layers outputting by adding a bias; and an output layer for multiplying each output value of the hidden layer by a connection strength (or weight) and outputting the result using an activation function. Here, the activation function may be a LeRU function or a Softmax function, but is not limited thereto. Connection strength and bias can be continuously updated by supervised learning.

Specifically, the parameter prediction model 192 may be supervised so that an output value of a loss function according to a given input value (a first one-hot vector) and an output value (a second one-hot vector) is minimized. . For example, the loss function H(Y, Y`) may be defined as in Equation 2 below.

In Equation 2, Ym may be the m-th component of the second one-hot vector, and Y'm may be the m-th component of the output vector output by receiving the first one-hot vector from the parameter prediction model 192 .

As the amount of training data increases, more supervised learning is performed on the parameter prediction model 192 to increase the accuracy of the parameter prediction model 192 .

An artificial neural network may be used for the parameter prediction model 192 . For example, the parameter prediction model 192 may be implemented as a Bidirectional LSTM (Bi-LSTM) or a Convolutional Neural Network (CNN).

The parameter prediction model 192 may predict a camera parameter optimized for the user by using the test photo input from the user.

The parameter setting unit 190 is a camera parameter of a shooting concept selected by the user as the plurality of predicted camera parameters when there are a plurality of camera parameters predicted by the parameter prediction model 192 , that is, when the user inputs a plurality of test photos. By comparing with , it is possible to determine the final camera parameters.

The parameter setting unit 190 may determine a predicted camera parameter most similar to a camera parameter of a shooting concept selected by the user from among the plurality of predicted camera parameters as the final camera parameter.

As described above, the camera parameter may include values such as picture quality, size, sensitivity (ISO), filter, aperture, and camera shutter speed. The predicted camera parameter having the smallest average of the difference between the value and the difference may be determined as the final camera parameter. The parameter may be determined as the final camera parameter.

The parameter setting unit 190 may control the camera 210 by generating a device control signal using the predicted camera parameter (final camera parameter).

Accordingly, the parameter setting unit 190 may extract the optimal camera parameter desired by the user from the user's test photo by using machine learning and apply it to the camera 210 of the shooting room.

12 is a diagram illustrating a configuration of a user terminal 300 according to an embodiment. Hereinafter, components constituting the user terminal 300 shown in FIG. 12 will be described in turn.

The wireless communication unit 310 may include one or more components that perform wireless communication between the user terminal 300 and the wireless communication system or wireless communication between the user terminal 300 and the network in which the user terminal 300 is located. . For example, the wireless communication unit 310 may include a broadcast reception module 311 , a mobile communication module 312 , a wireless Internet module 313 , a short-range communication module 314 , and a location information module 315 , etc. .

The broadcast reception module 311 receives a broadcast signal and/or broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. Meanwhile, broadcast-related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 312 .

In addition, the mobile communication module 312 transmits and receives a wireless signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 313 refers to a module for wireless Internet access, and may be built-in or external to the user terminal 300 .

The short-range communication module 314 refers to a module for short-range communication. As the short-distance communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used.

Also, the location information module 115 is a module for confirming or obtaining the location of the user terminal 300 . An example is a Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude.

Meanwhile, the A/V (Audio/Video) input unit 320 is for inputting an audio signal or a video signal, and may include a camera 321 , a microphone 322 , and the like. The camera 321 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a shooting mode. Then, the processed image frame may be displayed on the display unit 351 .

The image frame processed by the camera 321 may be stored in the memory 360 or transmitted to the outside through the wireless communication unit 310 . Two or more cameras 321 may be provided according to the configuration of the user terminal 300 .

The microphone 322 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data. In addition, the processed voice data may be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 312 and output in the call mode. The microphone 322 may implement various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 330 receives an input operation from the user and generates input data for controlling the operation of the user terminal 300 .

The sensing unit 340 detects the current state of the user terminal 300 , such as the location of the user terminal 300 , the presence of user contact, the orientation of the user terminal 300 , and acceleration/deceleration of the user terminal 300 . A sensing signal for controlling the operation of the terminal 300 is generated.

The interface unit 370 serves as an interface with all external devices connected to the user terminal 300 . For example, wired/wireless headset ports, external charger ports, wired/wireless data ports, memory card ports, ports for connecting devices equipped with identification modules, audio input/output (I/O) ports, It may include a video input/output (I/O) port, an earphone port, and the like.

The output unit 350 is for outputting an audio signal, a video signal, or an alarm signal, and may include a display unit 351 , a sound output module 352 , an alarm unit 353 , and the like.

The display unit 351 displays and outputs information processed by the user terminal 300 . For example, when the terminal is in a call mode, a user interface (UI) or graphic user interface (GUI) related to a call is displayed. And, when the user terminal 300 is in the video call mode or the shooting mode, the captured and/or received image or UI and GUI are displayed.

Meanwhile, as described above, when the display unit 351 and the touch pad form a layer structure to form a touch screen, the display unit 351 may be used as an input device in addition to an output device. The display unit 351 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display ( 3D display). In addition, two or more display units 351 may exist according to an implementation form of the user terminal 300 . For example, the user terminal 300 may be provided with an external display unit (not shown) and an internal display unit (not shown) at the same time.

The sound output module 352 outputs audio data received from the wireless communication unit 310 or stored in the memory 360 in call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, and the like. In addition, the sound output module 352 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the user terminal 300 . The sound output module 352 may include a speaker, a buzzer, and the like.

The alarm unit 353 outputs a signal for notifying the occurrence of an event in the user terminal 300 . Examples of events occurring in the terminal include call signal reception, message reception, and key signal input.

The memory 360 may store a program for processing and control of the controller 380, and provides a function for temporary storage of input/output data (eg, phonebook, message, still image, video, etc.). can also be done

The memory 360 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), a RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) magnetic memory, magnetic disk, It may include at least one type of storage medium among optical disks.

The controller 380 generally controls the overall operation of the terminal. For example, it performs related control and processing for voice calls, data communications, video calls, and the like. Also, the controller 380 may include a multimedia module 181 for playing multimedia. The multimedia module 381 may be implemented within the control unit 380 or may be implemented separately from the control unit 380 .

The controller 380 controls various operations of the terminal for implementing the above-described photo studio operating method.

The power supply unit 290 receives external power and internal power under the control of the control unit 280 to supply power required for operation of each component.

On the other hand, at least some or all of the operation of the above-described operation server 100 may be implemented in the user terminal (300). In this case, an application for communicating with the operation server 100 and performing the operation of the operation server 100 described above may be installed in the user terminal 300 in advance.

13 is a diagram illustrating a wireless communication system that can be applied in a communication process according to an embodiment of the present invention. 14 is a diagram illustrating a base station in the wireless communication system according to FIG. 13 . 15 is a diagram illustrating a terminal in the wireless communication system according to FIG. 13 . 16 is a diagram illustrating a communication interface in the wireless communication system according to FIG. 13 .

Hereinafter, an example of a wireless communication network system supporting communication between various servers and terminals will be described in detail as an example. In the following description, a first node (device) may be an anchor/donor node or a centralized unit (CU) of an anchor/donor node, and a second node (device) may be an anchor/donor node or a distributed unit (DU) of a relay node. can be

As a part of a node using a radio channel in a wireless communication system, a base station (BS), a terminal, a server, and the like may be included.

A base station is a network infrastructure that provides wireless access to terminals and terminals. A base station has coverage defined as a certain geographic area according to the distance over which signals can be transmitted.

A base station is an "access point (AP)", "enodeb (eNB)", "5th generation (5G) node", "wireless point", " It may be referred to as a "transmission/reception point (TRP)".

The base station, the terminal, and the terminal may transmit and receive radio signals in millimeter wave (mmWave) bands (eg, 28 GHz, 30 GHz, 38 GHz, 60 GHz). In this case, the base station, the terminal, and the terminal may perform beamforming to improve the channel gain. Beamforming may include transmit beamforming and receive beamforming. That is, the base station, the terminal, and the terminal may impart directivity to the transmitted signal and the received signal. To this end, the base station, the terminal, and the terminal may select a serving beam through a beam discovery procedure or a beam management procedure. Thereafter, communication may be performed using a resource that is in a quasi co-located relationship with a resource carrying the serving beam.

The first antenna port and the second antenna port are considered quasi-co-located if the large-scale properties of the channel through which the symbol of the first antenna port is carried can be inferred from the channel through which the symbol of the second antenna port is carried. The large-scale attribute may include one or more of delay spread, Doppler spread, Doppler shift, average gain, average delay, and spatial Rx parameters.

Hereinafter, a base station is exemplified in the above-described wireless communication system. The terms “-module”, “-unit” or “-er” used hereinafter may mean a unit that processes at least one function or operation, and includes hardware, software, or hardware and software. It can be implemented as a combination of

The base station may include a wireless communication interface, a backhaul communication interface, a storage unit and a controller.

The wireless communication interface performs a function of transmitting and receiving signals through a wireless channel. For example, the wireless communication interface may perform a conversion function between a baseband signal and a bit stream according to a physical layer standard of the system. For example, in data transmission, a wireless communication interface compresses and modulates a transmitted bit stream to produce a complex symbol. In addition, upon data reception, the wireless communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream.

The wireless communication interface performs a function of transmitting and receiving signals through a wireless channel. For example, the wireless communication interface may perform a conversion function between a baseband signal and a bit stream according to a physical layer standard of the system. For example, in data transmission, a wireless communication interface compresses and modulates a transmitted bit stream to produce a complex symbol. In addition, upon data reception, the wireless communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream.

In addition, the wireless communication interface up-converts the base band signal into a radio frequency (RF) band signal, transmits the converted signal through the antenna, and then down-converts the RF band signal received through the antenna into a base band signal. To this end, the wireless communication interface includes a transmission filter, a reception filter, an amplifier, a mixer, an oscillator, a digital-to-analog converter (DAC), It may include an analog-to-digital converter (ADC) and the like. Also, the wireless communication interface may include a plurality of transmission/reception paths. Further, the wireless communication interface may include at least one antenna array including a plurality of antenna elements.

In terms of hardware, the wireless communication interface may include a digital unit and an analog unit, and the analog unit may include a plurality of sub-units according to operating power, operating frequency, and the like. The digital unit may be implemented with at least one processor (eg, a digital signal processor (DSP)).

The wireless communication interface transmits and receives signals as described above. Accordingly, a wireless communication interface may be referred to as a "transmitter", "receiver" or "transceiver". In addition, in the following description, transmission/reception performed through a wireless channel may be used to include processing performed in a wireless communication interface as described above.

The backhaul communication interface provides an interface for performing communication with other nodes in the network. That is, the backhaul communication interface converts the bit stream transmitted to another node, for example, another access node, another base station, a higher node or a core network from a base station converts the physical signal received from the other node into a physical signal. Convert to stream.

The storage unit stores data such as basic programs, applications, and setting information for operation of the base station. The storage unit may include a volatile memory, a non-volatile memory, or a combination of a volatile memory and a non-volatile memory.

The controller controls the overall operation of the base station. For example, the controller transmits and receives signals through a wireless communication interface or a backhaul communication interface. In addition, the controller writes data to the storage and reads the recorded data. The controller can perform the function of the protocol stack required by the communication standard. According to another implementation, the protocol stack may be included in a wireless communication interface. To this end, the controller may include at least one processor.

According to an embodiment, the controller may control the base station to perform an operation according to an embodiment of the present invention.

According to various embodiments, a donor node of a wireless communication system includes at least one processor, a transceiver operatively coupled to the at least one processor, and a plurality of radio bearers for a terminal accessing the relay node. and send to the relay node a first message including first information related to the donor node regarding receive, from the relay node, a second message including second information related to the relay node regarding a plurality of radio bearers for the terminal; Data for the terminal may be transmitted to the relay node. Data may be transmitted to the terminal through a plurality of radio bearers based on the first information and the second information.

According to various embodiments, a radio bearer among a plurality of radio bearers may aggregate a plurality of radio bearers. the at least one processor is further configured to determine a radio bearer for the terminal accessing the relay node and a multiple radio bearer aggregated by the radio bearer; Alternatively, a radio bearer for a terminal accessing the relay node may be determined.

According to various embodiments, the first message may include one or more of the following: identification of a terminal accessing the relay node; display information indicating the type of terminal accessing the relay node; information on a radio bearer of a terminal accessing a relay node; information on the radio bearer delivered by the terminal accessing the relay node; information on the tunnel established for the radio bearer between the donor node and the relay node; information on the aggregated multiple radio bearers; radio bearer mapping information; information on the address of the side of the donor node; information on the address of the relay node side; indication information corresponding to a radio bearer of a terminal accessing a relay node; indication information indicating the relay node to allocate a new address to a radio bearer for a terminal accessing the relay node; a list of address information that cannot be used by a relay node that transmits data of a radio bearer of a terminal accessing the relay node; and information related to security configuration.

According to various embodiments, the second message may include one or more of the following: identification of a terminal accessing the relay node; information on radio bearers accepted by the relay node; information on radio bearers not acknowledged by the relay node; information on radio bearers partially granted by the relay node; radio bearer mapping information; configuration information of a terminal accessing the relay node generated by the relay node; information on the address of the relay node side; and information related to security configuration.

According to various embodiments, the second message may further include information on the integrated multi-radio bearer.

According to various embodiments, the donor node may include a central unit of the donor node, and the relay node may include a distributed unit of the donor node.

According to various embodiments, a relay node of a wireless communication system includes at least one processor, a transceiver operatively coupled to the at least one processor, and a plurality of terminals accessing the relay node from a donor node. configured to receive a first message comprising first information related to a donor node regarding a radio bearer of ; transmit a second message including second information related to the relay node regarding the plurality of radio bearers to the terminal to the donor node; It is possible to receive data for the terminal from the donor node. Data may be transmitted to the terminal through a plurality of radio bearers based on the first information and the second information.

According to various embodiments, a radio bearer among a plurality of radio bearers may aggregate a plurality of radio bearers. the at least one processor is further configured to determine a radio bearer for the terminal accessing the relay node and a multiple radio bearer aggregated by the radio bearer; Alternatively, multiple radio bearers integrated by the radio bearer may be determined.

According to various embodiments, the first message may include one or more of the following: identification of a terminal accessing the relay node; display information indicating the type of terminal accessing the relay node; information on a radio bearer of a terminal accessing a relay node; information on the radio bearer delivered by the terminal accessing the relay node; information on the tunnel established for the radio bearer between the donor node and the relay node; information on the aggregated multiple radio bearers; radio bearer mapping information; information on the address of the side of the donor node; information on the address of the relay node side; indication information corresponding to a radio bearer of a terminal accessing a relay node; indication information indicating the relay node to allocate a new address to a radio bearer for a terminal accessing the relay node; a list of address information that cannot be used by a relay node that transmits data of a radio bearer of a terminal accessing the relay node; and information related to security configuration.

According to various embodiments, the second message may include one or more of the following: identification of a terminal accessing the relay node; information on radio bearers accepted by the relay node; information on radio bearers not acknowledged by the relay node; information on radio bearers partially granted by the relay node; radio bearer mapping information; configuration information of a terminal accessing the relay node generated by the relay node; information on the address of the relay node side; and information related to security configuration.

According to various embodiments, the second message may further include information on the integrated multi-radio bearer.

According to various embodiments, the donor node may include a central unit of the donor node, and the relay node may include a distributed unit of the donor node.

Hereinafter, components of a terminal in the above-described wireless communication system are illustrated. The components of the terminal to be described below are components of a general-purpose terminal supported by the wireless communication system, and may be merged or integrated with the components of the terminal according to the above-described contents, and to the extent that some overlap or conflict, refer to the drawings above. Contents described with reference may be interpreted as having priority. The terms “-module”, “-unit” or “-er” used below may refer to a unit that processes at least one function.

The terminal includes a communication interface, a storage unit and a controller.

The communication interface performs a function of transmitting and receiving signals through a wireless channel. For example, the communication interface performs a function of converting between a baseband signal and a bit stream according to the physical layer standard of the system. For example, in data transmission, a communication interface compresses and modulates a transport bit stream to produce a complex symbol. In addition, upon data reception, the communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream. In addition, the communication interface up-converts the base band signal into an RF band signal, transmits the converted signal through the antenna, and then down-converts the RF band signal received through the antenna into a base band signal. For example, the communication interface may include a transmission filter, a reception filter, an amplifier, a mixer, an oscillator, and a digital-to-analog converter (DAC). , an analog-to-digital converter (ADC), and the like.

Also, the communication interface may include a plurality of transmission/reception paths. Further, the communication interface may include at least one antenna array including a plurality of antenna elements. On the hardware side, the wireless communication interface may include a digital circuit and an analog circuit (eg, a radio frequency integrated circuit, RFIC). The digital circuit may be implemented by at least one processor (eg, DSP). The communication interface may include a plurality of RF chains. The communication interface may perform beamforming.

The communication interface transmits and receives signals as described above. Accordingly, a communication interface may be referred to as a "transmitter", "receiver" or "transceiver". In addition, in the following description, transmission/reception performed through a wireless channel may be used to include processing performed in a communication interface as described above.

The storage unit stores data such as basic programs, applications, and setting information for the operation of the terminal. The storage unit may include a volatile memory, a non-volatile memory, or a combination of a volatile memory and a non-volatile memory. In addition, the storage unit provides the stored data according to the request of the controller.

The controller controls the overall operation of the terminal. For example, the controller sends and receives signals through a communication interface. In addition, the controller writes data to the storage and reads the recorded data. The controller can perform the function of the protocol stack required by the communication standard. According to another implementation, the protocol stack may be included in the communication interface. To this end, the controller may include at least one processor or microprocessor or regenerate a part of the processor. In addition, a part of the communication interface or controller may be referred to as a communication processor (CP).

According to an embodiment of the present invention, the controller may control the terminal to perform the operation according to the embodiment of the present invention.

Hereinafter, a communication interface in a wireless communication system is exemplified.

The communication interface includes compression and modulation circuitry, digital beamforming circuitry, a plurality of transmission paths, and analog beamforming circuitry.

The compression and modulation circuitry performs channel compression. At least one of a low-density parity check (LDPC) code, a convolutional code, and a polar code may be used for channel compression. The compression and modulation circuitry generates modulation symbols by performing constellation mapping.

The digital beamforming circuit performs beamforming on a digital signal (eg, a modulation symbol). To this end, the digital beamforming circuit multiplexes the modulation symbols by the beamforming weight value. The beamforming weight may be used to change the size and phrase of a signal, and may be referred to as a “precoding matrix” or a “precoder”. The digital beamforming circuit outputs digital beamformed modulation symbols to a plurality of transmission paths. In this case, modulation symbols may be multiplexed according to a multiple input multiple output (MIMO) transmission method, or the same modulation symbol may be provided to a plurality of transmission paths.

The plurality of transmission paths converts the digital beamformed digital signal into an analog signal. To this end, each of the plurality of transmission paths may include an inverse fast Fourier transform (IFFT) calculation unit, a cyclic prefix (CP) insertion unit, a DAC, and an up-conversion unit. The CP insertion unit is for an orthogonal frequency division multiplexing (OFDM) method and may be omitted when other physical layer methods (eg, a filter bank multi-carrier: FBMC) are applied. That is, the plurality of transmission paths provide independent signal processing processes for a plurality of streams generated through digital beamforming. However, depending on the implementation, some elements of a plurality of transmission paths may be used in common.

The analog beamforming circuit performs beamforming on an analog signal. To this end, the digital beamforming circuit multiplexes the analog signal by the beamforming weight value. Beamformed weights are used to change the size and text of the signal. More specifically, according to a connection structure between the plurality of transmission paths and the antenna, the analog beamforming circuit may be configured in various ways. For example, each of the plurality of transmission paths may be connected to one antenna array. In another example, a plurality of transmission paths may be coupled to one antenna array. In another example, the plurality of transmission paths may be adaptively coupled to one antenna array or may be coupled to two or more antenna arrays.

The steps of a method or algorithm described in relation to an embodiment of the present invention may be implemented directly in hardware, as a software module executed by hardware, or by a combination thereof. A software module may contain random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present invention pertains.

As mentioned above, although embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains know that the present invention may be embodied in other specific forms without changing the technical spirit or essential features thereof. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims (8)

As a method of operation of the photo studio operation server,
receiving a shooting concept selected by a user from a shooting room server;
extracting concept data corresponding to the shooting concept selected by the user by using the concept mapping table;
generating a device control signal including a control signal of at least one of a lighting device, a speaker, and a camera by using the concept data; and
Transmitting the device control signal to the recording room server, comprising the step of controlling at least one of the lighting, speaker, and camera,
The concept data is
music corresponding to the shooting concept selected by the user, a background image, a light color of the lighting device, illuminance information of the lighting device, and camera parameters;
The generating of the device control signal comprises:
receiving a test picture from the user;
predicting camera parameters by inputting the test picture into a parameter prediction model; and
generating the device control signal including the control signal of the camera by using the predicted camera parameter,
As a plurality of test photos are received, if there are a plurality of predicted camera parameters, a final camera parameter is determined by comparing the plurality of predicted camera parameters with the camera parameter of the shooting concept selected by the user, and the final camera parameter is determined. generating the device control signal including a control signal of the camera by using the camera parameter;
The parameter prediction model is
Taking the characteristic values of the learning data including the representative color, representative saturation, and representative subject of the learning picture received from the manager as input values, the quality and size of the training picture, the sensitivity (ISO) of the camera that took the training picture, Using training data with camera parameters of training data including filter, aperture, and shutter speed as output values,
Supervised learning is performed so that the result value of the loss function defined according to the following equation is minimized,

In the above equation, Ym is the m-th component of the output value of the training data, and Y'm is the m-th component of the output value obtained by receiving the input value of the training data from the parameter prediction model,
How the photo studio operation server works. The method of claim 1,
When a preset determination period arrives, a detection signal according to a user action prior to each of the plurality of pattern periods is analyzed based on each of the plurality of pattern periods based on the arrival time of the determination period, and for each of the plurality of pattern periods extracting a behavior pattern;
determining the behavior of the user by comparing the behavior pattern of each of the plurality of pattern periods with at least one standard behavior pattern provided for each of the plurality of pattern periods; and
Further comprising the step of generating the device control signal including the control signal of the lighting device according to the determined user action,
The analysis includes a three-sided analysis in consideration of a temporal attribute based on each of a plurality of pattern periods, and the three-sided analysis includes a first surface of movement amount according to the plurality of pattern periods, and according to the plurality of pattern periods including a second surface of the sound amount, and a third surface of the movement amount according to the sound amount
How the photo studio operation server works. delete delete A non-transitory recording medium in which a program for executing the operating method according to claim 1 is recorded and which can be read by a computer. In the photo studio operating server, a computer program recorded in a non-transitory recording medium to execute the operating method according to claim 1. at least one processor; and
As a photo studio operation server, comprising a memory (memory) for storing instructions (instructions) instructing the at least one processor to perform at least one operation,
The at least one operation is
receiving a shooting concept selected by a user from a shooting room server;
extracting concept data corresponding to the shooting concept selected by the user by using the concept mapping table;
generating a device control signal including a control signal of at least one of a lighting device, a speaker, and a camera by using the concept data; and
Transmitting the device control signal to the recording room server, comprising the step of controlling at least one of the lighting, speaker, and camera,
The concept data is
music corresponding to the shooting concept selected by the user, a background image, a light color of the lighting device, illuminance information of the lighting device, and camera parameters;
The generating of the device control signal comprises:
receiving a test picture from the user;
predicting camera parameters by inputting the test picture into a parameter prediction model; and
generating the device control signal including the control signal of the camera by using the predicted camera parameter,
As a plurality of test photos are received, if there are a plurality of predicted camera parameters, a final camera parameter is determined by comparing the plurality of predicted camera parameters with the camera parameter of the shooting concept selected by the user, and the final camera parameter is determined. generating the device control signal including a control signal of the camera by using the camera parameter;
The parameter prediction model is
Taking the characteristic values of the learning data including the representative color, representative saturation, and representative subject of the learning picture received from the manager as input values, the quality and size of the training picture, the sensitivity (ISO) of the camera that took the training picture, Using training data with camera parameters of training data including filter, aperture, and shutter speed as output values,
Supervised learning is performed so that the result value of the loss function defined according to the following equation is minimized,

In the above equation, Ym is the m-th component of the output value of the training data, and Y'm is the m-th component of the output value obtained by receiving the input value of the training data from the parameter prediction model,
Photo studio operating server. A photo studio operating system comprising:
Cameras, speakers, lights, and sensors provided in the shooting room;
a photographing room server provided in the photographing room to control the camera, the speaker, the lighting, and the sensor based on a device control signal; and
Comprising an operation server for transmitting the device control signal to the shooting room server,
The operating server is
at least one processor; and
and a memory for storing instructions instructing the at least one processor to perform at least one operation,
The at least one operation is
receiving a shooting concept selected by a user from a shooting room server;
extracting concept data corresponding to the shooting concept selected by the user by using the concept mapping table;
generating a device control signal including a control signal of at least one of a lighting device, a speaker, and a camera by using the concept data; and
Transmitting the device control signal to the recording room server, comprising the step of controlling at least one of the lighting, speaker, and camera,
The concept data is
music corresponding to the shooting concept selected by the user, a background image, a light color of the lighting device, illuminance information of the lighting device, and camera parameters;
The generating of the device control signal comprises:
receiving a test picture from the user;
predicting camera parameters by inputting the test picture into a parameter prediction model; and
generating the device control signal including the control signal of the camera by using the predicted camera parameter,
As a plurality of test photos are received, if there are a plurality of predicted camera parameters, a final camera parameter is determined by comparing the plurality of predicted camera parameters with the camera parameter of the shooting concept selected by the user, and the final camera parameter is determined. generating the device control signal including a control signal of the camera by using the camera parameter;
The parameter prediction model is
Taking the characteristic values of the learning data including the representative color, representative saturation, and representative subject of the learning picture received from the manager as input values, the quality and size of the training picture, the sensitivity (ISO) of the camera that took the training picture, Using training data with camera parameters of training data including filter, aperture, and shutter speed as output values,
Supervised learning is performed so that the result value of the loss function defined according to the following equation is minimized,

In the above equation, Ym is the m-th component of the output value of the training data, and Y'm is the m-th component of the output value obtained by receiving the input value of the training data from the parameter prediction model.

Images