KR102632129B1 - The method and system for operating photo studio - Google Patents

Abstract

A photo studio operation method and system are disclosed. The above embodiments relate to a photo studio operation method and system. Specifically, the lighting, music, and camera of the shooting room are controlled according to the shooting concept selected by the user, the lighting of the shooting room is controlled by analyzing the user's behavior, and the machine is controlled. It relates to a method and system for setting the optimal camera parameters desired by the user from the user's test photos based on learning.

Description

Photo studio operation method and system{THE METHOD AND SYSTEM FOR OPERATING PHOTO STUDIO}

The following embodiments relate to a photo studio operation method and system. Specifically, the lighting, music, and camera of the shooting room are controlled according to the shooting concept selected by the user, the lighting of the shooting room is controlled by analyzing the user's behavior, and the machine is controlled. It relates to a method and system for setting the optimal camera parameters desired by the user from the user's test photos based on learning.

General photography is one of the most sensitive tasks that is affected by light. Accordingly, commemorative photos such as 100th day photos, first birthday photos, and wedding photos, as well as advertising photos that can provide accurate information about a specific subject, are being taken by professional photographers.

Meanwhile, as photography requires technology that can take pictures while controlling interference by light, it is necessary to take pictures in a closed studio where light can be easily controlled. These studios require operator accessibility to control light from a static position that maintains the appropriate height and distance to the subject.

Accordingly, in recent years, research has been continuously conducted to easily provide various studio environments to improve workers' accessibility to filming.

In the past, the production of commemorative photo albums was done by taking photos in a photo studio, completing them in-house, and providing them to consumers (users). However, with the spread of the Internet and the development of digital technology, when a user takes photos directly in a photo studio and requests an album to be created, the photo file to be used in the album can be viewed using the photo studio's website or web hard drive. The service has been improved to allow downloading of digital files.

However, because it is not easy to set the lighting of the subject or shooting environment or various parameters of the camera to take the photo the user wants, it is not possible to obtain high-quality photos like those taken by a professional photographer if the user takes the photo himself. In most cases,

Therefore, there is a need for various ways to take high-quality photos with the lighting and atmosphere desired by the user, even without professional knowledge of photography.

The matters described in this background art section are written to improve understanding of the background of the invention, and may include matters that are not prior art already known to those skilled in the art in the field to which this technology belongs.

The following embodiments were designed to solve the above-mentioned problems, and control the lighting, music, and camera in the shooting room according to the shooting concept selected by the user, control the lighting in the shooting room by analyzing the user's behavior, and use machine learning to control the lighting in the shooting room. Based on this, the purpose is to derive a photo studio operation method and system that sets the optimal camera parameters desired by the user from the user's test photos.

The problems to be solved by one embodiment are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below.

One embodiment for achieving the above object is a method of operating a photo studio operating server, comprising: receiving a shooting concept selected by a user from a shooting room server; extracting concept data corresponding to the shooting concept selected by the user using a concept mapping table; Using the concept data, generating a device control signal including a control signal for at least one of a lighting device, a speaker, and a camera; And transmitting the device control signal to the shooting room server to control at least one of the lighting, speaker, and camera, wherein the concept data includes music, background images, and music corresponding to the shooting concept selected by the user. Provides a method of operating a photo studio operation server including at least one of the light color of the lighting device, illuminance information of the lighting device, and camera parameters,

In one embodiment, when a preset judgment cycle arrives, the detection signal according to user behavior up to each of the plurality of pattern cycles based on the arrival of the judgment cycle is analyzed based on each of the plurality of pattern cycles, and the plurality of patterns Extracting behavior patterns for each cycle; determining the user's behavior by comparing the behavior pattern of each of the plurality of pattern cycles with at least one standard behavior pattern provided for each of the plurality of pattern cycles; And according to the determined user's behavior, further comprising generating the device control signal including a control signal of the lighting device, wherein the analysis is a three-sided analysis considering time properties based on each of a plurality of pattern periods. Includes, the three-sided analysis includes a first side of the motion amount according to the plurality of pattern periods, a second side of the sound amount according to the plurality of pattern periods, and a second side of the motion amount according to the sound amount Includes 3 pages.

One embodiment includes receiving a test photo from the user; predicting the camera parameters by inputting the test photo into a parameter prediction model; and generating the device control signal including a control signal of the camera using the predicted camera parameters.

In one embodiment, when there are a plurality of predicted camera parameters, the device determines final camera parameters by comparing them with camera parameters of the shooting concept selected by the user, and includes a control signal for the camera using the final camera parameters. It further includes generating a control signal.

One embodiment includes at least one processor; and a memory storing instructions that instruct the at least one processor to perform at least one operation, wherein the at least one operation is shooting. Receiving a user-selected shooting concept from a room server; extracting concept data corresponding to the shooting concept selected by the user using a concept mapping table; Using the concept data, generating a device control signal including a control signal for at least one of a lighting device, a speaker, and a camera; And transmitting the device control signal to the shooting room server to control at least one of the lighting, speaker, and camera, wherein the concept data includes music, background images, and music corresponding to the shooting concept selected by the user. A photo studio operating server is provided that includes at least one of light color of a lighting device, illuminance information of the lighting device, and camera parameters.

One embodiment provides a photo studio operating system.

The photo studio operating system includes cameras, speakers, lights, and sensors provided in a shooting room; a shooting room server provided in the shooting room to control the camera, the speaker, the lighting, and the sensor based on a device control signal; and the operation server transmitting the device control signal to the shooting room server.

The operating server includes at least one processor; and a memory storing instructions that instruct the at least one processor to perform at least one operation.

The at least one operation may include receiving a shooting concept selected by a user from a shooting room server; extracting concept data corresponding to the shooting concept selected by the user using a concept mapping table; Using the concept data, generating a device control signal including a control signal for at least one of a lighting device, a speaker, and a camera; And transmitting the device control signal to the shooting room server to control at least one of the lighting, speaker, and camera.

The concept data includes at least one of music corresponding to the shooting concept selected by the user, a background image, a light color of the lighting device, illuminance information of the lighting device, and camera parameters.

According to the embodiments described above, the lighting, music, and camera of the shooting room are controlled according to the shooting concept selected by the user, thereby providing an environment in which the user can take photos according to the desired concept.

In addition, by detecting the user's behavior in real time and determining the user's behavior considering time attributes, it is possible to provide a lighting environment in the shooting room suitable for the user's various actions according to time changes.

In addition, by setting the lighting environment of the shooting room suitable for the user's behavior in consideration of the illumination of the user's location, the shooting environment desired by the user can be provided.

Additionally, using machine learning, the optimal camera parameters desired by the user can be extracted from the user's test photos and applied to the camera in the shooting room.

The effects of one embodiment are not limited to the effects mentioned above, and other effects not mentioned may be clearly understood by those skilled in the art from the description below.

1 is a diagram illustrating a photo studio operating system according to an embodiment.
Figure 2 is a diagram illustrating the configuration of a photo studio operation server according to an embodiment.
Figure 3 is a diagram illustrating the configuration of a shooting concept control unit according to an embodiment.
Figure 4 is a diagram illustrating an example of a photography concept table according to an embodiment.
Figure 5 is a flowchart of a shooting concept control method according to an embodiment.
Figure 6 is a diagram illustrating the configuration of a lighting control unit according to an embodiment.
Figure 7 is a diagram for explaining a user behavior analysis method according to an embodiment.
Figures 8 and 9 are diagrams for explaining three-sided analysis of a behavior pattern extraction unit according to an embodiment.
Figure 10 is a flowchart of a lighting control method according to one embodiment.
Figure 11 is a diagram for explaining a parameter prediction model according to an embodiment.
Figure 12 is a diagram illustrating the configuration of a user terminal according to an embodiment.
Figure 13 is a diagram showing a wireless communication system that can be applied in a communication process according to an embodiment of the present invention.
FIG. 14 is a diagram showing a base station in the wireless communication system according to FIG. 13.
FIG. 15 is a diagram showing a terminal in the wireless communication system according to FIG. 13.
FIG. 16 is a diagram showing a communication interface in the wireless communication system according to FIG. 13.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the disclosure of the present invention is complete and to provide a general understanding of the technical field to which the present invention pertains. It is provided to fully inform the skilled person of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terminology used herein is for describing embodiments and is not intended to limit the invention. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used in the specification, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other elements in addition to the mentioned elements. Like reference numerals refer to like elements throughout the specification, and “and/or” includes each and every combination of one or more of the referenced elements. Although “first”, “second”, etc. are used to describe various components, these components are of course not limited by these terms. These terms are merely used to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may also be a second component within the technical spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.

Hereinafter, embodiments will be described in detail with reference to the attached drawings.

FIG. 1 is a diagram illustrating a photo studio operating system 10 according to an embodiment.

Referring to FIG. 1, the photo studio operating system 10 according to one embodiment includes an operation server 100, a shooting room server 200, a camera 210, a speaker 220, a light 230, and a sensor 240. ) and a user terminal 300.

Communication between various entities included in the photo studio operating system 10 may be performed through wired/wireless networks. Wired/wireless networks may use standard communication technologies and/or protocols.

The operating server 100, the shooting room server 200, and the user terminal 300 in the photo studio operating system 10 include, for example, a computer, an Ultra Mobile PC (UMPC), a workstation, a net-book, Electronic devices such as personal digital assistants (PDAs), portable computers, web tablets, wireless phones, mobile phones, smart phones, and portable multimedia players (PMPs). As one of the examples, it may include all electronic devices capable of installing and executing an application related to an embodiment. The electronic device can perform overall service operations, such as configuring a service screen, inputting data, transmitting and receiving data, and storing data, under the control of an application.

The operation server 100 is a server that provides various functions related to photo studio operation.

The operation server 100 can control lighting, music, and cameras in the shooting room according to the shooting concept selected by the user.

The operation server 100 may analyze the user's behavior and control the lighting of the filming room according to the user's behavior pattern.

The operation server 100 can set optimal camera parameters desired by the user from the user's test photos based on machine learning and control the camera 210 according to the set camera parameters.

The operation server 100 can control various devices installed in the filming room by transmitting a device control signal to the filming room server 200.

The operation server 100 may transmit a photo taken by the camera 210 to the user terminal 300 and receive a test photo from the user terminal 300.

The specific configuration and functions of the operation server 100 will be described in detail in FIG. 2 below.

The shooting room server 200 is a server provided in the shooting room and provides various functions necessary for taking photos to users.

The shooting room server 200 can control the camera 210, speaker 220, lighting 230, and sensor 240 provided in the shooting room using the device control signal received from the operation server 100. there is.

The shooting room server 200 may receive sensor values from the sensor 240 and transmit the received sensor values to the operation server 100.

The shooting room server 200 may be equipped with input means such as a touch screen, keyboard, mouse, and microphone, and the shooting room server 200 can receive shooting setting information and device control information from the user through the input means. . Shooting setting information in one embodiment may include shooting concept, photo size, number of shots, etc., and device control information may include camera parameters, lighting illuminance, lighting color, shooting music, speaker volume, etc.

The shooting room server 200 may be equipped with an output means such as a display device and a speaker, and the shooting room server 200 may output various information necessary for taking photos to the user through the output means. For example, the shooting room server 200 may output a shooting concept selectable by the user and a photo taken by the user.

The shooting room server 200 may provide users with payment functions necessary for taking photos.

The camera 210 is provided in the recording room, and the user can directly take pictures using the camera 210.

The camera 210 can be set by learning from the operation server 100, or can take pictures by applying camera parameters input by the user through the shooting room server 200.

Camera parameters in one embodiment may include values such as photo quality, size, camera sensitivity (ISO), filter, aperture, shutter speed, etc.

The speaker 220 is provided in the shooting room and can play shooting music.

Lighting 230 may include a number of lighting devices installed in the filming room and may output light according to device control signals.

The sensor 240 may include a motion sensor 241, a voice sensor 242, and an illumination sensor 243 provided in the recording room.

The motion sensor 241 can detect a motion signal generated according to the user's movement. The voice sensor 242 can detect an acoustic signal generated according to the user's movement and a voice command signal that can be issued according to the user's specific situation. The illuminance sensor 243 can recognize the illuminance value at the user's location.

The user terminal 300 may output the captured photo received from the operation server 100 to the user.

The user terminal 300 may transmit a test photo as learning data to the operation server 100.

The specific configuration and functions of the user terminal 300 will be described in detail in FIG. 12 below.

FIG. 2 is a diagram illustrating the configuration of the operation server 100 according to an embodiment.

Referring to FIG. 2, the operation server 100 according to one embodiment includes a communication unit 110, an input unit 120, an output unit 130, a memory 140, a power supply unit 150, and a control unit 160. can do. The control unit 160 may include a shooting concept control unit 170, a lighting control unit 180, and a parameter setting unit 190.

The configurations shown in FIG. 2 are illustrative diagrams for implementing embodiments of the present invention, and appropriate hardware/software configurations that are obvious to those skilled in the art may be additionally included in the operating server 100.

The communication unit 110 can communicate with external devices through various communication methods. For example, the communication unit 110 may communicate with the shooting room server 200 and the user terminal 300 to transmit and receive various data.

The input unit 120 may receive various inputs from an administrator who is a user of the operation server 100 and transmit them to the control unit 160. In particular, the input unit 120 may include a touch sensor, a (digital) pen sensor, a pressure sensor, a key, or a microphone. The touch sensor may use at least one of, for example, a capacitive type, a resistive type, an infrared type, or an ultrasonic type. The (digital) pen sensor may be, for example, part of a touch panel or may include a separate recognition sheet. Keys may include, for example, physical buttons, optical keys, or keypads. The microphone is configured to receive the administrator's voice and may be installed inside the operation server 100, but this is only an example. It is provided outside the operation server 100 and is electrically connected to the operation server 100. You can.

The output unit 130 can provide various screens. For example, the output unit 130 may output a concept mapping table to the manager.

The memory 140 may store commands or data related to at least one other component of the operating server 100. In particular, the memory 140 may be implemented as non-volatile memory, volatile memory, flash-memory, hard disk drive (HDD), or solid state drive (SSD). The memory 140 is accessed by the control unit 160, and the control unit 160 can read/write/modify/delete/update data. In the present invention, the term memory refers to memory 140, ROM (not shown), RAM (not shown) in the control unit 160, or a memory card (not shown) mounted on the operating server 100 (e.g., micro SD). card, memory stick). Additionally, the memory 140 may store programs and data for configuring various screens to be displayed in the display area of the output unit 130.

The power supply unit 150 receives external power and internal power under the control of the control unit 160 and supplies power necessary for the operation of each component.

The control unit 160 is electrically connected to the communication unit 110, the input unit 120, the output unit 130, the memory 140, and the power supply unit 150 to control the overall operation and functions of the operation server 100. You can. In particular, the control unit 160 can provide functions described later using various modules stored in the memory 140.

It will be apparent that various operations on the operation server 100 described below can be performed under the control of the control unit 160.

As described above, the control unit 160 may include a shooting concept control unit 170, a lighting control unit 180, and a parameter setting unit 190.

The shooting concept control unit 170 can control lighting, music, and cameras in the shooting room according to the shooting concept selected by the user.

The shooting concept control unit 170 may use the shooting concept received from the shooting room server 200 to generate control signals for lighting, speakers, and cameras in the shooting room. The shooting concept control unit 170 may use the concept mapping table to generate a device control signal including control signals for lighting, speakers, and cameras in the shooting room. Here, the camera control signal is the same signal as the camera parameter described above.

The specific configuration and function of the shooting concept control unit 170 will be described in detail in FIG. 3 below.

The lighting control unit 180 may analyze the user's behavior and control the lighting of the shooting room according to the user's behavior pattern.

The lighting control unit 180 may determine the user's behavior pattern by analyzing the user's behavior and the illuminance of the user's location obtained from the sensor 240. The lighting control unit 180 may generate a device control signal including a lighting control signal of the shooting room according to the identified user's behavior pattern.

The specific configuration and function of the lighting control unit 180 will be described in detail in FIG. 6 below.

The parameter setting unit 190 can predict optimal camera parameters desired by the user from a test photo input by the user based on machine learning, and can control the camera 210 according to the predicted camera parameters.

The camera parameter prediction method of the parameter setting unit 190 will be described in detail in FIG. 11 below.

The control unit 160 can control the communication unit 110 and transmit a device control signal to the filming room server 200 to control various devices installed in the filming room.

The device control signal in one embodiment includes a lighting, speaker, and camera control signal (camera parameters) generated by the shooting concept control unit 170, a lighting control signal generated by the lighting control unit 180, and a camera generated by the parameter setting unit 190. Can contain parameters.

The control unit 160 can control the communication unit 110 to transmit a photo taken by the camera 210 to the user terminal 300 and receive a test photo from the user terminal 300.

The control unit 160 may receive data related to the shooting concept mapping table and learning photos from the manager through the input unit 120.

FIG. 3 is a diagram illustrating the configuration of the shooting concept control unit 170 according to an embodiment.

Referring to FIG. 3, the photography concept control unit 170 according to one embodiment may include a concept mapping table generator 171, a concept mapping table DB 172, and a device control signal generator 173.

The concept mapping table creation unit 171 may receive data from an administrator, create a photography concept mapping table 174, and store the generated concept mapping table 174 in the concept mapping DB 172. The device control signal generator 173 may use the concept mapping table 174 to generate a device control signal for the shooting concept selected by the user.

FIG. 4 is a diagram illustrating an example of a concept mapping table 174 according to an embodiment.

Referring to FIG. 4, the concept mapping table 174 of one embodiment is a data structure including the shooting concept name, shooting concept image, music, background image, light color and illuminance information of lighting equipment provided in the shooting room, and camera parameters. am.

The shooting concept control unit 170 transmits the generated concept mapping table 174 to the shooting room server 200, and the shooting room server 200 can output and receive a selection input of shooting concepts that can be selected by the user.

The shooting concept control unit 170 may receive the shooting concept selected by the user from the shooting room server 200.

The shooting concept control unit 170 may use the concept mapping table 174 to generate a device control signal for the shooting concept selected by the user.

The shooting concept control unit 170 uses the concept mapping table 174 to include music corresponding to the shooting concept selected by the user, a background image, light color and illuminance information of lighting devices installed in the shooting room, and camera parameters. Data can be extracted.

The shooting concept control unit 170 may generate control signals for the lighting 230, speaker 220, and camera 21 using the extracted concept data. As described above, the control signal of the camera here is the same signal as the camera parameter described above.

For example, when the user selects the shooting concept of 'Concept A', the shooting concept control unit 170 selects the music, background image, and lighting equipment provided in the shooting room corresponding to 'Concept A' in the concept mapping table 174. It can generate device control signals that include light color and illuminance information and camera parameters.

Figure 5 is a flowchart of a shooting concept control method according to an embodiment.

Referring to FIG. 5 , the shooting concept control method according to an embodiment may include a shooting concept receiving step (S100), a concept data extracting step (S110), and a device control signal generating step (S120).

First, in the shooting concept reception step (S100), the shooting concept control unit 170 may receive the shooting concept selected by the user from the shooting room server 200.

Then, in the concept data extraction step (S110), the shooting concept control unit 170 uses the concept mapping table 174 to include music, background images, and light from lighting equipment provided in the shooting room corresponding to the shooting concept selected by the user. Concept data including color and illuminance information and camera parameters can be extracted.

Then, in the device control signal generation step (S120), the shooting concept control unit 170 can generate control signals for the lighting 230, the speaker 220, and the camera 21 using the extracted concept data.

Accordingly, the shooting concept control unit 170 can control the lighting, music, and camera of the shooting room according to the shooting concept selected by the user, providing an environment in which the user can take photos according to the desired concept.

FIG. 6 is a diagram illustrating the configuration of the lighting control unit 180 according to one embodiment.

Referring to FIG. 6, the lighting control unit 180 may include a detection unit 181, a control unit 182, a service provision unit 183, and a template DB 184.

The detection unit 181 may detect user behavior and provide a detection signal corresponding to the detected behavior to the control unit 182, and the detection unit 181 may include a motion sensor 241, a voice sensor 120, and Corresponding sensor data may be received from the illuminance sensor 130.

As described above, the motion sensor 241 can detect a motion signal generated according to the user's movement, and the voice sensor 242 can emit an acoustic signal generated according to the user's movement and the user's specific situation. A voice command signal can be detected, and the illuminance sensor 243 can recognize the illuminance value of natural light at the user's location.

When a preset judgment cycle arrives, the control unit 182 analyzes the detection signals prior to each of the plurality of pattern cycles based on the arrival of the judgment cycle to determine the behavior pattern for each of the plurality of pattern cycles. A service provision unit extracts and compares the behavior pattern of each of the plurality of pattern cycles with at least one standard behavior pattern provided for each of the plurality of pattern cycles to determine the user's behavior and provide a service suitable for the determined user's behavior. (183) can be controlled.

The control unit 182 may include an analysis unit 182-1, a behavior pattern extraction unit 182-2, a comparison judgment unit 182-3, and a service provision unit control unit 182-4.

When a preset judgment cycle arrives, the analysis unit 182-1 analyzes the detection signals up to each of the plurality of pattern cycles based on the arrival of the judgment cycle based on each of the plurality of pattern cycles and extracts the behavior pattern extraction unit 182-1. 2) and may include multiple pattern cycles.

A plurality of pattern cycles can be analyzed separately by considering the time properties of the detection signal, including a short-term pattern cycle (e.g., 5 seconds), a medium-term pattern cycle (e.g., 1 minute), and a long-term pattern cycle (e.g., , 5 minutes).

Figure 7 is a diagram for explaining a user behavior analysis method according to an embodiment.

Referring to FIG. 7, the short-term pattern cycle can be used as reference data for extracting behavior patterns during a mid-term pattern cycle and a long-term pattern cycle other than the short-term pattern cycle among a plurality of pattern cycles. Specifically, the analysis process can be minimized by using the average and standard deviation of the data signal derived by analyzing previous detection signals based on a short-term pattern cycle as behavior pattern extraction data for each of a plurality of pattern cycles. The arrival point of the judgment cycle (for example, 2.5 seconds) may be a point where the preset judgment cycle overlaps by 50%, and data disconnection can be prevented by analyzing the preset judgment cycle with an overlap of 50%. there is.

The behavior pattern extraction unit 182-2 extracts behavior patterns for each of a plurality of pattern cycles through three-sided analysis (yz, xy, xz) and provides the extracted behavior patterns to the comparison judgment unit 182-3. You can.

Figures 8 and 9 are diagrams for explaining three-sided analysis of a behavior pattern extraction unit according to an embodiment.

Referring to FIG. 9, the three-sided analysis considers the time properties of the detection signal based on each of a plurality of pattern cycles to determine the size of the sound signal (x-axis), the plurality of pattern cycles (y-axis), and the size of the motion signal (z-axis). ) By extracting multiple behavior patterns, it is possible to more accurately understand the behavior of various users compared to time by considering the time properties of specific actions, and the first side (yz), the second side (xy) and It may include a third side (xz).

Referring to FIG. 8A, the first surface calculates the time average of the motion signal using a plurality of pattern periods as one axis, determines the section of the one axis through the standard deviation of the time average, and determines the size of the motion signal with the motion signal size as the other axis. By calculating the size average, determining the section of the other axis through the standard deviation of the size average, and identifying the characteristics of the motion signal for each multiple pattern cycle over time, it is possible to understand the user's behavior in relation to various user movements over time.

Referring to FIG. 8A, the second surface calculates the time average of the sound signal using a plurality of pattern periods as one axis, determines the section of the first axis through the standard deviation of the time average, and determines the sound signal size with the sound signal size as the other axis. By calculating the size average, determining the section of the other axis through the standard deviation of the size average, and identifying the characteristics of the sound signal for each multiple pattern period over time, it is possible to understand the user's behavior regarding the sound of various users over time.

Referring to Figure 8b, the third side calculates the average size of the sound signal with the sound signal size as one axis, determines the section on one axis through the standard deviation of the size average, and determines the size of the movement signal size with the motion signal size as the other axis. By calculating the average and determining the section of the other axis through the standard deviation of the size average, the behavior of various users can be identified by comparing the ratio between the movement signal and the sound signal.

The plurality of behavior patterns may be the user's life patterns considering time attributes and may include short-term behavior patterns, medium-term behavior patterns, and long-term behavior patterns. The short-term behavior pattern may be a pattern for a user's voice command and may include a light control command. The illuminance control command may be a voice command such as illuminance increase/decrease control and ON/OFF according to the user's needs. A mid-term behavior pattern may be a pattern for sudden behavioral changes, such as changing the user's gestures. A long-term behavior pattern may be a pattern of gradual temporal behavioral changes, such as a user's location change. The comparison judgment unit 182-3 compares the behavior pattern obtained through three-sided analysis of each of the plurality of pattern cycles with at least the standard behavior pattern provided for each of the plurality of pattern cycles to judge the user's behavior in real time and sends it to the service provision unit control unit. It can be provided at (182-4). Here, the standard behavior pattern may be of the same form as the behavior pattern obtained through three-sided analysis.

In contrast, the comparison judgment unit 182-3 synchronizes the time series between the time-series measurement data of the motion and sound loudness signals and the time-series measurement data of the motion and sound loudness signals, and calculates the correlation coefficient using Equation 1 below: It is possible to judge real-time user behavior based on the standard behavior pattern with the highest similarity.

Here, rxy is the correlation coefficient, n is the number of data, xi is the time-series measurement data of the motion magnitude signal, yi is the time-series measurement data of the sound magnitude signal, ^x is the time-series standard data for the motion magnitude signal, and ^y is It is time-series standard data for sound loudness signals, and the method of using correlation coefficients can be useful in determining the behavior of short-term periodic patterns.

The service provision unit control unit 182-4 can control the service provision unit 183 to provide a service suitable for the determined user's behavior, and may include a voice command recognition mode and an intelligent mode.

The voice command recognition mode can provide illuminance control appropriate for the user's behavior by prioritizing voice commands, and illuminance control by voice commands can be maintained until another voice command or a preset time has elapsed.

Intelligent mode can control the illuminance of the user's location to an illuminance appropriate for the user's behavior.

Intelligent mode and voice command recognition mode can perform complementary functions.

The service provision unit 183 may be equipped with at least one preset service function and may include a lighting control signal generator 183-1.

The lighting control signal generator (183-1) is equipped with a light emitting means and can generate a device control signal that can provide illumination appropriate for the user's behavior and turn on and off under the control of the service provision unit control unit (182-4). there is.

The template DB 184 can store at least one standard behavior pattern provided for each of a plurality of pattern cycles, and includes a behavior pattern DB 184-1, a voice command DB 184-2, and a behavior pattern DB 184-1 for each of the plurality of pattern cycles. It may include illuminance DB (184-3).

The behavior pattern DB 184-1 may be pre-stored data that classifies behavior based on a detection signal that can be detected when a user performs a specific behavior, taking time attributes into account.

The voice command DB (184-2) may be pre-stored data that distinguishes voices such as illuminance increase/decrease control and ON/OFF according to the user's needs in consideration of time properties.

The illuminance DB 184-3 may be data in which a standard illuminance value suitable for a user's specific action is already stored.

Figure 10 is a flowchart of a lighting control method according to one embodiment.

Referring to FIG. 10, the smart lighting control unit 180 can detect the user's movement, sound, and illumination in real time using the sensing unit 100 (S201), and analyzes the detected signal through the analysis unit 182-1. It can be used to analyze each of a plurality of pattern cycles (S202).

Next, the behavior pattern extraction unit 182-2 may extract a behavior pattern for each of a plurality of pattern cycles (S203).

Next, the comparison decision unit 182-3 may determine the user's behavior in real time by comparing the behavior pattern of each of the plurality of pattern cycles with at least one standard behavior pattern provided for each of the plurality of pattern cycles (S204). .

Next, the service provision unit control unit 182-4 can determine whether it is a voice command (S205), and in the case of a voice command, it can determine the illuminance appropriate for the user's actions by considering the illuminance of the user's location (S206). .

Next, the service providing unit 183 may control the increase/decrease of the illuminance value to an illuminance appropriate for the determined user's behavior (S207).

If it is determined in S205 that the user's behavior pattern is a pattern for the voice command, the service provision unit control unit 182-4 may determine whether to issue a lighting control command in response to the voice command (S208).

In the case of a lighting control command in S208, the service providing unit control unit 182-4 can control the illuminance value to increase or decrease by using the service providing unit 183 according to the user's voice command (S209).

Next, when controlling the increase/decrease of the illuminance value using the illuminance by the user's voice command, it can be determined whether another voice command or a preset time has elapsed (S210). If another voice command is not recognized or the preset time has elapsed, the illuminance value is maintained. It can be (S211).

As a result, the lighting control unit 180 detects the user's behavior in real time and determines the user's behavior in consideration of time attributes, thereby providing a lighting environment in the shooting room suitable for the user's various actions according to time changes, and adjusting the user's location. By setting the lighting environment of the shooting room suitable for the user's behavior in consideration of the illuminance, the shooting environment desired by the user can be provided.

Hereinafter, the parameter setting unit 190 will be described.

The parameter setting unit 190 can predict optimal camera parameters desired by the user based on the test photo input by the user, and can control the camera 210 according to the predicted camera parameters.

To this end, the parameter setting unit 190 may generate learning data from learning photos input from the administrator. For example, the parameter setting unit 190 may generate the learning photo as training data as is, detect the color transition section from the learning photo, divide the learning photo according to the detected color transition section and compress it, and thereby create the learning data. can be created.

The parameter setting unit 190 may extract characteristic values from the learning data. The characteristic value of one embodiment may include a representative color, representative saturation, or representative subject of the photo.

The parameter setting unit 190 may generate camera parameters of learning data. As described above, the camera parameters of one embodiment may include values such as picture quality, size, camera sensitivity (ISO), filter, aperture, shutter speed, etc., and the parameter setting unit 190 learns from the learning data. By extracting values such as photo quality, size, and sensitivity (ISO), filter, aperture, and shutter speed of the camera that took the learning photo, camera parameters of the learning data can be created.

The parameter setting unit 190 can predict the optimal camera parameters desired by the user through machine learning using the characteristic values of the learning data and camera parameters.

First, the parameter setting unit 190 can learn the parameter prediction model 191 using the learning photo input from the administrator, and input the test photo input from the user into the learned parameter prediction model to optimize the camera for the user. Parameters can be predicted.

FIG. 11 is a diagram for explaining a parameter prediction model 192 according to an embodiment.

Referring to FIG. 11, the parameter setting unit 190 may include a parameter prediction model learning unit 191 and a parameter prediction model 192. The parameter prediction model learning unit 191 and the parameter prediction model 192 are divided according to the functions of the parameter setting unit 190, and it is obvious that all corresponding functions can be performed in the parameter setting unit 190.

An artificial neural network may be used as the parameter prediction model 192 in one embodiment. An artificial neural network is a prediction model implemented in software or hardware that imitates the computational ability of a biological system using a large number of artificial neurons (or nodes).

The parameter prediction model 192 may be supervised by the parameter prediction model learning unit 191 using the characteristic values of the learning data and camera parameters. At this time, supervised learning refers to learning to find an output value according to a given input value by using data with input values and corresponding output values as learning data, and refers to learning that takes place when the correct answer is known. The set of input and output values given to supervised learning is called training data. That is, the characteristic values of the above-described learning data are input values, and the camera parameters of the learning data are output values, and can be used as training data for supervised learning of the parameter prediction model 192.

For example, the parameter prediction model learning unit 191 generates an input value by converting the characteristic values of the learning data into a unique first one-hot vector, and converts the camera parameters of the learning data into a unique one-hot vector. After converting to a second one-hot vector and generating an output value, the parameter prediction model 192 can be supervised using the generated input and output values. Here, the first one-hot vector and the second one-hot vector may be vectors in which one of the component values constituting the vector is '1' and the remaining component values are '0'.

In one example, the parameter prediction model 192 receives an input value, multiplies the connection strength (or weight) for each of the input layer and the output value of the input layer having nodes corresponding to the number of components of the first one-hot vector, and , one or more hidden layers that add a bias and output; And it may include an output layer that multiplies each output value of the hidden layer by a connection strength (or weight) and outputs the result using an activation function. Here, the activation function may be a LeRU function or a Softmax function, but is not limited thereto. Connection strengths and biases can be continuously updated by supervised learning.

Specifically, the parameter prediction model 192 may be supervised so that the output value of the loss function according to the given input value (first one-hot vector) and output value (second one-hot vector) is minimized. . For example, the loss function (H(Y, Y')) can be defined as Equation 2 below.

In Equation 2, Ym may be the mth component of the second one-hot vector, and Y'm may be the mth component of the output vector output by receiving the first one-hot vector from the parameter prediction model 192.

The more training data there is, the more supervised learning can be performed on the parameter prediction model 192, thereby increasing the accuracy of the parameter prediction model 192.

An artificial neural network may be used in the parameter prediction model 192. For example, the parameter prediction model 192 may be implemented as a Bidirectional LSTM (Bi-LSTM) or a Convolutional Neural Network (CNN).

The parameter prediction model 192 can predict camera parameters optimized for the user using a test photo input from the user.

When there are a plurality of camera parameters predicted by the parameter prediction model 192, that is, when the user inputs a plurality of test photos, the parameter setting unit 190 sets the plurality of predicted camera parameters to the camera parameters of the shooting concept selected by the user. By comparing with , the final camera parameters can be determined.

The parameter setting unit 190 may determine, among a plurality of predicted camera parameters, the predicted camera parameter that is most similar to the camera parameter of the shooting concept selected by the user as the final camera parameter.

As described above, camera parameters may include values such as photo quality, size, sensitivity (ISO), filter, aperture, camera shutter speed, etc. For example, the parameter setting unit 190 may set the camera parameters of the shooting concept. The predicted camera parameter with the smallest average difference between the values can be determined as the final camera parameter. In another example, the parameter setting unit 190 sets the predicted camera parameter with the smallest difference between the high priority values according to the priority of the camera parameter values. The parameters can be determined as final camera parameters.

The parameter setting unit 190 may control the camera 210 by generating a device control signal using predicted camera parameters (final camera parameters).

Accordingly, the parameter setting unit 190 can use machine learning to extract optimal camera parameters desired by the user from the user's test photos and apply them to the camera 210 in the shooting room.

FIG. 12 is a diagram illustrating the configuration of a user terminal 300 according to an embodiment. Hereinafter, we will look at the components that make up the user terminal 300 shown in FIG. 12 in turn.

The wireless communication unit 310 may include one or more components that perform wireless communication between the user terminal 300 and the wireless communication system or wireless communication between the user terminal 300 and the network in which the user terminal 300 is located. . For example, the wireless communication unit 310 may include a broadcast reception module 311, a mobile communication module 312, a wireless Internet module 313, a short-range communication module 314, and a location information module 315. .

The broadcast reception module 311 receives broadcast signals and/or broadcast-related information from an external broadcast management server through a broadcast channel. Here, broadcast channels may include satellite channels and terrestrial channels. Meanwhile, broadcast-related information can also be provided through a mobile communication network, and in this case, it can be received by the mobile communication module 312.

Additionally, the mobile communication module 312 transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to voice call signals, video call signals, or text/multimedia message transmission and reception.

The wireless Internet module 313 refers to a module for wireless Internet access and may be built into or external to the user terminal 300.

The short-range communication module 314 refers to a module for short-range communication. As short-range communication technologies, Bluetooth, RFID (Radio Frequency Identification), infrared data association (IrDA), UWB (Ultra Wideband), ZigBee, etc. can be used.

Additionally, the location information module 115 is a module for confirming or obtaining the location of the user terminal 300. An example is a GPS (Global Position System) module. The GPS module receives location information from multiple satellites. Here, the location information may include coordinate information expressed in latitude and longitude.

Meanwhile, the A/V (Audio/Video) input unit 320 is for inputting audio or video signals, and may include a camera 321 and a microphone 322. The camera 321 processes image frames, such as still images or moving images, obtained by an image sensor in video call mode or shooting mode. And, the processed image frame can be displayed on the display unit 351.

The image frame processed by the camera 321 may be stored in the memory 360 or transmitted externally through the wireless communication unit 310. Two or more cameras 321 may be provided depending on the configuration of the user terminal 300.

The microphone 322 receives external sound signals through a microphone in call mode, recording mode, voice recognition mode, etc., and processes them into electrical voice data. Additionally, the processed voice data can be converted into a form that can be transmitted to a mobile communication base station through the mobile communication module 312 and output when in call mode. The microphone 322 may implement various noise removal algorithms to remove noise generated in the process of receiving an external acoustic signal.

The user input unit 330 receives an input action from the user and generates input data for controlling the operation of the user terminal 300.

The sensing unit 340 detects the current state of the user terminal 300, such as the location of the user terminal 300, presence or absence of user contact, orientation of the user terminal 300, acceleration/deceleration of the user terminal 300, etc. Generates a sensing signal to control the operation of the terminal 300.

The interface unit 370 serves as an interface with all external devices connected to the user terminal 300. For example, wired/wireless headset ports, external charger ports, wired/wireless data ports, memory card ports, ports for connecting devices equipped with identification modules, audio I/O (Input/Output) ports, A video I/O (Input/Output) port, an earphone port, etc. may be included.

The output unit 350 is for outputting an audio signal, a video signal, or an alarm signal, and may include a display unit 351, an audio output module 352, an alarm unit 353, etc.

The display unit 351 displays and outputs information processed by the user terminal 300. For example, when the terminal is in call mode, it displays a user interface (UI) or graphic user interface (GUI) related to the call. And, when the user terminal 300 is in a video call mode or a shooting mode, the captured and/or received video, UI, or GUI is displayed.

Meanwhile, as described above, when the display unit 351 and the touch pad form a layered structure to form a touch screen, the display unit 351 can be used as an input device in addition to an output device. The display unit 351 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display ( 3D display). And, depending on the implementation type of the user terminal 300, there may be two or more display units 351. For example, the user terminal 300 may be equipped with an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 352 outputs audio data received from the wireless communication unit 310 or stored in the memory 360 in call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, etc. Additionally, the sound output module 352 outputs sound signals related to functions performed in the user terminal 300 (eg, call signal reception sound, message reception sound, etc.). This sound output module 352 may include a speaker, buzzer, etc.

The alarm unit 353 outputs a signal to notify the occurrence of an event in the user terminal 300. Examples of events that occur in the terminal include receiving a call signal, receiving a message, and inputting a key signal.

The memory 360 may store programs for processing and controlling the control unit 380 and has a function for temporarily storing input/output data (e.g., phone book, messages, still images, videos, etc.). It can also be done.

The memory 360 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), and RAM. (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) magnetic memory, magnetic disk, It may include at least one type of storage medium among optical disks.

The control unit 380 typically controls the overall operation of the terminal. For example, it performs related control and processing for voice calls, data communications, video calls, etc. Additionally, the control unit 380 may be equipped with a multimedia module 181 for multimedia playback. The multimedia module 381 may be implemented within the control unit 380 or may be implemented separately from the control unit 380.

The control unit 380 controls various operations of the terminal to implement the photo studio operation method described above.

The power supply unit 290 receives external power and internal power under the control of the control unit 280 and supplies power necessary for the operation of each component.

Meanwhile, at least some or all of the operations of the operation server 100 described above may be implemented in the user terminal 300. At this time, an application for communicating with the operation server 100 and performing the above-described operation of the operation server 100 may be installed in the user terminal 300 in advance.

Figure 13 is a diagram showing a wireless communication system that can be applied in a communication process according to an embodiment of the present invention. FIG. 14 is a diagram showing a base station in the wireless communication system according to FIG. 13. FIG. 15 is a diagram showing a terminal in the wireless communication system according to FIG. 13. FIG. 16 is a diagram showing a communication interface in the wireless communication system according to FIG. 13.

Below, an example of a wireless communication network system that supports communication between various servers and terminals will be described in detail. In the following description, the first node (device) may be an anchor/donor node or a centralized unit (CU) of an anchor/donor node, and the second node (device) may be a distributed unit (DU) of an anchor/donor node or relay node. It can be.

In a wireless communication system, a base station (BS), terminal, server, etc. may be included as part of the nodes that use a wireless channel.

A base station is a network infrastructure that provides wireless access to terminals and terminals. A base station has a coverage area defined as a geographic area depending on the distance over which signals can be transmitted.

A base station, like a "base station", can be referred to as an "access point (AP)", "enodeb (eNB)", "5th generation (5G) node", "wireless point", " It may be referred to as a “transmission/reception point (TRP)”.

Base stations, terminals, and terminals can transmit and receive wireless signals in the millimeter wave (mmWave) band (e.g., 28 GHz, 30 GHz, 38 GHz, 60 GHz). At this time, the base station, terminal, and terminal may perform beamforming to improve channel gain. Beamforming may include transmit beamforming and receive beamforming. That is, the base station, terminal, and terminal can give directivity to the transmitted signal and the received signal. To this end, the base station, terminal, and terminal can select a serving beam through a beam search procedure or beam management procedure. Thereafter, communication may be performed using a resource that is in a quasi co-located relationship with the resource carrying the serving beam.

A first antenna port and a second antenna port are considered to be quasi-colocated if the large-scale properties of the channel on which the symbols of the first antenna port are carried can be inferred from the channel on which the symbols of the second antenna port are carried. Large-scale properties may include one or more of delay spread, Doppler spread, Doppler shift, average gain, average delay, and spatial Rx parameters.

Below, a base station in the above-described wireless communication system is exemplified. As used hereinafter, the terms "-module", "-unit", or "-er" may mean a unit that processes at least one function or operation, and may mean hardware, software, or hardware and software. It can be implemented as a combination of.

The base station may include a wireless communication interface, a backhaul communication interface, a storage unit, and a controller.

The wireless communication interface performs the function of transmitting and receiving signals through a wireless channel. For example, a wireless communication interface may perform a conversion function between a baseband signal and a bit stream according to the system's physical layer standard. For example, in data transmission, a wireless communication interface compresses and modulates a transmitted bit stream to generate complex symbols. Additionally, when receiving data, the wireless communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream.

The wireless communication interface performs the function of transmitting and receiving signals through a wireless channel. For example, a wireless communication interface may perform a conversion function between a baseband signal and a bit stream according to the system's physical layer standard. For example, in data transmission, a wireless communication interface compresses and modulates a transmitted bit stream to generate complex symbols. Additionally, upon receiving data, the wireless communication interface demodulates and decodes the baseband signal to reconstruct the received bit stream.

Additionally, the wireless communication interface up-converts the base band signal into an RF (Radio Frequency) band signal, transmits the converted signal through an antenna, and then down-converts the RF band signal received through the antenna into a base band signal. For this purpose, the wireless communication interface includes a transmission filter, a reception filter, an amplifier, a mixer, an oscillator, a digital-to-analog convertor (DAC), It may include an analog-to-digital convertor (ADC), etc. Additionally, the wireless communication interface may include a plurality of transmission and reception paths. Additionally, the wireless communication interface may include at least one antenna array including a plurality of antenna elements.

In terms of hardware, a wireless communication interface may include a digital unit and an analog unit, and the analog unit may include a plurality of subunits depending on operating power, operating frequency, etc. The digital unit may be implemented with at least one processor (eg, digital signal processor (DSP)).

The wireless communication interface transmits and receives signals as described above. Accordingly, a wireless communication interface may be referred to as a “transmitter,” “receiver,” or “transceiver.” Additionally, in the following description, transmission and reception performed through a wireless channel may be used to include processing performed in a wireless communication interface as described above.

The backhaul communication interface provides an interface to communicate with other nodes within the network. That is, the backhaul communication interface converts the bit stream transmitted to other nodes, for example, other access nodes, other base stations, upper nodes or the core network from the base station into physical signals, and converts the physical signals received from other nodes into bits. Convert to stream.

The storage unit stores data such as basic programs, applications, and setting information for operation of the base station. The storage unit may include volatile memory, non-volatile memory, or a combination of volatile memory and non-volatile memory.

The controller controls the overall operation of the base station. For example, the controller transmits and receives signals through a wireless communication interface or a backhaul communication interface. Additionally, the controller records data in the storage and reads the recorded data. The controller can perform the protocol stack functions required by communication standards. According to another implementation, the protocol stack may be included in the wireless communication interface. For this purpose, the controller may include at least one processor.

According to one embodiment, the controller may control the base station to perform operations according to the embodiment of the present invention.

According to various embodiments, a donor node of a wireless communication system includes at least one processor, a transceiver operably coupled to the at least one processor, and a plurality of radio bearers for a terminal accessing the relay node. configured to transmit to a relay node a first message containing first information related to the donor node regarding; receive a second message from the relay node containing second information related to the relay node regarding a plurality of radio bearers for the terminal; Data about the terminal can be transmitted to the relay node. Data may be transmitted to the terminal through a plurality of radio bearers based on the first information and the second information.

According to various embodiments, a radio bearer among a plurality of radio bearers may integrate a plurality of radio bearers. The at least one processor is further configured to determine a radio bearer for a terminal accessing the relay node and multiple radio bearers integrated by the radio bearer; Alternatively, a radio bearer for a terminal accessing the relay node can be determined.

According to various embodiments, the first message may include one or more of the following: identification of the terminal accessing the relay node; Display information indicating the type of terminal connecting to the relay node; Information about the radio bearer of the terminal connecting to the relay node; Information about the radio bearer carried by the terminal accessing the relay node; Information about the tunnel established for the radio bearer between the donor node and the relay node; Information on integrated multi-radio bearers; radio bearer mapping information; Information about the address on the donor node side; Information about the address on the relay node side; Indication information corresponding to the radio bearer of the terminal connecting to the relay node; Indication information indicating the relay node to allocate a new address to a radio bearer for a terminal accessing the relay node; A list of address information that cannot be used by the relay node transmitting data of the radio bearer of the terminal connecting to the relay node; and information related to security configuration.

According to various embodiments, the second message may include one or more of the following: identification of the terminal accessing the relay node; Information about radio bearers approved by the relay node; Information about radio bearers not acknowledged by the relay node; Information about radio bearers partially accepted by the relay node; radio bearer mapping information; Configuration information of a terminal connecting to the relay node created by the relay node; Information about the address on the relay node side; and information related to security configuration.

According to various embodiments, the second message may further include information about integrated multiple radio bearers.

According to various embodiments, the donor node may include a central unit of the donor node, and the relay node may include a distributed unit of the donor node.

According to various embodiments, a relay node in a wireless communication system includes at least one processor, includes a transceiver operably coupled to the at least one processor, and transmits, from a donor node, a plurality of terminals accessing the relay node. configured to receive a first message containing first information related to a donor node regarding a radio bearer of; transmitting a second message containing second information related to a relay node regarding a plurality of radio bearers for the terminal to the donor node; Data about the terminal can be received from the donor node. Data may be transmitted to the terminal through a plurality of radio bearers based on the first information and the second information.

According to various embodiments, a radio bearer among a plurality of radio bearers may integrate a plurality of radio bearers. The at least one processor is further configured to determine a radio bearer for a terminal accessing the relay node and multiple radio bearers integrated by the radio bearer; Alternatively, multiple radio bearers integrated by radio bearer may be determined.

According to various embodiments, the first message may include one or more of the following: identification of the terminal accessing the relay node; Display information indicating the type of terminal connecting to the relay node; Information about the radio bearer of the terminal connecting to the relay node; Information about the radio bearer carried by the terminal accessing the relay node; Information about the tunnel established for the radio bearer between the donor node and the relay node; Information on integrated multi-radio bearers; radio bearer mapping information; Information about the address on the donor node side; Information about the address on the relay node side; Indication information corresponding to the radio bearer of the terminal connecting to the relay node; Indication information indicating the relay node to allocate a new address to a radio bearer for a terminal accessing the relay node; A list of address information that cannot be used by the relay node transmitting data of the radio bearer of the terminal connecting to the relay node; and information related to security configuration.

According to various embodiments, the second message may include one or more of the following: identification of the terminal accessing the relay node; Information about radio bearers approved by the relay node; Information about radio bearers not acknowledged by the relay node; Information about radio bearers partially accepted by the relay node; radio bearer mapping information; Configuration information of a terminal connecting to the relay node created by the relay node; Information about the address on the relay node side; and information related to security configuration.

According to various embodiments, the second message may further include information about integrated multiple radio bearers.

According to various embodiments, the donor node may include a central unit of the donor node, and the relay node may include a distributed unit of the donor node.

Below, the components of the terminal in the above-described wireless communication system are shown. The components of the terminal described below are components of a general-purpose terminal supported by a wireless communication system and may be merged or integrated with the components of the terminal according to the above-mentioned contents, and may be compared to the previous drawings to the extent of some overlap or conflict. The content explained with reference may be interpreted as having priority. The terms “-module”, “-unit”, or “-er” used below may refer to a unit that processes at least one function.

The terminal includes a communication interface, a storage unit, and a controller.

The communication interface performs the function of transmitting and receiving signals through a wireless channel. For example, the communication interface performs conversion between baseband signals and bit streams according to the system's physical layer standards. For example, in data transmission, a communication interface compresses and modulates the transmitted bit stream to generate complex symbols. Additionally, when receiving data, the communication interface demodulates and decodes the base band signal to reconstruct the received bit stream. Additionally, the communication interface up-converts the base band signal into an RF band signal, transmits the converted signal through an antenna, and then down-converts the RF band signal received through the antenna into a base band signal. For example, the communication interface includes a transmission filter, reception filter, amplifier, mixer, oscillator, and digital-to-analog convertor (DAC). , analog-to-digital convertor (ADC), etc.

Additionally, the communication interface may include multiple transmission and reception paths. Additionally, the communication interface may include at least one antenna array including a plurality of antenna elements. On the hardware side, the wireless communication interface may include digital circuits and analog circuits (eg, radio frequency integrated circuit, RFIC). A digital circuit may be implemented with at least one processor (e.g., DSP). The communication interface may include multiple RF chains. The communication interface may perform beamforming.

The communication interface transmits and receives signals as described above. Accordingly, a communication interface may be referred to as a “transmitter,” “receiver,” or “transceiver.” Additionally, in the following description, transmission and reception performed through a wireless channel may be used to include processing performed in the communication interface as described above.

The storage unit stores data such as basic programs, applications, and setting information for the operation of the terminal. The storage unit may include volatile memory, non-volatile memory, or a combination of volatile memory and non-volatile memory. Additionally, the storage unit provides stored data upon request from the controller.

The controller controls the overall operation of the terminal. For example, a controller sends and receives signals through a communication interface. Additionally, the controller records data in the storage and reads the recorded data. The controller can perform the protocol stack functions required by communication standards. According to another implementation, a protocol stack may be included in the communication interface. For this purpose, the controller may comprise at least one processor or microprocessor or may reproduce part of a processor. Additionally, a part of the communication interface or controller may be referred to as a communication processor (CP).

According to an embodiment of the present invention, a controller can control a terminal to perform an operation according to an embodiment of the present invention.

Below, a communication interface in a wireless communication system is illustrated.

The communication interface includes compression and modulation circuitry, digital beamforming circuitry, multiple transmission paths, and analog beamforming circuitry.

Compression and modulation circuitry performs channel compression. At least one of a low-density parity check (LDPC) code, a convolutional code, and a polar code may be used for channel compression. The compression and modulation circuit generates modulation symbols by performing constellation mapping.

A digital beamforming circuit performs beam forming on digital signals (eg, modulation symbols). For this purpose, the digital beamforming circuit multiplexes the modulation symbols by beamforming weight values. Beamforming weights can be used to change the size and wording of the signal and may be referred to as a “precoding matrix” or “precoder.” The digital beamforming circuit outputs digital beamformed modulation symbols through a plurality of transmission paths. At this time, depending on the multiple input multiple output (MIMO) transmission method, modulation symbols may be multiplexed or the same modulation symbol may be provided to multiple transmission paths.

A plurality of transmission paths convert digital beamformed digital signals into analog signals. To this end, each of the plurality of transmission paths may include an inverse fast Fourier transform (IFFT) calculation unit, a cyclic prefix (CP) insertion unit, a DAC, and an upconversion unit. The CP insertion unit is for the orthogonal frequency division multiplexing (OFDM) method and can be omitted when applying another physical layer method (e.g., a filter bank multi-carrier (FBMC)). That is, multiple transmission paths provide independent signal processing processes for multiple streams generated through digital beamforming. However, depending on the implementation, some elements of multiple transmission paths may be commonly used.

The analog beamforming circuit performs beamforming on analog signals. For this purpose, the digital beamforming circuit multiplexes the analog signal by beamforming weighting values. Beamformed weights are used to change the size and wording of the signal. More specifically, depending on the connection structure between a plurality of transmission paths and antennas, the analog beamforming circuit can be configured in various ways. For example, each of the plurality of transmission paths may be connected to one antenna array. In another example, multiple transmission paths may be connected to one antenna array. In another example, multiple transmission paths may be adaptively connected to one antenna array or may be connected to two or more antenna arrays.

The steps of the method or algorithm described in connection with embodiments of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or a combination thereof. The software module may be RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, hard disk, removable disk, CD-ROM, or It may reside on any type of computer-readable recording medium well known in the art to which the present invention pertains.

Above, embodiments of the present invention have been described with reference to the attached drawings, but those skilled in the art will understand that the present invention can be implemented in other specific forms without changing its technical idea or essential features. You will be able to understand it. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive.

Claims (8)

A shooting concept reception step of receiving, at the photo studio operation server, a shooting concept name selected by the user among at least one shooting concept name output through a display from the shooting room server;
A concept data extraction step of extracting concept data including camera parameters corresponding to the received shooting concept name and light color and illuminance information of a lighting device from the photo studio operation server using a concept mapping table; and
A control signal generation step of transmitting the extracted concept data from the photo studio operation server to the shooting room server to control cameras, lighting equipment, or a combination thereof provided in the shooting room;
The control signal generation step is,
Receiving at least one test photo from a user terminal provided by the user,
Predict each camera parameter from the at least one test photo,
Compare the predicted camera parameters with the camera parameters of the extracted concept data, respectively,
As a result of the comparison, among the predicted camera parameters, the one most similar to the camera parameter of the extracted concept data is determined as the final camera parameter,
Transmitting the determined final camera parameters and the extracted light color and illuminance information of the lighting device to the shooting room server to control the camera, lighting device, or combination thereof provided in the shooting room,
The test photo includes any one of a photo previously taken by the user, a photo of a celebrity, or a portrait taken by a photography expert,
The concept mapping table is a photo studio operation method, characterized in that camera parameters and light color and illuminance information of lighting equipment are mapped according to the shooting concept name. delete delete delete A non-transitory recording medium on which a program for executing the photo studio operating method according to claim 1 is recorded and which can be read by a computer. At least one processor for executing the photo studio operating method according to claim 1; and
A photo studio operation server comprising a memory that stores a computer program for executing the photo studio operation method. delete As a photo studio operating system,
Cameras provided in the filming room;
Lighting equipment provided in the filming room;
a shooting room server provided in the shooting room that controls the camera, lighting devices, or a combination thereof based on camera parameters of the camera and light color and illuminance information of the lighting device; and
It includes a photo studio operation server that transmits the camera parameters and the light color and illuminance information of the lighting device to the shooting room server,
The photo studio operating server is,
at least one processor; and
Includes a memory that stores instructions that instruct the at least one processor to perform at least one operation,
The at least one operation is,
A shooting concept receiving step of receiving a shooting concept name selected by the user among at least one shooting concept name output from the shooting room server through a display;
A concept data extraction step of extracting concept data including camera parameters corresponding to the received shooting concept name and light color and illuminance information of a lighting device from the photo studio operation server using a concept mapping table; and
A control signal generation step of transmitting the extracted concept data from the photo studio operation server to the shooting room server to control cameras, lighting equipment, or a combination thereof provided in the shooting room;
The control signal generation step is,
Receiving at least one test photo from a user terminal provided by the user,
Predict each camera parameter from the at least one test photo,
Compare the predicted camera parameters with the camera parameters of the extracted concept data, respectively,
As a result of the comparison, among the predicted camera parameters, the one most similar to the camera parameter of the extracted concept data is determined as the final camera parameter,
Transmitting the determined final camera parameters and the extracted light color and illuminance information of the lighting device to the shooting room server to control the camera, lighting device, or combination thereof provided in the shooting room,
The test photo includes any one of a photo previously taken by the user, a photo of a celebrity, or a portrait taken by a photography expert,
The concept mapping table is a photo studio operating system characterized in that camera parameters and light color and illuminance information of lighting equipment are mapped according to the shooting concept name.