KR20220032318A - Method for generating light control time series data and Apparatus thereof - Google Patents

Abstract

The present invention provides a method for generating lighting control time series data and a device thereof. The method for generating lighting control time series data comprises the steps of: receiving first lighting control time series data having first streaming data, second streaming data and color data of a light stick, which changes as synchronized with the first streaming data, recorded therein, from a streaming server; extracting a similar part of the first streaming data and the second streaming data; generating pre-lighting control serial data by duplicating a part of the first lighting control time series data corresponding to the similar part of the first streaming data on the similar part of the second streaming data, wherein the pre-lighting control time series data include an unfinished part and a finished part, where part of the first lighting control time series data have been duplicated; and finishing the pre-lighting control time series data into second lighting control time series data by filling the unfinished part. Therefore, provided is a method for generating lighting control time series data, wherein new lighting control time series data are generated easily using pre-manufactured lighting control time series data.

Description

Method for generating light control time series data and Apparatus thereof

The present invention relates to a method and apparatus for generating lighting control time series data. Specifically, the present invention relates to a method and apparatus for generating new lighting control time series data using existing lighting control time series data.

It includes the light emitting part of the light stick, so it is a device that can emit light of various colors or display the light expression that changes with time by flashing the light. These light sticks were produced exclusively for specific singers and have been used as a way to express the color pattern of the audience harmonious to the singers' performances. As the color temperature and blinking pattern of the light stick change harmoniously in synchronization with the music of the performance, it was possible to bring out a common cultural experience of the singer and the audience.

The light stick used in the recent offline performances of singers is used through short-range wireless communication. Specifically, when the user of the light stick participates in the performance and inputs the seat number where he or she sits, the color change of the light stick is collectively controlled at one control desk according to the position of the seat, so that the light sticks of the attendees can be displayed in various ways in the performance audience. A color pattern can be formed. Through this, the participants of the performance were able to experience a variety of harmonious experiences in the audience.

However, the offline use of such a light stick can be made only in a limited situation attending a performance, so there have been attempts to increase the utility of the light stick. In particular, one of them is an attempt to expand the use of light sticks online as well as offline.

At this time, in order to control the light stick, lighting control time series data synchronized with the moving picture is required, and the production of such light control time series data can be performed manually one by one along the time line of the moving picture. Accordingly, the generation of the light control time series data requires a lot of time and effort, and it may be difficult to produce the light control time series data for many moving pictures. Therefore, if the production of the lighting control time series data can be done quickly and efficiently, users can control the light stick in conjunction with the moving picture much more freely.

An object of the present invention is to provide a lighting control time series data generation method for easily generating new lighting control time series data using pre-fabricated lighting control time series data.

In addition, another object of the present invention is to provide a lighting control time series data generating apparatus for easily generating new lighting control time series data using pre-fabricated light control time series data.

In addition, another object of the present invention is to provide a computer program for executing a data transmission method for controlling a light rod to increase transmission efficiency by embedding data for control of a light rod in streaming data in combination with a computing device.

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention not mentioned may be understood by the following description, and will be more clearly understood by the examples of the present invention. It will also be readily apparent that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the appended claims.

Lighting control time series data generation method according to some embodiments of the present invention for solving the above problems, the first streaming data from the streaming server, the second streaming data and the color data of the light stick changing in synchronization with the first streaming data is recorded Receive the first lighting control time-series data, extract a similar portion of the first streaming data and the second streaming data, and a portion of the first lighting control time-series data corresponding to the similar portion of the first streaming data Creates a duplicated pre-lighting control time-series data in an area corresponding to a similar part of the second streaming data, wherein the pre-lighting control time-series data includes an incomplete part and a completed part in which a part of the first lighting control time-series data is duplicated, , Completing the pre-lighting control time-series data into the second lighting-control time-series data by filling the incomplete part.

In addition, obtaining the playback time of the video while playing the video with the second streaming data, converting the color data of the second lighting control time series data corresponding to the reproduction time into control data, and supporting the control data It may further include burning with a rod.

In addition, the extracting of the similar part includes separating first streaming data into first image data and first sound data, separating second streaming data into first image data and second sound data, and the first sound extracting first pitch data and first magnitude data from the data, extracting second pitch data and second magnitude data from the second sound data, and extracting a similar portion between the first pitch data and the second pitch data This may include extraction.

In addition, extracting the similarity portion between the first pitch data and the second pitch data determines the pitch similarity between the first and second pitch data, and the magnitude similarity between the first and second pitch data. and extracting the similar part by determining the final similarity in consideration of the pitch similarity and the size similarity.

Also, determining the final similarity may include determining the image similarity of the first and second image data, and determining the final similarity in consideration of the pitch similarity, the size similarity, and the image similarity. .

Also, extracting the similar part may include extracting through artificial intelligence.

Lighting control time series data generating apparatus according to some embodiments of the present invention for solving the other problem receives the first and second streaming data, and separates the first streaming data into first image data and first sound data and an image and sound data separation unit for separating the second streaming data into a second image data and a second sound data, receiving the first lighting control time series data synchronized with the first streaming data, and the first and the first 2 Extract a similar part of the sound data, and generate pre-lighting control time-series data based on the similar part and the first lighting control time-series data, wherein the pre-lighting control time-series data is a part of the first lighting control time-series data A second lighting control time series data completion unit by filling in the incomplete part of the pre-lighting control time-series data and a similar feature extraction unit including the duplicated completed part and the incomplete part.

In addition, the similar feature extracting unit includes a data preprocessing unit for extracting first pitch data and first size data from the first sound data, and extracting second pitch data and second size data from the second sound data; A similar part detection unit for detecting a similar part between the first and second pitch data, and lighting control time series data forming that duplicates the completion part of the pre-lighting control time series data through the first lighting control time series data and the similar part may include wealth.

The similarity detection unit may include a pitch similarity evaluation unit evaluating the pitch similarity of the first and second pitch data, a size similarity evaluation unit evaluating the size similarity of the first and second size data, and the pitch and a final similarity determining unit for extracting a similar part by determining a final similarity in consideration of the similarity and the size similarity.

In addition, the similarity detection unit further includes an image similarity evaluation unit for evaluating the image similarity of the first and second image data, and the final similarity determining unit considering the pitch similarity, the size similarity, and the image similarity to the final similarity can be determined to extract a similar part.

In addition, it may further include a control data conversion unit for converting the first and second lighting control time-series data into first and second control data, respectively, and transmitting it to the light stick.

The lighting control time-series data generation method and apparatus of the present invention can quickly generate new lighting control time-series data using the completed lighting control time-series data between similar streaming data.

In addition, the user of the light stick can automatically generate the lighting control time series data directly through the mobile terminal without much effort.

The specific effects of the present invention in addition to the above will be described together while explaining the specific details for carrying out the invention below.

1 is a conceptual diagram illustrating a light rod color control system in which an apparatus for generating light control time series data according to some embodiments of the present invention is implemented.
FIG. 2 is a block diagram for explaining in detail the structure of the mobile terminal of FIG. 1 .
FIG. 3 is a block diagram for explaining in detail the structure of the light rod of FIG. 1 .
4 is a block diagram for explaining the structures of the first streaming data and the second streaming data of FIG. 1 .
5 is a block diagram for describing in detail a process of completing lighting control time series data and deriving control data using the structure of the mobile terminal of FIG. 1 .
6 is a block diagram illustrating in detail the similar feature extracting unit of FIG. 5 .
7 is a block diagram for explaining extraction of pitch data and size data from first and second sound data.
8 is a diagram for explaining a method of extracting a similar portion from first and second streaming data.
9 is a block diagram illustrating in detail the similarity detection unit of FIG. 6 .
FIG. 10 is a view for explaining the operation of the lighting control time series data completion unit of FIG. 5 .
11 is a block diagram illustrating an apparatus for generating light control time series data according to some embodiments of the present invention.
FIG. 12 is a block diagram for explaining in detail the similarity detection unit of FIG. 11 .
13 is a flowchart illustrating a method of generating lighting control time series data according to some embodiments of the present invention.
14 is a block diagram for explaining in detail the control data generation step of FIG. 13 .
15 to 19 are intermediate step diagrams for explaining in detail the control data generation step of FIG. 13 .
20 is a multi-subject flowchart illustrating a method of generating lighting control time series data according to some embodiments of the present invention.

Terms or words used in this specification and claims should not be construed as being limited to a general or dictionary meaning. In accordance with the principle that the inventor can define a term or concept of a word in order to best describe his/her invention, it should be interpreted as meaning and concept consistent with the technical idea of the present invention. In addition, since the embodiments described in this specification and the configurations shown in the drawings are only one embodiment in which the present invention is realized, and do not represent all the technical spirit of the present invention, they can be substituted at the time of the present application. It should be understood that there may be various equivalents and modifications and applicable examples.

Terms such as first, second, A, B, etc. used in this specification and claims may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. The term 'and/or' includes a combination of a plurality of related listed items or any of a plurality of related listed items.

Terms used in this specification and claims are used only to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. It should be understood that terms such as “comprise” or “have” in the present application do not preclude the possibility of addition or existence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification in advance. .

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

In addition, each configuration, process, process or method included in each embodiment of the present invention may be shared within a range that does not technically contradict each other.

Hereinafter, a data transmission method for controlling a light stick according to some embodiments of the present invention will be described with reference to FIGS. 1 to 10 .

1 is a conceptual diagram illustrating a lightstick color control system in which an apparatus for generating light control time series data according to some embodiments of the present invention is implemented.

Referring to FIG. 1 , the lightstick color control system in which the data transmission method for controlling the lightstick according to some embodiments of the present invention is implemented is a streaming server 100 , a mobile terminal 200 and a lightstick 300 . include

Streaming server 100 may provide the first streaming data (Dv1), the second streaming data (Dv2) and the first lighting control time series data (Dn1) to the mobile terminal 200 (Dn1). The streaming server 100 includes a workstation, a data center, an internet data center (IDC), a direct attached storage (DAS) system, a storage area network (SAN) system, and a network attached storage (NAS) system. and RAID (redundant array of inexpensive disks, or redundant array of independent disks) systems, but the present embodiment is not limited thereto.

The streaming server 100 may transmit data to the mobile terminal 200 through a network. The network may include a network based on a wired Internet technology, a wireless Internet technology, and a short-range communication technology. Wired Internet technology may include, for example, at least one of a local area network (LAN) and a wide area network (WAN).

Wireless Internet technologies are, for example, wireless LAN (WLAN), DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband: Wibro), Wimax (World Interoperability for Microwave Access: Wimax), HSDPA (High Speed Downlink Packet) Access), High Speed Uplink Packet Access (HSUPA), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS) and 5G New Radio (NR) technology. However, the present embodiment is not limited thereto.

Short-range communication technologies include, for example, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra-Wideband (UWB), ZigBee, and Near Field Communication: At least one of NFC), Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, Wi-Fi Direct, and 5G NR (New Radio) may include However, the present embodiment is not limited thereto.

The streaming server 100 and the mobile terminal 200 communicating through the network may comply with technical standards and standard communication methods for mobile communication. For example, standard communication methods include Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), and Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (EV-DO). , at least one of Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTEA), and 5G New Radio (NR) may include However, the present embodiment is not limited thereto.

The streaming server 100 may transmit the first streaming data Dv1 and the second streaming data Dv2 to the mobile terminal 200 . The first streaming data Dv1 and the second streaming data Dv2 may be data implemented to reproduce the first video and the second video in the mobile terminal 200 , respectively. Specifically, the first streaming data (Dv1) is data implemented so that the mobile terminal 200 can play a first video through streaming, and the second streaming data (Dv2) is data obtained by the mobile terminal 200 through streaming. 2 It may be data implemented to play a video.

The mobile terminal 200 may play a video in the mobile terminal 200 using the received first streaming data Dv1 and second streaming data Dv2. In addition, the mobile terminal 200 may generate the first control data (Dc1) from the received first lighting control time series data (Dn1). In addition, the mobile terminal 200 may generate the second lighting control time series data (Dn2), and generate the second control data (Dc2) therefrom.

The first control data Dc1 and the second control data Dc2 may be data corresponding to the color data of the first lighting control time series data Dn1 and the second lighting control time series data Dn2, respectively. The first control data Dc1 and the second control data Dc2 may be data directly used to change the color of the light stick 300 . The mobile terminal 200 may transmit the first control data Dc1 and the second control data Dc2 to the light rod 300 to change the color emitted by the light rod 300 . At this time, the mobile terminal 200 converts the color data of the first light control time series data (Dn1) and the second light control time series data (Dn2) corresponding to each of the playback times of the first video and the second video in real time The first control data Dc1 and the second control data Dc2 may be transmitted.

The first lighting control time-series data (Dn1) and the second lighting control time-series data (Dn2) may be data corresponding to the first streaming data (Dv1) and the second streaming data (Dv2), respectively. The first lighting control time series data (Dn1) and the second lighting control time series data (Dn2) may be data synchronized with the first streaming data (Dv1) and the second streaming data (Dv2), respectively. The first lighting control time-series data (Dn1) and the second lighting control time-series data (Dn2) are the first streaming data (Dv1) and the second streaming data (Dv2), respectively, the playback time of the first video and the second video reproduced by It may include the color data of the light stick 300 that changes according to the.

Through this, while the mobile terminal 200 plays the first video or the second video according to the first streaming data Dv1 or the second streaming data Dv2, the color emitted by the light stick 300 is the first It may change in response to the lighting control time-series data (Dn1) and the second lighting control time-series data (Dn2). In this case, the above-described “color data” may be a concept that includes data about the blinking of light in addition to the simple color of light.

In conclusion, the first control data (Dc1) is synchronized with the first lighting control time series data (Dn1) and the first streaming data (Dv1), the second control data (Dc2) is the second lighting control time series data (Dn2) and It may be synchronized with the second streaming data Dv2.

The mobile terminal 200 may be driven by a program or application installed therein. The mobile terminal 200 is a first control data (Dc1) and a first control data (Dc1) composed of a byte (byte) array through the library stored in advance the color data located in the first lighting control time series data (Dn1) and the second lighting control time series data (Dn2) and Each of the second control data Dc2 may be converted. However, the present embodiment is not limited thereto.

The light stick 300 may be connected to the mobile terminal 200 through short-range communication technology. Short-range communication technologies include, for example, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra-Wideband (UWB), ZigBee, and Near Field Communication: At least one of NFC), Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, Wi-Fi Direct, and 5G NR (New Radio) may include However, the present embodiment is not limited thereto. Hereinafter, for convenience, the light stick 300 will be described as being paired with the mobile terminal 200 through Bluetooth.

The light stick 300 may emit light of various colors. The light stick 300 may also display a flashing signal of light. The light stick 300 may receive the first control data Dc1 and the second control data Dc2 from the mobile terminal 200 in real time, respectively. The light stick 300 may control the color and blinking of emitted light through the first control data Dc1 and the second control data Dc2 .

FIG. 2 is a block diagram for explaining in detail the structure of the mobile terminal of FIG. 1 .

2 , the mobile terminal 200 according to an embodiment of the present invention includes a controller 210, an input/output device 220, I/O, a memory device 230, a memory device, an interface 240, and a bus ( 250, bus). The controller 210 , the input/output device 220 , the memory device 230 , and/or the interface 240 may be coupled to each other through the bus 250 . The bus 250 corresponds to a path through which data is moved.

The controller 210 includes a central processing unit (CPU), a micro processor unit (MPU), a micro controller unit (MCU), a graphic processing unit (GPU), a microprocessor, a digital signal processor, a microcontroller, an application processor (AP). ) and logic elements capable of performing a function similar thereto.

The input/output device 220 may include at least one of a keypad, a keyboard, a touch screen, and a display device. The memory device 230 may store data and/or a program.

The interface 240 may perform a function of transmitting data to or receiving data from a communication network. The interface 240 may be in a wired or wireless form. For example, the interface 240 may include an antenna or a wired/wireless transceiver. Although not shown, the memory device 230 is a working memory for improving the operation of the controller 210 , and may further include a high-speed DRAM and/or SRAM. The memory device 230 may store a program or an application therein. The mobile terminal 200 may implement a data transmission method for controlling the light stick according to some embodiments of the present invention to be described later through a program or an application.

The mobile terminal 200 includes a personal digital assistant (PDA), a portable computer, a web tablet, a wireless phone, a mobile phone, and a digital music player (digital). music player), a memory card, or any electronic product capable of transmitting and/or receiving information in a wireless environment.

Alternatively, the mobile terminal 200 in which the light stick color change method according to the embodiments of the present invention is implemented may be a system in which a plurality of mobile terminals 200 are connected to each other through a network. In this case, each module or combinations of modules may be implemented as the mobile terminal 200 . However, the present embodiment is not limited thereto.

FIG. 3 is a block diagram for explaining in detail the structure of the light rod of FIG. 1 .

Referring to FIG. 3 , the light stick 300 may include a communication unit 310 , a light emitting unit 320 , a control unit 330 , a power supply unit 340 , and a button unit 350 .

The communication unit 310 may communicate with the mobile terminal 200 . The communication unit 310 may establish communication with the mobile terminal 200 using short-range communication technology. The communication unit 310 may receive the control data Dc from the mobile terminal 200 . The communication unit 310 may transmit the control data Dc to the control unit 330 .

The controller 330 includes a central processing unit (CPU), a micro processor unit (MPU), a micro controller unit (MCU), a graphic processing unit (GPU), a microprocessor, a digital signal processor, a microcontroller, an application processor (AP). ) and logic elements capable of performing a function similar thereto. However, the present embodiment is not limited thereto.

The controller 330 may control the color and blinking of the light of the light emitting unit 320 . The controller 330 may operate in at least two modes, a first mode and a second mode. The first mode may be a mode in which the light emitting unit 320 is controlled through the control data Dc, and the second mode may be a mode in which the light emitting unit 320 is controlled by the control button 352 .

In the first mode, the control unit 330 may receive the control data Dc from the communication unit 310 . The controller 330 may control the color and blinking of the light of the light emitting unit 320 by using the control data Dc.

In the second mode, the control unit 330 may control the light emitting unit 320 according to the color change and blinking pattern of the light preset by the control button 352 of the button unit 350 .

The light emitting unit 320 may emit light of various colors. The light emitting unit 320 may express the flickering of light. The light emitting unit 320 may include a transparent case and a light source expressing various colors. However, the present embodiment is not limited thereto.

The power supply unit 340 may supply power to the communication unit 310 , the light emitting unit 320 , and the control unit 330 . The power supply unit 340 may include a space in which the battery is accommodated. However, the present embodiment is not limited thereto.

The button unit 350 may include a mode change button 351 and a control button 352 . The mode change button 351 may be operated in any one of an off state, a first mode state, and a second mode state. When the mode change button 351 is in an off state, power supply from the power supply unit 340 may be cut off. Accordingly, the power of the light rod 300 may be turned off.

When the mode change button 351 is in the first mode state, the communication unit 310 may attempt to connect to the mobile terminal 200 using a short-range wireless technology. For example, the communication unit 310 may attempt Bluetooth pairing with the mobile terminal. When the communication unit 310 is connected to the mobile terminal 200 to receive the control data Dc, the control unit 330 may receive the control data Dc to control the light emitting unit 320 .

When the mode change button 351 is in the second mode state, the light emitting unit 320 may be controlled by the control button 352 . Specifically, according to the number of times the control button 352 is pushed, the color and blinking pattern of the light emitting unit 320 designated in advance may be changed. The control unit 330 may receive the number of times the control button 352 is pushed, so that the color and blinking pattern of the light emitting unit 320 may be changed. However, the present embodiment is not limited thereto.

Although only two buttons of the mode change button 351 and the control button 352 are included in the button unit 350 in FIG. 3 , the present embodiment is not limited thereto. That is, in the light rod 300 of the data transmission method for controlling the light rod according to the present embodiment, three or more buttons may exist in the button unit 350 .

4 is a block diagram for explaining the structures of the first streaming data and the second streaming data of FIG. 1 .

Referring to FIG. 4 , the first streaming data Dv1 may include the first image data Di1 and the first sound data Ds1. The first image data Di1 may be a part corresponding to an image in the first moving picture, and the first sound data Ds1 may be a part corresponding to a sound in the moving picture. In this case, the first image data Di1 and the first sound data Ds1 may be data that change in time series.

The first image data Di1 and the first sound data Ds1 may be synchronized with each other and reproduced together when the first moving picture is reproduced. That is, the first image data Di1 may be output as an image through a display or the like, and the first sound data Ds1 may be output as a sound through a speaker or the like. The first image data Di1 and the first sound data Ds1 are synchronized and output in time series, and the first moving picture may be reproduced.

Similarly, the second streaming data Dv2 may include the second image data Di2 and the second sound data Ds2. The second image data Di2 may be a part corresponding to an image in the second moving picture, and the second sound data Ds2 may be a part corresponding to a sound in the moving picture. In this case, the second image data Di2 and the second sound data Ds2 may be time-series data. A second video may be reproduced while the second image data Di2 and the second sound data Ds2 are synchronized and output in time series.

Subsequently, the first sound data Ds1 and the second sound data Ds2 may be compared with each other to extract a similar part.

5 is a block diagram for describing in detail a process of completing lighting control time series data and deriving control data using the structure of the mobile terminal of FIG. 1 .

Referring to FIG. 5 , the mobile terminal 200 may include an image and sound data separation unit 260 , a similar feature extraction unit 270 , a lighting control time series data completion unit 280 , and a control data conversion unit 290 . can

Specifically, when the mobile terminal 200 receives the first streaming data (Dv1) and the second streaming data (Dv2) from the streaming server 100, the mobile terminal 200 preferentially the first streaming data (Dv1) and the second streaming data Dv2 may be transmitted to the image and sound data separation unit 260 .

The image and sound data separation unit 260 may separate the first image data Di1 and the first sound data Ds1 from the first streaming data Dv1. The image and sound data separation unit 260 may separate the second image data Di2 and the second sound data Ds2 from the second streaming data Dv2. The first streaming data Dv1 and the second streaming data Dv2 include first sound data Ds1 and first image data Di1 and second sound data Ds2 and second image data Di2, respectively. are doing Accordingly, the image and sound data separation unit 260 may separate and extract only the first sound data Ds1 and the second sound data Ds2 excluding the first image data Di1 and the second image data Di2. .

Subsequently, the image and sound data separation unit 260 may transmit the separated first sound data Ds1 and second sound data Ds2 to the similarity feature extraction unit 270 . The similar feature extraction unit 270 may receive the first lighting control time series data Dn1 from the streaming server 100 .

The similar feature extractor 270 may compare the first sound data Ds1 and the second sound data Ds2 to extract a similar part having a similar feature. In this case, the similar portion may exist in the first sound data Ds1 and the second sound data Ds2, respectively. The similar feature extraction unit 270 copies the color data of the first lighting control time series data Dn1 corresponding to the time of the similar part of the first sound data Ds1 to the time of the similar part of the second sound data Ds2 to generate the pre-lighting control time-series data Dn2a. The pre-lighting control time-series data (Dn2a) may be completed later as the second lighting control time-series data (Dn2).

Subsequently, the lighting control time series data completion unit 280 may receive the free lighting control time series data (Dn2a). In this case, the pre-lighting control time-series data (Dn2a) may include a completed part and an unfinished part of which data is not yet determined, duplicated from the first lighting control time-series data (Dn1). The lighting control time-series data completion unit 280 may complete the pre-lighting control time-series data Dn2a as the second lighting control time-series data Dn2 by filling the incomplete part with color data.

Subsequently, the control data conversion unit 290 may receive the second lighting control time series data (Dn2) from the lighting control time series data completion unit 280. Control data conversion unit 290 may receive the first lighting control time series data (Dn1) from the streaming server (100). The control data conversion unit 290 converts the first lighting control time series data (Dn1) into the first control data (Dc1), and converts the second lighting control time series data (Dn2) into the second control data (Dc2) there is. The control data converter 290 may transmit the first control data Dc1 and the second control data Dc2 to the light stick 300 .

FIG. 6 is a block diagram for explaining in detail the similar feature extracting unit of FIG. 5 , and FIG. 7 is a block diagram for explaining extracting pitch data and size data from first and second sound data. FIG. 8 is a diagram for explaining a method of extracting a similar part from first and second streaming data, and FIG. 9 is a block diagram for explaining in detail the similar part detecting unit of FIG. 6 .

Referring to FIG. 6 , the similarity feature extraction unit 270 includes a data preprocessing unit 271 , a similarity portion detection unit 272 , and a lighting control time series data forming unit 273 .

6 and 7 , the data preprocessor 271 may receive the first sound data Ds1 and the second sound data Ds2. The first sound data Ds1 may include the first pitch data Dp1 and the first size data Db1.

The first pitch data Dp1 may be data about a tone that changes according to time of the first sound data Ds1, that is, a pitch. The first pitch data (Dp1) may of course be synchronized with the first lighting control time series data (Dn1).

The first volume data Db1 may be data on the volume of the first sound data Ds1 that changes according to time. The first size data (Db1) may also be synchronized with the first lighting control time series data (Dn1).

Similarly, the second pitch data Dp2 is data on a time-varying pitch of the second sound data Ds2, and the second magnitude data Db2 is a time-varying sound of the second sound data Ds2. It may be data about the size of .

The data preprocessor 271 may extract the first pitch data Dp1 from the first sound data Ds1 . Also, the data preprocessor 271 may extract the second pitch data Dp2 from the first sound data Ds1 . The data preprocessor 271 may also extract the first size data Db1 from the first sound data Ds1 and the second size data Db2 from the second sound data Ds2, if necessary. However, the present embodiment is not limited thereto.

6 and 8 , the similarity detection unit 272 may detect a similarity between the first pitch data Dp1 and the second pitch data Dp2 . For example, the first similar feature F1 of the first pitch data Dp1 and the third similar feature F3 of the second pitch data Dp2 may be similar parts that are similar to each other. Also, the second similar feature F2 of the first pitch data Dp1 and the fourth similar feature F4 of the second pitch data Dp2 may be similar parts that are similar to each other. The degree of similarity between the first to fourth similar features F1 to F4 may be determined through artificial intelligence or machine learning. However, the present embodiment is not limited thereto.

In FIG. 8 , a total of four similar features are shown, two for each data, but the present embodiment is not limited thereto. That is, the number of similar features may vary.

As shown in the first similar feature F1 and the third similar feature F3 , the similar portion may be located at different times in the first pitch data Dp1 and the second pitch data Dp2 . That is, in the first pitch data Dp1, the first similar feature F1 may be positioned at 0 to 3 s, but in the second pitch data Dp2, the second similar feature F2 may be positioned at 1 to 4 s.

Also, similar parts extracted as being similar to each other, such as the first similar feature F1 and the third similar feature F3, do not have to be completely identical, and may be extracted as a similar part when the degree of similarity is greater than or equal to a preset reference value. Such a reference value may be freely changed by the user. The similarity detection unit 272 may transmit the extracted first to fourth similarity features F1 to F4 to the lighting control time series data forming unit 273 .

9 is a block diagram illustrating in detail the similarity detection unit of FIG. 6 .

Referring to FIG. 9 , the similarity detection unit 272 may include a pitch similarity evaluation unit 272_1 , a size similarity evaluation unit 272_2 , and a final similarity determination unit 272_3 .

The pitch similarity evaluation unit 272_1 may evaluate the pitch similarity of the first pitch data Dp1 and the second pitch data Dp2 as described above with reference to FIG. 8 . The size similarity evaluation unit 272_2 may evaluate the size similarity of the first size data Db1 and the second size data Db2. In this case, the magnitude similarity may be evaluated in the same manner as in the method of evaluating the pitch similarity of FIG. 8 .

The final similarity determining unit 272_3 may finally determine the final similarity in consideration of the pitch similarity and the size similarity. In this case, 100% of the pitch similarity may be considered and 0% of the size similarity may be considered, and such a case may be a method of extracting the first to fourth similarity features F1 to F4 in FIG. 8 .

That is, the final similarity determining unit 272_3 may finally determine the final similarity with respective weights for the pitch similarity and the size similarity. Each weight may be between 0 and 100%, and the sum of the weights may be 100%. A portion in which the determined final similarity is higher than a preset reference value may be extracted as a similar portion like the first to fourth similarity features F1 to F4.

The lighting control time series data generating apparatus according to some embodiments of the present invention may determine the similarity by mainly using the pitch similarity, and determine the similarity by using the size similarity as an auxiliary. That is, the weight of the pitch similarity may be greater than or equal to the weight of the magnitude similarity. However, the present embodiment is not limited thereto.

In the lighting control time-series data generating apparatus according to some embodiments of the present invention, a similar portion may be preferentially extracted by the pitch similarity evaluation unit 272_1. Then, the size similarity evaluation unit 272_2 determines the size similarity only for the extracted similarity parts, and the final similarity determining unit 272_3 also determines the final similarity only for the extracted similar parts, and selects a similar part from among them. there is. Through this, it is possible to more precisely determine the similarity by excluding parts having similar pitches even if they are similar in size. However, the present embodiment is not limited thereto.

Referring to FIG. 6 , the lighting control time series data forming unit 273 receives the first to fourth similar features F1 to F4 from the similar part detection unit 272 , and the first lighting control time series from the streaming server 100 . The data Dn1 may be received.

The lighting control time series data forming unit 273 separates the color data of the first lighting control time series data Dn1 corresponding to the first similar feature F1 and the second similar feature F2 with the first color data D1 and It may be defined as the second color data D2. The first color data D1 and the second color data D2 may be a collection of color data positioned at a time at which the first similar feature F1 and the second similar feature F2 are positioned.

The lighting control time series data forming unit 273 may generate the pre-lighting control time series data Dn2a in which the first color data D1 and the second color data D2 are duplicated. In this case, the pre-lighting control time-series data Dn2a may include a completed portion in which the first color data D1 and the second color data D2 are copied and an incomplete portion TBD to be determined later.

The finished part may have third color data D3 and fourth color data D4 that are identical to the first color data D1 and second color data D2. Specifically, the third color data D3 may be the same as the first color data D1 , and the fourth color data D4 may be the same as the second color data D2 .

However, the time at which the third color data D3 and the fourth color data D4 are located may be different from the time at which the first color data D1 and the second color data D2 are located. Specifically, the time at which the third color data D3 is located is the time at which the third similar feature F3 of the second pitch data Dp2 is located, and the time at which the fourth color data D4 is located is the time at which the second pitch data ( It may be a time at which the fourth similar feature F4 of Dp2) is located.

FIG. 10 is a view for explaining the operation of the lighting control time series data completion unit of FIG. 5 .

5 and 10 , the lighting control time series data completion unit 280 may receive the pre-lighting control time series data Dn2a from the similar feature extraction unit 270 . The pre-lighting control time-series data Dn2a may include a completed part such as the third color data D3 and the fourth color data D4 and an unfinished incomplete part.

The lighting control time series data completion unit 280 fills the incomplete part with the fifth color data D5 and the sixth color data D6 and completes the free lighting control time series data Dn2a with the second light control time series data Dn2 can do it

There may be various ways to fill in the incomplete parts. The lighting control time series data completion unit 280 may complete the second lighting control time series data Dn2 by sequentially adding preset color data to the incomplete parts.

Alternatively, the lighting control time series data completion unit 280 may determine the color data of the unfinished part by using the color data located on the side of the unfinished part. For example, color data having a color temperature having an average or an intermediate value of color temperatures of color data of both sides of the unfinished portion may be determined as the color data of the unfinished portion. Through this, it is possible to derive a natural color change of the light stick 300 . However, the present embodiment is not limited thereto.

Alternatively, the lighting control time series data completion unit 280 may automatically fill in the incomplete part after learning several lighting control time series data based on artificial intelligence. However, the present embodiment is not limited thereto.

This embodiment presents an efficient method for generating lighting control time-series data for controlling the color change of the light stick 300 . That is, in general, in order to generate the lighting control time series data, each must be manually produced according to the timeline of the video, which requires a lot of time and effort.

However, in the case of a moving picture similar to a moving picture in which the lighting control time series data has already been produced, it may be inefficient to manually produce the light control time series data again. For example, in the case of a video of another performance of the same song, a cover video, or an image of a partially modified song, it is possible to automatically generate light control time series data corresponding to the existing light control time series data by using the existing light control time series data.

Hereinafter, an apparatus for generating light control time series data according to some embodiments of the present invention will be described with reference to FIGS. 11 and 12 . Parts overlapping with the above-described embodiment will be simplified or omitted.

11 is a block diagram illustrating an apparatus for generating light control time series data according to some embodiments of the present invention, and FIG. 12 is a block diagram illustrating in detail the similarity detection unit of FIG. 11 .

Referring to FIG. 11 , the image and sound data separation unit 260 also transmits the first image data Di1 and the second image data Di2 to the similarity feature extraction unit 270 .

Referring to FIG. 12 , the similarity detection unit 272 includes an image similarity evaluation unit 272_4 . The image similarity evaluation unit 272_4 may evaluate the image similarity of the first image data Di1 and the second image data Di2 . In this case, the image similarity may be determined using at least one of a convolutional neural network (CNN), a graphic neural network (GNN), and a recurrent neural network (RNN). However, the present embodiment is not limited thereto.

That is, the final similarity determining unit 272_3 may finally determine the final similarity with respective weights for the pitch similarity, size similarity, and image similarity. Each weight may be between 0 and 100%, and the sum of the weights may be 100%. A portion in which the determined final similarity is higher than a preset reference value may be extracted as a similar portion like the first to fourth similarity features F1 to F4.

In the present embodiment, the final similarity can be more precisely determined using the image similarity. Through this, it is possible to more efficiently generate lighting control time series data for a similar part.

Hereinafter, a method of generating lighting control time series data according to some embodiments of the present invention will be described with reference to FIGS. 13 to 20 . Parts overlapping with the above-described embodiment will be simplified or omitted.

13 is a flowchart illustrating a method of generating lighting control time series data according to some embodiments of the present invention.

Referring to FIG. 13 , the video content is accessed ( S110 ).

Specifically, referring to FIG. 1 , video content may be provided to the mobile terminal 200 by the streaming server 100 . The mobile terminal 200 may access the video content provided by the streaming server 100 through an application or program.

Again, referring to FIG. 13 , the reception of the first lighting control time series data starts ( S120 ).

Specifically, referring to FIG. 1 , the streaming server 100 may transmit the first lighting control time series data Dn1 to the mobile terminal 200 .

Again, referring to FIG. 13 , it is determined whether it is connected to the light stick (S130).

Specifically, referring to FIG. 1 , specifically, referring to FIG. 1 , when the light stick 300 and the mobile terminal 200 are not connected to each other, they may wait until they are connected. When the light stick 300 and the mobile terminal 200 are connected to each other, the following procedure may be performed.

Again, referring to FIG. 13, it is determined whether the reception of the first lighting control time series data is completed (S140).

Specifically, referring to FIG. 1 , the mobile terminal 200 receives the first lighting control time series data Dn1 from the streaming server 100 , and when the reception is complete, the following procedure may be performed.

13 shows that step S130 is performed before step S140, the present embodiment is not limited thereto. That is, steps S130 and S140 may be performed in parallel.

Again, referring to FIG. 13 , reception of the first and second streaming data is started ( S150 ).

Specifically, referring to FIG. 1 , the mobile terminal 200 receives the first streaming data Dv1 and the second streaming data Dv2 from the streaming server 100 to play the first video and the second video, that is, , can be streamed. In the video streaming, the reception of the first streaming data (Dv1) and the second streaming data (Dv2) and the reproduction of the first video and the second video are performed in parallel, and the streaming data corresponding to the video part being played is transmitted to the video playback. It should be received in advance by the mobile terminal 200 in advance. In this case, the video may not be played after the streaming data is completely received, but the video may be played for the previously received portion as the streaming data is received.

Again, referring to FIG. 13 , a second lighting control time series data is generated ( S160 ).

Specifically, referring to FIG. 5 , the image and sound data separation unit 260 may separate the first image data Di1 and the first sound data Ds1 from the first streaming data Dv1. The image and sound data separation unit 260 may separate the second image data Di2 and the second sound data Ds2 from the second streaming data Dv2. Subsequently, the image and sound data separation unit 260 may transmit the separated first sound data Ds1 and second sound data Ds2 to the similarity feature extraction unit 270 . The similar feature extraction unit 270 may receive the first lighting control time series data Dn1 from the streaming server 100 .

The similar feature extractor 270 may compare the first sound data Ds1 and the second sound data Ds2 to extract a similar part having a similar feature. The similar feature extraction unit 270 copies the color data of the first lighting control time series data Dn1 corresponding to the time of the similar part of the first sound data Ds1 to the time of the similar part of the second sound data Ds2 to generate the pre-lighting control time-series data Dn2a. The lighting control time-series data completion unit 280 may complete the pre-lighting control time-series data Dn2a as the second lighting control time-series data Dn2 by filling the incomplete part with color data.

Again, referring to FIG. 13 , control data according to the second video playback time is generated ( S170 ).

Specifically, referring to FIGS. 1 and 2 , the mobile terminal 200 checks the playback time of the second video currently being played in the mobile terminal 200 and generates the second control data Dc2 accordingly. can The second lighting control time series data Dn2 is data synchronized with the second streaming data Dv2, and color data according to the second video playback time may be arranged. Accordingly, the mobile terminal 200 may convert the color data corresponding to the second video playback time into the control data Dc.

In this case, the mobile terminal 200 may convert the color data of the second lighting control time series data Dn2 to the second control data Dc2 in real time at the second video playback time. In this case, since the conversion itself is performed immediately, an additional operation is not required, and thus the speed of the entire operation may be increased.

Alternatively, the mobile terminal 200 may convert the color data of the second lighting control time series data (Dn2) into the second control data (Dc2) by using a delay call by securing the buffer time from the second video playback time. In this case, since the synchronization between the reproduction of the second video and the conversion of the second control data Dc2 is calculated in advance, the possibility of synchronization failure can be minimized. How to use the buffer time will be described in more detail later.

Again, referring to FIG. 13 , the second control data is transmitted to the light stick (S180).

Specifically, referring to FIG. 1 , the mobile terminal 200 may transmit the second control data Dc2 to the light stick 300 through short-range communication technology.

14 is a block diagram for explaining in detail the control data generation step of FIG. 13 . FIG. 14 shows detailed steps of step S170 of FIG. 13 . 15 to 19 are intermediate step diagrams for explaining in detail the control data generation step of FIG. 13 .

Referring to FIG. 14 , a second video playback time is received ( S171 ).

Specifically, referring to FIG. 15 , the current playback time may be checked. The current playback time can be continued as time passes.

Again, referring to FIG. 14 , the second lighting control time series data of the first future time closest to the second video playback time is searched (S172).

Specifically, referring to FIG. 15 , the second lighting control time series data Dn2 may have a unit time. In this case, for example, the unit time may be illustrated as 1 second (1s). However, the present embodiment is not limited thereto. The second lighting control time series data Dn2 may include color data for each unit time.

The first future time T1 may be any one of the times corresponding to the unit time of the second lighting control time series data Dn2. The first future time T1 may be located in the future from the current playback time of the second video. The first future time T1 may be a unit time of the nearest future from the current playback time of the second video.

Again, referring to FIG. 14 , the second lighting control time series data for the buffer time of the first time from the first future time is stored in advance (S173).

Specifically, referring to FIG. 16 , the buffer time Tb may be set from the first future time T1 to the first time P1. The second lighting control time series data (Dn2) for the buffer time (Tb) may be stored in advance in the mobile terminal (200). At this time, “store” means to be stored in the memory for conversion of the second control data Dc2, and may have a different meaning from that received from the streaming server 100 to the mobile terminal 200.

The reason for storing the buffer time (Tb) in advance is that it is necessary to set a delay call in advance in order to accurately synchronize the video and the lighting control time series data. The buffer time Tb may be reduced as the current playback time is changed. Accordingly, when the buffer time Tb is reduced by the predetermined minimum buffer time, the buffer time Tb may be increased back to the first time P1.

In this case, the first time P1 may mean an initial time before the buffer time Tb decreases. As the first time P1 is set to be larger, the number of operations to increase the buffer time Tb may be reduced, and thus the amount of calculation may be reduced. Conversely, as the first time P1 is set smaller, the amount of calculation may increase. However, when the first time P1 is set too large, the probability of out of synchronization between the delayed call and the playback time of the second video, that is, the second streaming data Dv2 may increase.

Accordingly, the first time P1 should be set to an appropriate size that is neither too large nor too small. For example, the first time P1 may be 2 seconds to 3 seconds, but the present embodiment is not limited thereto.

Again, referring to FIG. 14, a delayed call is reserved for color data located within the buffer time (S174).

Specifically, referring to FIG. 16 , a first delay time TL1 with respect to a unit time in which color data is located is calculated based on the current playback time. A delayed call may be reserved using the calculated first delay time TL1. That is, color data between 3 seconds and 4 seconds after the first delay time TL1 based on the current playback time may be called with a delay. Here, “call” means that it is loaded to be converted into the second control data Dc2. Through this delayed call method, the second streaming data (Dv2) and the second lighting control time series data (Dn2) for the second video playback can be synchronized.

Again, referring to FIG. 14, it is determined whether the buffer time is greater than the minimum buffer time (S175).

If the buffer time is greater than or equal to the minimum buffer time, the delayed-called color data is converted into second control data (S177).

Specifically, referring to FIGS. 16 and 17 , the buffer time Tb may decrease from the first time P1 to the second time P2 as the current playback time progresses. However, the second time P2 may be greater than or equal to the preset minimum buffer time. Accordingly, the color data located therein may be continuously converted into the second control data Dc2 without changing the size of the buffer time Tb.

Again, referring to FIG. 14 , if the buffer time is less than the minimum buffer time, the buffer time of the delayed-called color data is extended to the first time ( S176 ). Next, a delayed call is reserved for the color data located within the buffer time again (S174).

Specifically, referring to FIGS. 18 and 19 , the third time P3 may be smaller than the preset minimum buffer time. Accordingly, the buffer time Tb may be extended to the size of the first time P1 again. As the current playback time progresses, the first delay time TL1 may also decrease. Also, as the buffer time Tb is extended, a second delay time TL2 for color data between 5 and 6 seconds may be calculated. A delayed call may be reserved using the calculated second delay time TL2. That is, after the second delay time TL2 based on the current playback time, color data between 5 seconds and 6 seconds may be called with a delay.

In this way, delayed calling of color data located at 3 seconds to 4 seconds, 5 seconds to 6 seconds, and 7 seconds to 8 seconds can be performed in synchronization with the reproduction of the second moving picture.

20 is a multi-subject flowchart for explaining a data transmission method for controlling a light stick according to some embodiments of the present invention.

Referring to FIG. 20 , the mobile terminal 200 requests the first lighting control time series data to the streaming server 100 ( S11 ). Subsequently, the mobile terminal 200 receives the first lighting control time series data from the streaming server 100 (S12).

Then, the light stick 300 requests the mobile terminal 200 to pair (S13). However, when the short-range wireless technology is Bluetooth, pairing may be requested, and in the case of another technology, a connection other than pairing may be requested. In addition, the direction of the request may be from the light rod 300 to the mobile terminal 200 side, and vice versa, from the mobile terminal 200 to the light rod 300 side. Subsequently, the mobile terminal 200 may be paired with the light stick 300 (S14).

Next, the mobile terminal 200 requests the first and second streaming data to the streaming server 100 (S15). Then, the mobile terminal 200 receives the first and second streaming data from the streaming server 100 (S16).

In the above description, steps S11 and S12, steps S13 and S14, and steps S15 and S16 have been described as being sequential, but the present embodiment is not limited thereto. Steps S11 and S12, steps S13 and S14, and steps S15 and S16 may be performed in parallel with each other. That is, any of the steps S11, S13, and S15 may be performed first, and any of the steps S12, S14, and S16 may be performed last.

Then, the mobile terminal 200 generates a second lighting control time series data (S17). Next, the mobile terminal 200 plays the second video (S18). Then, the mobile terminal 200 generates the second control data from the second lighting control time series data (S19). Next, the mobile terminal 200 transmits the second control data to the light stick 300 (S20). Subsequently, the color of the light rod 300 may be changed (S21).

When the user of the mobile terminal 200 receives streaming data online and plays a video, the lighting control time series data generating device according to this embodiment may experience a color change of the light stick synchronized with it.

Through this, you can get the same experience as attending an offline performance through the light stick 300, even if you are not in a concert hall. A differentiated user experience can be provided through patterns.

In addition, if there is streaming data for a similar video, it is possible to easily create lighting control time series data by automatically duplicating similar parts without manually producing new light control time series data.

Furthermore, since the production of such light control time series data is also possible in the mobile terminal 200 , the user of the mobile terminal 200 can also easily produce light control time series data.

The above description is merely illustrative of the technical idea of this embodiment, and various modifications and variations will be possible without departing from the essential characteristics of the present embodiment by those skilled in the art to which this embodiment belongs. Accordingly, the present embodiments are intended to explain rather than limit the technical spirit of the present embodiment, and the scope of the technical spirit of the present embodiment is not limited by these embodiments. The protection scope of this embodiment should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present embodiment.

Claims (11)

Receive the first lighting control time series data in which the color data of the light stick changing in synchronization with the first streaming data, the second streaming data and the first streaming data is recorded from the streaming server,
Extracting a similar portion of the first streaming data and the second streaming data,
A portion of the first lighting control time series data corresponding to the similar portion of the first streaming data is reproduced in an area corresponding to the similar portion of the second streaming data to generate pre-lighting control time-series data, the pre-lighting control time-series data includes an incomplete part and a completed part in which a part of the first lighting control time series data is duplicated,
Lighting control time-series data generating method comprising completing the pre-lighting control time-series data as second lighting control time-series data by filling the incomplete part.
According to claim 1,
Obtaining the playback time of the video while playing the video with the second streaming data,
Converting the color data of the second lighting control time series data corresponding to the reproduction time into control data,
Lighting control time series data generation method further comprising burning the control data to the light stick.
According to claim 1,
Extracting the similar part is
separating the first streaming data into first image data and first sound data;
separating the second streaming data into first image data and second sound data;
extracting first pitch data and first magnitude data from the first sound data;
extracting second pitch data and second magnitude data from the second sound data;
Lighting control time series data generating method comprising extracting a similar portion between the first pitch data and the second pitch data.
4. The method of claim 3,
Extracting a similar portion between the first pitch data and the second pitch data comprises:
determining a pitch similarity between the first and second pitch data;
determining a size similarity between the first and second size data;
Lighting control time series data generating method comprising extracting the similarity by determining the final similarity in consideration of the pitch similarity and the size similarity.
5. The method of claim 4,
To determine the final similarity,
determining the image similarity of the first and second image data;
Lighting control time series data generation method comprising determining the final similarity in consideration of the pitch similarity, the size similarity, and the image similarity.
4. The method of claim 3,
Extracting the similar part is a lighting control time series data generation method comprising extracting through artificial intelligence.
an image for receiving first and second streaming data, separating the first streaming data into first image data and first sound data, and separating the second streaming data into second image data and second sound data; and sound data separation unit;
Receive the first lighting control time-series data synchronized with the first streaming data, extract a similar part of the first and second sound data, and pre-light control based on the similar part and the first lighting control time-series data A similar feature extraction unit that generates time-series data, wherein the pre-lighting control time-series data includes a completed part and an incomplete part in which a part of the first lighting control time-series data is duplicated; and
Lighting control time-series data generating device including a second lighting control time-series data completion unit by filling the incomplete part of the pre-lighting control time-series data.
8. The method of claim 7,
The similar feature extraction unit,
a data preprocessing unit for extracting first pitch data and first size data from the first sound data and extracting second pitch data and second size data from the second sound data;
a similarity detection unit for detecting a similarity between the first and second pitch data;
Lighting control time-series data generating device comprising a lighting control time-series data forming unit for duplicating the complete part of the pre-lighting control time-series data through the first lighting control time-series data and the similar part.
9. The method of claim 8,
The similar part detection unit,
a pitch similarity evaluation unit for evaluating the pitch similarity of the first and second pitch data;
a size similarity evaluation unit for evaluating the size similarity of the first and second size data;
Lighting control time series data generating apparatus comprising a final similarity determining unit for extracting a similar portion by determining the final similarity in consideration of the pitch similarity and the size similarity.
10. The method of claim 9,
The similarity detection unit further comprises an image similarity evaluation unit for evaluating the image similarity of the first and second image data,
The final similarity determining unit determines the final similarity in consideration of the pitch similarity, the size similarity, and the image similarity, and extracts a similar part by determining the final similarity.
8. The method of claim 7,
Lighting control time series data generating device further comprising a control data conversion unit for converting the first and second light control time series data into first and second control data, respectively, and transmits to the light stick.

Images