KR20220018666A - Method for transmitting data for controlling cheer stick and Apparatus thereof - Google Patents

Abstract

The present invention discloses a data transmission method for controlling a light stick and a device thereof. The data transmission method for controlling the light stick comprises: receiving the streaming data from a streaming server in which the streaming data comprises the image data and the sound data and the sound data comprises the embedding data embedded therein; extracting the lighting control time series data through the embedding data in which the lighting control time series data is synchronized with each other with the streaming data and the color data of the light stick that changes with time is the recorded data; obtaining a playback time of the video while playbacking the video with the streaming data; converting the color data of the lighting control time series data corresponding to the playback time into the control data; and transmitting the control data to the light stick. Therefore, the present invention is capable of maximizing an efficiency of receiving data.

Description

Method for transmitting data for controlling cheer stick and Apparatus thereof

The present invention relates to a data transmission method and apparatus for controlling a light stick. Specifically, the present invention relates to a method and apparatus for controlling a light stick by inserting embedding data into streaming data.

It includes the light emitting part of the light stick, so it is a device that can emit light of various colors or display the light expression that changes with time by flashing the light. These light sticks were produced exclusively for specific singers and have been used as a way to express the color pattern of the audience harmonious to the singers' performances. As the color temperature and blinking pattern of the light stick change harmoniously in synchronization with the music of the performance, it was possible to bring out a common cultural experience of the singer and the audience.

The light stick used in the recent offline performances of singers is used through short-range wireless communication. Specifically, when the user of the light stick participates in the performance and inputs the seat number where he or she sits, the color change of the light stick is collectively controlled at one control desk according to the position of the seat, so that the light sticks of the attendees can be displayed in various ways in the performance audience. A color pattern can be formed. Through this, the participants of the performance were able to experience a variety of harmonious experiences in the audience.

However, the offline use of such a light stick can be made only in a limited situation attending a performance, so there have been attempts to increase the utility of the light stick. In particular, one of them is an attempt to expand the use of light sticks online as well as offline.

In this case, data for controlling the light stick needs to be transmitted to the user's mobile terminal separately from streaming data, and for this, separate time and network traffic allocation are required. Therefore, it is also necessary to develop a technology for increasing the efficiency of such data transmission.

An object of the present invention is to provide a data transmission method for controlling a light stick by embedding data for controlling the light stick in streaming data to increase transmission efficiency.

In addition, another object of the present invention is to provide a data transmission device for controlling the light rod to increase the transmission efficiency by embedding data for controlling the light rod in the streaming data.

In addition, another object of the present invention is to provide a computer program for executing a data transmission method for controlling a light rod to increase transmission efficiency by embedding data for control of a light rod in streaming data in combination with a computing device.

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention not mentioned may be understood by the following description, and will be more clearly understood by the examples of the present invention. It will also be readily apparent that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the appended claims.

A data transmission method for controlling a light stick according to some embodiments of the present invention for solving the above problems receives streaming data from a streaming server, wherein the streaming data includes image data and sound data, and the sound data is internal Including embedding data embedded in the, but extracting the lighting control time series data through the embedding data, the lighting control time series data is synchronized with the streaming data and each other (Synchronized), color data of the light stick that changes with time is recorded data, obtains the reproduction time of the video while playing the video with the streaming data, converts the color data of the lighting control time series data corresponding to the reproduction time into control data, and supports the control data Including transfer by rod.

In addition, extracting the lighting control time series data through the embedding data, separating the sound data from the streaming data, extracting the embedding data from the sound data, and the lighting control time series data using the extracted embedding data may include creating

Also, the embedding data may be embedded in an inaudible frequency region of the sound data.

In addition, the embedding data may include first to nth embedding data, and the lighting control time series data may be generated by merging the first to nth embedding data.

Also, the sound data may include first to nth sound data blocks, and the first to nth embedding data may be located in least significant bits (LSBs) of the first to nth sound data blocks.

In addition, converting the color data into the control data is to search for the lighting control time series data of a first future time corresponding to the playback time of the moving picture, and from the first future time to the buffer time of the first time. store lighting control time series data, reserve a delayed call for color data located within the buffer time, determine whether the buffer time is greater than a preset minimum buffer time, and if the buffer time is greater than a preset minimum buffer time, and converting the delayed-called color data into the control data.

The data transmission device for controlling the light stick according to some embodiments of the present invention for solving the other problem includes a memory device in which a program is stored and a controller for executing the program, the program receiving streaming data, The streaming data includes image data and sound data, and the sound data includes an operation including embedding data embedded therein, and extracting lighting control time series data through the embedding data, wherein the lighting control time series data is the streaming data An operation in which the color data of the light stick that is synchronized with each other and changes with time is recorded data, the operation of acquiring the playback time of the video while playing the video with the streaming data, the lighting control time series data corresponding to the playback time converting color data into control data and embedding the embedding data into the sound data.

In addition, extracting the lighting control time series data through the embedding data, separating the sound data from the streaming data, extracting the embedding data from the sound data, and the lighting control time series data using the extracted embedding data may include creating

In addition, the embedding data may include first to nth embedding data, and the lighting control time series data may be generated by merging the first to nth embedding data.

The computer program, stored in a computer-readable recording medium according to some embodiments of the present invention for solving the another problem, is combined with a computing device to receive streaming data from a streaming server, wherein the streaming data is image data and sound data, wherein the sound data includes embedding data embedded therein, extracting lighting control time series data through the embedding data, wherein the lighting control time series data is synchronized with the streaming data and time Step in which the color data of the light stick that changes according to is recorded data, acquiring the playback time of the video while playing the video with the streaming data, color data of the lighting control time series data corresponding to the playback time as control data converting and transmitting the control data to the light stick.

The data transmission method and the device for controlling a light stick of the present invention can maximize data reception efficiency by embedding data for lighting control in streaming data.

In addition, through this, network traffic is alleviated so that users can use streaming services and light stick control services at high speed.

The specific effects of the present invention in addition to the above will be described together while explaining the specific details for carrying out the invention below.

1 is a conceptual diagram illustrating a lightstick color control system in which a data transmission method for controlling a lightstick according to some embodiments of the present invention is implemented.
FIG. 2 is a block diagram illustrating a detailed structure of streaming data of FIG. 1 .
FIG. 3 is a block diagram for explaining in detail the structure of the mobile terminal of FIG. 1 .
4 is a block diagram for explaining in detail a process of deriving control data from streaming data using the structure of the mobile terminal of FIG. 1 .
5 is a diagram for describing in detail sound data combined with embedding data.
6 is a view for explaining in detail a process of generating lighting control time series data.
7 is a block diagram for explaining in detail the structure of the light bar of FIG. 1 .
8 is a flowchart illustrating a data transmission method for controlling a light stick according to some embodiments of the present invention.
9 is a flowchart for explaining in detail the extraction step of the lighting control time series data from the streaming data of FIG.
FIG. 10 is a flowchart for explaining the control data generation step of FIG. 8 in detail.
11 to 15 are intermediate step diagrams for explaining the control data generation step of FIG. 8 in detail.
16 is a multi-subject flowchart for explaining a data transmission method for controlling a light stick according to some embodiments of the present invention.

Terms or words used in this specification and claims should not be construed as being limited to a general or dictionary meaning. In accordance with the principle that the inventor can define a term or concept of a word in order to best describe his/her invention, it should be interpreted as meaning and concept consistent with the technical idea of the present invention. In addition, since the embodiments described in this specification and the configurations shown in the drawings are only one embodiment in which the present invention is realized, and do not represent all the technical spirit of the present invention, they can be substituted at the time of the present application. It should be understood that there may be various equivalents and modifications and applicable examples.

Terms such as first, second, A, B, etc. used in this specification and claims may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. The term 'and/or' includes a combination of a plurality of related listed items or any of a plurality of related listed items.

Terms used in this specification and claims are used only to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. It should be understood that terms such as “comprise” or “have” in the present application do not preclude the possibility of addition or existence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification in advance. .

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

In addition, each configuration, process, process or method included in each embodiment of the present invention may be shared within a range that does not technically contradict each other.

Hereinafter, a data transmission method for controlling a light stick according to some embodiments of the present invention will be described with reference to FIGS. 1 to 15 .

1 is a conceptual diagram for explaining a light stick color control system in which a data transmission method for controlling a light stick according to some embodiments of the present invention is implemented, and FIG. 2 is a detailed structure of the streaming data of FIG. This is a block diagram for

1 and 2, the lightstick color control system in which the data transmission method for controlling the lightstick according to some embodiments of the present invention is implemented is a streaming server 100, a mobile terminal 200, and a lightstick ( 300) is included.

Streaming server 100 may provide streaming data (Dv) and lighting control time series data (Dn) to the mobile terminal (200). The streaming server 100 includes a workstation, a data center, an internet data center (IDC), a direct attached storage (DAS) system, a storage area network (SAN) system, and a network attached storage (NAS) system. and RAID (redundant array of inexpensive disks, or redundant array of independent disks) systems, but the present embodiment is not limited thereto.

The streaming server 100 may transmit data to the mobile terminal 200 through a network. The network may include a network based on a wired Internet technology, a wireless Internet technology, and a short-range communication technology. Wired Internet technology may include, for example, at least one of a local area network (LAN) and a wide area network (WAN).

Wireless Internet technologies are, for example, wireless LAN (WLAN), DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband: Wibro), Wimax (World Interoperability for Microwave Access: Wimax), HSDPA (High Speed Downlink Packet) Access), High Speed Uplink Packet Access (HSUPA), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS) and 5G New Radio (NR) technology. However, the present embodiment is not limited thereto.

Short-range communication technologies include, for example, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra-Wideband (UWB), ZigBee, and Near Field Communication: At least one of NFC), Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, Wi-Fi Direct, and 5G NR (New Radio) may include However, the present embodiment is not limited thereto.

The streaming server 100 and the mobile terminal 200 communicating through the network may comply with technical standards and standard communication methods for mobile communication. For example, standard communication methods include Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), and Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (EV-DO). , at least one of Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTEA), and 5G New Radio (NR) may include However, the present embodiment is not limited thereto.

The streaming server 100 may transmit streaming data Dv to the mobile terminal 200 . The streaming data Dv may be data implemented to play a video in the mobile terminal 200 . Specifically, the streaming data Dv may be data implemented so that the mobile terminal 200 can reproduce a video through streaming.

In this case, the streaming data Dv may include the embedding data De therein. Specifically, the streaming data Dv may include image data Di and sound data Ds. The image data Di may be a part corresponding to an image in a moving picture, and the sound data Ds may be a part corresponding to a sound in the moving picture. In this case, the image data Di and the sound data Ds may be data that change in time series.

The image data Di and the sound data Ds may be synchronized with each other and reproduced together when a moving picture is reproduced. That is, the image data Di may be output as an image through a display or the like, and the sound data Ds may be output as sound through a speaker or the like. While the image data Di and the sound data Ds are synchronized and output in time series, a moving picture may be reproduced.

The sound data Ds may include embedding data De. That is, the embedding data De may be embedded in the sound data Ds. The embedding data De may be later extracted as lighting control time series data Dn. As the embedding data De is inserted into the streaming data Dv, the mobile terminal 200 receives only the streaming data Dv without the need to separately receive the lighting control time series data Dn from the streaming server 100. have.

The lighting control time series data Dn may be data corresponding to the streaming data Dv. The lighting control time series data Dn may be data synchronized with the streaming data Dv. The lighting control time series data Dn may include color data of the light stick 300 that changes according to the reproduction time of a moving picture reproduced by the streaming data Dv. Through this, while the mobile terminal 200 plays a video according to the streaming data Dv, the color emitted by the light stick 300 may change in response to the lighting control time series data Dn.

In this case, the above-described “color data” may be a concept that includes data about the blinking of light in addition to the simple color of light.

The mobile terminal 200 may play a video in the mobile terminal 200 using the received streaming data Dv. In addition, the mobile terminal 200 may extract the lighting control time series data (Dn) from the received streaming data (Dv). The mobile terminal 200 may generate the control data Dc using the extracted lighting control time series data Dn.

The control data Dc may be data corresponding to the color data of the lighting control time series data Dn. The control data Dc may be data directly used to change the color of the light stick 300 . The mobile terminal 200 may transmit the control data Dc to the light stick 300 to change the color emitted by the light stick 300 . At this time, the mobile terminal 200 may transmit the control data Dc in real time by converting the color data of the lighting control time series data Dn corresponding to the reproduction time of the moving picture. Accordingly, the control data Dc may also be synchronized with the streaming data Dv.

The mobile terminal 200 may be driven by a program or application installed therein. The mobile terminal 200 may convert the color data located in the lighting control time series data Dn into control data Dc composed of a byte array through a library stored in advance. However, the present embodiment is not limited thereto.

Alternatively, the mobile terminal 200 may directly convert the embedding data De into the control data Dc. That is, the embedding data De may be directly converted into the control data Dc without a process of being extracted as the lighting control time series data Dn. However, the present embodiment is not limited thereto.

The light stick 300 may be connected to the mobile terminal 200 through short-range communication technology. Short-range communication technologies include, for example, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra-Wideband (UWB), ZigBee, and Near Field Communication: At least one of NFC), Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, Wi-Fi Direct, and 5G NR (New Radio) may include However, the present embodiment is not limited thereto. Hereinafter, for convenience, the light stick 300 will be described as being paired with the mobile terminal 200 through Bluetooth.

The light stick 300 may emit light of various colors. The light stick 300 may also display a flashing signal of light. The light stick 300 may receive the control data Dc from the mobile terminal 200 in real time. The light stick 300 may control the color and blinking of the emitted light through the control data Dc.

FIG. 3 is a block diagram for explaining in detail the structure of the mobile terminal of FIG. 1 .

Referring to FIG. 3 , the mobile terminal 200 according to an embodiment of the present invention includes a controller 210 , an input/output device 220 , I/O, a memory device 230 , a memory device, an interface 240 , and a bus ( 250, bus). The controller 210 , the input/output device 220 , the memory device 230 , and/or the interface 240 may be coupled to each other through the bus 250 . The bus 250 corresponds to a path through which data is moved.

The controller 210 includes a central processing unit (CPU), a micro processor unit (MPU), a micro controller unit (MCU), a graphic processing unit (GPU), a microprocessor, a digital signal processor, a microcontroller, an application processor (AP). ) and logic elements capable of performing a function similar thereto.

The input/output device 220 may include at least one of a keypad, a keyboard, a touch screen, and a display device. The memory device 230 may store data and/or a program.

The interface 240 may perform a function of transmitting data to or receiving data from a communication network. The interface 240 may be in a wired or wireless form. For example, the interface 240 may include an antenna or a wired/wireless transceiver. Although not shown, the memory device 230 is a working memory for improving the operation of the controller 210 , and may further include a high-speed DRAM and/or SRAM. The memory device 230 may store a program or an application therein. The mobile terminal 200 may implement a data transmission method for controlling the light stick according to some embodiments of the present invention to be described later through a program or an application.

The mobile terminal 200 includes a personal digital assistant (PDA), a portable computer, a web tablet, a wireless phone, a mobile phone, and a digital music player (digital). music player), a memory card, or any electronic product capable of transmitting and/or receiving information in a wireless environment.

Alternatively, the mobile terminal 200 in which the light stick color change method according to the embodiments of the present invention is implemented may be a system in which a plurality of mobile terminals 200 are connected to each other through a network. In this case, each module or combinations of modules may be implemented as the mobile terminal 200 . However, the present embodiment is not limited thereto.

4 is a block diagram for explaining in detail a process of deriving control data from streaming data using the structure of the mobile terminal of FIG. 1 .

Referring to FIG. 4 , the mobile terminal 200 may include a sound data separation unit 260 , an embedding data extraction unit 270 , and a control data conversion unit 280 .

Specifically, when the mobile terminal 200 receives the streaming data Dv from the streaming server 100 , the mobile terminal 200 may preferentially transmit the streaming data Dv to the sound data separation unit 260 . .

The sound data separator 260 may separate the sound data Ds from the streaming data Dv. Since the streaming data Dv includes the sound data Ds and the image data Di, the sound data separator 260 may separate and extract only the sound data Ds excluding the image data Di.

Subsequently, the sound data separation unit 260 may transmit the separated sound data Ds to the embedding data extraction unit 270 .

The embedding data extractor 270 may extract the embedding data De included in the received sound data Ds. In this case, the embedding data De may be separately included in the sound data Ds. However, the present invention is not limited thereto. The embedding data extraction unit 270 may generate the lighting control time series data Dn by merging, arranging, and transforming the extracted embedding data De.

Subsequently, the embedding data extraction unit 270 may transmit the generated lighting control time series data Dn to the control data conversion unit 280 .

The control data conversion unit 280 may transmit the lighting control time series data (Dn) to the control data (Dc) after conversion to the light stick (300). The conversion of the control data Dc will be described in more detail later.

5 is a diagram for describing in detail sound data combined with embedding data. Referring to FIG. 5 , the original sound data Ds ₀ may be pure sound data without noise. When the embedding data De is combined with the original sound data Ds ₀ , the sound data Ds may be generated. In this case, the embedding data De may be formed of digital data. However, the present embodiment is not limited thereto.

The embedding data De may be embedded in a manner that minimizes the change of the original sound data Ds ₀ . For example, when the embedding data De is combined with the original sound data Ds ₀ , the embedding data De may be divided into a plurality of embedding data (first to nth embedding data) having a small size. . Subsequently, the separated n embedding data De may be uniformly combined with the entire portion of the original sound data Ds ₀ . Through this, the sound data Ds to which the embedding data De is added is not significantly changed from the original sound data Ds ₀ , and the user may not feel a sound difference when playing a video later. However, the present invention is not limited thereto, and the embedding data De may be combined with the original sound data Ds ₀ without being separated.

Alternatively, the embedding data De may be embedded in the frequency domain domain of the original sound data Ds ₀ . When the original sound data Ds ₀ is expressed in the frequency domain, a human audible frequency region and an inaudible frequency region may exist. For example, the embedding data De may be embedded in an inaudible frequency domain rather than a human audible frequency domain so that a user who listens to the actual sound data Ds does not feel whether it is embedded. However, the present embodiment is not limited thereto.

6 is a view for explaining in detail a process of generating lighting control time series data.

Referring to FIG. 6 , the sound data Ds may include first to eighth sound data blocks Ds ₁ to Ds ₈ . Although 8 sound data blocks are shown in FIG. 6, the present embodiment is not limited thereto. That is, the number of sound data blocks may be 7 or less, or 9 or more.

Similarly, 8 separated embedding data De ₁ to De ₈ are illustrated in FIG. 6 , but the present embodiment is not limited thereto. That is, the number of the separated embedding data De ₁ to De ₈ may be 7 or less, or 9 or more.

Each of the first sound data to the eighth sound data blocks Ds ₁ to Ds ₈ constituting the sound data Ds may consist of 1 byte, that is, 8 bits. However, the present embodiment is not limited thereto. That is, the size of the sound data block may be larger or smaller than 1 byte, and each sound data block may have a different size.

In this case, the first to nth embedding data De ₁ to De _n may be located in least significant bits (LSBs) of the first to eighth sound data blocks Ds ₁ to Ds ₈ , respectively. Through this, the change of the content of the sound data Ds can be minimized.

4 and 6 , the embedding data extractor 270 may extract first to eighth embedding data De ₁ to De ₈ from the sound data block of the sound data Ds. The embedding data extractor 270 may generate the lighting control time series data Dn by merging the extracted first to eighth embedding data De ₁ to De ₈ .

In this case, the embedding data extraction unit 270 may organize the arrangement of the first to eighth embedding data De ₁ to De ₈ , and perform data conversion to generate the lighting control time series data Dn. However, the present invention is not limited thereto.

7 is a block diagram for explaining in detail the structure of the light bar of FIG. 1 .

Referring to FIG. 7 , the light stick 300 may include a communication unit 310 , a light emitting unit 320 , a control unit 330 , a power supply unit 340 , and a button unit 350 .

The communication unit 310 may communicate with the mobile terminal 200 . The communication unit 310 may establish communication with the mobile terminal 200 using short-range communication technology. The communication unit 310 may receive the control data Dc from the mobile terminal 200 . The communication unit 310 may transmit the control data Dc to the control unit 330 .

The controller 330 includes a central processing unit (CPU), a micro processor unit (MPU), a micro controller unit (MCU), a graphic processing unit (GPU), a microprocessor, a digital signal processor, a microcontroller, an application processor (AP). ) and logic elements capable of performing a function similar thereto. However, the present embodiment is not limited thereto.

The controller 330 may control the color and blinking of the light of the light emitting unit 320 . The controller 330 may operate in at least two modes, a first mode and a second mode. The first mode may be a mode in which the light emitting unit 320 is controlled through the control data Dc, and the second mode may be a mode in which the light emitting unit 320 is controlled by the control button 352 .

In the first mode, the control unit 330 may receive the control data Dc from the communication unit 310 . The controller 330 may control the color and blinking of the light of the light emitting unit 320 by using the control data Dc.

In the second mode, the control unit 330 may control the light emitting unit 320 according to the color change and blinking pattern of the light preset by the control button 352 of the button unit 350 .

The light emitting unit 320 may emit light of various colors. The light emitting unit 320 may express the flickering of light. The light emitting unit 320 may include a transparent case and a light source expressing various colors. However, the present embodiment is not limited thereto.

The power supply unit 340 may supply power to the communication unit 310 , the light emitting unit 320 , and the control unit 330 . The power supply unit 340 may include a space in which the battery is accommodated. However, the present embodiment is not limited thereto.

The button unit 350 may include a mode change button 351 and a control button 352 . The mode change button 351 may be operated in any one of an off state, a first mode state, and a second mode state. When the mode change button 351 is in an off state, power supply from the power supply unit 340 may be cut off. Accordingly, the power of the light rod 300 may be turned off.

When the mode change button 351 is in the first mode state, the communication unit 310 may attempt to connect to the mobile terminal 200 using a short-range wireless technology. For example, the communication unit 310 may attempt Bluetooth pairing with the mobile terminal. When the communication unit 310 is connected to the mobile terminal 200 to receive the control data Dc, the control unit 330 may receive the control data Dc to control the light emitting unit 320 .

When the mode change button 351 is in the second mode state, the light emitting unit 320 may be controlled by the control button 352 . Specifically, according to the number of times the control button 352 is pushed, the color and blinking pattern of the light emitting unit 320 designated in advance may be changed. The control unit 330 may receive the number of times the control button 352 is pushed, so that the color and blinking pattern of the light emitting unit 320 may be changed. However, the present embodiment is not limited thereto.

Although only two buttons of the mode change button 351 and the control button 352 are included in the button unit 350 in FIG. 7 , the present embodiment is not limited thereto. That is, in the light rod 300 of the data transmission method for controlling the light rod according to the present embodiment, three or more buttons may exist in the button unit 350 .

8 is a flowchart illustrating a data transmission method for controlling a light stick according to some embodiments of the present invention.

Referring to FIG. 8 , the video content is accessed ( S110 ).

Specifically, referring to FIG. 1 , video content may be provided to the mobile terminal 200 by the streaming server 100 . The mobile terminal 200 may access the video content provided by the streaming server 100 through an application or program.

Again, referring to FIG. 8 , it is determined whether it is connected to the light stick ( S120 ).

Specifically, referring to FIG. 1 , when the light stick 300 and the mobile terminal 200 are not connected to each other, they may wait until they are connected. When the light stick 300 and the mobile terminal 200 are connected to each other, the following procedure may be performed.

Again, referring to FIG. 8, streaming data reception is started (S130).

Specifically, referring to FIG. 1 , the mobile terminal 200 may receive streaming data Dv from the streaming server 100 to play a video, ie, stream it. In the video streaming, the reception of the streaming data Dv and the reproduction of the video are performed in parallel, and the streaming data Dv corresponding to the reproduced video part must be received by the mobile terminal 200 in advance before the video is played. In this case, the video may not be played after the streaming data Dv has been completely received, but the video may be played for the previously received portion while the streaming data Dv is being received.

Again, referring to FIG. 8, the extraction of the lighting control time series data from the streaming data starts (S140).

Specifically, referring to FIGS. 1 and 2 , the mobile terminal 200 may extract the lighting control time series data Dn from the received streaming data Dv. Even if the streaming data (Dv) is not all received, the lighting control time series data (Dn) may be sequentially extracted from the received part. That is, the embedding data (De) of the streaming data (Dv) may be extracted while being sequentially converted into the lighting control time series data (Dn). The extraction of the lighting control time series data Dn is performed in parallel with video playback, but may be performed prior to playback. Only then, by converting the lighting control time series data (Dn) to the control data (Dc), the color control of the light stick 300 can be performed in synchronization with the video playback.

Again, referring to FIG. 8 , the playback of the video is started ( S150 ).

Specifically, referring to FIG. 2 , the image data Di and the sound data Ds may be synchronized with each other and reproduced together when a moving picture is reproduced in the mobile terminal 200 . That is, the image data Di may be output as an image through a display or the like, and the sound data Ds may be output as sound through a speaker or the like. While the image data Di and the sound data Ds are synchronized and output in time series, a moving picture may be reproduced.

Again, referring to FIG. 8 , control data according to the video playback time is generated ( S160 ).

Specifically, referring to FIGS. 1 and 2 , the mobile terminal 200 may check the playback time of a video currently being played in the mobile terminal 200 and generate control data Dc according thereto. The lighting control time series data Dn is data synchronized with the streaming data Dv, and color data according to a video playback time may be arranged. Accordingly, the mobile terminal 200 may convert the color data corresponding to the video playback time into the control data Dc.

In this case, the mobile terminal 200 may convert the color data of the lighting control time series data Dn into the control data Dc in real time at the video playback time. In this case, since the conversion itself is performed immediately, an additional operation is not required, and thus the speed of the entire operation may be increased.

Alternatively, the mobile terminal 200 may convert the color data of the lighting control time series data (Dn) into the control data (Dc) by using a delay call by securing the buffer time from the video playback time. In this case, since the synchronization between the reproduction of the moving picture and the conversion of the control data Dc is calculated in advance, the possibility of synchronization failure can be minimized. How to use the buffer time will be described in more detail later.

Again, referring to FIG. 8, control data is transmitted to the light stick (S170).

Specifically, referring to FIG. 1 , the mobile terminal 200 may transmit the control data Dc to the light stick 300 through short-range communication technology.

9 is a flowchart for explaining in detail the extraction step of the lighting control time series data from the streaming data of FIG. FIG. 9 shows detailed steps of step S140 of FIG. 8 .

Referring to FIG. 9 , following step S130 of FIG. 8 , the sound data separation unit separates sound data from streaming data ( S141 ).

Specifically, referring to FIG. 4 , the sound data separation unit 260 may separate the sound data Ds included in the streaming data Dv up to the received portion even if all of the streaming data Dv has not been received. have.

Again, referring to FIG. 9 , the embedding data De is extracted from the sound data Ds (S145).

Specifically, referring to FIG. 4 , the embedding data extraction unit 270 may extract the embedding data De located in the received sound data Ds. In this case, the embedding data De may be divided into a plurality of pieces to be embedded, or may exist as one single piece of data.

Again, referring to FIG. 9 , the lighting control time series data Dn is generated using the embedding data De (S149).

Specifically, referring to FIG. 4 , the embedding data extraction unit 270 may extract the embedding data De and then generate the lighting control time series data Dn using the extracted data.

If, as in FIG. 6 , when the embedding data De is divided into a plurality and embedded, a plurality of divided data may be merged to generate the lighting control time series data Dn. Alternatively, when the format of the embedding data De is different from the format of the lighting control time series data Dn, the format may be converted to generate the lighting control time series data Dn. However, these are merely examples, and the present embodiment is not limited thereto.

Hereinafter, a data transmission method for controlling the light stick using the buffer time will be described with reference to FIGS. 10 to 15 .

10 is a flowchart for explaining in detail the control data generating step of FIG. 8 , and FIGS. 11 to 15 are intermediate steps for explaining in detail the control data generating step of FIG. 8 . Hereinafter, step S160 of FIG. 8 will be described in detail with reference to FIGS. 10 to 15 .

Referring to FIG. 10 , a video playback time is received ( S161 ).

Specifically, referring to FIG. 11 , the current playback time may be checked. The current playback time can be continued as time passes.

Again, referring to FIG. 10, the lighting control time series data of the first future time closest to the video playback time is searched (S162).

Specifically, referring to FIG. 11 , the lighting control time series data Dn may have a unit time. In this case, for example, the unit time may be illustrated as 1 second (1s). However, the present embodiment is not limited thereto. The lighting control time series data Dn may include color data for each unit time.

The first future time T1 may be any one of the times corresponding to the unit time of the lighting control time series data Dn. The first future time T1 may be located in the future from the current playback time of the video. The first future time T1 may be a unit time of the nearest future from the current playback time of the moving picture.

Again, referring to FIG. 10, the lighting control time series data for the buffer time of the first time from the first future time is stored in advance (S163).

Specifically, referring to FIG. 12 , the buffer time Tb may be set from the first future time T1 to the first time P1 . Lighting control time series data (Dn) for the buffer time (Tb) may be stored in advance in the mobile terminal (200). At this time, “store” means to be stored in the memory for conversion of the control data Dc, and may have a different meaning from that received from the streaming server 100 to the mobile terminal 200 .

The reason for storing the buffer time (Tb) in advance is that it is necessary to set a delay call in advance in order to accurately synchronize the video and the lighting control time series data. The buffer time Tb may be reduced as the current playback time is changed. Accordingly, when the buffer time Tb is reduced by the predetermined minimum buffer time, the buffer time Tb may be increased back to the first time P1.

In this case, the first time P1 may mean an initial time before the buffer time Tb decreases. As the first time P1 is set to be larger, the number of operations to increase the buffer time Tb may be reduced, and thus the amount of calculation may be reduced. Conversely, as the first time P1 is set smaller, the amount of calculation may increase. However, when the first time P1 is set too large, the probability of out of synchronization between the delayed call and the playback time of the video, that is, the streaming data Dv, may increase.

Accordingly, the first time P1 should be set to an appropriate size that is neither too large nor too small. For example, the first time P1 may be 2 seconds to 3 seconds, but the present embodiment is not limited thereto.

Again, referring to FIG. 10, a delayed call is reserved for color data located within the buffer time (S164).

Specifically, referring to FIG. 12 , the first delay time TL1 with respect to the unit time in which the color data is located is calculated based on the current reproduction time. A delayed call may be reserved using the calculated first delay time TL1. That is, color data between 3 seconds and 4 seconds after the first delay time TL1 based on the current playback time may be called with a delay. Here, “call” means that it is loaded to be converted into control data Dc. Through this delayed call method, streaming data (Dv) for video playback and lighting control time series data (Dn) can be synchronized.

Again, referring to FIG. 10, it is determined whether the buffer time is greater than the minimum buffer time (S165).

If the buffer time is greater than or equal to the minimum buffer time, the delayed-called color data is converted into control data (S167).

Specifically, referring to FIGS. 12 and 13 , as the current playback time progresses, the buffer time Tb may decrease in size, and thus may decrease from the first time P1 to the second time P2 . However, the second time P2 may be greater than or equal to the preset minimum buffer time. Accordingly, the color data located therein may be continuously converted into the control data Dc without changing the size of the buffer time Tb.

Again, referring to FIG. 10, if the buffer time is less than the minimum buffer time, the buffer time of the delayed-called color data is extended to the first time (S166). Next, a delayed call is reserved for the color data located within the buffer time again (S164).

Specifically, referring to FIGS. 14 and 15 , the third time P3 may be smaller than a preset minimum buffer time. Accordingly, the buffer time Tb may be extended to the size of the first time P1 again. As the current playback time progresses, the first delay time TL1 may also decrease. Also, as the buffer time Tb is extended, a second delay time TL2 for color data between 5 and 6 seconds may be calculated. A delayed call may be reserved using the calculated second delay time TL2. That is, after the second delay time TL2 based on the current playback time, color data between 5 seconds and 6 seconds may be called with a delay.

In this way, delayed calling of color data located at 3 seconds to 4 seconds, 5 seconds to 6 seconds, and 7 seconds to 8 seconds can be performed in synchronization with video playback.

16 is a multi-subject flowchart for explaining a data transmission method for controlling a light stick according to some embodiments of the present invention.

Referring to FIG. 16 , the light stick 300 requests pairing from the mobile terminal 200 ( S11 ). However, when the short-range wireless technology is Bluetooth, pairing may be requested, and in the case of another technology, a connection other than pairing may be requested. In addition, the direction of the request may be from the light rod 300 to the mobile terminal 200 side, and vice versa, from the mobile terminal 200 to the light rod 300 side. Subsequently, the mobile terminal 200 may be paired with the light stick 300 (S12).

Then, the mobile terminal 200 requests streaming data to the streaming server 100 (S13). Next, the mobile terminal 200 receives streaming data from the streaming server 100 (S14).

In the above description, steps S11 and S12 and steps S13 and S14 have been described as being sequential, but the present embodiment is not limited thereto. Steps S11 and S12 and steps S13 and S14 may be performed in parallel with each other. That is, any of steps S11 and S13 may be performed first, and any of steps S12 and S14 may be performed last.

Then, the mobile terminal 200 extracts the lighting control time series data (Dn) from the streaming data (Dv) (S15). Next, the mobile terminal 200 plays the video (S16). Then, the mobile terminal 200 generates control data from the lighting control time series data (S17). Then, the mobile terminal 200 transmits the control data to the light stick 300 (S18). Subsequently, the color of the light stick 300 may be changed (S19).

In the data transmission method for controlling the light stick according to the present embodiment, when the user of the mobile terminal 200 receives streaming data online and plays a video, the color change of the light stick synchronized thereto can be experienced.

Through this, you can get the same experience as attending an offline performance through the light stick 300, even if you are not in a concert hall. A differentiated user experience can be provided through patterns.

In addition, the mobile terminal 200 can be extracted from the streaming data (Dv) without separately receiving the lighting control time series data (Dn) from the streaming server 100, it is possible to increase the data reception efficiency, networking of the overall system You can keep your speed running smoothly.

The above description is merely illustrative of the technical idea of this embodiment, and various modifications and variations will be possible without departing from the essential characteristics of the present embodiment by those skilled in the art to which this embodiment belongs. Accordingly, the present embodiments are intended to explain rather than limit the technical spirit of the present embodiment, and the scope of the technical spirit of the present embodiment is not limited by these embodiments. The protection scope of this embodiment should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present embodiment.

Claims (10)

Receive streaming data from a streaming server, wherein the streaming data includes image data and sound data, and the sound data includes embedded data embedded therein,
The lighting control time series data is extracted through the embedding data, but the lighting control time series data is synchronized with the streaming data and the color data of the light stick that changes with time is recorded data,
Acquire the playback time of the video while playing the video with the streaming data,
Converting the color data of the lighting control time series data corresponding to the reproduction time into control data,
A data transmission method for controlling a light stick comprising transmitting the control data to the light stick.
According to claim 1,
Extracting the lighting control time series data through the embedding data,
separating the sound data from the streaming data;
extracting the embedding data from the sound data;
Data transmission method for controlling a light stick comprising generating the lighting control time series data using the extracted embedding data.
According to claim 1,
The embedding data is a data transmission method for controlling a light stick embedded in an inaudible frequency region of the sound data.
According to claim 1,
The embedding data includes first to n-th embedding data,
The lighting control time-series data is a data transmission method for controlling a light bar that is generated by merging the first to n-th embedding data.
5. The method of claim 4,
The sound data includes first to nth sound data blocks,
The first to n-th embedding data are located in LSB (Least Significant Bit) of the first to n-th sound data block.
According to claim 1,
Converting the color data to the control data comprises:
Searching for the lighting control time series data of the first future time corresponding to the playback time of the video,
Storing the lighting control time series data for the buffer time of the first time from the first future time,
Reserve a delayed call for color data located within the buffer time;
It is determined whether the buffer time is greater than a preset minimum buffer time,
and converting the delayed-called color data into the control data when the buffer time is greater than a preset minimum buffer time.
a memory device in which the program is stored; and
a controller for executing the program;
The program is
receiving streaming data, wherein the streaming data includes image data and sound data, and the sound data includes embedding data embedded therein;
Extracting the lighting control time-series data through the embedding data, wherein the lighting control time-series data is synchronized with the streaming data, and color data of the light stick that changes with time is recorded data;
acquiring a playback time of the video while playing the video using the streaming data;
converting color data of the lighting control time series data corresponding to the reproduction time into control data; and
The embedding data is a data transmission device for controlling a light stick comprising an operation of being embedded in the sound data.
8. The method of claim 7,
Extracting the lighting control time series data through the embedding data,
separating the sound data from the streaming data;
extracting the embedding data from the sound data;
Data transmission device for controlling a light stick comprising generating the lighting control time series data by using the extracted embedding data.
8. The method of claim 7,
The embedding data includes first to n-th embedding data,
The lighting control time-series data is a data transmission device for controlling a light bar that is generated by merging the first to n-th embedding data.
In combination with a computing device,
receiving streaming data from a streaming server, wherein the streaming data includes image data and sound data, wherein the sound data includes embedding data embedded therein;
extracting the lighting control time-series data through the embedding data, wherein the lighting control time-series data is synchronized with the streaming data, and the color data of the light stick that changes with time is recorded data;
acquiring a playback time of the video while playing the video with the streaming data;
converting color data of the lighting control time series data corresponding to the reproduction time into control data; and
A computer program stored in a computer-readable recording medium that executes the step of transmitting the control data to the light stick.

Images