KR102602698B1 - Method and device for synchronizing video and a light stick - Google Patents

Abstract

A lightstick control signal interlocking method and device are provided. A method of linking a light stick control signal according to an embodiment of the present invention includes receiving a target video including a plurality of frames, an identification value of the target video, and a video transmission reference time, and using the identification value of the target video. It includes obtaining a light stick control signal for the target video and transmitting the light stick control signal according to the video transmission reference time to the target light stick.

Description

Method and device for linking video and light stick control signals {METHOD AND DEVICE FOR SYNCHRONIZING VIDEO AND A LIGHT STICK}

The present invention relates to a method and device for linking a light stick control signal to an image. More specifically, it relates to a method and device for generating a control signal for a physical cheering stick in conjunction with an externally transmitted broadcast video.

With the development of fan culture, light sticks controlled by user terminals through Bluetooth communication have become common. In particular, physical cheering sticks using LED lights were mainly used for offline fan activities such as concerts and various performances.

Meanwhile, with the recent spread of untact culture and the development of video platforms, online performances are becoming more active, and accordingly, technology development for cheering methods suitable for the online environment is underway. For example, a method was recently developed to display a virtual cheering stick on the display of a user terminal to indicate liking for a star's performance video.

The above-mentioned background technology is technical information that the inventor possessed for deriving the present invention or acquired in the process of deriving the present invention, and cannot necessarily be said to be known art disclosed to the general public before filing the application for the present invention.

Embodiments of the present invention provide a method and device for linking a cheering stick control signal that can cheer for a video transmitted in real time using a physical cheering stick.

A method of linking a light stick control signal according to an embodiment of the present invention includes transmitting a target video and a video transmission reference time from a video transmission server to a first user terminal and a second user terminal, and the first user terminal transmits the video. A step of transmitting a light stick control signal corresponding to the target video to a target light stick based on a reference time, and a second user terminal cheering the target video by sending a light stick control signal corresponding to the target video based on the video transmission reference time. It may include the step of transmitting to a rod.

A method of linking a light stick control signal according to another embodiment of the present invention includes receiving a target video including a plurality of frames, an identification value of the target video, and a video transmission reference time, and using the identification value of the target video. It may include obtaining a light stick control signal for the target video and transmitting the light stick control signal according to the video transmission reference time to the target light stick.

A light stick control signal interlocking device according to another embodiment of the present invention receives a target video including a plurality of frames, an identification value of the target video, and a video transmission reference time for each frame, and uses the identification value of the target video. Obtain light stick control scenario information for the target video, obtain target light stick information included in the light stick control scenario information and a light stick control signal in the form of time series data, and transmit the video to the target light stick. The light stick control signal can be transmitted according to time.

Other aspects, features and advantages in addition to those described above will become apparent from the following drawings, claims and detailed description of the invention.

Figure 1 is a diagram illustrating an example of a light stick control signal interlocking system according to an embodiment of the present invention.
Figure 2 is a block diagram for explaining the internal configuration of a user terminal and a server that performs a method of linking a light stick control signal according to an embodiment of the present invention.
Figure 3 is a flowchart of a method of linking a light stick control signal according to an embodiment of the present invention.
Figure 4 is a flowchart for explaining each operation subject of the light stick control signal according to an embodiment of the present invention.
Figure 5 is a diagram for explaining a method of linking a light stick control signal to a video transmitted in real time according to an embodiment of the present invention.
Figure 6 is a diagram for explaining video transmission reference time information according to an embodiment of the present invention.
Figure 7 is a diagram for explaining the database structure of a light stick control signal interlocking device according to an embodiment of the present invention.
8 and 9 are examples of an application GUI installed on a user terminal connected to a light stick according to an embodiment of the present invention.

The detailed description of the present invention described below refers to the accompanying drawings, which show by way of example specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different from one another but are not necessarily mutually exclusive. For example, specific shapes, structures and characteristics described herein may be implemented with changes from one embodiment to another without departing from the spirit and scope of the invention. Additionally, it should be understood that the location or arrangement of individual components within each embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description described below is not to be taken in a limiting sense, and the scope of the present invention should be taken to encompass the scope claimed by the claims and all equivalents thereof. Like reference numbers in the drawings indicate identical or similar elements throughout various aspects.

Hereinafter, several embodiments of the present invention will be described in detail with reference to the attached drawings in order to enable those skilled in the art to easily practice the present invention.

Figure 1 is a diagram illustrating an example of a light stick control signal interlocking system according to an embodiment of the present invention.

The network environment in FIG. 1 shows an example that includes at least one user terminal 100, a light stick 110, a video transmission server 120, a light stick control signal generation server 130, and a network. Figure 1 is an example for explaining the invention, and the number of user terminals or servers is not limited as in Figure 1.

The user terminal 100, the light stick 110, the video transmission server 120, and the light stick control signal generation server 130 may communicate through a network. The communication method is not limited, and may include communication methods that utilize communication networks that the network may include (for example, mobile communication networks, wired Internet, wireless Internet, and broadcasting networks) as well as short-distance wireless communication between devices. For example, networks include personal area network (PAN), local area network (LAN), campus area network (CAN), metropolitan area network (MAN), wide area network (WAN), broadband network (BBN), Internet, etc. It may include one or more arbitrary networks among the networks. Additionally, the network may include, but is not limited to, any one or more of network topologies including a bus network, star network, ring network, mesh network, star-bus network, tree or hierarchical network, etc. .

The user terminal 100 may be a fixed terminal implemented as a computer device or a mobile terminal. Examples of the user terminal 100 include smart phones, mobile phones, navigation systems, computers, laptops, digital broadcasting terminals, Personal Digital Assistants (PDAs), Portable Multimedia Players (PMPs), and tablet PCs. More specifically, the light stick control signal interlocking system according to an embodiment of the present invention includes a video transmission server 120, a user terminal 100 that plays the video, and a light stick 110, and in some embodiments, the light stick A control signal generation server 130 may be further included. In another embodiment, the user terminal 100 may communicate with other user terminals and/or an external server through a network using a wireless or wired communication method.

The light stick 110 is a cheering tool used by fans to cheer at a live performance venue. In one embodiment, the light stick 110 may be an electronic device capable of communicating with the user terminal 100 through a network. . As described above, the communication method between the light stick 110 and the user terminal 100 is not limited, but for example, the light stick 110 and the user terminal 100 may perform Bluetooth communication. The cheering stick 110 may be of various types depending on the object and situation being cheered. Accordingly, the single user terminal 100 can perform network communication with a plurality of cheering sticks, and each of the plurality of cheering sticks described above may have different identification values.

In one embodiment, the light stick 110 can be controlled using an application installed on the user terminal 100, and a software development kit (SDK) corresponding to each light stick can be installed in the application.

The video transmission server 120 may receive a video request signal from the user terminal 100 and transmit the video to the user terminal 100 in response to the video request signal. In one embodiment, the video transmission server 120 may transmit recorded video to the user terminal 100, and in another embodiment, the video transmission server 120 transmits real-time video according to a designated schedule to the user terminal 100. It can also be transmitted.

The video transmission server 120 can specify an identification value for each video to be transmitted, and can transmit the identification value of the video to the user terminal 100 and/or the light stick control signal generation server 130. In some embodiments, when transmitting real-time video, the video transmission server 120 may transmit information related to the transmitted video to the light stick control signal generation server 130. Thereafter, the light stick control signal generation server 130 may use the video information received from the video transmission server 120 to generate a light stick control signal corresponding to the video received in real time.

The video transmission server 120 according to some embodiments of the present invention may tag the video transmission reference time for the target video. For example, metadata of the video transmitted from the video transmission server 120 may include UTC (Coordinated Universal Time) time information at which the video was transmitted.

The light stick control signal generation server 130 may generate light stick control scenario information based on video information received from the video transmission server 120. In one embodiment, the light stick control scenario information may correspond one-to-one with the identification value of the image.

In another embodiment, the light stick control scenario information may include a plurality of light stick control information, and in this case, the light stick control information may correspond to at least one section of the video. For example, if the light stick control scenario information corresponds to a concert video of a specific singer, the light stick control information may correspond to a section in which the singer's song is played. According to some embodiments of the present invention, the light stick control scenario information generated by the light stick control signal generation server 130 may be generated based on the video transmission reference time. A more detailed description is provided below in the related drawings.

Thereafter, the user terminal 100 sends the light stick 110 to the light stick 110 based on the light stick control scenario information received from the light stick control signal generation server 130 and the video and video transmission reference time received from the video transmission server 130. A light stick control signal can be transmitted. The light stick control signal may include a control signal for at least one module included in the light stick 110. For example, the light stick control signal may include an LED control signal and a vibration sensor control signal.

As described above, in the light stick control signal linking system according to some embodiments of the present invention, the video transmission server 120 and the light stick control signal generation server 130 may be independently provided. Through this, the light stick control signal linkage system can stably control the light stick control signal even if there is a delay between the video output from the user terminal and the transmitted broadcast video due to network delay or data transmission and reception errors. In this case, the light stick may be controlled according to the light stick control signal received from the light stick control signal generating server 130.

Figure 2 is a block diagram for explaining the internal configuration of a user terminal and a server that performs a method of linking a light stick control signal according to an embodiment of the present invention.

In one embodiment, the user terminal 100, the light stick 110, the video transmission server 120, and the light stick control signal generation server 130 that perform the method of linking the light stick control signal for the video have memories 101 and 111. , 121, 131), processors (102, 112, 122, 132), communication modules (103, 113, 123, 144), and input/output interfaces (104, 114, 124, 134).

The memories 101, 111, 121, and 131 are computer-readable recording media and include non-permanent mass storage devices such as random access memory (RAM), read only memory (ROM), and disk drives. can do. Additionally, program codes and settings for controlling the user terminal 100, target images, and light stick control scenario information may be temporarily or permanently stored in the memory 101.

Processors 102, 112, 122, and 132 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Commands may be provided to the processors 102, 112, 122, and 132 by memories 101, 111, 121, and 131 or communication modules 103, 113, 123, and 133. For example, the processors 102, 112, 122, and 132 may be configured to execute instructions received according to program codes stored in a recording device such as the memory 101, 111, 121, and 131. In one embodiment, the processor 102 of the user terminal 100 may receive a target video including a plurality of frames, an identification value of the target video, and a video transmission reference time for each frame from the video transmission server 120. Thereafter, the processor 102 may obtain light stick control scenario information for the target image from the light stick control signal generation server 130 using the identification value of the target image. In addition, the processor 102 acquires the target light stick information included in the light stick control scenario information and a light stick control signal in the form of time series data, and transmits the video corresponding to the current time to the target light stick 110 according to the reference time. A lightstick control signal can be transmitted.

Communication modules 103, 113, 123, and 133 may provide functions for communication through a network. For example, a request generated by the processor 102 of the user terminal 100 according to a program code stored in a recording device such as the memory 101 is sent to the video transmission server 120 through the network under the control of the communication module 103. It can be transmitted as . Conversely, control signals, commands, content, files, etc. provided under the control of the processor 122 of the video transmission server 120 may be received by the user terminal 100 through the communication module 103 via the network. . For example, control signals or commands of the video transmission server 120 received through the communication module 103 may be transmitted to the processor 102 or memory 101, and content or files may be transmitted to the user terminal 100. This may be stored in a storage medium that may further include. Additionally, the communication modules 103, 113, 123, and 133 can communicate through a network. The communication method is not limited, but the network may be a local area wireless communication network. For example, the network may be a Bluetooth, Bluetooth Low Energy (BLE), or Wifi communication network.

The input/output interfaces 104, 114, 124, and 134 may be means for interfacing with an input/output device. For example, an input device may include a device such as a keyboard or mouse, and an output device may include a device such as a display for displaying a communication session of an application. As another example, the input/output interface 104 of the user terminal 100 may be a means for interfacing with a device that integrates input and output functions into one, such as a touch screen. As a more specific example, the processor 102 of the user terminal 100 uses data provided by the video transmission server 120 or the light stick control signal generation server 130 in processing the commands of the loaded computer program. A service screen or content constructed using can be displayed on the display through the input/output interface 104. In one embodiment, the input/output interface 114 of the light stick 110 may be a means for interfacing with other components that the light stick 110 further includes, such as an LED module, a vibration module, or a GPS module.

In addition, in other embodiments, the user terminal 100, the light stick 110, the video transmission server 120, and the light stick control signal generation server 130 may include more components than those of FIG. 2. It may be possible. However, there is no need to clearly show most prior art components. For example, the user terminal 100 may include a battery and a charging device that supplies power to the internal components of the user terminal, and may be implemented to include at least some of the above-described input/output devices, or a transceiver, It may further include other components such as a Global Positioning System (GPS) module, various sensors, and a database.

Figure 3 is a flowchart of a method of linking a light stick control signal according to an embodiment of the present invention.

In step S110, the user terminal may receive the target video, the identification value of the target video, and the video transmission reference time.

In one embodiment, the user terminal may receive a target video including a plurality of frames, an identification value of the target video, and a video transmission reference time for each frame. In one embodiment, the user terminal may receive a target video and a video transmission reference time of the target video for each designated section from the video transmission server.

In another embodiment, when the user terminal receives a target video in real time from a video transmission server, the user terminal may receive a video transmission reference time for each frame of the target video received in real time. In one embodiment, several frames included in the video may include time stamp information including video transmission reference time information. For example, video metadata (for example, ID3 tag meta or event tag) may include video transmission standard time information at specified time intervals.

In step S120, the user terminal may obtain a light stick control signal for the target image using the identification value of the target image.

In another embodiment, the user terminal may obtain light stick control scenario information for the target image using the identification value of the target image. The light stick control scenario information may include target light stick information and light stick control signals. In this embodiment, the user terminal may transmit the identification value of the target image to an external server and receive light stick control scenario information corresponding to the target image from the external server.

In one embodiment, when the user terminal receives video in designated sections, the user terminal may transmit a lightstick control scenario information request signal to the external server for each designated section described above, and each section from the external server described above. You can obtain information on the corresponding lightstick control scenario.

In an optional embodiment, light stick control scenario information previously received from the outside may be stored in the memory of the user terminal.

In some embodiments, the user terminal may receive light stick control scenario information using an SDK included in an application installed on the user terminal. In this embodiment, the user terminal can transmit the identification value of the target image to the SDK described above. The external server that has received the identification value of the target video can transmit the lightstick control scenario corresponding to the target video to the user terminal.

Lighting stick control scenario information according to some embodiments of the present invention includes a plurality of light stick control information, and each of the plurality of light stick control information may correspond to at least one of a plurality of sections included in the target image.

In one embodiment, the light stick control scenario information may correspond one-to-one with the image identification value. For example, if the light stick control scenario information corresponds to a concert video of a specific singer, the light stick control information may correspond to a section in which the singer's song is played. For example, when a performer appearing in a specific video sings multiple songs, lightstick control scenario information consisting of lightstick control information corresponding to each of the plurality of songs may be generated.

Thereafter, the user terminal may obtain target light stick information included in the light stick control scenario information and a light stick control signal in the form of time series data. In one embodiment, the user terminal may perform network communication with a plurality of light sticks, and in this case, each of the plurality of light sticks may have different identification values. Each light stick may be assigned an identification value depending on its type. For example, the identification values of cheering sticks cheering for the same singer may be the same, and the identification values of cheering sticks cheering for different singers may be different. Therefore, in this embodiment, the light stick information described above may include an identification value of the light stick.

In one embodiment, light stick control scenario information may be generated based on the video transmission reference time. The format of the video transmission standard time information is not limited. For example, the video transmission standard time information may be an integer or character format converted from UTC time information, or may be a data format in which UTC time information is encoded. For example, if the video transmission reference time is the UTC time when the video was transmitted from the video transmission server, the light stick control scenario information may include a light stick control signal according to UTC time.

In step S130, the user terminal may transmit a light stick control signal according to the video transmission reference time to the target light stick. In one embodiment, the light stick control signal in the form of time series data includes a light stick control signal for each time as the video transmission standard of the target video, and the user terminal sets the video transmission standard corresponding to the current time regardless of the video frame output on the display. A light stick control signal according to time can be transmitted to the target light stick.

Since the light stick control signal generated according to some embodiments of the present invention is generated based on the video transmission reference time, the delay of the light stick control signal can be minimized even if network delay occurs. For example, even if a network error occurs between the video transmission server and the user terminal, the user terminal transmits the lightstick control signal to the physical lightstick based on the video transmission standard time information, so even if there is a delay in video output, the lightstick control signal is transmitted. There is no delay. As another example, even if a network error occurs between the user terminal and the actual light stick, a temporary delay in the light stick signal may occur. However, since the video transmission standard time and the light stick control signal are mapped, a plurality of light stick control signals are consecutive. There is no overall delay for .

In another embodiment, the user terminal may transmit control signals for a plurality of light sticks. In this embodiment, when the light stick control scenario information includes control signals for a plurality of light sticks, the target light stick information in this embodiment may include first light stick information and second light stick information. In this case, the light stick control signal includes the above-described first light stick control signal and the second light stick control signal, and the user terminal transmits the first light stick control signal to the first light stick and the second light stick to the second light stick control signal. 2 A light stick control signal can be transmitted.

In another embodiment, the user terminal may receive a feedback signal for the light stick control signal from the target light stick. Through this, the user terminal can correct errors or errors occurring in the light stick in real time.

Figure 4 is a flowchart for explaining each operation subject of the light stick control signal according to an embodiment of the present invention.

In step S200, the user terminal may transmit a target video request signal to the video transmission server. For example, when a user input for playing a target video is received for the user terminal, the user terminal may transmit a target video request signal to the video transmission server.

In step S210, the video transmission server may transmit the target video, the identification value of the target video, and the video transmission reference time to the user terminal. In this case, the data transmitted from the video transmission server to the user terminal may be different depending on the state of the target video.

In one embodiment, when the video transmission server transmits real-time video to the user terminal, data for the entire target video cannot be delivered to the user terminal at once. Therefore, in this case, the video transmission server can deliver the target video in streaming format to be transmitted in real time to the user terminal. In this embodiment, the video transmission server may transmit the video transmission reference time for each frame of the target video or at designated time intervals.

In another embodiment, when the video transmission server transmits the entire previously generated target video to the user terminal according to a designated schedule, the video transmission server may transmit the target video according to the designated unit interval, and the metadata of the target video to be transmitted may be transmitted. Video transmission time information for each frame of the target video may be included in the data.

In step S220, the user terminal may transmit the identification value of the target image to the light stick control signal generation server, and then in step S230, the light stick control signal generation server controls the previously generated light stick using the identification value of the received target image. Scenario information can be obtained. The light stick control signal generation server according to some embodiments of the present invention may generate at least one light stick control scenario information corresponding to the target video using the identification value information of the target video previously received from the video transmission server. . However, in the case of video transmitted in real time, there may be no light stick control scenario information previously generated by the light stick control signal generation server, which is a problem. This embodiment will be described in detail in FIG. 5.

And, in step S240, the light stick control signal generating server may transmit light stick control scenario information to the user terminal. That is, the light stick control signal generating server that receives the identification value of the target image from the user terminal may transmit light stick control scenario information corresponding to the above-described target image to the user terminal.

In step S250, the user terminal may transmit a light stick control signal according to the video transmission reference time corresponding to the current time to the light stick. As described above, the light stick control signal may include a control signal for at least one module included in the light stick. For example, the light stick control signal may include an LED control signal and a vibration sensor control signal.

Figure 5 is a diagram for explaining a method of linking a light stick control signal to a video transmitted in real time according to an embodiment of the present invention.

As described above, the user terminal may transmit a target video request signal to the video transmission server in step S300, and in step S310, the video transmission server may transmit the target video, the identification value of the target video, and the video transmission reference time to the user terminal. You can. In this case, when the video transmission server transmits a target video transmitted in real time to the user terminal, the question becomes whether the light stick control signal generation server can generate light stick control scenario information corresponding to the target video in advance.

According to one embodiment of the present invention, the video transmission server that transmits real-time video may transmit the target video, the identification value of the target video, and the video transmission reference time to the lightstick control signal generation server in step S320 while performing step S310. In this case, the sequential relationship between step S310 and step S320 is not limited, and in one embodiment, step S310 and step S320 may be performed simultaneously.

The user terminal may transmit the identification value of the target image to the light stick control signal generation server in step S330. In step S340, the light stick control signal generation server may generate light stick control scenario information corresponding to the target video received from the video transmission server in real time. The order of steps S330 and S340 is not limited to that shown. In one embodiment, step S330 may be performed after step S340, or step S330 and step S340 may be performed simultaneously. Alternatively, step S340 may be performed immediately after step S320, regardless of step S330.

The light stick control signal generation server according to an embodiment of the present invention can generate new light stick control scenario information by grouping single light stick information and multiple light stick control information. For example, when a specific singer appearing in the target video sings multiple songs, the lightstick control signal generation server can generate the lightstick control scenario information described above using the lightstick control information corresponding to each song. .

In another embodiment, the light stick control signal generation server may group a plurality of light stick information and a plurality of light stick control information to generate new light stick control scenario information. For example, when multiple singers appearing in a target video sing multiple songs, the lightstick control signal generation server cheers for each of the multiple songs described above for multiple target lightsticks corresponding to each of the multiple singers. Lighting stick control scenario information can be created based on the stick control information.

Thereafter, the light stick control signal generation server may transmit the light stick control scenario information generated in step S350 to the user terminal. For example, an SDK for each light stick may be installed in the application of the user terminal. In this case, the light stick control signal generation server can transmit light stick control scenario information related to the light stick to the SDK of the target light stick.

As described above, the user terminal may transmit a light stick control signal according to the video transmission reference time to the light stick in step S360. In one embodiment, when the light stick control scenario information received by the user terminal includes light stick control information for a plurality of target light sticks, the user terminal controls the light stick according to the video transmission reference time for each of the plurality of light sticks. Signals can be transmitted.

Figure 6 is a diagram for explaining video transmission reference time information according to an embodiment of the present invention.

According to the method of linking the light stick control signal according to an embodiment of the present invention, the video transmission server can transmit the target video and video transmission reference time to a plurality of user terminals. Depending on the network environment and communication method, the communication speed between the video transmission server and the plurality of user terminals described above may be different, and accordingly, the target images output from the plurality of user terminals may be different from each other. However, since the video transmission server according to some embodiments of the present invention transmits the video transmission reference time to the plurality of user terminals, each user terminal can control the light stick based on the same video transmission reference time.

That is, the method of linking the light stick control signal according to some embodiments of the present invention can perform light stick control based on the video transmission reference time regardless of the playback section of the target video currently output from the user terminal. Hereinafter, a detailed description will be given of how the user terminal transmits a lightstick control signal to the lightstick according to the video transmission standard time.

In Figure 6, the transmission time (10) of the target video transmitted from the video transmission server, the output time (20) of the target video output from user terminal 1, and the output time (30) of the target video output from user terminal 2 are disclosed. there is. User terminal 1 and user terminal 2 receive the target video from the video transmission server through network communication, so the target video transmission time (10) and target video output time (20, 30) are different depending on the network environment and communication delay. can do. In addition, differences may also occur between the output times (20 and 30) of the target images of user terminals.

The light stick according to some embodiments of the present invention receives a light stick control signal from the user terminal, but the light stick control signal may be generated based on the video transmission reference time. That is, regardless of the time when the user terminal receives the target video or the time when the target video is output on the display of the user terminal, the light stick control signal according to this embodiment is based on the video transmission reference time of the target video specified by the video transmission server. It can be created based on

For example, when referring to the figure, the video transmission time transmitted from the video transmission server and the output time of the target video output from user terminal 1 are delayed by the first section 23, and the video transmission time described above and the user terminal 1 are delayed by the first section 23. The output time of the target image output from terminal 2 may be delayed by the second section 33. In this case, the first frame output from the video transmission server at the first video transmission reference time (11) is output to user terminal 1 at a time point (22) that is delayed by the first section (24) from the first video transmission reference time (11). It can be, and in user terminal 2, the first frame can be output at a point in time (32) that is delayed by a second section (34) from the first video transmission reference time (11). On the other hand, the light stick receives the light stick control signal corresponding to the first video transmission reference time 11, regardless of the delay for the above-described first section 24 and second section 34 corresponding to the first frame. can do. For example, user terminal 1 may transmit a light stick control signal mapped to the first video transmission reference time (11) corresponding to the time (21) for transmitting the light stick control signal to the target light stick. Likewise, user terminal 2 may also transmit a light stick control signal mapped to the first video transmission reference time (11) corresponding to the time (31) for transmitting the light stick control signal to the target light stick.

Figure 7 is a diagram for explaining the database structure of a light stick control signal interlocking device according to an embodiment of the present invention.

The light stick control signal linking device according to some embodiments of the present invention may store a database related to light stick control scenario information, light stick control information for each section, and light stick control information.

Referring to the illustration, in one embodiment, light stick control scenario information may correspond one-to-one with individual images. Additionally, the light stick control scenario information may include light stick control information for a plurality of sections. For example, in the case of a performance video, the performance video may be divided into multiple sections according to the table of contents of the performance. In another example, when the light stick control scenario information corresponds to a concert video of a specific singer, the light stick control information for each section may correspond to a section in which the singer's song is played. In this case, when a performer appearing in a specific video sings multiple songs, light stick control scenario information consisting of light stick control information for each section corresponding to each of the plurality of songs may be generated.

Lighting stick control information for each section may include an identification value of the corresponding video, information on a specific section of the corresponding video, and lighting stick control information. The light stick control information may include the target light stick and light stick control signal for the corresponding section. In one embodiment, each light stick may be assigned a different identification value. For example, the identification values of cheering sticks cheering on the same singer may be the same, and the identification values of cheering sticks cheering on different singers may be different. Alternatively, the target light stick may be different for each performance.

8 and 9 are examples of an application GUI installed on a user terminal connected to a light stick according to an embodiment of the present invention.

Referring to what is shown in FIG. 8, a target image may be output on the display of the user terminal 100 according to one embodiment. Additionally, a UI object 210 for performing a light stick network connection may be further displayed on the display of the user terminal 100. In one embodiment, the user terminal 100 may transmit a network connection request signal for the target light stick in response to receiving a user input for the “Connect light stick” UI object 210. Referring to FIG. 9, in one embodiment, the user terminal 100 may further output a guide screen for network connection with the light stick. The communication method between the user terminal 100 and the light stick is not limited, but for example, the user terminal 100 and the light stick may perform Bluetooth communication. Accordingly, information on the network connection method with the light stick and the target light stick may be output to the user terminal 100.

The device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), etc. , may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. Computer-readable media may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited examples and drawings, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims (12)

A video transmission server transmitting a target video and a video transmission time of the target video to a first user terminal and a second user terminal;
Playing the target video by a first user terminal after a first delay time from the video transmission time;
Playing the target video by a second user terminal after a second delay time different from the first delay time from the video transmission time;
transmitting, by the first user terminal, a light stick control signal corresponding to the target video to a first light stick based on the video transmission time; and
Including the step of the second user terminal transmitting a light stick control signal corresponding to the target video to the second light stick based on the video transmission time,
Even if the time at which the first user terminal plays the target video and the time at which the second user terminal plays the target video are different from each other, the first and second light sticks operate according to the light stick control signal. A method of linking a lightstick control signal, characterized in that it is performed simultaneously. According to claim 1,
The light stick control signal is programmed in time series based on the video transmission time of the target video,
The step of transmitting the light stick control signal from the first user terminal to the first light stick,
When the current time of the first user terminal is the same as the time after a pre-programmed setting time from the video transmission time, transmitting a light stick control signal corresponding to the set time,
The step of transmitting the light stick control signal from the second user terminal to the second light stick,
When the current time of the second user terminal is the same as the time after the set time from the video transmission time, transmitting a light stick control signal corresponding to the set time. According to claim 1,
transmitting, by the first user terminal and the second user terminal, an identification value of the target image to an external server;
A method of linking a light stick control signal comprising receiving, by the first user terminal and the second user terminal, the light stick control signal corresponding to the target image from the external server. In the light stick control method performed by the user terminal,
Transmitting a signal requesting a target video to a video transmission server;
Receiving the target video, an identification value of the target video, and a video transmission time of the target video from the video transmission server;
Obtaining a light stick control signal corresponding to the target image using the identification value;
Playing the target video after a delay time from the video transmission time; and
Including transmitting the light stick control signal to the first light stick based on the video transmission time,
The light stick control signal is programmed in time series based on the video transmission time,
The first light stick controls the light stick, characterized in that it performs programmed operations in time series according to the light stick control signal based on the video transmission time, regardless of whether the target video is played with delay in the user terminal. method. According to clause 4,
The target image includes a plurality of frames,
The step of receiving the video transmission time is,
A light stick control method comprising receiving frame transmission times at predetermined unit intervals in the plurality of frames. According to clause 4,
The target image includes a plurality of section images,
The step of receiving the video transmission time is,
A cheering stick control method comprising receiving a section video transmission time for each of the plurality of section images. According to clause 4,
The step of receiving the target video, the identification value, and the video transmission time,
Receiving the target image including metadata,
The metadata is a light stick control method characterized in that it includes the identification value and the video transmission time. According to clause 4,
The step of acquiring the light stick control signal is,
Transmitting the identification value to a light stick control signal generation server; and
A light stick control method comprising receiving the light stick control signal from the light stick control signal generating server. According to clause 4,
A light stick control method further comprising receiving a feedback signal for the light stick control signal from the first light stick. A user terminal transmitting a signal requesting a target video to a video transmission server;
transmitting, by the video transmission server, the target video, an identification value of the target video, and a video transmission time of the target video to a user terminal and a light stick control signal generation server in real time;
Generating a light stick control signal programmed in time series based on the video transmission time in response to the target video received by the light stick control signal generation server in real time;
transmitting, by the user terminal, the identification value of the target image to the cheering stick control signal generation server;
Receiving, by the user terminal, the light stick control signal corresponding to the target image from the light stick control signal generation server in real time;
After a delay time from the video transmission time, the user terminal plays the target video; and
A method of linking a light stick control signal comprising the step of the user terminal transmitting the light stick control signal to a light stick based on the video transmission time.
According to claim 10,
The light stick performs operations programmed in time series by the light stick control signal generation server according to the light stick control signal based on the video transmission time, regardless of whether the target video is played with delay in the user terminal. A method of linking a lightstick control signal further comprising steps. Includes a processor,
The processor,
Receiving a target video including a plurality of frames, an identification value of the target video, and video transmission time for each frame,
Obtaining light stick control scenario information corresponding to the target image using the identification value of the target image,
After a delay time from the video transmission time for each frame, playing a frame of the target video transmitted at the video transmission time for each frame,
Using the target light stick information included in the light stick control scenario information and the light stick control signal in the form of time series data, the light stick in the form of time series data is programmed based on the video transmission reference time for each frame to the target light stick. configured to transmit a rod control signal,
The target light stick is a light stick control characterized in that it performs programmed operations in time series according to the light stick control signal based on the video transmission time for each frame, regardless of whether the frame of the target video is played with delay. Signal interlocking device.

Images