WO2019164361A1

WO2019164361A1 - Streaming device and streaming method

Info

Publication number: WO2019164361A1
Application number: PCT/KR2019/002272
Authority: WO
Inventors: 전수영; 권지용
Original assignee: 스타십벤딩머신 주식회사
Priority date: 2018-02-23
Filing date: 2019-02-25
Publication date: 2019-08-29

Abstract

The present invention relates to a streaming device and a streaming method. The streaming device according to an embodiment comprises: a communication unit for obtaining a streaming image; and a controller for converting state data obtained with the streaming image, providing the converted state data together with the streaming image, and obtaining feedback data in response to the provision of the state data.

Description

Streaming device and streaming method

Embodiments disclosed herein relate to a streaming apparatus and a streaming method, and more particularly, to a streaming method and apparatus for acquiring an interaction of a viewer synchronized with a streaming video in a live streaming environment.

With the development of terminals today, people can use a variety of contents anytime and anywhere by using electronic terminals such as mobile terminals such as mobile phones, PMPs, PDAs, laptops, or fixed terminals such as desktops.

In particular, video was available only when stored in the past through storage media, but with the development of communication technology, large-capacity videos can be provided and viewed in real time by streaming.

In recent years, with the development of technology, a personal broadcasting service, in which a user photographs by using a terminal and provides a plurality of other users in real time through streaming, has been increased.

The personal broadcasting service provides contents such as games that require mutual interaction between users in an environment in which images are provided in real time, not just providing images.

In this case, in order to provide content required for mutual interaction in an environment for providing a real-time video, a server providing content separately from a server providing a video receives and processes a user's input.

However, when the time point at which an image is streamed and the time point at which content is provided are not synchronized, there is a problem in that a time point for requesting input from a viewer and a time point at which an actual viewer can perform input through the content are different. Alternatively, there is a problem in that a time point for providing information according to a viewer's input and a time point for providing content or the information according to the viewer's input differ from each other.

For example, the streaming service has a delay of about 10 seconds on average from reaching the broadcaster terminal of the broadcaster to the broadcaster terminal, and minimizes the delay using WebRTC. Even if a delay of about 2 seconds to 3 seconds occurs, the delay time may be further increased depending on the state of the viewer terminal.

On the other hand, if the content to be provided in the streaming service is a game such as OX quiz, multiple choice quiz, crossword matching, survey, roulette, etc., the existing game service using socket communication technology has a delay time to the viewer terminal within 0.5 seconds. The time is different.

Due to the difference in the delay time, even if the broadcaster simultaneously plays the video and transmits the video, the viewer receives the result of the game first and receives the video later. As a result, the user experience of the game service is degraded. do.

Therefore, there is a need for a method of synchronizing the progress of the content with the video of the broadcaster for transmitting the video.

In the related art, Korean Patent Laid-Open Publication No. 10-2015-0095142 proposes a network camera device and a method of providing video streaming thereof, but the prior art provides that a first camera provides a user interface to a user terminal and the user terminal. Obtains a message requesting video streaming of the first profile from the first camera, and the first camera provides the first profile video to the user terminal or the second camera provides the first camera depending on whether the first camera performs the requested video streaming. It only provides the video of the first profile transmitted from, but does not provide a synchronized game in an environment that provides the video in real time.

Therefore, there is a need for a technique for solving the above problems.

On the other hand, the background art described above is technical information that the inventors possess for the derivation of the present invention or acquired in the derivation process of the present invention, and is not necessarily a publicly known technique disclosed to the general public before the application of the present invention. .

Embodiments disclosed herein are intended to present a streaming device and a streaming method.

In addition, the embodiments disclosed herein are to provide a streaming device and a streaming method that can obtain the interaction of the viewer synchronized with the streaming video in a real-time streaming environment.

In addition, the embodiments disclosed herein are to provide a streaming device and a streaming method that can be obtained using a minimum of resources when obtaining the interaction of the synchronized viewer in a real-time streaming environment.

As a technical means for achieving the above-described technical problem, according to an embodiment, as a streaming device for streaming an image in real time, a communication unit for obtaining a streaming image, and converts and converts the state data obtained with the streaming image The control unit may provide the received state data together with the streaming video and obtain feedback data in response to the provision of the state data.

According to another embodiment, a method for streaming an image by a streaming device for streaming an image in real time, the method comprising: obtaining a streaming image, converting the state data acquired together with the streaming image, and converting the converted state data Providing with the streaming video, and acquiring feedback data in response to the provision of the state data.

According to yet another embodiment, a computer readable recording medium having recorded thereon a program for performing a streaming method, the streaming method comprising: obtaining a streaming image, converting state data acquired with the streaming image, and converting The method may include providing the state data together with the streaming video and acquiring feedback data in response to the provision of the state data.

According to yet another embodiment, a computer program executed by a streaming device and stored in a medium to perform a streaming method, the streaming method comprising: obtaining a streaming video, converting state data acquired with the streaming video; Step, providing the converted state data with the streaming video. And acquiring feedback data in response to the provision of the state data.

According to any one of the above-described problem solving means, it is possible to provide a streaming device and a streaming method.

In addition, according to any one of the above-described problem solving means, it is possible to provide a streaming device and a streaming method for acquiring the interaction of the viewer synchronized with the streaming video in a real-time streaming environment. Through this, video and content progress are synchronized, so that the synchronization between the state transition of the content and the reaction of the broadcaster is closely performed, thereby dramatically increasing the user experience of the viewer as well as the broadcaster.

In addition, according to any one of the aforementioned problem solving means, it is possible to provide a streaming device and a streaming method that can be obtained using a minimum of resources when obtaining the interaction of the synchronized viewer in a real-time streaming environment.

The effects obtainable in the disclosed embodiments are not limited to the effects mentioned above, and other effects not mentioned above are apparent to those skilled in the art to which the embodiments disclosed from the following description belong. Can be understood.

1 is a block diagram illustrating a streaming service system according to an exemplary embodiment.

2 to 3 are block diagrams illustrating a streaming apparatus according to an embodiment.

4 through 5 are flowcharts for describing a streaming method, according to an exemplary embodiment.

6 to 8 are exemplary diagrams for describing a streaming method according to an embodiment.

Hereinafter, various embodiments will be described in detail with reference to the accompanying drawings. The embodiments described below may be embodied in various different forms. In order to more clearly describe the features of the embodiments, detailed descriptions of the matters well known to those skilled in the art to which the following embodiments belong are omitted. In the drawings, parts irrelevant to the description of the embodiments are omitted, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a configuration is "connected" to another configuration, this includes not only 'directly connected' but also 'connected' between different configurations. In addition, when a configuration "includes" a certain configuration, this means that, unless specifically stated otherwise, it may further include other configurations other than the other configuration.

Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings.

However, before describing this, the meanings of the terms used below are first defined.

'Status data' refers to data of content to be provided to the viewer when the video is streamed to the viewer watching the video broadcast by the broadcaster.

The state data may further include a time stamp, and the time stamp may be information about a time point at which an event corresponding to the state data is executed. In this case, the view point may mean a point in time at which the image is received and reproduced in the viewer terminal, may be information about a point in time included in the frame of the image, and may mean a standard time in the viewer terminal receiving the state data. . This time stamp allows the content of the state data to be synchronized with the streamed video.

In addition, the state data may include content for requesting the viewer's feedback, or may include triggering information for executing the content in the viewer terminal receiving the state data.

The state data may be option data to be input by the viewer or triggering information for displaying the choice when the broadcaster wants to hear opinions from the viewer. In addition, the status data may be, for example, a variety of information for obtaining feedback of the viewer about the game when the game is played between the viewer and the broadcaster, the game start or end information, game identification information, the answer to the query of the broadcaster It may be choice data, etc. which can be selected.

In addition to the terms defined above, terms that need explanation are explained separately below.

1 is a block diagram illustrating a streaming service system 100 according to an embodiment.

The streaming service system 100 may display content information corresponding to the state data or request feedback from the user terminal according to the state data synchronized with a specific time point of the image to each terminal transmitting and receiving the image in real time streaming.

That is, the streaming service system 100 may load state data on the video signal. Accordingly, the broadcast server may provide the broadcast server with the content that the broadcaster wants to provide to the viewer.

Referring to FIG. 1, the streaming service system 100 may include a user terminal 10 and a streaming device 20. As shown in FIG. 1, the streaming service system 100 may include one or more user terminals 10 and one or more streaming devices 20, and the user terminal 10 and the streaming device 20 may include a network ( Can communicate via N).

The user terminal 10 may transmit and receive the image captured in real time by streaming, and may allow the viewer to interact by being synchronized with the image transmitted and received by streaming, or provide predetermined content to the viewer by being synchronized with the image transmitted and received by streaming. The application may be implemented as an electronic terminal that can be installed.

In this case, the electronic terminal may be implemented as a computer, a portable terminal, a television, a wearable device, or the like, connected to a remote server through a network N or connected to other terminals and servers. Here, the computer includes, for example, a laptop, desktop, laptop, etc., which is equipped with a web browser, and the portable terminal is, for example, a wireless communication device that ensures portability and mobility. , Personal Communication System (PCS), Personal Digital Cellular (PDC), Personal Handyphone System (PHS), Personal Digital Assistant (PDA), Global System for Mobile communications (GSM), International Mobile Telecommunication (IMT) -2000, Code CDMA Division Multiple Access (2000), all types of handhelds such as W-Code Division Multiple Access (W-CDMA), Wireless Broadband Internet (Wibro), Smart Phones, and Mobile Worldwide Interoperability for Microwave Access (WiMAX). It may include a (Handheld) based wireless communication device. In addition, the television may include an Internet Protocol Television (IPTV), an Internet Television (Internet Television), a terrestrial TV, a cable TV, or the like. Further, the wearable device is, for example, an information processing device of a type that can be worn directly on a human body such as a watch, glasses, accessories, clothes, shoes, etc., and is connected to a remote server or another terminal via a network directly or through another information processing device. It can be connected with.

The user terminal 10 may be divided into a broadcaster terminal 11 and a viewer terminal 12, and such a classification is not classified according to a configuration difference but a classification based on a user subject.

The broadcaster terminal 11 may transmit a video recorded in real time through a camera, and may transmit the state data related to the content executed in the viewer terminal 12 receiving the video with streaming along with the streamed video data. have.

In addition, the viewer terminal 12 may receive a video captured by the broadcaster terminal 11 in real time, and at the same point in time as the control of the broadcaster that is a user of the broadcaster terminal 11 occurs in the video. It can be displayed by executing and the user input for the content can be obtained.

In this case, the streaming service system 100 may include a plurality of broadcaster terminals 11 and a plurality of viewer terminals 12. Hereinafter, one broadcaster terminal 11 and a viewer terminal 12 for convenience of description. It is assumed that this is included.

Meanwhile, the streaming device 20 may be implemented as a computing device capable of communicating with the user terminal 10 through a network (N).

The streaming device 20 receives the captured video in real time from the broadcaster terminal 11 and transmits the streamed video to the viewer terminal 12 in streaming, and converts the converted streaming video together with the state data in the transmitted video stream. The broadcast server 21 may be provided to the viewer terminal 12, and the content processing server 22 may acquire and process feedback data from the viewer terminal 12.

In this case, 'feedback data' means information input by the viewer in response to the state data. For example, if the state data was option data, the information selected by the viewer among the choices may be feedback data.

The broadcast server 21 may acquire the state data from the broadcaster terminal 11 while streaming the real-time captured image from the broadcaster terminal 11 to the viewer terminal 12 by streaming the streamed state data. The image data may be converted to be transmitted together with the video data and provided to the viewer terminal 12.

Meanwhile, the content processing server 22 may obtain feedback data from the viewer terminal 12, and the content processing server 22 directly obtains feedback data from the viewer terminal 12 or feeds back through the broadcast server 21. Data can be obtained.

The content processing server 22 may provide the content processing information according to the acquisition of the feedback data to the broadcaster terminal 11, the viewer terminal 12, or the broadcast server 21.

In this case, the 'content processing information' is information processed by the viewer's feedback data on the content transmitted by the broadcaster, and may be, for example, information processed so that the broadcaster can check the feedback data input by one viewer. The information may be processed to allow a broadcaster to check feedback data input by a plurality of viewers. The content processing information may include triggering information for triggering a predetermined event according to a result of processing the feedback data.

For example, the content processing server 22 may process so that the broadcaster can determine what type of answer each viewer has input according to the acquired feedback data, or, for example, statistics about feedback data input by a plurality of viewers. You can sort the information that had the most input and provide it to the broadcaster. In addition, for example, the content processing server 22 may cause a predetermined event to be triggered according to the processed result. The content processing server 22 may reward a viewer who inputs a correct answer or an event corresponding to information selected by the most viewers is executed. The event may be executed only for viewers who have selected the information selected by the most viewers.

In addition, the content processing server 22 may provide data according to the request of the broadcaster terminal 11, for example, if the broadcaster terminal 11 intends to play a game with the viewer terminal 12, the state data In accordance with the present invention, the data may be provided to the viewer terminal 12 or the game installed in the viewer terminal 12 may be controlled.

For example, when the broadcaster wants to play the 'OX game', the content processing server 22 does not have the 'OX game' installed in the viewer terminal 12, the viewer terminal 12 additionally displays the game from the state data. The identification information may be extracted to install a game selected by the broadcaster terminal 11. Accordingly, for example, the viewer terminal 12 may download the "OX game" from the content processing server 22 or the "OX game" through the third server based on the game identification information. The viewer terminal 12 may execute a game, and may receive a state of the executed game from the broadcaster terminal 11 through the broadcast server 21.

The broadcast server 21 and the content processing server 22 described above may be embodied as one server or as physically separated servers to communicate through the network N according to an embodiment.

The streaming device 20 composed of the above-described broadcast server 21 and content processing server 22 may be implemented as a server-client system. If the streaming device 20 is implemented as a server-client system, a client for interacting with a viewer or a broadcaster may be installed in the above-described user terminal 10, and the computing device capable of communicating through a network with the electronic terminal where the client is installed. The server can be implemented.

2 is a diagram illustrating a configuration of a streaming apparatus according to an embodiment. Referring to FIG. 2, the streaming apparatus 20 according to an embodiment includes a controller 210, a communication unit 220, and a memory 230.

The controller 210 controls the overall operation of the streaming device 20, and may include a processor such as a CPU. The controller 210 may control other components included in the streaming apparatus 20 to perform an operation corresponding to a user input received through an input / output unit (not shown).

For example, the controller 210 may execute a program stored in the memory 230, read a file stored in the memory 230, or store a new file in the memory 230.

The controller 210 described above will be described later in more detail with reference to FIG. 3.

Meanwhile, the communication unit 220 may perform wired or wireless communication with another electronic terminal or a network. To this end, the communication unit 220 may include a communication module supporting at least one of various wired and wireless communication methods. For example, the communication module may be implemented in the form of a chipset.

Wireless communication supported by the communication unit 220 may be, for example, Wi-Fi (Wireless Fidelity), Wi-Fi Direct, Bluetooth, UWB (Ultra Wide Band), or Near Field Communication (NFC). In addition, the wired communication supported by the communication unit 220 may be, for example, USB or High Definition Multimedia Interface (HDMI).

The communication unit 220 may transfer or acquire a streaming image, obtain a streaming image including the state data, or deliver a streaming image including the converted state data.

Meanwhile, various types of data such as files, applications, and programs may be installed and stored in the memory 230. The controller 210 may access and use data stored in the memory 230 or store new data in the memory 230. In addition, the controller 210 may execute a program installed in the memory 230. A program for performing a streaming method may be installed in the memory 230.

In addition, the streaming device 20 may include an input / output unit (not shown).

The input / output unit (not shown) may include an input unit for receiving an input from a user, and an output unit for displaying information such as a result of performing a task or a state of the streaming apparatus 20. For example, the input / output unit (not shown) may include an operation panel for receiving a user input and a display panel for displaying a screen.

In detail, the input unit may include devices capable of receiving various types of user input such as a keyboard, a physical button, a touch screen, a camera, or a microphone. In addition, the output unit may include a display panel or a speaker. However, the present invention is not limited thereto, and the input / output unit (not shown) may include a configuration supporting various input / output.

According to an embodiment, when the state data is received together with the streaming image through the input / output unit (not shown), the controller 210 executes a program stored in the memory 230 to perform a streaming method.

3 is a diagram illustrating a configuration of the controller 210 according to an embodiment.

As shown in FIG. 3, the controller 210 includes an image processor 310, a state converter 320, and a feedback processor 330.

The image processor 310 allows the image captured in real time to be streamed in real time through an input / output unit such as a camera.

The image processor 310 receives the broadcast from the broadcaster terminal that transmits the image, and delivers the broadcast to the viewer terminal for viewing the broadcast. The image processing unit 310 provides a real time delay to minimize the delay time between the broadcaster terminal's image transmission time and the viewer terminal image reception time. You can stream the video.

The state conversion unit 220 obtains state data together with the image, and converts the state data.

In this case, the state converter 220 may acquire the state data based on a format for obtaining the streaming image in order to obtain the state data together with the streaming image. For example, the state data may have the same format as the video format because the state data may be acquired along with the video signal.

In addition, the state converter 220 may extract the state data from the streaming video. For example, the acquired image data may include the state data as well as the image data transmitted by the broadcaster, and thus the state data may be extracted from the streaming image.

The state conversion unit 220 may convert the extracted state data to be delivered to the viewer terminal.

In addition, the state conversion unit 220 may convert the streaming video itself including the state data. That is, the state conversion unit 220 may generate a streaming video in which the state data is converted by converting the image as it is without extracting the state data from the image acquired with the state data.

At the time of conversion, the state switching unit 220 may convert the state data according to a format for supporting the video to be viewed by the viewer terminal viewing the streaming video. Accordingly, when the viewer receives the streaming video, the converted state data may be received in the streaming video, and the state data may be obtained at the time when the streaming video is synchronized with the streaming video.

Meanwhile, according to an exemplary embodiment, the state conversion unit 220 may obtain information about an event which the broadcaster wants to proceed according to the state data, and may set the condition for causing the event to be triggered by the feedback processor 230.

For example, when the broadcaster starts the 'survey', the state conversion unit 220 acquires the state data of the 'survey' cue sign or the state data of the identification information so that an event according to the 'survey' result is triggered. The feedback processor 230 may set an event identification condition, a triggering condition, and the like.

The feedback processor 230 obtains feedback data in response to the status data from the viewer.

In addition, the feedback processor 230 may process the feedback data to generate content processing information and provide the content processing information to the broadcaster terminal 11 or to execute an event according to triggering information corresponding to the content processing information.

The feedback processor 230 may store a condition for triggering a predetermined event. When the feedback data is acquired as a result of processing the feedback data, the feedback event may be executed.

For example, the feedback processor 230 may provide a reward to the viewer who inputs the correct answer, or may provide the viewer with a URL or a coupon corresponding to a selection input by a plurality of viewers.

The controller 210 may further include a state transmitter (not shown) and a state receiver (not shown).

The state transmitter (not shown) may insert the state data into the image photographed and generated by the broadcaster terminal 11 to be transmitted together.

On the other hand, when the state receiver (not shown) receives the image including the converted state data, the state receiver may extract the state data from the image and provide an interface corresponding to the extracted state data.

In this case, the interface is capable of interacting with the viewer, and may be implemented to provide content (for example, a UI, text, an image, a video, etc.) according to state data, and receive feedback from the viewer regarding the content. Such an interface may be implemented as, for example, a web view, a page of an application, or a layer displayed on an image being viewed, but is not limited to the above-described example.

The information obtained through the interface as described above may be provided to the feedback processor 330 as feedback data.

As described above, each configuration of the streaming device 20 may be implemented on elements constituting the streaming service system 100.

According to an embodiment, the configuration of the streaming device 20 may be implemented on the broadcast server 21 and the content processing server 22.

For example, the control unit 210, the communication unit 220, and the memory 230 are implemented on the broadcast server 21 and the content processing server 22, but the image processing unit 310 and the state conversion unit of the control unit 210 are provided. 320 may be implemented on the broadcast server 21 and the feedback processor 330 may be implemented on the content processing server 22.

According to another embodiment, the configuration of the streaming device 20 may be implemented on the broadcaster terminal 11, the viewer terminal 12, the broadcast server 21, and the content processing server 22.

For example, the input / output unit (not shown), the control unit 210, the communication unit 220 and the memory 230 are implemented on the broadcast server 21 and the content processing server 22, but the input and output unit (not shown) May be implemented over the broadcaster terminal 11 and the viewer terminal 12. In addition, the image processing unit 310 and the state conversion unit 320 of the control unit 210 may be implemented on the broadcast server 21, the feedback processing unit 330 on the content processing server 22, the control unit 210 The state transmitter (not shown) may be implemented on the broadcaster terminal 11 and the state receiver (not shown) may be implemented on the viewer terminal 12.

The streaming method according to the embodiment shown in FIG. 4 includes steps that are processed in time series in the streaming device 20 shown in FIGS. 1 to 3. Therefore, even if omitted below, the above descriptions of the streaming device 20 shown in FIGS. 1 to 3 may be applied to the streaming method according to the embodiment shown in FIG. 4.

Referring to FIG. 4, the streaming apparatus 20 may acquire a streaming image (S410).

In this case, if the streaming data 20 does not include the state data in the obtained streaming video, the streaming device 20 may provide the streaming video to the viewer (S430), and may end.

On the other hand, the streaming device 20 may obtain a streaming video including the state data (S420).

In this case, the streaming device 20 may acquire the state data based on a format for obtaining the streaming video. In addition, the streaming device 20 may obtain the state data by extracting the state data from the streaming video.

When the streaming data obtained as described above includes the state data, the streaming device 20 may generate a streaming image in which the state data is converted (S440), and provide the viewer with a streaming image including the converted state data (S440). S450).

In this case, the streaming device 20 may convert the state data obtained together with the streaming video, and convert the state data into the same format as that for providing the streaming video to the viewer.

Meanwhile, the streaming method according to an embodiment will be described with reference to FIG. 5. At this time, the steps having the same reference numerals as those in FIG. 4 are identical to those in FIG. 4, and thus description thereof will be omitted.

As illustrated in FIG. 5, the streaming apparatus 20 may obtain feedback data in response to providing the viewer with a streaming image including the converted state data (S450) (S510).

In this case, the streaming device 20 may obtain a viewer input as feedback data. If there is no viewer input, the streaming device 20 may process that the feedback data has not been obtained. Alternatively, if there is no viewer input, the streaming device 20 may process, for example, inputting an incorrect answer in the case of a quiz game, or input a predetermined value to obtain the incorrect answer or the predetermined value as feedback data. have.

The streaming device 20 may process the feedback data to provide the processed content processing information to the broadcaster or the viewer, or to trigger an event corresponding to the content processing information.

First, the broadcast server 21 may receive an image captured in real time by the broadcaster terminal 11 from the broadcaster terminal 11 by streaming, and may transmit the received image data to the viewer terminal 12.

At this time, the broadcaster terminal 11 can record the broadcast video in real time and transmit it to the viewer terminal 12 through the broadcast server 21 while playing the game with the viewer. The game list may be provided, and one of the games may be selected.

That is, the broadcaster of the broadcaster terminal 11 can start the quiz game if you want to proceed with the quiz game with the viewer of the viewer terminal 12. For example, a broadcaster may want to run a quiz show live, and may want to give a prize to a viewer who has solved a predetermined number or more of problems.

Thereafter, the broadcaster terminal 11 may transmit the state data regarding the quiz to the broadcast server 21 along with the streamed video data (S610).

For example, the broadcaster terminal 11 may transmit the state data including the game identification information of the 'OX game' selected by the user during the broadcast and the start information which is the start signal of the game together with the streamed video data. Can be.

Therefore, when the state of the game progress in the broadcaster terminal 11 is changed (for example, OX game start, OX game question, correct answer announcement, etc.), the status data for this is transmitted to the broadcast server 21 together with the video and audio. Can be.

In this case, according to an embodiment, the state data may be transmitted in the same manner as the text information transmitted together with the streamed video data.

In addition, the broadcast server 21 may provide the state data generated by the broadcaster terminal 11 while streaming the video data received from the broadcaster terminal 11 to the viewer terminal 12 (S620).

For example, the broadcast server 11 may convert the state data of the game received according to the transmission protocol according to the reception protocol. For example, when the broadcasting server 11 transmits a broadcast using the RTMP protocol and receives a broadcast using the HLS protocol, the data transmitted from the transmitting side is in AMF format. Can convert to format

Thereafter, the viewer terminal 12 may identify the state data in the data received together with the image data streamed from the broadcast server 21, and the image of the time stamp corresponding to the state data is displayed on the viewer terminal 12. At this point, an event corresponding to the state data may be triggered.

For example, the viewer terminal 12 may analyze the state of the game by analyzing the state data of the game entered with the image. Accordingly, the viewer terminal 12 may receive and reproduce the image captured and broadcast by the broadcaster terminal 11 by streaming, and the broadcaster of the broadcaster terminal 11 executes the 'OX game' in the video based on the state data. You can play 'OX Game' in synchronization with the visual point of time. The viewer terminal 12 may be provided with an interface for inputting a correct answer in the "OX game".

7 is a view for explaining an example of a screen displayed through the screen of the electronic terminal implemented by the viewer terminal 12.

As illustrated in FIG. 7, during a predetermined period of time during which a broadcaster can enter an answer after asking a question, an interface 700 may be displayed in which the viewer can enter an answer that he or she thinks.

The viewer terminal 12 may obtain a user input for the game controlled by the broadcaster terminal 11, and transmit the obtained user input to the content processing server 22 as feedback data (S630).

For example, the viewer terminal 12 may receive input from the user in response to the OX problem provided to the user, and transmit the input value to the content processing server 22.

Thereafter, the content processing server 22 may provide a result of the user input received from the viewer terminal 12 to the broadcaster terminal 11 (S640).

Therefore, for example, when the correct answer is input in the viewer terminal 12, the broadcaster terminal 11 can immediately know the information input by the viewer using existing socket communication.

According to an embodiment, the content processing server 22 may transmit a user input received from the viewer terminal 12 to at least one of the broadcaster terminal 11 or the broadcast server 21 to trigger an event for the user input. have.

According to another embodiment, the content processing server 22 may process the user input received from the viewer terminal 12 to trigger an event for the user input, and provide the event triggering result to the broadcaster terminal 11. can do.

To this end, the content processing server 22 or the broadcasting server 21 may store the correct answer that matches the intention of the broadcaster, or may store information about an event to be triggered according to the input answer.

For example, when the content processing server 22 transmits an answer received from the viewer terminal 12 to the broadcast server 21, the broadcast server 21 determines whether the answer input by the user is correct, and thus the broadcaster. The terminal 11 and / or the viewer terminal 12 may be provided. In addition, the content processing server 22 may trigger an event according to a user's input response.

Alternatively, for example, the content processing server 220 may process an answer received from the viewer terminal 12 to trigger an event and provide the triggered result to the broadcaster terminal 11 and / or the viewer terminal 12. .

For example, when the content processing server 22 transmits an answer received from the viewer terminal 12 to the broadcaster terminal 11, the broadcaster terminal 11 may determine whether the answer is correct. have. In addition, the content processing server 22 may trigger an event according to a user's input response according to a determination result of the broadcaster.

Or, for example, when the content processing server 22 receives an answer from the plurality of viewer terminals 12, the content is grouped and sorted to provide the most inputted answer to the broadcaster terminal 11, or corresponding to the answer. Can trigger the event.

In addition, the content processing server 22 may provide content processing information according to a user input to the viewer terminal 12.

For example, the viewer terminal 12 may display a screen displaying whether the user answers the OX Quid based on the response information.

For example, the content processing server 22 may provide the coupon to the viewer terminal 12 if the user can receive the coupon according to the user's input.

8 is a diagram illustrating an example of a screen displayed through a screen of an electronic terminal implemented by the viewer terminal 12.

As illustrated in FIG. 8, when the viewer who inputs the answer is correct, the coupon 800 may be provided as a reward.

According to the prior art, if the broadcaster wants to proceed with the 'OX game', even if the broadcaster mentions that the correct answer for the OX quiz is X and then X is set to be correctly processed, the viewer is in a state data due to the delay time of the video. In most cases, the first inquiry and the video are viewed, but according to the embodiment disclosed in the present specification, since the viewer receives the state data and the video at the same time, the problem caused by the asynchronous method does not occur. .

Therefore, according to one embodiment described in the present specification, when the content that the broadcaster wants to proceed with the viewer is a game such as OX quiz, multiple choice quiz, word matching, survey, roulette, etc. It can synchronize between viewers, synchronize the broadcaster's game progress with the image viewed by the viewer, and provide the viewer with a reward for the game according to the results of the viewer's reaction to the game.

In addition, according to an embodiment described in the present specification, when the broadcaster wants to proceed with the viewers as a commerce advertisement, and the content that pays a discount coupon immediately through a questionnaire / voting or the like for a product to be discounted during live streaming, the commerce advertisement Collecting a plurality of viewers' response to the broadcaster to inform the broadcaster of the results, according to the result can be executed an event that pays at least some of the viewers discount coupons, which can be synchronized with the video progressed by the broadcaster .

In addition, according to one embodiment described herein as a content that the broadcaster wants to proceed with the viewer, there is a large number of information selected by the viewer in accordance with the question / vote during live streaming and the broadcaster who appears in the broadcast proceeds according to the selected information In the case of content to be collected, a plurality of viewers' responses to the broadcast may be collected to inform the broadcaster of the result, and if there is an event whose condition is a condition, the corresponding event may be triggered.

According to the streaming method disclosed herein, an image transmitted by the broadcaster and an image received by the viewer in the above-described example may be synchronized.

The term '~' used in the above embodiments refers to software or a hardware component such as a field programmable gate array (FPGA) or an ASIC, and '~' serves a part. However, '~' is not meant to be limited to software or hardware. '~ Portion' may be configured to be in an addressable storage medium or may be configured to play one or more processors. Thus, as an example, '~' means components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, and the like. Subroutines, segments of program patent code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.

The functionality provided within the components and 'parts' may be combined into a smaller number of components and 'parts' or separated from additional components and 'parts'.

In addition, the components and '~' may be implemented to play one or more CPUs in the device or secure multimedia card.

The streaming method according to an embodiment may also be implemented in the form of a computer readable medium for storing instructions and data executable by a computer. In this case, the command and data may be stored in the form of program code, and when executed by the processor, a predetermined program module may be generated to perform a predetermined operation. In addition, computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer readable medium may be a computer recording medium, which is volatile and non-implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Both volatile, removable and non-removable media may be included. For example, computer recording media may be provided via magnetic storage media such as HDDs and SSDs, optical recording media such as CDs, DVDs and Blu-ray discs, or may be accessible via a network. It may be a memory included in the server.

In addition, the streaming method according to an embodiment may be implemented as a computer program (or computer program product) including instructions executable by a computer. The computer program includes programmable machine instructions processed by the processor and may be implemented in a high-level programming language, an object-oriented programming language, an assembly language, or a machine language. . The computer program may also be recorded on tangible computer readable media (eg, memory, hard disks, magnetic / optical media or solid-state drives, etc.).

Accordingly, the streaming method according to an embodiment may be implemented by executing the computer program as described above by the computing device. The computing device may include at least a portion of a processor, a memory, a storage device, a high speed interface connected to the memory and a high speed expansion port, and a low speed interface connected to the low speed bus and the storage device. Each of these components are connected to each other using a variety of buses and may be mounted on a common motherboard or otherwise mounted in a suitable manner.

Here, the processor may process instructions within the computing device, such as to display graphical information for providing a graphical user interface (GUI) on an external input, output device, such as a display connected to a high speed interface. Instructions stored in memory or storage. In other embodiments, multiple processors and / or multiple buses may be used with appropriately multiple memories and memory types. The processor may also be implemented as a chipset consisting of chips comprising a plurality of independent analog and / or digital processors.

The memory also stores information within the computing device. In one example, the memory may consist of a volatile memory unit or a collection thereof. As another example, the memory may consist of a nonvolatile memory unit or a collection thereof. The memory may also be another form of computer readable medium, such as a magnetic or optical disk.

In addition, the storage device can provide a large amount of storage space to the computing device. The storage device may be a computer readable medium or a configuration including such a medium, and may include, for example, devices or other configurations within a storage area network (SAN), and may include a floppy disk device, a hard disk device, an optical disk device, Or a tape device, flash memory, or similar other semiconductor memory device or device array.

The above-described embodiments are for illustrative purposes, and those of ordinary skill in the art to which the above-described embodiments belong may easily change to other specific forms without changing the technical spirit or essential features of the above-described embodiments. I can understand. Therefore, it is to be understood that the above-described embodiments are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope to be protected by the present specification is represented by the following claims rather than the above description, and should be construed to include all changes or modifications derived from the meaning and scope of the claims and their equivalents. .

Claims

As a streaming device for streaming video in real time,

Communication unit for obtaining a streaming video; And

And a controller configured to convert the state data acquired together with the streaming video, to provide the converted state data together with the streaming video, and to obtain feedback data in response to the provision of the state data.
The method of claim 1,

The control unit,

And obtaining the state data based on a format for obtaining the streaming video.
The method of claim 1,

The control unit,

And obtaining the state data by extracting the state data from the streaming video.
The method of claim 1,

The control unit,

And converting the state data acquired together with the streaming video into the same format as that for providing the streaming video.
The method of claim 1,

The state data,

Streaming device comprising a time stamp to be synchronized with the streaming video.
The method of claim 1,

The control unit,

And the content processing information processed by processing the feedback data is provided to the broadcaster of the streaming video.
The method of claim 1,

The control unit,

And generating an event based on the processed content processing information by processing the feedback data.
A streaming device for streaming an image in real time, the method for streaming the image,

Obtaining a streaming video;

Converting the state data acquired with the streaming video;

Providing the converted state data together with the streaming video; And

Obtaining feedback data in response to the provision of the state data.
The method of claim 8,

Acquiring the streaming video,

Obtaining the state data based on a format for acquiring the streaming video.
The method of claim 8,

Acquiring the streaming video,

And obtaining the state data by extracting the state data from the streaming video.
The method of claim 8,

Converting the state data,

And converting the state data acquired together with the streaming video into the same format as the format for providing the streaming video.
The method of claim 8,

The state data,

Streaming method comprising a timestamp to be synchronized with the streaming video.
The method of claim 8,

The streaming method,

And providing content processing information processed by processing the feedback data to a broadcaster of the streaming video.
The method of claim 8,

The streaming method,

And generating an event based on the processed content processing information by processing the feedback data.
A computer-readable recording medium having recorded thereon a program for performing the method of claim 8.