WO2013133477A1

WO2013133477A1 - System and method for providing real-time multi-language caption service for online live broadcast

Info

Publication number: WO2013133477A1
Application number: PCT/KR2012/002892
Authority: WO
Inventors: 전정환; 정지돈; 김규훈; 박웅권; 김준영; 김태균; 유진호
Original assignee: Jeon Jeong-Hwan; Jung Ji-Don; Kim Kyu-Hoon; Park Woomg-Kwon; Kim Joon-Young; Kim Tae-Kyun; Yoo Jin-Ho
Priority date: 2012-03-05
Filing date: 2012-04-17
Publication date: 2013-09-12
Also published as: KR101192207B1

Abstract

The present invention relates to a system and method for providing a real-time multi-language caption service for an online live broadcast and provides a system and method for providing a real-time multi-language caption service for an online live broadcast that may service multi-language captions optimized to each content item by an interpreter simultaneously with the adjusting of a sync rate by region. To that end, a system for providing a real-time multi-language caption service for an online live broadcast according to the present invention includes: an encoder receiving a broadcast signal from a broadcast center and converting the signal into protocols corresponding to a plurality of viewer terminals; a streaming server transmitting a converted packet; a caption service web server including a plurality of edge servers and delaying the packet transmitted from the streaming server by a time that is set by the edge servers; and a plurality of interpreter terminals receiving the packet from one of the plurality of edge servers in real time without a delay and receiving multi-language captions that are translations made by interpreters by using languages set for a broadcast corresponding to the received packet, wherein the caption service web server may transmit, to the plurality of viewer terminals corresponding to each edge server, multi-language captions input in real time from the plurality of interpreter terminals, together with the delayed packet. The present invention having such a configuration has the effect that it is possible to enhance the accuracy of multi-language captions that match with content and regional characteristics.

Description

Real-time Multilingual Subtitle Service System and Online Method for Online Live Broadcasting

The present invention relates to a real-time multilingual subtitle service system for online live broadcasting and a method thereof. In particular, it is possible to selectively delay the broadcast in consideration of the Internet environment of local viewers around the world and to improve the accuracy of multilingual subtitles by an interpreter. A real-time multilingual subtitle service system for online live broadcasting, and a method thereof.

The development of the Internet environment has made it easier to access information around the world, and users are increasingly in need of more information. In response to this demand, many translation programs and services are emerging to provide information on countries with different languages.

In particular, with the development of mobile communication, anytime, anywhere access to the Internet has emerged a service providing real-time translated subtitles on the Internet. There is a service that provides text broadcasting for major events occurring around the world. However, these services do not provide more information to users because they exclude video by focusing on real-time relaying. Furthermore, the information is provided in real time because the service provider who received the incident has been translated and distributed online. There is a problem that can not be.

Recently popular YouTube video service is a service that provides a variety of videos produced by people around the world or personally produced, if a user uploads multi-language translated subtitles to solve language barriers, video and subtitle files The combined and reproduced files can provide multilingual subtitles according to a video. However, since the multilingual subtitle service is generally translated according to an automatic translation system or personal inclination, the translation success rate for various expressions is very low, and furthermore, the error probability of translation is very high because it is based on the sound included in the video. In addition, because the dialect, dialect, and historical background do not vary the information of different languages, the expression is somewhat unnatural even when correctly translated.

In order to solve the above problems of the prior art, the present invention provides a real-time multilingual subtitle service system for online live broadcasting that can adjust the sync rate for each region and simultaneously provide subtitles optimized for each content by an interpreter and multilingual services. To provide a method.

The present invention for solving the above problems is to set the delay time for each region to adjust the sync according to the Internet environment of viewers around the world in consideration of the specificity of online live broadcasting. In particular, due to the nature of online live broadcasting in real time, it takes time for simultaneous interpretation, so the broadcast is transmitted in consideration of the delay time. That is, by setting different delay times for edge servers disposed in each region in order to achieve an accurate sync rate for each region, viewers who watch live broadcast content can watch a delayed live broadcast within about 10 seconds with multilingual subtitles.

In addition, by providing a subtitle service with a real-time interpretation concept rather than a mechanical translation, translations are provided in real time through simultaneous interpreters for each country to improve the accuracy of multilingual subtitles. It provides a multilingual subtitle service optimized for various contents of the company, and in particular, provides a fully translated multilingual subtitle service based on preliminary investigation and background of the corresponding content. To this end, simultaneous interpreters are provided without delay.

In one embodiment, a real-time multilingual subtitle service system for online live broadcasting includes: an encoder for receiving a broadcast signal from a broadcasting center and converting the broadcast signal into a protocol corresponding to a plurality of viewer terminals; A streaming server for transmitting the converted packet; A caption service web server including a plurality of edge servers and delaying a packet transmitted from the streaming server according to a time set for each of the plurality of edge servers; And a plurality of interpreter terminals for receiving the packets in real time without delay from one of the plurality of edge servers, and receiving multi-language subtitles translated into a language set for a broadcast corresponding to the received packets by an interpreter in real time. The subtitle service web server may include multilingual subtitles input in real time from the plurality of interpreter terminals together with the delayed packets to the plurality of viewer terminals corresponding to the respective edge servers.

In one embodiment, the encoder may convert the broadcast signal received from the broadcast center into a Real Time Messaging Protocol (RTMP) protocol.

In addition to the above, the encoder may include an H.264 / AAC codec.

In another embodiment, the streaming server may be a Wowza streaming server.

In another embodiment, the edge server may be a Real Time Streaming Protocol (RTSP) server, an HTTP Live Streaming (HLS) server, or an IPTV server.

In one embodiment, the caption service web server, a database that stores user information for the plurality of interpreter terminal; And setting a delay time of the plurality of edge servers, searching for whether the plurality of interpreter terminals are registered users in the database, and when the registered users are registered, multilingual subtitles input from the plurality of interpreter terminals. It may further include a control unit for controlling to transmit to.

In addition to the above, each of the plurality of edge servers, the packet receiving unit for receiving a packet from the streaming server; A delay controller configured to delay the packet according to a delay time set by the controller and to transmit the packet to the viewer terminal together with the multilingual subtitles input in real time; A temporary storage unit temporarily storing the packet to delay the packet; And a packet transmitter configured to transmit a packet delayed in response to the broadcast and the real-time multilingual subtitles to the plurality of viewer terminals.

In one embodiment, the viewer terminal, the streaming viewer for displaying a broadcast corresponding to the delayed packet received; And a chat viewer in which the multilingual subtitles transmitted in real time are displayed in a language set by the viewer.

In one embodiment, each of the plurality of interpreter terminal, the input unit for inputting a multilingual subtitle translated by the interpreter in a set language; A chat module for converting the input multilingual subtitles to be displayed in a chat viewer of the viewer terminal; A storage unit storing a lexical dictionary for the set language; And a typo correcting unit for checking and correcting the input multilingual subtitle according to the vocabulary dictionary of the storage unit.

In addition, the present invention provides a real-time multi-language subtitle service method for online live broadcasting in which a media server including a plurality of edge server and a streaming server serves a multi-language subtitle translated from a plurality of interpreter terminals to a plurality of viewer terminals in relation to broadcasting to provide.

In one embodiment, a receiving step of receiving a broadcast signal from a broadcasting center and converting it into a protocol corresponding to the plurality of viewer terminals; A delay step of delaying the converted broadcast signal to be transmitted to the plurality of viewer terminals according to a time set for each of the plurality of edge servers; An input step of transmitting the broadcast signal to the plurality of interpreter terminals in real time without delay and inputting, in real time, a multilingual subtitle translated into a language set for the broadcast by an interpreter; Transmitting the delayed broadcast signal to the plurality of viewer terminals corresponding to the respective edge servers, and simultaneously transmitting multilingual subtitles input from the plurality of interpreter terminals to the plurality of viewer terminals. have.

The present invention may further include a setting step of setting a delay time of the broadcast signal for each of the plurality of edge servers.

In an embodiment, the receiving step may include an encoding step of converting a broadcast signal received from the broadcasting center into a Real Time Messaging Protocol (RTMP) protocol.

In addition to the above, the input step may include a correcting step of checking and correcting the input multilingual subtitle according to a lexical dictionary stored.

The present invention may further include a display step in which each of the plurality of viewer terminals displays the delayed broadcast and simultaneously displays the real-time transmitted multilingual subtitles in a language set by the viewer.

Real-time multi-language subtitle service system and method for online live broadcasting according to the present invention by delaying the selective transmission of the broadcasting in consideration of the characteristics of online live broadcasting and the global Internet environment by region, and simultaneously transmitting the multilingual subtitles translated by an interpreter, There is an effect that can improve the accuracy of the multilingual subtitles to suit the characteristics of each content and region.

In addition, the present invention improves the accuracy of multilingual subtitles so that service users can view content provided from all over the world in real time, thereby overcoming the limitation of viewing due to time and regional differences.

In addition, the present invention enables the service user to watch a variety of contents provided by different language countries without language barriers by improving the accuracy of multilingual subtitles, thereby diversifying the selection of contents and satisfying the wide demands of the service users. have.

1 is a schematic diagram of a real-time multilingual subtitle service system for online live broadcasting according to an embodiment of the present invention.

FIG. 2 is a detailed block diagram of the caption service web server of FIG. 1.

3 is a detailed block diagram of the edge server of FIG.

4 is a view illustrating a display state of the viewer terminal of FIG. 1.

5 is a detailed block diagram of the interpreter terminal of FIG. 1.

6 is a flowchart of a real-time multilingual subtitle service method for online live broadcasting according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention.

First, a real-time multilingual subtitle service system for online live broadcasting according to an embodiment of the present invention will be described with reference to FIGS. 1 to 5.

The real-time multilingual subtitle service system 10 includes a broadcasting center 100 for transmitting a broadcast, a media server 200 for providing a multilingual translation subtitle service, and a plurality of viewer terminals 300 for receiving delayed broadcasting and multilingual translation subtitles in real time. It may include a plurality of interpreter terminal 400 is input multi-language subtitles for the broadcast, and a plurality of viewer terminal 300 for receiving the multi-language subtitles in real time.

The real-time multilingual subtitle service system 10 classifies users according to access terminals and determines delay times in order to adjust regional syncs. That is, the broadcaster provides the broadcast without delay to the interpreter terminal 400 for translating the broadcast into multiple languages, and provides the delayed broadcast according to a preset time for each region to the viewer terminal 300 which is a general viewer. Here, the multilingual subtitle service input from the interpreter terminal 400 by the simultaneous interpreter is transmitted to the viewer terminal 300 which is a general viewer in a manner similar to the one-way chat.

The broadcast center 100 produces and transmits a broadcast registered in advance in the media server 200. The broadcast center 100 does not mean only a general broadcasting station, but may include a video produced by a general user and distributed to the Internet.

The media server 200 is a main component of a real-time multilingual subtitle service system for online live broadcasting. The media server 200 includes a broadcast receiver 210 for receiving a broadcast signal from the broadcast center 100 and an encoder for converting the received broadcast signal into a packet having a predetermined format. 220, the streaming server 230 for transmitting the converted packet, and delays the packet corresponding to the broadcast according to the set time to the viewer terminal 300 and transmits the multilingual subtitles received from the interpreter terminal 400 in real time. It may include a subtitle service web server 240 to transmit to the viewer terminal (300).

The broadcast receiver 210 receives a broadcast signal transmitted from the broadcast center 100. The broadcast receiver 210 may receive a broadcast signal by any wireless or wired communication method.

The encoder 220 receives a broadcast signal from the broadcast center 100, converts the broadcast signal into a protocol corresponding to the plurality of viewer terminals 300, and may include an H.264 / AAC codec. Therefore, the encoder 220 may code the broadcast signal received in real time from the broadcast center 100 with the H.264 / AAC codec to enable playback on the viewer terminal 300 configured with any device. Here, the broadcast video is H.264 with a very high data compression rate, and the voice for the broadcast is converted to H.264 by converting it to AAC (Advanced Audio Coding), which is a basic audio format used by Apple's iPhone, iPod, and iTunes. / AAC packet can be generated. Such a packet may be converted to a Real Time Messaging Protocol (RTMP) protocol and transmitted to the streaming server 230.

The streaming server 230 may receive a packet from the encoder 220 by a standard video streaming protocol such as RTSP or HLS and transmit it to the subtitle service web server 240. Here, the streaming server 230 may be a Wowza streaming server. The streaming server 230 is ready to receive the H.264 / AAC packet converted by the encoder 220 in real time to transmit the protocol for each device, as will be described later, optionally a plurality of edge servers The packet may be sent to 250.

As described below with reference to FIG. 2, the subtitle service web server 240 may delay a packet transmitted from the streaming server 230 according to a time set for each of the plurality of edge servers 250. The subtitle service web server 240 may transmit a multilingual subtitle input in real time from the interpreter terminal 400 to the plurality of viewer terminals 300 corresponding to each edge server 250 together with the delayed packet.

In addition, the subtitle service web server 240 provides a chat module 420 including a chat program to the interpreter terminal 400, and the chat program can be input only by a registered user. The user cannot input.

In addition, the caption service web server 240 transmits a JW player capable of receiving and watching broadcasts, and a Wowza chat module for multilingual caption input and caption viewing to the viewer terminal 300 and the interpreter terminal 400.

FIG. 2 is a detailed block diagram of the caption service web server of FIG. 1.

The caption service web server 240 may include a plurality of edge servers 250 having delay times set, a controller 224 for setting delay times of the plurality of edge servers 250, and a database 246 storing registered user information. It may include.

The plurality of edge servers 250 may be configured in various forms according to the local environment of the country in which it is installed and services provided. For example, an RTSP server, an HLS server, or an Internet protocol having the same protocol as the Wowza streaming server may be used. It may be an IPTV server that provides digital television service.

As shown in FIG. 1, the plurality of edge servers 250 operate in a user mode for transmitting a delayed packet to the viewer terminal 300 and in a manager mode for transmitting a packet without delay to the interpreter terminal 400. Can be. For example, any one of the plurality of edge servers 250 operates in the manager mode, and may transmit packets transmitted from the streaming server 230 to the plurality of interpreter terminals 400 in real time without delay. In addition, the other edge server 250 operates in a user mode, and may delay the packet transmitted from the streaming server 230 according to a set time and then transmit the packet to a plurality of viewer terminals 300.

3 is a detailed block diagram of the edge server of FIG.

Each of the plurality of edge servers 250 includes a packet receiver 252 for receiving a packet from the streaming server 230, a delay controller 254 for controlling the packet to be delayed according to a set time, and a temporary storage unit for temporarily storing the packet. 256, and a packet transmitter 258 for transmitting the delayed packet to the viewer terminal 300.

The packet receiver 252 may receive a packet transmitted from the streaming server 230 according to the format of the edge server 250. The packet receiver 252 may be configured to receive a packet in a manner corresponding to the service format of the edge server 250.

The delay control unit 254 delays the received packet according to the delay time set by the control unit 224 of the subtitle service web server 240. For example, the delay control unit 254 may perform a designated time from the first packet received from the streaming server 230. The packet may be controlled to be stored in the temporary storage unit 256.

In addition, the delay controller 254 may control to transmit the packet stored in the temporary storage unit 256 to the viewer terminal 300 together with the multilingual subtitles input in real time from the interpreter terminal 400.

The temporary storage unit 256 temporarily stores a packet to be delayed under the control of the delay controller 254, and may be, for example, a cache or a queue.

The packet transmitter 258 may transmit a real-time multilingual subtitle transmitted in real time from the interpreter terminal 400 to the plurality of viewer terminals 300 together with the packet delayed in response to the broadcast. The packet receiver 252 may be configured to transmit a packet in a manner corresponding to the service format of the corresponding edge server 250 and the device type of the viewer terminal 300.

The edge server 250 may store the packet for a predetermined time from the first packet received from the streaming server 230 in the temporary storage unit 256 and transmit the packet to the plurality of viewer terminals 300. The 300 may receive an image of a broadcast transmitted from the broadcasting center 100 after a predetermined time.

As illustrated in FIG. 2, the controller 224 may set delay times of the plurality of edge servers 250. Here, the delays for the plurality of edge servers 250 may be determined based on country statistics for each viewer terminal 300. Since there is a different delay time between the subtitle service web server 240 and the viewer country, the edge server ( Per country). The delay time can be set in seconds.

In addition, when the interpreter terminal 400 accesses the caption service web server 240, the controller 224 searches whether the connected interpreter terminal 400 is a user registered in the database 246, and the search result is registered. In the case of a user, for example, when the user of the interpreter terminal 400 is an authorized simultaneous interpreter, the multilingual subtitles input from the interpreter terminal 400 may be controlled to be transmitted to the plurality of edge servers 250.

The database 246 stores user information that can be input using a chat program as described below. For example, the database 246 may include registered interpreter information as user information for a plurality of interpreter terminals 400.

As illustrated in FIG. 1, the viewer terminal 300 may access a caption service web server 240 and receive a broadcast selected in real time along with multilingual captions. The viewer terminal 300 may select a multilingual subtitle service provided by the subtitle service web server 240 in a language desired by the viewer. Here, the broadcast selected by the viewer terminal 300 is not limited to a general broadcast program such as a drama, but may be various types of videos provided by the subtitle service web server 240.

4 is a view illustrating a display state of the viewer terminal of FIG. 1.

The viewer terminal 300 may include a streaming viewer 302 in which an image of a broadcast to be watched is displayed, and a chat viewer 304 in which multilingual subtitles corresponding to the image are displayed.

The streaming viewer 302 is executed by the JW player provided from the subtitle service web server 240, and may display an image of a broadcast corresponding to a delayed packet.

The chat viewer 304 is executed by the Wowza chat module provided from the subtitle service web server 240, and multilingual subtitles translated into a language set by a user may be displayed. Here, the chat viewer 304 may change its location according to the viewer's selection.

As illustrated in FIG. 1, the interpreter terminal 400 receives a packet in real time without delay from any one of the plurality of edge servers 250, and in a language set for broadcasting corresponding to the packet received by the simultaneous interpreter. The translated multilingual subtitles can be input in real time. For example, the simultaneous interpreter may translate the inputted language into the interpreter terminal 400 while watching the video of the broadcast executed by the JW player in real time without delay.

5 is a detailed block diagram of the interpreter terminal of FIG. 1.

Each of the plurality of interpreter terminals 400 includes an input unit 410 for inputting multilingual subtitles translated by a simultaneous interpreter, a chat module 420 for providing multilingual subtitles in a chat method, and a typo for correcting a typo of input multilingual subtitles. The correction unit 430 may include a storage unit 440 that stores a lexicon for translation.

The input unit 410 is an input device such as a keyboard provided in the interpreter terminal 400, and may be an input device supporting a language to be translated. The input unit 410 may input a multilingual subtitle translated by a corresponding simultaneous interpreter in a set language.

The chat module 420 may be provided from the subtitle service web server 240, and may convert the multilingual subtitles input by the simultaneous interpreter to be displayed in the chat viewer 304 of the viewer terminal 300 in a chat manner. Such a chat module 420 may be a Wowza chat module, and a simultaneous interpreter may input translated multilingual subtitles according to a chat program executed by the chat module 420. Here, since the chat program provided from the subtitle service web server 240 transmits the subtitles input in real time without delay, as a result, the simultaneous interpreter inputs the translated multilingual subtitles to the interpreter terminal 400. ) Can be displayed in the chat viewer 304.

The typo corrector 430 may check and correct a multilingual subtitle input from the input unit 410 according to a lexical dictionary of the storage unit 440. The typo correcting unit 430 automatically corrects a typo corresponding to a word among input subtitles translated by a simultaneous interpreter. Here, the correction of the typo is described as a typo correction for the word based on the lexicon stored in the storage unit 440, but is not limited to this, and is not limited to this, for the vocabulary such as the survey in response to the basic grammar of the language. You can also correct typos.

The storage unit 440 may store a lexical dictionary for a language set for the simultaneous interpreter. Here, the lexical dictionary is described as including only words for the language, but is not limited thereto and may include a basic grammar of the language.

In the present exemplary embodiment, the typo corrector 430 for correcting the input multilingual caption is described as being provided in the interpreter terminal 400, but the present invention is not limited thereto, and the caption for receiving the multilingual caption input from the interpreter terminal 400 is provided. It may be implemented in the service web server 240.

As a result, when the typo correcting unit 430 is provided in the interpreter terminal 400 or the subtitle service web server 240, the typo is corrected before the multilingual caption is transmitted to the viewer terminal 300. The terminal 300 receives only a multilingual subtitle in which a typo is corrected, and thus the viewer can watch only the multilingual subtitle in which the typo is corrected.

Hereinafter, a real time multilingual subtitle service method for online live broadcasting of the present invention will be described with reference to FIG. 6.

In FIG. 6, first, the media server 200 receives a broadcast signal transmitted from the broadcast center 100 and converts the broadcast signal into a format corresponding to a device suitable for the viewer terminal 300 such as a PC or a smart device. The converted broadcast signal is provided to the interpreter terminal 400 in real time without delay or is delayed according to a preset time. The simultaneous interpreter receiving the real-time broadcast is translated into a language set based on this, input to the interpreter terminal 400, and the multilingual subtitles input by the simultaneous interpreter are delivered to the media server 200 in real time. The media server 200 transmits the delayed broadcast signal to the viewer terminal 300 and simultaneously transmits the multilingual subtitles transmitted from the interpreter terminal 400 to the viewer terminal 300 in real time. As a result, viewers can watch subtitles optimized for a particular online live broadcast with the video in the desired language.

First, a setting for sinking may be performed for each region. In operation S601, a delay time of a broadcast signal to be provided to the viewer terminal 300 for each of the plurality of edge servers 250 may be set. Here, the delays for the plurality of edge servers 250 may be set based on country statistics for each viewer terminal 300. Since there is a different delay time between the subtitle service web server 240 and the viewer country, the edge server ( Per country). The delay time can be set in seconds.

Next, the broadcast signal may be received from the broadcast center 100 and converted into a protocol corresponding to the plurality of viewer terminals 300. In operation S602, a broadcast transmitted from the broadcast center 100 may be received. In this case, the received broadcast may include not only a broadcast transmitted from a general broadcasting station but also a video produced by a general user and distributed to the Internet. In operation S603, the broadcast signal received from the broadcast center 100 may be converted into a form according to the viewer terminal 300. Here, the broadcast signal may be converted into a packet and converted into an RTMP protocol.

Next, the broadcast signals to be transmitted to the plurality of viewer terminals 300 may be delayed according to the time set for each of the plurality of edge servers 250. In operation S604, the broadcast signal is delayed according to a set time. For example, the first packet received from the streaming server 230 may be temporarily stored and then transmitted to a plurality of viewer terminals 300. . As a result, the viewer terminal 300 may receive an image of a broadcast after a predetermined time. At the same time, in step S605, the broadcast signal may be transmitted in real time to the plurality of interpreter terminals 400 without delay.

Next, the multilingual subtitles translated into the language set for the broadcast by the simultaneous interpreter may be input in real time. In operation S606, the simultaneous interpreter may translate the multi-language subtitles through the interpreter terminal 400 by translating into a set language corresponding to the corresponding broadcast while watching the broadcast received in real time. At this time, the input multilingual subtitles are input in a chat method, and since the chat program provided from the subtitle service web server 240 transmits the input subtitles in real time without delay, the simultaneous interpreter translates to the interpreter terminal 400. The instant input of the multilingual subtitles may be displayed on the chat viewer 304 of the viewer terminal 300.

In step S607, the multilingual subtitles inputted by the simultaneous interpreter to the interpreter terminal 400 may be checked and corrected according to a stored lexical dictionary. In this case, the correction of the typo is not limited to the correction of the typo for the word based on the pre-stored lexical dictionary, and the typo for the vocabulary such as the survey may be corrected corresponding to the basic grammar of the corresponding language.

Next, the multi-language subtitles input from the plurality of interpreter terminals 400 are simultaneously transmitted to the plurality of viewer terminals 300 while transmitting the delayed broadcast signal to the plurality of viewer terminals 300 corresponding to the respective edge servers 250. Can transmit In operation S608, the interpreter terminal 400 may transmit the multilingual subtitles translated by the simultaneous interpreter to the subtitle service web server 240 in real time. In operation S609, the broadcast signal delayed for each edge server 250 may be transmitted to the plurality of viewer terminals 300, and at the same time, the multilingual subtitles input from the interpreter terminal 400 may be transmitted to the plurality of viewer terminals 300 in real time.

Next, the present invention may display a broadcast in which each of the plurality of viewer terminals 300 is delayed and simultaneously display the multilingual subtitles transmitted in real time in a language set by the viewer. In operation S610, the viewer terminal 300 may receive and display a delayed broadcast signal and simultaneously display a multilingual subtitle translated into a language according to the viewer's setting.

As such, the received broadcast is delayed and provided to the viewer terminal 300, while the delay is provided to the interpreter terminal 400 in real time, and the multilingual subtitles translated by the simultaneous interpreter are transmitted to the viewer terminal 300 in a chat manner. By receiving delayed broadcasts while providing in real time, viewers can watch online live broadcasts in real time through subtitles provided in a desired language.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited thereto, and various modifications can be made within the scope of the technical idea of the present invention, and it is obvious that the present invention belongs to the appended claims. Do.

The present invention can be applied to various types of real-time multilingual subtitle service systems and methods.

Claims

An encoder for receiving a broadcast signal from a broadcasting center and converting the broadcast signal into a protocol corresponding to a plurality of viewer terminals;

A streaming server for transmitting the converted packet;

A caption service web server including a plurality of edge servers and delaying a packet transmitted from the streaming server according to a time set for each of the plurality of edge servers; And

A plurality of interpreter terminals for receiving the packets in real time without delay from one of the plurality of edge servers, and receiving multi-language subtitles translated into a language set for a broadcast corresponding to the received packets by an interpreter in real time; But

The caption service web server transmits a multilingual subtitle input in real time from the plurality of interpreter terminals together with the delayed packet to the plurality of viewer terminals corresponding to each of the edge servers. system.
The method of claim 1,

The encoder converts a broadcast signal received from the broadcast center into a Real Time Messaging Protocol (RTMP) protocol, real-time multilingual subtitle service system for online live broadcasting.
The method of claim 2,

The encoder includes a H.264 / AAC codec, real-time multilingual subtitle service system for live online.
The method of claim 1,

The streaming server is a Wowza streaming server, real-time multilingual subtitle service system for online live broadcasting.
The method of claim 1,

The edge server is a Real Time Streaming Protocol (RTSP) server, HTTP Live Streaming (HLS) server or IPTV server, real-time multilingual subtitle service system for live online.
The method of claim 1,

The caption service web server,

A database storing user information on the plurality of interpreter terminals; And

Set delay times of the plurality of edge servers, search whether the plurality of interpreter terminals are registered users in the database, and when the registered users are registered, multilingual subtitles input from the plurality of interpreter terminals to the plurality of edge servers. A real-time multilingual subtitle service system for online live broadcasting, further comprising a control unit for controlling transmission.
The method of claim 6,

Each of the plurality of edge servers,

A packet receiver for receiving a packet from the streaming server;

A delay controller configured to delay the packet according to a delay time set by the controller and to transmit the packet to the viewer terminal together with the multilingual subtitles input in real time;

A temporary storage unit temporarily storing the packet to delay the packet; And

And a packet transmitter for transmitting the packet delayed in response to the broadcast and the real-time multilingual subtitles to the plurality of viewer terminals.
The method of claim 1,

The viewer terminal,

A streaming viewer displaying a broadcast corresponding to the delayed packet; And

And a chat viewer in which the multilingual subtitles transmitted in real time are displayed in a language set by a viewer.
The method of claim 8,

Each of the plurality of interpreter terminals,

An input unit for inputting multilingual subtitles translated by the interpreter in a set language;

A chat module for converting the input multilingual subtitles to be displayed in a chat viewer of the viewer terminal;

A storage unit storing a lexical dictionary for the set language; And

And a typo correcting unit configured to check and correct the input multilingual subtitle according to the lexical dictionary of the storage unit, the real-time multilingual subtitle service system for online live broadcasting.
In the real-time multi-language subtitle service method for online live broadcasting in which a media server including a plurality of edge server and a streaming server services a multi-language subtitle translated from a plurality of interpreter terminals to a plurality of viewer terminals in relation to the broadcast,

A receiving step of receiving a broadcasting signal from a broadcasting center and converting the broadcasting signal into a protocol corresponding to the plurality of viewer terminals;

A delay step of delaying the converted broadcast signal to be transmitted to the plurality of viewer terminals according to a time set for each of the plurality of edge servers;

An input step of transmitting the broadcast signal to the plurality of interpreter terminals in real time without delay and inputting in real time a multilingual subtitle translated into a language set for the broadcast by an interpreter; And

Transmitting the delayed broadcast signal to the plurality of viewer terminals corresponding to the respective edge servers, and simultaneously transmitting multilingual subtitles input from the plurality of interpreter terminals to the plurality of viewer terminals. Real-time multilingual subtitle service method for online live broadcasting.
The method of claim 10,

And a setting step of setting a delay time of the broadcast signal for each of the plurality of edge servers.
The method of claim 10,

The receiving step,

And converting a broadcast signal received from the broadcast center into a Real Time Messaging Protocol (RTMP) protocol.
The method of claim 10,

The input step,

And a correcting step of checking and correcting the input multilingual subtitles according to a lexical dictionary stored therein, the real-time multilingual subtitle service for online live broadcasting.
The method of claim 10,

And displaying the delayed transmission of each of the plurality of viewer terminals and simultaneously displaying the real-time transmission of the multilingual subtitles in a language set by the viewer.