WO2013133477A1 - Système et procédé de réalisation de service de sous-titrage multilingue en temps réel pour diffusion en ligne en direct - Google Patents

Système et procédé de réalisation de service de sous-titrage multilingue en temps réel pour diffusion en ligne en direct Download PDF

Info

Publication number
WO2013133477A1
WO2013133477A1 PCT/KR2012/002892 KR2012002892W WO2013133477A1 WO 2013133477 A1 WO2013133477 A1 WO 2013133477A1 KR 2012002892 W KR2012002892 W KR 2012002892W WO 2013133477 A1 WO2013133477 A1 WO 2013133477A1
Authority
WO
WIPO (PCT)
Prior art keywords
time
viewer
real
multilingual
packet
Prior art date
Application number
PCT/KR2012/002892
Other languages
English (en)
Korean (ko)
Inventor
전정환
정지돈
김규훈
박웅권
김준영
김태균
유진호
Original Assignee
Jeon Jeong-Hwan
Jung Ji-Don
Kim Kyu-Hoon
Park Woomg-Kwon
Kim Joon-Young
Kim Tae-Kyun
Yoo Jin-Ho
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jeon Jeong-Hwan, Jung Ji-Don, Kim Kyu-Hoon, Park Woomg-Kwon, Kim Joon-Young, Kim Tae-Kyun, Yoo Jin-Ho filed Critical Jeon Jeong-Hwan
Publication of WO2013133477A1 publication Critical patent/WO2013133477A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/222—Secondary servers, e.g. proxy server, cable television Head-end
    • H04N21/2223—Secondary servers, e.g. proxy server, cable television Head-end being a public access point, e.g. for downloading to or uploading from clients
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles

Definitions

  • the present invention relates to a real-time multilingual subtitle service system for online live broadcasting and a method thereof.
  • a real-time multilingual subtitle service system for online live broadcasting and a method thereof.
  • YouTube video service is a service that provides a variety of videos produced by people around the world or personally produced, if a user uploads multi-language translated subtitles to solve language barriers, video and subtitle files
  • the combined and reproduced files can provide multilingual subtitles according to a video.
  • the multilingual subtitle service is generally translated according to an automatic translation system or personal inclination, the translation success rate for various expressions is very low, and furthermore, the error probability of translation is very high because it is based on the sound included in the video.
  • the dialect, dialect, and historical background do not vary the information of different languages, the expression is somewhat unnatural even when correctly translated.
  • the present invention provides a real-time multilingual subtitle service system for online live broadcasting that can adjust the sync rate for each region and simultaneously provide subtitles optimized for each content by an interpreter and multilingual services. To provide a method.
  • the present invention for solving the above problems is to set the delay time for each region to adjust the sync according to the Internet environment of viewers around the world in consideration of the specificity of online live broadcasting.
  • the broadcast is transmitted in consideration of the delay time. That is, by setting different delay times for edge servers disposed in each region in order to achieve an accurate sync rate for each region, viewers who watch live broadcast content can watch a delayed live broadcast within about 10 seconds with multilingual subtitles.
  • a real-time multilingual subtitle service system for online live broadcasting includes: an encoder for receiving a broadcast signal from a broadcasting center and converting the broadcast signal into a protocol corresponding to a plurality of viewer terminals; A streaming server for transmitting the converted packet; A caption service web server including a plurality of edge servers and delaying a packet transmitted from the streaming server according to a time set for each of the plurality of edge servers; And a plurality of interpreter terminals for receiving the packets in real time without delay from one of the plurality of edge servers, and receiving multi-language subtitles translated into a language set for a broadcast corresponding to the received packets by an interpreter in real time.
  • the subtitle service web server may include multilingual subtitles input in real time from the plurality of interpreter terminals together with the delayed packets to the plurality of viewer terminals corresponding to the respective edge servers.
  • the encoder may convert the broadcast signal received from the broadcast center into a Real Time Messaging Protocol (RTMP) protocol.
  • RTMP Real Time Messaging Protocol
  • the encoder may include an H.264 / AAC codec.
  • the streaming server may be a Wowza streaming server.
  • the edge server may be a Real Time Streaming Protocol (RTSP) server, an HTTP Live Streaming (HLS) server, or an IPTV server.
  • RTSP Real Time Streaming Protocol
  • HLS HTTP Live Streaming
  • IPTV IPTV
  • the caption service web server a database that stores user information for the plurality of interpreter terminal; And setting a delay time of the plurality of edge servers, searching for whether the plurality of interpreter terminals are registered users in the database, and when the registered users are registered, multilingual subtitles input from the plurality of interpreter terminals. It may further include a control unit for controlling to transmit to.
  • each of the plurality of edge servers the packet receiving unit for receiving a packet from the streaming server;
  • a delay controller configured to delay the packet according to a delay time set by the controller and to transmit the packet to the viewer terminal together with the multilingual subtitles input in real time;
  • a temporary storage unit temporarily storing the packet to delay the packet;
  • a packet transmitter configured to transmit a packet delayed in response to the broadcast and the real-time multilingual subtitles to the plurality of viewer terminals.
  • the viewer terminal the streaming viewer for displaying a broadcast corresponding to the delayed packet received; And a chat viewer in which the multilingual subtitles transmitted in real time are displayed in a language set by the viewer.
  • each of the plurality of interpreter terminal the input unit for inputting a multilingual subtitle translated by the interpreter in a set language;
  • a chat module for converting the input multilingual subtitles to be displayed in a chat viewer of the viewer terminal;
  • a storage unit storing a lexical dictionary for the set language;
  • a typo correcting unit for checking and correcting the input multilingual subtitle according to the vocabulary dictionary of the storage unit.
  • the present invention provides a real-time multi-language subtitle service method for online live broadcasting in which a media server including a plurality of edge server and a streaming server serves a multi-language subtitle translated from a plurality of interpreter terminals to a plurality of viewer terminals in relation to broadcasting to provide.
  • An input step of transmitting the broadcast signal to the plurality of interpreter terminals in real time without delay and inputting, in real time, a multilingual subtitle translated into a language set for the broadcast by an interpreter; Transmitting the delayed broadcast signal to the plurality of viewer terminals corresponding to the respective edge servers, and simultaneously transmitting multilingual subtitles input from the plurality of interpreter terminals to the plurality of viewer terminals. have.
  • the present invention may further include a setting step of setting a delay time of the broadcast signal for each of the plurality of edge servers.
  • the receiving step may include an encoding step of converting a broadcast signal received from the broadcasting center into a Real Time Messaging Protocol (RTMP) protocol.
  • RTMP Real Time Messaging Protocol
  • the input step may include a correcting step of checking and correcting the input multilingual subtitle according to a lexical dictionary stored.
  • the present invention may further include a display step in which each of the plurality of viewer terminals displays the delayed broadcast and simultaneously displays the real-time transmitted multilingual subtitles in a language set by the viewer.
  • Real-time multi-language subtitle service system and method for online live broadcasting by delaying the selective transmission of the broadcasting in consideration of the characteristics of online live broadcasting and the global Internet environment by region, and simultaneously transmitting the multilingual subtitles translated by an interpreter, There is an effect that can improve the accuracy of the multilingual subtitles to suit the characteristics of each content and region.
  • the present invention improves the accuracy of multilingual subtitles so that service users can view content provided from all over the world in real time, thereby overcoming the limitation of viewing due to time and regional differences.
  • the present invention enables the service user to watch a variety of contents provided by different language countries without language barriers by improving the accuracy of multilingual subtitles, thereby diversifying the selection of contents and satisfying the wide demands of the service users. have.
  • FIG. 1 is a schematic diagram of a real-time multilingual subtitle service system for online live broadcasting according to an embodiment of the present invention.
  • FIG. 2 is a detailed block diagram of the caption service web server of FIG. 1.
  • FIG. 3 is a detailed block diagram of the edge server of FIG.
  • FIG. 4 is a view illustrating a display state of the viewer terminal of FIG. 1.
  • FIG. 5 is a detailed block diagram of the interpreter terminal of FIG. 1.
  • FIG. 6 is a flowchart of a real-time multilingual subtitle service method for online live broadcasting according to an embodiment of the present invention.
  • FIG. 1 is a schematic diagram of a real-time multilingual subtitle service system for online live broadcasting according to an embodiment of the present invention.
  • the real-time multilingual subtitle service system 10 includes a broadcasting center 100 for transmitting a broadcast, a media server 200 for providing a multilingual translation subtitle service, and a plurality of viewer terminals 300 for receiving delayed broadcasting and multilingual translation subtitles in real time. It may include a plurality of interpreter terminal 400 is input multi-language subtitles for the broadcast, and a plurality of viewer terminal 300 for receiving the multi-language subtitles in real time.
  • the real-time multilingual subtitle service system 10 classifies users according to access terminals and determines delay times in order to adjust regional syncs. That is, the broadcaster provides the broadcast without delay to the interpreter terminal 400 for translating the broadcast into multiple languages, and provides the delayed broadcast according to a preset time for each region to the viewer terminal 300 which is a general viewer.
  • the multilingual subtitle service input from the interpreter terminal 400 by the simultaneous interpreter is transmitted to the viewer terminal 300 which is a general viewer in a manner similar to the one-way chat.
  • the broadcast center 100 produces and transmits a broadcast registered in advance in the media server 200.
  • the broadcast center 100 does not mean only a general broadcasting station, but may include a video produced by a general user and distributed to the Internet.
  • the media server 200 is a main component of a real-time multilingual subtitle service system for online live broadcasting.
  • the media server 200 includes a broadcast receiver 210 for receiving a broadcast signal from the broadcast center 100 and an encoder for converting the received broadcast signal into a packet having a predetermined format. 220, the streaming server 230 for transmitting the converted packet, and delays the packet corresponding to the broadcast according to the set time to the viewer terminal 300 and transmits the multilingual subtitles received from the interpreter terminal 400 in real time. It may include a subtitle service web server 240 to transmit to the viewer terminal (300).
  • the broadcast receiver 210 receives a broadcast signal transmitted from the broadcast center 100.
  • the broadcast receiver 210 may receive a broadcast signal by any wireless or wired communication method.
  • the encoder 220 receives a broadcast signal from the broadcast center 100, converts the broadcast signal into a protocol corresponding to the plurality of viewer terminals 300, and may include an H.264 / AAC codec. Therefore, the encoder 220 may code the broadcast signal received in real time from the broadcast center 100 with the H.264 / AAC codec to enable playback on the viewer terminal 300 configured with any device.
  • the broadcast video is H.264 with a very high data compression rate
  • the voice for the broadcast is converted to H.264 by converting it to AAC (Advanced Audio Coding), which is a basic audio format used by Apple's iPhone, iPod, and iTunes.
  • AAC packet can be generated. Such a packet may be converted to a Real Time Messaging Protocol (RTMP) protocol and transmitted to the streaming server 230.
  • RTMP Real Time Messaging Protocol
  • the streaming server 230 may receive a packet from the encoder 220 by a standard video streaming protocol such as RTSP or HLS and transmit it to the subtitle service web server 240.
  • the streaming server 230 may be a Wowza streaming server.
  • the streaming server 230 is ready to receive the H.264 / AAC packet converted by the encoder 220 in real time to transmit the protocol for each device, as will be described later, optionally a plurality of edge servers The packet may be sent to 250.
  • the subtitle service web server 240 may delay a packet transmitted from the streaming server 230 according to a time set for each of the plurality of edge servers 250.
  • the subtitle service web server 240 may transmit a multilingual subtitle input in real time from the interpreter terminal 400 to the plurality of viewer terminals 300 corresponding to each edge server 250 together with the delayed packet.
  • the subtitle service web server 240 provides a chat module 420 including a chat program to the interpreter terminal 400, and the chat program can be input only by a registered user. The user cannot input.
  • the caption service web server 240 transmits a JW player capable of receiving and watching broadcasts, and a Wowza chat module for multilingual caption input and caption viewing to the viewer terminal 300 and the interpreter terminal 400.
  • FIG. 2 is a detailed block diagram of the caption service web server of FIG. 1.
  • the caption service web server 240 may include a plurality of edge servers 250 having delay times set, a controller 224 for setting delay times of the plurality of edge servers 250, and a database 246 storing registered user information. It may include.
  • the plurality of edge servers 250 may be configured in various forms according to the local environment of the country in which it is installed and services provided.
  • an RTSP server an HLS server, or an Internet protocol having the same protocol as the Wowza streaming server may be used. It may be an IPTV server that provides digital television service.
  • the plurality of edge servers 250 operate in a user mode for transmitting a delayed packet to the viewer terminal 300 and in a manager mode for transmitting a packet without delay to the interpreter terminal 400.
  • a manager mode for transmitting a packet without delay to the interpreter terminal 400.
  • any one of the plurality of edge servers 250 operates in the manager mode, and may transmit packets transmitted from the streaming server 230 to the plurality of interpreter terminals 400 in real time without delay.
  • the other edge server 250 operates in a user mode, and may delay the packet transmitted from the streaming server 230 according to a set time and then transmit the packet to a plurality of viewer terminals 300.
  • FIG. 3 is a detailed block diagram of the edge server of FIG.
  • Each of the plurality of edge servers 250 includes a packet receiver 252 for receiving a packet from the streaming server 230, a delay controller 254 for controlling the packet to be delayed according to a set time, and a temporary storage unit for temporarily storing the packet. 256, and a packet transmitter 258 for transmitting the delayed packet to the viewer terminal 300.
  • the packet receiver 252 may receive a packet transmitted from the streaming server 230 according to the format of the edge server 250.
  • the packet receiver 252 may be configured to receive a packet in a manner corresponding to the service format of the edge server 250.
  • the delay control unit 254 delays the received packet according to the delay time set by the control unit 224 of the subtitle service web server 240.
  • the delay control unit 254 may perform a designated time from the first packet received from the streaming server 230.
  • the packet may be controlled to be stored in the temporary storage unit 256.
  • the delay controller 254 may control to transmit the packet stored in the temporary storage unit 256 to the viewer terminal 300 together with the multilingual subtitles input in real time from the interpreter terminal 400.
  • the temporary storage unit 256 temporarily stores a packet to be delayed under the control of the delay controller 254, and may be, for example, a cache or a queue.
  • the packet transmitter 258 may transmit a real-time multilingual subtitle transmitted in real time from the interpreter terminal 400 to the plurality of viewer terminals 300 together with the packet delayed in response to the broadcast.
  • the packet receiver 252 may be configured to transmit a packet in a manner corresponding to the service format of the corresponding edge server 250 and the device type of the viewer terminal 300.
  • the edge server 250 may store the packet for a predetermined time from the first packet received from the streaming server 230 in the temporary storage unit 256 and transmit the packet to the plurality of viewer terminals 300.
  • the 300 may receive an image of a broadcast transmitted from the broadcasting center 100 after a predetermined time.
  • the controller 224 may set delay times of the plurality of edge servers 250.
  • the delays for the plurality of edge servers 250 may be determined based on country statistics for each viewer terminal 300. Since there is a different delay time between the subtitle service web server 240 and the viewer country, the edge server ( Per country). The delay time can be set in seconds.
  • the controller 224 searches whether the connected interpreter terminal 400 is a user registered in the database 246, and the search result is registered.
  • the multilingual subtitles input from the interpreter terminal 400 may be controlled to be transmitted to the plurality of edge servers 250.
  • the database 246 stores user information that can be input using a chat program as described below.
  • the database 246 may include registered interpreter information as user information for a plurality of interpreter terminals 400.
  • the viewer terminal 300 may access a caption service web server 240 and receive a broadcast selected in real time along with multilingual captions.
  • the viewer terminal 300 may select a multilingual subtitle service provided by the subtitle service web server 240 in a language desired by the viewer.
  • the broadcast selected by the viewer terminal 300 is not limited to a general broadcast program such as a drama, but may be various types of videos provided by the subtitle service web server 240.
  • FIG. 4 is a view illustrating a display state of the viewer terminal of FIG. 1.
  • the viewer terminal 300 may include a streaming viewer 302 in which an image of a broadcast to be watched is displayed, and a chat viewer 304 in which multilingual subtitles corresponding to the image are displayed.
  • the streaming viewer 302 is executed by the JW player provided from the subtitle service web server 240, and may display an image of a broadcast corresponding to a delayed packet.
  • the chat viewer 304 is executed by the Wowza chat module provided from the subtitle service web server 240, and multilingual subtitles translated into a language set by a user may be displayed.
  • the chat viewer 304 may change its location according to the viewer's selection.
  • the interpreter terminal 400 receives a packet in real time without delay from any one of the plurality of edge servers 250, and in a language set for broadcasting corresponding to the packet received by the simultaneous interpreter.
  • the translated multilingual subtitles can be input in real time.
  • the simultaneous interpreter may translate the inputted language into the interpreter terminal 400 while watching the video of the broadcast executed by the JW player in real time without delay.
  • FIG. 5 is a detailed block diagram of the interpreter terminal of FIG. 1.
  • Each of the plurality of interpreter terminals 400 includes an input unit 410 for inputting multilingual subtitles translated by a simultaneous interpreter, a chat module 420 for providing multilingual subtitles in a chat method, and a typo for correcting a typo of input multilingual subtitles.
  • the correction unit 430 may include a storage unit 440 that stores a lexicon for translation.
  • the input unit 410 is an input device such as a keyboard provided in the interpreter terminal 400, and may be an input device supporting a language to be translated.
  • the input unit 410 may input a multilingual subtitle translated by a corresponding simultaneous interpreter in a set language.
  • the chat module 420 may be provided from the subtitle service web server 240, and may convert the multilingual subtitles input by the simultaneous interpreter to be displayed in the chat viewer 304 of the viewer terminal 300 in a chat manner.
  • Such a chat module 420 may be a Wowza chat module, and a simultaneous interpreter may input translated multilingual subtitles according to a chat program executed by the chat module 420.
  • the chat program provided from the subtitle service web server 240 transmits the subtitles input in real time without delay, as a result, the simultaneous interpreter inputs the translated multilingual subtitles to the interpreter terminal 400.
  • the typo corrector 430 may check and correct a multilingual subtitle input from the input unit 410 according to a lexical dictionary of the storage unit 440.
  • the typo correcting unit 430 automatically corrects a typo corresponding to a word among input subtitles translated by a simultaneous interpreter.
  • the correction of the typo is described as a typo correction for the word based on the lexicon stored in the storage unit 440, but is not limited to this, and is not limited to this, for the vocabulary such as the survey in response to the basic grammar of the language. You can also correct typos.
  • the storage unit 440 may store a lexical dictionary for a language set for the simultaneous interpreter.
  • the lexical dictionary is described as including only words for the language, but is not limited thereto and may include a basic grammar of the language.
  • the typo corrector 430 for correcting the input multilingual caption is described as being provided in the interpreter terminal 400, but the present invention is not limited thereto, and the caption for receiving the multilingual caption input from the interpreter terminal 400 is provided. It may be implemented in the service web server 240.
  • the typo correcting unit 430 is provided in the interpreter terminal 400 or the subtitle service web server 240, the typo is corrected before the multilingual caption is transmitted to the viewer terminal 300.
  • the terminal 300 receives only a multilingual subtitle in which a typo is corrected, and thus the viewer can watch only the multilingual subtitle in which the typo is corrected.
  • FIG. 6 is a flowchart of a real-time multilingual subtitle service method for online live broadcasting according to an embodiment of the present invention.
  • the media server 200 receives a broadcast signal transmitted from the broadcast center 100 and converts the broadcast signal into a format corresponding to a device suitable for the viewer terminal 300 such as a PC or a smart device.
  • the converted broadcast signal is provided to the interpreter terminal 400 in real time without delay or is delayed according to a preset time.
  • the simultaneous interpreter receiving the real-time broadcast is translated into a language set based on this, input to the interpreter terminal 400, and the multilingual subtitles input by the simultaneous interpreter are delivered to the media server 200 in real time.
  • the media server 200 transmits the delayed broadcast signal to the viewer terminal 300 and simultaneously transmits the multilingual subtitles transmitted from the interpreter terminal 400 to the viewer terminal 300 in real time.
  • viewers can watch subtitles optimized for a particular online live broadcast with the video in the desired language.
  • a setting for sinking may be performed for each region.
  • a delay time of a broadcast signal to be provided to the viewer terminal 300 for each of the plurality of edge servers 250 may be set.
  • the delays for the plurality of edge servers 250 may be set based on country statistics for each viewer terminal 300. Since there is a different delay time between the subtitle service web server 240 and the viewer country, the edge server ( Per country). The delay time can be set in seconds.
  • the broadcast signal may be received from the broadcast center 100 and converted into a protocol corresponding to the plurality of viewer terminals 300.
  • a broadcast transmitted from the broadcast center 100 may be received.
  • the received broadcast may include not only a broadcast transmitted from a general broadcasting station but also a video produced by a general user and distributed to the Internet.
  • the broadcast signal received from the broadcast center 100 may be converted into a form according to the viewer terminal 300.
  • the broadcast signal may be converted into a packet and converted into an RTMP protocol.
  • the broadcast signals to be transmitted to the plurality of viewer terminals 300 may be delayed according to the time set for each of the plurality of edge servers 250.
  • the broadcast signal is delayed according to a set time.
  • the first packet received from the streaming server 230 may be temporarily stored and then transmitted to a plurality of viewer terminals 300. .
  • the viewer terminal 300 may receive an image of a broadcast after a predetermined time.
  • the broadcast signal may be transmitted in real time to the plurality of interpreter terminals 400 without delay.
  • the multilingual subtitles translated into the language set for the broadcast by the simultaneous interpreter may be input in real time.
  • the simultaneous interpreter may translate the multi-language subtitles through the interpreter terminal 400 by translating into a set language corresponding to the corresponding broadcast while watching the broadcast received in real time.
  • the input multilingual subtitles are input in a chat method, and since the chat program provided from the subtitle service web server 240 transmits the input subtitles in real time without delay, the simultaneous interpreter translates to the interpreter terminal 400.
  • the instant input of the multilingual subtitles may be displayed on the chat viewer 304 of the viewer terminal 300.
  • step S607 the multilingual subtitles inputted by the simultaneous interpreter to the interpreter terminal 400 may be checked and corrected according to a stored lexical dictionary.
  • the correction of the typo is not limited to the correction of the typo for the word based on the pre-stored lexical dictionary, and the typo for the vocabulary such as the survey may be corrected corresponding to the basic grammar of the corresponding language.
  • the multi-language subtitles input from the plurality of interpreter terminals 400 are simultaneously transmitted to the plurality of viewer terminals 300 while transmitting the delayed broadcast signal to the plurality of viewer terminals 300 corresponding to the respective edge servers 250.
  • the interpreter terminal 400 may transmit the multilingual subtitles translated by the simultaneous interpreter to the subtitle service web server 240 in real time.
  • the broadcast signal delayed for each edge server 250 may be transmitted to the plurality of viewer terminals 300, and at the same time, the multilingual subtitles input from the interpreter terminal 400 may be transmitted to the plurality of viewer terminals 300 in real time.
  • the present invention may display a broadcast in which each of the plurality of viewer terminals 300 is delayed and simultaneously display the multilingual subtitles transmitted in real time in a language set by the viewer.
  • the viewer terminal 300 may receive and display a delayed broadcast signal and simultaneously display a multilingual subtitle translated into a language according to the viewer's setting.
  • the received broadcast is delayed and provided to the viewer terminal 300, while the delay is provided to the interpreter terminal 400 in real time, and the multilingual subtitles translated by the simultaneous interpreter are transmitted to the viewer terminal 300 in a chat manner.
  • viewers can watch online live broadcasts in real time through subtitles provided in a desired language.
  • the present invention can be applied to various types of real-time multilingual subtitle service systems and methods.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • Tourism & Hospitality (AREA)
  • General Health & Medical Sciences (AREA)
  • Economics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention, qui concerne un système et un procédé de réalisation d'un service de sous-titrage multilingue en temps réel destiné à la diffusion en ligne en direct, propose un système et un procédé de réalisation d'un service de sous-titrage multilingue en temps réel conçu pour la diffusion en ligne en direct avec des sous-titres multilingues optimisés en fonction de chaque élément de contenu par un traducteur, concomitamment avec une adaptation de la vitesse de synchronisation en fonction des régions. Un tel système comprendra un codeur, un serveur de diffusion en continu, un serveur web de service de sous-titrage, et une pluralité de terminaux de traducteurs. Le codeur reçoit d'un centre de diffusion un signal de diffusion qu'il convertit en protocoles correspondant à une pluralité de terminaux de spectateurs. Le serveur de diffusion en continu transmet un paquet converti. Le serveur web de service de sous-titrage, qui comporte une pluralité de serveurs Edge, affecte le paquet transmis depuis le serveur de diffusion en continu d'un retard défini par les serveurs Edge. La pluralité de terminaux de traducteurs reçoit en temps réel en provenance de l'un des serveurs de la pluralité de serveurs Edge, d'une part le paquet non retardé, et d'autre part les sous-titres multilingues qui sont des traductions effectuées par des traducteurs dans les langues définies pour la diffusion correspondant au paquet reçu. Le serveur web de service de sous-titrage peut ainsi transmettre, à la pluralité de terminaux de spectateurs correspondant à chaque serveur Edge, des sous-titres multilingues introduits en temps réel depuis la pluralité de terminaux de traducteurs, en accompagnement du paquet retardé. La configuration de l'invention d'améliorer la précision de sous-titres multilingues qui soient adaptés au contenu et respectant les caractéristiques régionales.
PCT/KR2012/002892 2012-03-05 2012-04-17 Système et procédé de réalisation de service de sous-titrage multilingue en temps réel pour diffusion en ligne en direct WO2013133477A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020120022134A KR101192207B1 (ko) 2012-03-05 2012-03-05 온라인 생방송을 위한 실시간 다국어 자막 서비스 시스템 및 그 방법
KR10-2012-0022134 2012-03-05

Publications (1)

Publication Number Publication Date
WO2013133477A1 true WO2013133477A1 (fr) 2013-09-12

Family

ID=47288186

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2012/002892 WO2013133477A1 (fr) 2012-03-05 2012-04-17 Système et procédé de réalisation de service de sous-titrage multilingue en temps réel pour diffusion en ligne en direct

Country Status (2)

Country Link
KR (1) KR101192207B1 (fr)
WO (1) WO2013133477A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016047818A1 (fr) * 2014-09-23 2016-03-31 (주)두드림 Système et procédé de fourniture d'interprétation simultanée à base de codecs multiples et de canaux multiples
WO2017007192A1 (fr) * 2015-07-06 2017-01-12 엘지전자 주식회사 Dispositif d'émission de signal de diffusion, dispositif de réception de signal de diffusion, procédé d'émission de signal de diffusion et procédé de réception de signal de diffusion
CN107371054A (zh) * 2017-06-20 2017-11-21 武汉斗鱼网络科技有限公司 一种弹幕处理方法及装置
US20180160157A1 (en) * 2015-07-16 2018-06-07 Naver Business Platform Corporation Video providing apparatus, video providing method, and computer program
CN110035323A (zh) * 2019-03-20 2019-07-19 苏州佳世达光电有限公司 自动调整显示字幕语言的多媒体播放方法及系统
CN110610444A (zh) * 2019-08-27 2019-12-24 格局商学教育科技（深圳）有限公司 一种基于直播教学云的后台数据管理系统
CN115474065A (zh) * 2021-06-11 2022-12-13 北京有竹居网络技术有限公司 一种字幕处理方法、装置、电子设备和存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101897968B1 (ko) * 2015-08-12 2018-09-12 (주)지엘컴 통역음성 정보를 제공하는 방법, 이를 운용하는 맞춤형 통역 서버 및 시스템
KR101832464B1 (ko) * 2017-10-16 2018-02-26 네이버 주식회사 동영상 제공 장치, 동영상 제공 방법, 및 컴퓨터 프로그램

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100580149B1 (ko) * 2006-04-06 2006-05-15 주식회사 현대홈쇼핑 홈쇼핑 방송을 데이터통신망을 통해 다국어로 제공하는다국어 제공 홈쇼핑 데이터방송 시스템 및 그 방법
KR20070044334A (ko) * 2005-10-24 2007-04-27 주식회사 어가람닷컴 외국인을 위한 유료 커뮤니티를 활용한 통역시스템과 그방법
KR100911717B1 (ko) * 2007-11-13 2009-08-10 연세대학교 산학협력단 멀티미디어 동시통역 시스템의 송신부 및 이를 포함하는멀티미디어 동시통역 시스템
KR101015234B1 (ko) * 2008-10-23 2011-02-18 엔에이치엔(주) 웹 상의 멀티미디어 컨텐츠에 포함되는 특정 언어를 다른 언어로 번역하여 제공하기 위한 방법, 시스템 및 컴퓨터 판독 가능한 기록 매체

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008072586A (ja) 2006-09-15 2008-03-27 Matsushita Electric Ind Co Ltd デジタルａｖストリーム再生装置
JP5354664B2 (ja) 2009-05-28 2013-11-27 Ｎｅｃカシオモバイルコミュニケーションズ株式会社 デジタルデータ受信機、及び、プログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070044334A (ko) * 2005-10-24 2007-04-27 주식회사 어가람닷컴 외국인을 위한 유료 커뮤니티를 활용한 통역시스템과 그방법
KR100580149B1 (ko) * 2006-04-06 2006-05-15 주식회사 현대홈쇼핑 홈쇼핑 방송을 데이터통신망을 통해 다국어로 제공하는다국어 제공 홈쇼핑 데이터방송 시스템 및 그 방법
KR100911717B1 (ko) * 2007-11-13 2009-08-10 연세대학교 산학협력단 멀티미디어 동시통역 시스템의 송신부 및 이를 포함하는멀티미디어 동시통역 시스템
KR101015234B1 (ko) * 2008-10-23 2011-02-18 엔에이치엔(주) 웹 상의 멀티미디어 컨텐츠에 포함되는 특정 언어를 다른 언어로 번역하여 제공하기 위한 방법, 시스템 및 컴퓨터 판독 가능한 기록 매체

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016047818A1 (fr) * 2014-09-23 2016-03-31 (주)두드림 Système et procédé de fourniture d'interprétation simultanée à base de codecs multiples et de canaux multiples
KR102014800B1 (ko) * 2015-07-06 2019-08-27 엘지전자 주식회사 방송 신호 송신 장치, 방송 신호 수신 장치, 방송 신호 송신 방법, 및 방송 신호 수신 방법
WO2017007192A1 (fr) * 2015-07-06 2017-01-12 엘지전자 주식회사 Dispositif d'émission de signal de diffusion, dispositif de réception de signal de diffusion, procédé d'émission de signal de diffusion et procédé de réception de signal de diffusion
US11178436B2 (en) 2015-07-06 2021-11-16 Lg Electronics Inc. Broadcast signal transmission device, broadcast signal reception device, broadcast signal transmission method, and broadcast signal reception method
KR20170142993A (ko) * 2015-07-06 2017-12-28 엘지전자 주식회사 방송 신호 송신 장치, 방송 신호 수신 장치, 방송 신호 송신 방법, 및 방송 신호 수신 방법
US10638172B2 (en) 2015-07-06 2020-04-28 Lg Electronics Inc. Broadcast signal transmission device, broadcast signal reception device, broadcast signal transmission method, and broadcast signal reception method
US10356451B2 (en) 2015-07-06 2019-07-16 Lg Electronics Inc. Broadcast signal transmission device, broadcast signal reception device, broadcast signal transmission method, and broadcast signal reception method
US10595067B2 (en) 2015-07-16 2020-03-17 Naver Business Platform Corporation Video providing apparatus, video providing method, and computer program
US20180160157A1 (en) * 2015-07-16 2018-06-07 Naver Business Platform Corporation Video providing apparatus, video providing method, and computer program
CN107371054A (zh) * 2017-06-20 2017-11-21 武汉斗鱼网络科技有限公司 一种弹幕处理方法及装置
CN110035323A (zh) * 2019-03-20 2019-07-19 苏州佳世达光电有限公司 自动调整显示字幕语言的多媒体播放方法及系统
CN110610444A (zh) * 2019-08-27 2019-12-24 格局商学教育科技（深圳）有限公司 一种基于直播教学云的后台数据管理系统
CN115474065A (zh) * 2021-06-11 2022-12-13 北京有竹居网络技术有限公司 一种字幕处理方法、装置、电子设备和存储介质
CN115474065B (zh) * 2021-06-11 2024-05-28 北京有竹居网络技术有限公司 一种字幕处理方法、装置、电子设备和存储介质

Also Published As

Publication number Publication date
KR101192207B1 (ko) 2012-10-17

Similar Documents

Publication Publication Date Title
WO2013133477A1 (fr) Système et procédé de réalisation de service de sous-titrage multilingue en temps réel pour diffusion en ligne en direct
US20200359104A1 (en) Method and apparatus for pushing subtitle data, subtitle display method and apparatus, device and medium
US11463779B2 (en) Video stream processing method and apparatus, computer device, and storage medium
US8045054B2 (en) Closed captioning language translation
US8330864B2 (en) Multi-lingual transmission and delay of closed caption content through a delivery system
TWI489862B (zh) Digital TV instant translation system and its method
US10715571B2 (en) Self-adaptive streaming medium processing method and apparatus
US20160066055A1 (en) Method and system for automatically adding subtitles to streaming media content
WO2013015546A2 (fr) Procédé et système de fourniture d'informations supplémentaires sur un contenu de diffusion
CN102802044A (zh) 视频处理方法、终端及字幕服务器
CN112616062B (zh) 一种字幕显示方法、装置、电子设备及存储介质
US20200074994A1 (en) Information processing apparatus and information processing method
EP2574054B1 (fr) Procédé pour synchroniser des sous-titres et de l'audio lors du sous-titrage en direct
WO2015108255A1 (fr) Appareil d'affichage, serveur interactif et procédé de fourniture d'informations de réponse
US9942620B2 (en) Device and method for remotely controlling the rendering of multimedia content
WO2018169255A1 (fr) Appareil électronique, et procédé de commande associé
KR20110114997A (ko) 자동 키워드 검출을 통한 방송서비스 제공장치 및 그 방법
CN112601102A (zh) 同声传译字幕的确定方法、装置、电子设备及存储介质
CN101202901A (zh) 一种节目传送包的包标识符的处理方法、装置及系统
CN202231825U (zh) 一种实现个性化界面显示的iptv系统
KR20130066432A (ko) 클라우드 기반의 ｉｐｔｖ 서비스 제공 방법 및 장치
KR101687615B1 (ko) 네트워크 ｔｖ를 이용하여 전화 서비스를 제공하는 방법 및 상기 네트워크 ｔｖ
WO2021060578A1 (fr) Dispositif d'affichage d'image, procédé de correction de synchronisation labiale associé, et système d'affichage d'image
JP2021061526A (ja) 字幕変換装置、コンテンツ配信システム、プログラム及びコンテンツ配信方法
JP5213572B2 (ja) 手話映像生成システム、サーバ、端末装置、情報処理方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12870479

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 30/01/2015)

122 Ep: pct application non-entry in european phase

Ref document number: 12870479

Country of ref document: EP

Kind code of ref document: A1