KR20020013664A - An Implementation of the Internet Caption Broadcasting Server and Client for the Hearing Impairment - Google Patents

Abstract

PURPOSE: A method for embodying a server and a client for an Internet caption broadcasting for hearing handicapped person is provided to transmit voice and caption data, and to mutually transmit information for the hearing handicapped person. CONSTITUTION: Media files are synchronized with caption files based on the passage of time according to a flow of data. In other words, times passed from a starting time are recorded in the caption files. The synchronization of the media files and the caption files are performed. In addition, a form of a caption document is newly defined for representing a structure capable of executing through real-time transmission and Korean caption modes. An RTSP(Real Time Streaming Protocol) capable of performing real-time transmission and an RTP(Real Time Protocol) capable of transmitting media data are used.

Description

An implementation of the Internet Caption Broadcasting Server and Client for the Hearing Impairment}

Closed captioning is a broadcasting program that sends out original broadcasting and sends out subtitles at the bottom or top of the screen, and sends out text or pictures such as sending a paused screen. It is a broadcast that allows viewers to watch a song or situation by subtitles at the same time. Open captioning was first launched in the 1970s in the United States, but many general viewers complained about visual distraction. As a result of repeated technical research, the National Subtitle Research Institute secured the necessary space and equipment for the first time in March 1980, and closed caption broadcasting was enacted.In October 1990, the Television Subtitle Display Act was enacted. The law requires that all televisions over 13 inches have a closed caption decoder. The research on subtitles integrated with multimedia data is focused on social welfare research. Of particular note are Microsoft's Synchronized Accessible Media Interchange (SAMI) and the Syncronized Multimedia Integration Language (SMIL), which was established as a standard in 1998. In the airwaves, the already closed caption broadcasting does not exist right now as Internet broadcasting becomes more and more common. Some Internet broadcasts are closed captions for simple translation, not subtitles for information delivery.

In the present invention, by designing a server and client for transmitting Internet subtitles to facilitate the transmission of information through the Internet by limiting the hearing impaired person who is inexperienced in listening to voice through subtitles but free to use the visual as a standard model. To this end, research is needed to synchronize subtitle data and media data, and Real Time Protocol (RTP), Real Time Streaming Protocol (RTSP), Real-time Transport Control Protocol (RTC) and Research on transmission standards, disk management techniques, and flow control on RSVP (Resource Reservation Protocol) is needed. In addition, real-time transmission of subtitles and subtitle formats of digital data have not been standardized, and studies on domestic broadcasting and application environments are insufficient.

1 is a structure of caption data

Figure 2 shows the flow of data in RTSP / RTP

3 is a layer structure of a subtitle service

4 is an example of a subtitle file

5 is a module for analyzing caption data

6 is a client for caption broadcasting

1 illustrates a structure of caption data, and illustrates an example of an audio file. It shows the process of synchronizing with the subtitle file based on the passage of time according to the data flow in the voice file. That is, by synchronizing the elapsed time from the start time to the caption file, the media file and the caption file can be synchronized.

As it is designed to be used after transmitting all subtitles like HTML, it is not suitable for providing subtitle data in real time, and efficiently expresses Korean subtitle mode included in the TTA.KO-07.0010 standard. Difficult to do Therefore, the subtitle document format was newly defined to represent the structure and the Korean subtitle mode that is executed through real-time transmission.

RTSP and RTP are used for the transmission of media data. RTSP is a protocol for the execution and control of information stored from an Internet on-demand audio server.

All data packets transmitted in the present invention follow the RTP packet configuration. The payload in RTP packet configuration is an identifier that indicates the data format of the application. The sequence number indicates the order in which the RTP data packets are sent and increases in the order of transmission. It is also used at the receiving end to check for packet loss or to reassemble out of order packets. The time stamp reflects the sampling instant of the RTP data packet, which must be a linear clock in time for synchronization with voice data or jitter calculations. You should start with. In addition, SSRC, CSRC, and CC fields are defined for multicast applications. Media data and subtitle data are added and transmitted here.

2 illustrates a media file transfer initialization and data transfer flow using the RTSP and RTP protocols. RTSP is responsible for data flow control, and RTP is used for data transmission.

3 is a diagram illustrating a service layer for Internet closed captioning, and illustrates a process on the left in which a server transmits data through a data management, packet configuration, and transport layer, and a process in which the client reconstructs and outputs the received data. It is easy to change and add functions when media file format for service is modified by dividing the function layer. The composition of the layer is divided into the data management layer, the configuration and reproduction layer of the transport packet, and the transport layer, which functions in the reverse order in the server and the client. The data management layer is responsible for matching subtitles, voice, and sound information, and checking elapsed time for transmitting voice and subtitles.

4 shows a subtitle file synchronized with 3 minutes of voice data using a defined subtitle tag. The title of the subtitle file can be entered using <TITLE> and </ TITLE>. It includes the title of the entire content and ancillary content, and has the following format:

<TITLE> .... title .. </ TITLE>

Information on the media file associated with the subtitle file is indicated by <MEDIAFILE> and has the following format:

<MEDIAFILE filename = '.. full path filename ..' fileformat = '.. fileformat ..'>

Here, "fileformat" means the extension of media files such as "wav", "avi", "mpg", and the like. The language is divided into Korean subtitle mode and English subtitle mode. Korean mode is expressed as <KOREAN>, </ KOREAN>, and English mode is expressed as <ENGLISH>, </ ENGLISH>. This follows the KSC-5601 character standard.

The following tags are used to synchronize subtitle strings with voice and sound information. "media elapsed time" sets the elapsed time of the media in milliseconds.

<TIMESTAMP = media elapsed time color = '.. text color ..' bgcolor = '.. background color ..'>

Until <TIMESTAMP> tag appears in <TIMESTAMP>, it contains contents to be output during the corresponding time. This is called a unit block. This includes text synchronized with voice, text information mode, emergency subtitles, and program ratings. The client program analyzes all the contents of the <TIMESTAMP> block and sets the attributes "color" and "bgcolor" so that the color and background color of the string corresponding to the specified elapsed time can be specified. If you do not specify the color and background color of the string, it has "color = 'black' bgcolor = 'white'" as the default property.

Program rating marks indicate the rating of a program to protect minors. The format is as follows:

<RATEMODE = 'aaa'>

The format of the emergency subtitles is as follows and all subtitles have priority.

<ALARMCAPTION>, </ ALARMCAPTION>

The format is applied to the "color" attribute for each tag. The color type is defined as follows. For example, <FONT color = "red" bgcolor = "white" size = "11"> .... </ FONT> will have a white background and a red text color.

Underscore can be specified and released using control codes. The format is as follows.

<U> and </ U>

Italic designation and release format is as follows.

<I> and </ I>

Due to the nature of subtitles, if a string passed in consists of more than one paragraph, a line break must be used to separate paragraphs. The format is as follows:

<BR>

5 is a configuration of a sentence interpretation module. The interpretation module for sentence interpretation and tag extraction is constructed using hash table and single link list program technique. This parsing module is used to select subtitle strings by detecting elapsed time during document interpretation and subtitle interpretation on the server side. On the client side, it is used to detect the operation mode of the subtitles received and to change the attributes of the sentences. The interpretation module parses the entire document and extracts two types of data. The first data determines the media file to be served with the subtitles, the color of the entire subtitles, the subtitle mode, etc. and is a common option for the entire subtitle data. This is represented by a simple data structure. The second data is the caption data according to the caption itself or the operation mode, the attributes, the indexes, and the changed operation mode. Since it can be expressed freely within a given grammar, it is programmed using a hash and a single linked list.

6 is a view showing an output of a caption tag through a client program as an execution screen. The color of the text was adjusted using the "<FONT color = red> Kim Young-sam (金泳三) </ FONT>" tag, and the "public security, labor crime and best practice </ U>" tag including the exemption of <U> is underlined. Indicates. Use "<FONT color = red size = 25> Special Slope, Lottery and Parole </ FONT>" to change the size and color.

.

Claims (1)

Servers and clients that transmit voice and subtitle data Sentence interpretation module for real time internet subtitle broadcasting Tags for synchronizing voice and subtitles