KR20090054139A - Apparatus and method for sharing multimedia caption in communication terminal - Google Patents

Abstract

The present invention relates to an apparatus and method for sharing a multimedia caption in a communication terminal, the method comprising: receiving information on a multimedia caption in one of text, image, and audio form from a caption server, and using the information on the multimedia caption. Including the process of outputting text, image or audio data corresponding to the multimedia subtitles, the existing text-oriented subtitle format is easily extended to express various multimedia effects, and easily share them with other users in real time or non-real time. There is an advantage to this.

Terminal, Subtitles, Subtitle Sharing, Multimedia Subtitles, Contents

Description

Apparatus and method for sharing multimedia subtitle in communication terminal {APPARATUS AND METHOD FOR SHARING MULTIMEDIA CAPTION IN COMMUNICATION TERMINAL}

The present invention relates to a communication terminal, and more particularly, to an apparatus and method for sharing multimedia subtitles.

Recently, with the help of the Internet, many movies and animations can be easily obtained in the form of video. In particular, with the development of the DivX format, the video quality and sound quality have improved to a level that is unparalleled. As a result, many people are watching movies or animations through video, and many others are translating foreign films or animations into subtitle files.

Subtitle files include sub, sort, smi, and the like. Among them, the smi subtitle file which is used most frequently in Korea is widely used for translating foreign language contents due to its small size and simple production method, and is supported by most video players such as the bear player. However, the subtitle file having the extension smi has a limitation that only subtitles in a text form are supported, and thus, the subtitle file has a problem of being used only for translation purposes. In addition, since only subtitles in the form of files are supported, there is a problem that real-time sharing is impossible.

An object of the present invention is to provide an apparatus and method for sharing multimedia subtitles in a communication terminal.

Another object of the present invention is to provide an apparatus and method for easily expressing various multimedia effects by extending the existing text-based subtitle format in a communication terminal and easily sharing them with other users in real time or non-real time.

According to an embodiment of the present invention to achieve the above object, a method for sharing a multimedia subtitle of a communication terminal, the process of receiving information on the multimedia subtitle of one of the form of text, image, audio from the subtitle server, and the multimedia And outputting text, an image, or audio data corresponding to the multimedia caption using information on the caption.

In order to achieve the above object, according to an embodiment of the present invention, a multimedia subtitle sharing apparatus of a communication terminal receives information on a multimedia subtitle of one of text, image, and audio form from a subtitle server, And a control unit for providing text, image or audio data corresponding to the multimedia subtitles using the information about the multimedia caption, and a display unit or a speaker for outputting text, image or audio data according to the provision of the control unit.

According to an embodiment of the present invention to achieve the above object, the method for sharing a multimedia subtitle of the caption server, the process of receiving information on the multimedia subtitle of one of the form of text, image, audio of the specific content from the terminal; And transmitting the information on the received multimedia subtitles to a user using the same content in real time.

According to an embodiment of the present invention, in order to achieve the above object, the multimedia subtitle sharing apparatus, when a multimedia subtitle of one type of text, image, audio for the specific content is input by the user, And a caption server for transmitting information to the caption server in real time and the caption server for transmitting in real time information about multimedia captions from the terminal to a user using the same content.

The present invention provides an apparatus and method for sharing a multimedia subtitle of a communication terminal, thereby extending the existing text-based subtitle format to easily express various multimedia effects, and share the same with other users in real time or in real time. have. By adding various multimedia effects to the subtitles as described above, the subtitles can be a new means of extending the content beyond the simple translation means. In addition, when the paradigm is changed, many users who have previously consumed content in a passive form can naturally participate in reproduction of content using subtitles, and can be utilized in a wide range of fields such as UCC. In particular, the multimedia subtitle according to the present invention is a subtitle in the form of a text consisting of a simple tag, there is an advantage that can be easily authored and shared even in a low-performance mobile device.

In addition, the real-time and non-real-time sharing of multimedia subtitles enables more effective and colorful communication between users when it replaces the real-time chat function provided by existing online contents companies. In the early stages of the Internet service, the text-oriented process proceeds in a flashy fashion, and the voice call service is gradually developed into a video call service. As a result, communication between users who enjoy content together is gradually proposed in the present invention. It is expected to evolve into multimedia communication. In particular, since the multimedia subtitle of the present invention is a subtitle in the form of a text consisting of a simple tag, the transmission technology and infrastructure of the existing text-based chat system can be used as it is, and there is an advantage that it can be easily applied.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

Hereinafter, an apparatus and method for sharing multimedia subtitles of a communication terminal will be described. In the following description, a subtitle is a multimedia subtitle that includes all subtitles in text, image, or audio format.

1 is a diagram showing the configuration of a network according to the present invention.

Referring to FIG. 1, the present invention provides a network for sharing caption data based on video content among a plurality of users. The network includes a plurality of terminals 110 and a subtitle server 100 and supports both real-time subtitle streaming and subtitle file download.

Here, the user of the terminal 110 may input a new subtitle for the content, and transmit the information about the input subtitle to the terminal 110 of the user using the same content through the subtitle server 100 in real time. have. In this case, the subtitle server 100 may generate a subtitle file by using the subtitle information, and after updating the subtitle file for the content stored in the subtitle file database with the generated subtitle file, another user corresponding content When the subtitle is requested to download, the subtitle file may be searched for and extracted from the subtitle file database and transmitted to the terminal 110 of the corresponding user.

Here, the method for inputting the multimedia subtitle of the terminal 110 may be input through a menu selection according to a user's key manipulation, or may be input in a text form based on a simple tag. In this case, the multimedia subtitle may be a predefined image or audio, or may be an image or audio linked to a specific URI. As a result, the user can easily overlay various voice effects and figures on the video content.

2 is a block diagram showing the configuration of a communication terminal according to the present invention.

As shown, the communication terminal includes a control unit 201, a storage unit 202, a codec 203, an input unit 206, a display unit 207, and a communication unit 208.

Referring to FIG. 2, the control unit 201 performs control and processing for the overall operation of the communication terminal, and in particular, the multimedia subtitle function of the expanded format and the subtitle sharing function through the subtitle server according to the present invention. do. That is, when a new multimedia subtitle for the content is input by the user, the information about the input subtitle is transmitted to the subtitle server, and when the subtitle file or real time subtitle information is received from the subtitle server, the multimedia for the corresponding content is received. Handles the subtitle output function. The storage unit 202 stores programs and various information necessary for the overall operation of the communication terminal, and in particular, a subtitle file or subtitle information received from a subtitle server.

A coder-coder 203 connected to the control unit 201 and a speaker 205 and a microphone 204 connected to the codec 203 are voice input / output blocks used for telephony communication and voice recording. . The codec 203 converts the digital data provided from the control unit 201 into an analog voice signal, transmits the same through the speaker 205, and converts the voice signal received through the microphone 204 into digital data. The control unit 201 is provided.

The input unit 206 is provided with a plurality of function keys to provide the control unit 201 with data corresponding to a key pressed by the user. The display unit 207 displays state information, numbers, letters, and images generated during the operation of the communication terminal. The communication unit 208 processes a signal transmitted and received through an antenna.

3 is an exemplary view showing a multimedia subtitle output method of a communication terminal according to the present invention.

Referring to FIG. 3, the terminal supports text overlay using only a partial area in most existing Smi-based players, whereas the entire video area is set as an overlay area to overlay images and text anywhere on the screen 300. Can be displayed. In addition, the terminal may receive the subtitle information in real time from the subtitle server 330 in addition to the subtitle file (.smi) 320 form and display it together with the video file (.avi) 310.

4 is a flowchart illustrating a procedure of a method for sharing multimedia captions in a caption server according to an exemplary embodiment of the present invention.

Referring to FIG. 4, the caption server 100 checks whether caption information on content is received from the user in step 401. The user may input a new subtitle for the content, and thus the terminal 110 may transmit the information about the input subtitle to the subtitle server 100.

Here, the caption information proposed in the present invention has an extended form as shown in Table 1 to support multimedia captions. That is, it has an extended form to express not only subtitles in text form but also audio and image subtitles.

tag Explanation Show Display start time Hide Mark end time Text Text to be displayed Type Media Format-Text (Default)-Audio-Image Data Media data Predefined data: Audio (applause / cheer / boo): Image (circle / ellipse / rectangular / star / balloon) or link to the resource: Audio or image file URI Position Location to be displayed Size Size to be displayed Color Color to be displayed From The subtitle provider Location Location of the subtitle provider

Here, the show, hide, and text items are items existing in the existing subtitle information, and the remaining items are newly added items according to the present invention. The show item indicates the display start time of the subtitle, the hide item indicates the display end time of the subtitle, and the text item indicates the text to be displayed when the subtitle format is text.

The Type item represents a media type of subtitles, and the media type includes text, audio, and image, and if the Type item is not set, it is treated as text, which is a default value. do.

The Data item represents media data as an additional item required according to the media type. Here, when the media data is a predefined audio or image, the Data item includes a predefined audio or image identifier, and the terminal receiving the predefined audio or image identifier is the corresponding audio or image. Outputs When the media data is a resource linked to a specific Uniform Resource Identifier (URI), the Data item includes a URI for the resource, and the terminal receiving the URI downloads the resource, that is, an audio or image from the URI. To print. For example, the predefined audio may include clapping, cheering, booing, and the like, and the predefined image may include shapes such as circles, ellipses, rectangles, stars, and balloons. As such, utilizing media data such as applause, cheering and booing, the user can enjoy the online sports relay content vividly as if they are in a real stadium. In addition, group studies, etc. can be used to exchange opinions in real time using various image effects, and the subtitle information can be generated and stored as subtitle files to be shared with other users or viewed together in the future. .

The Position item indicates a position where the corresponding subtitle is to be displayed. It is possible to adjust the position where the subtitle is displayed in the existing player, but this is applied to all subtitles so that all subtitles are displayed at the same position. On the other hand, the present invention provides a function of displaying each subtitle at a desired position by utilizing the Position item.

The Size item indicates the size of the subtitle to be displayed, and the Color item indicates the color of the subtitle to be displayed. That is, various images and texts are displayed on the screen in sizes and colors according to the Size item and Color item.

The From item represents information about the provider of the subtitle. The subtitle proposed by the present invention is a concept of a subtitle created by several users, and the information may be used for communication with a provider of the subtitle, or for filtering a subtitle posted by a specific user. .

The Location item represents location information of a provider of a corresponding subtitle, and GPS data may be used as the location information. By using the information, it is possible to control the output position of the subtitle according to the position of the subtitle provider, which can give a more realistic effect when watching sports content.

When caption information on content is received from a user, the caption server 100 transmits the received caption information in real time to users who use the same content in step 403. In operation 405, the subtitle server 100 generates a subtitle file using the received subtitle information, and updates the subtitle file for the content stored in the subtitle file database with the generated subtitle file.

In step 407, the subtitle server 100 checks whether a subtitle download request for the corresponding content is received from another user. When the subtitle download request is received, the subtitle server 100 searches for and extracts a subtitle file for the content from the subtitle file database in step 409 and transmits the subtitle file to the corresponding user.

Subsequently, the subtitle server 100 ends the algorithm according to the present invention.

5 is a flowchart illustrating a procedure of a method for outputting a multimedia subtitle of a communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 5, in step 501, the terminal 110 checks whether caption information for content exists. The terminal 110 may request the caption server 100 to download the caption file for the content and may receive caption information about the content from the caption server 100 in real time.

When the subtitle information exists, the terminal 110 checks whether the provider of the subtitle is an allowed subtitle provider using the subtitle information in step 503. Here, whether or not the permitted subtitle provider is checked may be checked by checking the From item of Table 1. If the user of the terminal 110 has disabled the subtitle provider, that is, if the provider of the subtitle is not a permitted subtitle provider, the terminal 110 ignores the subtitle and proceeds to step 501. Go back and repeat the steps below. This can be useful for preventing spoilers or spam.

On the other hand, if the provider of the subtitle is the permitted subtitle provider, the terminal 110 checks whether the media format of the subtitle is text in step 505. Here, whether the media type is text can be checked by checking the Type item of Table 1 below. If the media format of the subtitle is text, the terminal 110 outputs the corresponding text to the display unit 207 in step 507.

On the other hand, if the media format of the caption is not text, the terminal 110 determines that the media format of the caption is audio or an image, and proceeds to step 509 to determine whether the media data is predefined data. Check it. In this case, whether the media data is predefined data may be checked by checking the Data item of the <Table 1>. If the media data is predefined data, the terminal 110 checks whether the media data is audio in step 511. If the media data is not audio, the display unit 207 displays the image defined in step 513. In the case of audio, the audio, which is predefined in operation 515, is output to the display unit 207.

On the other hand, if the media data is not predefined data, the terminal 110 determines that the media data is linked data, and in step 517 determines whether the media data is audio. In the case of audio, the terminal 110 downloads the resource from the URI in step 519 and outputs the linked audio to the display unit 207. If not, in step 521, the terminal 110 downloads the resource from the URI. The linked image is output to the display unit 207.

Here, the text, audio, and image are output to the display unit 207 using the remaining information (ie, items of Show, Hide, Position, Size, Color, Location, etc. of Table 1). That is, the corresponding text, audio, and image are output in the corresponding size and color at the corresponding position during the corresponding display time. If the Position item of Table 1 is set, the terminal 110 outputs the corresponding text, image, and audio at the corresponding location, and if the Position item is not set and the Location item is set, the terminal is set. 110 may determine a location to display by comparing the current location information of the user with the location information of the Location item.

Thereafter, the terminal 110 terminates the algorithm according to the present invention.

On the other hand, the embodiment according to the present invention includes both an extended form of a multimedia subtitle function and a subtitle sharing function through a subtitle server, but it is also possible to use only the extended form of the multimedia subtitle function except for the subtitle sharing function. Do. In this case, the subtitle information is stored in the form of a subtitle file as before, and all functions other than real-time online sharing are the same as before.

In addition, it is also possible to use a real-time subtitle sharing function by configuring a P2P network between users without passing through the subtitle server. Even in this case, the overall structure is not changed, and the caption data transmission between the terminals is similar to that of the message transmission method of the P2P messenger.

In addition, various effects may be added in addition to the predefined effects such as audio (applause / cheer / boo) / image (circle / ellipse / rectangular / star / balloon) illustrated in the present invention.

Meanwhile, in the detailed description of the present invention, specific embodiments have been described, but various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the scope of the following claims, but also by the equivalents of the claims.

1 is a diagram showing the configuration of a network according to the present invention;

2 is a block diagram showing the configuration of a communication terminal according to the present invention;

3 is an exemplary view showing a multimedia subtitle output method of a communication terminal according to the present invention;

4 is a flowchart illustrating a procedure of a method for sharing multimedia captions in a caption server according to an embodiment of the present invention;

5 is a flowchart illustrating a procedure of a method for outputting a multimedia subtitle of a communication terminal according to an exemplary embodiment of the present invention.

Claims (25)

In the multimedia subtitle sharing method of the communication terminal, Receiving information about multimedia subtitles in one of text, image, and audio form from the subtitle server; And outputting text, an image, or audio data corresponding to the multimedia subtitle by using the information on the multimedia subtitle. The method of claim 1, The information on the multimedia caption is received in real time from the caption server or in the form of an information file from the caption server at the request of the terminal. The method of claim 1, The information on the multimedia subtitles may include information about a display start time, display end time, text to be displayed, media format, media data, location to be displayed, size to be displayed, color to be displayed, a corresponding subtitle provider, and a location of the subtitle provider. At least one information. The method of claim 3, wherein Wherein the media format includes one of a text format, an audio format, and an image format, and defaults to the text format. The method of claim 3, wherein The media data may include an identifier of predefined audio or image data, or a Uniform Resource Identifier (URI) to which the audio or image data is linked. The method of claim 5, wherein the outputting process, If the multimedia subtitle is predefined audio or image data, output the predefined audio or image data, and if the data for the multimedia subtitle is a resource linked to a specific URI (Uniform Resource Identifier), the resource in the URI And downloading the audio or image data. The method of claim 3, wherein And if the provider of the multimedia subtitle is not a subtitle provider permitted by the user, ignoring the multimedia subtitle. The method of claim 3, wherein If the information on the location to be displayed is not included in the information on the multimedia subtitle, further comprising: determining a location to display by comparing the information on the location of the corresponding subtitle provider with the current location of the terminal; Characterized in that the method. In the multimedia subtitle sharing device of the communication terminal, A control unit which receives information on the multimedia subtitles in one of text, image and audio form from the subtitle server, and provides text, image or audio data corresponding to the multimedia subtitles using the information on the multimedia subtitles; , And a display unit or a speaker for outputting text, an image, or audio data according to the provision of the controller. The method of claim 9, The information on the multimedia subtitle is received in real time from the subtitle server, or at the request of the terminal characterized in that it is received from the subtitle server in the form of an information file. The method of claim 9, The information on the multimedia subtitles may include information about a display start time, display end time, text to be displayed, media format, media data, location to be displayed, size to be displayed, color to be displayed, a corresponding subtitle provider, and a location of the subtitle provider. And at least one piece of information. The method of claim 11, Wherein the media format includes one of a text format, an audio format, and an image format, and defaults to the text format. The method of claim 11, The media data may include an identifier of predefined audio or image data, or a Uniform Resource Identifier (URI) to which the audio or image data is linked. The method of claim 13, wherein the control unit, If the multimedia subtitle is a predefined audio or image data, provides the predefined audio or image data, and if the data for the multimedia subtitle is a resource linked to a specific URI (Uniform Resource Identifier), the resource in the URI Device for downloading and providing the corresponding audio or image data. The method of claim 11, And if the provider of the multimedia subtitle is not a subtitle provider permitted by the user, the control unit ignores the multimedia subtitle. The method of claim 11, If the information on the location to be displayed is not included in the information on the multimedia subtitles, the controller compares the information on the location of the corresponding subtitle provider with the current location of the terminal to determine a location to display. Device. In the multimedia subtitle sharing method of the subtitle server, Receiving information about a multimedia subtitle of one type of text, image, or audio of a specific content from the terminal; And transmitting the information on the received multimedia subtitles to a user using the same content in real time. The method of claim 17, Generating a subtitle file using the received information about the multimedia subtitle, and updating the subtitle file for the content stored in the subtitle file database with the generated subtitle file; And receiving a subtitle download request for the corresponding content from another terminal, searching for and extracting the subtitle file for the content from the subtitle file database, and transmitting the subtitle file to the corresponding user. The method of claim 17, The information on the multimedia subtitles may include information about a display start time, display end time, text to be displayed, media format, media data, location to be displayed, size to be displayed, color to be displayed, a corresponding subtitle provider, and a location of the subtitle provider. At least one piece of information. The method of claim 19, Wherein the media format includes one of a text format, an audio format, and an image format, and defaults to the text format. The method of claim 19, The media data may include an identifier of predefined audio or image data, or a Uniform Resource Identifier (URI) to which the audio or image data is linked. In the multimedia subtitle sharing device, A terminal for transmitting information on the multimedia subtitles to the subtitle server when the user inputs the multimedia subtitles in one of text, image, and audio form for a specific content; And the caption server for real-time transmission of information on multimedia captions from the terminal to a user using the same content. The method of claim 22, wherein the subtitle server, After generating a subtitle file using the received information about the multimedia subtitle, and updating the subtitle file for the content stored in the subtitle file database with the generated subtitle file, a subtitle download request for the corresponding content is received from another terminal. When received, the device characterized in that for searching and extracting the caption file for the content in the caption file database and transmits it to the user. The method of claim 22, The information on the multimedia subtitles may include information about a display start time, display end time, text to be displayed, media format, media data, location to be displayed, size to be displayed, color to be displayed, a corresponding subtitle provider, and a location of the subtitle provider. And at least one piece of information. The method of claim 24, The media format includes one of a text format, an audio format, and an image format, and the text format is a default value, and the media data is an identifier of predefined audio or image data, or a corresponding audio or image data is linked. Device comprising a URI (Uniform Resource Identifier).

Images