KR100849492B1 - Apparatus and Method for Converting Format of Digital Content including Character in Video - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to an apparatus and method for converting a format of digital content in which text is included in a video.

2. The technical problem to be solved by the invention

According to the present invention, when converting DTV (Digital Television) content contained in the video into DMB (Digital Multimedia Broadcasting) content, the characters are extracted from the DTV content separately from the video, and then the extracted characters and the video are separately converted in format. And then combining them to create content for DMB, thereby preventing the loss of readability of characters due to changes in resolution and aspect ratio due to conversion of the content format. And to provide a method thereof.

3. Summary of Solution to Invention

The present invention provides a format conversion apparatus for digital content in which characters are included in video, comprising: preprocessing means for separating the DTV video from the DTV content; Video conversion means for converting the separated DTV video into a DMB video conforming to the DMB video standard; Character conversion means for extracting characters from the separated DTV video and converting the extracted characters into a character string for DMB conforming to the DMB standard; And DMB content generating means for generating DMB content using the converted DMB video and the converted DMB character string.

4. Important uses of the invention

The present invention is used for format conversion of digital content in which text is included in video.

Text, Video for DTV, Video for DMB, XMT, MP4, MPEG-2 Video, MPEG-4 AVC, DMB

Description

Apparatus and Method for Converting Format of Digital Content including Character in Video}

1 is a configuration diagram of an apparatus for converting a format of content for converting DTV content into content for DMB according to the present invention;

2 is a detailed configuration diagram of an embodiment of a character conversion unit in a content conversion apparatus for converting DTV content of FIG. 1 into DMB content according to the present invention;

3 is a flowchart illustrating a format conversion method of content for converting DTV content into DMB content according to the present invention;

FIG. 4 is a detailed flowchart illustrating a character conversion process in a format conversion method of content for converting the DTV content of FIG. 3 to DMB content according to the present invention.

* Explanation of symbols on the main parts of the drawing

110: preprocessor 120: video converter

130: audio converter 140: character converter

150: DMB content generation unit 141: video input unit

142: character extraction unit 143: string generation unit for DMB

The present invention relates to an apparatus and method for converting digital content in which text is included in video, and more particularly, to converting DTV (Digital Television) content in which text is included in video into digital multimedia broadcasting (DMB) content. After extracting text from DTV content separately from video, format the extracted text and video separately, and combine them to create DMB content, and then change the resolution and aspect ratio due to conversion of content format. The present invention relates to an apparatus and method for converting a format of digital content in which text is included in a video, which can prevent the loss of readability.

At present, the terrestrial DMB service is entering the commercialization service phase with the increase of social tools for mobile multimedia services. In terrestrial DMB, digital TV content retransmission service is emerging as an important service for early settlement of terrestrial DMB service.

Conventional image change technology is a technology that converts the aspect ratio of the content of the digital TV content to the terrestrial DMB content, which adjusts the aspect ratio of the digital TV content to the terrestrial DMB video To receive it at the terrestrial DMB terminal.

However, such a conventional technology reads a character that becomes unreadable due to a decrease in resolution and a change in aspect ratio in the process of converting a 1920 * 1080 HD digital TV video into a 320 * 288 terrestrial DMB video. There was a problem that loss appeared. For example, in the prior art, since the score is normally displayed on the upper right side of the sports relay, the left and right sides of the image may be cut off and the score display may be cut off due to the change of the aspect ratio. Because of this, the case of the character recognition is not possible. In this regard, characters are used in various forms in show programs, as well as sports relays, for example, so that the loss of characters can have a significant effect on the content content.

The present invention has been proposed to solve the above problems, and when the characters are converted into DMB (Digital Television) content contained in the video, DMB (Digital Multimedia Broadcasting) content, after extracting the characters from the DTV content separately from the video By converting the extracted text and video separately, and then combining them to create content for DMB, it is possible to prevent the loss of readability of the text by changing the resolution and aspect ratio due to the conversion of the content format. An object of the present invention is to provide an apparatus and method for converting digital content included in video.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. It will also be appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

According to an aspect of the present invention, there is provided a format conversion apparatus for digital content in which text is included in a video, the apparatus comprising: preprocessing means for separating the DTV video from the DTV content; Video conversion means for converting the separated DTV video into a DMB video conforming to the DMB video standard; Character conversion means for extracting characters from the separated DTV video and converting the extracted characters into a character string for DMB conforming to the DMB standard; And DMB content generating means for generating DMB content using the converted DMB video and the converted DMB character string. The present invention further includes audio converting means for converting the separated DTV audio into DMB audio conforming to the DMB audio standard.

On the other hand, the present invention, a method of converting the digital content of the text contained in the video, the pre-processing step of separating the DTV video from the DTV content; A video conversion step of converting the separated DTV video into a DMB video conforming to the DMB video standard; A character extraction step of extracting characters from the separated DTV video; Generating a character string for DMB by converting the extracted character into a character string for DMB conforming to the DMB standard; And generating a DMB content by using the converted DMB video and the generated DMB string. The present invention may further include an audio conversion step of converting AC-3 audio, which is the separated DTV audio, into MPEG-4 BSAC, which is DMB audio.

The present invention is to prevent the loss of readability of the character due to the change in resolution and aspect ratio due to the conversion of the content format.

To do this, extract characters from DTV content (video for 1920 * 1080 size HD digital TV) separately from the video, format the extracted characters and video separately, and combine them to combine DMB content (320 * 288). Creating terrestrial DMB video of size) allows the conversion of the format of digital content containing characters without loss of legibility.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Hereinafter, it is assumed that the content for terrestrial DTV is generated according to the domestic terrestrial DTV standard.

In addition, it is assumed that the content for terrestrial DMB is stored in an eXtensible MPEG-4 Textual format (XMT) and an MP4 file format. It is assumed that the XMT and MP4 file formats are the storage formats of the contents that conform to the MPEG-4 Systems standard, and since the terrestrial DMB contents follow the MPEG-4 Systems standard, they are used as the storage formats. Of course, since the transmission of the terrestrial DMB content follows the MPEG-2 TS format, the contents converted by the present invention will be finally converted into the MPEG-2 TS and transmitted.

Here, the scope of the present invention is not limited to the specific format of the terrestrial DTV content or the specific format of the terrestrial DMB content.

1 is a configuration diagram of an apparatus for converting a format of content for converting DTV content into DMB content according to the present invention. Hereinafter, each component will be described.

As illustrated in FIG. 1, the content converting apparatus includes a preprocessor 110, a video converter 120, an audio converter 130, a character converter 140, and a DMB content generator 150. .

The preprocessing unit 110 analyzes the input terrestrial DTV content and divides it into video, audio, and data. That is, the preprocessing unit 110 receives terrestrial DTV content in MPEG-2 Transport Stream (TS) format and separates video, audio, and data included in the input terrestrial DTV content, and includes program specific information (PSI) and AIT. (Application Information Table) and related descriptors are analyzed. The preprocessor 110 separates the video stream, the audio stream, and the data stream from the terrestrial DTV content using the analyzed information. In addition, the preprocessor 110 performs integration and control functions for the video converter 120, the audio converter 130, the character converter 140, and the DMB content generator 150.

The video converter 120 converts the DTV video separated by the preprocessor 110 into a DMB video conforming to the DMB video standard. That is, the video converter 120 converts the format of the MPEG-2 video, which is the DTV video, separated from the preprocessor 110 to MPEG-4 AVC (Advanced Video Coding), which is the DMB video, and converts the terrestrial DMB video. Convert the aspect ratio size (resolution) to the DMB standard. Accordingly, the video conversion unit 120 sets the resolution of the video to HD level at the QMBA (Quarter Video Graphics Array), QCIF (Quarter Common Intermediate Format), VDF (Variable Data File), or CIF (Common Intermediate) for DMB. Format).

The audio converter 130 converts the DTV audio separated by the preprocessor 110 into DMB audio that conforms to the DMB audio standard. That is, the audio converter 130 converts AC-3 audio used in terrestrial DTV into MPEG-4 bit sliced arithmetic coding (BSAC) for terrestrial DMB.

The character converter 140 extracts a character from the video for DTV separated by the preprocessor 110 and converts the extracted character into a character string for DMB conforming to the DMB standard. That is, the character converter 140 extracts the characters included in the DTV video separated by the preprocessor 110 and uses the extracted characters of the XMT format, which is an MPEG-4 content representation standard that satisfies the auxiliary data standard of the DMB. Convert to a string.

Here, the character conversion process according to the present invention is for converting the format of the characters included in the video, if the character itself is included in the video itself. On the other hand, if the video itself does not contain characters, in the case of DTV, if the content of the ACAP (Application Configuration Access Protocol) standard is included in the broadcast content, even if the video itself does not contain characters, the video is transmitted together with the video. The data may include characters. In addition, even in the case of teletext, subtitle broadcasting, and the like, even if the video itself has no text, the digital content contains text.

The DMB content generation unit 150 uses the DMB video converted by the video converter 120, the DMB audio converted by the audio converter 130, and the DMB character string converted by the character converter 140. Create content. That is, the DMB content generation unit 150 converts the XMT into an MP4 file to generate terrestrial DMB content.

Here, XMT is a framework for describing MPEG-4 Binary Format for Scene (BIFS) and Object Description (OD) in a text format. Since XMT is described as text, it is easy to exchange authored content among content authors, and an unencoded audio / video object can be used for content authoring, and information for encoding it can be stored separately.

FIG. 2 is a detailed configuration diagram of an exemplary embodiment of a character converter in a format converting apparatus for converting DTV contents of FIG. 1 into DMB contents according to the present invention. The character converter 140 includes a video input unit 141, a character extractor 142, and a DMB character string generator 143. Hereinafter, each component will be described.

The video input unit 141 performs a function of receiving a video for DTV separated from the preprocessor 110. That is, the video input unit 141 receives video data constituting the screen of the terrestrial DTV content.

The character extracting unit 142 extracts the confirmed character by checking the presence or absence of the character in the DTV video input by the video input unit 141. That is, when the MPEG-2 video is input, the character extractor 142 checks whether a character exists in the video. As a result of the check, the character extracting unit 142 extracts the character when the character exists. When extracting characters, the character extractor 142 extracts not only the characters themselves but also position and size information in the MPEG-2 video.

The DMB string generation unit 143 converts the characters extracted by the character extraction unit 142 according to the DMB standard to generate a terrestrial DMB string. That is, the DMB character string generation unit 143 converts the characters extracted by the character extraction unit 142 into an XMT storage format conforming to the terrestrial DMB standard, and converts the converted character strings using scene technology conforming to the MPEG-4 system standard. Create a character string for terrestrial DMB, or create a character string for terrestrial DMB using an image file. XMT and the like can be used for the content format for terrestrial DMB.

3 is a flowchart illustrating a format conversion method of content for converting DTV content into DMB content according to the present invention. Hereinafter, an operation of an apparatus for converting format of digital content in which text is included in a video will be described.

First, when terrestrial DTV content is input (300), a preprocessing process for separating the video, audio, and data included in the terrestrial DTV content by analyzing the input terrestrial DTV content is performed (302).

The separated video and audio in the preprocessing are converted into terrestrial DMB video (MPEG-4 AVC) and terrestrial DMB audio, respectively (304).

In the preprocessing process, the separated video is analyzed, and when a character is included in the analyzed video, a character included in the video is extracted (306), and a character string for terrestrial DMB is generated using the extracted character (308).

The character string generation process 308 uses a method of generating a character string using a scene description defined in the MPEG-4 system standard, or a method of converting a character string into an image file (for example, a JPEG image). Can be performed. Here, a method of generating a string using the scene technology defined in the MPEG-4 Systems standard may include a method using a text node, a method using geometric object nodes such as lines, a text node and a geometric object node. Method and the like.

Terrestrial DMB content is converted by terrestrial DMB video, terrestrial DMB audio, and terrestrial DMB strings generated in terrestrial DMB string generation process 308 to generate terrestrial DMB contents (310). ).

FIG. 4 is a detailed flowchart illustrating a character conversion process in a format conversion method of content for converting the DTV content of FIG. 3 to DMB content according to the present invention. Hereinafter, the character extraction method and the character generation method in the content conversion method will be described in detail.

In the preprocessing process of FIG. 3, the separated video is analyzed to determine whether there is a character in the video (400), and if a character exists in the video, the character is extracted (402). Here, in the character extraction, not only the character itself but also the position and size information of the character in the MPEG-2 video are extracted together. If there is no character in the video, the digital content conversion process is performed without the character extraction process.

The size and generation position of the character string for the terrestrial DMB content are determined using the characters extracted in the character extraction process 402 (404). Here, the size of the string may be determined in consideration of the character size in MPEG-2 video and readability when converted to terrestrial DMB, and the position of the string is converted into character position and terrestrial DMB video in MPEG-2 video. The position at the time of use can be considered and determined. In this case, when the position on the MPEG-2 video does not exist when it is converted for the terrestrial DMB, the converted character string may be inserted at a predetermined position or an arbitrary position.

After the character is extracted in step 402, and the generation position of the string and the size of the string are determined in the step 404, a string generation method for generating the string using the character, the generation position and the size of the string is determined. (406). Here, the string generation method refers to a method of generating a string using the scene description defined in the MPEG-4 system standard as described above. The string generation method 406 includes a method of using a text node, a method of using geometric object nodes such as lines, and a method of generating a string using both text nodes and geometric object nodes. A suitable method is selected from these string generation methods.

According to the character string generation method determined in step 406, a string is generated 408, and the generated string may be stored in an XMT or MP4 format.

Embodiments of the method for extracting / generating characters according to the present invention may be automatically performed, and as another embodiment to the present invention, may be semi-automatically performed by human intervention. For example, there may be a method of designating a position at which a character is located or a position at which a character string is inserted according to a request from a user.

In this way, by extracting and converting characters from video data constituting one screen and inserting them according to the MPEG-4 Systems standard of the converted string terrestrial DMB content, it is possible to prevent the readability of the characters occurring during the content conversion process. have. In addition, since the server providing the terrestrial DMB content converts the characters and inserts them into the terrestrial DMB content, the structure of the terrestrial DMB terminal does not need to be changed.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

As described above, the present invention extracts and converts characters from video data constituting one screen, and inserts the converted character string into terrestrial DMB content according to the MPEG-4 system standard, thereby resulting in a resolution and a screen generated during the content conversion process. There is an effect that can prevent the readability of the character due to the change of proportion.

In addition, the present invention, by converting the characters on the server side providing the terrestrial DMB content and inserted into the terrestrial DMB content, there is an effect that can be easily compatible with the structure of the existing terrestrial DMB terminal.

Claims (14)

In the apparatus for converting the format of digital content in which characters are included in the video, Preprocessing means for separating the DTV video from the DTV content; Video conversion means for converting the separated DTV video into a DMB video conforming to the DMB video standard; Character conversion means for extracting characters from the separated DTV video and converting the extracted characters into a character string for DMB conforming to the DMB standard; And DMB content generation means for generating DMB content using the converted DMB video and the converted DMB character string; The apparatus for converting the format of digital content, the character comprising a video. The method of claim 1, The pretreatment means, Separating the DTV audio from the DTV content, The apparatus may further include audio conversion means for converting the separated DTV audio into DMB audio conforming to the DMB audio standard. The DMB content generating means, And digitally generating DMB content using the converted DMB video, the converted DMB string, and the converted DMB audio. The method of claim 2, The audio conversion means, And converting the AC-3 audio, which is the separated DTV audio, into MPEG-4 bit sliced Arithmetic Coding (BSAC), which is DMB audio. The method according to any one of claims 1 to 3, The pretreatment means, Analyzing program specific information (PSI), application information table (AIT), descriptor (descriptor) of the DTV content, and separating the DTV video or DTV audio from the DTV content by using the analyzed result A device for converting the format of digital content containing a character to the video. The method of claim 4, wherein The video conversion means, Characters characterized by converting the format of the MPEG-2 video, the separated DTV video to MPEG-4 AVC (Advanced Video Coding), which is a DMB video, and converts the aspect ratio of the video for the DMB to DMB standard Format conversion device for digital content contained in the video. The method of claim 5, wherein The character conversion means, Video input means for receiving the separated DTV video; Character extracting means for checking the presence or absence of characters in the DTV video received by the video input means and extracting the identified characters; And DMB character string generation means for generating the character string for DMB by converting the extracted characters in accordance with the DMB standard The apparatus for converting the format of digital content, the character comprising a video. The method of claim 6, The DMB character string generation means, The extracted character is converted into an XMT storage format conforming to the DMB standard, and the converted character is generated using a scene technology conforming to the MPEG-4 system standard, or a character string for DMB is generated using an image file, or a character string for DMB is generated. And a format conversion apparatus for digital content in which characters are included in the video. The method of claim 6, The DMB content generating means, Characters included in the video are characterized by generating the DMB content by converting the converted DMB video, the converted DMB audio, and the converted DMB character string into an MP4 storage format conforming to the MPEG-4 system standard. Format conversion device for content. In the format conversion method of the digital content containing the text, A preprocessing step of separating the DTV video from the DTV content; A video conversion step of converting the separated DTV video into a DMB video conforming to the DMB video standard; A character extraction step of extracting characters from the separated DTV video; Generating a character string for DMB by converting the extracted character into a character string for DMB conforming to the DMB standard; And DMB content generation step of generating DMB content using the converted DMB video, the generated DMB string Method for converting the format of the digital content that contains a character containing a video. The method of claim 9, The pretreatment step, Analyze the program specific information (PSI), the application information table (AIT), the descriptor (descriptor) of the DTV content, and separate the DTV video or the DTV audio from the DTV content by using the analyzed result, The audio conversion step of converting the separated DTV audio AC-3 audio to DMB audio MPEG-4 BSAC, further comprising: The DMB content generation step, And digitally generating DMB content using the converted DMB video, the generated DMB string, and the converted DMB audio. The method of claim 10, The video conversion step, Characters characterized by converting the format of the MPEG-2 video, which is a video for DTV separated in the preprocessing step to MPEG-4 AVC, which is a DMB video, and converts the aspect ratio of the video for the DMB in accordance with the DMB standard How to convert the format of digital content contained in video. The method according to any one of claims 9 to 11, The character extraction step, Character presence check step of confirming the presence or absence of characters in the video for DTV separated in the pre-processing step; And Extraction step of extracting the checked character from the video for DTV only when there is a character in the character check step Method for converting the format of the digital content that contains a character containing a video. The method of claim 12, The string generation step, A character string size and position determination step of determining a size and a generation position of a character string for DMB for DMB content using the character extracted in the character extraction step; A character string generation method determining step of determining a character string generation method using a text node or a geometric object node which is a scene description according to the MPEG-4 system standard; And DMB string generation step of generating a string for DMB by converting to the XMT storage format by using the determined size, generation position, generation method Method for converting the format of the digital content that contains a character containing a video. The method of claim 13, The DMB string generation step, When the size and position of the character string are not determined in the character string size and position determination step, the character string may be included in the video by inserting the converted character string into a predetermined generation position or a predetermined position. Format conversion of digital content.

Images