KR101438447B1 - An apparatus for displaying 3-dimensional subtitles and the method thereof - Google Patents

Abstract

Dimensional stereoscopic caption is generated in a multi-type open system using Unicode which supports the worldwide languages, and then a three-dimensional stereoscopic caption is displayed in real time together with the content using a parallel buffer, and further, The present invention relates to a three-dimensional subtitle display apparatus and a method thereof, which can prevent a font from being broken by allowing a point of a glyph outline to be adjusted when displaying a stereoscopic three-dimensional subtitle.

Description

TECHNICAL FIELD [0001] The present invention relates to a three-dimensional subtitle display apparatus,

The present invention relates to a three-dimensional subtitle display apparatus and method thereof, and more particularly, to a three-dimensional subtitle display apparatus and method thereof capable of displaying three-dimensional stereoscopic subtitles in a multi-type open system using Unicode And more particularly, to a three-dimensional subtitle display apparatus and method thereof.

Recently, three-dimensional stereoscopic images, which are displayed through movies and television, are increasing.

However, the biggest problem in viewing the three-dimensional stereoscopic image relates to subtitle processing. For example, in 3D stereoscopic images, certain objects are projected to the front of the screen or sometimes deeper than the screen to allow the viewer (user) to feel a stereoscopic effect. Since the subtitles are displayed in two dimensions, And it is always displayed on the surface of the screen, so that it is unnatural, and there is also a problem that fatigue is added to the eyes of the viewer.

Unlike the case of viewing a two-dimensional image, when a three-dimensional image is viewed, a two-dimensional image is mixed with the three-dimensional image. Therefore, in order to solve the above problems, it is necessary to generate and display a three-dimensional stereoscopic caption suitable for a three-dimensional stereoscopic image.

On the other hand, the subtitles are classified into various categories according to their purposes and contents. The subtitles include a title caption for informing the title of the work, a caption for informing the name of the performer and the creator, a guide caption for indicating the place and time of the scene And metabolic subtitles representing conversations among people. In recent years, the number of subtitles produced using Universal Code System (UCS) has increased. In general, 7 bits of English, 8 bits of non-English characters, and 16 bits of Japanese characters are used for each character of a code. Unicode is an international character code system in which all of them are unified into 16 bits.

Therefore, when the 3D stereoscopic caption is generated using the Unicode, it is possible to display the 3D stereoscopic caption in various other systems in various countries with different languages. However, in the related art, there has not been provided a method of generating and displaying a three-dimensional stereoscopic caption in real time using Unicode when reproducing a content, or a method of naturally displaying a font (font) without breaking it.

As a background art of the present invention, a subtitle production system disclosed in Korean Patent Laid-Open Publication No. 10-2009-0131629 (Dec. 29, 2009) is a system in which caption data for real time caption broadcasting is transmitted through a plurality of subtitle input devices connected to one host device A method for inputting a caption and editing a plurality of inputted shorthand data into one caption and creating the caption is proposed. Also, a method for generating a caption for a personal portable terminal disclosed in Korean Patent Laid-open Publication No. 10-2005-0116350 (Dec. 12, 2005) A multimedia data editing and providing apparatus and method synchronizes a caption file such as a lyric file or a text file in a Unicode form corresponding to digital contents output from a portable digital audio and video player to corresponding digital contents, Means for automatically displaying an image on the display means, Dimensional stereoscopic caption in real time by using Unicode and does not propose to prevent the font (font) from being broken when displaying a three-dimensional stereoscopic caption. In this case, There is a difference in the purpose, constitution and effect of the invention.

The present invention has been made in order to solve the above problems, and it is an object of the present invention to provide a stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic stereoscopic A three-dimensional subtitle display apparatus and method thereof are provided.

Another object of the present invention is to provide a three-dimensional subtitle display apparatus and method capable of adjusting a font (font) so as not to be broken when displaying a three-dimensional stereophonic subtitle generated using Unicode It has its purpose.

According to an aspect of the present invention, there is provided a three-dimensional subtitle display apparatus including: a content reproducing unit for reproducing a content; A three-dimensional caption processing unit for generating a three-dimensional stereoscopic caption by calling a caption of Unicode format and reproducing the three-dimensional stereophonic caption in real time together with the content to be reproduced by using a parallel buffer; A user interface unit for adjusting a point of a glyph outline with respect to a specific font of the three-dimensional stereoscopic caption to prevent the font from being broken; Wherein the three-dimensional caption processing unit comprises: a two-dimensional caption processing unit for converting the caption of the Unicode format into a two-dimensional graphic image; Wherein the user interface unit is configured to convert the caption converted into the two-dimensional graphic image into a three-dimensional stereographic image to generate a three-dimensional stereoscopic caption, wherein the user interface unit enlarges the font of the three- And the coordinate information of the changed point is automatically updated when the user selects a specific point and changes its position, and the user interface unit is configured by a graphical user interface method.

According to another aspect of the present invention, there is provided a method of displaying three-dimensional subtitles, A second step of reproducing the content using the parallel buffer and reproducing the stereoscopic caption in real time; A third step of adjusting a point of a glyph outline with respect to a font of the stereoscopic caption to be reproduced to prevent the font from being broken; Wherein the second step is performed on the user interface so as to reproduce the font of the caption and display the point to be adjusted so that the user can mutually adjust the font, And the subtitles are characterized in that a common worldwide language is supported by a plurality of production systems.

The present invention has an effect of enabling generation and display of three-dimensional stereoscopic caption in an open system of many types of countries in different languages by displaying the three-dimensional stereoscopic caption generated using Unicode.

In addition, the present invention has the effect of preventing the font from being broken by adjusting the point of the outline glyph of the font (font) naturally when displaying the generated three-dimensional stereoscopic caption using Unicode.

FIG. 1 is a block diagram showing a schematic configuration of a three-dimensional subtitle display apparatus according to an embodiment of the present invention,
FIG. 2 is a block diagram showing a schematic configuration according to an embodiment of the three-dimensional caption processing unit in FIG. 1,
FIG. 3 is an exemplary diagram for explaining the operation of the user interface unit in FIG. 1,
4 is a flowchart illustrating a method of displaying a 3D subtitle according to an exemplary embodiment of the present invention.

Hereinafter, an embodiment of a three-dimensional subtitle display apparatus and method according to the present invention will be described with reference to the accompanying drawings.

FIG. 1 is a block diagram showing a schematic configuration of a three-dimensional subtitle display apparatus according to an embodiment of the present invention. As shown in FIG. 1, a subtitle file of Unicode format is called up to convert the subtitle into a two- A three-dimensional caption processing unit (200) for converting the caption converted into the two-dimensional graphic image into a three-dimensional three-dimensional graphic image; A user interface unit 300 for adjusting a point of a glyph outline to prevent a font from being broken, a content playback unit 400 for playing back image content, And a display unit 500 for outputting a stereoscopic caption.

The two-dimensional subtitle processor 100 processes the subtitle into a TrueType font. The TrueType font is an outline font used for screen display and printing, and has a feature in that a coarse line is not visible even if the character size increases.

The three-dimensional subtitle processing unit 200 converts the two-dimensional subtitle of the TrueType font into a three-dimensional stereographic subtitle. That is, a three-dimensional stereoscopic three-dimensional caption having a three-dimensional effect is generated by synthesizing the right and left images of the two-dimensional caption to have a specific depth. At this time, when the texture, illumination, or specific expression attribute used in the caption is set, it is also applied to generate a 3D caption.

However, when the three-dimensional stereophonic caption having a certain depth is generated as described above, the font may be broken as shown in FIG. 3 (a), depending on the character shape. For example, when a specific depth is applied to a character according to the shape of each country, a first glyph outline (Glyph Outline 1) and a second glyph outline (Glyph Outline 2) may be formed in the font of the character . That is, the font may be broken.

Accordingly, the user interface unit 300 adjusts a point of a glyph outline with respect to the font of the subtitle converted into the 3D graphic image, thereby preventing the font from being broken. For example, as shown in FIG. 3 (b), specific points are adjusted in accordance with any one of the glyph outlines (e.g., Glyph Outline 1).

At this time, it is preferable that the coordinates of the point to be adjusted can be automatically changed in correspondence with a depth applied using a specific function. It is also preferable that the coordinates of the point to be adjusted can be changed corresponding to the letters of each country. In addition, it is preferable that the glyph-out-line coordinate information for the adjusted font is stored in a specific memory (not shown) so that it can be referred to the same font.

3, the user interface unit 300 enlarges and displays the fonts of the subtitles at a predetermined ratio (for example, 1,000 times), and the user interface unit 300 is configured such that the user can adjust each point in an interactive manner . For example, when the user selects a specific point of the font and changes its position, the coordinate information of the changed point is automatically updated. Therefore, it is preferable to apply a graphic user interface (GUI) scheme to implement the above operation.

The three-dimensional caption processing unit 200 outputs the reproduced content, three-dimensional stereoscopic caption, or a combination thereof to the display unit 500 using the parallel buffers 280 and 290. By using the parallel buffers 280 and 290 as described above, it is possible to improve the throughput of each buffer, which has a limitation on the processing speed, to enable the real time display of the subtitles corresponding to the reproduced contents. In addition, the 3D caption processing unit 200 is configured to operate in an open system (e.g., open GL).

The content reproducing unit 400 reproduces the 3D image content, inputs the reproduced content to the 3D caption processing unit 200 according to the configuration of the apparatus, synthesizes the 3D content with the 3D stereoscopic caption, Alternatively, the display unit 500 may separately input the content to be reproduced and the three-dimensional stereoscopic caption, and output the combined content.

The display unit 500 may process the content to be reproduced and the three-dimensional stereoscopic caption together and output the same to a specific display device (e.g., a LCD monitor or a CRT monitor). The display unit 500 may include the specific display device (e.g., a LCD monitor or a CRT monitor), and the function of the display unit 500 may be included in the 3D caption processing unit 200, The three-dimensional subtitle processor 200 may process the content and the three-dimensional stereophonic subtitles together.

FIG. 2 is a block diagram showing a schematic configuration according to an embodiment of the three-dimensional caption processing unit in FIG. 1. Referring to FIG. 2, the three-dimensional caption processing unit 200 extracts caption data Subtitle) is divided into pixel data and vertex data.

The vertex data includes vertex coordinates of a vertex of a font (e.g., a font of a caption converted into a graphic image) constituting the caption data, a normal, a color, texture coordinate), and the pixel data is data related to each pixel of the image constituting the caption data. The vertex data is stored in a vertex buffer (not shown).

The 3D caption processing unit 200 includes a display list 210, a vertex operation 220, a primitive assembly 230, a pixel operation unit 240, A texture memory 250, a rasterization 260, a fragment operation 270, and a plurality of frame buffers 280 and 290.

The display list unit 210 stores a three-dimensional caption graphic image to be displayed on the screen, and displays it when necessary. When caption data (caption converted into a graphic image) stored in the display list unit 210 displays captions having the same content, the same caption is continuously updated for a specific time.

The vertex processing unit 220 receives the caption data stored in the display list unit 210 or the newly inputted caption data, and performs three-dimensional conversion on the vertices constituting the font. If a texture is used in the font, the texture coordinates are generated and projected, and if there is lighting, it is computed, and if the rendering attribute is set, it is also computed and processed.

The primitive assembling unit 230 assembles the set of vertices constituting the font in the vertex-processed caption data into basic elements such as a line segment and a polygon.

The pixel operation unit 240 receives the caption data stored in the display list unit 210 or caption data to be newly input, and performs three-dimensional conversion on each pixel constituting the font. At this time, the texture information is separated from the processed caption data and stored in the texture memory 250.

The rasterization unit 260 receives vertex data and texture information, which are still expressed in a vertex shape, and converts the vertex data and the texture information into pixels of a frame buffer. That is, the vertex data, the pixel data, and the texture data are rasterized to convert them into fragments. Where each fragment includes color, depth, line thickness, point thickness, anti-aliasing, and the like, with each fragment corresponding to one pixel of the frame buffer.

The fragment operation unit 270 performs a fragment operation before the rasterized values are actually stored in the frame buffers 280 and 290 to change or remove specific fragments. The fragment operation unit 270 calculates the depth and the like and updates the pixels in the frame buffers 280 and 290.

The plurality of frame buffers 280 and 290 are buffers for processing data processed in the fragment operation unit 270 in parallel and sequentially store the subtitle images output from the fragment operation unit 270 for each frame . For example, one of the three-dimensional converted caption images (e.g., left image) is stored in the first frame buffer 280 and the other (e.g., right image) is sequentially stored in the second frame buffer 290 .

The left image (not shown) and the right image (not shown) of the subtitles stored in the respective frame buffers 280 and 290 are input to the pixel arithmetic unit 240 for processing, And to repeatedly process the caption data stored in the frame buffer (280, 290) for display. By configuring the frame buffers 280 and 290 as parallel buffers as described above, the limitation of the data processing speed of one frame buffer is improved, and the real time display of the subtitles is enabled in accordance with the contents to be reproduced.

3 is an exemplary diagram for explaining the operation of the user interface unit in FIG. As shown, when generating three-dimensional stereophonic characters having a specific depth, a plurality of glyph outlines (Glyph Outline 1, Glyph Outline 2) as shown in (a) occur for a character font of a specific language . That is, it is assumed that the font is broken.

Accordingly, the user (device manufacturer) enlarges and displays the character font for the specific language at a specific rate (for example, 1,000 times) through the user interface unit 300. The user can select a specific point in the enlarged font and change the position in accordance with the specific glyph outline.

When the user changes the position of a specific point in the font as described above, the coordinate information of the changed point is automatically updated and stored in a specific memory (not shown), and the same language (or the same font) So that it is possible to prevent the font from being broken by displaying the coordinate information with reference to the coordinate information.

Meanwhile, although not described in detail in the above embodiment, the three-dimensional subtitle display apparatus according to the present invention may further include a controller (not shown) or a subtitle processor (not shown) for controlling the blocks constituted as described above .

FIG. 4 is a flowchart for explaining a three-dimensional subtitle display method according to an embodiment of the present invention. When a content is reproduced, a controller (not shown) or a subtitle processor (not shown) A stereoscopic three-dimensional caption is created by calling a caption file of a Unicode format synchronized with the content (S110).

As described in one embodiment of the present invention, a method of generating a three-dimensional stereophonic caption by converting a caption file of Unicode format into a two-dimensional caption graphic of a TrueType font format Dimensional stereoscopic caption can be generated by converting the 2D caption graphic into a 3D caption graphic. For example, the three-dimensional stereoscopic caption is a subtitle representing a stereoscopic effect by synthesizing a left-image caption and a right-image caption after they are generated.

 The three-dimensional stereoscopic caption (for example, left image caption, right image caption) generated as described above is reproduced in real time together with the content to be reproduced using the parallel buffer (S120).

For example, the three-dimensional stereoscopic caption (three-dimensional caption in which a left caption and a right caption are combined) is sequentially stored in the parallel buffer corresponding to the frame of the content to be reproduced, The synthesized three-dimensional subtitle is stored in the first frame buffer, the second synthesized three-dimensional subtitle is stored in the second frame buffer, and then reproduced sequentially). Alternatively, the left image subtitle and the right image subtitle are sequentially stored in the parallel buffer in correspondence with the frame of the content, and are reproduced (e.g., the left image subtitle and the right image subtitle are respectively reproduced in the first frame buffer and the second frame buffer, , And then sequentially reproduced).

On the other hand, when the content and the three-dimensional stereoscopic caption are reproduced in real time, if the font of the caption is broken, the glyph outline of the font is adjusted through a user interface that can adjust the point of the glyph outline with respect to the font S130). At this time, the font information (e.g., coordinate information) of which the glyph outline is adjusted is stored in a separate memory (S140).

Accordingly, when the subtitle of the same font as the font of which the glyph out line is adjusted is reproduced (or displayed), the glyph outline information is reproduced with reference to the glyph outline information stored in the memory (not shown). Accordingly, the user (or the apparatus manufacturer) adjusts the glyph outline only once, and can later reproduce the subtitle referring to the glyph outline information, thereby preventing the font from being broken.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. I will understand. Accordingly, the technical scope of the present invention should be defined by the following claims.

100: two-dimensional subtitle processing unit 200: three-dimensional subtitle processing unit
210: display list unit 220: vertex processing unit
230 primitive assembling unit 240 pixel operation unit
250: texture memory 260: rasterizer
270: fragment operation unit 280, 290: frame buffer
300: user interface unit 400: content playback unit
500:

Claims (8)

A contents reproducing unit for reproducing the contents;
A three-dimensional caption processing unit for generating a three-dimensional stereoscopic caption by calling a caption of the Unicode format and reproducing the three-dimensional stereoscopic caption in real time together with the content reproduced by the content reproduction unit using a parallel buffer;
A user interface unit for adjusting a point of a glyph outline with respect to a specific font of the three-dimensional stereoscopic caption to prevent the font from being broken; Dimensional stereoscopic image of the three-dimensional stereoscopic image. The method according to claim 1,
The three-dimensional caption processing unit includes:
A two-dimensional caption processing unit for converting the caption of the Unicode format into a two-dimensional graphic image; Further comprising:
Dimensional stereoscopic image, and converts the caption converted into the two-dimensional graphic image into a three-dimensional stereoscopic graphic image to generate a three-dimensional stereoscopic caption. The method according to claim 1,
The user interface unit,
Dimensional stereoscopic caption is enlarged and displayed at a specific ratio, and when the user selects a specific point and changes its position, the coordinate information of the changed point is automatically updated. Device. The method according to claim 1,
The user interface unit,
Dimensional stereoscopic display apparatus according to claim 1, A first step of reproducing the content;
A second step of reproducing the contents using a parallel buffer and real-time three-dimensional stereoscopic caption reproduction;
A third step of adjusting a point of a glyph outline with respect to a font of a three-dimensional stereoscopic caption to be reproduced to prevent the font from being broken; Dimensional stereoscopic image of the three-dimensional stereoscopic image. The method of claim 5,
A three-dimensional stereoscopic caption display method comprising: reproducing a three-dimensional stereoscopic caption font, displaying a point to be adjusted, and providing a user interface so that a user can adjust each point interactively. The method of claim 5,
Dimensional stereoscopic caption display method according to claim 1, wherein the three-dimensional stereoscopic caption display method comprises: The method of claim 5,
Wherein the three-dimensional stereoscopic caption is generated in an open system of a plurality of types using Unicode supporting a plurality of languages, and the three-dimensional stereoscopic caption can be displayed without breaking the font.

Images