KR20240062731A - Method for synchronizing subtitles data and av data - Google Patents

Abstract

A method of operating a video playback device, comprising: receiving a video stream from a server connected through a network; separating the video stream into AV (AudioVideo) data and a plurality of subtitle data; storing the AV data with a set show timestamp (Show Timestamp) unit, grouping the plurality of subtitle data into the show timestamp unit, and controlling the divided AV data and at least one subtitle data belonging to the same show timestamp section to be output on the same screen. Includes steps.

Description

Method for synchronizing AV data and subtitle data {METHOD FOR SYNCHRONIZING SUBTITLES DATA AND AV DATA}

This disclosure relates to a method of synchronizing AV (AudioVideo) data and subtitle data.

In real-time channel services such as terrestrial broadcasting, AV data and subtitle data are received separately by a set-top box, and the set-top box outputs AV data and subtitle data as one real-time channel data according to a designated method.

However, conventionally, the AV stream and subtitle data are processed in one thread cycle. Since the structure is to draw subtitles graphically on the video as subtitle data is received, problems with readability such as spacing and line breaks occur.

When processed with one thread cycle, the AV stream and subtitle stream are controlled sequentially according to one time logic, so the AV data and subtitle data may not be well synchronized. This is because the subtitle data itself was created to help hearing impaired people understand. Therefore, the shape of the person's mouth on the AV screen and the content of the subtitle data may not match each other.

In addition, the delay time that occurs while drawing subtitle graphics causes synchronization with video/audio, making viewing difficult, making it very inconvenient to use. Closed caption, which is subtitle data, converts voice to text, and the conversion time takes approximately 2 to 3 seconds, so there is a difference between the time of AV transmission and the time of transmission of the subtitle data. In order to synchronize subtitle data and AV data, it is necessary to receive a video stream, synchronize it by an encoding server, store the synchronized video stream on the server, and then stream it again from the server. It is necessary to expand the server so that it can be stored in the buffer. However, this is difficult to implement in practice because each IPTV (Internet Protocol Television) operator faces enormous cost problems due to server expansion.

Therefore, conventional services are limited to providing subtitles for the hearing impaired. For reasons such as the government's guide to guaranteeing the viewing rights of the hearing impaired, the subtitle function was mandatory and applied to IPTV devices. However, due to the various inconveniences mentioned above, IPTV operators turn off subtitles by default and provide subtitle services when the user turns on the subtitle function.

However, when turning on the subtitle function, users often turn off the subtitle function because the synchronization between the subtitles and the video is not correct or the readability of the subtitles is poor. As such, the conventional subtitle service is somewhat inconvenient for general customers to use, and the utilization rate is low.

The present disclosure processes two threads in parallel by dividing them into a video thread that processes both AV (AudioVideo) data and subtitle data and a subtitle thread that processes only subtitle data, and sets them based on screen settings and/or subtitle settings. Multiple subtitle data are grouped based on a Show TimeStamp, AV data is divided and grouped based on the show timestamp, and AV data belonging to the same group and multiple subtitle data are synchronized to display one screen. It provides a method of printing to .

According to one feature, a method of operating a video playback device includes the steps of receiving a video stream from a server connected through a network, separating the video stream into AV (AudioVideo) data and a plurality of subtitle data, and dividing the AV data into dividing into units of set show timestamps, grouping the plurality of subtitle data into units of show timestamps, and matching the current show timestamp of the AV data output on the screen to the current show time. It includes the step of outputting subtitle data belonging to the stamp on the screen.

Before the dividing step, it may further include calculating the maximum number of characters to be output on one line using at least one of character size, screen ratio, and resolution, and setting the calculated maximum number of characters as the show timestamp size. You can.

Before the setting step, it further includes the step of checking the screen ratio, resolution, and font size level according to the user input, and the setting step includes setting the maximum number of characters for each screen ratio, resolution, and font size level. From the mapped table, you can check the maximum number of characters corresponding to the confirmed screen ratio, resolution, and font size level, and set the confirmed maximum number of characters as the show timestamp size.

Before the setting step, a step of setting the show timestamp size using the STC (System Time Clock) used when calculating the PTS (Presentation Time Stamp) may be further included.

Before the separating step, it further includes the step of determining whether the video stream is a multi-thread target based on a channel number or content identifier through which the video stream is received, and the separating step includes determining whether the video stream is a multi-thread target. The video stream can be separated into multiple subtitle data and AV data.

According to the embodiment, the show timestamp that can be most efficiently displayed on the screen is set, thereby improving subtitle readability in real-time channels.

Additionally, AV output and subtitles are synchronized and displayed together according to the show timestamp, thereby improving inconvenience in AV viewing.

In addition, it can be usefully applied to various subtitle services, such as users who watch TV after setting it to mute and users who need to use the subtitle service to improve their ability to hear words.

In addition, it is expected to be widely used in various fields such as games, real-time VR (Virtual Reality), and various AI (Artificial Intelligence) terminals.

In addition, convenience of use can be improved at the endpoint IPTV terminal regardless of the status of the subtitle data and without physical costs such as expansion of IPTV servers for each service provider.

Figure 1 is a block diagram showing the configuration of a video playback device that performs subtitle synchronization according to an embodiment.
Figure 2 is a conceptual diagram explaining subtitle synchronization according to an embodiment.
Figure 3 is an example screen showing subtitle synchronization applied according to the embodiment of Figure 2.
FIG. 4 is a conceptual diagram illustrating conventional subtitle synchronization for comparison with the embodiment of the present invention in FIG. 2.
Figure 5 is an example screen according to subtitle synchronization in Figure 4.
Figure 6 is a flowchart showing a subtitle synchronization method of a video playback device according to an embodiment.
Figure 7 is a block diagram showing the hardware configuration of a video playback device according to an embodiment.

Below, with reference to the attached drawings, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily practice them. However, the present disclosure may be implemented in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present disclosure in the drawings, parts that are not related to the description are omitted, and similar parts are given similar reference numerals throughout the specification.

Throughout the specification, when a part is said to “include” a certain element, this means that it may further include other elements rather than excluding other elements, unless specifically stated to the contrary.

In addition, terms such as “…unit”, “…unit”, and “…module” used in the specification refer to a unit that processes at least one function or operation, which may be implemented through hardware or software or a combination of hardware and software. You can.

The devices described in the present invention are composed of hardware including at least one processor, a memory device, a communication device, etc., and a program that is executed in conjunction with the hardware is stored in a designated location. The hardware has a configuration and performance capable of executing the method of the present invention. The program includes instructions that implement the operating method of the present invention described with reference to the drawings, and executes the present invention by combining it with hardware such as a processor and memory device.

In this specification, “transmission or provision” may include not only direct transmission or provision, but also indirect transmission or provision through another device or using a circuitous route.

In this specification, expressions described as singular may be interpreted as singular or plural, unless explicit expressions such as “one” or “single” are used.

In this specification, the same reference numbers refer to the same elements regardless of the drawings, and “and/or” includes each and all combinations of one or more of the mentioned elements.

In this specification, terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be referred to as a second component, and similarly, the second component may be referred to as a first component without departing from the scope of the present disclosure.

In the flowchart described herein with reference to the drawings, the order of operations may be changed, several operations may be merged, certain operations may be divided, and certain operations may not be performed.

FIG. 1 is a block diagram showing the configuration of a video playback device that performs subtitle synchronization according to an embodiment, FIG. 2 is a conceptual diagram explaining subtitle synchronization according to an embodiment, and FIG. 3 is a block diagram according to the embodiment of FIG. 2. This is an example screen with subtitle synchronization applied. FIG. 4 is a conceptual diagram explaining conventional subtitle synchronization for comparison with the embodiment of the present invention in FIG. 2, and FIG. 5 is an example screen according to subtitle synchronization in FIG. 4.

First, referring to FIG. 1, the video playback device 100 communicates with the server 300 through the network 200. The video playback device 100 receives a video stream including AudioVideo (AV) data and a plurality of subtitle data related to the AV data from the server 300.

The video stream may be a real-time broadcast channel stream. Alternatively, the video stream may be a real-time closed caption broadcast, such as a TV replay VOD service.

The video playback device 100 includes a video stream receiver 110, a subtitle processing unit 120, an image processing unit 130, a playback processing unit 140, a display device 150, a subtitle management unit 160, and a subtitle setting unit 170. , and a screen setting unit 180.

The video playback device 100 and the display device 150 may be separate hardware devices or may be implemented as the same hardware device as shown in FIG. 1 .

The video playback device 100 may be a set-top box, a vehicle terminal, etc.

The video stream receiver 110 receives a video stream from the server 300 through the network 200. The received video stream includes AV data and a plurality of subtitle data.

The video stream receiver 110 may determine whether the received video stream is subject to multi-threading, that is, whether it is subject to the embodiment of the present invention.

According to one example, the video stream receiver 110 checks whether the channel number of the received video stream is a real-time channel broadcast based on the IPTV (Internet Protocol Television) schedule, and if confirmed to be a real-time channel broadcast, multi-threading is applied. You can judge. In addition, subtitle data is not applied to all real-time channels and is usually provided only on some broadcasting channels such as terrestrial channels, so if it is a real-time channel broadcast that provides a subtitle service, it can be determined to be subject to multi-threading.

Additionally, the video stream receiver 110 may determine that multi-threading is applicable in the case of a VOD (Video On Demand) service in which subtitle data is provided based on the content identifier of the video stream.

If the video stream receiver 110 determines that the received video stream is subject to multi-threading, it separates the video stream into AV data and subtitle data. The video stream receiver 110 allocates AV data to the video thread and subtitle data to the subtitle thread. At this time, the subtitle thread is processed by the subtitle processing unit 120, and the video thread is processed by the image processing unit 130.

In general, a thread may refer to a unit of flow or task performance that runs within a processor.

The subtitle processing unit 120 processes the subtitle thread.

The subtitle processing unit 120 provides subtitle data to the subtitle management unit 160. The subtitle management unit 160 performs screen settings and/or subtitle settings on the subtitle data and then provides the subtitle data with the screen settings and/or subtitle settings to the subtitle processing unit 120.

The subtitle processing unit 120 groups screen settings and/or subtitle set subtitle data based on a show timestamp.

The subtitle processing unit 120 sequentially outputs subtitle data groups to the reproduction processing unit 140 according to time.

The image processing unit 130 processes image threads. The video processing unit 130 divides the AV data based on the show timestamp received from the subtitle management unit 160 to create a plurality of AV data groups. The image processing unit 130 sequentially outputs AV data groups to the playback processing unit 140 according to time.

The playback processing unit 140 generates a video stream screen by combining a plurality of subtitle data and AV data belonging to the same group, and outputs the generated video stream screen to the display device 150.

At this time, the video playback device 100 according to the embodiment uses the Android TV structure. Therefore, the video playback device 100 can use two types of media player and Chipsa player for broadcast stream processing provided by the Android Framework of Google OS. Examples of chip players include Synaptics' Synaplayer and Hisilicon's Hiplayer.

The subtitle processing unit 120 may operate in a Chipsa player, and the image processing unit 130 and playback processing unit 140 may operate in a media player.

Conventionally, the only player that can process broadcast streams in Linux and AOSP (Android Open Source Project) is the Chipsa player, so only one thread can process it. As in the past, when there is only one thread, the video stream is controlled sequentially according to one time logic, so only the output of AV data and subtitle data is controlled, and a separate time stamp or sync delay is required. time) cannot be calculated. This is because, in order to process AV data and subtitle data in one thread cycle, there is no choice but to proceed in parallel, but in this case, situations in which the sequence is twisted can frequently occur, and decoding, decoding, channel tuning, etc. may affect the timing of. As a result, issues such as black screen, no signal, unsubscribed channel error pop-up, and CAS error may occur.

However, in the embodiment of the present invention using the Android TV structure, multi-thread processing is possible through heterogeneous media players, so AV data and subtitle data can be processed in parallel without causing the same issues as before.

As such, according to an embodiment of the present invention, AV data and subtitle data are synchronized and output in a multi-threaded manner.

As in the past, when operating as a single thread, the subtitle is displayed on the screen immediately regardless of the line on which the subtitle is displayed, and the subtitle is deleted after a certain period of time (e.g., 2 to 3 seconds). On the other hand, when operating with multi-threading as in the present invention, the number of subtitles determined based on the show timestamp can be output in synchronization with AV data.

Basically, subtitles are received with a relative delay of several seconds compared to AV, and the playback processing unit 140 determines the start of the phrase of the text data and the time of the beginning of the spoken voice in AV through the subtitle thread cycle. The delay time value equal to the difference can be calculated. Since the sync delay time between AV and subtitle points is different for each broadcaster stream and content stream, it is necessary to calculate the synchronization delay time every time the channel switches to a channel containing subtitles. That is, the playback processing unit 140 does not output the stream to HDMI (High-Definition Multimedia Interface) immediately as it is received in the AV thread cycle, but at the subtitle data reception time calculated in the caption thread cycle. Accordingly, the AV is stored in the buffer and output to HDMI. Therefore, the AV data is output delayed by the time it is stored in the buffer, and the subtitle data is output as soon as it is received.

When the subtitle function is turned on, there is no problem when moving to a general channel without subtitle data, but when moving to some channels (terrestrial, etc.) with subtitle data, a delay of less than 5 seconds may occur in the channel switching speed. The playback processing unit 140 may pop up a screen through the display device 150 informing that the broadcast may be several seconds later than the actual broadcast time.

Additionally, the delay time that occurs while generating subtitle graphics is only a few ms. Therefore, there are more synchronization failures due to unsynchronization intervals of several seconds due to AV and subtitles not matching each other than synchronization failures between AV and subtitles due to the delay time of subtitle graphics. However, in the embodiment of the present invention, synchronization performance can be improved because subtitles and AV are mapped based on the show timestamp.

Additionally, the delay time (e.g., several ms) that occurs while generating subtitle graphics may vary depending on the CPU/GPU performance of the terminal, and this part can be added to the sync delay time, so graphics performance This case of falling terminals can also be covered.

The subtitle management unit 160 sets the Show TimeStamp size based on the subtitle setting data input from the subtitle setting unit 170 and/or the screen setting data input from the screen setting unit 180.

Subtitle setting data and screen setting data may be set according to user input or may be set by the service provider.

Subtitle setting data may include subtitle on/off, subtitle language (English, Korean), subtitle size (small, medium, large), subtitle size, number of characters, spacing, line breaks, etc.

Screen setting data may include screen resolution (720p, 1080p, 2160p) and screen ratio (16:9, 4:3, etc.).

The subtitle setting unit 170 is an app installed on the video playback device 100 and can provide a user interface so that the user can set subtitles.

The screen setting unit 180 is an app installed on the video playback device 100 and can provide a user interface so that the user can set the screen.

The subtitle management unit 160 can specify a show timestamp based on the System Time Clock (STC) used when calculating the Presentation Time Stamp (PTS). That is, the corresponding STC point can be calculated according to the size of the next show timestamp calculated by the subtitle management unit 160.

The subtitle management unit 160 may set the show timestamp size based on the time index of the AV to which a plurality of subtitle data is mapped.

At this time, the font size (small, medium, large) can be set through the subtitle setting unit 170, and the screen ratio and resolution can be set through the screen setting unit 180.

The subtitle management unit 160 calculates the maximum number of characters to be output in one line according to the settings of the subtitle setting unit 170 and the screen setting unit 180, and sets the show timestamp size by dividing the subtitle data by line. . In other words, the maximum number of characters can be set to the show timestamp size.

Here, the maximum number of characters that can be printed on one line depends on the graphics performance of the chip (CPU (Central Processing Unit)/GPU (Graphic Processing Unit)), the degree of clarity of the characters, and the operator's setting information (e.g., font size, etc.). Since it may vary depending on the value, manually entered values may be used. Depending on manual input, for example, when the resolution is 720p, the screen ratio is 16:9, and the font size is set to small, the subtitle management unit 160 can set the maximum number of characters to be output on one line to 21.

The subtitle management unit 160 can specify in advance the number of characters to be output on one line according to resolution, screen ratio, and font size, and this is in the form of a table mapping resolution and font size for each screen ratio, as shown in Tables 1 and 2. It can be configured and saved.

screen ratio
16:9 font size small commonly big resolution 720p 21 17 15 1080i 23 19 17 1080p 23 19 17 2160 30p 25 21 19 2160 60p 25 21 19

screen ratio
4:3 font size small commonly big resolution 720p 19 15 13 1080i 21 17 15 1080p 21 17 15 2160 30p 23 19 17 2160 60p 23 19 17

The subtitle management unit 160 provides the show timestamp to the video stream receiving subtitle processing unit 120 and the video processing unit 130. Then, the subtitle processing unit 120 groups the plurality of subtitle data based on the show timestamp and outputs the plurality of subtitle data to the playback processing unit 140 in the same group unit in the order of the show timestamp. The video processing unit 130 divides and groups the AV data based on the show time stamp, and outputs the divided AV data in the order of the show time stamp to the playback processing unit 140.

Segmented AV data refers to data that divides the entire seamless AV into sections based on the show timestamp.

Referring to FIG. 2, the video stream receiver 110 can receive nine subtitle data and one AV data.

The video stream receiver 110 creates a subtitle thread that processes nine subtitle data and a video thread that processes nine subtitle data and one AV data.

The subtitle thread is processed by the subtitle processing unit 120, and the video thread is processed by the video processing unit 130.

The subtitle processing unit 120 may divide nine subtitle data into three groups based on show timestamps provided from the subtitle management unit 160. That is, according to the subtitle thread cycle, subtitles 1, 2, 3, and 4 are mapped to Show TimsStamp 1 section, subtitles 5, 6, and 7 are mapped to Show Timestamp 2 section, and subtitles 8 and 9. is mapped to section 3 of the show timestamp.

The image processing unit 130 divides one AV data into three AV data based on the show timestamps provided from the subtitle management unit 160. According to the AV thread cycle, AV 1 is mapped to the show timestamp 1 section, AV 2 is mapped to the show timestamp 2 section, and AV 3 is mapped to the show timestamp 3 section.

The playback processing unit 140 synchronizes the subtitles and AV mapped to the same show timestamp section and outputs them on one screen in chronological order of the show timestamp. In other words, AV 1, which belongs to the earliest show timestamp 1, and subtitles 1, 2, 3, and 4 are synchronized and displayed on one screen.

The playback processing unit 140 synchronizes AV 2 and subtitles 5, 6, and 7 belonging to show timestamp 2, which is the next time, and outputs them on one screen.

The playback processing unit 140 synchronizes AV 3 and subtitles 8, 9, 10, and 11 belonging to show timestamp 3, which is the next time, and outputs them on one screen.

By controlling the video stream in this way, it is possible to display easily readable subtitle data on one screen, as shown in FIG. 3.

That is, according to (a) of Figure 3, a subtitle with a news start comment (Hello viewers, the 8 o'clock news will start soon) and the corresponding AV are displayed on one screen.

According to (b) of Figure 3, a subtitle such as the first news comment (this is the first news. It is news about an obesity immunity vaccine) and the corresponding AV are displayed on one screen. At this time, the show timestamp can be set considering the number of characters to be displayed in one line, so subtitles can be displayed with good readability as shown in FIG. 3.

In contrast, conventionally, as shown in FIG. 4, subtitle data is sequentially output in the order in which it is received or according to a determined time index, and AV data is displayed in the same manner.

In other words, since subtitle data is sequentially and repeatedly output on the same AV screen, synchronization of the subtitles and the screen may fail.

According to Figures 5 (a), (b), and (c), the AV screen is the same, only subtitles are output sequentially, and the displayed subtitles disappear after a certain period of time.

Therefore, as shown in Figure 5(a), 'viewer' is displayed, as shown in Figure 5(b), 'viewer' is followed by 'you', and as shown in Figure 5(c), 'viewer' is displayed. ' disappears, and the subtitle 'Hello' is displayed. Therefore, subtitles may appear and disappear multiple times on the same screen, which may cause them to be out of synchronization with the AV screen, and some subtitles may disappear, resulting in poor subtitle readability.

However, in an embodiment of the present invention, subtitles and AV are grouped and output at once, making it possible to provide a synchronized screen.

FIG. 6 is a flowchart showing a subtitle synchronization method of a video playback device according to an embodiment, which is explained in connection with the configuration of FIGS. 1 to 5.

Referring to FIG. 6, the video stream receiver 110 receives a video stream including AV data and a plurality of subtitle data related to the AV data from the server 300 (S101).

If the video stream receiver 110 determines that the video stream is a multi-thread target based on a channel number or content identifier (S102), it separates AV data and a plurality of subtitle data from the video stream (S103).

At this time, if the video stream is not a multi-thread target, the video stream that is a multi-thread target is put into a waiting state, or a basic operation (terminal operation without applying the embodiment of the present invention) for the video stream is performed (S104) .

The video stream receiver 110 allocates the separated AV data to the video thread executed by the video processing unit 130, and assigns a plurality of separated subtitle data to the subtitle thread executed by the subtitle processing unit 120 (S105) ).

The subtitle management unit 160 sets the show timestamp size based on the subtitle setting data input through the subtitle setting unit 170 and/or the screen setting data input through the screen setting unit 180 (S106).

The subtitle processing unit 120 groups a plurality of subtitle data in units of show timestamp size provided from the subtitle management unit 160, and the video processing unit 130 groups the subtitle data in units of show timestamp size provided from the subtitle management unit 160, The AV data is divided into multiple pieces and grouped (S107).

The playback processing unit 140 controls AV data and multiple subtitle data belonging to the same group to be output on one screen (S108). That is, the playback processing unit 140 combines AV data and a plurality of subtitle data belonging to the same show timestamp section to form one screen and outputs it to the display device 150.

Meanwhile, Figure 7 is a block diagram showing the hardware configuration of a video playback device that performs subtitle synchronization according to an embodiment.

Referring to FIG. 7, the video playback device 100 described in FIGS. 1 to 6 is a computing device 400 operated by at least one processor, including at least one processor 410, memory 420, and storage ( 430), a communication device 440, an input device 450, and a display device 460, and may be connected through a bus 470.

Physical computing resources provided by hardware devices can be virtualized.

The processor 410 is a device that controls the operation of a computing device and may be various types of processors that process instructions included in a computer program, for example, a Central Processing Unit (CPU), a Micro Processor Unit (MPU), It may be an MCU (Micro Controller Unit), GPU (Graphics Processing Unit), etc. Additionally, the processor 410 may perform operations on a computer program to execute the methods described in FIGS. 1 to 6 .

The memory 420 stores various data, commands and/or information. Memory 420 may load a corresponding computer program from storage 430 so that instructions described to execute operations of the present disclosure are processed by processor 410. The memory 420 may be, for example, read only memory (ROM), random access memory (RAM), etc.

The processor 410 includes the video stream receiving unit 110, the subtitle processing unit 120, the video processing unit 130, the playback processing unit 140, the subtitle management unit 160, and the subtitle setting unit 170 described in FIGS. 1 to 6. And instructions described to execute the operations of the screen setting unit 180 can be loaded into the memory 420 and driven.

The storage 430 can store various data, computer programs, etc. required to execute the operations of the present disclosure. Storage 430 may non-temporarily store computer programs. Storage 430 may be implemented as non-volatile memory.

The communication device 440 may be a wired/wireless communication module. Information input by the input device 450 is transmitted to the processor 410, and information according to the operation of the processor 410 may be output to the display device 460.

The embodiments of the present disclosure described above are not only implemented through devices and methods, but may also be implemented through programs that implement functions corresponding to the configurations of the embodiments of the present disclosure or recording media on which the programs are recorded.

Although the embodiments of the present disclosure have been described in detail above, the scope of the rights of the present disclosure is not limited thereto, and various modifications and improvements made by those skilled in the art using the basic concept of the present disclosure defined in the following claims are also possible. It falls within the scope of rights.

Claims (5)

As a method of operating a video playback device,
Receiving a video stream from a server connected through a network,
Separating the video stream into AV (AudioVideo) data and a plurality of subtitle data,
Dividing the AV data into set Show Timestamp units,
Grouping the plurality of subtitle data by the show timestamp, and
A step of outputting subtitle data belonging to the current show timestamp on the screen according to the current show timestamp of the AV data displayed on the screen.
Method, including. In paragraph 1:
Before the dividing step,
Calculating the maximum number of characters to be displayed on one line using at least one of character size, screen ratio, and resolution, and setting the calculated maximum number of characters as the show timestamp size.
A method further comprising: In paragraph 2,
Before the setting step,
Further comprising the step of checking the screen ratio, resolution, and font size level according to user input,
The setting step is,
From a table that maps the maximum number of characters to each aspect ratio, resolution, and font size level, check the maximum number of characters corresponding to the confirmed screen ratio, resolution, and font size level, and use the confirmed maximum number of characters as the show timestamp size. How to set it up. In paragraph 1:
Before the setting step,
Step to set the show timestamp size using STC (System Time Clock), which is used when calculating PTS (Presentation Time Stamp)
A method further comprising: In paragraph 1:
Before the separation step,
Further comprising determining whether the video stream is a multi-threaded target based on the channel number or content identifier through which the video stream was received,
The separating step is,
A method of separating the video stream determined to be a multi-thread target into a plurality of subtitle data and AV data.

Images