KR102445069B1 - System and method for integrated transmission by synchronizing a plurality of media sources - Google Patents

Abstract

The present invention relates to a system and method for integrated transmission by synchronizing a plurality of media sources, and each media source for an event including sports, art, culture, politics, or a combination thereof independently generated in different places By receiving for each channel, synchronizing each received media source based on the delay characteristic identified by tracking for each channel, and integrating each synchronized media source and transmitting it to the receiving device, that is, the receiver receives a plurality of different media sources A system and method for synchronizing and integrated transmission of a plurality of media sources for viewing without a difference in delay between them.

Description

SYSTEM AND METHOD FOR INTEGRATED TRANSMISSION BY SYNCHRONIZING A PLURALITY OF MEDIA SOURCES

The present invention relates to a system and method for integrated transmission by synchronizing a plurality of media sources, and more particularly, to events including sports, art, culture, politics, or a combination thereof independently generated in different places. By receiving a media source for each channel, synchronizing each of the received media sources based on the delay characteristics identified by tracking for each channel, and integrating each synchronized media source and transmitting it to the receiving device, that is, the receiver receives a plurality of A system and method for synchronizing and integrated transmission of a plurality of media sources enabling viewing without a difference in delay between different media sources.

In general, when various events, including sports, art, culture, politics, or a combination thereof, are being held separately at the same time in different places or countries, it is necessary to synchronize each media source that recorded the event and provide it to viewers do.

However, in the prior art, events held in different places, countries, etc. were individually provided to viewers by separating them into screens, subtitles, and sounds, or provided in turns. In consideration of network delay, each media source is synchronized and each It has been difficult to provide media sources to viewers in real time.

Also, in the prior art, media between a plurality of channels was synchronized by simply delaying or buffering other channels according to the worst-delayed channel with the greatest delay for the plurality of channels.

However, when another channel is delayed or buffered in accordance with the worst-delayed channel, even a good channel becomes excessively dependent on the worst-delayed channel, thereby deteriorating overall communication quality.

In addition, it is true that there is no separate need for this, since the need to provide each media source in an integrated manner for events held in different places and countries has not been raised in the prior art. For example, when sports events, cultural events (exhibitions, concerts, etc.), summit meetings, etc. are held in a plurality of different places or countries at the same time, conventionally, separate edits are made in different places or countries. The event scene was only provided, but in consideration of network delay, it was not possible to synchronize each media source and provide it to the viewer.

Therefore, in the present invention, media sources for various events independently generated in different places are received for each channel, and each received media source is synchronized based on the delay characteristics confirmed by tracking for each channel, and the synchronized An object of the present invention is to propose a method whereby the receiver can watch media related to various events without a difference in delay between a plurality of different media sources by integrating each media source and transmitting the same to a receiving device.

Next, the prior art existing in the technical field of the present invention will be briefly described, and then the technical matters that the present invention intends to achieve differently from the prior art will be described.

First, Korean Patent Registration No. 1934200 (2019.04.05.) relates to a media synchronization method and system. In providing various content sources to a user terminal in real time, the provided stream is synchronized and provided for media synchronization It relates to methods and systems.

In the prior art, when the same photographing target (eg, object or scene) is photographed in each of a plurality of photographing devices (eg, action cam, drone cam, etc.) of different types and provided to a user terminal, hardware for each photographing device A media synchronization method for performing media synchronization in consideration of a delay due to a difference in data characteristics, a difference in codec characteristics, and a delay occurring in a process of providing stream sources generated by each of a plurality of photographing devices to a plurality of user terminals; and It describes the system.

However, according to the present invention, the delay characteristic of each channel that transmits the media source is tracked and confirmed, the media source received for each channel is synchronized based on the delay characteristic confirmed by the tracking, and each synchronized media source is integrated. Therefore, since it is transmitted to a media receiving device, there is a significant difference in configuration between the prior art and the present invention.

In addition, Korean Patent Application Laid-Open No. 2012-0084252 (2012.07.27.) relates to a receiving device for receiving a plurality of real-time transport streams, a transmitting device therefor, and a method for reproducing multimedia content. A first receiver, a second receiver for receiving the second real-time transport stream through a communication network, a delay processor for synchronizing by delaying at least one of the first and second real-time transport streams, and first data from the first real-time transport stream a first detection unit for detecting , thereby stably playing multimedia contents.

That is, the prior art describes a receiving apparatus and a transmitting apparatus for transmitting and receiving one multimedia content through different paths, and a reproduction method thereof.

On the other hand, in the present invention, the media source of another channel is delayed or buffered based on the worst-delayed channel with the greatest delay for each channel that transmits the media source, and the corresponding media is not synchronized between each channel, but for each channel. Based on the tracking and confirmed delay characteristics, each media source received for each channel is synchronized, and each synchronized media source is integrated and transmitted to the media receiving device. Obvious.

The present invention was created to solve the above problems, and synchronizes each media source for the live performance of various events including sports, art, culture, politics, or a combination thereof in a plurality of different places or countries. An object of the present invention is to provide a system and method capable of transmitting the synchronized media sources to a receiver by integrating them.

In addition, the present invention does not synchronize the corresponding media between channels by delaying or buffering the media sources of other channels based on the worst case delay channel with the greatest delay for each channel that transmits the media source, Another object of the present invention is to provide a system and method capable of tracking and checking a delay characteristic for each channel, and synchronizing a media source received through each channel based on the tracking and checked delay characteristic.

The delay characteristic predicts the delay of each channel through a prediction model generated by machine learning the delay pattern of each channel for each time, date, season, etc. for the media providing device, the receiving device, and the network. When the environment information at the time of media transmission and reception is input, an expected delay pattern is extracted based on the input, and the media source is synchronized by reflecting the corresponding delay in advance.

In addition, the present invention synchronizes the media sources received for each channel, and integrates the synchronized media sources to form a packet and transmits the packet to the media receiving device. By receiving the packet through the same transmission environment, the media receiving device receives the media. Another object of the present invention is to provide a system and method for preventing a delay problem between each media source from occurring even when a network delay or broadcast delay occurs between a source integrated transmission system and a media receiving device.

In addition, the present invention synchronizes each media source without the need to edit the media sources for various events that are taking place in a plurality of different places or countries, and integrates each synchronized media source to provide the receiver in real time. Another object is to provide a system and a method therefor. That is, the present invention provides the receiver with scenes of sports events, cultural events (exhibitions, concerts, etc.), summit meetings, etc. held in a plurality of different places or countries at the same time, separate editing including screen division is performed. It is not provided through a separate editing process, but each media source is synchronized for integrated transmission.

In accordance with an embodiment of the present invention, there is provided a system for integrated transmission by synchronizing a plurality of media sources, comprising: a media receiver configured to receive media sources independently generated in different places through respective channels; a synchronization unit performing delay compensation for each of the received media sources and synchronizing each of the media sources for which the delay compensation has been performed; and an integrated transmission unit that integrates and transmits each of the synchronized media sources; by integrating each of the synchronized media sources and transmitting the synchronized media sources to a media receiving device, the receiver does not have a difference in delay between a plurality of different media sources It is characterized by being able to watch.

In addition, the integrated transmitter further comprises integrating each of the synchronized media sources into a packet and transmitting it to the media receiving device, wherein the packet received by the media receiving device is received through the same transmission environment, the It is characterized in that even if a network delay occurs between the system and the media receiving device, a delay problem between the respective media sources does not occur.

In addition, the system may include: a delay monitoring unit for monitoring a delay state for each channel receiving the media source; a delay pattern extraction unit for extracting a pattern in which the delay is repeated with respect to the monitored delay of each channel; and a delay predictor for predicting a delay for each channel according to time change through the extracted pattern.

At this time, the pattern is a repeating pattern of the trend of change over time of the delay, and a prediction model is pre-stored by machine learning, and predicting the delay is calculating the rate of change per unit time at which the delay occurs, , by inputting the calculated rate of change into the predictive model to predict how it will change in the future.

In addition, the synchronization unit determines a buffering time for each channel based on the delay for each channel predicted by the delay prediction unit, and performs buffering for each media source received through the media receiver based on the determined buffering time for each channel. Compensating for delay deviation by performing the method, further comprising synchronizing each media source that has performed the buffering, and determining the buffering time for each channel may be performed periodically according to a change in the situation for each channel, , the delay deviation is a difference in delay generated for each channel.

In addition, in the method for integrated transmission by synchronizing a plurality of media sources according to an embodiment of the present invention, in the integrated transmission system for a media source, media reception for receiving media sources independently generated in different places through respective channels step; a synchronization step of performing, in the media source integrated transmission system, delay compensation for each of the received media sources, and synchronizing each of the media sources for which the delay compensation has been performed; and an integrated transmission step of integrating and transmitting each of the synchronized media sources in the media source integrated transmission system, wherein the synchronized media sources are integrated and transmitted to the media receiving device in the integrated media source transmission system By doing so, it is characterized in that the receiver can watch without a difference in delay between a plurality of different media sources.

In addition, the integrated transmission step further includes, in the media source integrated transmission system, integrating each of the synchronized media sources into a packet and transmitting it to the media receiving device, wherein the packet received by the media receiving device is the same As received through a transmission environment, it is characterized in that even if a network delay occurs between the system and the media receiving device, a delay problem between the respective media sources does not occur.

The method may further include, in the media source integrated transmission system, a delay monitoring step of monitoring a delay state for each channel receiving the media source; a delay pattern extraction step of extracting, in the media source integrated transmission system, a pattern in which the delay is repeated with respect to the delay of each monitored channel; and a delay prediction step of predicting a delay for each channel according to a time change through the extracted pattern in the integrated media source transmission system.

At this time, the pattern is a repeating pattern of the trend of change over time of the delay, and a prediction model is pre-stored by machine learning, and predicting the delay is calculating the rate of change per unit time at which the delay occurs, , by inputting the calculated rate of change into the predictive model to predict how it will change in the future.

In addition, the synchronization step may include, in the media source integrated transmission system, determining a buffering time for each channel based on the delay for each channel predicted in the delay estimation step; compensating for delay deviation by buffering each media source received through the media receiving step based on the determined buffering time for each channel in the media source integrated transmission system; and synchronizing, in the integrated media source transmission system, each media source that has performed the buffering, wherein determining the buffering time for each channel is performed periodically according to a change in the situation for each channel. and the delay deviation is a difference in delay generated for each channel.

As described above, according to the system and method for integrated transmission by synchronizing a plurality of media sources of the present invention, various events including sports, art, culture, politics, or a combination thereof are independently generated in different places. By receiving a media source for each channel, synchronizing each received media source based on a delay characteristic identified by tracking for each channel, and integrating each synchronized media source and transmitting it to a media receiving device, the receiver receives a plurality of There is an effect that it is possible to conveniently view media related to various events without a difference in delay between different media sources.

In addition, the present invention synchronizes the media sources received for each channel in the integrated media source transmission system, integrates the synchronized media sources into packets and transmits them to the media receiving device, and the media receiving device transmits the same packet. Since it receives through the environment, even if a network delay or broadcast delay occurs between the media source integrated transmission system and the media receiving device, it affects all media sources in common, so there is no delay problem between each media source. There is an effect that does not need to perform editing such as separating into individual screens, subtitles, and sounds as in .

1 is a diagram for explaining the configuration of a system for integrated transmission by synchronizing a plurality of media sources according to an embodiment of the present invention.
2 is a conceptual diagram for explaining a process of synchronizing and integrated transmission of a plurality of media sources according to an embodiment of the present invention.
3 is a diagram for explaining an example of a delay pattern of each channel applied to the present invention.
4 is a diagram illustrating in detail the configuration of a media source integrated transmission system according to an embodiment of the present invention.
5 is a flowchart illustrating in detail an operation process of a method for integrated transmission by synchronizing a plurality of media sources according to an embodiment of the present invention.
6 is a flowchart illustrating in more detail a synchronization performing process applied to the present invention.

Hereinafter, a preferred embodiment of a system and method for integrated transmission by synchronizing a plurality of media sources of the present invention will be described in detail with reference to the accompanying drawings. Like reference numerals in each figure indicate like elements. In addition, specific structural or functional descriptions of the embodiments of the present invention are only exemplified for the purpose of describing the embodiments according to the present invention, and unless otherwise defined, all terms used herein, including technical or scientific terms They have the same meaning as commonly understood by those of ordinary skill in the art to which the present invention pertains. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present specification. It is preferable not to

1 is a diagram for explaining the configuration of a system for integrated transmission by synchronizing a plurality of media sources according to an embodiment of the present invention.

As shown in FIG. 1 , the present invention is configured to include a media source integrated transmission system 100 , a media providing device 200 , a media receiving device 300 , a database 400 , and the like.

The media source integrated transmission system 100 is a media source including video or audio recording various events including sports, art, culture, politics, or a combination thereof in different places (eg, countries, cities, etc.) receives from the media providing device 200 through each channel, synchronizes each of the media sources received through each channel, and integrates the synchronized media sources to receive media from other broadcasting equipment, display devices, mobile terminals, etc. By providing the device 300 in real time, a receiver (ie, a viewer) can view media related to various events without delay between a plurality of different media sources.

That is, the present invention provides a receiver with a live performance of various events in progress in different places so that the receiver can watch the event scenes in progress in each place without delay due to distance or communication environment. It is to synchronize the media sources so that they can be provided in an integrated manner.

In this case, each media source received from the media providing device 200 through each channel may have different delays depending on the reception processing process of the media source integrated transmission system 100 or the network communication state.

In this way, if the delay is different for each channel, the video or audio signal for each media source is not synchronized, resulting in a significant decrease in the quality of the media. do. Accordingly, in the prior art, various events held in different places were provided by separately providing screens and audio separately, or by performing editing such as providing them in turns, but by integrating media sources for various events held in various places The needs of viewers who want to be provided have gradually increased.

In order to solve the needs of these receivers, a typical method used in the prior art is to delay or buffer the media source of another channel based on the worst case delay channel having the greatest delay among the channels, thereby delaying or buffering the media source between the respective channels. method to synchronize However, when another channel is delayed or buffered in accordance with the worst-delayed channel, even a channel having good communication quality is excessively dependent on a channel having the worst-delayed channel, and thus overall communication quality may be deteriorated.

The present invention has been proposed to solve this conventional problem, and the media source integrated transmission system 100 receives media sources for various events held at different places from the media providing device 200 for each channel. to perform a synchronization operation, the delay characteristics related to the network state are tracked for each channel and each channel received from the media providing device 200 according to the status of each channel based on the tracked and confirmed delay characteristics is performed. The media sources are synchronized, and each of the synchronized media sources can be integrated and provided to the receiver.

In other words, based on the delay characteristics that are tracked and confirmed for each channel, the media source received through each channel is synchronized and provided to the receiver, so that the receiver can perform various events in different places without any difference in delay between a plurality of different media sources. It is to enable viewing of related content (ie, video or audio, etc.).

At this time, when the media source integrated transmission system 100 synchronizes each media source independently generated from the media providing device 200, the following method may be performed.

Specifically, the media source integrated transmission system 100 monitors a delay state for each channel for receiving each media source independently generated from the media providing device 200, and each monitored channel For the delay of , a pattern in which each delay is repeated is extracted, and a delay for each channel according to time change is predicted through the extracted pattern. In this case, the prediction of the delay means predicting how the delay will change in the future by calculating the rate of change per unit time at which the delay occurs, and inputting the calculated rate of change into a predictive model in which a delay pattern is generated in advance, The predictive model is generated by machine learning a repeating pattern of the trend of change over time of delay.

In addition, the media source integrated transmission system 100 determines a buffering time for each channel based on the predicted delay for each channel, and each media source received from the media providing apparatus 200 based on the determined buffering time for each channel. After buffering is performed to compensate for delay deviation, each media source is synchronized, and each synchronized media source is integrated and transmitted to the media receiving device 300 .

At this time, when the media source integrated transmission system 100 integrates each of the synchronized media sources and transmits them to the media receiving device 300 , it is made into a packet and transmitted, and the media receiving device 300 transmits the packet in the same transmission environment. Since the data is received through , even if a network delay or broadcast delay occurs between the integrated media source transmission system 100 and the media reception device 300, there is no delay problem between the respective media sources. That is, even if a network delay or broadcast delay occurs, a synchronization problem between the respective media sources does not occur because the media source integrated transmission system 100 affects all media sources integrated and transmitted in common.

In addition, the media source integrated transmission system 100 integrates each media source synchronized with the media receiving device 300 and provides it in a packet form, so that various events that are simultaneously occurring in different places can be individually screened, subtitled, and sounded. There is no need to separate and edit and provide. For example, when multiple sports events for ranking are played in multiple different places or countries at the same time, or when heads of each country talk and discuss at the same time in their offices or specific places, the media sources are integrated When the transmission system 100 synchronizes each media source and transmits the packet in the form of a packet, the media receiving device 300 receives and restores the packet and plays or broadcasts the packet, so that the media source integrated transmission system 100 . There is no need for any editing process.

The media providing device 200 is configured to include a microphone, a camera, network communication equipment, etc. installed in each of a plurality of places where an event including sports, art, culture, politics, or a combination thereof is performed, and a video obtained by photographing the event , and transmits a media source including audio or a combination thereof to the integrated media source transmission system 100 through a network.

In this case, the media providing apparatus 200 independently generates a media source including images, audio, or a combination thereof for the various events, and sets the generated media source to a specific information connected to the media source integrated transmission system 100 . transmitted through the channel.

The media receiving device 300 is configured to include broadcasting equipment, TV, smart phone, computer, etc., and receives a packet in which each media source synchronized from the media source integrated transmission system 100 is integrated, and the received The packet is transmitted to the receiving device of the lower stage for broadcasting, or the received packet is restored and reproduced so that the receiver can check it.

For example, the media receiving device 300 restores a packet in which each synchronized media source received from the integrated media source transmission system 100 is reconstructed to reproduce each media source in a divided screen form, Each media source can be played sequentially at regular time intervals, or a specific media source selected by the receiver can be played. In this case, the media source integrated transmission system 100 may packetize and provide each of the synchronized media sources according to a specific method (eg, screen division, sequential playback, etc.) required by the media receiving device 300 .

The database 400 is a prediction for predicting the delay for each channel based on various operation programs and delay tracking characteristics required to track the delay characteristics related to the network state for each channel used in the integrated media source transmission system 100 . Stores and manages models, etc.

A process for synchronizing and integrated transmission of such a plurality of media sources will be described in detail with reference to FIG. 2 as follows.

2 is a conceptual diagram for explaining a process of synchronizing and integrated transmission of a plurality of media sources according to an embodiment of the present invention.

First, the media source integrated transmission system 100 transmits a media source that shoots a specific event including sports, art, culture, politics, or a combination of sports, art, culture, politics, or a combination thereof, which is being conducted simultaneously from each media providing device 200 located in different places. Receive through each channel (①). In this case, the media source includes images and audio independently generated by each media providing device 200 .

In addition, the media source integrated transmission system 100 monitors the delay state of each channel that transmits the media source (②), and extracts a pattern in which the delay is repeated with respect to the delay of each monitored channel (③) . That is, for each channel, the delay characteristic related to the network state is tracked and confirmed. In this case, the monitoring of the delay state may further include a delay in the internal processing of the media providing apparatus 200 for transmitting the media source and the media source integrated transmission system 100 for receiving the media source in addition to the network state.

Then, the media source integrated transmission system 100 predicts the delay for each channel according to the time change through the extracted pattern (④).

At this time, the media source integrated transmission system 100 is generated by machine learning the delay pattern of each channel for each time, date, season, etc. between the media source integrated transmission system 100 and the media providing device 200. The delay of each channel is predicted through the predictive model. That is, the media source integrated transmission system 100 inputs the rate of change per unit time at which the delay occurs (eg, the rate of change F(Δt) during t1 and t2 in FIG. 3 ) to the generated prediction model, so that the delay is It's about predicting how things will change. Here, the prediction model outputs the prediction result for the delay as a probability, and the media source integrated transmission system 100 selects a specific delay pattern with the highest probability, thereby determining a delay to occur in the future through the selected specific delay pattern. make it predictable.

As such, when the delay for each channel is predicted, the media source integrated transmission system 100 performs delay compensation for each of the received media sources, and synchronizes each media source that has performed the delay compensation (⑤) .

In addition, the media source integrated transmission system 100 integrates each of the synchronized media sources and transmits them to the media receiving device 300, so that the media receiving device 300 transmits and broadcasts to another receiving device, or the Integrate and play the synchronized media source so that the receiver can check it (⑥).

In this case, the media source integrated transmission system 100 may packetize each media source and transmit it to the media receiving device 300 when the synchronized media sources are integrated and transmitted.

On the other hand, the delay pattern for each channel between the integrated media source transmission system 100 and each media providing device 200 varies greatly depending on the network state, which will be described with reference to FIG. 3 as follows.

3 is a diagram for explaining an example of a delay pattern of each channel applied to the present invention.

The delay pattern for each channel may appear in various ways depending on the time period, usage, and the like, transmitted from the media providing device 200 to the integrated media source transmission system 100 .

For example, as shown in (a) and (b) of FIG. 3 , a large amount of delay occurs during the daytime when the network usage is high, and a small delay occurs during the late night time when the network usage is low. In this case, the delay pattern may appear linear.

However, since the delay pattern fluctuates greatly depending on the network usage, in addition to the case where it appears linearly as in FIGS. 3(a) and (b), it is also frequently do. In other words, when a specific event such as a performance or event is held for a certain period of time, at the beginning, users' interest is high, so network usage becomes active, and thus a lot of delay occurs. , when it reaches the end, network usage increases again, which may cause a lot of delay.

Accordingly, in the present invention, in consideration of various delay patterns for each channel as in the example of FIG. 3, synchronization processing is performed for each media source independently generated at different locations and received for each channel.

4 is a diagram illustrating in detail the configuration of a media source integrated transmission system according to an embodiment of the present invention.

As shown in FIG. 4 , the media source integrated transmission system 100 includes a media receiving unit 110 , a delay monitoring unit 120 , a delay pattern extracting unit 130 , a delay prediction unit 140 , and a synchronization unit 150 . ), the integrated transmission unit 160, and the like.

In addition, although not shown in the drawing, the integrated media source transmission system 100 includes a power supply unit for supplying operating power to each component, an input unit for data input for various functions, an update management unit for managing updates of various operating programs, and media It may further include a communication interface unit for transmitting and receiving data related to the source.

The media receiving unit 110 receives media sources independently generated in different places from the media providing apparatus 200 through a network through each channel, and transmits the received media sources to the synchronizer 150 through a network. print out

In this case, the media receiver 110 may include a low noise amplifier, an analog/digital converter (ADC), a decoder, and the like, and uses the received media source for low noise amplification, digital conversion, and transmission-side encoding. After performing the decoding process according to the above, output to the synchronization unit 150 .

The delay monitoring unit 120 monitors a delay state for each channel that receives the media source, and outputs information on the monitored delay state to the delay pattern extraction unit 130 .

The delay pattern extraction unit 130 extracts a pattern in which the delay is repeated based on the information on the delay state of each monitored channel provided from the delay monitoring unit 120, and uses the extracted delay pattern as the pattern. It outputs to the delay prediction unit 140 .

In this case, the pattern means a repeating pattern with respect to the trend of change with time of the delay.

The delay prediction unit 140 predicts a delay for each channel according to time change through the delay pattern extracted by the delay pattern extraction unit 130 , and outputs information about the predicted delay to the synchronization unit 150 . do.

At this time, the delay prediction unit 140 calculates the rate of change per unit time at which the delay occurs, and inputs the calculated rate of change into a previously generated prediction model to predict how it will change in the future.

The synchronization unit 150 includes at least one buffer, and performs delay compensation for each media source received by the media receiving unit 110 using the buffer, and performs delay compensation for each media source that has been compensated for the delay. It is synchronized and output to the integrated transmission unit 160 .

That is, the synchronization unit 150 determines a buffering time for each channel based on the delay for each channel predicted by the delay prediction unit 140 , and based on the determined buffering time for each channel through the media receiver 110 . Buffering is performed for each received media source to compensate for a delay in delay for each channel, and each media source that has been buffered is synchronized. In this case, the determination of the buffering time for each channel may be performed periodically according to a change in the situation for each channel.

For example, suppose that the media sources received by each of the three channels are synchronized, the delay of channel #1 predicted at a specific point in time is 2 seconds, the delay of channel #2 is 1 second, and the delay of channel #3 is 3 seconds. , the synchronization unit 150 buffers 1 second for the media source received through channel #1, buffers 2 seconds for the media source received through channel #2, and buffers 2 seconds for the media source received through channel #3. Synchronization of each media source is performed without buffering.

Also, when the delay of channel #1 is 3 seconds, the delay of channel #2 is 2 seconds, and the delay of channel #3 is 1 second, at different points in time according to a change in the situation of each channel, the synchronization unit 150 sets the channel #1 Media source received through channel #2 does not perform buffering, media source received through channel #2 buffers 1 second, and media source received through channel #3 buffers 2 seconds and then synchronizes each media source do.

The integrated transmission unit 160 integrates each media source synchronized by the synchronization unit 150 and transmits it to the media reception device 300 .

That is, the integrated transmission unit 160 integrates each of the synchronized media sources and transmits them to the media receiving device 300 , so that the receiver receives a difference in delay between a plurality of different media sources through the media receiving device 300 . It allows you to watch without it.

In addition, the integrated transmission unit 160 may integrate each of the synchronized media sources into a packet, and transmit the packet to the media reception device 300 . At this time, since the packet received by the media receiving device 300 is received through the same transmission environment, even if a network delay or broadcast delay occurs between the media source integrated transmission system 100 and the media receiving device 300, the entire Since the media sources are commonly affected, there is no delay between each media source.

In the present invention, the delay pattern is predicted for a specific channel, and when the predicted result is different from the actual delay measurement result, the difference is input again into the machine learning prediction model to predict the delay pattern again, so that the optimum delay to be able to predict

Next, an embodiment of a method for integrated transmission by synchronizing a plurality of media sources according to the present invention configured as described above will be described in detail with reference to FIGS. 5 and 6 . In this case, the order of each step according to the method of the present invention may be changed by the environment of use or by those skilled in the art.

5 is a flowchart illustrating in detail an operation process of a method for integrated transmission by synchronizing a plurality of media sources according to an embodiment of the present invention, and FIG. 6 is a flowchart illustrating a synchronization performing process applied to the present invention in more detail.

First, the media source integrated transmission system 100 performs a media reception step of receiving a media source independently generated in relation to a specific event simultaneously proceeding in different places from each media providing device 200 (S100) .

In addition, the media source integrated transmission system 100 performs a delay monitoring step of monitoring a delay state of each channel for receiving the respective media sources from the respective media providing apparatuses 200 through the step S100 (S200). ).

In addition, the media source integrated transmission system 100 performs a delay pattern extraction step of extracting a pattern in which the delay is repeated for the delay of each channel monitored in the step S200 (S300). In this case, the pattern extracted in step S300 is a repeating pattern for the trend of change over time of the delay, and the media source integrated transmission system 100 machine-learns the pattern and stores the prediction model in advance.

Then, the media source integrated transmission system 100 performs a delay prediction step of predicting the delay for each channel according to the time change through the pattern extracted in the step S300 (S400). In this case, the prediction of the delay is performed based on calculating the rate of change per unit time at which the delay occurs, and predicting how it will change in the future by inputting the calculated rate of change into the prediction model.

Here, predicting the delay for each channel is to predict the optimal delay by re-predicting the delay pattern by inputting the difference into the machine learning prediction model again when the predicted result is different from the actual delay measurement result. let it be The input of the predictive model is provided with an artificial intelligence machine learning input port for inputting a difference between the delay predicted from the predictive model and the delay actually measured.

As such, when the delay for each channel is predicted through the step S400, the media source integrated transmission system 100 receives each channel received from the media providing device 200 through the step S100 based on the predicted delay for each channel. A delay compensation is performed on the media source, and a synchronization step of synchronizing each media source for which the delay compensation is performed is performed (S500).

6, the integrated media source transmission system 100 determines a buffering time for each channel based on the delay for each channel predicted in step S400 (S510). In this case, the determination of the buffering time for each channel may be performed periodically according to a change in the situation for each channel.

In addition, the integrated media source transmission system 100 performs buffering for each media source received from each media providing apparatus 200 in the step S100 based on the buffering time for each channel determined in the step S510, A delay deviation, which is a difference in delay generated for each channel, is compensated (S520).

In addition, the media source integrated transmission system 100 synchronizes each media source that has been buffered through step S520 (S530).

Referring back to FIG. 5 , the media source integrated transmission system 100 performs an integrated transmission step of integrating each media source synchronized through the step S500 and transmitting it to the media receiving device 300 ( S600 ).

That is, by integrating each of the synchronized media sources in the media source integrated transmission system 100 and transmitting them to the media receiving device 300 , the receivers each other related to a specific event without a difference in delay between a plurality of different media sources. The goal is to be able to watch each media source being created in a different place.

On the other hand, when integrating each of the synchronized media sources in step S600 and transmitting them to the media receiving device 300, the media source integrated transmission system 100 integrates each of the synchronized media sources into a packet, and the It can be transmitted to the media receiving device 300 . In this case, since the packet received by the media receiving device 300 is received through the same transmission environment, there is no correlation with network delay or broadcast delay between the media source integrated transmission system 100 and the media receiving device 300 . none.

As such, the present invention receives media sources for various events, including sports, art, culture, politics, or a combination thereof, that are independently generated in different places for each channel, and tracks and checks delay characteristics for each channel. Since each of the received media sources is synchronized based on the synchronization of each of the synchronized media sources and transmitted to the media receiving device, the receiver can conveniently view media related to various events without delay between a plurality of different media sources. can watch

Also, according to the present invention, since each media source synchronized in the media source integrated transmission system is integrated into a packet and transmitted to the media receiving device, the media receiving device receives the packet through the same transmission environment, so that the media source integrated transmission Even if a network delay or broadcast delay occurs between the system and the media receiving device, it affects all media sources in common, so there is no delay problem between each media source. no need to do

As described above, the present invention has been described with reference to the embodiments shown in the drawings, which are merely exemplary, and those of ordinary skill in the art can make various modifications and equivalent other embodiments therefrom. You will understand that it is possible. Therefore, the technical protection scope of the present invention should be judged by the following claims.

100: media source integrated transmission system
110: media receiving unit 120: delay monitoring unit
130: delay pattern extraction unit 140: delay prediction unit
150: synchronization unit 160: integrated transmission unit
200: media providing device 300: media receiving device
400 : database

Claims (10)

a media receiving unit for receiving media sources for events held in a plurality of different places through respective channels;
a delay monitoring unit for monitoring a delay state of each channel receiving the media source;
a delay pattern extraction unit for extracting a pattern in which the delay is repeated with respect to the delay state for each monitored channel;
a delay predictor for predicting a delay for each channel according to time change using the extracted pattern;
a synchronization unit performing delay compensation for each of the received media sources based on the predicted delay for each channel and synchronizing each of the media sources for which the delay compensation has been performed; and
Including; an integrated transmission unit for integrating and transmitting each of the synchronized media sources;
To predict the delay, calculate the rate of change per unit time at which the delay occurs, and predict how it will change in the future according to the calculated rate of change per unit time,
The system for synchronizing and integrated transmission of a plurality of media sources, characterized in that by integrating each of the synchronized media sources and transmitting them to a media receiving device, the receiver can watch without a difference in delay between the plurality of different media sources. The method according to claim 1,
The integrated transmission unit,
The method further comprises integrating each of the synchronized media sources into a packet and transmitting it to the media receiving device,
The packet received by the media receiving device,
A system for integrated transmission by synchronizing a plurality of media sources as received through the same transmission environment, and characterized in that even if a network delay occurs between the system and the media receiving device, a delay problem between the respective media sources does not occur. delete The method according to claim 1,
The pattern is
A system for synchronizing and integrated transmission of a plurality of media sources, characterized in that the delay is a repeating pattern of the trend of change over time, and can be generated as a predictive model by machine learning. The method according to claim 1,
The synchronization unit,
At least one buffer is included, and a buffering time for each channel is determined based on the delay for each channel predicted by the delay predictor, and is received through the media receiver using the buffer based on the determined buffering time for each channel. Compensating for a delay difference occurring for each channel by performing buffering for each media source, further comprising synchronizing each media source for which the delay deviation has been compensated,
Determining the buffering time for each channel is,
It can be performed periodically according to the change of the situation for each channel,
The deviation of the delay is
A system for synchronized and integrated transmission of a plurality of media sources, characterized in that it is a difference in delay generated for each channel. In the integrated media source transmission system, a media receiving step of receiving a media source for an event proceeding in a plurality of different places through each channel;
a delay monitoring step of monitoring a delay state for each channel receiving the media source;
a delay pattern extraction step of extracting a pattern in which the delay is repeated with respect to the delay state for each monitored channel;
a delay prediction step of predicting a delay for each channel according to time change using the extracted pattern;
a synchronization step of performing delay compensation for each of the received media sources based on the predicted delay for each channel, and synchronizing each of the media sources for which the delay compensation has been performed; and
Including; an integrated transmission step of integrating and transmitting each of the synchronized media sources;
To predict the delay, calculate the rate of change per unit time at which the delay occurs, and predict how it will change in the future according to the calculated rate of change per unit time,
The method for synchronizing and integrated transmission of a plurality of media sources, characterized in that by integrating each of the synchronized media sources and transmitting them to a media receiving device, the receiver can watch without a difference in delay between the plurality of different media sources. 7. The method of claim 6,
The integrated transmission step is
In the media source integrated transmission system, the method further comprises integrating each synchronized media source into a packet and transmitting it to the media receiving device,
The packet received by the media receiving device,
A method for integrated transmission by synchronizing a plurality of media sources, which is received through the same transmission environment and does not cause a delay problem between the respective media sources even when a network delay occurs between the system and the media receiving device. delete 7. The method of claim 6,
The pattern is
A method of synchronizing and integrated transmission of a plurality of media sources, characterized in that the delay is a repeating pattern of the trend of change over time, and can be generated as a predictive model by machine learning. 7. The method of claim 6,
The synchronization step is
determining, in the integrated media source transmission system, a buffering time for each channel based on the delay for each channel predicted in the delay prediction step;
compensating for a delay in delay occurring for each channel by buffering each media source received through the media receiving step using at least one buffer based on the determined buffering time for each channel; and
Further comprising; synchronizing each media source compensating for the deviation of the delay;
Determining the buffering time for each channel is,
It can be performed periodically according to the change of the situation for each channel,
The deviation of the delay is
A method for synchronized and integrated transmission of a plurality of media sources, characterized in that the difference in delay generated for each channel is.

Images