CN111601133B - Multimedia data synchronous output system and method - Google Patents
Multimedia data synchronous output system and method Download PDFInfo
- Publication number
- CN111601133B CN111601133B CN201910130417.2A CN201910130417A CN111601133B CN 111601133 B CN111601133 B CN 111601133B CN 201910130417 A CN201910130417 A CN 201910130417A CN 111601133 B CN111601133 B CN 111601133B
- Authority
- CN
- China
- Prior art keywords
- output
- multimedia data
- synchronous
- unit
- same
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application provides a multimedia data synchronous output system and a method, wherein the system comprises: the system comprises a multimedia data input unit, a multimedia data output unit and a synchronous management group; the synchronous management group comprises a reference clock management unit and a clock synchronization unit, wherein the reference clock management unit is used for providing the same clock source for each multimedia data output unit in the same synchronous output group; the synchronous output calibration unit is used for configuring the same output parameters for each multimedia data output unit and controlling each multimedia data output unit to output multimedia data at the same output starting time; the synchronous processing control unit is used for controlling each multimedia output unit to receive the multimedia data and the corresponding control data sent by the multimedia data input unit at the same receiving time; and the synchronous transmission control unit is used for feeding back the output time of each multimedia data output unit to the multimedia data input unit. The method can ensure the synchronism of multimedia data output in the multimedia data synchronous output system.
Description
Technical Field
The present application relates to video monitoring technologies, and in particular, to a system and a method for synchronously outputting multimedia data.
Background
The synchronous output generally includes video matrix switching synchronous output, video splicing roaming synchronous output and the like. The video matrix switching synchronous output generally refers to that video data of the same video input end is simultaneously switched to a plurality of video output ends to be displayed, and the display picture content of each video output end is synchronous; the video splicing roaming synchronous output generally means that a video input image is cut into a plurality of video blocks according to preset parameters and is respectively displayed on each video output end, images displayed simultaneously on each display screen of the whole splicing screen belong to the same frame of the video input image, and the phenomenon of image tearing and dislocation of crossing screens does not exist.
However, practice shows that in the existing synchronous output scheme, when the video output units in the same synchronous output group run for a long time, frequency deviation between the video output units is increased, and finally, display of a display cannot be synchronized; in addition, each video output unit in the same synchronous output group cannot ensure that the same video frame is received in the same output period, and therefore, the display may be asynchronous.
Disclosure of Invention
In view of the above, the present application provides a system and a method for synchronously outputting multimedia data.
Specifically, the method is realized through the following technical scheme:
according to a first aspect of embodiments of the present application, there is provided a multimedia data synchronous output system, including: the system comprises a multimedia data input unit, a multimedia data output unit and a synchronous management group; the synchronous management group comprises a reference clock management unit, a synchronous output calibration unit, a synchronous processing control unit and a synchronous transmission control unit; wherein:
the multimedia data input unit is used for sending multimedia data and corresponding control data;
the multimedia data output unit is used for receiving the multimedia data and the corresponding control data and outputting the received multimedia data according to the received control data;
the reference clock management unit is used for providing the same clock source for each multimedia data output unit in the same synchronous output group;
the synchronous output calibration unit is used for configuring the same output parameters for all multimedia data output units in the same synchronous output group and controlling all multimedia data output units in the same synchronous output group to output multimedia data at the same output starting time;
the synchronous processing control unit is used for controlling each multimedia output unit in the same synchronous output group to receive the multimedia data and the corresponding control data sent by the multimedia data input unit at the same receiving time;
the synchronous transmission control unit is used for feeding back the output time of each multimedia data output unit in the same synchronous output group to the multimedia data input unit so that the multimedia data input unit sends multimedia data and corresponding control data according to the output time.
According to a second aspect of the embodiments of the present application, there is provided a multimedia data synchronous transmission method applied to the multimedia data synchronous output system, the method including:
the multimedia data input unit sends multimedia data and corresponding control data;
the multimedia data output unit receives the multimedia data and the corresponding control data;
the synchronous management group controls the multimedia data output of the multimedia data output units, so that the multimedia output units in the same synchronous output group synchronously output the received multimedia data according to the received control data.
The multimedia data synchronous transmission system of the embodiment of the application arranges the synchronous management group in the multimedia data synchronous output system, the synchronous management group provides the same clock source for each multimedia data output unit in the same synchronous output group through the reference clock management unit, configures the same output parameter for each multimedia data output unit in the same synchronous output group through the synchronous output calibration unit, controls each multimedia data output unit in the same synchronous output group to output multimedia data at the same output starting time, controls each multimedia output unit in the same synchronous output group to receive the multimedia data sent by the multimedia data input unit and the corresponding control data at the same receiving time through the synchronous processing control unit, and feeds back the output time of each multimedia data output unit in the same synchronous output group to the multimedia data input unit through the synchronous transmission control unit, the multimedia data input unit sends the multimedia data and the corresponding control data according to the output time, and the output synchronism of the multimedia data in the multimedia data synchronous output system is ensured.
Drawings
Fig. 1 is a schematic structural diagram of a multimedia data synchronous output system according to an exemplary embodiment of the present application;
FIG. 2 is a block diagram illustrating an architecture of a digital matrix synchronous output system according to an exemplary embodiment of the present application;
FIG. 3 is a schematic diagram illustrating a process of calibrating a synchronous output group by a synchronous output calibration unit according to an exemplary embodiment of the present application;
FIG. 4 is a diagram illustrating a timing of a calibrated output of a synchronous output unit according to an exemplary embodiment of the present application;
FIG. 5 is a schematic diagram illustrating a synchronization process control unit controlling video processing of video output units within a synchronization output group according to an exemplary embodiment of the present application;
FIG. 6 is a digital matrix asynchronous schematic diagram as shown in an exemplary embodiment of the present application;
FIG. 7 is a digital matrix receive out-of-sync schematic shown in an exemplary embodiment of the present application;
FIG. 8 is a timing diagram illustrating an exemplary embodiment of a digital matrix synchronous transmission unit control;
FIG. 9 is a diagram illustrating an exemplary embodiment of a digital matrix synchronous transmission;
fig. 10 is a flowchart illustrating a method for synchronously outputting multimedia data according to an exemplary embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
In order to make the technical solutions provided in the embodiments of the present application better understood and make the above objects, features and advantages of the embodiments of the present application more comprehensible, the technical solutions in the embodiments of the present application are described in further detail below with reference to the accompanying drawings.
Referring to fig. 1, a schematic structural diagram of a multimedia data synchronous output system according to an embodiment of the present disclosure is shown in fig. 1, where the multimedia data synchronous output system may include a multimedia data input unit 110, a multimedia data output unit 120, and a synchronization management group 130; the synchronization management group 130 includes a reference clock management unit 131, a synchronization output calibration unit 132, a synchronization processing control unit 133, and a synchronization transmission control unit 134; wherein:
the multimedia data input unit 110 is configured to send multimedia data and corresponding control data;
the multimedia data output unit 120 is configured to receive multimedia data and corresponding control data, and output the received multimedia data according to the received control data;
the reference clock management unit 131 is configured to provide a same clock source for each multimedia data output unit in a same synchronous output group;
the synchronous output calibration unit 132 is configured to configure the same output parameters for each multimedia data output unit in the same synchronous output group, and control each multimedia data output unit in the same synchronous output group to output multimedia data at the same output start time;
the synchronous processing control unit 133 is configured to control each multimedia output unit in the same synchronous output group to receive the multimedia data and the corresponding control data sent by the multimedia data input unit at the same receiving time;
the synchronous transmission control unit 134 is configured to feed back the output time of each multimedia data output unit in the same synchronous output group to the multimedia data input unit, so that the multimedia data input unit sends multimedia data and corresponding control data according to the output time.
It should be noted that, in the embodiment of the present application, the multimedia data may include, but is not limited to, video data, audio data, or picture data.
For convenience of description and understanding, the following description will be given by taking multimedia data as video data as an example, and accordingly, the multimedia data input unit is a video input unit and the multimedia data output unit is described as a video output unit.
In the embodiment of the application, in order to ensure the output synchronism of the video output units in the same synchronous output group, the data transmission of the video input unit and the data reception and output of the video output unit can be controlled through the synchronous management group.
Specifically, in the embodiment of the present application, the synchronization management group 130 may manage all the video synchronization output groups through the reference clock management unit 131, and provide the same clock source for each video output unit in the same synchronization output group, so as to ensure that the basic clocks among the video output units in each synchronization output group have the same frequency and phase.
Next, the sync management group 130 may configure the same output parameter for each video output unit in the same sync output group through the sync output calibration unit 132 to ensure that the output periods of the video data units in the same sync output group are the same, and control each video output unit in the same sync output group to output video at the same output start time.
Optionally, the output parameters may include, but are not limited to, resolution or/and refresh rate, etc.
Furthermore, the synchronization management group 130 can also control each video output unit in the same synchronization output group to receive the video data and the corresponding control data sent by the video input unit at the same receiving time through the synchronization processing control unit 133, so as to ensure that the processing of the data of the same video frame or the data of each video frame segment of the same video frame is completed in the same output period, thereby realizing the synchronization output of each video output unit in the same synchronization output group, and not being diverged along with the long-time operation of the system.
Alternatively, the control data may include, but is not limited to, switching wall control data, pan and tilt control data, and/or auxiliary control data, and the like.
Finally, the synchronization management group 130 may also feed back the output time of each video output unit in the same synchronization output group to the video input unit through the synchronization transmission control unit 134, and control the time when the video input unit sends the video data and the corresponding control information.
Because the receiving time of each video output unit in the same synchronous output group is not completely consistent, and the time when the synchronously transmitted control data reaches the video output units is different, the control data synchronously received in the same output period is not corresponding to the same frame of video, and the video display is asynchronous; the synchronous transmission control unit 131 can obtain the output time of each video output unit in the same synchronous output group, for example, the time of detecting output interruption, and calculate the time of synchronous reception and the time of synchronous processing of the video output units, thereby controlling the time of sending video data and control data, ensuring that each video output unit in the same output group can receive the same frame of video in the same output period under the condition that the synchronous reception time is different, and ensuring synchronous transmission, synchronous reception (receiving the same frame of video), synchronous processing and synchronous output through a closed-loop feedback system, thereby realizing full-flow splicing synchronous display.
In one embodiment of the present application, the synchronization output calibration unit 132 may be specifically configured to broadcast a parameter configuration signal to the multimedia data output units 120 in the same synchronization output group, so that the multimedia data output units 120 in the same synchronization output group configure the same output parameter.
In this embodiment, to ensure that the video output units in the same sync output group have the same configuration parameters, the sync output calibration unit 132 may broadcast parameter configuration signals to the video output units in the same sync output group; when the video output unit receives the parameter configuration signal, the video output unit can perform parameter configuration according to the parameter configuration signal, so as to ensure that all video output units in the same output group have the same output period.
In one example, the parameter configuration signal may carry output parameters (referred to herein as target output parameters); when the video output units receive the parameter configuration signal, the video output units can perform output parameter configuration according to the target output parameters carried in the parameter configuration signal, so as to ensure that the video output units in the same output group have the same output parameters, and further ensure that the video output units in the same output group have the same output period.
It should be noted that, in this embodiment, the parameter configuration signal may also not carry the output parameter, but store the output parameter of the video output units in the same output group at the designated location, and when the video output unit receives the parameter configuration signal, the video output unit may obtain the output parameter stored in advance from the designated location, so as to ensure that each video output unit in the same output group has the same output parameter, and the specific implementation thereof is not described herein again.
Further, in an example, the synchronization output calibration unit 132 may be further specifically configured to broadcast a restart signal to each multimedia data output unit 120 in the same synchronization output group, so that each multimedia data output unit 120 in the same synchronization output group restarts the output timing.
In this example, in order to ensure that the video output units in the same synchronous output group have the same output start time, after the synchronous output calibration unit 132 configures the output parameters of the video output units in the synchronous output group, a restart signal may be broadcast to the video output units in the synchronous output group; when the video output units receive the restart signal, the output time sequence can be restarted, so that the video output units in the same synchronous output group are ensured to have the same output starting time.
It should be noted that the same time (e.g., the same output start time) mentioned in the embodiment of the present application is not limited to the time being completely the same, and a preset error (which may be determined according to an actual scenario, for example, 1 to 2 milliseconds, several hundred microseconds, and the like) may also be allowed, and the following description of the embodiment of the present application is not repeated.
In one embodiment of the present application, the synchronization processing control unit 133 can be specifically configured to trigger each multimedia data output unit 120 in the synchronization output group to receive multimedia data and corresponding control data and trigger each multimedia data output unit 120 in the synchronization output group to output multimedia data, when detecting that the output of each multimedia data output unit 120 in the same synchronization output group is interrupted, so that each multimedia data output unit 120 in the synchronization output group outputs multimedia data processed in a previous multimedia data output period.
In this embodiment, when the synchronization processing control unit 133 detects that the output of each video output unit in the same synchronization output group is interrupted (the output of the same video frame or the same video frame is interrupted), the synchronization processing control unit 133 may trigger each video output unit in the synchronization output group to receive the video data and the corresponding control data, so as to ensure the synchronous reception of each video output unit in the same synchronization output group.
In addition, the synchronization processing control unit 133 may also trigger each video output unit in the synchronization output group to output the video data, so that each video output unit in the synchronization output group outputs the video data processed in the previous video output period, so as to ensure the synchronous output of each video output unit in the same synchronization output group.
In one embodiment of the present application, the synchronization transmission control unit 134 may be specifically configured to determine an optimal transmission time of control data according to output times of the multimedia output units 120 in the same synchronization output group, and feed back the optimal transmission time of control data to the multimedia data input unit 110, so that the multimedia data input unit 110 transmits control data according to the optimal transmission time of control data.
In one example, the synchronization transmission control unit 134 may be specifically configured to determine the optimal transmission time of the control data according to an average value of the output times of the multimedia data output units 120 in the same synchronization output group.
For example, the synchronous transmission control unit 134 may specifically be configured to determine the optimal transmission time of the control data according to the following formula:
Tz＝t+T0*1/2
where, Tz is the optimal sending time of the control data, T is the average value of the output time of each multimedia data output unit 120 in the synchronous output group, and T0 is the multimedia data output period of each multimedia data output unit 120 in the synchronous output group.
In order to enable those skilled in the art to better understand the technical solutions provided in the embodiments of the present application, the technical solutions provided in the embodiments of the present application are described below with reference to specific examples.
In this embodiment, taking the tiled display in a digital matrix scene as an example, a complete frame of video source image needs to be displayed across multiple tiled screens, and a portion of the image frame (referred to as a video frame tile) is displayed on each tiled screen.
Referring to fig. 2, a schematic diagram of an architecture of a digital matrix synchronous output system according to an embodiment of the present invention is shown in fig. 2, where the digital matrix synchronous output system may include a video input unit, a video output unit, a reference clock management unit, a synchronous output calibration unit, a synchronous processing control unit, and a synchronous transmission control unit.
The implementation of synchronous output of the digital matrix in the embodiment of the present application is described below with reference to specific functions of the reference clock management unit, the synchronous output calibration unit, the synchronous processing control unit, and the synchronous transmission control unit.
Firstly, a synchronous output calibration unit:
the method is mainly used for correcting the Output time sequence synchronization of VO (Video Output) and ensuring that the Output time sequences of all Video Output units in the same Output synchronization group are consistent; the method mainly comprises the following steps:
1. the synchronous output calibration unit configures (can configure according to a pre-configured synchronous output group configuration file) a synchronous output group according to needs;
2. the synchronous output calibration unit manually triggers or automatically detects and triggers a broadcast calibration signal as required, controls each video output unit in the same synchronous output group to be configured with the same output parameters (parameters such as resolution/refresh rate) and controls each output unit in the same synchronous output group to be synchronously restarted;
for example, a typical synchronous output calibration unit calibrates the synchronous output set processing steps as shown in fig. 3, which includes:
1) the synchronous output calibration unit configures a video synchronous output group according to needs, and selects a video output unit 1/2/3/4;
2) the synchronous output calibration unit broadcasts and configures the output parameters of each video output unit (the video output unit 1/2/3/4) to ensure that the video output periods of the video output units are consistent;
3) the synchronous output calibration unit starts the output time sequence of each video output unit in a broadcasting way to ensure that the output starting time of each video output unit is consistent; the calibration output timing diagram of the synchronous output unit can be as shown in fig. 4.
Two, synchronous processing control unit
The method is mainly used for controlling the same video frame data of each output unit in the same synchronous output group to be processed in one output period, and ensuring that each output unit in the synchronous output group synchronously outputs the video data processed in the current output period in the next output period.
For example, a typical synchronous processing control unit can control the video processing of each video output unit in the synchronous output group as shown in fig. 5, and the processing elements thereof include:
1. synchronous receiving: the video output of each video output unit in the video synchronous output group is interrupted, each video output unit is synchronously triggered to receive the video frame segmentation block and the corresponding control data, and each video output unit is ensured to simultaneously receive the corresponding control data and the video frame segmentation block, at the moment, each video output unit simultaneously receives or does not simultaneously receive the corresponding control data and the video frame segmentation block, and the synchronous output of the video frames of each video output unit can be ensured under the two conditions of receiving or not receiving (if receiving, each video output unit in the output period finishes the processing of the received video frame segmentation block, each video output unit in the next output period outputs the video frame; if not receiving, each video output unit does not process, each video output unit in the next output period repeatedly outputs the previous video frame);
2. and (3) synchronous processing: the link only needs to ensure that the corresponding video frame segmentation blocks received by each video output unit are processed before the next video output interruption triggers the video frame output, and strict synchronization does not need to be ensured among the video output units;
3. and (3) synchronous output: and (3) interrupting video output of each video output unit in the video synchronous output group, synchronously triggering video frame output, and synchronously acquiring and outputting a video frame processed by the synchronous processing link in the previous video output period by each video frame output unit (if each video output unit in the previous output period does not receive the video frame segmentation block, repeatedly outputting the latest video frame segmentation block data currently processed).
Third, reference clock management unit
The method is mainly used for controlling the output time sequences (or called display time sequences) of all the video output units in the synchronous output group to be consistent, and ensuring that the video output units in the same synchronous output group cannot cause the difference accumulation of the output time sequences among the output units due to long-time operation.
Fourthly, a synchronous transmission control unit:
the method is mainly used for determining the time difference existing when each video output unit carries out synchronous receiving according to the output time of each output unit in the same synchronous output group, and determining the optimal time for synchronous transmission of the video input units according to the result, thereby avoiding receiving different video frames in the same output period when each output unit in the same synchronous output group carries out synchronous receiving.
In this embodiment, it is considered that if there is no interaction mechanism between the video output units in the same synchronization output group, and there is no cooperative processing mechanism for processing between the video output units and between the video input unit and the output unit, the timings of the control information synchronization reception and the video processing may be inconsistent, and meanwhile, the synchronization of the video output cannot be guaranteed in consideration of the time difference existing in the broadcast information reception.
For example, if the video input unit sends the video data completely, the corresponding control data is sent in a broadcast manner, and the broadcast manner itself may also bring a difference of microsecond or millisecond level, so that the time when the control data reaches different video output units in the same synchronization output group is not completely consistent, and there is a slight difference in time.
As shown in fig. 6, assuming that the video output units perform video output at a frequency of 60HZ, there is a difference in the arrival time of video frames at each video output unit in the same video output period. Assuming that the time when the control data of the video frame Fn arrives at the video data unit 1 is t1 and the time when the control data of the video frame Fn arrives at the video output unit 2 is t1+ Δ t, if the synchronous receiving time is between t1 and t1+ Δ t, the video output unit 1 receives the video frame, the video output unit 2 does not receive the video frame, and the video output unit 1 and the video output unit 2 output different video images in the same video output period, which results in asynchronous display.
In addition, in this embodiment, the synchronous output calibration unit starts and stops the output timing of each video output unit in a broadcast command manner, and due to the difference in the time when the broadcast command reaches each video output unit, the time when the output of each video data unit is interrupted (i.e., the time when the video data is output) is not completely synchronized, so that the video image processing also has a time difference.
Furthermore, because the synchronous transmission control unit needs to be awakened to inquire the control data through output interruption, and the timeliness of interruption response of different video output units is different, microsecond difference can be generated in time; and the execution time of the query control information will also generate microsecond difference.
For example, as shown in fig. 7, assuming that the video output unit outputs video at a frequency of 60HZ, the synchronous receiving time of the video output unit 2 is t1, the synchronous receiving time of the video output unit 1 is t1+ Δ t, if the time when the control data reaches the video output unit is between t1 and t1+ Δ t, the control data of the video frame Fn received by the video output unit 1 at t1+ Δ t will occur, and the control data of the video frame Fn is not received by the video output unit 2 at t1, and finally the receiving asynchronization will occur, which will cause the video images processed in the same output period to be inconsistent, and cause the display asynchronization.
The time difference can cause the video splicing display to be incompletely synchronized.
In this embodiment, the synchronous transmission control unit may adapt the video output unit in a manner of dynamically adjusting the transmission tempo of the video input unit. The synchronous transmission control unit obtains the output interruption time of each video output unit in the same synchronous output group, calculates the average value (assumed to be t) of the output interruption time of each video output unit in the same synchronous output group, determines the video output period (for example, 20ms or 16.666ms) according to the output frame rate (for example, 50Hz or 60Hz), and determines the time for transmitting the control data at t +10ms or t +8ms in order to ensure that the time for the control data broadcasted by the video input unit to reach each video output unit of the same synchronous output group avoids the error value of the synchronous receiving time of each video output unit.
For example, as shown in fig. 8, assuming that the output frequency is 60HZ, the average value t of the output interruption times of the video output units in the same synchronization output group is calculated, t +8ms is determined as the optimal transmission time of the control data, the optimal transmission data of the control data is fed back to the video input unit, and the video input unit transmits the control data according to the optimal transmission time.
It can be seen that, the synchronous transmission control unit obtains the video interruption time of each video output unit in the same synchronous output group, and calculates the average value of the video interruption time of each video output unit in the same synchronous output group to obtain the average time of the video interruption time of each video output unit in the same synchronous output group, and sends the optimal sending time to the video input unit in consideration of the delay reserved part of the margin of the broadcast signal, and the video input unit sends the control data after delaying according to the optimal sending time to ensure that each video output unit in the same synchronous output group can synchronously receive the same video data and the corresponding control data, thereby ensuring the video display synchronization, and the schematic diagram can be as shown in fig. 9.
Based on the same technical concept of the system embodiment, the embodiment of the present application further provides a multimedia data synchronous output method, which can be applied to the multimedia data synchronous output system.
As shown in fig. 10, which is a schematic flow chart of a multimedia data synchronous output method provided in an embodiment of the present application, as shown in fig. 10, the multimedia data synchronous output method may include the following steps:
step S1000, the multimedia data input unit sends the multimedia data and the corresponding control data.
In step S1010, the multimedia data output unit receives the multimedia data and the corresponding control data.
Step S1020, the synchronization management group controls data transmission of the multimedia data input unit and data reception and output of the multimedia data output unit, so that each multimedia output unit in the same synchronization output group synchronously outputs the received multimedia data according to the received control data.
In the embodiment of the application, in order to ensure the output synchronism of the video output units in the same synchronous output group, the data transmission of the video input unit and the data reception and output of the video output unit can be controlled through the synchronous management group.
In an embodiment of the application, the controlling the data output of the multimedia data output unit by the synchronization management group may include:
the synchronous output calibration unit configures the same output parameters for all multimedia data output units in the same synchronous output group and controls all multimedia data output units in the same synchronous output group to output multimedia data at the same output starting time.
In this embodiment, the sync management group may configure the same output parameter for each video output unit in the same sync output group through the sync output calibration unit to ensure that the output periods of the video data units in the same sync output group are the same, and control each video output unit in the same sync output group to output video at the same output start time.
Optionally, the output parameters may include, but are not limited to, resolution or/and refresh rate, etc.
In one example, configuring, by the sync output calibration unit, the same output parameter for each multimedia data output unit in the same sync output group may include:
the synchronous output calibration unit broadcasts parameter configuration signals to all multimedia data output units in the same synchronous output group, so that all multimedia data output units in the same synchronous output group are configured with the same output parameters.
In this example, to ensure that the video output units in the same sync output group have the same configuration parameters, the sync output calibration unit may broadcast parameter configuration signals to the video output units in the same sync output group; when the video output unit receives the parameter configuration signal, the video output unit can perform parameter configuration according to the parameter configuration signal, so as to ensure that all video output units in the same output group have the same output period.
In one example, the parameter configuration signal may carry output parameters (referred to herein as target output parameters); when the video output units receive the parameter configuration signal, the video output units can perform output parameter configuration according to the target output parameters carried in the parameter configuration signal, so as to ensure that the video output units in the same output group have the same output parameters, and further ensure that the video output units in the same output group have the same output period.
It should be noted that, in this embodiment, the parameter configuration signal may also not carry the output parameter, but store the output parameter of the video output units in the same output group at the designated location, and when the video output unit receives the parameter configuration signal, the video output unit may obtain the output parameter stored in advance from the designated location, so as to ensure that each video output unit in the same output group has the same output parameter, and the specific implementation thereof is not described herein again.
Further, in one example, the synchronization output calibration unit may broadcast a restart signal to each multimedia data output unit in the same synchronization output group, so that each multimedia data output unit in the same synchronization output group restarts the output timing.
In this example, in order to ensure that the video output units in the same synchronous output group have the same output start time, after the synchronous output calibration unit configures the output parameters of the video output units in the synchronous output group, a restart signal may be broadcast to the video output units in the synchronous output group; when the video output units receive the restart signal, the output time sequence can be restarted, so that the video output units in the same synchronous output group are ensured to have the same output starting time.
In one embodiment of the present application, the controlling the data reception of the multimedia data output unit by the synchronization management group may include:
the synchronous processing control unit controls each multimedia output unit in the same synchronous output group to receive the multimedia data and the corresponding control data sent by the multimedia data input unit at the same receiving time.
In this embodiment, the synchronization management group may further control, by the synchronization processing control unit, each video output unit in the same synchronization output group to receive the video data and the corresponding control data sent by the video input unit at the same receiving time, so as to ensure that processing of the same video frame data or each video frame block data of the same video frame is completed in the same output period, thereby implementing synchronized output of each video output unit in the same synchronization output group, and not being diverged along with long-time operation of the system.
Alternatively, the control data may include, but is not limited to, switching wall control data, pan and tilt control data, and/or auxiliary control data, and the like.
In an example, the controlling unit for controlling the multimedia output units in the same synchronization output group to receive the multimedia data and the corresponding control data sent by the multimedia data input unit at the same receiving time may include:
when the synchronous processing control unit detects that the output of each multimedia data output unit in the same synchronous output group is interrupted, each multimedia data output unit in the synchronous output group is triggered to receive the multimedia data and the corresponding control data, and each multimedia data output unit in the synchronous output group is triggered to output the multimedia data, so that each multimedia data output unit in the synchronous output group outputs the multimedia data processed in the previous multimedia data output period.
In this example, when the synchronization processing control unit detects an output interruption of each video output unit in the same synchronization output group (an output interruption of the same video frame or a partition of the same video frame), the synchronization processing control unit may trigger each video output unit in the synchronization output group to receive video data and corresponding control data to ensure synchronous reception of each video output unit in the same synchronization output group.
In addition, the synchronous processing control unit can also trigger each video output unit in the synchronous output group to output the video data, so that each video output unit in the synchronous output group outputs the video data processed in the last video output period, and the synchronous output of each video output unit in the same synchronous output group is ensured.
In an embodiment of the present application, the controlling the data transmission of the multimedia data input unit by the synchronization management group may include:
the synchronous transmission control unit feeds back the output time of each multimedia data output unit in the same synchronous output group to the multimedia data input unit, so that the multimedia data input unit sends the multimedia data and the corresponding control data according to the output time.
In this embodiment, the synchronization management group may feed back the output time of each video output unit in the same synchronization output group to the video input unit through the synchronization transmission control unit, and control the time at which the video input unit sends the video data and the corresponding control information.
Because the receiving time of each video output unit in the same synchronous output group is not completely consistent, and the time when the synchronously transmitted control data reaches the video output units is different, the control data synchronously received in the same output period is not corresponding to the same frame of video, and the video display is asynchronous; the synchronous transmission control unit can obtain the output time of each video output unit in the same synchronous output group, for example, the output interruption time is detected, and the synchronous receiving time and the synchronous processing time of the video output units are calculated, so that the sending time of video data and control data is controlled, the same frame of video can be received in the same output period under the condition that the synchronous receiving time of each video output unit in the same output group is different, the synchronous transmission, synchronous receiving (receiving the same frame of video), synchronous processing and synchronous output are ensured through a closed-loop feedback system, and the splicing synchronous display of the whole flow is realized.
In an example, the above-mentioned synchronous transmission control unit feeds back the output time of each multimedia data output unit in the same synchronous output group to the multimedia data input unit, and may include:
the synchronous transmission control unit determines the optimal sending time of the control data according to the output time of each multimedia output unit in the same synchronous output group and feeds the optimal sending time of the control data back to the multimedia data input unit, so that the multimedia data input unit sends the control data according to the optimal sending time of the control data.
For example, the synchronous transmission control unit may determine the optimal transmission timing of the control data according to an average value of output timings of the multimedia data output units in the same synchronous output group.
For example, the synchronous transmission control unit may determine the optimal transmission time of the control data according to the following formula:
Tz＝t+T0*1/2
where Tz is the optimal transmission time of the control data, T is the average value of the output time of each multimedia data output unit 120 in the synchronous output group, and T0 is the multimedia data output period of each multimedia data output unit 120 in the synchronous output group.
In the embodiment of the application, a synchronous management group is deployed in a multimedia data synchronous output system, the synchronous management group provides a same clock source for each multimedia data output unit in a same synchronous output group through a reference clock management unit, configures same output parameters for each multimedia data output unit in the same synchronous output group through a synchronous output calibration unit, controls each multimedia data output unit in the same synchronous output group to output multimedia data at a same output starting time, controls each multimedia output unit in the same synchronous output group to receive multimedia data and corresponding control data at a same receiving time through a synchronous processing control unit, and feeds back the output time of each multimedia data output unit in the same synchronous output group to the multimedia data input unit through a synchronous transmission control unit, the multimedia data input unit sends the multimedia data and the corresponding control data according to the output time, and the output synchronism of the multimedia data in the multimedia data synchronous output system is ensured.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (16)
1. A system for synchronously outputting multimedia data, comprising: the system comprises a multimedia data input unit, a multimedia data output unit and a synchronous management group; the synchronous management group comprises a reference clock management unit, a synchronous output calibration unit, a synchronous processing control unit and a synchronous transmission control unit; wherein:
the multimedia data input unit is used for sending multimedia data and corresponding control data;
the multimedia data output unit is used for receiving the multimedia data and the corresponding control data and outputting the received multimedia data according to the received control data;
the reference clock management unit is used for providing the same clock source for each multimedia data output unit in the same synchronous output group;
the synchronous output calibration unit is used for configuring the same output parameters for each multimedia data output unit in the same synchronous output group and controlling each multimedia data output unit in the same synchronous output group to output multimedia data at the same output starting time;
the synchronous processing control unit is used for controlling each multimedia output unit in the same synchronous output group to receive the multimedia data and the corresponding control data sent by the multimedia data input unit at the same receiving time;
the synchronous transmission control unit is used for feeding back the output time of each multimedia data output unit in the same synchronous output group to the multimedia data input unit so as to enable the multimedia data input unit to send multimedia data and corresponding control data according to the output time;
the synchronous transmission control unit is specifically configured to determine an optimal sending time of control data according to output times of multimedia output units in the same synchronous output group, and feed back the optimal sending time of the control data to the multimedia data input unit, so that the multimedia data input unit sends the control data according to the optimal sending time of the control data.
2. The system of claim 1,
the synchronous output calibration unit is specifically configured to broadcast a parameter configuration signal to each multimedia data output unit in the same synchronous output group, so that each multimedia data output unit in the same synchronous output group configures the same output parameter.
3. The system of claim 2,
the synchronous output calibration unit is specifically configured to broadcast a parameter configuration signal carrying a target output parameter to each multimedia data output unit in the same synchronous output group, so that each multimedia data output unit in the same synchronous output group performs output parameter configuration according to the target output parameter.
4. The system of claim 2,
the synchronous output calibration unit is further specifically configured to broadcast a restart signal to each multimedia data output unit in the same synchronous output group, so that each multimedia data output unit in the same synchronous output group restarts an output timing sequence.
5. The system of claim 1,
the synchronous processing control unit is specifically configured to, when it is detected that output of each multimedia data output unit in the same synchronous output group is interrupted, trigger each multimedia data output unit in the synchronous output group to receive multimedia data and corresponding control data, and trigger each multimedia data output unit in the synchronous output group to output multimedia data, so that each multimedia data output unit in the synchronous output group outputs multimedia data processed in a previous multimedia data output period.
6. The system of claim 1,
the synchronous transmission control unit is specifically configured to determine an optimal sending time of the control data according to an average value of output times of the multimedia data output units in the same synchronous output group.
7. The system of claim 6,
the synchronous transmission control unit is specifically configured to determine an optimal transmission time of control data according to the following formula:
Tz＝t+T0*1/2
where, Tz is the optimal sending time of the control data, T is the average value of the output time of each multimedia data output unit in the synchronous output group, and T0 is the multimedia data output period of each multimedia data output unit in the synchronous output group.
8. A multimedia data synchronous transmission method, applied to the multimedia data synchronous output system according to any one of claims 1 to 7, the method comprising:
the multimedia data input unit sends multimedia data and corresponding control data;
the multimedia data output unit receives the multimedia data and the corresponding control data;
the synchronous management group controls the data transmission of the multimedia data input unit and the data receiving and output of the multimedia data output unit so as to enable each multimedia output unit in the same synchronous output group to synchronously output the received multimedia data according to the received control data;
wherein, the synchronous management group controls the data transmission of the multimedia data input unit, and comprises: the synchronous transmission control unit determines the optimal sending time of control data according to the output time of each multimedia output unit in the same synchronous output group, and feeds the optimal sending time of the control data back to the multimedia data input unit, so that the multimedia data input unit sends the control data according to the optimal sending time of the control data.
9. The method of claim 8, wherein the synchronization management group controls data output of the multimedia data output unit, and comprises:
the synchronous output calibration unit configures the same output parameters for all multimedia data output units in the same synchronous output group and controls all multimedia data output units in the same synchronous output group to output multimedia data at the same output starting time.
10. The method of claim 9, wherein the synchronization output calibration unit configures the same output parameters for each multimedia data output unit in the same synchronization output group, and comprises:
the synchronous output calibration unit broadcasts parameter configuration signals to all multimedia data output units in the same synchronous output group, so that all multimedia data output units in the same synchronous output group are configured with the same output parameters.
11. The method of claim 10, wherein the synchronization output calibration unit broadcasts parameter configuration signals to each multimedia data output unit in the same synchronization output group, comprising:
the synchronous output calibration unit is specifically configured to broadcast a parameter configuration signal carrying a target output parameter to each multimedia data output unit in the same synchronous output group, so that each multimedia data output unit in the same synchronous output group performs output parameter configuration according to the target output parameter.
12. The method of claim 10, wherein the synchronization management group controls data output of the multimedia data output unit, and further comprising:
the synchronous output calibration unit broadcasts a restart signal to each multimedia data output unit in the same synchronous output group so as to restart the output time sequence of each multimedia data output unit in the same synchronous output group.
13. The method of claim 8, wherein the synchronization management group controls data reception of the multimedia data output unit, and comprises:
and the synchronous processing control unit controls each multimedia output unit in the same synchronous output group to receive the multimedia data and the corresponding control data sent by the multimedia data input unit at the same receiving time.
14. The method of claim 13, wherein the synchronization processing control unit controls each multimedia output unit in the same synchronization output group to receive the multimedia data and the corresponding control data sent by the multimedia data input unit at the same receiving time, comprising:
when the synchronous processing control unit detects that the output of each multimedia data output unit in the same synchronous output group is interrupted, each multimedia data output unit in the synchronous output group is triggered to receive multimedia data and corresponding control data, and each multimedia data output unit in the synchronous output group is triggered to output the multimedia data, so that each multimedia data output unit in the synchronous output group outputs the multimedia data processed in the previous multimedia data output period.
15. The method of claim 8, wherein the determining, by the synchronous transmission control unit, the optimal transmission time of the control data according to the output time of each multimedia output unit in the same synchronous output group comprises:
and the synchronous transmission control unit determines the optimal sending time of the control data according to the average value of the output time of each multimedia data output unit in the same synchronous output group.
16. The method of claim 15, wherein the synchronous transmission control unit determines the optimal transmission time of the control data according to an average value of output times of multimedia data output units in the same synchronous output group, comprising:
the synchronous transmission control unit determines the optimal sending time of the control data according to the following formula:
Tz＝t+T0*1/2
where, Tz is the optimal sending time of the control data, T is the average value of the output time of each multimedia data output unit in the synchronous output group, and T0 is the multimedia data output period of each multimedia data output unit in the synchronous output group.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910130417.2A CN111601133B (en) | 2019-02-21 | 2019-02-21 | Multimedia data synchronous output system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910130417.2A CN111601133B (en) | 2019-02-21 | 2019-02-21 | Multimedia data synchronous output system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111601133A CN111601133A (en) | 2020-08-28 |
| CN111601133B true CN111601133B (en) | 2022-07-01 |
Family
ID=72188569
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910130417.2A Active CN111601133B (en) | 2019-02-21 | 2019-02-21 | Multimedia data synchronous output system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111601133B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117097946B (en) * | 2023-10-19 | 2024-02-02 | 广东视腾电子科技有限公司 | Video all-in-one machine and control method for same |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1968078A (en) * | 2006-09-29 | 2007-05-23 | 中兴通讯股份有限公司 | Method for clock synchronization of mobile multimedia broadcast receiving terminal |
| CN108259783A (en) * | 2016-12-29 | 2018-07-06 | 杭州海康威视数字技术股份有限公司 | A kind of character matrix synchronism output control method, device and electronic equipment |
| CN109240159A (en) * | 2018-09-17 | 2019-01-18 | 苏州中德睿博智能科技有限公司 | Multi-path synchronous signal triggering method, terminal, data collection system and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9519420B2 (en) * | 2013-10-16 | 2016-12-13 | Samsung Electronics Co., Ltd. | Apparatus and method for editing synchronous media |
-
2019
- 2019-02-21 CN CN201910130417.2A patent/CN111601133B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1968078A (en) * | 2006-09-29 | 2007-05-23 | 中兴通讯股份有限公司 | Method for clock synchronization of mobile multimedia broadcast receiving terminal |
| CN108259783A (en) * | 2016-12-29 | 2018-07-06 | 杭州海康威视数字技术股份有限公司 | A kind of character matrix synchronism output control method, device and electronic equipment |
| CN109240159A (en) * | 2018-09-17 | 2019-01-18 | 苏州中德睿博智能科技有限公司 | Multi-path synchronous signal triggering method, terminal, data collection system and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111601133A (en) | 2020-08-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200275149A1 (en) | Multi-screen synchronized playback system and method thereof | |
| CN113365127B (en) | Local area network multi-screen display synchronization method and device | |
| JP4178552B2 (en) | Master-slave synchronous communication method | |
| US10135601B1 (en) | Providing common point of control and configuration in IP-based timing systems | |
| US10595075B2 (en) | Automatic timing of production devices in an internet protocol environment | |
| JP2002521934A (en) | Video and audio synchronization | |
| CN111954050B (en) | Method and system for synchronizing videos among multiple devices | |
| CN103475908A (en) | Multi-screen synchronization play method and device | |
| CN111601133B (en) | Multimedia data synchronous output system and method | |
| KR102566550B1 (en) | Method of display playback synchronization of digital contents in multiple connected devices and apparatus using the same | |
| WO2018121012A1 (en) | Method and apparatus for controlling synchronization output of digital matrix, and electronic device | |
| WO2019033956A1 (en) | Monitoring video synchronization method and video camera | |
| CN113453053B (en) | Distributed video synchronous display system, video synchronous display method and storage medium | |
| JPH05244453A (en) | Synchronization of vertical phase of video signal in video system | |
| US20020018402A1 (en) | Network subscriber for improved time synchronization accuracy and associated method therefor | |
| JPH09186641A (en) | Earth trajectory telephone system | |
| KR102306226B1 (en) | Method of video/audio playback synchronization of digital contents and apparatus using the same | |
| US6854019B2 (en) | System uses time pulse that simultaneously transmits with time of day message to synchronize network user stations | |
| JP3278414B2 (en) | Video switching method and apparatus for television broadcasting | |
| JPS6326591B2 (en) | ||
| TWI660628B (en) | Method for playback synchronization of media among devices | |
| JP2005223821A (en) | Multistream reproduction system | |
| JP2021044629A (en) | Network system, transmission device and reception device | |
| JP2001119607A (en) | Automatic phase adjusting device | |
| JPH0783329B2 (en) | Transmission timing hold method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |