CN110166733B

CN110166733B - Pre-monitoring method and device, output box, server and splicing system

Info

Publication number: CN110166733B
Application number: CN201810146707.1A
Authority: CN
Inventors: 马旭炳
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2018-02-12
Filing date: 2018-02-12
Publication date: 2020-09-15
Anticipated expiration: 2038-02-12
Also published as: CN110166733A

Abstract

The invention discloses a pre-monitoring method and device, an output box, a server and a splicing system, and belongs to the field of video splicing. The method comprises the following steps: when a synchronous pre-monitoring command sent by a server is received, determining a time scale of each video frame data in at least one video frame data contained in a video stream output by a target output box from the moment of receiving the synchronous pre-monitoring command; and sending the video stream and the time scale of each video frame data in the video stream to a server, so that the server splices the m video streams sent by the m output boxes according to the time scale of each video frame data in each video stream in the m video streams sent by the m output boxes to obtain a spliced video stream, and controlling the pre-monitoring equipment to display a spliced video image according to the spliced video stream. The invention is beneficial to solving the problem of poor performance of the splicing system and improving the performance of the splicing system. The invention is used for video splicing.

Description

Pre-monitoring method and device, output box, server and splicing system

Technical Field

The invention relates to the field of video splicing, in particular to a pre-monitoring method and device, an output box, a server and a splicing system.

Background

The splicing system is used as a modern video system and is widely applied to the fields of public security monitoring, traffic management and command, production scheduling and the like.

The splicing system generally includes a splicing screen, a splicing switching card, at least one input box and at least one output box, where each input box of the at least one input box is used to connect with a video input source, and the at least one input box and the at least one output box are respectively connected with the splicing switching card, the splicing screen is a screen formed by splicing at least two display screens, each display screen of the at least two display screens is connected with one output box, and each display screen or a combined display screen (a combined display screen refers to at least two display screens of the splicing screen) can display a video image according to a video signal input by one video input source. In the related art, in order to ensure the display effect of the video images displayed on the splicing screen, the video images displayed on the splicing screen often need to be previewed through pre-monitoring, for this reason, the splicing system further comprises pre-monitoring equipment and a pre-monitoring card, the pre-monitoring equipment is connected with the splicing switching card through the pre-monitoring card, the splicing switching card can switch the video signals input by the video input source to the pre-monitoring equipment through the pre-monitoring card, and the pre-monitoring equipment displays the video images according to the video signals so as to realize the pre-monitoring. The pre-monitoring card is usually an output box or a network coding card which is arranged independently.

In the process of implementing the invention, the inventor finds that the related art has at least the following problems:

when the splicing system realizes pre-monitoring, the switching bandwidth of the splicing switching card needs to be occupied in the pre-monitoring process, so that the bandwidth for transmitting the video signal to the splicing screen by the splicing switching card is smaller, and the performance of the splicing system is poorer.

Disclosure of Invention

The invention provides a pre-monitoring method and device, an output box, a server and a splicing system, which can solve the problem of poor performance of the splicing system. The technical scheme of the invention is as follows:

in a first aspect, a pre-monitoring method is provided, where the pre-monitoring method is used for a target output box in a splicing system, where the splicing system includes a pre-monitoring device, a server, and m output boxes, the server is connected to the m output boxes and the pre-monitoring device, the target output box is any one of the m output boxes, and m is a positive integer, and the method includes:

when a synchronous pre-monitoring command sent by the server is received, determining a time scale of each video frame data in at least one video frame data included in the video stream output by the target output box from the time when the synchronous pre-monitoring command is received, wherein the time scale of each video frame data indicates the output time of each video frame data output from the target output box;

and sending the video stream and the time scale of each video frame data in the video stream to the server, so that the server splices the m video streams sent by the m output boxes according to the time scale of each video frame data in each video stream in the m video streams sent by the m output boxes to obtain a spliced video stream, and controlling the pre-monitoring device to display a spliced video image according to the spliced video stream.

Optionally, the determining, from the time when the synchronous pre-monitoring command is received, a time stamp of each of at least one video frame data included in the video stream output by the target output box includes:

counting from the moment of receiving the synchronous pre-monitoring command according to the clock frequency of the target output box to obtain a counting value corresponding to each video frame data in the at least one video frame data;

and determining the corresponding count value of each video frame data as the time scale of each video frame data.

In a second aspect, a pre-monitoring method is provided, where the pre-monitoring method is used for a server in a splicing system, where the splicing system includes a pre-monitoring device, m output boxes, and the server is connected to the m output boxes and the pre-monitoring device, respectively, and m is a positive integer, and the method includes:

sending a synchronous pre-monitoring command to the m output boxes;

receiving a video stream sent by a target output box and a time scale of each video frame data in the video stream, wherein the time scale of each video frame data indicates an output time of each video frame data output from the target output box, and the target output box is any one of the m output boxes;

splicing the m video streams according to the time scale of each video frame data in each of the m video streams sent by the m output boxes to obtain a spliced video stream;

and controlling the pre-monitoring equipment to display spliced video images according to the spliced video stream.

Optionally, the splicing system further comprises: the spliced screen is formed by splicing n display screens, each output box in the m output boxes is connected with at least one display screen in the n display screens, n is more than or equal to 2 and is an integer,

the splicing the m video streams according to the time stamp of each video frame data in each of the m video streams sent by the m output boxes to obtain a spliced video stream includes:

determining specification parameters of the spliced screen, wherein the specification parameters of the spliced screen comprise the number of display screens contained in the spliced screen, the arrangement mode of the display screens contained in the spliced screen and the identification of the display screens contained in the spliced screen;

and splicing the video frame data with the same time scale in the m video streams according to the specification parameters of the spliced screen to obtain spliced video streams.

In a third aspect, a pre-monitoring apparatus is provided, where the pre-monitoring apparatus is used for a target output box in a splicing system, the splicing system includes a pre-monitoring device, a server, and m output boxes, the server is respectively connected to the m output boxes and the pre-monitoring device, the target output box is any one of the m output boxes, m is a positive integer, and the apparatus includes:

a time scale module, configured to, when a synchronous pre-monitoring command sent by the server is received, determine, from a time when the synchronous pre-monitoring command is received, a time scale of each video frame data of at least one video frame data included in the video stream output by the target output box, where the time scale of each video frame data indicates an output time at which each video frame data is output from the target output box;

and the sending module is used for sending the video stream and the time scale of each video frame data in the video stream to the server, so that the server splices the m video streams sent by the m output boxes according to the time scale of each video frame data in each video stream in the m video streams sent by the m output boxes to obtain a spliced video stream, and controls the pre-monitoring device to display a spliced video image according to the spliced video stream.

Optionally, the timestamp module is configured to:

In a fourth aspect, a pre-monitoring apparatus is provided for a server in a splicing system, the splicing system includes pre-monitoring equipment, m output boxes and the server, the server is respectively connected to the m output boxes and the pre-monitoring equipment, m is a positive integer, the apparatus includes:

the sending module is used for sending a synchronous pre-monitoring command to the m output boxes;

a receiving module, configured to receive a video stream sent by a target output box and a time scale of each video frame data in the video stream, where the time scale of each video frame data indicates an output time at which each video frame data is output from the target output box, and the target output box is any one of the m output boxes;

the splicing module is used for splicing the m video streams according to the time scale of each video frame data in each of the m video streams sent by the m output boxes to obtain a spliced video stream;

and the control module is used for controlling the pre-monitoring equipment to display spliced video images according to the spliced video stream.

Optionally, the splicing system further comprises: the spliced screen is formed by splicing n display screens, each output box of the m output boxes is connected with at least one display screen of the n display screens, n is not less than 2, n is an integer, and the spliced module is used for:

In a fifth aspect, a splicing system is provided, the splicing system comprising: the system comprises pre-monitoring equipment, a server and m output boxes, wherein the server is respectively connected with the m output boxes and the pre-monitoring equipment, and m is a positive integer; a target output cartridge comprising the pre-monitoring apparatus of the third aspect or any alternative form of the third aspect, the target output cartridge being any one of the m output cartridges; the server comprises the pre-monitoring device of the fourth aspect or any optional manner of the fourth aspect.

Optionally, the splicing system further comprises: the spliced screen is formed by splicing n display screens, each output box in the m output boxes is connected with at least one display screen in the n display screens, n is not less than 2, and n is an integer.

Optionally, the splicing system further comprises: splicing the switching card and p input boxes, wherein p is more than or equal to 2 and is an integer; the p input boxes and the m output boxes are respectively connected with the splicing switching card, and each input box in the p input boxes is used for being connected with one video input source.

Optionally, m is equal to n, and the m output boxes are connected with the n display screens in a one-to-one correspondence.

Optionally, the pre-monitoring device comprises at least one of a local pre-monitoring device and a remote pre-monitoring device.

In a sixth aspect, there is provided an output cartridge comprising: a processor and a memory, wherein the processor is capable of processing a plurality of data,

the memory is used for storing a computer program;

the processor is configured to execute the program stored in the memory to implement the pre-monitoring method according to the first aspect or any optional manner of the first aspect.

In a seventh aspect, a server is provided, including: a processor and a memory, wherein the processor is capable of processing a plurality of data,

the memory is used for storing a computer program;

the processor is configured to execute the program stored in the memory to implement the pre-monitoring method according to the second aspect or any optional manner of the second aspect.

In an eighth aspect, there is provided a computer readable storage medium having stored therein instructions which, when executed on a processor of an output cartridge, cause the output cartridge to perform the pre-monitoring method of the first aspect or any alternative of the first aspect.

In a ninth aspect, there is provided a computer readable storage medium having stored therein instructions which, when executed by a processor of a server, cause the server to perform the pre-monitoring method of the second aspect or any alternative of the second aspect.

The technical scheme provided by the invention has the beneficial effects that:

the invention provides a pre-monitoring method and device, an output box, a server and a splicing system, wherein the splicing system comprises pre-monitoring equipment, the server and m output boxes, when a synchronous pre-monitoring command sent by the server is received by a target output box, a time scale of each video frame data in at least one video frame data contained in a video stream output by the target output box is determined from the moment of receiving the synchronous pre-monitoring command, the video stream and the time scale of each video frame data in the video stream are sent to the server, the server splices m video streams sent by the m output boxes according to the time scales of each video frame data in each video stream in the m video streams sent by the m output boxes to obtain a spliced video stream, and controls the pre-monitoring equipment to display the spliced video images according to the spliced video stream. The server directly obtains the video stream from the output box for pre-monitoring, so that the switching bandwidth of the splicing switching card is not required to be occupied in the pre-monitoring process, the problem of poor performance of the splicing system is solved, and the performance of the splicing system is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a splicing system according to an embodiment of the present invention;

FIG. 2 is a schematic structural diagram of another splicing system provided by an embodiment of the present invention;

FIG. 3 is a flow chart of a method of pre-monitoring according to an embodiment of the present invention;

FIG. 4 is a flow chart of a method of another pre-monitoring method according to an embodiment of the present invention;

FIG. 5 is a flowchart of a method of a further pre-monitoring method according to an embodiment of the present invention;

fig. 6 is a flowchart of a method for determining a time stamp of video frame data according to an embodiment of the present invention;

fig. 7 is a flowchart of a method for sending a video stream and a timestamp of each video frame data to a server according to an embodiment of the present invention;

fig. 8 is a flowchart of a method for associating video frame data with a timestamp of the video frame data according to an embodiment of the present invention;

fig. 9 is a flowchart of a method for splicing m video streams according to an embodiment of the present invention;

FIG. 10 is a block diagram of a pre-monitoring apparatus according to an embodiment of the present invention;

fig. 11 is a block diagram of a sending module according to an embodiment of the present invention;

FIG. 12 is a block diagram of another pre-monitoring apparatus provided in accordance with an embodiment of the present invention;

fig. 13 is a block diagram of another pre-monitoring apparatus according to an embodiment of the present invention.

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In addition, the splicing system provided by the related art cannot synchronously realize network pre-monitoring and local pre-monitoring, is limited by the resources of the pre-monitoring card, and cannot realize the pre-monitoring of a large-scale splicing screen. The splicing system provided by the embodiment of the invention directly obtains the video stream from the output box for pre-monitoring, a pre-monitoring card is not required to be arranged, the switching bandwidth of the splicing switching card is not occupied, the structure of the splicing system is simplified, the performance of the splicing system is improved, the splicing system provided by the embodiment of the invention can synchronously realize network pre-monitoring and local pre-monitoring, and the pre-monitoring of a large-scale splicing screen can be realized. The present invention is described in detail with reference to the following examples.

Fig. 1 is a schematic structural diagram of a splicing system provided in an embodiment of the present invention, and referring to fig. 1, the splicing system includes: the system comprises pre-monitoring equipment, a server and m output boxes, wherein the server is respectively connected with the m output boxes and the pre-monitoring equipment, and m is a positive integer.

The pre-monitoring device may include at least one of a local pre-monitoring device and a remote pre-monitoring device, so that the splicing system can implement at least one of local pre-monitoring and remote pre-monitoring. The pre-monitoring device may be a smartphone, tablet, smart television, laptop portable computer, display, desktop computer, or monitoring device, etc. The server can be a server, a server cluster consisting of a plurality of servers, or a cloud computing service center. As shown in fig. 1, the m output boxes include output boxes 1 to m, and each of the output boxes 1 to m is connected to a server, and in practical applications, the output boxes may also be referred to as output cards. Alternatively, each of the output cartridges 1 to m may be connected to the server through a network, which may be a wireless network or a wired network, which may include, but is not limited to: wireless Fidelity (WIFI for short), bluetooth, infrared, Zigbee (Zigbee) or data, etc., and the wired network may be a Universal Serial Bus (USB for short).

Optionally, referring to fig. 2, which shows a schematic structural diagram of another splicing system provided in the embodiment of the present invention, referring to fig. 2, the splicing system further includes: the spliced screen is formed by splicing n display screens, each output box in the m output boxes is connected with at least one display screen in the n display screens, n is more than or equal to 2, and n is an integer. Optionally, the m output boxes are connected to the n Display screens in a one-to-one correspondence, each Display screen of the n Display screens may be a Liquid Crystal Display (LCD) or a Light Emitting Diode (LED) Display screen, and each output box of the m output boxes is connected to at least one Display screen of the n Display screens through a video line.

Further, as shown in fig. 2, the splicing system further includes: splicing the switching card and p input boxes, wherein p is more than or equal to 2 and is an integer; p input boxes and m output boxes are connected to the stitching switch card, respectively, and each of the p input boxes is used for connecting to a video input source (not shown in fig. 2). As shown in fig. 2, the p input boxes include input boxes 1 to p, each of the input boxes 1 to p is connected to a splicing switching card, and each of the output boxes 1 to m is connected to a splicing switching card. The video input source may be a video capture device, for example, the video input source may be a device with a video capture function, such as a monitoring camera device, a mobile phone or a computer, and the video input source has a video interface, and the video interface may be: digital Video Interface (DVI), High Definition Multimedia Interface (HDMI), Video Graphics Array (VGA), High Definition Digital Serial Digital Interface (HDSDI), 3G Serial Digital Interface (3 GSDI), or snap-fit connector (Bayton NutConnector (BNC).

In the splicing system shown in fig. 2, each video input source may input a video stream to the splicing switching card through one input box, the splicing switching card performs splicing switching on the received video stream, outputs the video stream to the splicing screen through the output box, and the splicing screen performs video image display according to the received video stream. Wherein the video stream input by each video input source can be displayed on at least one display screen in the n display screens.

The splicing system shown in fig. 1 and 2 can implement the pre-monitoring function on the premise of not occupying the switching bandwidth of the splicing switching card, and therefore, the performance of the splicing system shown in fig. 1 and 2 is better. The pre-monitoring process of the splicing system shown in fig. 1 or fig. 2 may be as follows:

the server sends a synchronous pre-monitoring command to the m output boxes, when the target output box receives the synchronous pre-monitoring command, the target output box determines the time scale of each video frame data in at least one video frame data contained in the video stream output by the target output box from the moment of receiving the synchronous pre-monitoring command, and sends the video stream and the time scale of each video frame data in the video stream to the server. Wherein the target output box is any one of the m output boxes, and the time scale of each video frame data may indicate an output time at which each video frame data is output from the target output box. Alternatively, the target output box may associate each video frame data in the video stream with a time stamp of the video frame data, obtain an associated video stream, and send the associated video stream to the server to send the video stream and the time stamp of each video frame data in the video stream to the server. Before associating the video frame data with the time scale, the target output box may further encode the video frame data to obtain encoded video frame data corresponding to the video frame data, and associate the encoded video frame data with the corresponding time scale.

Each output box in the m output boxes can send the video stream and the time scale of each video frame data in the video stream to the server, so that the server can receive the m video streams, the server can splice the m video streams according to the time scale of each video frame data in each video stream in the m video streams to obtain a spliced video stream, and the pre-monitoring device is controlled to display spliced video images according to the spliced video stream to achieve pre-monitoring. Optionally, the video stream received by the server may be a related video stream, and the video frame data in the video stream is encoded video frame data encoded by the output box, and the server may decode the encoded video frame data to obtain corresponding video frame data, and then splice the video frame data with the same time stamp in the m video streams to obtain a spliced video stream.

Referring to fig. 3, a flow chart of a method of a pre-monitoring method provided by an embodiment of the present invention is shown, the pre-monitoring method can be used for a target output box, and the target output box can be any output box in the splicing system shown in fig. 1 or fig. 2. Referring to fig. 3, the method includes:

step 301, when receiving a synchronous pre-monitoring command sent by a server, determining a time scale of each video frame data in at least one video frame data included in a video stream output by a target output box from a time when the synchronous pre-monitoring command is received, where the time scale of each video frame data indicates an output time when each video frame data is output from the target output box.

Step 302, sending the video stream and the time stamp of each video frame data in the video stream to the server, so that the server splices the m video streams sent by the m output boxes according to the time stamp of each video frame data in each video stream in the m video streams sent by the m output boxes to obtain a spliced video stream, and controlling the pre-monitoring device to display a spliced video image according to the spliced video stream.

In summary, according to the pre-monitoring method provided by the embodiment of the present invention, since the server directly obtains the video stream from the output box for pre-monitoring, the pre-monitoring process does not need to occupy the switching bandwidth of the splicing switching card, which is beneficial to solving the problem of poor performance of the splicing system and improving the performance of the splicing system.

Optionally, step 302 includes: associating each video frame data in the video stream with the time scale of each video frame data to obtain an associated video stream; the associated video stream is sent to the server. The time scales of the video frame data and the video frame data are associated and transmitted, so that the server can conveniently determine the time scale of each video frame data, and the m video streams are spliced according to the time scales of the video frame data.

Optionally, associating each video frame data in the video stream with a time stamp of each video frame data to obtain an associated video stream, including: coding each video frame data in the video stream to obtain coded video frame data corresponding to each video frame data; and associating the coded video frame data corresponding to each video frame data with the time scale of each video frame data to obtain an associated video stream. Since the video frame data is encoded and transmitted, reliability of transmission of the video frame data can be improved.

Optionally, step 301 comprises: counting from the moment of receiving the synchronous pre-monitoring command according to the clock frequency of the target output box to obtain a counting value corresponding to each video frame data in at least one video frame data; and determining the corresponding count value of each video frame data as the time scale of each video frame data. Due to the fact that clocks of the m output boxes are synchronous, counting can be started at the moment when the synchronous pre-monitoring command is received, the time scale of the video frame data is determined according to the counting value, and the determination of the time scale of the video frame data is facilitated.

All the above-mentioned optional technical solutions can be combined arbitrarily to form the optional embodiments of the present invention, and are not described herein again.

Referring to fig. 4, a flowchart of another method for pre-monitoring provided by the embodiment of the present invention is shown, where the method for pre-monitoring can be used in a server in the splicing system shown in fig. 1 or fig. 2. Referring to fig. 4, the method includes:

step 401, sending a synchronous pre-monitoring command to m output boxes.

Step 402, receiving a video stream sent by a target output box and a time scale of each video frame data in the video stream, where the time scale of each video frame data indicates an output time of each video frame data output from the target output box, and the target output box is any one of m output boxes.

And step 403, splicing the m video streams according to the time stamp of each video frame data in each of the m video streams sent by the m output boxes to obtain a spliced video stream.

And step 404, controlling the pre-monitoring equipment to display the spliced video image according to the spliced video stream.

Optionally, step 401 may comprise: and receiving the associated video stream sent by the target output box, wherein the associated video stream is obtained by associating each video frame data in the video stream output by the target output box with the time stamp of each video frame data by the target output box. Since the associated video stream is obtained by associating the video frame data with the time scale of the video frame data by the target output box, the server can determine the time scale of each video frame data conveniently, so that the m video streams are spliced according to the time scales of the video frame data.

Optionally, the associated video stream is obtained by associating, by the target output box, encoded video frame data corresponding to each video frame data with a time stamp of each video frame data after the target output box encodes each video frame data in the video stream output by the target output box to obtain encoded video frame data corresponding to each video frame data, before step 402, the method further includes: and decoding each coded video frame data in the associated video stream to obtain corresponding video frame data. Since the video frame data is encoded and transmitted, reliability of transmission of the video frame data can be improved.

Optionally, the splicing system further comprises: the concatenation screen, the concatenation screen is the screen that is formed by n display screen concatenations, and every output box in m output boxes is connected with at least one display screen in n display screens, and n is more than or equal to 2, and n is the integer, and step 402 includes: determining specification parameters of the spliced screen, wherein the specification parameters of the spliced screen comprise the number of display screens contained in the spliced screen, the arrangement mode of the display screens contained in the spliced screen and the identification of the display screens contained in the spliced screen; and splicing the video frame data with the same time scale in the m video streams according to the specification parameters of the spliced screen to obtain spliced video streams. Because the video frame data with the same time scale in the m video streams are spliced according to the specification parameters of the splicing screen, the synchronization of the pre-monitoring picture and the picture displayed by the splicing screen can be ensured.

Optionally, step 403 includes: and sending the spliced video stream to a pre-monitoring device, wherein the pre-monitoring device is used for displaying the spliced video image according to the spliced video stream. According to the pre-monitoring method provided by the embodiment of the invention, the spliced video stream is sent to the pre-monitoring equipment, so that the pre-monitoring equipment can conveniently display the spliced video image, and the pre-monitoring is carried out.

Referring to fig. 5, a flowchart of a method of a pre-monitoring method according to another embodiment of the present invention is shown, where the pre-monitoring method can be used in the splicing system shown in fig. 1 or fig. 2. Referring to fig. 5, the method includes:

step 501, the server sends a synchronous pre-monitoring command to m output boxes, wherein the m output boxes comprise target output boxes.

In the embodiment of the present invention, the pre-monitoring of the splicing system may be initiated by a server, and the process of initiating the pre-monitoring by the server may include: the server generates a synchronous pre-supervisor command and then sends the synchronous pre-supervisor command to m output cartridges at the same time, which may include the target output cartridge. Wherein the server can send the synchronous pre-monitoring command to the corresponding output box through a network between the server and each output box.

Optionally, the synchronous pre-monitoring command may carry a pre-monitoring identifier, where the pre-monitoring identifier may be agreed in advance by the server and the output box, and the output box may determine whether the received command is the synchronous pre-monitoring command according to whether the received command carries the pre-monitoring identifier; alternatively, the commands transmitted by the server to the output box are limited to synchronous pre-monitoring commands, and the output box considers the commands as synchronous pre-monitoring commands once receiving the commands sent by the server. Of course, besides, the synchronous pre-monitoring command may also be embodied in any other form, and the embodiment of the present invention is not described herein again.

Step 502, when receiving a synchronous pre-monitoring command sent by a server, a target output box determines, from a time when the synchronous pre-monitoring command is received, a time stamp of each video frame data in at least one video frame data included in a video stream output by the target output box, where the time stamp of each video frame data indicates an output time when each video frame data is output from the target output box.

The target output box is any one of the m output boxes, when receiving the synchronous pre-monitoring command, the target output box may determine, from a time when the synchronous pre-monitoring command is received, a time scale of each video frame data in at least one video frame data included in the video stream output by the target output box, where each video frame data is data of one frame of video image, and the time scale of each video frame data indicates an output time when each video frame data is output from the target output box.

Optionally, as shown in fig. 2, the video stream is sequentially transmitted to the splicing screen through the input box, the splicing switching card, and the output boxes, each output box has an output port, the video stream in the output box is output to the splicing screen through the output port, and the target output box may acquire the video stream at the output port of the target output box from the time when the synchronous pre-monitoring command is received, so as to obtain the video stream output by the target output box, and determine the time scale of each video frame data in at least one video frame data included in the video stream. Or each output box has a storage space, a video stream is stored in the storage space, and the target output box can read the video stream from the storage space of the target output box from the moment when the synchronous pre-monitoring command is received to obtain the video stream output by the target output box, and determine the time stamp of each video frame data in at least one video frame data contained in the video stream.

Optionally, a timer is disposed in the target output box, and each time the target output box outputs one piece of video frame data, the output time of the video frame data may be recorded by the timer, and the output time is used as the time scale of the video frame data. Alternatively, the clocks of the m output boxes may be synchronized, and thus, the target output box may determine the time stamp of the video frame data using the method provided by the embodiment of fig. 6 described below.

Referring to fig. 6, a flowchart of a method for determining a time stamp of video frame data according to an embodiment of the present invention is shown, and referring to fig. 6, the method includes:

in the substep 5021, the target output box starts to count from the moment when the synchronous pre-monitoring command is received according to the clock frequency of the target output box, so as to obtain a count value corresponding to each video frame data in at least one video frame data.

Optionally, a counter is disposed in the target output box, the timing frequency of the counter may be equal to the clock frequency of the target output box, and when the synchronous pre-monitoring command is received, the counter of the target output box starts to count, and since the target output box is still outputting the video stream in the process, the target output box may obtain a count value corresponding to each video frame data in the video stream in the process of counting.

For example, assuming that the at least one video frame data includes video frame data 11, video frame data 12, video frame data 13, video frame data 14, and video frame data 15, the count value corresponding to each video frame data of the at least one video frame data counted by the target output box may be as shown in table 1 below:

TABLE 1

Video frame data	Count number
		Video frame data 11	1
Video frame data 12	2
		Video frame data 13	3
Video frame data 14	4
		Video frame data 15	5

In sub-step 5022, the target output box determines the corresponding count value of each video frame data as the time scale of each video frame data.

After the target output box obtains the count value corresponding to each video frame data in the at least one video frame data, because the clocks of the m output boxes are synchronous, and the timing frequency of the counter can be equal to the clock frequency of the output box, the target output box can determine the count value corresponding to each video frame data as the time scale of each video frame data.

For example, as shown in table 1, the target output box may have count value 1 as the time scale for video frame data 11, count value 2 as the time scale for video frame data 12, count value 3 as the time scale for video frame data 13, and so on.

Step 503, the target output box sends the video stream and the timestamp of each video frame data in the video stream to the server.

After the target output box determines the time stamp of each video frame data in the video stream, the video stream and the time stamp of each video frame data in the video stream may be sent to the server. Optionally, please refer to fig. 7, which shows a flowchart of a method for a target output box to send a video stream and a timestamp of each video frame data in the video stream to a server according to an embodiment of the present invention, and referring to fig. 7, the method includes:

in sub-step 5031, the target output box associates each video frame data in the video stream with the time stamp of each video frame data to obtain an associated video stream.

Optionally, the target output box binds the video frame data with the time scale of the video frame data to associate the video frame data with the time scale of the video frame data, so as to obtain an associated video stream. By way of example, assume that the video stream acquired by the target output box is: { video frame data 11, video frame data 12, video frame data 13, video frame data 14, and video frame data 15}, the associated video stream may be: { (video frame data 11, 1), (video frame data 12, 2), (video frame data 13, 3), (video frame data 14, 4), (video frame data 15, 5) }.

Referring to fig. 8, which shows a flowchart of a method for associating video frame data with a time stamp of the video frame data by a target output box according to an embodiment of the present invention, referring to fig. 8, the method includes:

in sub-step 50311, the target output box encodes each video frame data in the video stream to obtain encoded video frame data corresponding to each video frame data.

Optionally, an encoding unit may be disposed in the target output box, and the encoding unit may encode each video frame data in the video stream output by the target output box to obtain encoded video frame data corresponding to each video frame data. The target output box may encode the video frame data in any encoding manner, and the specific encoding process may refer to related technologies, which is not described herein again in the embodiments of the present invention.

By way of example, assume that the video stream acquired by the target output box is: { video frame data 11, video frame data 12, video frame data 13, video frame data 14, and video frame data 15}, the target output box encodes the video frame data 11 in the video stream to obtain encoded video frame data 11, encodes the video frame data 12 to obtain encoded video frame data 12, encodes the video frame data 13 to obtain encoded video frame data 13, encodes the video frame data 14 to obtain encoded video frame data 14, and encodes the video frame data 15 to obtain encoded video frame data 15.

In sub-step 50312, the target output box associates the coded video frame data corresponding to each video frame data with the time stamp of each video frame data to obtain an associated video stream.

The target output box may bind the encoded video frame data corresponding to each video frame data with the time stamp of each video frame data to obtain the associated video stream.

For example, the time scale of the video frame data 11 is 1, the time scale of the video frame data 12 is 2, the time scale of the video frame data 13 is 3, the time scale of the video frame data 14 is 4, and the time scale of the video frame data 15 is 5, the target output box encodes the video frame data 11 to obtain encoded video frame data 11, encodes the video frame data 12 to obtain encoded video frame data 12, encodes the video frame data 13 to obtain encoded video frame data 13, encodes the video frame data 14 to obtain encoded video frame data 14, and encodes the video frame data 15 to obtain encoded video frame data 15, and then the target output box associates the encoded video frame data corresponding to each video frame data with the time scale of each video frame data to obtain an associated video stream, which may be: { (encoded video frame data 11, 1), (encoded video frame data 12, 2), (encoded video frame data 13, 3), (encoded video frame data 14, 4), (encoded video frame data 15, 5) }.

Sub-step 5032 the target egress box sends the associated video stream to the server.

The target output box may send the associated video stream to the server over a network with the server. For example, the target output box sends the associated video stream to the server over a network with the server: { (encoded video frame data 11, 1), (encoded video frame data 12, 2), (encoded video frame data 13, 3), (encoded video frame data 14, 4), (encoded video frame data 15, 5) }.

Step 504, the server receives the video stream sent by the target output box and the time stamp of each video frame data in the video stream.

Optionally, the receiving, by the server, the video stream transmitted by the target output box and the time stamp of each video frame data in the video stream may include: the server receives the associated video stream sent by the target output box, and as can be seen from the description in step 504, the associated video stream is obtained by associating each video frame data in the video stream output by the target output box with the timestamp of each video frame data by the target output box.

And 505, splicing the m video streams by the server according to the time stamp of each video frame data in each video stream in the m video streams sent by the m output boxes to obtain a spliced video stream.

In an embodiment of the present invention, each of the m output boxes may send the video stream and the time stamp of each video frame data in the corresponding video stream to the server, so that the server may receive the m video streams and the time stamp of each video frame data in each of the m video streams, and the server may splice the m video streams according to the time stamp of each video frame data in each of the m video streams to obtain a spliced video stream.

In the embodiment of the present invention, as shown in fig. 2, the splicing system further includes: the spliced screen is formed by splicing n display screens, each output box in the m output boxes is connected with at least one display screen in the n display screens, n is not less than 2, n is an integer, and the server can splice the m video streams according to the specification parameters of the spliced screen. Optionally, referring to fig. 9, which shows a flowchart of a method for splicing m video streams by a server according to an embodiment of the present invention, referring to fig. 9, the method includes:

substep 5051, determining specification parameters of the spliced screen, wherein the specification parameters of the spliced screen include the number of display screens included in the spliced screen, the arrangement mode of the display screens included in the spliced screen, and the identification of the display screens included in the spliced screen.

Optionally, the server is configured with specification parameters of the tiled screen, and the server can read the specification parameters of the tiled screen to determine the specification parameters of the tiled screen, and the specification parameters of the tiled screen may include the number of display screens included in the tiled screen, the arrangement mode of the display screens included in the tiled screen, and the identifiers of the display screens included in the tiled screen, for example, the specification parameters of the tiled screen may include: 2 × 2, P11, P12, P21 and P22, 2 × 2 indicates that the display screen is composed of 2 × 2 display screens, and the 2 × 2 display screens are arranged in 2 rows and 2 columns, P11, P12, P21 and P22 indicate the identifications of 4 display screens included in the spliced screen, P11 indicates the identification of the display screen 11, P12 indicates the identification of the display screen 12, P21 indicates the identification of the display screen 21, and P22 indicates the identification of the display screen 22.

And a sub-step 5052, according to the specification parameters of the spliced screen, splicing the video frame data with the same time scale in the m video streams to obtain a spliced video stream.

Optionally, the server may compare the time stamps to determine the same time stamp, and then, according to the specification parameters of the splicing screen, splice video frame data with the same time stamp in the m video streams to obtain a spliced video stream.

By way of example, assuming that m is 4, the stitching system includes 4 output boxes, namely output box 1 to output box 4, 4 display screens of the stitching screen include display screen 11, display screen 12, display screen 21 and display screen 22, the display screen 11 is denoted by P11, the display screen 12 is denoted by P12, the display screen 21 is denoted by P21, the display screen 22 is denoted by P22, output box 1 is connected to display screen 11, output box 2 is connected to display screen 12, output box 3 is connected to display screen 21, output box 4 is connected to display screen 22, the video stream output by output box 1 is video stream 1, the video stream output by output box 2 is video stream 2, the video stream output by output box 3 is video stream 3, the video stream output by output box 4 is video stream 4, then video stream 1 flows to display screen 11, video stream 2 flows to display screen 12, video stream 3 flows to display screen 21, video stream 4 flows to display screen 22, assume that video streams 1 to 4 are as shown in table 2 below:

TABLE 2

The server splices the video frame data 11, the video frame data 21, the video frame data 31 and the video frame data 41 to obtain spliced video frame data 1, splices the video frame data 12, the video frame data 22, the video frame data 32 and the video frame data 42 to obtain spliced video frame data 2, splices the video frame data 13, the video frame data 23, the video frame data 33 and the video frame data 43 to obtain spliced video frame data 3, splices the video frame data 14, the video frame data 24, the video frame data 34 and the video frame data 44 to obtain spliced video frame data 4, and splices the video frame data 15, the video frame data 25, the video frame data 35 and the video frame data 45 to obtain spliced video frame data 5 according to the specification parameters of the spliced screen, so that a spliced video stream is obtained, wherein the spliced video stream comprises the spliced video frame.

It should be noted that the output box may dynamically send the video streams to the server, so that the process of splicing the m video streams by the server is dynamically performed, in other words, the server receives the video streams and splices the video streams at the same time, which is not described herein again in this embodiment of the present invention.

It should also be noted that, in this embodiment of the present invention, the m video streams received by the server may be associated video streams, where the associated video streams are obtained by associating, by the output box, the encoded video frame data corresponding to each video frame data after encoding each video frame data in the video streams output by the output box to obtain the encoded video frame data corresponding to each video frame data with the time stamp of each video frame data, and before splicing the m video streams, the server may decode each encoded video frame data in the associated video streams to obtain corresponding video frame data, and optionally, the server may decode the encoded video frame data by using a decoding method corresponding to the output box encoding, and a specific decoding process may refer to a related technology, which is not described herein again.

Step 506, the server controls the pre-monitoring device to display the spliced video image according to the spliced video stream.

After the server obtains the spliced video stream, the server can control the pre-monitoring equipment to display the spliced video image according to the spliced video stream. Optionally, the server may send the spliced video stream to the pre-monitoring device, and the pre-monitoring device displays the spliced video image according to the spliced video stream sent by the server, where the pre-monitoring device may be at least one of a local pre-monitoring device and a remote pre-monitoring device.

Optionally, the server may further send specification parameters of the mosaic screen, a size of the mosaic screen, and the like to the pre-monitoring device, and the pre-monitoring device may determine, according to the specification parameters of the mosaic screen, the size of the mosaic screen, and the like, a corresponding display area of each display screen of the mosaic screen in the display screen (or a pre-monitoring window) of the pre-monitoring device, and then control the display screen of the pre-monitoring device to display a video image in the corresponding display area according to video data in each mosaic video data in the mosaic video stream, so that the mosaic video image is displayed on the pre-monitoring device to achieve pre-monitoring. The process of determining, by the pre-monitoring device, the corresponding display area of each display screen of the mosaic screen in the display screen (or the pre-monitoring window) of the pre-monitoring device may refer to related technologies, and details of the embodiment of the present invention are not described herein again.

It should be noted that, the order of the steps of the pre-monitoring method provided in the embodiment of the present invention may be appropriately adjusted, and the steps may also be increased or decreased according to the circumstances, and any method that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included in the protection scope of the present invention, and therefore, the detailed description is omitted.

In summary, according to the pre-monitoring method provided by the embodiment of the present invention, since the server directly obtains the video stream from the output box for pre-monitoring, the pre-monitoring process does not need to occupy the switching bandwidth of the splicing switching card, which is beneficial to solving the problem of poor performance of the splicing system and improving the performance of the splicing system. The pre-monitoring method provided by the embodiment of the invention realizes the pre-monitoring function on the premise of not occupying the splicing resources of the splicing system and not influencing the splicing scale, and simultaneously supports local pre-monitoring and network pre-monitoring.

The following are embodiments of the apparatus of the present invention that may be used to perform embodiments of the method of the present invention. For details which are not disclosed in the embodiments of the apparatus of the present invention, reference is made to the embodiments of the method of the present invention.

Referring to fig. 10, a block diagram of a pre-monitoring apparatus 1000 according to an embodiment of the present invention is shown, where the pre-monitoring apparatus 1000 may be a functional unit in a target output box, and the target output box may be any one of m output boxes in the stitching system shown in fig. 1 or fig. 2. Referring to fig. 10, the pre-monitoring device 1000 may include, but is not limited to:

the time scale module 1010 is configured to, when a synchronous pre-monitoring command sent by the server is received, determine a time scale of each video frame data of at least one video frame data included in the video stream output by the target output box from a time when the synchronous pre-monitoring command is received, where the time scale of each video frame data indicates an output time when each video frame data is output from the target output box;

the sending module 1020 is configured to send the video stream and the time stamp of each video frame data in the video stream to the server, so that the server splices the m video streams sent by the m output boxes according to the time stamp of each video frame data in each video stream in the m video streams sent by the m output boxes to obtain a spliced video stream, and controls the pre-monitoring device to display a spliced video image according to the spliced video stream.

In summary, in the pre-monitoring device provided in the embodiment of the present invention, since the server directly obtains the video stream from the output box for pre-monitoring, the switching bandwidth of the splicing switching card does not need to be occupied in the pre-monitoring process, which is beneficial to solving the problem of poor performance of the splicing system and improving the performance of the splicing system.

Optionally, referring to fig. 11, which shows a block diagram of a sending module 1020 according to an embodiment of the present invention, referring to fig. 11, the sending module 1020 includes:

the association submodule 1021 is configured to associate each video frame data in the video stream with a time stamp of each video frame data, so as to obtain an associated video stream;

the sending submodule 1022 is configured to send the associated video stream to the server.

Optionally, the association submodule 1021 is configured to:

coding each video frame data in the video stream to obtain coded video frame data corresponding to each video frame data;

and associating the coded video frame data corresponding to each video frame data with the time scale of each video frame data to obtain an associated video stream.

Optionally, a timestamp module 1010, configured to:

counting from the moment of receiving the synchronous pre-monitoring command according to the clock frequency of the target output box to obtain a counting value corresponding to each video frame data in at least one video frame data;

Referring to fig. 12, a block diagram of another pre-monitoring apparatus 1200 according to an embodiment of the present invention is shown, where the pre-monitoring apparatus 1000 may be a functional unit in the server shown in fig. 1 or fig. 2. Referring to fig. 12, the pre-monitoring apparatus 1200 may include, but is not limited to:

a sending module 1210, configured to send a synchronous pre-monitoring command to the m output cartridges;

the receiving module 1220 is configured to receive the video stream sent by the target output box and a time scale of each video frame data in the video stream, where the time scale of each video frame data indicates an output time at which each video frame data is output from the target output box, and the target output box is any one of the m output boxes;

the splicing module 1230 is configured to splice the m video streams according to the time stamp of each video frame data in each of the m video streams sent by the m output boxes, so as to obtain a spliced video stream;

and the control module 1240 is used for controlling the pre-monitoring equipment to display the spliced video images according to the spliced video stream.

Optionally, the receiving module 1220 is configured to receive the associated video stream sent by the target output box, where the associated video stream is obtained by associating each video frame data in the video stream output by the target output box with a time stamp of each video frame data.

Optionally, the associated video stream is obtained by associating the encoded video frame data corresponding to each video frame data with the time stamp of each video frame data after the target output box encodes each video frame data in the video stream output by the target output box to obtain the encoded video frame data corresponding to each video frame data,

referring to fig. 13, which shows a block diagram of a pre-monitoring apparatus 1200 according to another embodiment of the present invention, referring to fig. 13, on the basis of fig. 12, the pre-monitoring apparatus 1200 further includes: the decoding module 1250 is configured to decode each encoded video frame data in the associated video stream to obtain corresponding video frame data.

Optionally, the splicing system further comprises: the concatenation screen, the concatenation screen is the screen that is formed by n display screen concatenations, and every output box in the m output boxes is connected with at least one display screen in n display screens, and n is more than or equal to 2, and n is the integer, concatenation module 1230 for:

Optionally, the control module 1240 is configured to send the stitched video stream to a pre-monitoring device, and the pre-monitoring device is configured to display the stitched video image according to the stitched video stream.

An embodiment of the present invention further provides a splicing system, which may be the splicing system shown in fig. 1 or fig. 2, in which a target output box in the splicing system includes the pre-monitoring apparatus 1000 shown in fig. 10, and a server includes the pre-monitoring apparatus 1200 shown in fig. 12 or fig. 13.

An embodiment of the present invention further provides an output cartridge, including: a processor and a memory, wherein the processor is capable of processing a plurality of data,

a memory for storing a computer program;

a processor, configured to execute the program stored in the memory to implement the pre-monitoring method provided in the embodiment shown in fig. 3 or the related steps of the pre-monitoring method provided in the embodiment shown in fig. 5.

An embodiment of the present invention further provides a server, where the server includes: a processor and a memory, wherein the processor is capable of processing a plurality of data,

a memory for storing a computer program;

and a processor for executing the program stored in the memory to implement the pre-monitoring method provided by the embodiment shown in fig. 4 or the relevant steps of the pre-monitoring method provided by the embodiment shown in fig. 5.

Embodiments of the present invention further provide a computer-readable storage medium, which stores instructions that, when executed by a processor of an output box, cause the output box to perform the pre-monitoring method provided in the embodiment shown in fig. 3 or the relevant steps of the pre-monitoring method provided in the embodiment shown in fig. 5.

An embodiment of the present invention further provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed by a processor of a server, the server executes the pre-monitoring method provided in the embodiment shown in fig. 4 or the relevant steps of the pre-monitoring method provided in the embodiment shown in fig. 5.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims

1. A pre-monitoring method is characterized in that the method is used for a target output box in a splicing system, the splicing system comprises pre-monitoring equipment, a server and m output boxes, the server is respectively connected with the m output boxes and the pre-monitoring equipment, the target output box is any one of the m output boxes, m is a positive integer, and the method comprises the following steps:

2. The method of claim 1, wherein determining a time stamp for each of at least one video frame data included in the video stream output by the target output box from the time the synchronous pre-monitoring command was received comprises:

3. A pre-monitoring method is characterized in that the method is used for a server in a splicing system, the splicing system comprises pre-monitoring equipment, m output boxes and the server, the server is respectively connected with the m output boxes and the pre-monitoring equipment, m is a positive integer, and the method comprises the following steps:

sending a synchronous pre-monitoring command to the m output boxes;

4. The method of claim 3, wherein the stitching system further comprises: the spliced screen is formed by splicing n display screens, each output box in the m output boxes is connected with at least one display screen in the n display screens, n is more than or equal to 2 and is an integer,

5. The utility model provides a pre-supervision device for target output box in the concatenation system, the concatenation system includes pre-supervision equipment, server and m output box, the server respectively with m output box with pre-supervision equipment is connected, target output box is any output box in the m output box, m is the positive integer, the device includes:

6. The apparatus of claim 5, wherein the time scale module is configured to:

7. The utility model provides a pre-supervision device for server in the concatenation system, the concatenation system including pre-supervision equipment, m export boxes and the server, the server respectively with m export boxes with pre-supervision equipment is connected, m is the positive integer, the device includes:

8. The apparatus of claim 7, wherein the splicing system further comprises: the spliced screen is formed by splicing n display screens, each output box of the m output boxes is connected with at least one display screen of the n display screens, n is not less than 2, n is an integer, and the spliced module is used for:

9. A splicing system, characterized in that the splicing system comprises: the system comprises pre-monitoring equipment, a server and m output boxes, wherein the server is respectively connected with the m output boxes and the pre-monitoring equipment, and m is a positive integer;

a target output cartridge comprising the pre-monitoring apparatus of claim 5 or 6, the target output cartridge being any one of the m output cartridges; the server comprising the pre-monitoring device of claim 7 or 8.

10. The splicing system of claim 9, further comprising: the spliced screen is formed by splicing n display screens, each output box in the m output boxes is connected with at least one display screen in the n display screens, n is not less than 2, and n is an integer.

11. The splicing system of claim 10, further comprising:

splicing the switching card and p input boxes, wherein p is more than or equal to 2 and is an integer;

the p input boxes and the m output boxes are respectively connected with the splicing switching card, and each input box in the p input boxes is used for being connected with one video input source.

12. The splicing system of claim 10, wherein m is n, and the m output boxes are connected to the n display screens in a one-to-one correspondence.

13. Splicing system according to any of the claims 9 to 12, wherein said pre-monitoring device comprises at least one of a local pre-monitoring device and a remote pre-monitoring device.

14. An output cartridge, comprising: a processor and a memory, wherein the processor is capable of processing a plurality of data,

the memory is used for storing a computer program;

the processor is configured to execute the program stored in the memory to implement the pre-monitoring method according to claim 1 or 2.

15. A server, characterized in that the server comprises: a processor and a memory, wherein the processor is capable of processing a plurality of data,

the memory is used for storing a computer program;

the processor is configured to execute the program stored in the memory to implement the pre-monitoring method of claim 3 or 4.

16. A computer readable storage medium having stored therein instructions that, when executed at a processor of an output cartridge, cause the output cartridge to perform the pre-monitoring method of claim 1 or 2.

17. A computer-readable storage medium having stored therein instructions that, when executed by a processor of a server, cause the server to perform the pre-monitoring method of claim 3 or 4.