CN116112620A - Processing method and system for improving video stream multipath merging stability - Google Patents
Processing method and system for improving video stream multipath merging stability Download PDFInfo
- Publication number
- CN116112620A CN116112620A CN202310071354.4A CN202310071354A CN116112620A CN 116112620 A CN116112620 A CN 116112620A CN 202310071354 A CN202310071354 A CN 202310071354A CN 116112620 A CN116112620 A CN 116112620A
- Authority
- CN
- China
- Prior art keywords
- video
- frame
- confluence
- communication link
- video source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 15
- 238000004891 communication Methods 0.000 claims abstract description 60
- 238000000605 extraction Methods 0.000 claims abstract description 40
- 238000012545 processing Methods 0.000 claims abstract description 18
- 238000000034 method Methods 0.000 claims description 26
- 238000001514 detection method Methods 0.000 claims description 8
- 239000000284 extract Substances 0.000 claims description 3
- 239000007787 solid Substances 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 9
- 238000012544 monitoring process Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2365—Multiplexing of several video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a processing method and a processing system for improving the stability of multiplexing and merging of video streams, which relate to the technical field of video data processing and are configured with a plurality of video sources; executing a confluence main program on a confluence management platform to form confluence display of multiple video sources; performing frame extraction processing on the video communication link every preset time length; and when the frame extraction time interval exceeds a preset frame extraction time threshold, an alarm prompt is sent out to prompt that the video source is unstable. Calling video attribute information of a video communication link corresponding to the video source; creating a blank image according to the video attribute information; inputting a false frame image to the video communication link at preset time intervals; and after the video source is successfully reconnected, canceling the input of the false frame, extracting the data frame from the video source, inputting the data frame into a confluence main program, and carrying out confluence display. The invention can timely and effectively maintain the stability of the data source, thereby ensuring that the terminal user can smoothly watch the converging video effect.
Description
Technical Field
The present invention relates to the field of video data processing technologies, and in particular, to a processing method and system for improving stability of video stream multiplexing.
Background
At present, in the fields of security monitoring, live broadcast, multi-user video call and the like, which relate to real-time video scenes of multiple video streams, the multiple video streams are required to be synthesized into one video so that a user terminal can simultaneously display multiple video pictures.
For example, in the prior art, application number CN201510790455.2 is a method and system for compressing multiple video streams into one video stream, where the document discloses that multiple clients upload related information and video streams to a server respectively; the server receives and caches the video streams uploaded by each client, performs initial layout on the video streams uploaded by the clients according to the related information uploaded by different clients, and compresses multiple paths of video streams uploaded by the clients into one path of video stream according to the initial layout; and sending the compressed one path of video stream to a corresponding client for display.
In the process of compressing multiple paths of video streams into one path of video stream, the video transmission module is used for uploading the video stream to the first video receiving module, and the related information transmission module is used for uploading the related information of the client to the server. The first video receiving module is connected with the video transmission modules of the clients and the related information transmission modules and is used for receiving the video streams and related information uploaded by the clients, wherein the related information comprises basic user information of the clients, screen size and the position of a video window of the clients on a display screen of the clients, and the basic user information comprises the basic information such as IP address, user ID and user name of the clients. And the video streams and the related information sent by each client are respectively subjected to initial layout on all the video streams uploaded by the clients according to the related information sent by different clients.
The scheme is that frames of each path of video are extracted, frames of the multiple paths of video at the same time are combined into a frame, and then the combined frames are encoded into a single path of video stream. The scheme has the defects that the merging stability is insufficient, and when a certain path of video stream network is unstable, and the path of video data cannot be normally uploaded to a merging server, the whole merging task fails. And the confluence interruption is easy to cause, and the user cannot smoothly watch the confluence video effect.
Disclosure of Invention
The processing method for improving the multiplexing stability of the video streams can timely and effectively maintain the stability of the data sources, so that the smooth watching of the confluent video effect of the terminal user is ensured.
The method comprises the following steps: configuring a plurality of cameras as video sources;
each camera is in communication connection with the confluence management platform through a corresponding video communication link;
executing a confluence main program on a confluence management platform to form confluence display of multiple video sources;
performing frame extraction processing on the video communication link every preset time length;
recording the time interval of each frame extraction, and when the frame extraction time interval exceeds a preset frame extraction time threshold, sending out an alarm prompt to prompt that the video source is unstable.
It should be further noted that, when a certain video source is detected to be unstable, video attribute information of a video communication link corresponding to the video source is called;
creating a blank image according to the video attribute information;
and inputting a dummy frame image into the video communication link every preset time interval.
The method is characterized in that the confluence management platform sends out a link instruction with a video source of the current interruption in real time;
and after the reconnection is successful, canceling the input of the dummy frame, extracting the data frame from the video source, inputting the data frame into a confluence main program, and carrying out confluence display.
It should be further noted that the attribute information includes decoding format, length and width of frame image, and video stream frame rate information.
It should be further noted that, after the merging main program is started, the link information of each video source is recorded and stored.
It should be further noted that, the dummy frames are configured according to the parameters related to the video stream generated by the video source.
It should be further noted that the video stream related parameters include a decoding format, a length and a width of a frame image, a video stream frame rate, a yuv encoding format, and a current pts value.
It should be further noted that the step of inputting a dummy frame into the video communication link for a predetermined period of time at each interval further includes:
creating a first false frame image according to the related parameters of the video stream, wherein the first false frame image has the same format as the real data frame, and the content is set to zero;
each dummy frame image created later is to increment the pts value by one normal frame interval time value.
It should be further noted that, a certain path or paths of video communication links are manually disconnected, and a confluence display state is observed;
and displaying a solid background image in the confluence layout area corresponding to the disconnected video communication link.
The invention also provides a processing system for improving the multiplexing stability of the video streams, which comprises: the system comprises a plurality of cameras, a confluence management platform, a video source stability detection module, a false frame creation module and a flow breaking reconnection module;
the camera is used as a video source; each camera is in communication connection with the confluence management platform through a corresponding video communication link;
the converging management platform is configured with a converging main program, and the converging main program performs converging display on video streams sent by a video source; creating a timer for each video communication link;
the video source stability detection module is used for performing frame extraction processing on the video communication link every preset time length based on the timing of the timer; recording the time interval of each frame extraction, and when the time interval of the frame extraction exceeds a preset frame extraction time threshold, sending an alarm prompt to prompt that a video source is unstable;
the false frame creation module is used for calling video attribute information of a video communication link corresponding to a video source after detecting that the video source is unstable; creating a blank image according to the video attribute information; inputting a false frame image to the video communication link at preset time intervals;
the current interruption reconnection module is used for sending a link instruction to a video source which is in real time and is in current interruption, connecting the video source, and after the reconnection is successful, the false frame creation module cancels the input of the false frame, extracts the data frame from the video source and inputs the data frame to the main program of the confluence, and performs confluence display.
From the above technical scheme, the invention has the following advantages:
the invention provides a processing method for improving the multipath merging stability of video streams, which realizes the function of timing frame extraction through a timer, monitors the video, can also record the generation time of each frame in detail, reserves a frame extraction parameter configuration interface, configures a frame extraction overtime time interval, triggers a corresponding program callback after exceeding a specified time interval, creates a false frame, fills the false frame on the video streams, can also timely receive an overtime signal, acquires an overtime state, enables a user to process in time, and ensures smoothness of video communication.
The invention combines pts value and length and width of frame image, video stream frame rate, etc. to create the first false frame image according to the related parameters of video stream, the first false frame image has the same format as the real data frame, and the content is set to zero; each dummy frame image created later is to increment the pts value by one normal frame interval time value. Thus, the continuity of the false frame images is ensured, and the user can smoothly watch the converging video effect.
The invention can also carry out confluence display on the information of the multiple paths of video streams, is convenient for monitoring personnel to review, and effectively improves the monitoring efficiency of the multiple paths of videos. The multi-path video stream information can be efficiently collected, stored and processed, process monitoring is realized based on the states of each video source and video communication link, and the multi-path video stream information is described by using a multi-dimensional space. The video attribute information of a video communication link corresponding to a video source can be called after the instability of the video source is detected; creating a blank image according to the video attribute information; a false frame image is input to the video communication link at preset time intervals, so that the stability of a data source can be maintained timely and effectively, and the main merging program can be continuously merged without interruption, so that the merging video effect can be smoothly watched by a terminal user, and timeliness and scientificity of video interaction overall process supervision, management and control are realized.
Drawings
In order to more clearly illustrate the technical solutions of the present invention, the drawings that are needed in the description will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a processing method for improving the stability of multiplexing and merging video streams;
FIG. 2 is a flowchart of an embodiment of a method for improving stability of video stream multiplexing;
FIG. 3 is a schematic diagram of a processing system for improving the stability of multiple merging of video streams.
Detailed Description
As shown in fig. 1, the processing method for improving the multiplexing and merging stability of video streams provided by the invention utilizes the merging technology of the video streams, and realizes the real-time video stream interactive mapping of a video source and the merging management platform by establishing the merging management platform and utilizing technologies such as a camera, video acquisition equipment, data transmission and the like, so that the video streams are merged and displayed in real time, and the real-time state display of a monitoring area can be effectively carried out.
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, a flowchart of a processing method for improving stability of multiplexing and merging of video streams in an embodiment is shown, where the method includes:
s101, configuring a plurality of cameras as video sources;
the video source is used as video acquisition equipment to acquire video streams, and the related fields can be the security monitoring field, the video live broadcasting field, the multi-user video call, the power equipment monitoring field, the engineering project construction field and the like.
S102, each camera is in communication connection with a confluence management platform through a corresponding video communication link;
the confluence management platform can be used as a server of the system, is configured with a database for storing videos and can simultaneously carry out confluence display.
S103, executing a confluence main program on a confluence management platform to form confluence display of multiple video sources;
s104, performing frame extraction processing on the video communication link every preset time interval;
in order to ensure that the video communication link can smoothly execute video stream communication, corresponding video information is called for monitoring.
S105, recording the time interval of each frame extraction, and when the frame extraction time interval exceeds a preset frame extraction time threshold, sending out an alarm prompt to prompt that the video source is unstable.
Illustratively, the video source stability detection may be to create a timer for each video, record a time interval for each frame extraction, such as about 40 ms for a normal time interval, perform the frame extraction every 40 ms, and if normal, the frame extraction is normal. When the video source is disconnected, the frame extraction will fail, the timer interval will exceed 1 second, of course, 100 ms, 200 ms, etc. can be set, and if the frame extraction fails, the video source can be considered unstable.
When a certain video source is detected to be unstable, the video attribute information of a video communication link corresponding to the video source is called;
creating a blank image according to the video attribute information;
and inputting a dummy frame image into the video communication link every preset time interval.
Therefore, the function of timing frame extraction is realized through the timer, the video is monitored, the generation time of each frame can be recorded in detail, the frame extraction parameter configuration interface is reserved, the time interval of frame extraction overtime is configured, the timer triggers the corresponding program callback after the specified time interval is exceeded, the false frame is created, the false frame is filled on the video stream, the overtime signal can be timely received, the overtime state is known, the user can process in time, and the smoothness of video communication is ensured.
Further, as a refinement and extension of the specific implementation manner of the foregoing embodiment, in order to fully describe the specific implementation process in this embodiment, as shown in fig. 2, in the processing method for improving the stability of multiplexing and merging video streams provided in the present invention, the following steps are further involved:
s201, when a certain video source is detected to be unstable, video attribute information of a video communication link corresponding to the video source is called;
the video attribute information may include information such as decoding format, length and width of frame image, frame rate of video stream, etc.
S202, creating a blank image according to the video attribute information;
s203, inputting a false frame image to the video communication link every preset time length.
Here, a blank image is created based on video attribute information, and a dummy frame is input to the merging main program at regular intervals according to a frame rate.
S204, the confluence management platform sends out a link instruction with a video source of the current interruption in real time;
and S205, after the reconnection is successful, canceling the input of the dummy frame, extracting the data frame from the video source, inputting the data frame into the confluence main program, and carrying out confluence display.
According to the invention, after continuously trying to reconnect the data source, the creation and filling of the false frame are canceled, the data frame is extracted from the real data source and is input into the merging main program, so that the smooth display of the merging video is ensured.
For the dummy frames of the present invention, the dummy frames are configured according to the video stream related parameters generated by the video source. The video stream related parameters comprise a decoding format, the length and the width of a frame image, a video stream frame rate, a yuv coding format and a current pts value.
The invention combines pts value and length and width of frame image, video stream frame rate, etc. to create the first false frame image according to the related parameters of video stream, the first false frame image has the same format as the real data frame, and the content is set to zero; each dummy frame image created later is to increment the pts value by one normal frame interval time value. Thus, the continuity of the false frame images is ensured, and the user can smoothly watch the converging video effect.
In one embodiment of the present invention, a method for improving the stability of video stream multiplexing is described in a non-limiting manner based on one possible embodiment given below.
Configuring a plurality of cameras and recording playing address information of each camera;
the user logs in the converging management platform, creates a converging process, and guides the playing address of the video source and the related information of the converging interface layout.
And starting confluence at the confluence management platform. Executing a confluence main program on a confluence management platform to form confluence display of multiple video sources; broadcasting and watching the converging effect on a converging management platform, and performing frame extraction processing on the video communication link at intervals of a preset time length; the time interval for each frame snapshot is recorded.
When a certain video source is detected to be unstable, video attribute information of a video communication link corresponding to the video source is called;
creating a blank image according to the video attribute information;
and inputting a dummy frame image into the video communication link every preset time interval.
The confluence management platform sends out a link instruction with a video source of the current interruption in real time;
and after the reconnection is successful, canceling the input of the dummy frame, extracting the data frame from the video source, inputting the data frame into a confluence main program, and carrying out confluence display.
According to the embodiment of the invention, a user can also manually disconnect a video communication link corresponding to one or more video sources and continue to watch the merging effect, and if the merging video is smoothly played without interruption, the method indicates that a false frame image is input to the video communication link. And after the reconnection is successful, canceling the input of the dummy frame, extracting the data frame from the video source, inputting the data frame into the confluence main program, and carrying out confluence display.
In another mode, the invention displays a solid background image in the confluence layout area where the video source with the dropped line is positioned so as to prompt the user.
As shown in fig. 3, the following is an embodiment of a processing system for improving the stability of multiple video stream merging provided by the embodiments of the present disclosure, where the system belongs to the same inventive concept as the processing method for improving the stability of multiple video stream merging of the embodiments described above, and details of the processing system for improving the stability of multiple video stream merging are not described in detail in the embodiment of the present disclosure, and reference may be made to the embodiment of the processing method for improving the stability of multiple video stream merging described above.
The system comprises: the system comprises a plurality of cameras, a confluence management platform, a video source stability detection module, a false frame creation module and a flow breaking reconnection module;
the camera is used as a video source; each camera is in communication connection with the confluence management platform through a corresponding video communication link;
the converging management platform is configured with a converging main program, and the converging main program performs converging display on video streams sent by a video source; creating a timer for each video communication link;
the video source stability detection module is used for performing frame extraction processing on the video communication link every preset time length based on the timing of the timer; recording the time interval of each frame extraction, and when the time interval of the frame extraction exceeds a preset frame extraction time threshold, sending an alarm prompt to prompt that a video source is unstable;
the false frame creation module is used for calling video attribute information of a video communication link corresponding to a video source after detecting that the video source is unstable; creating a blank image according to the video attribute information; inputting a false frame image to the video communication link at preset time intervals;
the current interruption reconnection module is used for sending a link instruction to a video source which is in real time and is in current interruption, connecting the video source, and after the reconnection is successful, the false frame creation module cancels the input of the false frame, extracts the data frame from the video source and inputs the data frame to the main program of the confluence, and performs confluence display.
In the embodiment of the invention, based on the improvement of the video stream multiplexing combination stability processing system, the related function of a timer is realized by combining the video source stability detection technology, the generation time of each frame is recorded in detail, a program parameter configuration interface is reserved for configuring the time interval of frame extraction overtime, the timer triggers the corresponding program callback after exceeding the designated time interval, and the false frame creation module can timely receive the overtime signal.
The invention uses false frame creating technology, when the false frame is created, the program obtains the relevant parameters of the video stream, mainly including the information of decoding format, length and width of frame image, video stream frame rate, yuv coding format, current pts, etc., and the program creates the first false frame image according to the above information, the image is the same as the real data frame format, and the content is set to zero. The subsequently created dummy frame images require that the pts value be incremented by one normal frame interval time value at a time.
The embodiment can also record the link information of each video stream based on the cutoff reconnection technology during the starting of the confluence. When the timer issues a timeout signal, the dummy frame creation and the cut-off reconnection are triggered simultaneously. And after the reconnection is successful, the program sends a reconnection success signal to inform the false frame creation module to pause.
Therefore, the invention can carry out confluence display on the information of the multi-path video stream, is convenient for monitoring personnel to review, and effectively improves the monitoring efficiency of the multi-path video. The multi-path video stream information can be efficiently collected, stored and processed, process monitoring is realized based on the states of each video source and video communication link, and the multi-path video stream information is described by using a multi-dimensional space. The video attribute information of a video communication link corresponding to a video source can be called after the instability of the video source is detected; creating a blank image according to the video attribute information; a false frame image is input to the video communication link at preset time intervals, so that the stability of a data source can be maintained timely and effectively, and the main merging program can be continuously merged without interruption, so that the merging video effect can be smoothly watched by a terminal user, and timeliness and scientificity of video interaction overall process supervision, management and control are realized.
The units and algorithm steps of each example described in the embodiments disclosed in the processing system for improving video stream multiplexing and combining stability provided by the invention can be implemented by electronic hardware, computer software or a combination of the two, and in order to clearly illustrate the interchangeability of hardware and software, the components and steps of each example have been generally described in terms of functions in the above description. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
Flow diagrams and block diagrams of methods and systems for improving video stream multiplexing stability illustrate the architecture, functionality, and operation of possible implementations of devices, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. Two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In embodiments of the present invention, computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including but not limited to an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or power server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A processing method for improving the stability of multiplexing and merging of video streams is characterized by comprising the following steps:
configuring a plurality of cameras as video sources;
each camera is in communication connection with the confluence management platform through a corresponding video communication link;
executing a confluence main program on a confluence management platform to form confluence display of multiple video sources;
performing frame extraction processing on the video communication link every preset time length;
recording the time interval of each frame extraction, and when the frame extraction time interval exceeds a preset frame extraction time threshold, sending out an alarm prompt to prompt that the video source is unstable.
2. The method for improving video stream multiplexing combining stability as defined in claim 1, wherein,
when a certain video source is detected to be unstable, video attribute information of a video communication link corresponding to the video source is called;
creating a blank image according to the video attribute information;
and inputting a dummy frame image into the video communication link every preset time interval.
3. The method for improving video stream multiplexing combining stability as defined in claim 2, wherein,
the confluence management platform sends out a link instruction with a video source of the current interruption in real time;
and after the reconnection is successful, canceling the input of the dummy frame, extracting the data frame from the video source, inputting the data frame into a confluence main program, and carrying out confluence display.
4. The method of claim 2, wherein the attribute information includes a decoding format, a length and a width of a frame image, and video stream frame rate information.
5. The processing method for improving the merging stability of video streams according to claim 1 or 2, wherein after the merging main program is started, the link information of each video source is recorded and stored.
6. The method of claim 2, wherein the dummy frames are configured according to parameters related to the video stream generated by the video source.
7. The method of claim 6, wherein the video stream related parameters include a decoding format, a length and a width of a frame image, a video stream frame rate, a yuv encoding format, and a current pts value.
8. The method of claim 6, wherein the step of inputting a dummy frame into the video communication link for a predetermined period of time at each interval further comprises:
creating a first false frame image according to the related parameters of the video stream, wherein the first false frame image has the same format as the real data frame, and the content is set to zero;
each dummy frame image created later is to increment the pts value by one normal frame interval time value.
9. The method for improving the stability of video stream multiplexing combination according to claim 1, wherein in the method, a certain video communication link or a certain video communication links are manually disconnected, and a confluent display state is observed;
and displaying a solid background image in the confluence layout area corresponding to the disconnected video communication link.
10. A processing system for improving the stability of multiple paths of merging of video streams, which is characterized in that the processing method for improving the stability of multiple paths of merging of video streams according to any one of claims 1 to 9 is adopted by the system;
the system comprises: the system comprises a plurality of cameras, a confluence management platform, a video source stability detection module, a false frame creation module and a flow breaking reconnection module;
the camera is used as a video source; each camera is in communication connection with the confluence management platform through a corresponding video communication link;
the converging management platform is configured with a converging main program, and the converging main program performs converging display on video streams sent by a video source; creating a timer for each video communication link;
the video source stability detection module is used for performing frame extraction processing on the video communication link every preset time length based on the timing of the timer; recording the time interval of each frame extraction, and when the time interval of the frame extraction exceeds a preset frame extraction time threshold, sending an alarm prompt to prompt that a video source is unstable;
the false frame creation module is used for calling video attribute information of a video communication link corresponding to a video source after detecting that the video source is unstable; creating a blank image according to the video attribute information; inputting a false frame image to the video communication link at preset time intervals;
the current interruption reconnection module is used for sending a link instruction to a video source which is in real time and is in current interruption, connecting the video source, and after the reconnection is successful, the false frame creation module cancels the input of the false frame, extracts the data frame from the video source and inputs the data frame to the main program of the confluence, and performs confluence display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310071354.4A CN116112620A (en) | 2023-01-17 | 2023-01-17 | Processing method and system for improving video stream multipath merging stability |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310071354.4A CN116112620A (en) | 2023-01-17 | 2023-01-17 | Processing method and system for improving video stream multipath merging stability |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116112620A true CN116112620A (en) | 2023-05-12 |
Family
ID=86261238
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310071354.4A Pending CN116112620A (en) | 2023-01-17 | 2023-01-17 | Processing method and system for improving video stream multipath merging stability |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116112620A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116931864A (en) * | 2023-09-18 | 2023-10-24 | 广东保伦电子股份有限公司 | Screen sharing method and intelligent interaction panel |
-
2023
- 2023-01-17 CN CN202310071354.4A patent/CN116112620A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116931864A (en) * | 2023-09-18 | 2023-10-24 | 广东保伦电子股份有限公司 | Screen sharing method and intelligent interaction panel |
| CN116931864B (en) * | 2023-09-18 | 2024-02-09 | 广东保伦电子股份有限公司 | Screen sharing method and intelligent interaction panel |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101536014B (en) | Embedded appliance for multimedia capture | |
| CA2951065A1 (en) | Synchronizing playback of segmented video content across multiple video playback devices | |
| CN109155840B (en) | Moving image dividing device and monitoring method | |
| CN104918137A (en) | Method enabling spliced screen system to play videos | |
| CN104427352A (en) | Method and system for recording and playing television video by mobile terminals to realize user interaction and sharing | |
| CN107197320B (en) | Video live broadcast method, device and system | |
| CN102148958A (en) | Method and system for embedding additional monitoring information in analog video data | |
| CN110300322B (en) | Screen recording method, client and terminal equipment | |
| CN109428864B (en) | Method and device for improving quality of nginx-rtmp pull flow service | |
| CN106227492A (en) | Combination and mobile intelligent terminal interconnected method and device | |
| CN109714622A (en) | A kind of video data handling procedure, device and electronic equipment | |
| CN116112620A (en) | Processing method and system for improving video stream multipath merging stability | |
| CN108419046B (en) | Monitoring method and device for multi-channel video | |
| CN106412617B (en) | Remote debugging control method and device | |
| CN112954433B (en) | Video processing method, device, electronic equipment and storage medium | |
| CN105898293A (en) | Locating method and device for video display abnormity | |
| CN111835988B (en) | Subtitle generation method, server, terminal equipment and system | |
| CN111277800A (en) | Monitoring video coding and playing method and device, electronic equipment and storage medium | |
| CN107566883B (en) | A method of utilizing recorded broadcast equipment recorded broadcast TV programme | |
| CN107734278B (en) | Video playback method and related device | |
| CN101754045B (en) | Method for distinguishing stay-dead picture in monitoring system, monitoring system and device | |
| US11812118B2 (en) | Client forensic watermarking device, system, and method | |
| CN112565799B (en) | Video data processing method and device | |
| CN110300290B (en) | Teaching monitoring management method, device and system | |
| CN114422866A (en) | Video processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |