CN114245176A - Transmission detection device and method for multimedia stream - Google Patents
Transmission detection device and method for multimedia stream Download PDFInfo
- Publication number
- CN114245176A CN114245176A CN202111542229.4A CN202111542229A CN114245176A CN 114245176 A CN114245176 A CN 114245176A CN 202111542229 A CN202111542229 A CN 202111542229A CN 114245176 A CN114245176 A CN 114245176A
- Authority
- CN
- China
- Prior art keywords
- stream data
- video stream
- module
- video
- adjusted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Abstract
The invention provides a transmission detection device and a method of multimedia stream, comprising the following steps: the device comprises a video stream data receiving module, a video stream data detecting module, a video stream data adjusting module and a display module; the video stream data receiving module is used for receiving video stream data and sending the video stream data to the video stream data detection module; the video stream data detection module is used for judging whether the video stream data has defects; if the video stream data exists, sending the video stream data to a video stream data adjusting module; if the video stream data does not exist, sending the video stream data to a display module through a video stream data adjusting module; the video stream data adjusting module is used for adjusting the video stream data to obtain adjusted video stream data and sending the adjusted video stream data to the display module; the display module is used for displaying video stream data or adjusted video stream data; the video stream data transmitted by the network can reach the playing end, and the playing effect of the playing end is improved.
Description
Technical Field
The present invention relates to the field of data transmission technologies, and in particular, to a device and a method for detecting transmission of multimedia streams.
Background
The multimedia technology is a technology for storing and managing various information such as language characters, data, audio, video and the like through a computer and enabling a user to communicate information with the computer in real time through various senses. The content presented and carried by multimedia technology is in fact the product of computer technology.
By medium is meant a carrier that carries or transports information or material of some kind. Can be divided into five categories: sensory media, presentation media, storage media, and transmission media. In the field of computers, media are mainly carriers for transmitting and storing information, and transmitted information includes language characters, data, video, audio and the like; carriers for storage include hard disks, floppy disks, magnetic tape, magnetic and optical disks, and the like. The multimedia is to scientifically integrate the functions of various media, and provide various forms of information display for users by combining hands, so that the obtained information is more visual and vivid.
The image file is mainly used for video conference, video and audio playing, remote monitoring and the like. Because the image file has more information content and large occupied space, the situation of defects (such as packet loss, disorder and jitter) is easy to exist in the transmission process, and the playing effect of the playing end is influenced.
Disclosure of Invention
In view of the above, the present invention provides a device and a method for detecting transmission of multimedia stream, which adjust video stream data when there is a defect in the video stream data, ensure that the video stream data transmitted through a network reaches a playing end, and improve the playing effect of the playing end.
In a first aspect, an embodiment of the present invention provides a device for detecting transmission of a multimedia stream, where the device includes: the device comprises a video stream data receiving module, a video stream data detecting module, a video stream data adjusting module and a display module;
the video stream data receiving module, the video stream data detecting module, the video stream data adjusting module and the display module are sequentially connected;
the video stream data receiving module is used for receiving video stream data and sending the video stream data to the video stream data detecting module;
the video stream data detection module is used for judging whether the video stream data has defects or not; if the video stream data exists, sending the video stream data to the video stream data adjusting module; if the video stream data does not exist, the video stream data is sent to the display module through the video stream data adjusting module;
the video stream data adjusting module is used for adjusting the video stream data to obtain adjusted video stream data and sending the adjusted video stream data to the display module;
the display module is used for displaying the video stream data or the adjusted video stream data.
Further, the video stream data adjusting module is configured to, when there is a packet loss in the video stream data, determine a length of the video stream data corresponding to the packet loss and mark the length;
sending feedback information to the video stream data receiving module through the video stream data detecting module, wherein the feedback information comprises video stream data corresponding to the packet loss;
receiving, by the video stream data detection module, video stream data corresponding to the packet loss retransmitted by the video stream data reception module;
and replacing the video stream data corresponding to the retransmitted packet loss at the corresponding position of the video stream data to obtain the adjusted video stream data.
Further, the video stream data adjusting module is configured to determine, when the video stream data has a disorder, video stream data corresponding to the disorder;
and adjusting the video stream data corresponding to the disorder sequence according to a time axis sequence to obtain the adjusted video stream data.
Further, the video stream data adjusting module is configured to, when the video stream data has jitter, obtain a previous frame video image and a current frame video image according to a time axis sequence;
comparing the previous frame video image with the current frame video image to obtain a pixel dot matrix which is lacked by the current frame video image relative to the previous frame video image;
and supplementing the pixel dot matrix to the corresponding position of the current video image to obtain the adjusted video stream data.
Further, the video stream data detection module is configured to detect each frame of video image of the video stream data, and determine whether the video stream data has packet loss, disorder and jitter.
In a second aspect, an embodiment of the present invention provides a multimedia stream transmission detection method, which is applied to the multimedia stream transmission detection apparatus described above, where the multimedia stream transmission detection apparatus includes a video stream data receiving module, a video stream data detection module, a video stream data adjustment module, and a display module; the method comprises the following steps:
the video stream data receiving module receives video stream data and sends the video stream data to the video stream data detecting module;
the video stream data detection module judges whether the video stream data has defects;
if the video stream data exists, sending the video stream data to the video stream data adjusting module;
if the video stream data does not exist, the video stream data is sent to the display module through the video stream data adjusting module;
the video stream data adjusting module adjusts the video stream data to obtain adjusted video stream data and sends the adjusted video stream data to the display module;
the display module displays the video stream data or the adjusted video stream data.
Further, the adjusting module of the video stream data adjusts the video stream data to obtain adjusted video stream data, including:
when the video stream data has packet loss, the video stream data adjusting module determines the length of the video stream data corresponding to the packet loss and marks the length;
sending feedback information to the video stream data receiving module through the video stream data detecting module, wherein the feedback information comprises video stream data corresponding to the packet loss;
receiving, by the video stream data detection module, video stream data corresponding to the packet loss retransmitted by the video stream data reception module;
and replacing the video stream data corresponding to the retransmitted packet loss at the corresponding position of the video stream data to obtain the adjusted video stream data.
Further, the adjusting module of the video stream data adjusts the video stream data to obtain adjusted video stream data, including:
when the video stream data has disorder, the video stream data adjusting module determines the video stream data corresponding to the disorder;
and adjusting the video stream data corresponding to the disorder sequence according to a time axis sequence to obtain the adjusted video stream data.
Further, the adjusting module of the video stream data adjusts the video stream data to obtain adjusted video stream data, including:
when the video stream data has jitter, the video stream data adjusting module acquires a previous frame video image and a current frame video image according to a time axis sequence;
comparing the previous frame video image with the current frame video image to obtain a pixel dot matrix which is lacked by the current frame video image relative to the previous frame video image;
and supplementing the pixel dot matrix to the corresponding position of the current video image to obtain the adjusted video stream data.
The embodiment of the invention provides a device and a method for detecting transmission of multimedia streams, which comprises the following steps: the device comprises a video stream data receiving module, a video stream data detecting module, a video stream data adjusting module and a display module; the video stream data receiving module, the video stream data detecting module, the video stream data adjusting module and the display module are sequentially connected; the video stream data receiving module is used for receiving video stream data and sending the video stream data to the video stream data detection module; the video stream data detection module is used for judging whether the video stream data has defects; if the video stream data exists, sending the video stream data to a video stream data adjusting module; if the video stream data does not exist, sending the video stream data to a display module through a video stream data adjusting module; the video stream data adjusting module is used for adjusting the video stream data to obtain adjusted video stream data and sending the adjusted video stream data to the display module; the display module is used for displaying video stream data or adjusted video stream data; when the video stream data has defects, the video stream data is adjusted to ensure that the video stream data transmitted by the network reaches the playing end, and the playing effect of the playing end is improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic diagram of a multimedia stream transmission detection apparatus according to an embodiment of the present invention;
fig. 2 is a flowchart of a multimedia stream transmission detection method according to a second embodiment of the present invention.
Icon:
1-video stream data receiving module; 2-video stream data detection module; 3-video stream data adjusting module; 4-display module.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
For the understanding of the present embodiment, the following detailed description will be given of the embodiment of the present invention.
The first embodiment is as follows:
fig. 1 is a schematic diagram of a transmission detection apparatus for multimedia stream according to an embodiment of the present invention.
Referring to fig. 1, the apparatus includes: the device comprises a video stream data receiving module 1, a video stream data detecting module 2, a video stream data adjusting module 3 and a display module 4;
the video stream data receiving module 1, the video stream data detecting module 2, the video stream data adjusting module 3 and the display module 4 are connected in sequence;
the video stream data receiving module 1 is used for receiving video stream data and sending the video stream data to the video stream data detecting module 2;
here, the video stream data is supplied from the video stream data receiving module 1 to the video stream data detecting module 2 in the time axis order.
The video stream data detection module 2 is used for judging whether the video stream data has defects; if the video stream data exists, sending the video stream data to a video stream data adjusting module 3; if the video stream data does not exist, sending the video stream data to a display module 4 through a video stream data adjusting module 3;
the video stream data adjusting module 3 is used for adjusting the video stream data to obtain adjusted video stream data and sending the adjusted video stream data to the display module 4;
and the display module 4 is used for displaying the video stream data or the adjusted video stream data.
Here, the display module 4 may be a display or a display terminal.
In this embodiment, the video stream data detection module determines whether the video stream data has a defect; if the video stream data exists, sending the video stream data to a video stream data adjusting module for adjustment to obtain adjusted video stream data; if the video stream data does not exist, sending the video stream data to a display module through a video stream data adjusting module for displaying; the video stream data adjusting module transmits the video stream data with defects and adjusted or the video stream data without defects to the display module, and the display module displays the video stream data or the adjusted video stream data, so that the video stream data transmitted by a network can reach a playing end, and the playing effect of the playing end is improved.
Further, the video stream data adjusting module 3 is configured to determine and mark the length of the video stream data corresponding to a packet loss when the video stream data has the packet loss;
sending feedback information to a video stream data receiving module 1 through a video stream data detection module 2, wherein the feedback information comprises video stream data corresponding to packet loss;
receiving video stream data corresponding to packet loss retransmitted by the video stream data receiving module 1 through the video stream data detecting module 2;
and replacing the video stream data corresponding to the retransmitted lost packet at the corresponding position of the video stream data to obtain the adjusted video stream data.
Here, when the video stream data receiving module 1 receives the feedback information, it re-preferentially sends the video stream data corresponding to the lost packet, and then the video stream data adjusting module 3 correspondingly supplements the video stream data corresponding to the retransmitted lost packet to the video stream data at the lost packet position, and replaces the original video stream data at the corresponding position.
Further, the video stream data adjusting module 3 is configured to determine video stream data corresponding to a disorder when the video stream data has the disorder;
and adjusting the video stream data corresponding to the disorder sequence according to the time axis sequence to obtain the adjusted video stream data.
Further, the video stream data adjusting module 3 is configured to, when the video stream data has jitter, obtain a previous frame video image and a current frame video image according to a time axis sequence;
comparing the previous frame video image with the current frame video image to obtain a pixel dot matrix which is lacked by the current frame video image relative to the previous frame video image;
and supplementing the pixel dot matrix to the corresponding position of the current video image to obtain the adjusted video stream data.
Here, the following description will be given taking video shooting as an example: when the camera moves downwards, the previous frame of video image moves upwards relative to the current frame of video image, and at the moment, compared with the current frame of video image, the previous frame of video image has more pixel lattices on the upper part than the current frame of video image, and the current frame of video image has more pixel lattices on the lower part than the previous frame of video image; at the moment, the pixel lattice of the upper part of the previous frame of video image which is more than that of the current frame of video image is obtained, and the pixel lattice of the upper part of the previous frame of video image is supplemented to the upper part of the current frame of video image, the current frame of video image has a larger visual field at the moment, and the picture is enlarged during playing, so that the dithering amplitude of the video is reduced, and the watching effect is improved.
Further, the video stream data detection module 2 is configured to detect each frame of video image of the video stream data, and determine whether the video stream data has packet loss, disorder and jitter.
Here, the video stream data detection module 2 splits the video stream data into each frame of video image in the process of detecting the video stream data, and then detects each frame of video image, so as to detect whether the video stream data has defects, that is, whether the video stream data has packet loss, disorder and jitter is determined.
The embodiment of the invention provides a transmission detection device of multimedia stream, comprising: the device comprises a video stream data receiving module, a video stream data detecting module, a video stream data adjusting module and a display module; the video stream data receiving module, the video stream data detecting module, the video stream data adjusting module and the display module are sequentially connected; the video stream data receiving module is used for receiving video stream data and sending the video stream data to the video stream data detection module; the video stream data detection module is used for judging whether the video stream data has defects; if the video stream data exists, sending the video stream data to a video stream data adjusting module; if the video stream data does not exist, sending the video stream data to a display module through a video stream data adjusting module; the video stream data adjusting module is used for adjusting the video stream data to obtain adjusted video stream data and sending the adjusted video stream data to the display module; the display module is used for displaying video stream data or adjusted video stream data; when the video stream data has defects, the video stream data is adjusted to ensure that the video stream data transmitted by the network reaches the playing end, and the playing effect of the playing end is improved.
Example two:
fig. 2 is a flowchart of a multimedia stream transmission detection method according to a second embodiment of the present invention.
Referring to fig. 2, the transmission detection apparatus for a multimedia stream as described above includes a video stream data receiving module, a video stream data detecting module, a video stream data adjusting module, and a display module; the method comprises the following steps:
step S101, a video stream data receiving module receives video stream data and sends the video stream data to a video stream data detection module;
step S102, a video stream data detection module judges whether the video stream data has defects; if so, executing step S103; if not, executing step S104;
step S103, sending the video stream data to a video stream data adjusting module;
step S104, sending the video stream data to a display module through a video stream data adjusting module;
step S105, the video stream data adjusting module adjusts the video stream data to obtain adjusted video stream data, and sends the adjusted video stream data to the display module;
step S106, the display module displays the video stream data or the adjusted video stream data.
Further, step S105 includes the steps of:
step S201, when the video stream data has packet loss, the video stream data adjusting module determines the length of the video stream data corresponding to the packet loss and marks the length;
step S202, sending feedback information to a video stream data receiving module through a video stream data detection module, wherein the feedback information comprises video stream data corresponding to packet loss;
step S203, receiving video stream data corresponding to the packet loss retransmitted by the video stream data receiving module through the video stream data detecting module;
and step S204, replacing the video stream data corresponding to the retransmitted packet loss at the corresponding position of the video stream data to obtain the adjusted video stream data.
Further, step S105 includes the steps of:
step S301, when the video stream data has disorder, the video stream data adjusting module determines the video stream data corresponding to the disorder;
step S302, the video stream data corresponding to the disorder sequence is adjusted according to the time shaft sequence, and the adjusted video stream data is obtained.
Further, step S105 includes the steps of:
step S401, when the video stream data has jitter, the video stream data adjusting module acquires a previous frame video image and a current frame video image according to the time axis sequence;
step S402, comparing the previous frame video image with the current frame video image to obtain a pixel dot matrix which is lacked by the current frame video image relative to the previous frame video image;
step S403, supplementing the pixel lattice to the corresponding position of the current video image to obtain the adjusted video stream data.
The embodiment of the invention provides a transmission detection method of multimedia stream, comprising the following steps: the video stream data receiving module receives video stream data and sends the video stream data to the video stream data detection module; the video stream data detection module judges whether the video stream data has defects; if the video stream data exists, sending the video stream data to a video stream data adjusting module; if the video stream data does not exist, sending the video stream data to a display module through a video stream data adjusting module; the video stream data adjusting module adjusts the video stream data to obtain adjusted video stream data and sends the adjusted video stream data to the display module; the display module displays video stream data or adjusted video stream data; when the video stream data has defects, the video stream data is adjusted to ensure that the video stream data transmitted by the network reaches the playing end, and the playing effect of the playing end is improved.
The embodiment of the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and when the processor executes the computer program, the steps of the method for detecting transmission of a multimedia stream provided in the foregoing embodiment are implemented.
The embodiment of the present invention further provides a computer-readable medium having a non-volatile program code executable by a processor, where the computer-readable medium stores a computer program, and the computer program is executed by the processor to perform the steps of the transmission detection method for multimedia stream according to the above-mentioned embodiment.
The computer program product provided in the embodiment of the present invention includes a computer-readable storage medium storing a program code, where instructions included in the program code may be used to execute the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment, which is not described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In addition, in the description of the embodiments of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (10)
1. An apparatus for detecting transmission of a multimedia stream, the apparatus comprising: the device comprises a video stream data receiving module, a video stream data detecting module, a video stream data adjusting module and a display module;
the video stream data receiving module, the video stream data detecting module, the video stream data adjusting module and the display module are sequentially connected;
the video stream data receiving module is used for receiving video stream data and sending the video stream data to the video stream data detecting module;
the video stream data detection module is used for judging whether the video stream data has defects or not; if the video stream data exists, sending the video stream data to the video stream data adjusting module; if the video stream data does not exist, the video stream data is sent to the display module through the video stream data adjusting module;
the video stream data adjusting module is used for adjusting the video stream data to obtain adjusted video stream data and sending the adjusted video stream data to the display module;
the display module is used for displaying the video stream data or the adjusted video stream data.
2. The apparatus according to claim 1, wherein the video stream data adjusting module is configured to determine a length of the video stream data corresponding to the packet loss and mark the length when the video stream data has the packet loss;
sending feedback information to the video stream data receiving module through the video stream data detecting module, wherein the feedback information comprises video stream data corresponding to the packet loss;
receiving, by the video stream data detection module, video stream data corresponding to the packet loss retransmitted by the video stream data reception module;
and replacing the video stream data corresponding to the retransmitted packet loss at the corresponding position of the video stream data to obtain the adjusted video stream data.
3. The apparatus according to claim 1, wherein the video stream data adjustment module is configured to determine, when the video stream data has an out-of-order sequence, video stream data corresponding to the out-of-order sequence;
and adjusting the video stream data corresponding to the disorder sequence according to a time axis sequence to obtain the adjusted video stream data.
4. The apparatus for detecting transmission of multimedia stream according to claim 1, wherein the video stream data adjustment module is configured to obtain a previous frame video image and a current frame video image according to a time axis sequence when there is jitter in the video stream data;
comparing the previous frame video image with the current frame video image to obtain a pixel dot matrix which is lacked by the current frame video image relative to the previous frame video image;
and supplementing the pixel dot matrix to the corresponding position of the current video image to obtain the adjusted video stream data.
5. The apparatus according to claim 1, wherein the video stream data detection module is configured to detect each frame of video image of the video stream data, and determine whether the video stream data has packet loss, disorder and jitter.
6. A multimedia stream transmission detection method, applied to the multimedia stream transmission detection device of any one of claims 1 to 5, wherein the multimedia stream transmission detection device comprises a video stream data receiving module, a video stream data detection module, a video stream data adjustment module and a display module; the method comprises the following steps:
the video stream data receiving module receives video stream data and sends the video stream data to the video stream data detecting module;
the video stream data detection module judges whether the video stream data has defects;
if the video stream data exists, sending the video stream data to the video stream data adjusting module;
if the video stream data does not exist, the video stream data is sent to the display module through the video stream data adjusting module;
the video stream data adjusting module adjusts the video stream data to obtain adjusted video stream data and sends the adjusted video stream data to the display module;
the display module displays the video stream data or the adjusted video stream data.
7. The method as claimed in claim 6, wherein the adjusting module adjusts the video stream data to obtain adjusted video stream data, and the method comprises:
when the video stream data has packet loss, the video stream data adjusting module determines the length of the video stream data corresponding to the packet loss and marks the length;
sending feedback information to the video stream data receiving module through the video stream data detecting module, wherein the feedback information comprises video stream data corresponding to the packet loss;
receiving, by the video stream data detection module, video stream data corresponding to the packet loss retransmitted by the video stream data reception module;
and replacing the video stream data corresponding to the retransmitted packet loss at the corresponding position of the video stream data to obtain the adjusted video stream data.
8. The method as claimed in claim 6, wherein the adjusting module adjusts the video stream data to obtain adjusted video stream data, and the method comprises:
when the video stream data has disorder, the video stream data adjusting module determines the video stream data corresponding to the disorder;
and adjusting the video stream data corresponding to the disorder sequence according to a time axis sequence to obtain the adjusted video stream data.
9. The method as claimed in claim 6, wherein the adjusting module adjusts the video stream data to obtain adjusted video stream data, and the method comprises:
when the video stream data has jitter, the video stream data adjusting module acquires a previous frame video image and a current frame video image according to a time axis sequence;
comparing the previous frame video image with the current frame video image to obtain a pixel dot matrix which is lacked by the current frame video image relative to the previous frame video image;
and supplementing the pixel dot matrix to the corresponding position of the current video image to obtain the adjusted video stream data.
10. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, wherein the processor implements the method of any of the preceding claims 6 to 9 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111542229.4A CN114245176A (en) | 2021-12-16 | 2021-12-16 | Transmission detection device and method for multimedia stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111542229.4A CN114245176A (en) | 2021-12-16 | 2021-12-16 | Transmission detection device and method for multimedia stream |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114245176A true CN114245176A (en) | 2022-03-25 |
Family
ID=80757036
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111542229.4A Pending CN114245176A (en) | 2021-12-16 | 2021-12-16 | Transmission detection device and method for multimedia stream |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114245176A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080107186A1 (en) * | 2006-11-02 | 2008-05-08 | Mikhail Brusnitsyn | Method And Apparatus For Estimating And Compensating For Jitter In Digital Video |
| CN101742122A (en) * | 2009-12-21 | 2010-06-16 | 汉王科技股份有限公司 | Method and system for removing video jitter |
| CN104735473A (en) * | 2015-03-05 | 2015-06-24 | 天脉聚源（北京）科技有限公司 | Video stream playing detection method and device |
| CN110113662A (en) * | 2019-04-18 | 2019-08-09 | 浙江工业大学 | A kind of video monitor client system adapting to multiple network situation |
| CN112104893A (en) * | 2020-11-04 | 2020-12-18 | 武汉中科通达高新技术股份有限公司 | Video stream management method and device for realizing plug-in-free playing of webpage end |
| CN113709525A (en) * | 2021-08-26 | 2021-11-26 | 程艳华 | Multi-element communication method and communication system |
-
2021
- 2021-12-16 CN CN202111542229.4A patent/CN114245176A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080107186A1 (en) * | 2006-11-02 | 2008-05-08 | Mikhail Brusnitsyn | Method And Apparatus For Estimating And Compensating For Jitter In Digital Video |
| CN101742122A (en) * | 2009-12-21 | 2010-06-16 | 汉王科技股份有限公司 | Method and system for removing video jitter |
| CN104735473A (en) * | 2015-03-05 | 2015-06-24 | 天脉聚源（北京）科技有限公司 | Video stream playing detection method and device |
| CN110113662A (en) * | 2019-04-18 | 2019-08-09 | 浙江工业大学 | A kind of video monitor client system adapting to multiple network situation |
| CN112104893A (en) * | 2020-11-04 | 2020-12-18 | 武汉中科通达高新技术股份有限公司 | Video stream management method and device for realizing plug-in-free playing of webpage end |
| CN113709525A (en) * | 2021-08-26 | 2021-11-26 | 程艳华 | Multi-element communication method and communication system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20130080525A1 (en) | Systems and methods for transferring application state between devices based on gestural input | |
| EP2613524A1 (en) | Transmission device, transmission method, reception device, reception method, program, and broadcast system | |
| CN107257510B (en) | Video unified playing method, terminal and computer readable storage medium | |
| AU2022204578B2 (en) | End-of-show content display trigger | |
| EP2460350B1 (en) | Video reproduction apparatus, control method thereof, and computer-readable storage medium storing program | |
| US10917604B2 (en) | Captured image display device, captured image display method, and captured image display program | |
| CN107040825B (en) | Terminal, television, multi-screen interaction system and screen capture parameter setting method | |
| CN111741353A (en) | Method for device cooperative work, terminal device and readable storage medium | |
| EP2634995A1 (en) | Apparatus and method of displaying contents using key frames in a terminal | |
| US9729931B2 (en) | System for managing detection of advertisements in an electronic device, for example in a digital TV decoder | |
| US20090089667A1 (en) | Application Content Format Based on Display Resolution | |
| CN111294651A (en) | Still picture anti-afterimage method and device based on play data stream and storage medium | |
| US20130246510A1 (en) | Remote control system, client device, and server device | |
| CN111050204A (en) | Video clipping method and device, electronic equipment and storage medium | |
| CN107360389B (en) | Video communication method, device and terminal | |
| US20130326601A1 (en) | Communication system | |
| JP2012175606A (en) | Program, mobile terminal, image reception apparatus, image reception system, mobile terminal control method, and image reception apparatus control method | |
| CN114245176A (en) | Transmission detection device and method for multimedia stream | |
| US9728157B2 (en) | Program, display apparatus, television receiver, display method, and display system | |
| CN111866058B (en) | Data processing method and system | |
| CN113453050A (en) | Play mode adjusting method based on rotary screen, intelligent terminal and storage medium | |
| US20090028238A1 (en) | Encoder and Decoder and Methods of Encoding and Decoding Sequence Information | |
| US20070197203A1 (en) | Method for remotely controlling a mobile communication device | |
| CN114640876B (en) | Multimedia service video display method, device, computer equipment and storage medium | |
| CN112468982B (en) | Calling method and calling device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |