CN115842811A

CN115842811A - Media stream processing method, device and equipment

Info

Publication number: CN115842811A
Application number: CN202111079436.0A
Authority: CN
Inventors: 陈书炫; 王静; 白一凡
Original assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Current assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Priority date: 2021-09-15
Filing date: 2021-09-15
Publication date: 2023-03-24

Abstract

The invention provides a media stream processing method, a device and equipment. The method comprises the following steps: acquiring a target playing identifier corresponding to a target video playing behavior; acquiring at least one network data packet, wherein the network data packet comprises media stream protocol information, and a header message of the media stream protocol information comprises a playing identifier; and determining a media stream corresponding to the target playing identifier according to a first network data packet in the at least one network data packet, wherein the playing identifier in the header message corresponding to the first network data packet is the same as the target playing identifier. According to the method provided by the embodiment of the invention, in the multi-channel video playing process, the network data can be associated with various player events in the multi-channel video playing process through the target playing identifier, so that the media stream can be rapidly identified.

Description

Media stream processing method, device and equipment

Technical Field

The present invention relates to the field of video monitoring technologies, and in particular, to a method, an apparatus, and a device for processing a media stream.

Background

The existing multi-channel video quality monitoring schemes mainly comprise two types: one is to capture the packet through the network port of the set-top box, identify the media stream in the message, perform complex video data association, and finally infer the user perception and find the user fault through a certain algorithm model; the other method is that the network port packet capturing of the set-top box is combined with the key events reported by the bottom player, and the media data of the network part of the related program can be associated according to the broadcast program address of the program reported by the player and the network packet capturing data, so as to obtain the user perception data and the network data of the respective video program. Both schemes essentially require data association to the network message according to the multimedia protocol, and are difficult to rapidly distinguish the media streams.

Disclosure of Invention

The invention aims to provide a media stream processing method, a device and equipment, which are used for solving the problem of how to rapidly distinguish media streams in a multi-channel video.

To achieve the above object, an embodiment of the present invention provides a media stream processing method, including:

acquiring a target playing identifier corresponding to a target video playing behavior;

acquiring at least one network data packet, wherein the network data packet comprises media stream protocol information, and a header message of the media stream protocol information comprises a playing identifier;

and determining a media stream corresponding to the target playing identifier according to a first network data packet in the at least one network data packet, wherein the playing identifier in the header message corresponding to the first network data packet is the same as the target playing identifier.

Optionally, after determining the media stream corresponding to the target play identifier, the method further includes:

generating a playing data set corresponding to the target playing identifier according to the playing information of the player and the media stream corresponding to the target playing identifier;

wherein the play data set comprises one or more of:

a target playing identifier;

a display area of at least one video window;

the identification of a first media stream, wherein the display area of a video window corresponding to the first media stream is a first display area;

the identification of a second media stream, wherein the display area of a video window corresponding to the second media stream is a second display area, and the first display area is larger than the second display area;

a player event;

and network data corresponding to various media stream protocol information.

Optionally, generating a play data set corresponding to the target play identifier includes:

under the condition that the network data packet is a network data packet corresponding to a Transmission Control Protocol (TCP), the network data comprises one or more of TCP connection time length, TCP retransmission rate, TCP out-of-order rate, hypertext transfer protocol (HTTP) response codes, real-time streaming protocol (RTSP) response codes, HTTP request response time length, RTSP request response time length, downloading speed and HTTP downloading time length;

or, in the case that the network data packet is a network data packet corresponding to a user datagram protocol UDP, the network data includes one or more of a domain name system DNS request delay, a DNS request error code, a real-time transport protocol RTP jitter, an RTP delay, an RTP packet loss rate, an RTP disorder rate, and a maximum number of RTP consecutive packets lost;

or, in the case that the network data packet is a network data packet of an internet group management protocol IGMP, the network data includes a multicast address.

Optionally, the method according to the embodiment of the present invention further includes:

under the condition that a video display window switching event is detected, updating the display area of at least one video window in the playing data set;

and updating the identifier of the media stream corresponding to the target video window, wherein the target video window is a video window with an updated display area.

Optionally, the updating the display area of at least one video window in the play data set includes:

and under the condition that the target playing identifier corresponding to the video display window switching event is positioned in the current playing identifier list, updating the maximum video window display area and the minimum video window display area according to the playing data set corresponding to the target playing identifier.

reporting a target index according to the playing data set under the condition of meeting a preset playing condition;

wherein the target indicator comprises one or more of:

a user experience index;

a service class index;

a network class index;

and the terminal basic information index.

and sending alarm data under the condition that the media stream corresponding to the target playing identifier does not meet the preset playing quality, wherein the alarm data comprises the target playing identifier and preset indexes of each message stream in a preset time period.

The embodiment of the invention also provides a media stream processing method, which comprises the following steps:

generating a target playing identifier corresponding to a target video playing behavior based on a preset generation rule, and sending the target playing identifier to a probe of the set top box;

and inserting the target playing identifier into a header message of the media stream protocol information corresponding to the target video playing behavior.

Optionally, the preset generation rule includes at least one of:

playing identifiers corresponding to different video playing behaviors are different;

playing identifiers corresponding to various player events occurring in the same video playing behavior are the same.

An embodiment of the present invention further provides a media stream processing apparatus, including:

the first acquisition module is used for acquiring a target playing identifier corresponding to a target video playing behavior;

a second obtaining module, configured to obtain at least one network data packet, where the network data packet includes media stream protocol information, and a header message of the media stream protocol information includes a play identifier;

a first determining module, configured to determine, according to a first network data packet in the at least one network data packet, a media stream corresponding to the target play identifier, where a play identifier in a header message corresponding to the first network data packet is the same as the target play identifier.

Optionally, the apparatus in the embodiment of the present invention further includes:

a first generating module, configured to, after the first determining module determines the media stream corresponding to the target play identifier, generate a play data set corresponding to the target play identifier according to play information of a player and the media stream corresponding to the target play identifier;

wherein the play data set comprises one or more of:

a target playing identifier;

a display area of at least one video window;

a player event;

and network data corresponding to the various media stream protocol information.

Optionally, the first generating module is configured to:

the first updating module is used for updating the display area of at least one video window in the playing data set under the condition that a video display window switching event is detected;

and the second updating module is used for updating the identification of the media stream corresponding to the target video window, wherein the target video window is a video window with an updated display area.

Optionally, the first updating module is configured to:

the first reporting module is used for reporting a target index according to the playing data set under the condition that a preset playing condition is met;

wherein the target indicator comprises one or more of:

a user experience index;

a service class index;

a network class index;

and the terminal basic information index.

and the second reporting module is configured to send alarm data when the media stream corresponding to the target playing identifier does not meet a preset playing quality, where the alarm data includes the target playing identifier and preset indexes of each packet stream in a preset time period.

the second generation module is used for generating a target playing identifier corresponding to a target video playing behavior based on a preset generation rule and sending the target playing identifier to a probe of the set top box;

and the first processing module is used for inserting the target playing identifier into a header message of the media stream protocol information corresponding to the target video playing behavior.

Optionally, the preset generation rule includes at least one of:

An embodiment of the present invention further provides a media stream processing device, including: a transceiver and a processor;

the transceiver is used for acquiring a target playing identifier corresponding to a target video playing behavior; acquiring at least one network data packet, wherein the network data packet comprises media stream protocol information, and a header message of the media stream protocol information comprises a playing identifier;

the processor is configured to determine, according to a first network data packet in the at least one network data packet, a media stream corresponding to the target play identifier, where a play identifier in a header message corresponding to the first network data packet is the same as the target play identifier.

the processor is used for generating a target playing identifier corresponding to a target video playing behavior based on a preset generation rule and sending the target playing identifier to a probe of the set top box through the transceiver; and inserting the target playing identifier into a header message of the media stream protocol information corresponding to the target video playing behavior.

An embodiment of the present invention further provides a media stream processing device, including: a transceiver, a processor, a memory, and a program or instructions stored on the memory and executable on the processor; wherein the processor implements the steps of the media stream processing method as described above when executing the program or instructions.

Embodiments of the present invention also provide a readable storage medium, on which a program or instructions are stored, and when the program or instructions are executed by a processor, the program or instructions implement the steps in the media stream processing method as described above.

The technical scheme of the invention has the following beneficial effects:

in the embodiment of the invention, the probe of the set top box acquires the target playing identifier corresponding to the target video playing behavior, and the header message of the media stream protocol information comprises the playing identifier, so that in the multi-channel video playing process, the network data can be associated with various player events in the multi-channel video playing process through the target playing identifier, and the media stream can be rapidly identified.

Drawings

Fig. 1 is a flowchart illustrating a media stream processing method according to an embodiment of the invention;

FIG. 2 is a second flowchart illustrating a media stream processing method according to a second embodiment of the invention;

FIG. 3 is a block diagram of a probe according to an embodiment of the present invention;

FIG. 4 is an interaction diagram of a media stream processing method according to an embodiment of the present invention;

FIG. 5 is a block diagram of a media stream processing apparatus according to an embodiment of the present invention;

fig. 6 is a second schematic block diagram of a media stream processing apparatus according to a second embodiment of the invention;

fig. 7 is one of the structural block diagrams of the media stream processing apparatus according to the embodiment of the present invention;

fig. 8 is a second block diagram of a media stream processing apparatus according to an embodiment of the invention.

Detailed Description

In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

In various embodiments of the present invention, it should be understood that the sequence numbers of the following processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.

In addition, the terms "system" and "network" are often used interchangeably herein.

In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a from which B can be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may be determined from a and/or other information.

As shown in fig. 1, an embodiment of the present invention provides a media stream processing method, which is executed by a probe of a set top box, and the method includes:

step 101: and acquiring a target playing identifier corresponding to the target video playing behavior.

Specifically, the target playing identifier sent by the bottom server is obtained. After a user clicks a video to start playing, a license plate side application program package (APK) completes playing authentication of the playing behavior, a real playing address is provided for a player at the bottom layer, and the player generates a unique playing identifier. And sending fields such as a playing address, a playing identifier and the like of the video to the probe APK through a starting preparation playing event (a player event started by each video playing interface), and recording the playing identifier after the probe APK receives the playing identifier and adding the playing identifier to a playing identifier list of the program being played by the current terminal.

The generation rule of the playing identifier is as follows:

the playing ID identification of each video watching behavior is different in a certain starting process, and even if the same video is watched for multiple times, the playing ID identification is also different.

The player event play ID identifications of the various types that occur during the same video viewing activity are the same.

Step 102: the method comprises the steps of obtaining at least one network data packet, wherein the network data packet comprises media stream protocol information, and a head message of the media stream protocol information comprises a playing identifier.

In the embodiment of the present invention, the underlying server sends fields such as a playing address and a playing identifier of a video to the probe APK, and initiates a corresponding network request to the playing address to obtain a Media stream corresponding to the video, and adds a customized Media Player ID in a header message of Media stream protocol information (which may be a Media stream protocol request) related to the currently played video, where the specific format is: "mediaplayer id: and the ID value is a target playing identifier corresponding to the current target video playing behavior. For example, the ID value is added to a header message of a Hypertext Transfer Protocol (HTTP) request and a Real Time Streaming Protocol (RTSP) request.

Step 103: and determining a media stream corresponding to the target playing identifier according to a first network data packet in the at least one network data packet, wherein the playing identifier in the header message corresponding to the first network data packet is the same as the target playing identifier.

The header message corresponding to the first network data packet refers to a header message in media stream protocol information included in the first network data packet.

Here, in the multi-channel video playing process, the network data can be associated with various player events in the multi-channel video playing process through the target playing identifier, so that the media stream can be quickly identified.

generating a play data set corresponding to the target play identifier according to the play information of the player and the media stream corresponding to the target play identifier;

wherein the play data set comprises one or more of:

a target playing identifier;

a display area of at least one video window;

player events, such as a start ready to play event, a start SEEK event, a SEEK end event, a pause event, a resume play event, a start buffer event, a buffer end event, a playable duration (or byte count) event currently cached by the player, a bitrate switch event, a start screenplay event, a screenplay end event, a play error event, a start underload event, an underload end event, a play window size change event, and a play end event;

and network data corresponding to the various media stream protocol information, wherein the network data comprises DNS data, TCP data, HTTP data, RTSP data, RTP data and the like.

In the embodiment of the invention, a bottom player finishes downloading required media stream data when starting playing, decodes a first I frame, plays a first frame of a video and sends a playing start event to a multi-channel video data processing module of a probe APK, and a field sent in the event comprises the display size (width x height) of a video window. And the multi-channel video data processing module of the probe APK inquires whether the current playing ID value list is in the current playing ID value list or not according to the playing ID value, and if so, the size of the video content display video window is updated to the corresponding playing data set. And traversing the display size of the video window corresponding to the data set in the play ID value list, and finding out the maximum value (width multiplied by height), namely the play ID program is a large-screen program, and the other programs are small-screen programs.

In the embodiment of the invention, a network message capturing and analyzing module of a probe APK captures each network data packet passing through a network port in real time through a network data packet capturing function library LIBPCAP, and performs different processing on network data packets of different protocols, specifically:

for the TCP protocol: recognizing each TCP session and the HTTP or RTSP protocol session in the TCP session, analyzing a field MediaPlayerID in a Header of the HTTP or RTSP request, and acquiring a corresponding ID value, namely the TCP session is a network request with a corresponding ID value. The acquisition field includes: network indexes such as TCP connection duration, TCP retransmission rate, TCP out-of-order rate, HTTP/RTSP response code, HTTP/RTSP request response duration, download speed, HTTP download duration and the like and play ID identification;

for the UDP protocol: the media stream needing to identify the RTP belongs to the program, for multicast, the association can be identified through the multicast address, for unicast, the RTSP protocol is mainly used to control the streaming media server and negotiate that the media stream is UDP/RTP for transmission, the RTSP can be used to determine the corresponding RTP stream information in the SETUP phase, and the play ID corresponding to the RTSP is associated to the corresponding RTP stream. The acquisition field includes: network indexes such as DNS request time delay, DNS request error codes, RTP jitter, RTP time delay, RTP packet loss rate, RTP disorder rate, RTP maximum continuous packet loss number and the like;

for the IGMP protocol: the method is mainly used for the live broadcast service in the IPTV province, related programs can be directly carried out through the multicast broadcast address, and the acquisition fields comprise: multicast addresses, etc.

when the user switches the large screen and the small screen, the player at the bottom layer reports the video window switching event. And updating the display area of at least one video window in the playing data set corresponding to the target playing identifier by the multi-channel video data processing module of the probe APK, for example, the display area comprises two video windows, a large-screen video display window and a small-screen video display window, and under the condition that a video display window switching event is detected, updating the display areas of the large-screen video display window and the small-screen video display window respectively.

Specifically, the display area of the video window in the play data set is traversed, the maximum value is found out, the maximum value is updated to the maximum display area of the video window, and the display areas of the other video windows except the maximum value are updated to the minimum display area of the video window.

Optionally, after updating the display area of at least one video window in the play data set, the method further includes:

Here, after the user performs the large and small screen switching, the probe APK newly recognizes the large and small screen program.

Optionally, the method in the embodiment of the present invention further includes:

wherein the target indicator comprises one or more of:

the user experience index comprises at least one of first loading time length, playing time length, blocking times and blocking time length;

the service class index comprises a playing address and/or a code rate;

network type indexes including HTTP request times, TCP retransmission and out-of-order rate;

and the terminal basic information index comprises at least one of a terminal SN, a network connection mode and a network negotiation rate.

In addition, under the condition that a playing end event is detected, relevant information in the playing identification value list is deleted according to the playing identification of the playing end event, and the playing data set corresponding to the playing identification is deleted.

For example, when a user has a jam, underload and screen splash alarm while watching a program, the multi-channel video message control module of the probe APK triggers alarm data reporting, sends an alarm strategy including a playing identifier to the network message capture and analysis module through the multi-channel video data processing module to perform targeted network data sampling reporting, and can collect the total download speed, TCP retransmission rate, TCP disorder rate, RTP jitter, RTP delay, RTP packet loss rate, RTP maximum continuous packet loss number, etc. of each message stream in a certain natural time period (for example, every 5 s).

The method of the embodiment of the invention can make the platform know various data indexes of the current program which is not subjected to fault alarm in the alarm period, and also know various data indexes of the whole terminal and other programs in the alarm period by reporting the alarm data, and judge whether the multi-channel video influences the current fault by combining the terminal network negotiation rate.

As shown in fig. 2, an embodiment of the present invention further provides a media stream processing method, which is executed by an underlying player, and the method includes:

step 201: and generating a target playing identifier corresponding to the target video playing behavior based on a preset generation rule, and sending the target playing identifier to a probe of the set top box.

The preset generation rule may include at least one of:

After a user clicks a video to start playing, a license plate side application program package (APK) completes playing authentication of the playing behavior, a real playing address is provided for a player at the bottom layer, and the player generates a unique playing identifier. And sending fields such as a playing address, a playing identifier and the like of the video to the probe APK through a starting preparation playing event (a player event started by each video playing interface), and recording the playing identifier after the probe APK receives the playing identifier and adding the playing identifier to a playing identifier list of the program being played by the current terminal.

Step 202: and inserting the target playing identifier into a header message of the media stream protocol information corresponding to the target video playing behavior.

The bottom layer server sends fields such as a playing address, a playing identifier and the like of the video to a probe of the set top box, initiates a corresponding network request to the playing address to acquire a Media stream corresponding to the video, adds a customized header message Media Player ID to a header message of Media stream protocol information (which can be requested by a Media stream protocol) related to the currently played video, and the specific format is as follows: "mediaplayer id: and the ID value is a target playing identifier corresponding to the current target video playing behavior. For example, the ID value is added to a header message of a Hypertext Transfer Protocol (HTTP) request and a Real Time Streaming Protocol (RTSP) request.

The media stream processing method of the embodiment of the invention generates the target playing identification corresponding to the target video playing behavior based on the preset generation rule, sends the target playing identification to the probe of the set top box, and inserts the target playing identification into the head message of the media stream protocol information corresponding to the target video playing behavior, so that the probe of the set top box can associate the network data with various player events in the multi-channel video playing process based on the target playing identification, and further can rapidly realize the identification of the media stream.

The probe of the embodiment of the invention can comprise a network message capturing and analyzing module, a multi-channel video processing module, a data storage module, a data reporting module and a multi-channel video message control module, and the structural schematic diagram can be specifically shown in fig. 3. The media stream processing method of the present invention is described below with reference to specific embodiments.

As shown in fig. 4, the media stream processing method of the present invention includes:

step 401: the user initiates the multi-channel video playing.

Step 402: and after playing authentication is carried out on the APK on the license plate side, sending start playing information to the bottom player.

Step 403: the underlying player generates a play identification ID.

Step 404: the player at the bottom layer sends the playing address and the playing ID field of the program to the probe APK through the event of starting to prepare for playing.

And the multi-channel video data processing module of the probe APK records the playing ID and adds the playing ID to a playing ID value list of a program being played by the current terminal.

Step 405: and the probe APK generates a play data set corresponding to the play identifier.

Step 406: and the user starts the video to start rendering and playing.

Step 407: the underlying player sends a start play event to the probe.

Step 408: and the player at the bottom layer decodes and renders the downloaded media stream.

Step 409: the probe performs multi-channel video data acquisition and processing.

Step 410: the player sends a player event to the probe APK.

Step 411: and the probe reports the multi-channel video programs.

Step 412: under the conditions of insufficient network fluctuation media data, static video picture or unsmooth user perception, the probe carries out acquisition and reporting of multi-channel video alarm data.

Step 413: and when the user quits the multi-channel video playing, the probe reports the quit of the program.

According to the media stream processing method provided by the embodiment of the invention, in the multi-channel video playing process, the network data can be associated with various player events in the multi-channel video playing process through the target playing identifier, so that the media stream can be rapidly identified.

As shown in fig. 5, an embodiment of the present invention further provides a media stream processing apparatus 500, including:

a first obtaining module 501, configured to obtain a target playing identifier corresponding to a target video playing behavior;

a second obtaining module 502, configured to obtain at least one network data packet, where the network data packet includes media stream protocol information, and a header message of the media stream protocol information includes a play identifier;

a first determining module 503, configured to determine, according to a first network data packet in the at least one network data packet, a media stream corresponding to the target play identifier, where a play identifier in a header message corresponding to the first network data packet is the same as the target play identifier.

Optionally, the apparatus further comprises:

wherein the play data set comprises one or more of:

a target playing identifier;

a display area of at least one video window;

a player event;

and network data corresponding to various media stream protocol information.

Optionally, the first generating module is configured to:

Optionally, the apparatus further comprises:

and the second updating module is used for updating the identifier of the media stream corresponding to the target video window after the first updating module updates the display area of at least one video window in the playing data set, wherein the target video window is a video window with the updated display area.

Optionally, the first updating module is configured to:

Optionally, the apparatus further comprises:

wherein the target indicator comprises one or more of:

a user experience index;

a service class index;

a network type index;

and the terminal basic information index.

Optionally, the apparatus further comprises:

The media stream processing apparatus can implement all implementation manners in the above media stream processing method embodiment, and details are not described here to avoid repetition.

As shown in fig. 6, an embodiment of the present invention provides a media stream processing apparatus 600, including:

the second generating module 601 is configured to generate a target playing identifier corresponding to a target video playing behavior based on a preset generating rule, and send the target playing identifier to a probe of the set top box;

a first processing module 602, configured to insert the target playing identifier into a header message of media stream protocol information corresponding to the target video playing behavior.

Optionally, the preset generation rule includes at least one of:

As shown in fig. 7, an embodiment of the present invention further provides a media stream processing apparatus 700, including: a transceiver 720 and a processor 710;

the transceiver 720 is configured to obtain a target playing identifier corresponding to a target video playing behavior; acquiring at least one network data packet, wherein the network data packet comprises media stream protocol information, and a header message of the media stream protocol information comprises a playing identifier;

the processor 710 is configured to determine, according to a first network data packet in the at least one network data packet, a media stream corresponding to the target play identifier, where a play identifier in a header message corresponding to the first network data packet is the same as the target play identifier.

Optionally, after the processor 710 determines the media stream corresponding to the target playing identifier, the processor is further configured to:

wherein the play data set comprises one or more of:

a target playing identifier;

a display area of at least one video window;

a player event;

and network data corresponding to various media stream protocol information.

Optionally, the processor 710 executes a step of generating a play data set corresponding to the target play identifier, including:

under the condition that the network data packet is a network data packet corresponding to a Transmission Control Protocol (TCP), the network data comprises one or more of TCP connection time length, TCP retransmission rate, TCP disorder rate, hypertext transfer protocol (HTTP) response codes, real-time streaming protocol (RTSP) response codes, HTTP request response time length, RTSP request response time length, download speed and HTTP download time length;

Optionally, the processor 710 is further configured to:

optionally, after the processor 710 updates the display area of at least one video window in the play data set, the processor is further configured to:

Optionally, the processor 710 performs the step of updating the display area of at least one video window in the play data set, including:

Optionally, the processor 710 is further configured to:

wherein the target indicator comprises one or more of:

a user experience index;

a service class index;

a network type index;

and the terminal basic information index.

Optionally, the processor 710 is further configured to:

The media stream processing device can implement all implementation manners in the above media stream processing method embodiment, and details are not described here to avoid repetition.

An embodiment of the present invention further provides a media stream processing device, a schematic structural diagram of which can refer to fig. 7, including: a transceiver and a processor;

Optionally, the preset generation rule includes at least one of:

An embodiment of the present invention provides a media stream processing apparatus, as shown in fig. 8, including a transceiver 810, a processor 800, a memory 820, and a program or instructions stored in the memory 820 and executable on the processor 800; the processor 800 implements the steps in the media stream processing apparatus described above when executing the programs or instructions.

The transceiver 810 is used for receiving and transmitting data under the control of the processor 800.

Where in fig. 8, the bus architecture may include any number of interconnected buses and bridges, with various circuits being linked together, particularly one or more processors represented by processor 800 and memory represented by memory 820. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface. The transceiver 810 may be a number of elements including a transmitter and a receiver that provide a means for communicating with various other apparatus over a transmission medium. The processor 800 is responsible for managing the bus architecture and general processing, and the memory 820 may store data used by the processor 800 in performing operations.

The embodiment of the present invention further provides a readable storage medium, on which a program or an instruction is stored, where the program or the instruction is executed by a processor to implement the steps in the media stream processing method described above, and the same technical effect can be achieved, and details are not repeated here to avoid repetition.

The processor is a processor in the media stream processing apparatus described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It is further noted that the terminals described in this specification include, but are not limited to, smart phones, tablets, etc., and that many of the functional components described are referred to as modules in order to more particularly emphasize their implementation independence.

In embodiments of the present invention, modules may be implemented in software for execution by various types of processors. An identified module of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be constructed as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may comprise disparate instructions stored in different bits which, when joined logically together, comprise the module and achieve the stated purpose for the module.

Indeed, a module of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Likewise, operational data may be identified within the modules and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.

When a module can be implemented by software, considering the level of hardware technology, a module implemented in software may build a corresponding hardware circuit to implement corresponding functions, without considering the cost, and the hardware circuit may include a conventional Very Large Scale Integration (VLSI) circuit or a gate array and an existing semiconductor such as a logic chip, a transistor, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like.

The exemplary embodiments described above are described with reference to the drawings, and many different forms and embodiments of the invention may be made without departing from the spirit and teaching of the invention, therefore, the invention is not to be construed as limited to the exemplary embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. In the drawings, the size and relative sizes of elements may be exaggerated for clarity. The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Unless otherwise indicated, a range of values, when stated, includes the upper and lower limits of the range, and any subranges therebetween.

While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A method for processing a media stream, comprising:

and determining a media stream corresponding to the target playing identifier according to a first network data packet in the at least one network data packet, wherein the playing identifier in a header message corresponding to the first network data packet is the same as the target playing identifier.

2. The method of claim 1, wherein after determining the media stream corresponding to the target playback identifier, further comprising:

wherein the play data set comprises one or more of:

a target playing identifier;

a display area of at least one video window;

a player event;

and network data corresponding to various media stream protocol information.

3. The method of claim 2, wherein generating the play data set corresponding to the target play identifier comprises:

4. The method of claim 2, further comprising:

5. The method of claim 4, wherein the updating the display area of at least one video window in the playback data set comprises:

6. A method for processing a media stream, comprising:

and inserting the target playing identification into a header message of media stream protocol information corresponding to the target video playing behavior.

7. The method of claim 6, wherein the preset generation rule comprises at least one of:

8. A media stream processing apparatus, comprising:

9. A media stream processing apparatus, comprising:

10. A media stream processing apparatus, comprising: a transceiver and a processor;

11. A media stream processing apparatus, comprising: a transceiver and a processor;

12. A media stream processing device, comprising: a transceiver, a processor, a memory, and a program or instructions stored on the memory and executable on the processor; characterized in that the processor implements the steps of the media stream processing method according to any one of claims 1 to 5 or implements the steps of the media stream processing method according to claim 6 when executing the program or the instructions.

13. A readable storage medium having a program or instructions stored thereon, wherein the program or instructions, when executed by a processor, implement the steps in the media stream processing method according to any one of claims 1 to 5, or implement the steps in the media stream processing method according to claim 6.