CN101179353A - Method and system of monitoring multimedia service performance - Google Patents
Method and system of monitoring multimedia service performance Download PDFInfo
- Publication number
- CN101179353A CN101179353A CNA2006101382206A CN200610138220A CN101179353A CN 101179353 A CN101179353 A CN 101179353A CN A2006101382206 A CNA2006101382206 A CN A2006101382206A CN 200610138220 A CN200610138220 A CN 200610138220A CN 101179353 A CN101179353 A CN 101179353A
- Authority
- CN
- China
- Prior art keywords
- multimedia
- data
- identification number
- reference point
- medium data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Abstract
A multimedia service performance monitoring method is provided. A reference point and a sampling point are set in the system. The reference point is set in a network transmission node A; the sampling point is located in the network transmission node A or any afterward network node that needs service monitoring. The network transmission node A copies the received multimedia data and then sends the data to the reference point. The reference point decodes the data and the decoded multimedia data serves as the reference multimedia data to build the index between the multimedia data packet identification number and the multimedia information; the index is then stored. The sampling point tests the integrality of the data packet. If a data packet is lost, the identification number of the lost data packet is fed back to the reference point. The reference point checks the relationship between the stored multimedia data packet identification number and the corresponding multimedia information according to the lost data packet identification number fed back by the sampling point. Then the corresponding multimedia information is obtained and the sampling point multimedia service quality is thus assessed. The invention can avoid extra multimedia decoding at the monitored receiving end and server end.
Description
Technical field
The invention belongs to multimedia messages transmission and process field, be specifically related to a kind of method and system of monitoring multimedia service performance.
Background technology
Along with the development of cable network and wireless network and the driving of user's request, multimedia technology has obtained increasing concern with relevant application, is considered to one of mainstream applications of following express network.Multimedia application comprises Video Applications and voice applications, uses as world wide web (www), Email (E-mail) etc. with respect to the tradition of network (Internet), and is bigger to the demand of bandwidth, multi-medium data be collapsed into a very urgent task.The coding techniques of high compression rate has been taked in the transmission of multi-medium datas such as existing video and audio frequency, therefore these coding techniquess have utilized multimedia messagess such as video and audio frequency to carry out data compression in time, space and statistical dependence, and data-bag lost in network transmission process or the delay video and the audio quality that can cause decoding end descends.But wired or wireless network does not provide QoS (the Quality of Serverices: guarantee service quality), so the losing or postpones unavoidably of packet that this all can cause the user experience quality decline of receiving terminal of transmission.In order to improve the quality of multimedia service, the multimedia messages by cable network or wireless network transmissions is carried out the research focus that quality-monitoring becomes field of multimedia communication.
Traditional monitoring multimedia service performance method is at receiving terminal the multimedia messages of receiving to be monitored, and handles the multi-medium data error message that detects in the network transmission process by multimedia decoding, and it is fed back to server end.Rebuild according to the multi-medium data of the error feedback information butt joint receiving end that receives at server end, thereby the multimedia service performance of the receiving end that achieves a butt joint is monitored and is estimated.
Fig. 1 is a kind of monitoring multimedia service performance system schematic in the prior art, and among the figure, transmitting terminal is packed to multi-medium data, and sends it to receiving terminal, during to pass through the plurality of network node.In the transport process of multi-medium data, the multi-medium data bag may take place to postpone or lose, and causes receiving terminal can not correctly receive all packets.At this moment, receiving terminal is handled by multimedia decoding, finds the error message in the content of multimedia, and it is fed back to server end.Monitor server according to the feedback error information that receives, utilizes multimedia decoder to estimate monitored receiving terminal multi-medium data again.With monitored multi-medium data with compare with reference to multi-medium data, realize the monitoring of multimedia service performance.
A shortcoming of traditional monitoring multimedia service performance method is just can obtain the error message of content of multimedia by the multimedia decoder processing of receiving terminal.This requires monitored receiving terminal to carry out decode operation completely to the multimedia messages of transmission.In the time need monitoring the performance of a plurality of multimedia services, conventional method shown in Figure 1 requires receiving terminal to decode to a plurality of multimedia service contents.This has not only increased the resource consumption of receiving terminal, and is unfavorable for the digital copyright management of content of multimedia.
The another one shortcoming of traditional monitoring multimedia service performance method is just can estimate the content of multimedia of monitored receiving terminal by the multimedia decoder processing procedure of server end.This requires server end that each monitored receiving terminal is carried out the multimedia decoding operation.In the time need monitoring the multimedia service performance of a plurality of receiving terminals, conventional method shown in Figure 1 requires server end that the multimedia service content is decoded, and this can increase considerably the resource consumption of server end.
Therefore, existing multimedia service performance detection method need be improved.
Summary of the invention
Technical problem to be solved by this invention provides a kind of method and system of monitoring multimedia service performance, on the one hand, avoids carrying out at monitored receiving terminal the processing procedure of multimedia decoding, helps digital copyright management; On the other hand, avoid server end to carry out extra multimedia decoding process, help a plurality of receiving terminals being carried out monitoring multimedia service performance at server end.
In order to solve the problems of the technologies described above, the invention provides a kind of monitoring multimedia service performance method, be applied to comprise the system of transmitting terminal, receiving terminal and go-between transmission node, comprise following steps:
(a) reference point and sampled point are set in system, described reference point is arranged on transport network node A, described sampling optimization is served the network node of monitoring in transport network node A or any needs afterwards, has bi-directional communication channels between reference point and the sampled point;
(b) transport network node A duplicates and sends to reference point to the multi-medium data of receiving, reference point is decoded to the multi-medium data that this duplicates, with the reference multi-medium data of decoded multi-medium data as service quality evaluation, and the index of setting up between multi-medium data bag identification number and the multimedia messages is also preserved;
(c) sampled point sorts to the packet that receives according to the bag identification number, detects the integrality of packet, if any data-bag lost, its identification number is fed back to reference point;
(d) identification number of the lost data packets returned according to sampled point of reference point, incidence relation between the multi-medium data bag identification number of searching preservation and the corresponding multimedia messages, obtain corresponding multimedia messages, and then the multimedia service quality of sampled point is estimated.
In a preferred embodiment, the sequence number that multi-medium data bag identification number sends for coding back multimedia data information in the described step (a).
In a preferred embodiment, multimedia messages is the multimedia data information of package identification correspondence in the described step (a), the characteristic information that perhaps extracts from multi-medium data, or multi-medium data compressed encoding information.
In a preferred embodiment, in the described step (b), for the service of adopting reliable transport protocol, transport network node is that the multi-medium data after retransmitting is duplicated and send to reference point, as the reference data of service quality evaluation.
In a preferred embodiment, in the described step (b), for the service of adopting reliable transport protocol such as ICP/IP protocol, sampled point is that the identification number of the lost data packets that obtain before will retransmitting sends to reference point.
In a preferred embodiment, the incidence relation between described package identification number and the multimedia messages is set up by indexed mode.
In a preferred embodiment, a record in the described index comprises the RTP Bale No., follow by frame of video sequence number, macro block sequence number and position, and the motion vector of each macro block; Perhaps, comprise the sequence number of a plurality of picture frames, the sequence number and the position of macro block, and the motion vector of each macro block.
In a preferred embodiment, evaluation method to the multimedia service quality in the described step (d) is: search incidence relation between package identification number and the multimedia messages according to the identification number of the lost data packets of sampled point feedback, the position of the video data that obtains losing, lose the video data that location estimation goes out monitored sampled point according to this then, again itself and reference video data are compared, just can obtain the Video service quality evaluation result of sampled point.
The system and method for a kind of monitoring multimedia service performance provided by the present invention, on the one hand, can monitor the transmission quality of multimedia messages according to the packet state information in the transmission course, thereby avoided carrying out the processing procedure of multimedia decoding, helped digital copyright management at monitored receiving terminal; On the other hand, by setting up the packet numbers of transmission and the incidence relation between the multi-medium data at server end, thereby avoided carrying out extra multimedia decoding process, helped a plurality of receiving terminals being carried out monitoring multimedia service performance at server end at server end.
Description of drawings
Fig. 1 is a kind of monitoring multimedia service performance system schematic in the prior art;
Fig. 2 is the monitoring multimedia service performance system schematic that the present invention is based on feedback information;
Fig. 3 is a monitoring multimedia service performance method flow diagram of the present invention;
Fig. 4 is a kind of package identification of the present invention number and encode video information index establishing method schematic diagram.
Embodiment
Performance monitoring with typical multimedia video service is performance monitoring principle and the implementation method that example is explained multimedia service of the present invention below, but is not limited to this application.
Shown in Figure 2 is the monitoring multimedia service performance system schematic that the present invention is based on feedback information.This system removes and comprises transmitting terminal, outside network node and the receiving terminal, also comprises by sampled point and reference point.Wherein:
Described reference point can be at the transmitting terminal (" transmitting terminal " in the literary composition comprises encoder interior) of multimedia system, also can be in the transport network node position of centre.Comprise a reference point in the example shown in Figure 2, the transport network node A in the middle of this reference point is positioned at, and between corresponding 2 sampled points bi-directional communication channels is arranged, these sampling optimizations are on reference point place transport network node A or reference node afterwards.
Described reference point is equivalent to the monitoring multimedia service performance server among Fig. 1, or is called server end.This server need obtain the copy of the complete multi-medium data of transmitting terminal transmission, (embodiment sets up with indexed mode to set up incidence relation between a multi-medium data bag identification number and the multimedia messages, but the present invention is not limited to this), and with this index preservation.Described reference point is used to receive the feedback information of the identification number of the lost data packets that sampled point sends over, according to this information searching multi-medium data bag identification number and multimedia messages index, obtain information such as corresponding multi-medium data or feature, thereby multimedia service performance is monitored, and the multimedia service quality is estimated.
Described sampled point can be in the network node position that needs the service monitoring arbitrarily.In the example of Fig. 2, set up sampled point 1 and sampled point 2 at network node 1 and network node 2 positions respectively.
Described sampled point is a device, obtains as the existing network transmission node is upgraded, and is used to detect the integrality of the package identification that receives number, judges whether to take place loss of data, and the identification number of lost data packets is sent to reference point by feedback channel.
Fig. 3 is a monitoring multimedia service performance method flow diagram of the present invention.Multi-medium data is packaged at transmitting terminal, through behind the network node, arrives receiving terminal.Because data transport network can't guarantee service quality, the multi-medium data that receiving terminal obtains may be inconsistent with the data of transmitting terminal.As shown in Figure 2, transmitting terminal between the network node 1 and network node 1 all have data-bag lost between the network node 2.In order to realize that to monitoring a kind of implementation method step of the present invention is as follows to the media video service performance:
Step 301: transport network node A duplicates and sends to reference point to the multi-medium data of receiving, reference point is decoded to the multi-medium data that this duplicates, and sets up index and preservation between multi-medium data bag identification number and the multimedia messages;
For the service of adopting reliable transport protocol such as ICP/IP protocol, transport network node is that the multi-medium data after retransmitting is duplicated and send to reference point, as the reference data of service quality evaluation.
Multi-medium data bag identification number is the sequence number that coding back multimedia data information sends, and in Real-time Transport Protocol, package identification number is a RTP bag sequence number; In ICP/IP protocol, package identification number is an IP bag sequence number; In agreement H.324M, package identification number is the Frame sequence number.
The multimedia messages that is used to set up index comprises the multimedia data information of packet correspondence, the characteristic information that perhaps extracts, perhaps multi-medium data compressed encoding information from multi-medium data.
Indexing means between package identification number and the multimedia messages is varied, for example, we need monitor the Video service quality, then set up the index between package identification number and the video information, can take a kind of simple package identification shown in Figure 4 number and multi-medium data compressed encoding information index method for building up, but be not limited to this method.A record in this index comprises the RTP Bale No., follows by frame of video sequence number, macro block sequence number and position, and the motion vector of each macro block.If in the RTP bag a plurality of picture frames are arranged, then comprise the sequence number of a plurality of picture frames, the sequence number and the position of macro block, and the motion vector of each macro block.
Step 302: each sampled point sorts to the packet that the corresponding network transmission node receives according to the bag identification number, checks the integrality of packet, if data-bag lost takes place, the identification number of the packet that will lose is sent to reference point by feedback channel;
For the service of adopting reliable transport protocol such as ICP/IP protocol, sampled point is that the identification number of the lost data packets that obtain before will retransmitting sends to reference point.
Only with the integrality that detects package identification number, the integrality of RTP bag sequence number for example is used for judging whether to take place packet loss on transport network node.Need not carry out the multimedia decoding process to packet and handle, only need the sequence number of the packet lost is detected and handles, and this error message is sent to reference point carries out service quality evaluation and monitoring at sampled point.
Handle owing to need not carry out the multimedia decoding process, improved the versatility that error message detects on the one hand, do not relate to different multimedia coding standards, reduced the implementation complexity of sampled point at sampled point; Improved the digital copyright management reliability of content of multimedia on the other hand, need not be decrypted authentication at sampled point.
Step 303: after reference point is received the identification number of the lost data packets that sampled point returns, according to the incidence relation between package identification of preserving number and the multimedia messages, obtain corresponding multimedia messages, as multi-medium data or characteristic information, and then the multimedia service quality of sampled point estimated.
When reference point is monitored content of multimedia, can be directly the packet identification number be retrieved with the index between the corresponding multimedia messages, obtain corresponding media data or characteristic information.Therefore do not need to carry out extra multimedia decoding in reference point again, thereby reduced resource consumption, help the multimedia service performance of a plurality of sampled points being monitored in reference point.
In Fig. 2, reference point receives the data-bag lost feedback information of sampled point 1 and sampled point 2, the RTP Bale No. of for example losing.Just can not need to carry out video decode and handle in reference point locations, respectively the Video service quality of sampled point 1 and sampled point 2 positions is estimated according to error feedback information.
Video service quality evaluating method to sampled point 1 is: the RTP Bale No. of losing according to sampled point 1 feedback retrieves the position of losing video data in the index of setting up in advance, then according to losing the video data that location estimation goes out monitored sampled point 1, all put 0 or other value as the video data that will lose device, again itself and reference video data (being the video data that transmitting terminal sends) are compared, just can obtain the Video service quality evaluation result of sampled point 1.
Video service quality evaluating method to sampled point 2 is: the RTP Bale No. of losing according to sampled point 2 feedbacks retrieves the position of losing video data in the index of setting up in advance, then according to losing the video data that location estimation goes out monitored sampled point 2, again itself and reference video data are compared, just can obtain the Video service quality evaluation result of sampled point 2.
But the present invention is not confined to the evaluation method of Video service quality with upper type.If when service quality evaluation did not need the reference video data that monitored video data and transmitting terminal duplicate compared, transmitting terminal also can not duplicate the video data of transmission to reference point.
In another embodiment, a plurality of reference points can be set in system, set up communication port between each reference point and corresponding one or more sampled point.Many groups of monitoring subsystems same as the previously described embodiments have been equivalent to constitute.
Though reference point of the present invention is arranged on transport network node and receives that with transport network node packet is a reference data, can the transmission state of thereafter network node be monitored equally.
Claims (8)
1. monitoring multimedia service performance method is applied to comprise the system of transmitting terminal, receiving terminal and go-between transmission node comprise following steps:
(a) reference point and sampled point are set in system, described reference point is arranged on transport network node A, described sampling optimization is served the network node of monitoring in transport network node A or any needs afterwards, has bi-directional communication channels between reference point and the sampled point;
(b) transport network node A duplicates and sends to reference point to the multi-medium data of receiving, reference point is decoded to the multi-medium data that this duplicates, with the reference multi-medium data of decoded multi-medium data as service quality evaluation, and the index of setting up between multi-medium data bag identification number and the multimedia messages is also preserved;
(c) sampled point sorts to the packet that receives according to the bag identification number, detects the integrality of packet, if any data-bag lost, its identification number is fed back to reference point;
(d) identification number of the lost data packets returned according to sampled point of reference point, incidence relation between the multi-medium data bag identification number of searching preservation and the corresponding multimedia messages, obtain corresponding multimedia messages, and then the multimedia service quality of sampled point is estimated.
2. the method for claim 1 is characterized in that: the sequence number that multi-medium data bag identification number sends for coding back multimedia data information in the described step (a).
3. method as claimed in claim 1 or 2, it is characterized in that: multimedia messages is the multimedia data information of package identification correspondence in the described step (a), the characteristic information that perhaps from multi-medium data, extracts, or multi-medium data compressed encoding information.
4. the method for claim 1, it is characterized in that: in the described step (b), for the service of adopting reliable transport protocol, transport network node is that the multi-medium data after retransmitting is duplicated and send to reference point, as the reference data of service quality evaluation.
5. the method for claim 1 is characterized in that: in the described step (b), for the service of adopting reliable transport protocol such as ICP/IP protocol, sampled point is that the identification number of the lost data packets that obtain before will retransmitting sends to reference point.
6. the method for claim 1 is characterized in that: the incidence relation between described package identification number and the multimedia messages is set up by indexed mode.
7. method as claimed in claim 6 is characterized in that: a record in the described index comprises the RTP Bale No., follow by frame of video sequence number, macro block sequence number and position, and the motion vector of each macro block; Perhaps, comprise the sequence number of a plurality of picture frames, the sequence number and the position of macro block, and the motion vector of each macro block.
8. the method for claim 1, it is characterized in that: the evaluation method to the multimedia service quality in the described step (d) is: search incidence relation between package identification number and the multimedia messages according to the identification number of the lost data packets of sampled point feedback, the position of the video data that obtains losing, lose the video data that location estimation goes out monitored sampled point according to this then, again itself and reference video data are compared, just can obtain the Video service quality evaluation result of sampled point.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006101382206A CN101179353A (en) | 2006-11-06 | 2006-11-06 | Method and system of monitoring multimedia service performance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006101382206A CN101179353A (en) | 2006-11-06 | 2006-11-06 | Method and system of monitoring multimedia service performance |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101179353A true CN101179353A (en) | 2008-05-14 |
Family
ID=39405457
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2006101382206A Withdrawn CN101179353A (en) | 2006-11-06 | 2006-11-06 | Method and system of monitoring multimedia service performance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101179353A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103119895A (en) * | 2010-09-16 | 2013-05-22 | 德国电信股份有限公司 | Method of and system for measuring quality of audio and video bit stream transmissions over a transmission chain |
| CN103269260A (en) * | 2013-06-03 | 2013-08-28 | 腾讯科技（深圳）有限公司 | Data transmission method, data receiving terminal, data sending terminal and data transmission system |
| CN104041028A (en) * | 2011-12-30 | 2014-09-10 | 英国电讯有限公司 | Assessing packet loss visibility in video |
| WO2017215583A1 (en) * | 2016-06-16 | 2017-12-21 | 华为技术有限公司 | Video service quality evaluation method and device |
| CN108989168A (en) * | 2017-06-02 | 2018-12-11 | 罗伯特·博世有限公司 | Method and apparatus for being identified in a computer network |
-
2006
- 2006-11-06 CN CNA2006101382206A patent/CN101179353A/en not_active Withdrawn
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103119895A (en) * | 2010-09-16 | 2013-05-22 | 德国电信股份有限公司 | Method of and system for measuring quality of audio and video bit stream transmissions over a transmission chain |
| CN104041028A (en) * | 2011-12-30 | 2014-09-10 | 英国电讯有限公司 | Assessing packet loss visibility in video |
| CN104041028B (en) * | 2011-12-30 | 2016-08-24 | 英国电讯有限公司 | Packet loss observability in assessment video |
| CN103269260A (en) * | 2013-06-03 | 2013-08-28 | 腾讯科技（深圳）有限公司 | Data transmission method, data receiving terminal, data sending terminal and data transmission system |
| WO2017215583A1 (en) * | 2016-06-16 | 2017-12-21 | 华为技术有限公司 | Video service quality evaluation method and device |
| CN107517410A (en) * | 2016-06-16 | 2017-12-26 | 华为技术有限公司 | The method and device that video service quality is assessed |
| US11006185B2 (en) | 2016-06-16 | 2021-05-11 | Huawei Technologies Co., Ltd. | Video service quality assessment method and apparatus |
| US11363346B2 (en) | 2016-06-16 | 2022-06-14 | Huawei Technologies Co., Ltd. | Video service quality assessment method and apparatus |
| CN108989168A (en) * | 2017-06-02 | 2018-12-11 | 罗伯特·博世有限公司 | Method and apparatus for being identified in a computer network |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101174995B (en) | Method and system for monitoring multimedia service performance | |
| US7562277B2 (en) | Data transmitting/receiving system and method thereof | |
| EP1482681B1 (en) | Medium streaming distribution system | |
| JP5588019B2 (en) | Method and apparatus for analyzing a network abstraction layer for reliable data communication | |
| CN101155311B (en) | Video code stream error detecting and processing method in video communication | |
| EP1173948B1 (en) | Apparatus for transmitting/receiving bitstream in network and method thereof | |
| CN102265553B (en) | Method and apparatus for reliable multicast streaming | |
| WO2020006912A1 (en) | Method and device for analyzing network transmission quality, computer equipment and storage medium | |
| JP2017130955A (en) | Apparatus for receiving data on digital broadcasting system | |
| CN106911699B (en) | Method for realizing I frame retransmission based on RTP protocol | |
| KR20090090361A (en) | Signaling buffer parameters indicative of receiver buffer architecture | |
| CN102342057A (en) | Method and apparatus for encapsulation of scalable media | |
| CN102333209B (en) | Data transmission method and equipment applied to video monitoring system | |
| CN101179353A (en) | Method and system of monitoring multimedia service performance | |
| EP3020188B1 (en) | Endpoint information for network vqm | |
| JP2005051299A (en) | Packet transmission apparatus, packet reception apparatus, packet transmission method and packet reception method | |
| CN101741752B (en) | The methods, devices and systems of video streaming | |
| CN101296166B (en) | Method for measuring multimedia data based on index | |
| CN104469538A (en) | Picture-quality-smaller-loss-oriented RTP video streaming data package recombination method | |
| US7894486B2 (en) | Method for depacketization of multimedia packet data | |
| EP1722570B1 (en) | Method of transmitting video data | |
| JP4252017B2 (en) | Coded stream relay apparatus, method and program thereof | |
| CN101316198B (en) | Monitoring method for multimedia data based on index | |
| KR101745646B1 (en) | System and method for retransmitting packet in wireless lan, access point therefor | |
| CN109196870B (en) | Method and apparatus for transmitting and receiving MMTP packets |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C04 | Withdrawal of patent application after publication (patent law 2001) | ||
| WW01 | Invention patent application withdrawn after publication |