JP2009273013A - Quality estimation method, quality estimation system, user terminal, quality management terminal and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce arithmetic processing amounts and memory capacities to be used, by a user terminal and a quality management terminal. <P>SOLUTION: A user terminal includes: an IP packet analysis section 101 for determining quality information required for quality estimation when quality deterioration of contents occurs between an information transmission terminal 1 and the device of the user's own terminal; and a quality information feedback section 103 for transmitting the quality information to a quality management terminal 4. The quality management terminal 4 includes: a transmission information storage section 201 for storing information of contents to be transmitted from the information transmission terminal 1 to user terminals 2A-2N; and a quality estimation section 104 for estimating, on the basis of the stored information of contents and the quality information, the quality of contents in the user terminal that has transmitted the quality information, and estimating, for the user terminal that has not transmitted quality information, the quality of contents at the user terminal that has not transmitted the quality information, on the basis of the stored information of contents. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technique for estimating the quality of communication such as an IPTV service, a video distribution service, a video communication service, and VoIP performed via an IP network such as the Internet.

  With the increase in the speed and bandwidth of Internet access lines, communication services that transmit and receive audio signals and video signals are expected. Since the Internet is not necessarily a network with guaranteed communication quality, when sending or receiving audio signals or video signals, if the network bandwidth between users is narrow or the line is congested, audio signals and video signals etc. In contrast, the quality of experience (QoE) perceived by the user is degraded. Specifically, when quality degradation is added to a video, it is perceived as blurring, blurring, mosaic distortion, jerky feeling, and the like. In order to provide communication services with high quality, quality design prior to service provision and quality management after service start are important. For this purpose, the quality enjoyed by users can be expressed appropriately, and it is simple and efficient. Quality evaluation technology is required.

  Conventionally, Non-Patent Document 1 and Non-Patent Document 2 recommended by the International Standardization Organization ITU-T (International Telecommunication Union Telecommunication Standardization Sector) describe an objective quality evaluation method for estimating the quality of content such as audio and video. Similarly, Non-Patent Document 3 and Non-Patent Document 4 recommended by ITU-T describe objective quality evaluation methods for estimating the quality of content from quality parameters that affect the quality of the content, and further recommended by ITU-T. Non-Patent Document 5 describes an objective quality evaluation method for estimating content quality only from IP packet header information. According to these objective evaluation techniques, the subjective quality can be estimated with an estimation error comparable to the statistical ambiguity of the subjective quality under a certain condition.

  In the conventional communication service, the quality of the content in the user terminal is estimated using the quality estimation model described in Non-Patent Document 1 to Non-Patent Document 5, and the estimated quality value is notified from the user terminal to the quality management center. The quality perceived by the user is managed by the quality management center.

  Further, in VoIP (Voice over IP), there is a technique for sending quality information to a quality control center using a protocol called RTCP-XR (RTP Control Protocol Extended Reports) (see Non-Patent Document 6). In this technique, quality information that affects the quality of content is analyzed at a receiving terminal, and the quality information is sequentially fed back to a quality management center.

“Perceptual evaluation of speech quality (PESQ): An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs”, ITU-T Recommendation P.862, 2001. “Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference”, ITU-T Recommendation J.144, 2003 “The E-model, a computational model for use in transmission planning”, ITU-T Recommendation G.107, 2005 “Opinion model for video-telephony applications”, ITU-T Recommendation G.1070, 2007 “Conformance testing for narrowband voice over IP transmission quality assessment models”, ITU-T Recommendation P.564, 2006 “RTP Control Protocol (RTCP), and defines how the use of XR packets”, IETF Network Working Group, Request for Comments 3611, <http://www.ietf.org/rfc/rfc3611.txt>

  However, in the methods disclosed in Non-Patent Literature 1 to Non-Patent Literature 6, when managing the quality of all users, a quality estimation model for estimating the quality of content based on audio signal, video signal, or packet information is used as a user terminal. Or an external device for quality estimation is required. Given the desire to reduce the cost of user terminals as much as possible, it is desirable to avoid providing expensive equipment on the receiving side.

  In general, a quality estimation model that estimates quality based on an audio signal or a video signal is computationally intensive, is not suitable for use in quality estimation in real time, and increases the processing load on the user terminal. It was. In addition, a quality estimation model that estimates the quality by calculating packet statistics (for example, packet loss rate, packet discard rate, etc.) from packet information is compared with a model that estimates quality based on an audio signal or a video signal. The amount of calculation is low. However, when the user terminal has a low calculation processing capability, such as a mobile phone terminal, or when the user terminal has a high calculation processing capability but does not want to perform many calculations in the user terminal from the viewpoint of battery consumption. However, there is a problem that the model for estimating the quality from the packet information is not suitable for mounting on the user terminal.

  Furthermore, when the quality value estimated by the above quality estimation model and the derived quality information are sent periodically (for example, every 10 seconds) to the quality management center using a protocol such as RTCP-XR, the quality management center periodically Since quality values or quality information are received from all users (for example, 10,000 users) and processed, there is a problem that the processing load on the quality management center increases. Further, with the technology using RTCP-XR, it is not possible to reduce the processing load on the user terminal.

  The present invention has been made to solve the above-described problems, and the object of the present invention is to reduce the amount of calculation processing and memory usage of the user terminal, and even in a user terminal where a conventional quality estimation model cannot be used. To provide a quality estimation method, a quality estimation system, a user terminal, a quality management terminal, and a program capable of applying a quality management technique and reducing the amount of calculation processing and memory usage of the quality management terminal. .

The present invention relates to a quality estimation method for estimating the quality of content in a user terminal at a quality management terminal on the content transmission side, wherein the quality management terminal stores information on the content transmitted from the transmission side to the user terminal via the network And the quality information that the user terminal transmits quality information necessary for quality estimation to the quality management terminal via the network when content quality degradation occurs between the transmission side and the user terminal. A transmission procedure and a user terminal that estimates the quality of the content in the user terminal that has transmitted the quality information based on the stored content information and the quality information, and does not transmit the quality information. Based on the stored content information, the content in the user terminal that does not transmit this quality information. It is characterized in further comprising a quality estimation procedure for estimating the quality of the tools.
Further, in one configuration example of the quality estimation method of the present invention, the quality information transmission procedure determines the quality information necessary for quality estimation according to a quality degradation factor, and the necessary quality information according to the determination. Is transmitted to the quality control terminal.
Further, in one configuration example of the quality estimation method of the present invention, the quality estimation procedure includes a degradation determination that identifies a quality degradation position and a degradation propagation position in the content based on the stored content information and the quality information. A loss parameter calculation procedure for calculating a loss parameter indicating the degree to which the quality deterioration affects the quality of the content based on the stored content information, the quality deterioration position, and the deterioration propagation position; Based on the transmission quality estimation procedure for estimating the transmission quality of the content from the content information and the transmission quality and the loss parameter, the quality of the content in the user terminal that transmitted the quality information is estimated, and the quality information is not transmitted For the user terminal, the reception quality with the transmission quality as the content quality in this user terminal It is characterized in that comprises a constant step.

The present invention also relates to a quality estimation system for estimating the quality of content in a user terminal at a quality management terminal on the content transmission side, wherein the user terminal experiences content quality degradation between the transmission side and the own device. Analyzing means for obtaining quality information necessary for quality estimation, and quality information feedback means for transmitting the quality information to the quality management terminal via the network, the quality management terminal from the transmission side via the network Based on the stored content information and the quality information, the storage means for storing the content information transmitted to the user terminal is estimated, and the quality of the content in the user terminal that transmitted the quality information is estimated, For user terminals that do not send quality information, this quality information is based on the stored content information. Is characterized in further comprising a quality estimation means for estimating the quality of the content in a user terminal not transmitting.
Further, in one configuration example of the quality estimation system of the present invention, the user terminal further includes quality information determination means for determining the quality information necessary for quality estimation according to a quality degradation factor, and the user terminal The quality information feedback means transmits the necessary quality information to the quality management terminal according to the judgment of the quality information judgment means.
Further, in one configuration example of the quality estimation system of the present invention, the quality estimation unit of the quality management terminal determines the quality degradation position and the degradation propagation position in the content based on the stored content information and the quality information. A deterioration determining means for specifying; a loss parameter calculating means for calculating a loss parameter indicating a degree to which the quality deterioration affects the quality of the content based on the stored content information, the quality deterioration position and the deterioration propagation position; Transmission quality estimation means for estimating the transmission quality of the content from the stored content information, estimating the quality of the content in the user terminal that transmitted the quality information based on the transmission quality and the loss parameter, and the quality For user terminals that do not transmit information, the transmission quality is set to the content of the user terminal. In which it characterized in that it comprises a reception quality estimating means to quality.

Further, the user terminal of the present invention comprises an analyzing means for obtaining quality information necessary for quality estimation by the quality management terminal when content quality degradation occurs between the transmission side and the own device, and the quality information And a quality information feedback means for transmitting to the quality management terminal via a network.
In addition, the quality management terminal of the present invention includes a storage unit that stores information on content transmitted from the transmission side to the user terminal via the network, information on the stored content, a transmission side, and the user terminal. Based on the quality information transmitted from this user terminal when the quality degradation of the content occurs, the quality of the content in the user terminal that transmitted this quality information is estimated, and the user terminal that does not transmit the quality information And quality estimation means for estimating the quality of the content in the user terminal that does not transmit the quality information based on the stored content information.

Further, the user terminal program of the present invention includes an analysis procedure for obtaining quality information necessary for quality estimation by the quality management terminal when content quality degradation occurs between the transmission side and the own device, and the quality information Is sent to the quality control terminal via the network, and the computer is caused to execute the quality information feedback procedure.
Further, the quality management terminal program of the present invention includes a storage procedure for storing content information transmitted from the transmission side to the user terminal via the network, stored content information, the transmission side, and the user terminal. A user terminal that estimates the quality of the content in the user terminal that has transmitted the quality information based on the quality information transmitted from the user terminal when the quality degradation of the content occurs between the user terminals and does not transmit the quality information Is characterized by causing a computer to execute a quality estimation procedure for estimating the quality of content in a user terminal that does not transmit the quality information based on the stored content information.

  According to the present invention, when quality degradation occurs between the transmission side and the user terminal, the user terminal acquires quality information, and only the user terminal in which quality degradation has occurred feeds back the quality information to the quality management terminal. Thus, there is no need to periodically feed back quality information to the quality control center as in the conventional case, and the amount of calculation processing required for information processing by the user terminal and the quality control terminal can be reduced. For user terminal terminals that have not deteriorated in quality with the transmission side, information from the user terminals is not required, and the quality in this terminal can be managed only by information on the quality management terminal side. Further, only the user terminal that has deteriorated in quality with the transmission side feeds back quality information to the quality management terminal, and the quality management terminal estimates the quality value in the user terminal based on this quality information. In comparison with the case where the quality is estimated at the user terminal or when the quality information is periodically fed back to the quality management center by RTCP-XR and the quality is estimated at the quality management center, The amount of processing and memory usage can be reduced. Furthermore, by feeding back the quality information from the user terminal, it is possible to extract transmission information whose quality has deteriorated from the transmission information storage unit and use it for quality estimation. Thus, according to the present invention, it is possible to easily determine whether or not a certain level of quality is maintained for a user who uses the service.

  Further, in the present invention, the user terminal determines the quality information necessary for quality estimation according to the quality degradation factor, and transmits the necessary quality information to the quality management terminal according to this determination. The quality management terminal can estimate the reception quality at the user terminal with the quality estimation model corresponding to the quality degradation factor.

[Principle of the Invention]
In the embodiment of the present invention, only the quality information (packet loss, fluctuation, delay) in the case where quality degradation has occurred among the information transmitted from the information transmission terminal on the transmission side to the user terminal is the quality from the user terminal. The quality management terminal performs quality estimation only at the location of the quality information received from the user terminal. For areas where quality information is not returned, the quality management terminal performs quality estimation. As a result, the user terminal only needs to incorporate a function for transmitting quality information, which leads to reduction of the processing load and cost of the user terminal, and conventionally, the quality control center by sequentially transmitting quality values to the quality control center. It can also be improved that the processing load has increased.

  More specifically, in a method using a conventional quality estimation model, a quality value is calculated at a user terminal or quality information (for example, packet loss rate or packet discard rate) based on packet statistical information is calculated. It was. On the other hand, in the embodiment of the present invention, the user terminal has only the function of extracting quality information regarding the number of lost packets or discarded packets and feeding back to the quality management terminal. This prevents the amount of calculation processing, memory usage, and power consumption from increasing.

In addition, since the quality of the content at the user terminal when no quality degradation has occurred with the information transmission terminal is affected only by the quality degradation due to coding distortion, the quality of the content transmitted from the information transmission terminal The quality of content viewed on the user terminal is equivalent.
Since the quality management terminal has information before and after encoding and information such as an IP packet to be transmitted and a TS (Transport Stream) packet, the quality management terminal estimates the quality of the content at the user terminal when no quality degradation has occurred. It is possible. However, in some cases, it is possible that the content before encoding is not in the quality control terminal.

  As a technique for the quality management terminal to estimate the quality of content in the user terminal, there is a technique for estimating the video quality immediately after encoding using the objective quality evaluation method disclosed in Non-Patent Document 2 above. If the quality control terminal has sufficient computing capability, the quality of the content can be calculated in real time, and the quality of the content in the user terminal when no quality degradation has occurred can be managed.

  That is, in the embodiment of the present invention, when quality degradation does not occur between the information transmission terminal and the user terminal, it is not necessary to feed back quality information from the user terminal to the quality management terminal. The amount of processing, memory usage, and power consumption can be reduced, and the amount of information fed back to the quality management terminal can be reduced. As a result, the calculation processing amount of the quality management terminal can also be reduced. However, there is a possibility that a control packet for confirming whether or not communication is performed is transmitted and received between the user terminal and the quality control terminal.

  In addition, in order to estimate the quality of content in the user terminal when packet loss occurs due to network line congestion, for example, the quality information is fed back from the user terminal to the quality management terminal, and the user terminal at the quality management terminal What is necessary is just to estimate the quality of the content. For example, the quality control terminal estimates the video quality immediately after encoding using the objective quality evaluation method disclosed in Non-Patent Document 2 above, and considers the influence of packet loss from the position of the video affected by packet loss. It is possible to extract the lost parameter and estimate the video quality perceived by the user from the value of the lost parameter.

With the above function, the quality of the content in the user terminal when no quality degradation has occurred with the information transmission terminal can be estimated only from the information on the content transmission side, and the quality value or Quality information need not be fed back to the quality control terminal.
In addition, for the user terminal when quality degradation has occurred with the information transmission terminal, the quality information is fed back to the quality management terminal, so there is no need to estimate the quality of the content at the user terminal. Therefore, it is only necessary to estimate the quality of the user terminal that has sent the quality information, so that it is possible to reduce the amount of calculation processing and memory usage of the quality management terminal and the user terminal.

  In addition, when content is encrypted from the viewpoint of copyright protection, it is theoretically difficult to extract the content information and estimate the quality on the user terminal side. It is also effective from the viewpoint of improving the quality estimation accuracy that the quality control terminal can analyze what kind of information was included in the degraded information and estimate the quality from that information. .

[Embodiment]
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a quality estimation system according to an embodiment of the present invention.
The quality estimation system includes an information transmission terminal 1 that transmits content, a plurality of user terminals 2A to 2N that receive content, a network 3 that connects the information transmission terminal 1 and user terminals 2A to 2N, and user terminals 2A to 2N. And a quality management terminal 4 for estimating the quality of content in 2N.

  In the example of FIG. 1, a communication service for distributing content from the information transmission terminal 1 to the user terminals 2A to 2N is performed, and the quality management terminal 4 manages the quality of the content perceived by the user. . Hereinafter, in the present embodiment, a case where video information is transmitted as an example of content transmitted by an IP packet will be described. In FIG. 1, the information transmission terminal 1 and the quality management terminal 4 are configured as separate devices, but may be configured as a single device.

  Each of the user terminals 2 </ b> A to 2 </ b> N includes an IP packet capture unit 100, an IP packet analysis unit 101, a quality information storage unit 102, a quality information feedback unit 103, and a quality information determination unit 105.

  The quality management terminal 4 includes a transmission information storage unit 201 and a quality estimation unit 104. Furthermore, the quality estimation unit 104 includes a quality information storage unit 104A, a degradation determination unit 104B, a loss parameter calculation unit 104C, a transmission quality estimation unit 104D, a reception quality estimation unit 104E, and a coefficient database 104F. .

  Next, the configuration of the user terminals 2A to 2N will be described. The IP packet capture unit 100 receives an IP packet transmitted from the information transmission terminal 1 via the network 3 and inputs the IP packet to the IP packet analysis unit 101.

  FIG. 2 is a diagram illustrating an example of an IP packet format. As shown in FIG. 2, an IP packet includes an IP header 20, a UDP (User Datagram Protocol) header 21, an RTP (Real-time Transport Protocol) header 22, a TS (Transport Stream) header 23, a PES (Packetized Elementary Streams). ) There are a header 24, an ES (Elementary Stream) 25 in which video signals and audio signals are encoded and packetized, and the like. 2 in FIG. 2 indicates a TS packet.

  The IP packet analysis unit 101 obtains quality information (value corresponding to the RTP sequence number, source address, time stamp, packet fluctuation information, packet delay information, etc.) necessary for performing quality estimation from the IP packet from the IP packet. The quality information is extracted and stored in the quality information storage unit 102.

  Specifically, the IP packet analysis unit 101, for example, an IP source (source) address and an IP destination (destination) address described in the IP header, a PID that is a packet identifier described in the TS header, and a lost TS CC (Continuity counter) number described in the packet, RTP sequence number of the lost IP packet, RTP sequence numbers and time stamps before and after the lost IP packet, first received in the quality measurement interval (for example, every 10 seconds) The RTP sequence number and time stamp of the last packet, the RTP sequence number and time stamp of the last packet received in the quality measurement period, and the like are extracted. In the present embodiment, a model for estimating video quality from the above parameters is described. However, packet delay time and packet fluctuation information may be added as quality information.

The quality management terminal 4 uses the IP source address in order to identify which information transmission terminal 1 is the packet transmitted to the user terminals 2A to 2N among the plurality of information transmission terminals 1 which are servers.
Further, the quality management terminal 4 identifies a different multicast address for each TV program, and uses the IP destination address to determine which program video information quality should be estimated. For ease of explanation, quality control for only one program will be described below, and description of the destination address will be omitted.

The quality control terminal 4 can identify video, sound, and other information from the PID described in the TS header, and can determine the presence or absence of loss of video and sound TS packets for each PID.
The quality management terminal 4 also includes the RTP sequence number and time stamp of the first packet received by the user terminals 2A to 2N within the quality measurement interval, and the RTP sequence number and time stamp of the last packet received within the quality measurement interval. The CC number of the lost TS packet and the RTP sequence number and time stamp of the IP packet including the TS packet can be used to clarify which position the packet has been lost.

  For example, the RTP sequence number of the first packet received by the user terminal 2A within the quality measurement interval is 1 and the time stamp is 0, and the RTP sequence number of the last packet received by the user terminal 2A within the quality measurement interval is 50000 The RTP sequence number of the lost IP packet is 10th and 11th, the CC of the video TS included in the lost packet is 1 to 10, and the RTP sequence of the packet immediately before the lost packet Assume that the number is 9 and the time stamp is 0.009 seconds, the RTP sequence number of the packet immediately after the lost packet is 12 and the time stamp is 0.011 seconds.

  The quality management terminal 4 receiving the feedback of these information specifies the position of the lost packet from the information of the IP packet and TS packet stored in the transmission information storage unit 201, and how the quality degradation occurs. You can know if you are.

  The quality information feedback unit 103 of the user terminals 2A to 2N transmits the quality information stored in the quality information storage unit 102 to the quality management terminal 4 on the information transmission side via the network 3. The quality information determination unit 105 determines quality information to be fed back to the transmission side for quality estimation. The quality information determination unit 105 stores in advance for each quality deterioration factor what kind of quality information is necessary for quality estimation. The quality information feedback unit 103 transmits necessary quality information to the quality management terminal 4 according to the determination of the quality information determination unit 105.

  Next, the configuration of the quality management terminal 4 will be described. First, the quality management terminal 4 includes a transmission information storage unit 201 that stores information transmitted from the information transmission terminal 1 to the user terminals 2A to 2N via the network 3. In the present embodiment, an example is shown in which an IP packet and a TS packet are stored in the transmission information storage unit 201 as content information transmitted to the user terminals 2A to 2N. In this embodiment, an example in which the transmission information storage unit 201 is mounted on the quality management terminal 4 is shown, but the transmission information storage unit 201 may be mounted on the information transmission terminal 1.

Next, the configuration of the quality estimation unit 104 of the quality management terminal 4 will be described.
The quality information storage unit 104A includes quality information transmitted from the user terminals 2A to 2N (an RTP sequence number of a lost packet, a CC number included in the lost RTP packet, an RTP sequence number of packets before and after the lost packet, and Time stamp, source address, etc.).

  The degradation determination unit 104B reads out information transmitted to the user terminals 2A to 2N from the transmission information storage unit 201, reads out quality information from the quality information storage unit 104A, and determines a quality degradation position (lost TS packet due to loss of TS packets). The position of the frame and the position of the frame) and the deterioration propagation position where the quality deterioration has propagated because the lost frame is referred to, and the information on the specified position is input to the loss parameter calculation unit 104C.

  FIG. 3 is a diagram for explaining a method of specifying the position of a lost TS packet, and No indicates an RTP sequence number. For example, as shown in FIG. 3, the RTP sequence number of the first packet received by the user terminal 2A within the quality measurement interval is 1 and the time stamp is 0, and the last packet received by the user terminal 2A within the quality measurement interval The RTP sequence number is 50000, the time stamp is 10 seconds, the RTP sequence numbers of the lost IP packets are Nos. 10 and 11, the RTP sequence number of the packet immediately before the lost packet is No. 9, and the time stamp is 0.009. Assume that the RTP sequence number of the packet immediately after the lost packet is 12th, the time stamp is 0.011 second, and the CC of the video TS included in the lost packet is 1-10.

  Since the transmission information storage unit 201 stores the same information as that transmitted from the information transmission terminal 1 to the user terminal 2A, the deterioration determination unit 104B includes the information stored in the transmission information storage unit 201 and the user. The lost TS packet can be identified from the quality information received from the terminal 2A. Further, the RTP sequence number makes one round at 65536 and is counted up again from zero. For this reason, the degradation determination unit 104B includes the RTP sequence number and time stamp of the first packet received by the user terminal 2A within the quality measurement interval, and the RTP sequence number of the last packet received by the user terminal 2A within the quality measurement interval. Then, from the time stamp, it is determined which range of the IP packet stored in the transmission information storage unit 201 corresponds to the quality measurement section.

  Further, the degradation determination unit 104B includes the RTP sequence number and time stamp of the first packet received by the user terminal 2A within the quality measurement interval, and the RTP sequence number and the last packet received by the user terminal 2A within the quality measurement interval. The time stamp can be used to specify at which position in the quality measurement interval a lost TS packet exists.

  Next, the deterioration determination unit 104B determines the position of the lost frame of the video TS (for example, the seventh frame) and the type of the lost frame based on the CC number included in the lost TS packet. Furthermore, the degradation determination unit 104B identifies a frame in which degradation has propagated because it refers to a lost frame.

  MPEG2 (Moving Picture Experts Group 2) and H.264 In video encoding schemes such as H.264, video signals are encoded and compressed into frames such as I, B, and P frames. The I frame is completed by itself, and the original frame image can be restored only by the information of the I frame. The P frame is difference information between the image of the corresponding frame and the image of the immediately preceding I frame or P frame. In order to decode a P frame, information on the immediately preceding I frame or P frame is required. The B frame is compressed using not only the previous frame but also the difference with the subsequent frame. In order to decode the B frame, information on the preceding and subsequent I frames and P frames is required.

  MPEG2 and H.264 In a video encoding method such as H.264, the I, B, and P frames are not compressed independently, but are compressed and decompressed in units of GOP (Group of Picture). For example, in the case of MPEG2, the GOP is configured in units of 15 frames (0.5 seconds) like IBBPBBPBBPBBPBB. In the upper case, there are 1 I frame, 4 P frames, and 10 B frames in one GOP.

  In this way, since there are P frames and B frames that refer to other frames in the frame, as shown in FIG. 4, the propagation of deterioration differs depending on the frame in which the packet loss occurs, and as a result The degradation range of the image perceived by the user is different. The example of FIG. 4 shows the case of GOP (M = 3, N = 15). When packet loss occurs in an I frame as indicated by Iloss in FIG. 4, the period of deterioration up to the next I frame propagates. Reference numeral 40 in FIG. 4 indicates the degradation propagation range at this time. In the example of FIG. 4, it is perceived that there are 17 frames of deterioration.

When packet loss occurs in the P frame as indicated by Ploss in FIG. 4, a period of deterioration up to the next I frame propagates. Reference numeral 41 in FIG. 4 indicates the degradation propagation range at this time. In the example of FIG. 4, it is perceived that there are 11 frames of deterioration.
On the other hand, as shown by Bloss in FIG. 4, even if packet loss occurs in the B frame, the degradation range perceived by the user is only the B frame, and the degradation does not propagate to other frames. The degradation determination unit 104B uses the phenomenon described with reference to FIG. 4 to identify a frame in which degradation has propagated because it refers to a lost frame.

  Then, the deterioration determination unit 104B inputs information indicating the position of the lost frame and information indicating the position of the frame where quality deterioration has propagated because the lost frame is referred to the loss parameter calculation unit 104C. .

  The loss parameter calculation unit 104C indicates a loss indicating the degree to which the video quality immediately after encoding is affected by the frame loss from the position of the lost frame specified by the deterioration determination unit 104B and the position of the frame in which the quality deterioration is propagated. The parameter is calculated, and this loss parameter is input to the reception quality estimation unit 104E.

  An example of the loss parameter is the number of invalid frames. The number of invalid frames is the total value of the number of lost frames and the number of frames in which deterioration has propagated because the lost frames are referenced. For example, if the seventh P frame is lost and the deterioration due to this loss propagates to the 18th frame, the number of invalid frames is 11. However, here, it is assumed that no degradation propagates to the 16th I frame, and this I frame is excluded from the invalid frame.

  The transmission quality estimation unit 104D reads information transmitted to the user terminals 2A to 2N from the transmission information storage unit 201, estimates the transmission quality (encoding quality) immediately after encoding, and receives information representing this transmission quality. It inputs into the quality estimation part 104E. Specifically, the transmission quality estimation unit 104D estimates the transmission quality immediately after encoding from the video encoding information (quantization parameter) described in the IP packet transmitted to the user terminals 2A to 2N.

The reception quality estimation unit 104E determines the video quality perceived by the user of the user terminals 2A to 2N from the loss parameter value input from the loss parameter calculation unit 104C and the transmission quality value input from the transmission quality estimation unit 104D. presume.
Coefficient database 104F stores in advance coefficients for quality estimation by transmission quality estimation section 104D and reception quality estimation section 104E.

In this embodiment, an example is shown in which a bitstream in which information about media is described in transmission quality estimation section 104D and reception quality estimation section 104E is used.
In the above, an example of quality degradation due to packet loss has been given, but the cause of quality degradation is not only packet loss.

  For example, when the packet arrival interval is delayed from the content output timing at the user terminal due to congestion of the network 3 line, the quality of the content is deteriorated. At this time, when the user terminals 2A to 2N wait for a predetermined time until the packet arrives, the display of the content on the user terminals 2A to 2N stops for a certain period. Further, when the user terminals 2A to 2N do not wait for the arrival of the packet, the user terminals 2A to 2N discard the delayed packet in the same manner as the lost packet.

  In order to estimate the video quality degradation due to such packet delay, the IP packet analysis unit 101 of the user terminals 2A to 2N determines the interval (for example, 10 ms) between the arrived IP packet and the immediately preceding IP packet. , And determine whether the measured arrival interval is longer than a predetermined threshold value.If the packet arrival interval is longer than the threshold value, it is determined that the arrival of the packet is delayed. The RTP sequence number and the time stamp of the packet that arrives at this time may be extracted as quality information. If the quality management terminal 4 recognizes in advance whether the user terminals 2A to 2N wait for a packet that arrives late or discards it, it can capture a quality degradation factor such as packet delay.

  In addition, when the order is reversed in the packet, the content is output as usual unless a large delay occurs in the packet if an environment capable of returning the order is prepared. However, if the order of the packets is reversed and a large delay occurs, the packet is discarded without being in time for the output timing as in the case of the delayed packet.

  Thus, information to be fed back to the transmission side for quality estimation differs depending on quality degradation factors. Therefore, the user terminals 2A to 2N include a quality information determination unit 105 that determines quality information necessary for quality estimation according to a deterioration factor. The quality information feedback unit 103 extracts necessary quality information from the quality information storage unit 102 according to the determination of the quality information determination unit 105 and transmits it to the quality management terminal 4.

  In addition, the quality information feedback unit 103 is configured to indicate a degradation factor number indicating the quality degradation factor based on the quality degradation factor determined by the quality information determination unit 105 so that the quality management terminal 4 can distinguish the quality degradation factor. Is added to the quality information and transmitted to the quality management terminal 4. For example, when the quality degradation factor is packet loss, the quality information feedback unit 103 sets the degradation factor number to 1, when the quality degradation factor is packet delay, the degradation factor number is 2, and the quality degradation factor is packet order reversal. In this case, the deterioration element number is 3. In this way, the quality management terminal 4 can distinguish the quality deterioration factor by the deterioration element number, and can estimate the quality using the quality estimation model prepared in advance for each quality deterioration factor.

Next, the operation of the quality estimation system of the present embodiment will be described. FIG. 5 is a flowchart showing the operation of the quality management terminal 4, and FIG. 6 is a flowchart showing the operation of the user terminals 2A to 2N.
First, the transmission information storage unit 201 of the quality management terminal 4 stores transmission information transmitted from the information transmission terminal 1 to the user terminals 2A to 2N (step S101 in FIG. 5). In the present embodiment, IP packets and TS packets are captured and stored as transmission information. However, when estimating the transmission quality and the reception quality, the video signal may be stored when the video signal before being packetized is used.

  The IP packet capture unit 100 of the user terminals 2A to 2N receives the information transmitted from the information transmission terminal 1, that is, the IP packet, and inputs this IP packet to the IP packet analysis unit 101 (step S201 in FIG. 6).

  The IP packet analysis unit 101 of the user terminals 2A to 2N, from the IP packet input from the IP packet capture unit 100, the IP source address, the IP destination address, the PID, the CC number described in the lost TS packet, the loss IP packet RTP sequence number, RTP sequence number and time stamp before and after the lost IP packet, RTP sequence number and time stamp of the first packet received in the quality measurement interval, RTP of the last packet received in the quality measurement interval A sequence number, a time stamp, and the like are extracted as quality information (step S202). However, when other parameters are used when quality estimation or degradation position determination is performed, analysis may be performed as appropriate. The quality information extracted by the IP packet analysis unit 101 is stored in the quality information storage unit 102.

The quality information feedback unit 103 of the user terminals 2A to 2N extracts necessary quality information from the quality information storage unit 102 according to the determination of the quality information determination unit 105 and transmits it to the quality management terminal 4 (step S203).
As described above, the user terminals 2A to 2N do not execute the processes of steps S202 and S203 when quality degradation factors such as packet loss, delay, and order inversion have not occurred.

Next, the quality information storage unit 104A of the quality management terminal 4 stores the quality information transmitted from the user terminals 2A to 2N (step S102 in FIG. 5).
The degradation determination unit 104B of the quality management terminal 4 reads out the information transmitted to the user terminals 2A to 2N from the transmission information storage unit 201, reads out the quality information from the quality information storage unit 104A, and determines the quality degradation position ( The position of the lost TS packet and the position of the lost frame) and the deterioration propagation position where the quality deterioration has propagated by referring to the lost frame are specified, and information on the specified position is input to the loss parameter calculation unit 104C (Step S103).

  The degradation determination unit 104B includes the RTP sequence number of the lost IP packet, the RTP sequence numbers and time stamps before and after the lost IP packet, the RTP sequence number and time stamp of the first packet received in the quality measurement period, and the quality measurement period. From the RTP sequence number and the time stamp of the last packet received, it is possible to specify which position in the IP packet has deteriorated. Further, the degradation determination unit 104B can determine the position of the lost frame and the type of the lost frame based on the CC number included in the lost TS packet.

  Furthermore, the degradation determination unit 104B identifies a frame in which degradation has propagated because it refers to a lost frame. For example, video data is often encoded into information having a frame structure such as I, B, and P frames. It is known that the I frame is used when information is decoded in the subsequent B frame or P frame, and if the loss occurs in the I frame, the quality of the video perceived by the user is deteriorated. In such a case, it is important to specify the position of the lost frame and how far the deterioration due to the lost frame propagates. Details of the method for specifying the degradation propagation position are as described in FIG.

  Next, the loss parameter calculation unit 104C of the quality management terminal 4 indicates the degree to which the video quality immediately after encoding is affected by the frame loss from the quality deterioration position and the deterioration propagation position specified by the deterioration determination unit 104B. The loss parameter is calculated, and this loss parameter is input to the reception quality estimation unit 104E (step S104).

  In the present embodiment, as the loss parameter, for example, JP 2006-33722 A, JP 2007-019802 A, JP 2007-060475 A, JP 2007-135040 A, JP 2007-258919 A, and the like. The number of invalid frames disclosed in Japanese Unexamined Patent Application Publication Nos. 2007-329771, 2007-329772, and 2008-005108 is used. Note that, considering the motion vector, the number of blocks that refer to the position where the deterioration has occurred and the position where the deterioration has propagated may be counted, and the total number of blocks may be used as the loss parameter.

  The transmission quality estimation unit 104D of the quality management terminal 4 reads information transmitted to the user terminals 2A to 2N from the transmission information storage unit 201, extracts bitstream information describing information about the medium from this information, The transmission quality immediately after encoding is estimated from the quantization parameter described in the stream information, and information representing this transmission quality is input to the reception quality estimation unit 104E (step S105).

  The transmission quality (encoding quality immediately after encoding) Vc decreases as the quantization parameter QP increases, and increases as the quantization parameter QP decreases. Using this feature, transmission quality estimation section 104D estimates transmission quality Vc by the following equation.

  vl, v2, and v3 are coefficients determined by a codec (CODEC) or the like. In order to determine the coefficients vl, v2, and v3, the transmission quality estimation unit 104D refers to the coefficient database 104F as illustrated in FIG. 7 and determines the types of services provided from the information transmission terminal 1 to the user terminals 2A to 2N. The values of the coefficients vl, v2, v3 corresponding to the type of codec used when encoding the video signals transmitted to the user terminals 2A to 2N and the format of the transmitted video signal are obtained from the coefficient database 104F. That's fine.

  Examples of service types include IPTV, TV phone, and VoD (Video On Demand). Examples of codec types include H.264. H.264, H.H. 261, MPEG2, MPEG4, and the like. Examples of the video format include HD (High Definition), SD (Standard Definition), VGA (Video Graphics Array), and QCIF (Quarter Common Intermediate Format). In this embodiment, the transmission quality is estimated using the bit stream information, but the transmission quality may be estimated using a quality estimation technique using a video signal.

  The reception quality estimation unit 104E of the quality management terminal 4 determines the transmission source of the quality information from the loss parameter (number of invalid frames) input from the loss parameter calculation unit 104C and the transmission quality value input from the transmission quality estimation unit 104D. The reception quality Vq (video quality perceived by the users of the user terminals 2A to 2N) at the user terminals 2A to 2N is estimated by the following equation (step S106).

  IF is the number of invalid frames, and v4 is a coefficient determined by a codec or the like. In order to determine the coefficients vl, v2, v3, v4, the reception quality estimation unit 104E refers to the coefficient database 104F, and similarly to the transmission quality estimation unit 104D, coefficients corresponding to the service type, codec type, and video format What is necessary is just to acquire the value of vl, v2, v3, v4 from the coefficient database 104F.

  Expression (2) is an expression of the quality estimation model when the quality deterioration factor is packet loss, that is, when the deterioration element number sent together with the quality information from the user terminals 2A to 2N is 1. When the quality degradation factor is packet delay or order reversal, the reception quality may be estimated using another quality estimation model formula.

  Further, the reception quality estimation unit 104E determines the transmission quality estimated by the transmission quality estimation unit 104D for a user terminal that does not transmit quality information, that is, a user terminal that does not experience quality degradation with the information transmission terminal 1. The reception quality at the user terminal may be used.

  As described above, according to the present embodiment, quality information is acquired when quality degradation occurs between the information transmission terminal and the user terminal, and only the user terminal in which quality degradation has occurred receives quality information. Since feedback is made to the management terminal, there is no need to periodically feed back quality information to the quality management center as in the prior art, and the amount of calculation processing required for information processing by the user terminal and the quality management terminal can be reduced. . For a user terminal that has not deteriorated in quality with the information transmitting terminal, information from the user terminal is not required, and the quality in this terminal can be managed only by information on the quality management terminal side.

  In addition, since only the user terminal in which quality degradation has occurred with the information transmitting terminal feeds back the quality information to the quality management terminal, and the quality management terminal estimates the quality value in the user terminal based on this quality information, Compared with the case where the quality is estimated at the user terminal as in the case where the quality information is periodically fed back to the quality management center by RTCP-XR and the quality is estimated at the quality management center, the user terminal and the quality management terminal The amount of calculation processing and memory usage can be reduced. Furthermore, by feeding back the quality information from the user terminal, it is possible to extract transmission information whose quality has deteriorated from the transmission information storage unit and use it for quality estimation. Thus, in this embodiment, it is possible to easily determine whether or not a certain level of quality is maintained for a user who uses the service.

  Note that the user terminals 2A to 2N and the quality management terminal 4 according to the present embodiment can be realized by a computer having a CPU, a storage device, and an external interface, and a program for controlling these hardware resources. . In these computers, the user terminal program and the quality control terminal program are provided in a state where they are recorded on a recording medium such as a flexible disk, a CD-ROM, a DVD-ROM, or a memory card. The CPU of the user terminal writes the user terminal program read from the recording medium to the storage device, and executes the processing described in the present embodiment according to the user terminal program. Similarly, the CPU of the quality management terminal writes the quality management terminal program read from the recording medium into the storage device, and executes the processing described in the present embodiment according to the quality management terminal program.

  The present invention can be applied to technologies for estimating communication quality, such as IPTV service, video distribution service, video communication service, and VoIP.

It is a block diagram which shows the structure of the quality estimation system which concerns on embodiment of this invention. It is a figure which shows one example of the format of an IP packet. It is a figure for demonstrating the identification method of the position of the lost TS packet in embodiment of this invention. It is a figure which shows the concept of the invalid frame in embodiment of this invention. It is a flowchart which shows operation | movement of the quality management terminal of the quality estimation system which concerns on embodiment of this invention. It is a flowchart which shows operation | movement of the user terminal of the quality estimation system which concerns on embodiment of this invention. It is a figure which shows the example of the coefficient database in embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Information transmission terminal, 2A, 2N ... User terminal, 3 ... Network, 4 ... Quality control terminal, 100 ... IP packet capture part, 101 ... IP packet analysis part, 102 ... Quality information storage part, 103 ... Quality information feedback part , 104 ... quality estimation unit, 104A ... quality information storage unit, 104B ... degradation determination unit, 104C ... loss parameter calculation unit, 104D ... transmission quality estimation unit, 104E ... reception quality estimation unit, 104F ... coefficient database, 105 ... quality information Judgment unit, 201... Transmission information storage unit.

Claims (10)

In a quality estimation method for estimating the quality of content in a user terminal at a quality management terminal on the content transmission side,
A storage procedure in which the quality management terminal stores information of content transmitted from the transmission side to the user terminal via the network;
A quality information transmission procedure in which, when content quality degradation occurs between the transmission side and the user terminal, the user terminal transmits quality information necessary for quality estimation to the quality management terminal via a network;
Based on the stored content information and the quality information, the quality management terminal estimates the quality of the content in the user terminal that transmitted the quality information, and stores the user terminal that does not transmit the quality information. A quality estimation method comprising: a quality estimation procedure for estimating the quality of content at a user terminal that does not transmit the quality information based on the content information. The quality estimation method according to claim 1,
The quality information transmission procedure includes a procedure of determining the quality information necessary for quality estimation according to a quality deterioration factor and transmitting the necessary quality information to the quality management terminal according to the determination. Quality estimation method. The quality estimation method according to claim 1,
The quality estimation procedure includes:
A degradation determination procedure for identifying a quality degradation position and a degradation propagation position in the content based on the stored content information and the quality information;
A loss parameter calculation procedure for calculating a loss parameter indicating the degree to which the quality deterioration affects the quality of the content based on the stored content information, the quality deterioration position and the deterioration propagation position;
A transmission quality estimation procedure for estimating the transmission quality of the content from the stored content information;
Based on the transmission quality and the loss parameter, the quality of the content in the user terminal that transmitted the quality information is estimated, and for the user terminal that does not transmit the quality information, the transmission quality is set as the content quality in the user terminal. A quality estimation method comprising: a reception quality estimation procedure. In a quality estimation system for estimating the quality of content in a user terminal at a quality management terminal on the content transmission side,
The user terminal is
An analysis means for obtaining quality information necessary for quality estimation when content quality degradation occurs between the transmission side and the own device;
Quality information feedback means for transmitting the quality information to the quality management terminal via a network,
The quality control terminal
Storage means for storing content information transmitted from the transmission side to the user terminal via the network;
Based on the stored content information and the quality information, the quality of the content in the user terminal that has transmitted this quality information is estimated, and the user terminal that does not transmit the quality information is stored in the stored content information. A quality estimation system comprising: quality estimation means for estimating the quality of content in a user terminal that does not transmit the quality information. The quality estimation system according to claim 4, wherein
Further, the user terminal comprises a quality information determining means for determining the quality information necessary for quality estimation according to a quality degradation factor,
The quality estimation system according to claim 1, wherein the quality information feedback means of the user terminal transmits necessary quality information to the quality management terminal according to the judgment of the quality information judgment means. The quality estimation system according to claim 4, wherein
The quality estimation means of the quality control terminal is:
Deterioration determining means for identifying a quality deterioration position and a deterioration propagation position in the content based on the stored content information and the quality information;
A loss parameter calculating means for calculating a loss parameter indicating a degree to which the quality deterioration affects the quality of the content based on the stored content information, the quality deterioration position and the deterioration propagation position;
Transmission quality estimation means for estimating the transmission quality of the content from the stored content information;
Based on the transmission quality and the loss parameter, the quality of the content in the user terminal that transmitted the quality information is estimated, and for the user terminal that does not transmit the quality information, the transmission quality is set as the content quality in the user terminal. A quality estimation system including reception quality estimation means. The user terminal in a quality estimation system that estimates the quality of content in a user terminal at a quality management terminal on the content transmission side,
Analysis means for obtaining quality information necessary for quality estimation by the quality management terminal when content quality degradation occurs between the transmission side and the own device;
A user terminal comprising: quality information feedback means for transmitting the quality information to the quality management terminal via a network. The quality management terminal in a quality estimation system that estimates the quality of content in a user terminal at a quality management terminal on the content transmission side,
Storage means for storing content information transmitted from the transmission side to the user terminal via the network;
Based on the stored content information and the quality information transmitted from the user terminal when the quality degradation of the content occurs between the transmission side and the user terminal, the user terminal that transmitted the quality information A user terminal that estimates the quality of content and does not transmit the quality information includes a quality estimation unit that estimates the quality of content in the user terminal that does not transmit the quality information based on the stored content information. A quality control terminal characterized by that. A user terminal program for operating a computer as the user terminal in a quality estimation system for estimating the quality of content in a user terminal at a quality management terminal on the content transmission side,
An analysis procedure for obtaining quality information necessary for quality estimation by the quality control terminal when quality degradation of content occurs between the transmission side and the own device;
A user terminal program that causes a computer to execute a quality information feedback procedure for transmitting the quality information to the quality management terminal via a network. A quality management terminal program for operating a computer as the quality management terminal in a quality estimation system for estimating the quality of content in a user terminal at a quality management terminal on the content transmission side,
A storage procedure for storing content information transmitted from the transmission side to the user terminal via the network;
Based on the stored content information and the quality information transmitted from the user terminal when the quality degradation of the content occurs between the transmission side and the user terminal, the user terminal that transmitted the quality information For a user terminal that estimates the quality of content and does not transmit the quality information, based on the stored content information, a quality estimation procedure for estimating the quality of content in the user terminal that does not transmit the quality information, A quality control terminal program which is executed by a computer.

Images