TWI235565B - Codec aware adaptive playout method and playout device - Google Patents

Abstract

A codec aware adaptive playout method estimates playout delays for a current packet based on a loss mean opinion score (LMOS), a delay mean opinion score (DMOS), and a mean opinion score (MMOS) of packets with reference to the codec used in voice over Internet protocol (VoIP), streaming audio, and streaming video transmissions. The method selects an estimated playout delay having an optimum MMOS, or playout quality, from the plurality of estimated playout delays, and delays the playout of the current packet by the selected estimated playout delay. A codec aware adaptive playout device includes a playout controller for controlling playout of packets in a playout buffer. The playout controller references network delay estimates provided by a network delay estimator, and codec information such as the LMOS, DM OS, and MMOS provided by a codec detector to determine playout delays for the packets of the playout buffer.

Description

"£ # 录 百 123 Face 5: No. 9] Rev. 136579 Rev. V. Description of the Invention (1) The technical field to which the invention belongs The invention relates to the transmission of network data, especially to the optimization of packet playback delay Method, wherein the packet is transmitted in a network, and the network will generate a solution delay when transmitting the packet. The popularity of the prior art Internet and the development of technology have made real-time sound and video transmission possible . Almost Internet users can hear streaming sound or watch streaming images. Recently, other communication methods through the Internet have been developed maturely, such as the Internet Voice Protocol (V ο IP). Use Software that can withstand the Internet's voice protocols has become a popular and economical way for users to communicate with each other through the Internet and other computer networks. In a streaming mode, such as the Internet Voice Protocol The biggest obstacle in the implementation of packet communication is the change of network delay, which is the so-called delay disturbance (ji 11 er). Delay disturbance can be based on a broadcast The delay is greatly reduced by the delayed playback of the packet. When the network delay is not fixed, reducing the number of delay disturbances of a transmission requires a reasonable measurement of the network delay and a correct judgment of the playback delay. However, the playback delay cannot be too long because The purpose of the transmission is to achieve the effect of real-time transmission, and the excessively long playback delay violates this item. 1235565 t No. 91136579 year, month, and day five. Description of the invention (2) Figure 1 is a sound data 20 Schematic diagram of data packet to be transmitted across a network 10. Data 20 contains audible segments 2 a, 2 0c, 2 0 e, which have identifiable audio messages, and data 20 contains a still segment. 2 0 b and 2 0 d, which have indistinguishable voice messages. A transmitter 12, which can be a personal computer or other device, sends packets P 1-P 1 5 in an orderly manner at fixed time intervals, but because Network delay will delay the transmission of packets P15, among which certain packets arriving at a receiver 14 must be further delayed by different amounts of time to form a cohesive sound data 22, where the receiver 14 can be a similar personal computer or device. The audio data 22 includes audible sections 22a, 22c, 22e and silent sections 22b, 22d, which correspond to the required sections. Segments 20a-20e in the transmitted data 20. The packet P1 is sent out by the transmitter 12 at a given time. The packet P1 may be delayed by the network 10 for any reason, as shown in Figure 1. The shaded square shows this delay and other further delay factors. Packet P 1 will be further delayed by receiver 14, so that this packet P 1 can be played continuously with packet P 2 which has been delayed by network 10. If the packet P 1 is not further delayed by the receiver 1 4, the packets P 1 and P 2 will not be played continuously, and an audio interruption will occur in the data 2 2. This hearing interruption in the data 22 is heard by the user at the receiver 14 and results in poor sound quality in the playback of the data 22. The packets P 2-P 5 are all delayed by the network 10 at the same time, and the packets P2-P5 are not necessarily furthered by the receiver 14

r,., -wV— »· —-'·,-1235565 ^-^ " -MU. _ 91136579.… .1—say the delay of the fifth, description of the invention (3). of —, where the receiver i Series 4 are played in the proper order according to the appropriate schedule. ^ However, packet P7 arrived earlier than packet P6. Until packet p receives 刖, receiver 14 must delay the playback of packet p7. This delay 22c is not suitable to be shaped on the stop zone slave 22b so that the audible section 22c is not called ~~~. Due to network delay and packet and P9 = and packet ρι〇 and m arrive at the same time. As for the PU, the playback is also delayed, and the delay of the material 22 occurs. D1: The same step of Γ suffers a similar row i,…, P13f / 14 and packets P6 and M arrive at the receiver in the usual order .: Messing. Packets P12 and P15 are being simplified as they are supposed to be simplified. The time of the packet P1-Pl5. In fact, the integer product gives the delay to the receiver and delay perturbation in time ^. During the transmission process, when the network delay bit form, the transmission is too large and the length of the packet The number ~ packet number must be delayed. GU:: 巴 ί: Tu Zheng received data 2 2 delay three sections, 14 two £ ί, including one, Tongzheng, F3., Playback delay. If the receiving delay f and the extra packets attached by the receiving burial I4 will have a delay of adding the ϊ 上 on some out of order, some delays. The conventional technology has already shown: Month: and other packets are completely delayed. The square of time *., How did Xi Xi estimate that it should be received 1 14e Delayed on the estimated playback delay μ cold, a basic and effective but controversial

Page 9

The modified method is the Mean Delay Variation Method (MDV), which is described in R. Ramjee, J. Kurose, D. Towsley, and 11.

Schu 1 zrinne n adaptive Playout Mechanisms for Packetized Audio Applications in Wide-area Networks " has been described, and is hereby proposed as a prior art of the present invention. The average delay variation method is further detailed in Marco Roccetti, Vittorio Ghini, Giovanni Pau, Paola Salomoni, and Maria Elena Bonfigli, Design and Experimental Evaluation of an Adaptive Del ay / control Mechanism for Packet ized Audi o for use over the Internets, which is also the prior art of the present invention. In short, the average delay variation number method is to estimate the playback delay by combining the average network delay variation number with a smoothing coefficient. This simple dynamic method provides important and key improvements over other non-dynamic methods. Other methods of estimating playback delay are described in the real-time transport protocol. n

Schulzrinne, S. Casner ^ R. Frederick ^ and V ·

Jacobson's " R.TP: A Transport Protocol for

"Real-Time Appl i cat ions" describes in detail the standard specification of the instant transmission protocol, which is also the prior art of the present invention. The real-time transmission protocol method used to estimate the delay is an average delay variation with a fixed smoothing factor Number method. Although simpler than the average delay variation method, the same-day transmission protocol can only provide a rough estimate of the network delay.

1255565 sb V. Description of the invention (5) 91136579 The other conventional techniques used to estimate the playback delay include an extremely long delay (S pike) test method, which is described in n A daptive P 1 ay. ut Mechanisms for packetized audio applications in wide-area networks In Periods'1 (http://citeseer.nj.nec.com/pinto99algorithm.html), although the extremely long delay detection method and the correlation time difference detection method increase the difficulty of the operation, they are not significantly superior. Based on the average delay variation method. Finally, the conventional technique also provides a normalized least mean square method, which is described in '丨 An Adaptive Predictor for Media Playout buffering 丨' by Phillip DeLeon and Cor mac J. Sr ee nan, (http: / /citeseer.nj.nec.com/deleon99adaptive.html). The normalized least-mean method is a complex calculation method that does not provide significant improvement. In addition, in the conventional technology, there are many patents concerning the playback of digital information and the monitoring of playback quality. For example, in US Patent 5,815,634, Daum et al. Have proposed stream synchronization

Page 11 1235565 .j No. 91136579 On the day of your fifth, the invention description (6) _ (stream synchronizat ion) method, applied to the MpE_ recording and playback function. In US Patent 6 '259, 677, Jain proposed an instant receiver and a corresponding method for receiving and playing instant packet data. The patents of the above two conventional technologies are the prior art of the present invention. In addition,

Schulman in US Patent 5,600,632 proposed a method for monitoring quality in a network using a synchronous network analyzer on packet delay, and 3 £ 『3% & 1 et al. Also in 118? &Amp; 161 ^ 6,072,80 9 provides the co-modulation prediction method to maintain and update the statistical trend of network delay. The patents of the above two conventional technologies also serve as the prior art of the present invention. The prior art methods described above all have a common feature ', that is, they only optimize the playback delay from network statistics. The prior art methods did not properly consider using codec technology to compress playback data to avoid distorted playback quality. SUMMARY OF THE INVENTION Therefore, the main object of the present invention is to provide a perceptual dynamic playback method using codec technology to optimize the playback delay of packet communication to solve the above-mentioned conventional techniques. In short, according to the scope of patent application of the present invention, it is based on a wearable comprehensive opinion score (L Μ 0 S) ', a delayed comprehensive opinion score (D Μ 0 S), and an average comprehensive opinion score (M Μ 0 S ) And refer to the codec technology to estimate the playback delay of the current packet. The present invention

1235565 Amends case number 91136579 7 " .......:: " .....-........... —… I yj 5. Description of Invention (7) = ^, Select the package with the largest average overall opinion score among the delays, and delay the current closed-out device based on the selected estimated playback delay to compile the broadcast to calculate the broadcast to the controller. According to this setting, the broadcast delay is estimated at the receiving decoder, and the estimated delay of the playback control is compressed. The invented playback device estimator and temporary storage technology are used to control the packetizer. The package of the patent application has been delayed for the optimal range, including a playback delay, and a packet. The message determines the playback network delay decoder, and then decodes the playback control packet buffer and the detector's transmission code. After the packet is packaged, the decoder is played by the decoder. The network sends out pre-detection decoders, including data transmission through a medium, broadcasters, broadcasters, estimated delays, estimated delays, measurement and editing technology, and data release control. The broadcast network is used to estimate the network decoding information. A playback controller, buffer delay and reference technology are used to delay the technology. The application point is ‘playback’ is based on the loss points. The wearable comprehensive person's average score and the average comprehensive opinion score are equal to the average person's sound, and the comprehensive opinion is delayed. The comprehensive opinion evaluation is delayed for the judgment of the quality of the playback. Quality, while at the same time and remotely selecting a playback delay to promote minimal. Search ’additional playback delay can also be minimized

1¾ Lion Case No. 91136579 Rev. V. Description of the Invention (8) The winter advantage of the patent application scope of the present invention is that the playback delay is a comparison value based on the average comprehensive opinion score in each estimated playback delay. It is selected from the estimated playback delay, so that the best playback quality can be obtained. Embodiments The perceptual dynamic playback method using the codec technology of the present invention can be combined with a playback device as the best interpretation and implementation. The marks in all equations and programs are exactly the same. Please refer to Figure 2. FIG. 2 is a system architecture of a playback device 30 of the present invention. The playback device 30 includes a receiver 32 for receiving packets from the network 10, and the playback device 30 also includes a playback buffer 34 for receiving packets from the receiver 32 and for receiving the packets from the receiver 32. The data of the packet is output to a media output device 36. The playback buffer 34 can absorb the network delay so that the packet can be played on the media output device 36 very smoothly and continuously. The media output device 36 may be a typical media output device, such as an Internet voice protocol player, a speaker, a wireless telephone display, or other devices. The playback device 30 further includes a network delay estimator 38 to estimate the network delay of the network 10, a codec detector 40 to detect the codec technology to the packet to be compressed, and A playback controller 44 is used to control the playback buffer 34. The playback controller 4 2 is based on the network delay estimated by the network delay estimator 3 8 and the codec technology determined by the codec detector 4 0 12355) 65 Case No. 91136579 i Month j Amended V. Description of the invention (9) Technical information to set the delay of packets received in the playback buffer 34. When the playback delay of a packet expires, the playback buffer 34 sends the packet to the media output device 36 for playback. The network delay estimator 38 and the playback controller 4 2 estimate the network delay and the average network delay variation number according to the following equation: =-Ri-χ)-< si-^-,) 1 MDA = FX + ( 1-F) x D4 (Equation 1) V, = MD4-D, | MV. = F x Μν4.χ + (1-F) x V4 is the delay number for the DR si network Jian Shi-r Shi v B 0 The device received and transmitted the sequel as "•", and the packet under the standard is marked as ".": The packet is delayed before the packet is delayed, and the delay is delayed. • The heterogeneous variable system is a delayed slipping road and the network is a number Network delay. The network delay estimator 3 8 then delivers the estimated network delay of the current packet

Page 15 Lian I No. 9Π36579 Rev. V. Description of the invention (10) Late to playback controller 4 2. The playback controller 4 2 then uses the average network delay to calculate the average network delay variation, smoothing factor, and network delay variation of the current packet. The playback controller 4 2 further calculates the playback delay of the current packet according to the following procedure: EPDpre = PD,.,

MMOSi.i (Eq. 2) Reward coffee = PDw EPDdec = PD,., EPDstft = ΜΥ ±: where EPD is the estimated playback delay, and EPDpre is the playback delay of one of the previous packets, and EPDine is increased by a certain amount (step size) of the previous packet playback delay, EPD dec is the playback delay of the previous packet reduced by a certain amount, and EPD sta is a playback delay calculated based on the codec technical information; PD is a playback delay; U a and U b is quantitative; SF is a playback permutation coefficient; LMOS is a loss comprehensive opinion score; MMOS is an average comprehensive opinion score; the playback controller 4 2 calculates a plurality of estimated playback delay EPDs, one of which will be selected to delay the playback of the current packet . The estimated playback delays EPDpre, EPD inc5, and EPD dec are simply determined based on the actual playback delay of the previous packet, and their sizes are the same as the previous packet, increasing or decreasing by a certain amount. In addition, phase

Page 16

Mi # Year and Month Revision—J 一 JJ _ 号 91136579-～ 产 -..- V. Description of the Invention (11) A similar method may be used to determine more estimated playback delays to include arbitrary formula numbers in Equation 2. . On the other hand, EPDsta's decision is based on specific information in the codec technology, including the wearout comprehensive opinion score and the average comprehensive opinion score. Given the corresponding packet loss rate and de-delaying the specific loss comprehensive opinion score in the codec technology, the specific delay comprehensive opinion score (DMOS) in the codec technology can be determined. The average comprehensive opinion score of the previous packet is a nasal average of the attrition comprehensive opinion score and the delayed comprehensive opinion score. Generally speaking, the codec technology itself is a complete solution; f; the consensus score ’is the delayed comprehensive opinion score, and the average comprehensive opinion score, as the same message is specific to the codec technology. For example, some codec-to-code technologies are more sensitive to packet loss than other codec technologies. Similarly, some codec technologies are particularly sensitive to packet delay. Each codec technology has different sensitivities to packet loss or packet delay due to different mechanisms and ways of compressing data. However, the wearout comprehensive opinion score, delayed comprehensive opinion score, and average comprehensive opinion score values can be taken from any given codec technology with reference to the packet wearout rate and latency. In addition, the average comprehensive opinion score is a good objective measure of overall playback quality. Please refer to Equation 2. The estimated playback delay EPDsta is calculated by the playback controller 42 based on the ratio of the wearout comprehensive opinion score to the average comprehensive opinion score in the previous packet. Or other comprehensive comments on wear and tear

Page 17 丨 Yayan r " Case number • ........-.......— · — V, ........ ·, 'V. Description of the invention (12) The delay synthesis can be used. Only the ratio of the ratings is relatively high. In terms of quality, the consensus score is higher than the EPD sta. The comprehensive opinion to ensure the playback delay loss is the current evaluation of the packet when the packet loss is the target. In this way, EPD sta achieves great value. 91136579 opinion score ’is, compared with the loss ratio, the rest is lower than when the packet consumption is lower. In other words, when the score is increased and the playback delay is low, the playback control is modified by the average comprehensive rating or the average comprehensive opinion rating ratio. The comprehensive opinion rating and average comprehensive opinion rate cannot significantly improve the playback quality . Caibei's comprehensive opinion score is high and delayed. The estimated playback delay of the current packet ^ When the packet loss is high, the loss will be reduced. Similarly, when the consumption J ~ consensus score is high, 诘 small is low. In other words, ‘Evening playback delay becomes the goal to be achieved ^ Determines the estimated playback delay " shoulder of the measured playback quality

The “playback delay” of ^ 疋 ^ 9, which is the current packet sowing field calculation, which one. Γ must compare each estimated play 疋 / appropriate, in order to perform this step, the play control, the average synthesis of each lag The opinion scoring controller 42 needs to use the following method to calculate the playback delay: ° 丨 Different total delay: TD. CD + + EPD .. -1., Where TD is the total delay; 夂 is 3 estimates Playback delay (EPD) of a codec delay; (Eq. 3) indexes

Revised 91136579 in December 1235565 V. Description of the invention (13) Play controller 4 2 Calculate multiple total delays for the current packet, or for each estimated playback delay as determined in Equation 2 EPDpre, EPD inc, EPD dec and EPD st | f calculates a total delay. Each total delay includes a codec delay, the network delay of the current packet from Equation 2, and the estimated playback delay. The codec delay represents the time required during the codec process. The playback controller 4 2 also determines a moving average packet loss rate for each estimated playback delay according to the following procedure: F EPDi (j < \ PLC, =

ELSE PLQ, = PLRj PLRi-w + (1-L> χ PLCy (Eq. 4) where PLC is the packet loss counter; PLR is the packet loss rate; L is the loss smoothing factor; when the estimated playback delay is considered less At the time of the current packet delay variation of the packet, the packet loss counter is set to 1, otherwise, the packet loss counter is set to 0. Then, referring to the packet loss rate of the previous packet, the playback controller 4 2 is estimated Playback delay calculates the packet loss rate.

Page 19 1235565 II '' Case No. 91136579 ......-'------- --------..-V. Description of the invention The playback controller 42 is the estimated playback delay in the current A, and the packet loss rate is determined by Equation 3, >, 匕, and each in Equation 2: Play and determine by L and then estimate the current packet # y said, test the codec technology j: j, select the flat V with the maximum value; the average of the two averages of each eight is to meet the Delayed playback, sweating. The items are summarized as follows: (Eq. 5) ^ 〇 £: 1,3 == MMOS (Τϋ ^, Ρ1ΗΜ) where 〇χ = OPT _ MOS (MMOSiΕΡ〇Α.) F " Λ " /? Λ ^ ^ I ^. In fact, encoding and decoding binary detection ~ this, o type 4 depends on the encoder and decoder technology information about the codec technology = ^ ^ should play the controller ^ a function; more playback controller 4 2 can implement pt , M〇s () is a function, i see the playback delay of the score, /, b returns the value corresponding to the maximum average comprehensive meaning

Pi). 9, 1 is the playback delay of the current packet; playing the μ playback controller 42 is so effective in determining that _ delay can give the most accurate level: ^ ai, 估计 an estimated broadcast is best for you The average, average, and combined thinking scores are expected to balance the broadcast, and the playback controller 42 delays the broadcast of the σ 4 ζ liver mesh packet.

Page 20 1235565, _ Case No. 91136579 Amendment _ ^ and V-; 'v .......... — — — — — — —............ ...................... V. Invention Description # 5) Late setting to this value. In practical applications, the playback device 30 and its components can be completed using traditional electronic circuits, integrated circuits, and related software programs. The logic programs of the playback controller 42, the network delay estimator 38, and other parts of the playback device 30 can be fine-tuned and compatible with related communication equipment. These related communication devices include Internet voice protocol players, streaming video phones, streaming sound devices, and other communication devices used on the Internet and wireless networks. The previously described process of using the playback device 30 to optimize the playback delay of a packet can be summarized into the flowchart in FIG. 3, which includes the following steps: Step 100: Start media playback; Step 102: Receiver 3 2 Packets to be played by the media output device 36 are continuously received and delivered to the playback buffer 34. The playback controller 42 recognizes one of these packets as the current packet to be played, and the other packets will be treated as previous packets and played according to a sorting method; Step 104: Network Delay Estimator '3 8 estimates network delay. The playback controller 4 2 further calculates the average network delay variation. The program conforms to the implementation procedure of formula 1; Step 106: Playback controller 4 2 Calculates the currently estimated number of playback delays of the packet N. The procedure conforms to the implementation procedure of formula 2;

123 Office 5 f ^ 91136579 4 3 a 1 ^ j £ V. Description of the invention (16) Step 1 〇 8: Playback controller 4 2 By following the operation procedures of Equations 3 and 4, it is to play in the plural N estimated Each playback delay in the delay calculates the packet loss rate and the total delay; Step 1 10: For any of the playback delays in the plurality of N estimated playback delays, the playback controller 42 refers to the codec detector The coded Is technical information provided by 40 is used to determine the current comprehensive consumption score and delayed comprehensive opinion score of the current packet. When this procedure is to be executed to process the next packet, it is necessary to calculate the estimated playback delay EPD st in Equation 2 based on the current comprehensive loss score and delayed comprehensive opinion score of the current packet. Step 1 1 2: Refer to the procedure of Equation 5, The playback controller 42 calculates an average comprehensive opinion score for the current packet for each of the N estimated playback delays. Alternatively, each average comprehensive opinion score can be regarded as an arithmetic average of the wearable comprehensive opinion score and the delayed comprehensive opinion score in the current packet; Step 11 4: The playback controller 4 2 directly compares the plural N average comprehensive opinion scores to determine which A most appropriate estimate of playback delay. The playback controller 4 2 will select the estimated playback delay that meets the highest average comprehensive opinion score as the playback delay of the current packet; Step 1 16: The playback controller 4 2 will control the playback buffer 34 to wait for the selected playback delay. Then deliver the current packet to the media output device for playback; Step 118: The playback controller 4 2 and the playback buffer 34 determine whether the playback is complete, or there are more packets waiting to be played. If playback is complete, proceed to step 1 2 0. If playback is not complete, return to step 102;

Page 22 I2355] 65 V. Description of the invention (17) Step 1 2 0: End. Media playback is complete. In practical applications, the above program will be executed continuously, close to instant playback under a packet with a large number of media output streams. Please note that the components in the communication device 30 can perform the same procedure as the above steps and must coordinate with the playback device described previously. However, according to the present invention, the above-mentioned program can be executed with different changes in the above-mentioned and even other elements, and is not limited to this example. In general, many parameters, such as the smoothing factor F, the quantitative U a and U b, the playback permutation factor SF, and the wear smoothing factor L can be set to achieve the maximum value of the average comprehensive opinion score and related playback quality. In addition, these parameters can be applied to a variety of different codec technologies, and further become user-adjustable designs. Compared to conventional techniques, the method of the present invention uses packet codec technical information such as attributive comprehensive opinion score, delayed comprehensive opinion score, and average comprehensive opinion score, together with network delay statistics such as network delay and delay disturbance , Select the most appropriate playback delay for the current packet from a plurality of estimated playback delays. According to the method of the present invention, since additional and unnecessary playback delays are minimized, higher playback quality can be achieved compared to the prior art. The above are only preferred embodiments of the present invention.

Page 23 12355 ^ 5:. Dagger cover 骞 91136571 ^ V. Description of the invention (18) All equivalent changes and modifications made to the scope of the patent shall be covered by the patent of the present invention.

Brief description of the diagram Brief description of the diagram 91136579 — year: month day correction Figure 1 is a schematic diagram of transmitting sound data in a packet across a network. FIG. 2 is a block diagram of a playback device according to the present invention. FIG. 3 is a flowchart of packet playback in the present invention. Symbol description of the icon:

10 network 12 transmitters 14 to 32 receivers 20 audio data 30 playback devices 34 playback buffers 36 media fm, output devices 38 network delay estimators 40 codec detection f 42 playback controllers page 25

Claims (1)

tmrnmi 义 号 —91136579 Six v city please. Li day correction 1. A method of optimizing the playout delay of a packet, the method includes the following steps: (aj according to a codec technology , Determine a loss average opinion score of a previous packet #loss (loss mean opinion score);, (b) calculate an estimated playback delay of one m packet based on the previous loss comprehensive opinion score, the estimated playback delay is Also calculated based on the average network delay variation of the packet and the playback permutation coefficient; and (c) delay the playback of the current packet based on the far-estimated playback delay. 2. The method as described in item 1 of the scope of patent application, further comprising the following steps: (d) Calculate the average network delay variation number of the current packet. ΪΓ " Broadcast Ϊ permutation coefficient (Play〇Ut SCaling'hctQr * h ( ) A plurality of other estimated playback delays that scratch the packet, (S) calculate the mean estimated opini〇n Sc〇re for each of the estimated playback delays in the plurality of estimated playback delays; and 2Before (e), * From among the plurality of estimated playback delays, select one of the estimated playback delays having the largest average comprehensive opinion score. The method described in item 2 of the above calculation, wherein the step (f) of the other estimated playback delays out of ten t include a playback delay of the previous packet; 123556,; M 91136579 #-J a 6. The patent application scope IT is increased by a certain amount (step size) of the playback delay of the previous packet; and a certain amount of playback delay of the previous packet. 4. The method as described in item 2 of the scope of patent application, wherein the average comprehensive opinion score is calculated based on the delay of the decompressor, the delay of the network, the estimated playback delay, and the loss rate of a packet. 5. The method as described in item 2 of the scope of patent application, wherein the average comprehensive opinion score is a measurement of playback quality, and a high average comprehensive opinion score corresponds to a high playback quality. 6. The method as described in item 1 of the scope of the patent application, wherein the packet contains audio or video information. 7. The method as described in item 1 of the scope of the patent application, wherein the packet playback can be applied to Internet sound protocol (voice over Internet p ro t o c ο 1), streaming sound, or streaming video. 8. A playback device that can play the data in an optimized delayed packet. The packet contains data, where the data is played in a stream and compressed according to a codec technology. The network is Teleport ; ^ 5 • 0 Case No. 91136579… ............-...... ............. 6. When applying for a patent scope, a net will be generated A playback buffer, a playback controller, to determine the delay of the packet to control the playback buffer, a network delay estimate, and sending the estimated network a codec to detect the compressed packet, and then put the control Device. Year, month and month, correct the road delay. The playback device includes: · It is used to receive and temporarily store the packet. · The estimated network delay and the codec put the delay, and according to the selected device. Delayed to the playback controller; and used to detect the codec technology and transmit the codec technology information technology delay information to the broadcast 9. If a packet is received a media I 0 · Such as the controller technical opinion comment II · If the controller comprehensively asks for the playback device described in item 2 of the 2 range, which: I let the playback buffer be placed by the receiver from the output garment 'to allow the The playback buffer outputs the first private patent in the scope of the patent application, + · β ^ refers to the playback device described by the general manager, which is one of the points provided by > , As well as the average & person ^ sigma tolerance score, 卞 9 'consensus score. The eighth place of the scope of patent application selects a playback delay from a plurality of estimated playback delays, and one of the estimated playback delays. < m has > includes: road reception 7 the playback decoder is late integrated r the playback is large average 1 ^ 35565 case number 91136571 order month and day amended 6. patent application scope 1 2 as described in item 11 of the patent application scope A playback device, wherein the estimated playback delay includes: a playback delay of the previous packet; a playback delay of the previous packet being increased by a certain amount; a playback delay of the previous packet being reduced by a certain amount; and a The playback delay is determined based on the comprehensive opinion score of the previous packet, an average network delay variation number of the current packet, and a playback ranking coefficient. 1 3. The playback device as described in item 11 of the scope of patent application, wherein the estimated playback delay is based on a comprehensive opinion score of the previous packet, an average network delay variation number of the current packet, and a playback arrangement Determined by a coefficient, wherein the playback ranking coefficient is further determined based on an average comprehensive opinion score of the previous packet. 1 4. The playback device as described in item 8 of the scope of patent application, wherein the playback controller refers to a codec delay, the network delay, the estimated playback delay, and a packet loss rate for each preview. The estimated playback delay determines the average overall opinion score for the current packet. 15. The playback device as described in item 11 of the scope of patent application, wherein the network can be a computer network or a radio transmission network connected to a wireless telephone. Page_12 1235565 Case No. 9] Amendment date of 136579 6 、 Scope of patent application 1 6. The playback device described in item 9 of the scope of patent application, wherein the media output device can be an Internet sound protocol player , Streaming sound player, or streaming video player. Page 30