WO2022126322A1

WO2022126322A1 - Method for generating evaluation information and related device

Info

Publication number: WO2022126322A1
Application number: PCT/CN2020/136149
Authority: WO
Inventors: 曹佑龙; 廖树日; 窦圣跃; 陈二凯
Original assignee: 华为技术有限公司
Priority date: 2020-12-14
Filing date: 2020-12-14
Publication date: 2022-06-23
Also published as: CN116368804A

Abstract

Embodiments of the present application relate to the technical field of XR, and to a method for generating evaluation information and a related device. The method is applied to a network device or a terminal, and comprises: transmitting multiple data units; obtaining evaluation parameters according to corresponding positions of an error data unit in the multiple data units; obtaining evaluation information according to the evaluation parameters; and then a network device communicating with a terminal according to the evaluation information. The evaluation parameters can represent the degree of influence of the type of an error video frame on user experience, and therefore, the evaluation information can reflect the influence of different types of video frame errors on the user experience. Hence, by means of this implementation mode, the user experience can be accurately evaluated, and thus a transmission policy can be precisely adjusted, and the communication performance is optimized.

Description

Evaluation information generation method and related equipment

technical field

The embodiments of the present application relate to the field of communication technologies, and in particular, to a user experience evaluation method and related equipment in the field of extended reality (XR).

Background technique

Extended reality (XR) technology is a general term for technologies such as virtual reality (VR), augmented reality (AR) and mixed reality (MR). XR technology refers to a technology that provides users with an immersive sensory experience by building a real and virtual human-computer interaction environment.

In the field of XR technology, the quality of user experience is usually measured by the packet error rate and delay of video data packets. In actual implementation, different types of video frames have different effects on the video presentation effect. Based on this, the user's sensory experience cannot be accurately reflected by the packet error rate and delay of the video data packets.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a communication method and related equipment to solve the problem that the user's sensory experience cannot be accurately reflected through the packet error rate and time delay of video data packets.

In a first aspect, an embodiment of the present application provides a communication method. The method may be performed by a network device, or may be performed by a component of the network device (eg, a chip, a system on a chip, or a processor, etc.). The method includes: sending a plurality of data units to a terminal; obtaining evaluation parameters according to the corresponding positions of the erroneous data units in the plurality of data units; obtaining evaluation information according to the evaluation parameters; and communicating with the terminal according to the evaluation information.

Wherein, the evaluation parameter is used to characterize the degree of influence of the location of the wrong data unit in the multiple data units on the user experience. The position of the erroneous data unit in a plurality of data units indicates the information of the erroneous video frame, and the information of the erroneous video frame includes the position of the erroneous video frame, the type of the erroneous video frame and the number of the erroneous video frame, so the evaluation parameter characterizes the erroneous video frame The degree to which the type and number of frames affect the user experience. Then, the evaluation information obtained according to the evaluation parameters can reflect the influence of the type and quantity of erroneous video frames on the user experience. It can be seen that with this implementation, the influence of the type and quantity of erroneous video frames on the user experience can be obtained, so that the user experience can be more accurately evaluated, so that the network device can more accurately adjust the transmission strategy according to the evaluation information, and optimize the Communication performance with the terminal.

In a possible implementation manner, the data unit is implemented as a data packet or a data frame, and the data packet includes an internet protocol (IP) packet or a packet data convergence protocol (packet data convergence protocol, PDCP) packet.

Wherein, when the method is performed by a network device or components of the network device, the network device and the components of the network device cannot obtain the positions of different types of video frames, and the positions of the data packets are associated with the positions of different types of video frames, so, With this implementation, the network device or components of the network device can infer the locations of different types of video frames according to the locations of the data packets, and further, the network device or components of the network device can determine the type of erroneous video frames.

In a possible implementation manner, the corresponding position of the erroneous data unit in the plurality of data units corresponds to at least one error sample, and the error sample indicates the position of the erroneous data unit in the first number of data units, and the first number is the same as the plurality of error samples. The number of data units is matched; obtaining the evaluation parameter according to the corresponding position of the erroneous data unit in the plurality of data units includes: obtaining the evaluation parameter according to at least one error sample.

In a possible implementation manner, the error samples are divided into at least two ranges according to the packet error rate (PER), and at least one error sample corresponding to the corresponding position of the error data unit in the plurality of data units corresponds to the The PER range corresponding to the wrong data unit.

In this implementation manner, the error samples are divided into at least two ranges, which can better maintain the error samples. Further, the evaluation parameters are obtained according to at least one error sample corresponding to the range including the related PER of the error data unit, which can reduce the complexity of obtaining the evaluation parameters.

In a possible implementation manner, each error sample in the at least one error sample corresponds to a reference evaluation parameter, and the reference evaluation parameter is related to the degree of influence of the error sample corresponding to the reference evaluation parameter on the user experience; the evaluation parameter is obtained according to the at least one error sample. , including: obtaining evaluation parameters according to all or part of the reference evaluation parameters corresponding to at least one error sample.

According to the predefined or pre-configured at least one error sample, each error sample corresponds to a reference evaluation parameter, and the reference evaluation parameter is used to indicate that the influence degree of the error sample corresponding to the reference evaluation parameter on the user experience is related. Further, the evaluation parameters are obtained, for example, according to all or part of the reference evaluation parameters corresponding to at least one error sample. With this implementation, the pre-defined or pre-configured correspondence between error samples and reference evaluation parameters provides a parameter basis for obtaining evaluation information according to the position of the erroneous data unit in the transmitted data unit.

In a possible implementation manner, obtaining the evaluation parameters according to all or part of the reference evaluation parameters corresponding to the at least one error sample includes: obtaining the corresponding position of each error sample in the at least one error sample and the erroneous data unit in multiple data units. The correlation coefficient of ; obtain the evaluation parameters according to the correlation coefficient and all or part of the reference evaluation parameters.

In one possible implementation, by

Or all or part of the reference evaluation parameters are weighted to obtain the evaluation parameter f, where x refers to the total number of reference evaluation parameters, EI _i refers to the ith reference evaluation parameter in the x reference evaluation parameters, and v1 refers to The binary vector of the corresponding position of the erroneous data unit in the multiple data units, Coef(v1, error sample _i ) refers to the correlation coefficient between the binary vector of the corresponding position of the erroneous data unit in the multiple data units and the error sample _i . With this implementation, the evaluation parameters obtained according to the reference evaluation parameters are relatively accurate.

In a possible implementation manner, obtaining the correlation coefficient between each error sample in the at least one error sample and the corresponding position of the error data unit in the plurality of data units includes: when the number of the plurality of data units is not the first number When the number of the multiple data units is greater than the first number, the correlation coefficient is obtained according to the position of the erroneous data unit in the first number of data units included in the multiple data units.

If the GoP structure related to multiple data units is variable, at least one error sample whose corresponding number of data units is less than the number of multiple data units and has the smallest difference from the number of multiple data units may be regarded as the corresponding number of multiple data units. The matched error samples are then used to obtain evaluation parameters based on the first number of data units in the plurality of data units. With this implementation, even if the GoP structures related to multiple data units are variable, relatively accurate evaluation information can be obtained based on error samples and reference evaluation parameters.

In a possible implementation manner, some data units in the multiple data units are discarded in sequence from back to front, and the remaining first number of data units are retained. Since an I-frame error has a relatively large impact on user experience, and the first few data units of multiple data units are generally the data units of an I-frame, this implementation method can ensure the first number of data units obtained. The data units of the I frame are included, so that the evaluation parameters obtained according to the obtained first number of data units can more accurately characterize the impact on the user experience.

In a possible implementation manner, the first number is an integer multiple of the number of data units contained in the group of pictures GoP. With this implementation manner, the evaluation information of a relatively large number of data units can be counted in the evaluation information statistical period.

In a possible implementation manner, obtaining the evaluation information according to the evaluation parameters includes: obtaining the evaluation information according to the evaluation parameters and delay information. In this way, the obtained evaluation information can more accurately represent the user's experience.

In a second aspect, an embodiment of the present application provides a communication method, and the method may be executed by a network device or by a component of the network device (for example, a chip, a chip system, or a processor, etc.). The method includes: sending a plurality of data units to a terminal; receiving first feedback information from the terminal; obtaining an evaluation parameter according to the first feedback information, where the evaluation parameter is related to the corresponding position of the erroneous data unit in the plurality of data units; Obtain evaluation information; communicate with the terminal according to the evaluation information.

The position of the erroneous data unit in the plurality of data units indicates the position of the erroneous video frame, so the evaluation parameter represents the degree of influence of the type and quantity of the erroneous video frame on the user experience. Then, the evaluation information obtained according to the evaluation parameters can reflect the influence of the type and number of erroneous video frames on the user experience. It can be seen that with this implementation, the influence of the type and quantity of erroneous video frames on the user experience can be obtained, so that the user experience can be more accurately evaluated, so that the network device can more accurately adjust the transmission strategy according to the evaluation information, and optimize the Communication performance with the terminal.

In a third aspect, an embodiment of the present application provides a communication method, and the method may be executed by a terminal, or may be executed by a component of the terminal (for example, a chip, a chip system, or a processor, etc.). The method includes: receiving multiple data units from a network device; obtaining evaluation parameters according to the corresponding positions of the received erroneous data units in the multiple data units; sending first feedback information to the network device, where the first feedback information is used to indicate the evaluation parameter.

In this example, the terminal obtains the evaluation parameter according to the position corresponding to the received erroneous data unit in the multiple data units. By adopting this implementation manner, the occupation of network equipment resources can be reduced.

In a possible implementation manner, the first indication information from the network device is received, the first indication information is used to indicate at least one error sample, and the error sample indicates the position of the erroneous data unit in the first number of data units, the first number of Matching with the number of the plurality of data units, the corresponding position of the received erroneous data unit in the plurality of data units corresponds to all or part of the error samples in at least one error sample; according to the received erroneous data unit in the plurality of data units Obtaining the evaluation parameters at the corresponding position includes: obtaining the evaluation parameters according to all or part of the error samples.

Wherein, the terminal usually cannot know the matching error samples of the multiple data units. Based on this, in this implementation manner, the terminal obtains at least one error sample matching with multiple data units according to the first indication information, and further obtains the evaluation parameter. In a possible implementation manner, the first indication information indicates matching error samples of the multiple data units and corresponding reference evaluation parameters. With this implementation manner, the terminal obtains the evaluation parameters according to the corresponding positions of the received erroneous data units in the multiple data units, which can reduce the occupation of network equipment resources.

In a fourth aspect, an embodiment of the present application provides a communication method, and the method may be executed by a terminal, or may be executed by a component of the terminal (eg, a chip, a chip system, or a processor, etc.). The method includes: receiving a plurality of data units from a network device; obtaining evaluation parameters according to the corresponding positions of the received erroneous data units in the plurality of data units; obtaining evaluation information according to the evaluation parameters; sending second feedback information to the network device; The second feedback information is used to indicate evaluation information.

In this example, the terminal obtains the evaluation parameter according to the position corresponding to the data unit of the received error in the plurality of data units, and then obtains the evaluation information according to the evaluation parameter. By adopting this implementation manner, the occupation of network equipment resources can be reduced.

In a possible implementation manner, the second indication information from the network device is received, the second indication information is used to indicate at least one error sample, and the error sample indicates the position of the erroneous data unit in the first number of data units, the first number of Matching with the number of the plurality of data units, the corresponding position of the received erroneous data unit in the plurality of data units corresponds to all or part of the error samples in at least one error sample; according to the received erroneous data unit in the plurality of data units Obtaining the evaluation parameters at the corresponding position includes: obtaining the evaluation parameters according to all or part of the error samples.

In a possible implementation manner, the second indication information indicates the matching error samples of the multiple data units, the corresponding reference evaluation parameters, and the algorithm of the evaluation information associated with the corresponding information. With this implementation manner, the terminal obtains the evaluation parameters according to the corresponding positions of the received erroneous data units in the multiple data units, which can reduce the occupation of network equipment resources.

In a fifth aspect, an embodiment of the present application provides a communication device, which can implement the method in the first aspect or any possible implementation manner of the first aspect. The apparatus comprises corresponding units, modules or components for carrying out the above-mentioned methods. The units, modules or components included in the apparatus may be implemented by means of software and/or hardware. The apparatus may be, for example, a network device, or may be a chip, a chip system, or a processor that supports the network device to implement the above method.

In a sixth aspect, an embodiment of the present application provides a communication device, which can implement the method in the second aspect or any possible implementation manner of the second aspect. The apparatus comprises corresponding units, modules or components for carrying out the above-mentioned methods. The units, modules or components included in the apparatus may be implemented by means of software and/or hardware. The apparatus may be, for example, a network device, or may be a chip, a chip system, or a processor that supports the network device to implement the above method.

In a seventh aspect, an embodiment of the present application provides a communication device, which can implement the third aspect or the method in any possible implementation manner of the third aspect. The apparatus comprises corresponding units, modules or components for carrying out the above-mentioned methods. The units, modules or components included in the apparatus may be implemented by means of software and/or hardware. The device may be, for example, a terminal, or may be a chip, a chip system, or a processor that supports the terminal to implement the above method.

In an eighth aspect, an embodiment of the present application provides a communication device, which can implement the method in the fourth aspect or any possible implementation manner of the fourth aspect. The apparatus comprises corresponding units, modules or components for carrying out the above-mentioned methods. The units, modules or components included in the apparatus may be implemented by means of software and/or hardware. The apparatus may be, for example, a terminal, or may be a chip, a chip system, or a processor that supports the terminal to implement the above method.

In a ninth aspect, an embodiment of the present application provides a communication device, comprising: a processor, where the processor is coupled to a memory, the memory is used to store a program or an instruction, and when the program or instruction is executed by the processor, the device executes the first aspect A method in the second aspect, in any possible design of the first aspect, or in any possible design of the second aspect.

In a tenth aspect, an embodiment of the present application provides a communication device, comprising: a processor, where the processor is coupled to a memory, the memory is used to store a program or an instruction, and when the program or instruction is executed by the processor, the device executes the third aspect , the fourth aspect, any possible design of the third aspect, or any possible design of the fourth aspect.

In an eleventh aspect, an embodiment of the present application provides a communication apparatus, where the apparatus is configured to execute the method in the first aspect, the second aspect, any possible design of the first aspect, or any possible design of the second aspect.

In a twelfth aspect, an embodiment of the present application provides a communication device, characterized in that the device is configured to perform the third aspect, the fourth aspect, any possible design of the third aspect, or any possible design of the fourth aspect. method.

A thirteenth aspect, an embodiment of the present application provides a communication device, characterized in that the device includes a device for implementing the first aspect, the second aspect, any possible design of the first aspect, or any possible design of the second aspect method of the module.

In a fourteenth aspect, an embodiment of the present application provides a communication device, characterized in that the device includes a device for implementing the third aspect, the fourth aspect, any possible design of the third aspect, or any possible design of the fourth aspect method of the module.

In a fifteenth aspect, an embodiment of the present application provides a computer program product, the computer program product includes computer program code, and when the computer program code is run on a computer, enables the computer to implement the first aspect, the second aspect, and the third aspect , the fourth aspect, any possible design of the first aspect, any possible design of the second aspect, any possible design of the third aspect, or any possible design of the fourth aspect.

A sixteenth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program or instruction is stored, and when the computer program or instruction is executed, causes the computer to execute the above-mentioned first aspect, second aspect, and third aspect. The method of the third aspect, the fourth aspect, any possible design of the first aspect, any possible design of the second aspect, any possible design of the third aspect, or any possible design of the fourth aspect.

To sum up, in the communication method of the embodiment of the present application, by pre-defining or pre-configuring the reference evaluation parameters corresponding to the erroneous data unit in different locations, the degree of influence of the erroneous data unit on the user experience at different locations is represented. After multiple data units are transmitted, the evaluation parameters corresponding to the positions of the erroneous data units in the multiple data units are obtained according to the reference evaluation parameters, and the evaluation information is obtained according to the evaluation parameters, so that the impact of different types of video frame errors on user experience can be obtained. Influence degree, and then can accurately reflect the user's experience, optimize the communication performance, and improve the user experience.

Description of drawings

FIG. 1A is a schematic diagram of an exemplary network architecture of a communication network 10 provided by an embodiment of the present application;

FIG. 1B is a schematic diagram of an exemplary network architecture of a communication network 101 provided by an embodiment of the present application;

FIG. 1C is a schematic diagram of an exemplary network architecture of a communication network 102 provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of an exemplary scene of the influence of different types of video frames on video quality provided by an embodiment of the present application;

FIG. 3A is an exemplary signaling interaction diagram of the communication method 100 provided by the embodiment of the present application;

FIG. 3B is an exemplary signaling interaction diagram of the communication method 200 provided by the embodiment of the present application;

FIG. 3C is an exemplary signaling interaction diagram of the communication method 300 provided by the embodiment of the present application;

4 is a schematic diagram of an exemplary scenario of a location of an erroneous data unit provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of an exemplary structure of an apparatus 500 provided by an embodiment of the present application;

FIG. 6 is a schematic diagram of an exemplary composition of a terminal 600 provided by an embodiment of the present application;

FIG. 7 is a schematic structural diagram of an apparatus 700 provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.

The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the embodiments of the present application. As used in the description of the embodiments of the present application and the appended claims, the singular expressions "a," "an," "the," "above," "the," and "the" are intended to Plural expressions are also included unless the context clearly dictates otherwise. It should also be understood that although the terms first, second, etc. may be used in the following embodiments to describe a certain class of objects, the objects should not be limited to these terms. For example, the terms first, second, etc. may be used in the following embodiments to describe error samples, but error samples should not be limited to these terms. In the following embodiments, the terms first, second, etc. may be used to describe other types of objects in the same way, and will not be repeated here.

The embodiment of the present application provides a communication method, after transmitting multiple data units, obtaining evaluation parameters according to the corresponding positions of the erroneous data units in the multiple data units, and obtaining evaluation information according to the evaluation parameters. Wherein, the corresponding position of the erroneous data unit in the plurality of data units is related to the type of the erroneous data frame in the plurality of data units, and the influence of the evaluation parameter and the corresponding position of the erroneous data unit in the plurality of data units on the user experience In this way, the evaluation information can reflect the influence of the type of the wrong data frame on the user experience, so that it can accurately reflect the user's sensory experience.

The following introduces application scenarios involved in the embodiments of the present application, related devices used in such application scenarios, and embodiments used for such devices.

The embodiments of the present application are applied to a communication network, and FIG. 1A shows a network architecture of a communication network 10 . The communication network 10 includes: a service device 11 , a network device 12 and a terminal 13 . Among them, the service device 11 is used to maintain the XR data unit. The network device 12 is used to send the data unit maintained by the service device 11 to the terminal 13 . The terminal 13 is used to display the audio and video corresponding to the XR data unit.

The service device 11 involved in the embodiments of the present application may be a device having functions such as video source encoding, decoding, and rendering, and the service device 11 may be implemented as a cloud server, user equipment (user equipment, UE), or the like, for example. The UE may include XR service equipment (including virtual reality (VR) service equipment, augmented reality (AR) service equipment, etc.), mobile phone, tablet computer (Pad), computer with wireless transceiver function, wireless data card , vehicle equipment, etc.

The network device 12 involved in the embodiments of the present application may include a radio access network (radio access network, RAN) device, an access point (access point, AP) device, a set-top box, or the like. The radio access network equipment may also be referred to as a base station, and the radio access network equipment is a device deployed in the radio access network to provide wireless communication functions for terminals, including but not limited to: various forms of Acer station, micro base station (also known as small station), relay station, transmission reception point (TRP), evolved node B (evolved node B, eNB), 5G new radio interface (the 5th-generation new radio, 5G NR) ), 6G (the 6th-generation) wireless access network equipment, etc. AP devices may include routers and the like. In systems using different access technologies, the names of access devices with similar communication functions may be different. For the convenience of description only, in all the embodiments of this application, the above-mentioned apparatus for providing a wireless communication function for a terminal is collectively referred to as a network device.

The terminal 13 involved in the embodiments of the present application may also be referred to as a UE or a mobile station (mobile station, MS), etc., and is a device capable of displaying XR audio and video content. The terminals may include various types of mobile phones (mobile phones), tablet computers (Pads), XR terminals (including virtual reality (VR) terminals, augmented reality (AR) terminals, head-mounted display devices, XR glasses, etc.) etc.

By way of example, FIG. 1B and FIG. 1C illustrate two possible architectures of the communication network 10 .

FIG. 1B shows a network architecture of a communication network 101 . The communication network 101 includes a cloud server 1011 , a RAN device 1012 and XR glasses 1013 . The cloud server 1011 may be used to perform encoding on video resources to obtain video data units and the like. The RAN equipment 1012 may be used to obtain data units of video from the cloud server 1011 via a core network (eg, a long term evolution (LTE) core network, a 5G core network, or a 6G core network), and via an air interface (eg, a 6G core network). The air interface of the LTE network, the air interface of 5G or the air interface of 6G) sends the data unit to the XR glasses 1013. The XR glasses 1013 can be used to feed back response information to the base station, where the response information indicates the reception status of the data unit by the XR glasses 1013 . XR glasses 1013 may also be used to decode data units to render XR visuals of the decoded video.

FIG. 1C shows a network architecture of another communication network 102 . The communication network 102 includes a mobile phone 1021 , a router 1022 and a mobile phone 1023 . The mobile phone 1021 can be used to encode the video resource to be projected to obtain the data unit. The router 1022 may be configured to send the data unit encoded by the mobile phone 1021 to the mobile phone 1023 through a wireless fidelity (WiFi) connection. The mobile phone 1023 can be used to decode the data unit sent by the router 1022 to display the decoded screen projection interface. In some embodiments, the video resources maintained in the mobile phone 1021 may be obtained by the mobile phone 1021 from a cloud server.

It can be understood that, FIG. 1B and FIG. 1C are only schematic descriptions, and do not constitute a limitation on the communication network 10 to which the embodiments of the present application are applied. In other embodiments, the RAN device and the XR glasses in the communication network 101 may be connected, for example, through a relay device. The relay device may be, for example, an integrated access and backhaul (integrated access and backhaul, IAB) base station or the like. In other embodiments, the mobile phone 1021 in the communication network 102 may be replaced with other devices, such as XR devices. Similarly, the mobile phone 1023 can also be replaced with other devices, such as a tablet computer and the like.

In some implementation manners, the data units involved in the embodiments of the present application may be implemented as data packets, such as video data packets. In other implementation manners, the data units involved in the embodiments of the present application may be implemented as data frames, such as video data frames.

It should be pointed out that video resources include different types of video frames, and different types of video frames have different functions during decoding. Therefore, different types of video frame transmission errors have different effects on user experience. Exemplarily, take a video including an intra frame (intra frame, I frame) and a predicted video frame (predicted frame, P frame) as an example, where the I frame is used to provide a reference for restoring the image during decoding, and the P frame is used to Characterize the difference between the image of this frame and the image of the previous frame. It can be seen that the I-frame error has a relatively large impact on the video quality, and correspondingly, the impact on the user experience is relatively large, while the P-frame error has a relatively small impact on the video quality, and accordingly, the impact on the user experience is relatively small. Small. When video codec is performed in units of a group of picture (GoP), one GoP may include one I frame and at least one P frame. Figure 2 uses an exemplary GoP as an example to describe the impact on video quality when different types of video frames have errors.

As shown in FIG. 2 , the GoP shown in FIG. 2 includes 1 I frame and 4 P frames, and each video frame includes 4 data packets. The packet error rate (PER) of data packets in each scenario shown in FIG. 2 is all 20%, that is, the GoP contains 4 wrong data packets (black squares represent wrong data packets). The data packets described in the embodiments of the present application are, for example, internet protocol (internet protocol, IP) packets or packet data convergence protocol (packet data convergence protocol, PDCP) packets. The video multi-method assessment fusion (VMAF) score shown in Figure 2 is used to characterize the video quality. The higher the VMAF score is, the better the video quality is. On the contrary, the lower the VMAF score is, the worse the video quality is. .

In the first scenario illustrated in FIG. 2 , the four erroneous data packets are all I-frame data packets. The VMAF score corresponding to scene 1 is, for example, 30 points. In the four scenes shown in FIG. 2 , the obtained video quality is the worst. In the second scenario shown in Figure 2, 4 erroneous data packets are distributed in 4 data frames, of which 1 erroneous data packet is an I-frame data packet, and the other 3 erroneous data packets are data of three P-frames respectively Bag. The VMAF score corresponding to the second scene is, for example, 50 points. In the third scenario shown in FIG. 2 , the 4 erroneous data packets are all P frame data packets, and the 4 erroneous data packets belong to the same P frame. The VMAF score corresponding to scene three is, for example, 60 points. In the fourth scenario shown in FIG. 2 , the four erroneous data packets are all P-frame data packets, wherein two erroneous data packets belong to one P-frame, and the other two erroneous data packets belong to one P-frame. The VMAF score corresponding to scene 4 is, for example, 80 points. In the four scenes shown in FIG. 2 , the obtained video quality is the best. It can be seen that under the condition that the PER remains unchanged, different types of video frames have errors, and the corresponding obtained video quality is quite different. Correspondingly, the user's viewing experience will also be quite different.

The above-mentioned GoP can be understood as a sequence of data units (eg, data packets or video frames), and each data unit in the GoP is arranged in a certain order. Accordingly, the location of the data unit is associated with the type of video frame. Exemplarily, still taking FIG. 2 as an example, the 1st to 4th data packets in the GoP shown in FIG. 2 are I-frame data packets, and the 5th to 8th data packets are P-frame data packets. packets, and so on. Furthermore, for example, where the third data packet is transmitted in error, it can be correlated that an error occurs in the I frame. For another example, the transmission error of the 10th data packet can be correlated to obtain an error in the P frame. Based on this, an embodiment of the present application proposes a communication method to obtain a user's look and feel experience in combination with the location of the data unit.

In a possible implementation manner, at least one error sample and a reference evaluation parameter corresponding to the at least one error sample may be predefined or preconfigured. In some embodiments, each error sample in the at least one error sample corresponds to a reference evaluation parameter. The error samples indicate the positions of the erroneous data units in the N data units, the positions of the erroneous data units indicated by different error samples in the N data units are different, and N is a positive integer. The reference evaluation parameter represents the influence degree of the error sample corresponding to the reference evaluation parameter on the user experience, and is used to obtain the evaluation parameter of the transmitted data unit.

Exemplarily, the correspondence between the at least one error sample and the reference evaluation parameter may be represented by a table, as shown in Table 1.

Table 1

差错样本Error sample	参考评价参数Reference evaluation parameters
差错样本01Error sample 01	参考评价参数01Reference evaluation parameter 01
差错样本02Error sample 02	参考评价参数02Reference evaluation parameter 02
……...	……...

Table 1 presents some information about the correspondence between error samples and reference evaluation parameters. In Table 1, for example, the error sample 01 corresponds to the reference evaluation parameter 01 of the row, and the error sample 02 corresponds to the reference evaluation parameter 02 of the row. The position of the erroneous data unit indicated by the error sample 01 in the N data units is different from the position of the erroneous data unit indicated by the error sample 02 in the N data units. The correspondence between other error samples not shown in Table 1 and the reference evaluation parameters will not be repeated here.

In some embodiments, the value of N is related to the total number M of data units contained in the GoP of the video source (M is directly referred to below), and N may be an integer multiple of M. For example, a GoP of an exemplary video source contains 100 data packets, and the error samples corresponding to the video source may indicate the location of the erroneous data packet among the 100 data packets. For another example, the GoP of an exemplary video source contains 20 data packets, and the error samples corresponding to the video source may indicate the position of the erroneous data packet in the 40 data packets.

In addition, it should be pointed out that the total number M of data units included in the GoP of video sources of different formats may be different. Therefore, for different M, the corresponding relationship between error samples and reference evaluation parameters can be predefined or pre-configured, and the number of data units corresponding to the error samples in the corresponding relationship is related to the M associated with the corresponding relationship, so that the communication device can The error samples that match the transmission data unit are used to calculate the evaluation information. The implementation form of the correspondence between each M-related error sample and the reference evaluation parameter may be as shown in Table 1. Exemplarily, the predefined or preconfigured correspondences include two groups, for example, the N corresponding to the error samples in the first group of correspondences is, for example, 10, and the N corresponding to the error samples in the second group of correspondences is, for example, 3. Correspondingly, the first set of correspondences are, for example, related to video sources with a total number of GoP data units of 5, and the second set of correspondence relationships are, for example, related to video sources with a total of 3 GoP data units.

In a scenario where at least two sets of correspondences are predefined or preconfigured, in some embodiments, if the number of data units indicated by the error samples of each set of correspondences in the at least two sets of correspondences is equal to the relevant M, the at least two sets of correspondences The presentation forms of the relationships may all be as shown in Table 1, that is, each set of corresponding relationships may not be marked with the M associated with the corresponding relationship. In other embodiments, if the number of data units indicated by the error samples of at least one set of the at least two sets of correspondences is 2 times or more than the M associated with the set of correspondences, in order to facilitate the identification of different video source phases Matched correspondence, each of the at least two sets of correspondences may be identified by M associated with the correspondence.

In some embodiments, the error samples may be implemented as binary vectors. The binary vector contains N binary bits, each binary bit corresponds to a data unit in the error sample, and the position of each binary bit in the N binary bits indicates the position of the data unit indicated by the binary bit in the N data units. In a possible implementation manner, "0", for example, indicates that the corresponding data unit is correct, and "1", for example, indicates that the corresponding data unit is incorrect. For example, a binary vector "01001" represents an error sample containing 5 data units, the binary vector represents five data units of the error sample one by one from the low order to the high order five bits, and the position of the error data unit in the error sample is in the error sample. The 1st and 4th positions of the samples from low to high. In another possible implementation manner, "0" also indicates that the corresponding data unit is wrong, and "1" indicates that the corresponding data unit is correct.

In other embodiments, the error samples may be implemented in the form of data sets. The data in the data set is the label or index of the position of the erroneous data unit in the N data units. For example, the data set {1,10,11,15,81} indicates the 1st position, the 2nd position, the 10th position, the 11th position and the 10th position in the 100 data units in order from low to high Bad data unit at 81 positions.

It can be understood that the implementation form of the above error samples is only a schematic description, and does not constitute a limitation on the error samples described in the embodiments of the present application. In other embodiments, the error samples may also be implemented in other forms that can characterize the location of the data unit.

It can be understood that the reference evaluation parameters corresponding to the error samples may be obtained based on data modeling. In some embodiments, a larger reference evaluation parameter may indicate a worse user experience, and accordingly, a smaller reference evaluation parameter may indicate a better user experience. In other embodiments, a larger reference evaluation parameter may indicate a better user experience, and accordingly, a smaller reference evaluation parameter may indicate a worse user experience. This embodiment of the present application does not limit this.

With this implementation, the pre-defined or pre-configured correspondence between error samples and reference evaluation parameters provides a parameter basis for obtaining evaluation information according to the position of the erroneous data unit in the transmitted data unit.

Embodiments of the communication method are introduced below.

FIG. 3A illustrates a communication method 100 (hereinafter referred to as the method 100 ), the method 100 includes: a network device sends a plurality of data units to a terminal, and further, the network device obtains, according to the corresponding positions of the error data units in the plurality of data units, Evaluation parameters. After that, the network device obtains evaluation information according to the evaluation parameters, and then communicates with the terminal according to the evaluation information.

Wherein, the evaluation parameter is used to characterize the influence degree of the corresponding position of the erroneous data unit in the plurality of data units on the user experience, for example, the evaluation parameter characterizes the influence degree of the type of the erroneous video frame on the user experience. Then, the evaluation information obtained according to the evaluation parameters can reflect the impact of different types of video frame errors on the user experience, so that the user experience can be more accurately evaluated, and further, the network device can more accurately adjust the transmission strategy according to the evaluation information. , to further optimize the communication performance with the terminal. For the convenience of description, "the corresponding position of an erroneous data unit in the plurality of data units" is simplified as an example of an error hereinafter in this specification.

The network device may count the evaluation information of the data unit according to the statistical period of the evaluation information. For example, the network device may set the statistical period of the evaluation information according to the transmission time interval (TTI) of the data unit, so that the network device can send the multiple data units within the statistical period. For example, the TTI of a data unit is 1 millisecond (ms). In order to ensure that 10 data units are sent to the terminal within the statistical period, the network device may set the statistical period to 10 ms.

During the implementation of the method 100, before obtaining the evaluation parameter according to the error instance, the network device may determine the corresponding relationship matching the plurality of data units according to the foregoing predefined or preconfigured corresponding relationship, and then, according to the determined corresponding relationship The evaluation parameter is calculated from at least one error sample in and the corresponding reference evaluation parameter.

Exemplarily, according to whether the GoP structures related to the multiple data units are variable, the embodiments of the present application have different manners for determining the corresponding relationship matching the multiple data units. The fixed GoP structure means that the total number of data units included in the GoP (ie, the aforementioned M) remains unchanged during the transmission process of the plurality of data units. The variable GoP structure means that during the transmission of the multiple data units, the total number M of data units included in the GoP can be changed.

In some embodiments, if the GoP structures related to the plurality of data units are fixed, the network device may use the corresponding relationship corresponding to the total number of data units included in the GoP as the corresponding relationship matching the plurality of data units. At least one error sample in the correspondence corresponds, for example, to a first number of data units. In this embodiment, the first number may be an integer multiple of the total number M of data units included in GoPs related to the multiple data units, and the number of the multiple data units may be an integer multiple of the first number. For example, the network device maintains the first correspondence, the second correspondence, and the third correspondence. The M corresponding to the first correspondence is, for example, 3, the M corresponding to the second correspondence is, for example, 20, and the M corresponding to the third correspondence, such as is 64. For example, the total number of data units included in the GoP is 20, then, the network device may select the second correspondence according to 20 as the correspondence that matches multiple data units. At least one error sample in the second correspondence relationship corresponds to, for example, 40 data units, and the number of the plurality of data units is, for example, 80.

In other embodiments, if the GoP structure is variable, the network device may select a corresponding relationship matching the plurality of data units according to the number (second number) of the plurality of data units. Exemplarily, the network device may calculate the difference between the second number and the number of data units corresponding to the error samples in each set of correspondences, and then, in the correspondence in which the number of data units corresponding to the error samples is less than the second number, select The correspondence relation corresponding to the minimum difference value is regarded as the correspondence relation matched with the plurality of data units. For example, the network device maintains the fourth correspondence, the fifth correspondence, and the sixth correspondence, the error samples in the fourth correspondence, for example, correspond to 3 data units, and the error samples in the fifth correspondence, for example, correspond to 64 data units unit, and the error samples in the sixth correspondence correspond to, for example, 100 data units. In this embodiment, the number of multiple data units is, for example, 70, the number of data units corresponding to the error samples in the fourth correspondence and the fifth correspondence is less than 70, and the number of data units corresponding to the error samples in the fifth correspondence is less than 70. The difference between the number and 70 is the smallest, and based on this, the network device selects the fifth correspondence as the correspondence that matches the plurality of data units.

Optionally, after the network device sends the multiple data units to the terminal, the terminal sends response information to the network device according to the reception of the data units. The acknowledgement information may include acknowledgement (ACK) information or negative acknowledgement (NACK) information, where the ACK information is used to indicate that the terminal has correctly received a certain data unit, and the NACK information is used to indicate that the terminal has not correctly received a certain data unit. unit. Based on this, the network device can obtain the corresponding position of the erroneous data unit in the multiple data units according to the ACK information and/or NACK information from the terminal, and then obtain the corresponding position of the erroneous data unit according to at least one error sample in the corresponding relationship determined above. Evaluation parameters related to the position of a unit in a plurality of data units.

In this embodiment of the present application, the network device may obtain the evaluation parameter according to all or part of the reference evaluation parameters corresponding to the at least one error sample. Among them, it should be pointed out that at least one error sample and the corresponding reference evaluation parameter in the foregoing corresponding relationship may correspond in various ways. The following describes an implementation manner of obtaining evaluation parameters in combination with different implementation forms of the corresponding relationship. For convenience of description, the following description describes "corresponding positions of erroneous data units in the plurality of data units" as an error example.

Possible implementation manner 1 of the embodiment of the present application:

In the first possible implementation manner of the embodiment of the present application, the presentation form of the corresponding relationship 01 may be as shown in Table 1. The at least one error sample included in the correspondence 01 may be a representative sample of the location of the erroneous data unit, that is, the at least one error sample of the correspondence 01 may not cover all instances where the erroneous data unit is located. Based on this, in the first implementation manner, after obtaining the aforementioned error instance, the network device can obtain the correlation coefficient between each error sample and the error instance in all the error samples of the corresponding relationship 01, and then, according to the correlation coefficient and the corresponding In relation 01, all or part of the evaluation parameters are obtained with reference to the evaluation parameters.

In some implementation manners, the reference evaluation parameter may be named as an error index (error index, EI) or other names, which are not limited in this embodiment of the present application.

Exemplarily, the corresponding relationship 01 may be represented by a table, as shown in Table 2.

Table 2

差错样本Error sample	EIEI
差错样本21Error sample 21	EI 21EI 21
差错样本22Error sample 22	EI 22EI 22
差错样本23Error sample 23	EI 23EI 23
差错样本24Error sample 24	EI 24EI 24
差错样本25Error sample 25	EI 25EI 25
……...	……...
差错样本2xError sample 2x	EI 2xEI 2x

As shown in Table 2, the error samples in the correspondence relationship 01 correspond to N01 data units, and N01 is, for example, 100. In Table 2, for example, the error sample 21 corresponds to the reference evaluation parameter 21 of the row, and the error sample 22 corresponds to the reference evaluation parameter 22 of the row. The relationship between the information of other rows in Table 2 is the same, and will not be repeated here. For example, the correspondence relationship 01 includes x error samples, where x is greater than 1 and less than 2 ^N01 . The x error samples include the locations of representative error packets for each error instance. In conjunction with the examples shown in Fig. 2 and Fig. 4, the GoP shown in Fig. 4 and the bit error information are the same as those shown in Fig. 2, and the frame where the error data unit shown in Fig. 4 is located is the same as the scene 4 shown in Fig. 2, if the corresponding relationship 01 If the error sample corresponding to the scene four shown in FIG. 2 is included, the error sample of the scene shown in FIG. 4 may not be included, and the error sample corresponding to the scene four shown in FIG. represent. The error samples shown in Table 2 can be implemented as binary vectors or data sets, which will not be repeated here.

Further, after obtaining the error instance v1, the network device can obtain the correlation coefficient between the error instance v1 and the error sample. For example, network devices are

Obtain the correlation coefficient Coef(v1, error sample _i ) of each error sample in the error instance v1 and the corresponding relationship 01, where i is greater than or equal to 1 and less than or equal to x, and the error sample _i refers to the first in the corresponding relationship 01. i error samples, <v1, error sample _i > _h refers to the Hamming distance between the vector corresponding to the error instance v1 and the vector corresponding to the error sample _i , ‖v1‖ means the error instance v1 is represented by a binary vector. The modulus of the corresponding vector, ‖ error sample _i ‖ refers to the modulus of the vector to which the error sample _i is represented in the form of a binary vector.

Furthermore, in some embodiments, the network device may obtain the evaluation parameter f of the error instance v1 according to the correlation coefficient. For example, network devices pass

Obtain the evaluation parameter f of the error instance v1, where EI _i refers to the EI corresponding to the i-th error sample in the correspondence 01.

In other embodiments, the network device may obtain a correlation coefficient greater than the first threshold from the x correlation coefficients, and then may perform a weighted average calculation on the EI corresponding to the error samples associated with all the correlation coefficients greater than the first threshold, to obtain The evaluation parameters of the error instance v1 are obtained.

In other embodiments, the network device may use the EI corresponding to the error sample with the largest correlation coefficient as the evaluation parameter of the error instance v1.

It can be understood that, the above embodiments of obtaining the evaluation parameter of the error instance v1 according to the correlation coefficient are all schematic descriptions, and do not constitute a limitation to the embodiments of the present application. In some other embodiments, the network device may also obtain the evaluation parameter of the error instance v1 according to the correlation coefficient according to other rules or algorithms.

The second possible implementation manner of the embodiment of the present application:

In order to facilitate the maintenance of error samples and EI, and to reduce the complexity of obtaining evaluation parameters, in the second possible implementation manner of the embodiment of the present application, in the corresponding relationship 02, the error samples and EI are divided into at least two groups according to the packet error rate (PER). , each of the at least two groups may include sub-correspondence similar to Table 1 or Table 2. Furthermore, after obtaining the error instance v2, the network device may calculate the PER corresponding to the error instance v2, and then obtain the evaluation parameter of the error instance v2 according to the sub-correspondence relation related to the range to which the PER belongs.

Exemplarily, the corresponding relationship 02 may be represented by a table, as shown in Table 3.

table 3

Table 3 presents an exemplary representation of the correspondence 02. In this embodiment, the corresponding relationship 02 divides the error samples and EI into five groups according to PER, and the PERs corresponding to the five groups are PER greater than or equal to 0 to less than or equal to 5%, and PER greater than 5% to less than or equal to 15%, PER greater than 15% to less than or equal to 30%, PER greater than 30% to less than or equal to 50%, and PER greater than 50% to less than or equal to 100%. in Table 3

Represents subcorrespondence. Exemplarily, in Table 3, for example, the PER range [0,5%] (ie, PER greater than or equal to 0 to less than or equal to 5%) corresponds to the corresponding sub-correspondence

PER range (5%, 15%] (ie, PER greater than 5% to less than or equal to 15%) corresponds to sub-correspondence

The correspondence of the information in other columns in Table 3 is the same, and is not repeated here. Wherein, each sub-correspondence in Table 3 includes at least one error sample and reference evaluation parameters corresponding to each error sample (as shown in Table 3-1 and Table 3-2), and at least one error in each sub-correspondence The PER of the sample belongs to the PER range associated with this sub-correspondence.

It can be understood that Table 3 is only a schematic description, and does not constitute a limitation to the embodiments of the present application. In some other embodiments, the corresponding relationship 02 may also be divided into more and less groups according to the PER range, which is not limited here.

Exemplary, subcorrespondence

It can be represented in a table, as shown in Table 3-1, where j can be 1, 2, 3, 4, or 5.

Table 3-1

差错样本Error sample	g _j,1 g _j,1	g _j,2 g _j,2	g _j,3 g _j,3	……	g _j,y g _j,y
EIEI	EI _j,1 EI _j,1	EI _j,2 EI _j,2	EI _j，3 EI _{j, 3}	……	EI _j,y EI _j,y

Table 3-1 presents the subcorrespondence

an exemplary expression of . As shown in Table 3-1, the sub-correspondence

For example, it contains y error samples, where y is a positive integer, and the specific value of y can be flexibly set according to different implementation scenarios. For example, when j is 1, y can be 10, indicating that the PER with 10 erroneous samples falls within the range (0,5%). For another example, when j is 2, y can be 7, indicating that the PER with 7 erroneous samples It belongs to the range (5%, 15%]. For example, in Table 3-1, the EI corresponding to the error sample g _j,1 is EI _j,1 , and the EI corresponding to the error sample g _j,2 is EI _j,2 . Table 3- The correspondence of the information in other columns in 1 is the same, and will not be repeated here.

Combining with the corresponding relationship 02, after obtaining the error instance v2, the network device can obtain the PER of the error instance v2, for example, 28%. Further, the network device can determine the PER range (15%, 30%) in the corresponding relationship 02 to which the PER 28% of the error instance v2 belongs. After that, the network device obtains the sub-range corresponding to the PER range (15%, 30%] based on the corresponding relationship 02. Correspondence

Furthermore, according to the sub-correspondence

At least one error sample in and the EI corresponding to each error sample determine the evaluation parameter of the error instance v2.

Exemplarily, the network device can obtain the sub-correspondence

The correlation coefficient between each error sample and the error instance v2 in

All or part of the evaluation parameters are obtained by referring to the evaluation parameters. In this embodiment, for the process of calculating the correlation coefficient by the network device and obtaining the evaluation parameter according to the correlation coefficient, reference may be made to the relevant description in the first implementation, which will not be described in detail here.

The implementation process of this embodiment is described below with reference to an example.

For example, the corresponding relationship 020 involved in this example is divided into five groups according to the PER range, and the PER ranges corresponding to the five groups are the same as the corresponding relationship 02, and are not repeated here. Both the error samples and the error instances v2 involved in this example include 100 data packets, and both the error samples and the error instances v2 represent the position of the error data packets in the 100 data packets with a data set. The error instance v2 is, for example, {1, 2, 10, 11, 81}, that is, the 1st, 2nd, 10th, 11th and 81st data packets among the 100 data packets sent by the network device to the terminal are error data packets. Further, the network device may determine that the PER of the error instance v2 is 5%, which belongs to the PER range [0%, 5%] in the corresponding relationship 020 . In this example, the sub-correspondence 021 corresponding to the PER range [0%, 5%] is shown in Table 3-2.

Table 3-2

差错样本Error sample	EIEI
g ₁:{1,2,3,4,5} g ₁ : {1,2,3,4,5}	EI ₁＝1 EI ₁ =1
g ₂:{1,10,11,15,81} g ₂ : {1,10,11,15,81}	EI ₂＝0.8 EI ₂ =0.8
g ₃:{1,21,41,61,81} g3:{ _{1,21,41,61,81} }	EI ₃＝0.7 EI ₃ =0.7
g ₄:{20,55,65,80,85} g4:{ _{20,55,65,80,85} }	EI ₄＝0.5 EI ₄ =0.5

g ₅:{80,85,90,95,99} g5:{ _{80,85,90,95,99} }	EI ₅＝0.3 EI ₅ =0.3
g ₆:{96,97,98,99,100} _g6 :{96,97,98,99,100}	EI ₆＝0.1 EI ₆ =0.1

Referring to Table 3-2, the sub-correspondence relationship 021 includes, for example, 6 error samples, the PER corresponding to the 6 error samples is all 5%, and the 6 error samples are all presented in the form of data sets. The number in each of the 6 error samples characterizes the location of the erroneous data packet in the 100 data packets. In addition, the information of each row in Table 3-2 corresponds, for example, the error sample g ₃ : {1, 21, 41, 61, 81} corresponds to EI ₃ =0.7, and EI ₃ =0.7 represents the error sample {1, 21 ,41,61,81} The degree of impact on user experience is 0.7. The information in other rows in Table 3-2 is the same, and will not be described here.

It can be understood that, Table 3-2 is only a schematic description, and does not constitute a limitation to the embodiments of the present application. In some other implementation manners, the sub-correspondence relationship involved in the embodiments of the present application may further include more or less error samples, and each error sample may also be presented in the form of a binary vector. I won't go into details here.

After obtaining the error instance v2: {1, 2, 10, 11, 81}, the network device can calculate the correlation coefficient between the error instance v2 and the 6 error samples in Table 3-2, for example, to obtain Coef(v ₂ , g ₁ )=0.4, Coef(v ₂ , g ₂ )=0.8, Coef(v ₂ , g ₃ )=0.4, Coef(v ₂ , g ₄ )=0, Coef(v ₂ , g ₅ )=0, Coef (v ₂ , g ₆ )=0. For details of the possible manner in which the network device calculates the correlation coefficient, please refer to the description of the foregoing implementation manner 1, and the description will not be repeated here.

Further, the network device calculates the evaluation parameter of the error instance v2 based on the six correlation coefficients and the EI related to the six correlation coefficients in Table 3-2. Exemplary, error instance v2

It can be understood that the above-mentioned method for calculating the evaluation parameter of the error instance v2 according to the six correlation coefficients is only a schematic description, and does not constitute a limitation on the embodiments of the present application. In some other embodiments, the network device may also determine the evaluation parameter of the error instance v2 according to the six correlation coefficients in other manners. For example, the network device may use the EI corresponding to the largest correlation coefficient 0.8 among the six correlation coefficients as the evaluation parameter of the error instance v2, that is, EI ₂ =0.8 as the evaluation parameter of the error instance v2.

Three possible implementations of the embodiments of the present application:

It should be noted that the above-mentioned possible implementation manner 1 and possible implementation manner 2 both take the fixed GoP structure as an example to describe the implementation process of obtaining the evaluation parameters. If the GoP structure is variable, the network device may obtain the correlation coefficient according to the position of the erroneous data unit in the first number of data units included in the plurality of data units.

Exemplarily, according to the foregoing description, if the GoP structure is variable, the number of the plurality of data units is greater than the first number. Based on this, the network device can intercept some data units in the multiple data units to obtain the first number of data units, and then calculate the aforementioned correlation coefficient according to the obtained first number of data units to obtain the first number of data units. The evaluation parameters and evaluation information corresponding to the unit. Wherein, the data unit discarded in the operation of intercepting multiple data units by the network device may be the data unit of the P frame.

According to the characteristics of the GoP structure, the I frame is usually the first frame in the GoP. In some implementations, the network device can sequentially discard some data units in the multiple data units from the back to the front, and retain the remaining first number of data units. data unit. It should be understood that the number of data units discarded by the network device may be the difference between the number of multiple data units and the first number.

It can be understood that, the foregoing manner of discarding data units sequentially from back to front is only a schematic description, and does not constitute a limitation on the embodiments of the present application. In some other implementation manners, on the premise that the reserved first number of data units include all data units of the I frame, and the discarded data units are all data units of the P frame, the network device may use other methods Intercept the data unit, which is not limited here.

For the implementation process of the network device calculating the correlation coefficient and the evaluation parameter according to the first number of data units, please refer to the description of the above-mentioned related implementation manners, which will not be repeated here.

Four possible implementations of the embodiments of the present application:

The correspondences involved in the above-mentioned possible implementation manners 1 to 3 reflect the positions of some erroneous data units, but do not include the positions of all erroneous data units. Therefore, based on the exemplary correspondences in the above-mentioned implementation manners, the network device The evaluation parameters are obtained according to the correlation coefficient between the error instance and the error sample. The corresponding relationship 03 involved in the fourth implementation may include error samples covering the positions of all erroneous data units. Based on this, after obtaining the error instance, the network device can determine the error sample consistent with the error instance from the corresponding relationship 03, and then use the EI corresponding to the corresponding error sample as the evaluation parameter of the error instance.

For example, the error samples involved in this example and the error instance v3 both include 3 data packets, and correspondingly, the corresponding relationship 030 involved in this example includes 2 ³ =8 error samples. In this example, the error samples and the error instance v3 both represent the positions of the error data packets in the three data packets in the form of binary vectors. The corresponding relationship 030 is shown in Table 4.

Table 4

差错样本Error sample	EIEI
[0,0,0][0,0,0]	00
[0,0,1][0,0,1]	0.050.05
[0,1,0][0,1,0]	0.60.6
[0,1,1][0,1,1]	0.750.75
[1,0,0][1,0,0]	0.950.95
[1,0,1][1,0,1]	11
[1,1,0][1,1,0]	11
[1,1,1][1,1,1]	11

Referring to Table 4, the corresponding relationship 030 includes 8 error samples, "0" in the 8 error samples, for example, indicates that the data packet at the corresponding position is a correct data packet, and "1" indicates that the data packet at the corresponding position is wrong data, for example Bag. The 8 error samples correspond to the EI of the same row. For example, the error sample [0,1,0] corresponds to 0.6, that is, the degree of influence of the error sample [0,1,0] on the user experience is 0.6. The information of other rows in Table 4 is the same, and will not be described one by one here.

It can be understood that Table 4 is only a schematic description, and does not constitute a limitation to the embodiments of the present application. In some other implementations, for error samples represented by binary vectors, "0" may also indicate that the data packet at the corresponding position is an erroneous data packet, and "1" may also indicate that the data packet at the corresponding position is a correct data packet.

Further, after obtaining the error instance v3, the network device may, for example, determine that the positions of the erroneous data packets in the error instance v3 are the first position and the third position. Correspondingly, the error instance v3 and the error sample [1,0,1 ]correspond. Furthermore, the network device can obtain the EI "1" corresponding to the error sample [1, 0, 1] from the corresponding relationship 030 shown in Table 4, and use the EI "1" as the evaluation parameter of the error instance v3.

After obtaining the evaluation parameter by adopting any one of the above possible implementations 1 to 4, the network device may obtain the evaluation information according to the evaluation parameter. In some embodiments, the network device may obtain the evaluation information according to the evaluation parameter and the packet delay budget (PDB) information of the multiple data units. Exemplarily, the network device may obtain the evaluation information according to the evaluation information=f(evaluation parameter, PDB) to obtain evaluation information. For example, the network device may obtain the evaluation information according to evaluation information=5.0-evaluation parameter*4-max(PDB-10,0)/50. In other embodiments, the network device may obtain the evaluation information according to the packet error rate of the multiple data units, the evaluation parameter, and the delay information of the multiple data units. Exemplarily, the network device may obtain the evaluation information according to the evaluation information=f(PER, evaluation parameters, PDB) to obtain evaluation information.

In other embodiments, the correspondence between error samples, reference evaluation parameters, PDBs and evaluation information may be predefined or preconfigured. In this embodiment, after obtaining the error instance, the network device determines the error sample, reference evaluation parameter and PDB corresponding to the error instance, and then searches the corresponding relationship for evaluation information corresponding to the error sample, reference evaluation parameter and PDB.

Exemplarily, the corresponding relationship 04 can be represented by a table, as shown in Table 5.

table 5

The corresponding relationship 04 shown in Table 5 includes 8 error samples, the EI corresponding to each error sample, and the evaluation information of each error sample when the PDB is 0ms, 5ms, 10ms, 15ms and 20ms respectively. The 8 error samples included in the corresponding relationship 04 and the EI corresponding to each error sample are the same as those shown in Table 4, and are not described in detail here. Each row in Table 5 represents an error sample, the EI of the error sample, and the evaluation information corresponding to the error sample when the PDB is 0ms, 5ms, 10ms, 15ms, and 20ms, respectively. For example, the row where the error sample [0,1,1] is located includes the EI 0.75 corresponding to the error sample [0,1,1], the evaluation information 2.0 of the error sample [0,1,1] when the PDB is 0ms, The error sample [0,1,1] has the evaluation information 2.0 when the PDB is 5ms, the error sample [0,1,1] has the evaluation information 2.0 when the PDB is 10ms, and the error sample [0,1,1] in the PDB is The evaluation information is 1.9 at 15ms, and the evaluation information 1.8 when the PDB is 20ms for the error sample [0,1,1]. The correspondence of the information in other rows and columns in Table 5 is the same, and will not be described one by one here.

It can be understood that Table 5 is only a schematic description, and does not constitute a limitation to the embodiments of the present application. In some other embodiments, the corresponding relationship 04 may further include, for example, more or less PDBs, and evaluation information corresponding to each PDB and different error samples.

Further, for example, after obtaining an error instance where the error sample is [0,0,1] and the PDB is 15ms, the network device can obtain the evaluation parameter of the corresponding error instance to be 0.05, and the evaluation information of the corresponding error instance to be 4.7.

It can be seen that with this implementation, the reference evaluation parameters corresponding to the erroneous data units at different positions are pre-defined to characterize the degree of influence of the erroneous data units on the user experience when the erroneous data units are at different positions. After multiple data units are transmitted, the evaluation parameters corresponding to the positions of the erroneous data units in the multiple data units are obtained according to the reference evaluation parameters, and the evaluation information is obtained according to the evaluation parameters, so that the impact of different types of video frame errors on user experience can be obtained. The degree of influence can then accurately reflect the user's experience.

FIG. 3B illustrates another communication method 200 (hereinafter referred to as the method 200 ) of the present application. The method 200 includes: a network device sends a plurality of data units to a terminal. The terminal obtains the evaluation parameter according to the position corresponding to the received erroneous data unit in the plurality of data units, and sends first feedback information to the network device, where the first feedback information is used to indicate the evaluation parameter. The network device obtains evaluation parameters according to the first feedback information, further obtains evaluation information according to the evaluation parameters, and communicates with the terminal according to the evaluation information.

In some implementations of the method 200, the aforementioned correspondences may be pre-stored in the terminal. In other embodiments, the network device may configure or indicate the aforementioned corresponding relationship to the terminal.

It should be pointed out that the terminal usually cannot know the matching relationship of the multiple data units, but the network device can obtain the GoP information of the multiple data units, and then learn the matching relationship of the multiple data units according to the GoP information. Based on this, in this embodiment, the network device may send the first indication information to the terminal, so as to inform the terminal of at least one error sample that matches multiple data units, so that the terminal can determine the error according to all or part of the at least one error sample. The sample obtains the evaluation parameters. Exemplarily, the network device may include the first indication information in radio resource control (radio resource control, RRC) signaling and send it to the terminal.

When the terminal maintains the aforementioned correspondence in advance, the network device can know the number of data units included in the GoP corresponding to the multiple data units, and then indicate the number of data units included in the GoP to the terminal. In this example, the first indication information indicates the number of data units included in the GoP.

Alternatively, each set of correspondences may be identified by a label, and the network device determines a correspondence that matches multiple data units according to the number of data units included in the GoP, and then indicates the label of the determined correspondence to the terminal. In this example, the first indication information indicates the label.

In a scenario where the terminal does not maintain the aforementioned correspondence in advance, after obtaining the matching correspondences between the multiple data units, the network device sends first indication information to the terminal, where the first indication information indicates that the multiple data units are compatible with each other. Matched error samples and corresponding reference evaluation parameters. Exemplarily, if the corresponding relationship is implemented as the aforementioned corresponding relationship 01, the first indication information may indicate all data of the corresponding corresponding relationship. If the corresponding relationship is implemented as the aforementioned corresponding relationship 02, the first indication information may indicate all data of the sub-correspondence relationship corresponding to the PER range to which the PERs of the multiple data units belong. If the corresponding relationship is implemented as the aforementioned corresponding relationship 03, the first indication information may indicate error samples and reference evaluation parameters corresponding to the plurality of data units.

It can be understood that, the implementation manner of the above-mentioned first indication information is only a schematic description, and does not constitute a limitation on the embodiments of the present application. In some other embodiments, according to the implementation manner of the corresponding relationship and the implementation process of the time period in which the network device sends the first indication information, the first indication information may also be presented in other forms of information, which is not limited here.

Further, after receiving the first indication information, the terminal may obtain evaluation parameters according to all or part of the error samples in the at least one error sample indicated by the first indication information. For the implementation of the terminal obtaining the evaluation parameters according to all or part of the at least one error sample, reference may be made to the implementation of the network device obtaining the evaluation parameters according to the error samples, which will not be repeated here.

After the terminal obtains the evaluation parameters, in some embodiments, the terminal may indicate the evaluation parameters to the network device through the first feedback information, so that the network device obtains the evaluation information according to the evaluation parameters. In other embodiments, the terminal may indicate data associated with the evaluation parameter to the network device through the first feedback information, so that the network device obtains the evaluation parameter according to the relevant data, and further obtains the evaluation information according to the evaluation parameter.

It should be noted that, the first feedback information may be response information from the terminal in response to an instruction from the network device, which is not limited here.

In this implementation manner, the terminal obtains the evaluation parameters representing the degree of influence of the location of the received erroneous data unit on the user experience according to the pre-defined or pre-configured reference evaluation parameters corresponding to the error data units at different locations, and then, through communication signaling, The information indicating the evaluation parameters is transmitted to the network device, so that the network device obtains evaluation information reflecting the user's experience, and then optimizes the communication performance according to the evaluation information.

FIG. 3C illustrates a communication method 300 (hereinafter referred to as the method 300 ), the method 300 includes: a network device sends a plurality of data units to a terminal. The terminal obtains the evaluation parameter according to the position corresponding to the data unit of the received error in the plurality of data units, and obtains the evaluation information according to the evaluation parameter. After that, the terminal sends second feedback information to the network device, where the second feedback information is used to indicate the evaluation information. The network device obtains evaluation information according to the second feedback information, and further communicates with the terminal according to the evaluation information.

Similar to method 200, in method 300, the terminal may pre-store the foregoing correspondences and calculation methods of evaluation information, or the network device may configure or instruct the terminal to calculate the foregoing correspondences and evaluation information.

For example, the terminal may receive second indication information from the network device, where the second indication information indicates all or part of the error samples in the at least one error sample and/or the algorithm of the corresponding evaluation information. The network device obtains the evaluation parameter according to the above-mentioned content indicated by the second indication information. For details, reference may be made to the descriptions of the foregoing embodiments, which will not be repeated here. For the second indication information, reference may be made to the relevant description of the first indication information involved in the method 200, which will not be repeated here. Different from the first indication information, in a scenario where the terminal does not store the aforementioned algorithms for each correspondence and evaluation information, the second indication information further indicates the algorithm of the evaluation information associated with the corresponding information.

In the method 300, after the terminal obtains the evaluation information according to the evaluation parameters, in some embodiments, the terminal may indicate the evaluation information to the network device through the second feedback information, so that the network device obtains the evaluation information. In other embodiments, the terminal may indicate data associated with the evaluation information (eg, discrete data forming the evaluation information, etc.) to the network device through the second feedback information, so that the network device obtains the evaluation information according to the relevant data. For the second feedback information, reference may be made to the relevant description of the first feedback information involved in the method 200, and details are not repeated here.

It should be pointed out that the above embodiments all take the position of the erroneous data unit in multiple data units as an example to describe the implementation process of the embodiment of the present application, but the embodiment of the present application is not limited thereto. In other implementations, the evaluation parameters and evaluation information may also be obtained according to the positions of the correct data units in multiple data units, and the related implementation process may be similar to the foregoing embodiments, which will not be described in detail here.

In addition, the data units involved in the above embodiments may be implemented as data packets, such as IP packets or PDCP packets. According to the relationship between the data packet and the video frame, the position of the data packet is related to the type of the video frame. Therefore, based on the idea of the embodiment of the present application, obtaining the evaluation information according to the position of the erroneous video frame in multiple video frames is also part of the present application. The protection scope of the application embodiment.

To sum up, in the communication method of the embodiment of the present application, by pre-defining or pre-configuring the reference evaluation parameters corresponding to the erroneous data unit in different locations, the degree of influence of the erroneous data unit on the user experience at different locations is represented. After multiple data units are transmitted, the evaluation parameters corresponding to the positions of the erroneous data units in the multiple data units are obtained according to the reference evaluation parameters, and the evaluation information is obtained according to the evaluation parameters, so that the impact of different types of video frame errors on user experience can be obtained. Influence degree, and then can accurately reflect the user's experience and optimize the communication performance.

Corresponding to the methods given in the foregoing method embodiments, the embodiments of the present application further provide corresponding apparatuses, including corresponding modules for executing the foregoing embodiments. The modules may be software, hardware, or a combination of software and hardware.

Figure 5 shows a schematic structural diagram of a device. The apparatus 500 may be a network device, a terminal, a chip, a chip system, or a processor that supports the network device to implement the above method, or a chip, a chip system, or a processor that supports the terminal to implement the above method. device, etc. The apparatus can be used to implement the methods described in the foregoing method embodiments, and for details, reference may be made to the descriptions in the foregoing method embodiments.

The apparatus 500 may include one or more processors 501, and the processors 501 may also be referred to as processing units, which may implement certain control functions. The processor 501 may be a general-purpose processor or a special-purpose processor, or the like. For example, it may be a baseband processor or a central processing unit. The baseband processor can be used to process communication protocols and communication data, and the central processing unit can be used to control communication devices (such as base stations, baseband chips, terminals, terminal chips, DU or CU, etc.), execute software programs, process software program data.

In an optional design, the processor 501 may also store instructions and/or data 503, and the instructions and/or data 503 may be executed by the processor, so that the apparatus 500 performs the above method embodiments method described.

In another optional design, the processor 501 may include a transceiver unit for implementing receiving and transmitting functions. For example, the transceiver unit may be a transceiver circuit, or an interface, or an interface circuit. Transceiver circuits, interfaces or interface circuits used to implement receiving and transmitting functions may be separate or integrated. The above-mentioned transceiver circuit, interface or interface circuit can be used for reading and writing code/data, or the above-mentioned transceiver circuit, interface or interface circuit can be used for signal transmission or transmission.

In yet another possible design, the apparatus 500 may include a circuit, and the circuit may implement the function of sending or receiving or communicating in the foregoing method embodiments.

Optionally, the apparatus 500 may include one or more memories 502 on which instructions 504 may be stored, and the instructions may be executed on the processor, so that the apparatus 500 executes the above method embodiments method described. Optionally, data may also be stored in the memory. Optionally, instructions and/or data may also be stored in the processor. The processor and the memory can be provided separately or integrated together. For example, the corresponding relationship described in the above method embodiments may be stored in a memory or in a processor.

Optionally, the apparatus 500 may further include a transceiver 505 and/or an antenna 505 . The processor 501 may be referred to as a processing unit, and controls the apparatus 500 . The transceiver 505 may be referred to as a transceiver unit, a transceiver, a transceiver circuit, a transceiver device, or a transceiver module, etc., and is used to implement a transceiver function.

Optionally, the apparatus 500 in this embodiment of the present application may be used to execute the method described in FIG. 3A , FIG. 3B , or FIG. 3C in the embodiment of the present application, or may be used to execute the method described in the above three or more figures. methods combined with each other.

The processors and transceivers described in this application can be implemented in integrated circuits (ICs), analog ICs, radio frequency integrated circuits (RFICs), mixed-signal ICs, application specific integrated circuits (ASICs), printed circuit boards ( printed circuit board, PCB), electronic equipment, etc. The processor and transceiver can also be fabricated using various IC process technologies, such as complementary metal oxide semiconductor (CMOS), nMetal-oxide-semiconductor (NMOS), P-type Metal oxide semiconductor (positive channel metal oxide semiconductor, PMOS), bipolar junction transistor (Bipolar Junction Transistor, BJT), bipolar CMOS (BiCMOS), silicon germanium (SiGe), gallium arsenide (GaAs), etc.

The apparatus described in the above embodiments may be a network device or a terminal, but the scope of the apparatus described in this application is not limited thereto, and the structure of the apparatus may not be limited by FIG. 5 . An apparatus may be a stand-alone device or may be part of a larger device. For example the means may be:

(1) Independent integrated circuit IC, or chip, or, chip system or subsystem;

(2) A set with one or more ICs, optionally, the IC set may also include storage components for storing data and/or instructions;

(3) ASIC, such as modem (MSM);

(4) Modules that can be embedded in other equipment;

(5) Receivers, terminals, smart terminals, cellular phones, wireless equipment, handsets, mobile units, in-vehicle equipment, network equipment, cloud equipment, artificial intelligence equipment, machine equipment, household equipment, medical equipment, industrial equipment, etc.;

(5) Others, etc.

FIG. 6 provides a schematic structural diagram of a terminal. The terminal may be applicable to the scenarios shown in FIG. 3A , FIG. 3B or FIG. 3C . For convenience of explanation, FIG. 6 only shows the main components of the terminal. As shown in FIG. 6 , the terminal 600 includes a processor, a memory, a control circuit, an antenna, and an input and output device. The processor is mainly used to process communication protocols and communication data, control the entire terminal, execute software programs, and process data of the software programs. The memory is mainly used to store software programs and data. The radio frequency circuit is mainly used for the conversion of the baseband signal and the radio frequency signal and the processing of the radio frequency signal. Antennas are mainly used to send and receive radio frequency signals in the form of electromagnetic waves. Input and output devices, such as touch screens, display screens, and keyboards, are mainly used to receive data input by users and output data to users.

When the terminal is powered on, the processor can read the software program in the storage unit, parse and execute the instructions of the software program, and process the data of the software program. When data needs to be sent wirelessly, the processor performs baseband processing on the data to be sent, and outputs the baseband signal to the radio frequency circuit. The radio frequency circuit processes the baseband signal to obtain a radio frequency signal and sends the radio frequency signal through the antenna in the form of electromagnetic waves. . When data is sent to the terminal, the radio frequency circuit receives the radio frequency signal through the antenna, the radio frequency signal is further converted into a baseband signal, and the baseband signal is output to the processor, and the processor converts the baseband signal into data and processes the data .

For ease of illustration, Figure 6 shows only one memory and processor. In an actual terminal, there may be multiple processors and memories. The memory may also be referred to as a storage medium or a storage device, etc., which is not limited in this embodiment of the present invention.

As an optional implementation, the processor may include a baseband processor and a central processing unit. The baseband processor is mainly used to process communication protocols and communication data, and the central processing unit is mainly used to control the entire terminal and execute software. Programs that process data from software programs. The processor in FIG. 6 integrates the functions of the baseband processor and the central processing unit. Those skilled in the art can understand that the baseband processor and the central processing unit may also be independent processors, interconnected by technologies such as a bus. Those skilled in the art can understand that a terminal may include multiple baseband processors to adapt to different network standards, a terminal may include multiple central processors to enhance its processing capability, and various components of the terminal may be connected through various buses. The baseband processor may also be expressed as a baseband processing circuit or a baseband processing chip. The central processing unit can also be expressed as a central processing circuit or a central processing chip. The function of processing the communication protocol and communication data may be built in the processor, or may be stored in the storage unit in the form of a software program, and the processor executes the software program to realize the baseband processing function.

In an example, an antenna and a control circuit with a transceiving function can be regarded as the transceiving unit 611 of the terminal 600 , and a processor having a processing function can be regarded as the processing unit 612 of the terminal 600 . As shown in FIG. 6 , the terminal 600 includes a transceiver unit 611 and a processing unit 612 . The transceiving unit may also be referred to as a transceiver, a transceiver, a transceiving device, or the like. Optionally, the device for implementing the receiving function in the transceiver unit 611 may be regarded as a receiving unit, and the device for implementing the transmitting function in the transceiver unit 611 may be regarded as a transmitting unit, that is, the transceiver unit 611 includes a receiving unit and a transmitting unit. Exemplarily, the receiving unit may also be referred to as a receiver, a receiver, a receiving circuit, and the like, and the transmitting unit may be referred to as a transmitter, a transmitter, or a transmitting circuit, or the like. Optionally, the above-mentioned receiving unit and transmitting unit may be an integrated unit, or may be multiple independent units. The above-mentioned receiving unit and transmitting unit may be located in one geographic location, or may be dispersed in multiple geographic locations.

As shown in FIG. 7 , another embodiment of the present application provides an apparatus 700 . The apparatus 700 may be a terminal, or may be a component of a terminal (eg, an integrated circuit, a chip, etc.). Alternatively, the apparatus may be a network device or a component of a network device (eg, an integrated circuit, a chip, etc.). The device may also be other communication modules, which are used to implement the methods in the method embodiments of the present application. The apparatus 700 may include: a processing module 702 (or referred to as a processing unit). Optionally, a transceiver module 701 (or referred to as a transceiver unit) and a storage module 703 (or referred to as a storage unit) may also be included.

In a possible design, one or more modules as shown in FIG. 7 may be implemented by one or more processors, or by one or more processors and memory; or by one or more processors and a transceiver; or implemented by one or more processors, a memory, and a transceiver, which is not limited in this embodiment of the present application. The processor, memory, and transceiver can be set independently or integrated.

The apparatus has the function of implementing the terminal described in the embodiments of the present application. For example, the apparatus includes modules or units or means corresponding to the terminal-related steps described in the embodiments of the present application by the terminal. The functions or units or The means can be implemented by software, or by hardware, or by executing corresponding software by hardware, or by a combination of software and hardware. For details, further reference may be made to the corresponding descriptions in the foregoing corresponding method embodiments. Alternatively, the apparatus has the function of implementing the network equipment described in the embodiments of the present application. For example, the apparatus includes modules or units or means corresponding to the network equipment performing the steps involved in the network equipment described in the embodiments of the present application. , the functions or units or means (means) may be implemented by software, or by hardware, or by executing corresponding software by hardware, or by a combination of software and hardware. For details, further reference may be made to the corresponding descriptions in the foregoing corresponding method embodiments.

Optionally, each module in the apparatus 700 in the embodiment of the present application may be used to execute the method described in FIG. 3A , FIG. 3B , or FIG. 3C in the embodiment of the present application, or may be used to execute the above three or more graphs. The methods described in are combined with each other.

In a possible design, an apparatus 700 may include: a processing module 702 and a transceiver module 701 .

In an optional design, the transceiver module 701 is configured to send multiple data units to the terminal. The processing module 702 is configured to obtain evaluation parameters according to the corresponding positions of the error data units in the plurality of data units, the processing module 702 is further configured to obtain evaluation information according to the evaluation parameters, and the processing module 702 is further configured to obtain evaluation information according to the evaluation information. The device is controlled to communicate with the terminal.

Optionally, the corresponding position of the erroneous data unit in the plurality of data units corresponds to at least one error sample, and the error sample indicates the position of the erroneous data unit in a first number of data units, and the first The number matches the number of the multiple data units, and the processing module 702 is configured to obtain the evaluation parameters according to the corresponding positions of the erroneous data units in the multiple data units, including: the processing module 702 is configured to obtain the evaluation parameters according to the The evaluation parameter is obtained from the at least one error sample.

Optionally, each error sample in the at least one error sample corresponds to a reference evaluation parameter, and the reference evaluation parameter is related to the degree of influence of the error sample corresponding to the reference evaluation parameter on the user experience. Obtaining the evaluation parameter from the at least one error sample includes: the processing module 702 is configured to obtain the evaluation parameter according to all or part of the reference evaluation parameters corresponding to the at least one error sample.

Optionally, the processing module 702 is configured to obtain the evaluation parameter according to all or part of the reference evaluation parameters corresponding to the at least one error sample, including: the processing module 702 is configured to obtain each error sample in the at least one error sample and Correlation coefficients of the corresponding positions of the erroneous data units in the plurality of data units. The processing module 702 is further configured to obtain the evaluation parameter according to the correlation coefficient and all or part of the reference evaluation parameters.

Optionally, the processing module 702 is configured to obtain the correlation coefficient between each error sample in the at least one error sample and the position corresponding to the error data unit in the plurality of data units, including: when the When the number of the multiple data units is not an integer multiple of the first number, and the number of the multiple data units is greater than the first number, the processing module is configured to: The correlation coefficient is obtained from the location of the erroneous data unit among the number of data units.

Optionally, the first number is an integer multiple of the number of data units included in the group of pictures GoP.

Optionally, the processing module 702 is configured to obtain the evaluation information according to the evaluation parameter, including: the processing module 702 is configured to obtain the evaluation information according to the evaluation parameter and delay information.

In another optional design, the transceiver module 701 is further configured to receive first feedback information from the terminal, and the processing module 702 is configured to obtain an evaluation parameter according to the first feedback information, and the evaluation parameter is related to the error Corresponding positions of the data units in the plurality of data units are related.

In yet another optional design, the transceiver module 701 is configured to receive multiple data units from a network device. The processing module 702 is configured to obtain evaluation parameters according to the corresponding positions of the data units that receive errors in the plurality of data units. The transceiver module 701 is further configured to send first feedback information to the network device, where the first feedback information is used to indicate the evaluation parameter.

Optionally, the transceiver module 701 is further configured to receive first indication information from the network device, where the first indication information is used to indicate at least one error sample, and the error sample indicates that the erroneous data unit is in the first quantity of data. the position in the unit, the first number matches the number of the plurality of data units, and the corresponding position of the received error data unit in the plurality of data units corresponds to the number of errors in the at least one error sample All or part of the error samples. The processing module 702 is configured to obtain the evaluation parameter according to the corresponding position of the received error data unit in the plurality of data units, including: the processing module 702 is configured to obtain the evaluation parameter according to all or part of the error samples .

In yet another optional design, the processing module 702 is further configured to obtain evaluation information according to the evaluation parameter, and send second feedback information to the network device, where the second feedback information is used to indicate the evaluation information .

It should be understood that, in the various embodiments of the present application, the size of the sequence numbers of each process does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, rather than the implementation process of the embodiment. constitute any limitation.

It can be understood that, in some scenarios, some optional features in the embodiments of the present application can be implemented independently of other features, such as the solution currently based on them, to solve corresponding technical problems and achieve corresponding The effect can also be combined with other features according to requirements in some scenarios. Correspondingly, the apparatuses provided in the embodiments of the present application may also implement these features or functions correspondingly, which will not be repeated here.

It can be understood that the processor in this embodiment of the present application may be an integrated circuit chip, which has signal processing capability. In the implementation process, each step of the above method embodiments may be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software. The above-mentioned processor may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable circuits. Programming logic devices, discrete gate or transistor logic devices, discrete hardware components.

The solutions described in this application can be implemented in various ways. For example, these techniques can be implemented in hardware, software, or a combination of hardware. For a hardware implementation, a processing unit for performing the techniques at a communication device (eg, a base station, terminal, network entity, or chip) may be implemented in one or more general purpose processors, DSPs, digital signal processing devices, ASICs, A programmable logic device, FPGA, or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of the above. A general-purpose processor may be a microprocessor, or alternatively, the general-purpose processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented by a combination of computing devices, such as a digital signal processor and a microprocessor, multiple microprocessors, one or more microprocessors in combination with a digital signal processor core, or any other similar configuration. accomplish.

It can be understood that the memory in this embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically programmable Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory. Volatile memory may be random access memory (RAM), which acts as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synchlink DRAM, SLDRAM) ) and direct memory bus random access memory (direct rambus RAM, DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but not be limited to, these and any other suitable types of memory.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line, DSL) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The available media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, high-density digital video discs (DVDs)), or semiconductor media (eg, solid state disks, SSD)) etc.

References in this application to elements in the singular are intended to mean "one or more" rather than "one and only one" unless specifically stated otherwise. In this application, unless otherwise specified, "at least one" is intended to mean "one or more", and "plurality" is intended to mean "two or more".

The term "and/or" in this article is only an association relationship to describe the associated objects, indicating that there can be three kinds of relationships, for example, A and/or B, it can mean that A exists alone, A and B exist at the same time, and A and B exist independently The three cases of B, where A can be singular or plural, and B can be singular or plural. The character "/" generally indicates that the associated objects are an "or" relationship.

The values of the information in each table in this application are only examples, and can be configured as other values, which are not limited in this application. When configuring the corresponding relationship between the information and each parameter, it is not necessarily required to configure all the corresponding relationships indicated in each table. For example, in the tables in this application, the corresponding relationships shown in some rows may not be configured. For another example, appropriate deformation adjustments can be made based on the above table, for example, splitting, merging, and so on. The names of the parameters shown in the headings in the above tables may also adopt other names that can be understood by the communication device, and the values or representations of the parameters may also be other values or representations that the communication device can understand. When the above tables are implemented, other data structures can also be used, such as arrays, queues, containers, stacks, linear lists, pointers, linked lists, trees, graphs, structures, classes, heaps, hash tables, or hash tables. Wait.

Predefined in this application may be understood as defining, predefining, storing, pre-storing, pre-negotiating, pre-configuring, curing, or pre-firing.

Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

A communication method, comprising:

send multiple data units to the terminal;

obtaining evaluation parameters according to the corresponding positions of the erroneous data units in the plurality of data units;

obtain evaluation information according to the evaluation parameters;

It communicates with the terminal according to the evaluation information.
The method of claim 1, wherein:

The corresponding position of the erroneous data unit in the plurality of data units corresponds to at least one error sample, the error sample indicating the position of the erroneous data unit in a first number of data units, the first number and the The number of multiple data units matches;

Obtaining the evaluation parameters according to the corresponding positions of the erroneous data units in the plurality of data units includes:

The evaluation parameter is obtained from the at least one error sample.
The method of claim 2, wherein:

Each error sample in the at least one error sample corresponds to a reference evaluation parameter, and the reference evaluation parameter is related to the degree of influence of the error sample corresponding to the reference evaluation parameter on the user experience;

Obtaining the evaluation parameter according to the at least one error sample includes:

The evaluation parameters are obtained according to all or part of the reference evaluation parameters corresponding to the at least one error sample.
The method according to claim 3, wherein obtaining the evaluation parameters according to all or part of the reference evaluation parameters corresponding to the at least one error sample, comprising:

obtaining a correlation coefficient between each error sample in the at least one error sample and the corresponding position of the error data unit in the plurality of data units;

The evaluation parameters are obtained from the correlation coefficient and the all or part of the reference evaluation parameters.
The method of claim 4, wherein obtaining the correlation coefficient between each error sample in the at least one error sample and the corresponding position of the erroneous data unit in the plurality of data units, comprising: :

When the number of the multiple data units is not an integer multiple of the first number, and the number of the multiple data units is greater than the first number, according to the first number of data included in the multiple data units The correlation coefficient is obtained from the location of the erroneous data unit in the unit.
The method according to any one of claims 2-4, wherein the first number is an integer multiple of the number of data units contained in the group of pictures GoP.
The method according to any one of claims 1-6, wherein obtaining evaluation information according to the evaluation parameters, comprising:

The evaluation information is obtained according to the evaluation parameters and delay information.
A communication method, comprising:

send multiple data units to the terminal;

receiving first feedback information from the terminal;

Obtaining an evaluation parameter according to the first feedback information, where the evaluation parameter is related to the corresponding position of the erroneous data unit in the plurality of data units;

obtain evaluation information according to the evaluation parameters;

It communicates with the terminal according to the evaluation information.
A communication method, comprising:

receive multiple data units from a network device;

obtaining the evaluation parameter according to the position corresponding to the data unit of the received error in the plurality of data units;

Send first feedback information to the network device, where the first feedback information is used to indicate the evaluation parameter.
The method of claim 9, further comprising:

receiving first indication information from the network device, the first indication information being used to indicate at least one error sample, the error sample indicating the position of the erroneous data unit in a first number of data units, the first number of Matching the number of the plurality of data units, the corresponding positions of the received erroneous data units in the plurality of data units correspond to all or part of the error samples in the at least one error sample;

Obtaining the evaluation parameter according to the corresponding position of the received erroneous data unit in the plurality of data units includes:

The evaluation parameters are obtained from all or part of the error samples.
A communication method, comprising:

receive multiple data units from a network device;

obtaining the evaluation parameter according to the position corresponding to the data unit of the received error in the plurality of data units;

obtain evaluation information according to the evaluation parameters;

Send second feedback information to the network device, where the second feedback information is used to indicate the evaluation information.
The method of claim 11, further comprising:

receiving second indication information from the network device, the second indication information being used to indicate at least one error sample, the error sample indicating the position of the erroneous data unit in a first number of data units, the first number of Matching the number of the plurality of data units, the corresponding positions of the received erroneous data units in the plurality of data units correspond to all or part of the error samples in the at least one error sample;

Obtaining the evaluation parameter according to the corresponding position of the received erroneous data unit in the plurality of data units includes:

The evaluation parameters are obtained from all or part of the error samples.
A communication device, characterized in that it includes a processing module and a transceiver module,

The transceiver module is used for sending a plurality of data units to the terminal;

The processing module is configured to obtain evaluation parameters according to the corresponding positions of the error data units in the plurality of data units;

The processing module is further configured to obtain evaluation information according to the evaluation parameter;

The processing module is further configured to control the device to communicate with the terminal according to the evaluation information.
14. The apparatus of claim 13, wherein a corresponding position of the erroneous data unit in the plurality of data units corresponds to at least one error sample, the error sample indicating that the erroneous data unit is in the first number of data units the position in the unit, the first quantity matches the quantity of the plurality of data units,

The processing module is configured to obtain the evaluation parameter according to the corresponding position of the error data unit in the plurality of data units, including:

The processing module is configured to obtain the evaluation parameter according to the at least one error sample.
The apparatus of claim 14, wherein each error sample in the at least one error sample corresponds to a reference evaluation parameter, and the reference evaluation parameter and the error sample corresponding to the reference evaluation parameter have an impact on user experience degree related,

The processing module is configured to obtain the evaluation parameter according to the at least one error sample, including:

The processing module is configured to obtain the evaluation parameter according to all or part of the reference evaluation parameters corresponding to the at least one error sample.
The apparatus according to claim 15, wherein the processing module is configured to obtain the evaluation parameters according to all or part of the reference evaluation parameters corresponding to the at least one error sample, comprising:

The processing module is configured to obtain a correlation coefficient between each error sample in the at least one error sample and the corresponding position of the error data unit in the plurality of data units;

The processing module is further configured to obtain the evaluation parameters according to the correlation coefficient and all or part of the reference evaluation parameters.
The apparatus according to claim 16, wherein the processing module is configured to obtain all of the corresponding positions of each error sample in the at least one error sample and the erroneous data unit in the plurality of data units The correlation coefficients described above include:

When the number of the multiple data units is not an integer multiple of the first number, and the number of the multiple data units is greater than the first number, the processing module is configured to include according to the multiple data units The correlation coefficient is obtained at the location of the erroneous data unit in the first number of data units.
The apparatus according to any one of claims 14-16, wherein the first number is an integer multiple of the number of data units contained in the group of pictures GoP.
The apparatus according to any one of claims 13-18, wherein the processing module is configured to obtain the evaluation information according to the evaluation parameter, comprising:

The processing module is configured to obtain the evaluation information according to the evaluation parameters and delay information.
A communication device, characterized in that it includes a processing module and a transceiver module,

The transceiver module is used for sending a plurality of data units to the terminal;

The transceiver module is further configured to receive first feedback information from the terminal;

The processing module is configured to obtain an evaluation parameter according to the first feedback information, where the evaluation parameter is related to the corresponding position of the erroneous data unit in the plurality of data units;

The processing module is further configured to obtain evaluation information according to the evaluation parameter;

The processing module is further configured to control the device to communicate with the terminal according to the evaluation information.
A communication device, characterized in that it includes a processing module and a transceiver module,

The transceiver module is used for receiving a plurality of data units from a network device;

The processing module is configured to obtain the evaluation parameter according to the corresponding position of the data unit in the plurality of data units according to the received error;

The transceiver module is further configured to send first feedback information to the network device, where the first feedback information is used to indicate the evaluation parameter.
The apparatus of claim 21, wherein

The transceiver module is further configured to receive first indication information from the network device, where the first indication information is used to indicate at least one error sample, and the error sample indicates the number of error data units in the first number of data units. a position, the first number matches the number of the plurality of data units, and the corresponding position of the received erroneous data unit in the plurality of data units corresponds to all or part of the at least one error sample error sample;

The processing module is configured to obtain the evaluation parameter according to the corresponding position of the received error data unit in the plurality of data units, including:

The processing module is configured to obtain the evaluation parameter according to the whole or part of the error samples.
A communication device, characterized in that it includes a processing module and a transceiver module,

The transceiver module is used for receiving a plurality of data units from a network device;

The processing module is configured to obtain the evaluation parameter according to the corresponding position of the data unit in the plurality of data units according to the received error;

The processing module is further configured to obtain evaluation information according to the evaluation parameter;

The transceiver module is further configured to send second feedback information to the network device, where the second feedback information is used to indicate the evaluation information.
The apparatus of claim 23, wherein

The transceiver module is further configured to receive second indication information from the network device, where the second indication information is used to indicate at least one error sample, and the error sample indicates the number of error data units in the first number of data units. a position, the first number matches the number of the plurality of data units, and the corresponding position of the received erroneous data unit in the plurality of data units corresponds to all or part of the at least one error sample error sample;

The processing module is configured to obtain the evaluation parameter according to the corresponding position of the received error data unit in the plurality of data units, including:

The processing module is configured to obtain the evaluation parameter according to the whole or part of the error samples.
A communication device, characterized in that it comprises: a processor coupled with a memory, the memory is used to store a program or an instruction, when the program or instruction is executed by the processor, the device causes the device A method as claimed in any one of claims 1 to 8 is performed.
A communication device, characterized in that it comprises: a processor coupled with a memory, the memory is used to store a program or an instruction, when the program or instruction is executed by the processor, the device causes the device A method as claimed in any one of claims 9 to 12 is performed.
A communication device, characterized in that, the device is configured to execute the method according to any one of claims 1 to 8.
A communication device, characterized in that the device is configured to execute the method of any one of claims 9 to 12.
A communication device, characterized in that the device comprises a module for performing the method of any one of claims 1 to 8.
A communication device, characterized in that the device comprises a module for performing the method of any one of claims 9 to 12.
A computer program product comprising computer program codes, characterized in that, when the computer program codes are run on a computer, the computer is made to implement the method according to any one of claims 1 to 8, Or cause a computer to implement the method of any one of claims 9 to 12.
A computer-readable storage medium on which a computer program or instruction is stored, characterized in that, when the computer program or instruction is executed, the computer executes the method according to any one of claims 1 to 8, or A computer is caused to implement the method of any one of claims 9 to 12.