WO2021134346A1

WO2021134346A1 - Feedback method and apparatus

Info

Publication number: WO2021134346A1
Application number: PCT/CN2019/130178
Authority: WO
Inventors: 黄曲芳
Original assignee: 华为技术有限公司
Priority date: 2019-12-30
Filing date: 2019-12-30
Publication date: 2021-07-08

Abstract

A feedback method and apparatus. The method comprises: when a second protocol layer of a first terminal device receives first information of a first protocol layer of the first terminal device, the first terminal device generates second information; the first terminal device sends the first information and the second information. The second protocol layer may be a lower protocol layer of the first protocol layer. By means of the method, a lower protocol layer of a first terminal device generates second information while an upper protocol layer of the first terminal device generates first information, and the first terminal device sends both the first information of the upper protocol layer and the second information of the lower protocol layer each time, so that information of multiple protocol layers can be fed back, and a sender can determine the corresponding state of each protocol layer in the first terminal device.

Description

Feedback method and device

Technical field

This application relates to the field of wireless communication technology, and in particular to a feedback method and device.

Background technique

With the continuous development of wireless communication networks, the support for multimedia services has become stronger and stronger, and multimedia services have also brought better visual experience to users. Currently, a multimedia service called extended reality (XR) is more and more popular with users. Compared with the existing virtual reality (VR), XR's biggest difference is that the content displayed by XR will change with the user's location, the angle of sight, etc., bringing users an immersive experience . In the VR service, no matter how the user changes his position or turns his sight, the content that the user feels remains the same.

For XR services, the content encoded by the encoder of the sender is affected by the feedback information sent by the receiver. For example, if a user watches a ball game, the user's line of sight angle remains unchanged, and the game screen in the line of sight will continue to change as the game progresses. However, relative to the sampling rate of 50-100 frames per second, the player's movements are in two frames. The changes between them are very small, that is to say, there is a strong correlation between the pictures of each frame. If the previous data packet has been successfully received, the encoder of the sender can encode only the changed part of the picture, which can significantly reduce the amount of encoded data. However, if the previous data packet is not successfully received, the sender can not only encode the changed part of the subsequent pictures, but encode all the pictures.

Since the data between the sender and the receiver needs to be processed by multiple protocol layers in the protocol stack, each protocol layer has its own feedback, for example, the medium access control (MAC) layer has hybrid automatic retransmission Request (hybrid automatic repeat request, HARQ) feedback, radio link control (RLC) layer has status report, and packet data convergence protocol (packet data convergence protocol, PDCP) layer has status report, etc. Since each protocol layer only feeds back the data reception status of that protocol layer, the sender cannot accurately determine whether the sent data reaches the application layer of the receiver. For a data packet, if the sender does not receive feedback from the receiver’s application layer for a long time, the sender regards the data packet as not received, and the sender’s encoding module will not implement differential encoding, resulting in data redundancy after encoding. The amount of data sent is large.

Summary of the invention

The purpose of the embodiments of the present application is to provide a feedback method and device to solve the problem of how to send feedback.

In a first aspect, the present application provides a feedback method, including: a second protocol layer of a first terminal device receives first information of a first protocol layer of the first terminal device, and the first terminal device generates a second Information; the second protocol layer is a lower protocol layer of the first protocol layer; the first terminal device sends the first information and the second information.

Through the above method, when the upper protocol layer of the first terminal device generates the first information, the lower protocol layer of the first terminal device generates the second information at the same time, and the first terminal device simultaneously sends the first information of the upper protocol layer and the lower layer each time The second information of the protocol layer can realize the feedback of the information of multiple protocol layers at the same time, so that the sender can simultaneously determine the state corresponding to the multiple protocol layers in the first terminal device.

In a possible implementation manner, the second protocol layer of the first terminal device receives the first information of the first protocol layer of the first terminal device, and the first terminal device generates the second information, including :

The second protocol layer of the first terminal device receives the first information from the first protocol layer of the first terminal device, when it is determined that the Internet Protocol IP quintuple corresponding to the first information When the IP quintuple is preset, the second information is generated; or, when the second protocol layer of the first terminal device receives all information from the first protocol layer of the first terminal device When the first information is described, the second information is generated.

In a possible implementation manner, the first information is used to indicate the data reception status of the first protocol layer of the first terminal device, or the first information is used to indicate the connection with the first terminal device At least one of the position change and the viewing angle change of the extended reality XR display device; the second information is used to indicate the data reception status of the second protocol layer of the first terminal device.

In the above method, the first terminal device can simultaneously feed back the data reception status of multiple protocol layers, so that the data sender can obtain multiple protocol layers such as the first protocol layer and the second protocol layer in the first terminal device at the same time. In this way, the reception status of the sent data at the first terminal device can be accurately determined, thereby reducing the occurrence of redundant coding.

In a possible implementation manner, the first protocol layer is an application layer, and the second protocol layer is at least one of a transmission control protocol RTP layer and a packet convergence data protocol PDCP layer; or the first protocol The layer is at least one of an application layer and an RTP layer, and the second protocol layer is a PDCP layer.

In a possible implementation manner, when the second protocol layer is an RTP layer, the second information includes the first sequence number or the second sequence number or the third information; the third information is used to indicate the The number of data packets buffered by the second protocol layer N or the total number of bits of the buffered data packets; the first sequence number is one of the N data packet sequence numbers corresponding to the N data packets buffered by the second protocol layer The smallest data packet sequence number, where the second sequence number is the largest data packet sequence number among the N data packet sequence numbers corresponding to the N data packets buffered by the second protocol layer, and N is an integer greater than 0.

In a possible implementation, when the second information includes the first sequence number or the second sequence number, the second information also includes a first bitmap; the first bitmap is used to indicate The N data packets buffered by the second protocol layer, and the unreceived data packets whose sequence numbers are located among the N data packets buffered by the second protocol layer.

In a possible implementation, when the second protocol layer is a PDCP layer, the second information includes a second bitmap or fourth information; the second bitmap is used to indicate the second bitmap The reception status of the first unreceived data packet of the protocol layer and the P data packets after the first unreceived data packet, where P is an integer greater than 0;

The fourth information is used to indicate the number of data packets received by the second protocol layer but not delivered to the first protocol layer; or the fourth information is used to indicate that the second protocol layer received , But not the total number of bits of the data packet submitted to the first protocol layer.

In the second aspect, the present application also provides a communication device that has any method provided in the first aspect. The communication device can be implemented by hardware, or can be implemented by hardware executing corresponding software. The hardware or software includes one or more units or units corresponding to the above-mentioned functions.

In a possible implementation manner, the communication device includes a processor configured to support the communication device to perform the corresponding function of the first terminal device in the above-mentioned method. The communication device may further include a memory, and the storage may be coupled with the processor, which stores program instructions and data necessary for the communication device. Optionally, the communication device further includes a communication interface, and the communication interface is used to support communication between the communication device and equipment such as network equipment.

In a possible implementation manner, the communication device includes corresponding functional units, which are respectively used to implement the steps in the above method. The function can be realized by hardware, or the corresponding software can be executed by hardware. The hardware or software includes one or more units corresponding to the above-mentioned functions.

In a possible implementation manner, the structure of the communication device includes a processing unit and a communication unit, and these units can perform corresponding functions in the foregoing method examples. For details, refer to the description of the method provided in the first aspect, and details are not repeated here.

In a third aspect, the present application provides a feedback method, including: a network device receives second information from a first terminal device; the network device determines control layer feedback information according to the second information; wherein the control layer feedback The information is used to indicate the data receiving status of the second protocol layer of the first terminal device; the network device sends the control layer feedback information to the server.

In a possible implementation manner, the second information is used to indicate the data receiving status of the second protocol layer of the first terminal device.

In a possible implementation manner, the second information includes a second bitmap or fourth information;

The second bitmap is used to indicate the first unreceived data packet of the second protocol layer of the first terminal device, and P data packets after the first unreceived data packet The receiving status of the data packet, P is an integer greater than 0;

The fourth information is used to indicate the number of data packets received by the second protocol layer but not delivered to the first protocol layer; or the fourth information is used to indicate that the second protocol layer has received it, but The total number of bits of data packets that are not delivered to the first protocol layer; the second protocol layer is a lower protocol layer of the first protocol layer.

In a possible implementation manner, the control layer feedback information includes the third bitmap and the first data packet;

Alternatively, the control layer feedback information includes the fifth information and the first data packet;

Wherein, the third bitmap is used to indicate the reception status of the first unreceived data packet of the second protocol layer and the P data packets after the first unreceived data packet; The first data packet is the first unreceived data packet of the second protocol layer;

The fifth information is used to indicate the number of data packets received by the second protocol layer but not delivered to the first protocol layer of the first terminal device; or the fifth information is used to indicate the first protocol layer The total number of bits of the data packet received by the second protocol layer but not delivered to the first protocol layer of the first terminal device.

In a possible implementation manner, the second protocol layer is a PDCP layer.

In a fourth aspect, the present application also provides a communication device having any method provided in the third aspect. The communication device can be implemented by hardware, or can be implemented by hardware executing corresponding software. The hardware or software includes one or more units or units corresponding to the above-mentioned functions.

In a possible implementation manner, the communication device includes a processor configured to support the communication device to perform the corresponding function of the network device in the method shown above. The communication device may further include a memory, and the storage may be coupled with the processor, which stores program instructions and data necessary for the communication device. Optionally, the communication device further includes a communication interface, and the communication interface is used to support communication between the communication device and a device such as the first terminal device.

In a possible implementation manner, the structure of the communication device includes a processing unit and a communication unit, and these units can perform corresponding functions in the foregoing method examples. For details, refer to the description of the method provided in the third aspect, which is not repeated here.

In a fifth aspect, this application provides a feedback method, including: a server sends service data to a first terminal device through a network device;

The server receives at least one of the first information, the second information, and the control layer feedback information;

Wherein, the control layer feedback information is used to indicate the data reception status of the second protocol layer of the first terminal device;

The server determines the reception status of the service data according to at least one of the first information, the second information, and the control layer feedback information.

In a possible implementation manner, the first information is used to indicate the data reception status of the first protocol layer of the first terminal device, or the location of the extended reality XR display device connected to the first terminal device At least one of change and perspective change;

The second information is used to indicate the data receiving status of the second protocol layer of the first terminal device.

In a possible implementation manner, the first protocol layer is an application layer, and the second protocol layer is at least one of a transmission control protocol RTP layer and a packet convergence data protocol PDCP layer;

Or the first protocol layer is at least one of an application layer and an RTP layer, and the second protocol layer is a PDCP layer.

In a sixth aspect, the present application also provides a communication device that has any method provided in the fifth aspect. The communication device can be implemented by hardware, or can be implemented by hardware executing corresponding software. The hardware or software includes one or more units or units corresponding to the above-mentioned functions.

In a possible implementation manner, the communication device includes a processor configured to support the communication device to perform the corresponding function of the server in the method shown above. The communication device may further include a memory, and the storage may be coupled with the processor, which stores program instructions and data necessary for the communication device. Optionally, the communication device further includes a communication interface, and the communication interface is used to support communication between the communication device and equipment such as network equipment.

In a seventh aspect, the present application provides a communication device that includes a processor, and when the processor executes a computer program or instruction in a memory, as described in the first or third or fifth aspects The method is executed.

In an eighth aspect, the present application provides a communication device. The communication device includes a processor and a memory. The memory is used to store computer programs or instructions; the processor is used to execute the computer programs or instructions stored in the memory. So that the communication device executes the corresponding method as shown in the first aspect or the third aspect or the fifth aspect.

In a ninth aspect, the present application provides a communication device that includes a processor, a memory, and a transceiver. The transceiver is used to receive signals or send signals; and the memory is used to store computer programs or instructions; The processor is configured to call the computer program or instruction from the memory to execute the method according to the first aspect or the third aspect or the fifth aspect.

In a tenth aspect, the present application provides a communication device, the communication device includes a processor and an interface circuit, the interface circuit is configured to receive code instructions and transmit them to the processor; the processor runs the code instructions In order to perform the corresponding method as shown in the first aspect or the third aspect or the fifth aspect.

In an eleventh aspect, the present application provides a computer-readable storage medium for storing a computer program or instruction. When the computer reads and executes the computer program or instruction, the first aspect or The method described in the third or fifth aspect is implemented.

In a twelfth aspect, the present application provides a computer program product including instructions. When the computer reads and executes the computer program product, the method described in the first aspect or the third aspect or the fifth aspect is realized.

In a thirteenth aspect, the present application provides a chip including a processor, the processor is coupled with a memory, and is configured to execute a computer program or instruction stored in the memory. When the processor executes the computer program or instruction At this time, the method described in the first aspect or the third aspect or the fifth aspect is realized.

In a fourteenth aspect, the present application provides a system including the communication device provided in the foregoing second aspect, the communication device provided in the foregoing fourth aspect, and the communication device provided in the foregoing sixth aspect.

Description of the drawings

FIG. 1 is a schematic diagram of a network architecture applicable to an embodiment of the present application;

FIG. 2 is a schematic diagram of a protocol stack structure provided by an embodiment of the application;

FIG. 3 is a schematic flowchart of a feedback method provided by an embodiment of the application;

FIG. 4 is a schematic diagram of a data packet reception status of an RTP layer provided by an embodiment of this application;

FIG. 5 is a schematic diagram of a data packet reception status of the PDCP layer according to an embodiment of the application;

FIG. 6 is a schematic structural diagram of a communication device provided by an embodiment of this application;

FIG. 7 is a schematic structural diagram of a communication device provided by an embodiment of this application.

Detailed ways

The embodiments of the present application will be described in further detail below in conjunction with the accompanying drawings.

The embodiments of the present application can be applied to transmit various service data, such as XR service data, in a mobile communication system such as 5G. As shown in FIG. 1, it is a schematic diagram of a network architecture applicable to an embodiment of the present application. Figure 1 includes a first terminal device, a second terminal device, a server, and a network device. Of course, the network shown in FIG. 1 may also include other devices, which will not be listed here.

Taking XR service data as an example, the second terminal device may collect data, for example, including but not limited to audio data and video data, and the second terminal device sends the quantized and encoded data to the server through the encoder.

The server processes the data from the second terminal device, such as video compression processing on image data, and then passes through the Real-time Transport Protocol (RTP) layer, the User Datagram Protocol (UDP) layer, The Internet protocol (IP) layer and other protocol layers are processed through the transport layer to the network equipment. Among them, when performing video compression processing on image data, any video compression codec protocol can be used for video compression, such as the High Efficiency Video Coding protocol or the H.266 protocol. Not limited.

The network equipment passes the received data through the Service Data Adaptation Protocol (SDAP), the Packet Data Convergence Protocol (PDCP) layer, the radio link control (RLC) layer, and the media interface. After the protocol layers such as the medium access control (MAC) layer and the physical (Physical, PHY) layer are processed, they are transmitted to the first terminal device through the wireless interface.

In XR, the first terminal device is connected to an XR display device, for example, via a universal serial bus (Universal Serial Bus, USB) or via Bluetooth or wireless connection. The first terminal device can provide video image data for the XR display device, and the XR display device can display the acquired video image data to the user through three-dimensional dynamic view, entity behavior interaction, etc., to provide users with an immersive application Experience.

In combination with the above description, the protocol stack corresponding to the architecture shown in FIG. 1 may be as shown in FIG. 2. In Figure 2, how the different protocol layers process data is not limited in the embodiment of the present application, and will not be repeated here. It should be noted that in Figure 2, the XR display device may not include a decoder. At this time, the first terminal device includes a decoder, and the first terminal device sends the decoded data to the XR display device through the decoder. The XR display device Display the obtained video data directly.

For XR services, the content encoded by the encoder of the second terminal device is affected by the feedback information sent by the first terminal device. For example, when a user watches a ball game through an XR display device, assuming that the user's line of sight angle does not change, the game screen in the line of sight will continue to change as the game progresses, but when the user's line of sight angle does not change, between the two frames The change is very small, so there is a strong correlation between the pictures of each frame. If the previous data packet has been successfully received, the encoder of the second terminal device can encode only the changed part of the picture, which can significantly reduce the amount of encoded data. However, if the previous data packet is not successfully received, the second terminal device cannot only encode the changed part of the subsequent picture, but should provide more detailed encoding information, such as encoding all the pictures.

Since the first terminal device receives the data, the data is processed sequentially between different protocol layers, so there is a certain time delay between when the second terminal device sends the data to the first terminal device's decoder receives the data, Therefore, the feedback information generated by the decoder of the first terminal device may not reflect the data receiving status of the first terminal device. After receiving such feedback information, the second terminal device does not perform differential encoding on subsequent data packets, thereby increasing the amount of encoded data. For this reason, the present application provides a method that can improve the accuracy of the first terminal device's feedback of the data receiving state and reduce the amount of coding of the second terminal device.

In the embodiments of this application, the terminal device may be a device with a wireless transceiver function or a chip that can be installed in any device, and may also be referred to as user equipment (UE), access terminal, user unit, or user station. , Mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, wireless communication device, user agent or user device. The terminal equipment in the embodiments of this application may be a mobile phone (mobile phone), a tablet computer (Pad), a computer with wireless transceiver function, a virtual reality (VR) terminal, an augmented reality (AR) terminal, an industrial Wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical, wireless terminals in smart grid, transportation safety Wireless terminals in the smart city (smart city), wireless terminals in the smart home (smart home), and so on.

The network equipment can be the next-generation base station (next Generation node B, gNB) in the NR system, the evolutional node B (eNB) in the LTE system, or the global system of mobile communication. The base station (BTS) in the GSM) system or the code division multiple access (CDMA) system, or the base station (nodeB) in the wideband code division multiple access (WCDMA) system , NB) and so on.

The network architecture and business scenarios described in the embodiments of this application are intended to more clearly illustrate the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. Those of ordinary skill in the art will know that with the network With the evolution of architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are equally applicable to similar technical problems.

In combination with the foregoing description, as shown in FIG. 3, it is a schematic flowchart of a feedback method provided by an embodiment of this application. Referring to Figure 3, the method includes:

Step 301: The second protocol layer of the first terminal device receives the first information of the first protocol layer of the first terminal device, and the first terminal device generates the second information.

Before step 301, the first terminal device may receive the service data sent by the server through the network device. The service data may include video data, audio data, etc., which is not limited in the embodiment of the present application. The service data sent by the server may be collected by the second terminal device. How to collect the service data will not be repeated here.

Exemplarily, in this embodiment of the present application, the second protocol layer is a lower protocol layer of the first protocol layer.

For example, when the first protocol layer is an application layer, the second protocol layer may be an RTP layer, or a PDCP layer, or an RTP layer and a PDCP layer.

For another example, when the first protocol layer is an application layer or an RTP layer, or an application layer and an RTP layer, the second protocol layer may be a PDCP layer, and other situations will not be described again.

In the embodiment of the present application, the first protocol layer of the first terminal device can feed back the reception status of the service data during the process of receiving the service data sent by the server through the network device, so that the server can determine which data is successfully received and which data fails to be received . To this end, the first protocol layer of the first terminal device may generate first information. In this case, the first information may be used to indicate the data reception status of the first protocol layer of the first terminal device.

Or, in XR, when the user wears the XR display device, the user may move, causing the position and viewing angle of the XR display device to change. For this reason, the first terminal device can indicate the position change and viewing angle of the XR display device through the first information At least one of the changes, so that the second terminal device performs encoding according to the position and angle of view indicated by the first information when encoding, thereby improving encoding efficiency.

For example, the second terminal device uses multiple 360-degree cameras and audio collectors to continuously collect audio and video data. Therefore, the encoder of the second terminal device encodes all the collected audio and video data, which can be called "Complete Data". If the user is wearing an XR display device, the area viewed by the current user’s perspective is area B1; the encoder of the second terminal device can perform high-precision encoding on the data corresponding to area B1 in the "full set of data", while leaving the user's eyes behind The image of the area covered by the light reduces the coding accuracy, and the parts that are invisible to the user's eyes, such as the area facing the back of the head, need not be coded. When the area viewed by the user’s perspective is changed to area B2, the first terminal indicates the change in perspective through the first information. At this time, the encoder of the second terminal device can perform high-precision data on the data corresponding to area B2 in the "full set of data". The data corresponding to area B1 can be encoded with low precision or not. In this way, the purpose of reducing the amount of coding and reducing the amount of transmitted data can be achieved without reducing the user experience.

Exemplarily, in this embodiment of the present application, the second information may be used to indicate the data reception status of the second protocol layer of the first terminal device. The specific content of the second information will be described below and will not be repeated here.

In combination with the foregoing description, in a possible implementation manner, when the second protocol layer of the first terminal device receives the first information from the first protocol layer of the first terminal device, the first The information makes any judgment and directly generates the second information.

In another possible implementation manner, the server or the network device may configure a preset IP quintuple for the first terminal device. When the first information is used to indicate the data reception status of the first protocol layer of the first terminal device, the first information is carried by a data packet using a preset IP quintuple.

In this implementation manner, when the second protocol layer of the first terminal device obtains the first information from the first protocol layer of the first terminal device, when determining the IP five yuan corresponding to the first information When the group is a preset IP 5-tuple, it can be determined that the first information is used to indicate the data reception status of the first protocol layer of the first terminal device, so that the second information can be generated; accordingly, when it is determined that the first information corresponds to When the IP quintuple of is not a preset IP quintuple, the second information may not be generated.

Step 302: The first terminal device sends the first information and the second information.

It should be noted that the first information and the second information are sent to the server through the network device.

Further, the first information is transparently transmitted to the server through the network device. When the second protocol layer is the RTP layer, the second information is also transparently transmitted to the server through the network device; when the second protocol layer is the PDCP layer, the network device can determine the control layer feedback information based on the second information, and then send it to the server For the feedback information of the control layer, please refer to the following description for details.

Step 303: The network device receives the second information from the first terminal device.

The network device may also receive the first information from the first terminal device, and forward the first information to the server.

Step 304: The network device determines control layer feedback information according to the second information, and sends the control layer feedback information to the server.

Step 305: The server receives at least one of the first information, the second information, and the control layer feedback information;

Step 306: The server determines the reception status of the service data according to at least one of the first information, the second information, and the control layer feedback information.

In the above process, since the first protocol layer is the upper protocol layer of the second protocol layer, when the first protocol layer of the first terminal device sends the first information, the second protocol layer of the first terminal device also sends the first information. In the case of second information, the first terminal device can feed back information of multiple protocol layers at the same time, so that the server can obtain the information of multiple protocol layers in the first terminal device, and the server can accurately determine that the service data sent by the server is in the first terminal device. The receiving status at the terminal equipment, thereby reducing the occurrence of redundant coding.

The previous process is described below through specific embodiments.

The following is a flow of a data transmission method provided in an embodiment of the application. In the following process, the first protocol layer is used as the application layer, and the second protocol layer includes the RTP layer and the PDCP layer as an example for description. For other situations, reference may be made to the description here, which will not be repeated here.

Step 1: The server sends service data to the first terminal device through the network device.

It should be noted that the service data sent by the server is collected and encoded by the second terminal device and then sent to the server.

Step 2: The first terminal device receives service data.

Step 3: The application layer of the first terminal device generates the first information.

In step 3, the first information generated by the first terminal device may be generated according to the reception status of the service data. In this case, the first information may be used to indicate the data reception status of the application layer of the first terminal device.

Alternatively, the first information generated by the first terminal device may also have nothing to do with the reception status of the service data. In this case, the first information may be used to indicate the position change and the viewing angle change of the extended reality XR display device connected to the first terminal device. At least one of.

Exemplarily, when the first information is used to indicate the data receiving status of the application layer of the first terminal device, the IP quintuple of the data packet including the first information may be a preset IP quintuple.

Optionally, in this embodiment of the present application, the network device may determine a separate logical channel for the first information sent by the application layer of the first terminal device, that is, the first information is processed by a PDCP entity of the network device alone, and is not related to the first information. Other data sent by a terminal device shares a PDCP entity.

The first information generated by the application layer of the first terminal device needs to be processed by the lower protocol layer of the application layer in the protocol stack and then sent to the network device, that is, the RTP layer and PDCP layer of the first terminal device will receive the first information.

For the convenience of description, in the following description, the second information generated when the RTP layer receives the first information is called the RTP status report; the second information generated when the PDCP layer receives the first information is called the PDCP status report. The RTP status report is used to indicate the data reception status of the RTP layer of the first terminal device; the PDCP status report is used to indicate the data reception status of the PDCP layer of the first terminal device, which will be described in detail below.

Step 4: The RTP layer of the first terminal device receives the first information and generates an RTP status report.

Exemplarily, the RTP status report may include one or more of the first sequence number, the second sequence number, the first bitmap, and the third information.

Wherein, the third information is used to indicate the number N of data packets buffered by the RTP layer of the first terminal device, and the data packet sequence number is located among the N data packets buffered by the RTP layer of the first terminal device that have not been received. At least one item of the number K of data packets, or the third information is used to indicate the total number of bits of data packets buffered by the RTP layer of the first terminal device, N is an integer greater than 0, and K is an integer greater than 0.

The first sequence number is the smallest data packet sequence number among the N data packet sequence numbers corresponding to the N data packets buffered by the RTP layer of the first terminal device; the second sequence number is the N data packet sequence numbers buffered by the RTP layer of the first terminal device The largest data packet sequence number among the N data packet sequence numbers corresponding to the data packet.

The first bitmap is used to indicate the N data packets buffered by the RTP layer of the first terminal device, and the unreceived data whose sequence numbers are located among the N data packets buffered by the RTP layer of the first terminal device package.

The RTP status report may also include other information, such as the first time, the second time, and other information, which will not be repeated here. Wherein, the first time is the receiving time of the data packet corresponding to the first sequence number, and the second time is the receiving time of the data packet corresponding to the second sequence number.

Exemplarily, the first moment and the second moment, etc., may be represented by Global Positioning System (GPS) time, for example, the first moment is 17:02 pm on October 22, 2019: 38 seconds: 408ms : 260ns; the second moment is 17:02 pm on October 22, 2019: 38 seconds: 840ms:50ns.

For example, in combination with the foregoing description, assuming that N=10, the data packet sequence numbers of the 10 data packets buffered in the RTP layer of the first terminal device may be as shown in FIG. 4. In FIG. 4, the RTP layer of the first terminal device receives a data packet with a data packet sequence number of 709 at the first moment, and a data packet with a data packet sequence number of 722 at the second moment. The data packet sequence numbers of the 10 data packets received in the RTP layer of the first terminal device are 709, 710, 712, 713, 714, 717, 718, 720, 721, and 722, respectively. Among them, the first sequence number, that is, the smallest data packet sequence number in the data packets buffered by the RTP layer of the first terminal device, is 709; the second sequence number, that is the largest data packet in the data packets buffered by the RTP layer of the first terminal device The packet sequence number is 722.

Further, the data packet sequence numbers are located among the 10 data packets buffered by the RTP layer of the first terminal device, and the data packet sequence numbers of the unreceived data packets are 711, 715, 716, and 719, respectively.

Assuming that each data packet corresponds to a bit, a bit value of 1 indicates that the RTP layer of the first terminal device buffers the data packet, and a bit value of 0 indicates that the RTP layer of the first terminal device does not receive the data packet, then follow the data packet sequence The order of numbers from small to large, the first bitmap corresponding to Figure 4 can be expressed as follows: 11011100110111; the bit corresponding to 709 is on the far left of the first bitmap, and the bit corresponding to 722 is on the far right of the first bitmap. .

Or, according to the sequence number of the data packet in descending order, the first bitmap corresponding to FIG. 4 may be expressed as follows: 11101100111011. The bit corresponding to 722 is on the far left of the first bitmap, and the bit corresponding to 709 is on the far right of the first bitmap.

With reference to the example in Figure 4, the RTP status report can be any of the following:

1. The RTP status report includes: the third information: the number of data packets buffered by the RTP layer 10; the first bitmap: 11011100110111 or 11101100111011.

2. The RTP status report includes: the first serial number: 709; the first bitmap: 11011100110111 or 11101100111011.

3. The RTP status report includes: the second serial number: 722; the first bitmap: 11101100111011 or 11101100111011.

4. The RTP status report includes: the second sequence number: 722; the third information: the number of data packets buffered by the RTP layer 10, and the data packet sequence number between the 10 data packets that has not been received. Quantity 4.

5. The RTP status report includes: the first sequence number: 709; the third information: the number of data packets buffered by the RTP layer 10, and the data packet sequence number between these 10 data packets that has not been received. Quantity 4.

The above are just examples, and there may be other implementations including the RTP state, which will not be listed here.

Step 5: When the PDCP layer of the first terminal device receives at least one of the first information of the application layer of the first terminal and the RTP status report of the RTP layer, a PDCP status report is generated.

It should be noted that there may also be a precondition for the PDCP status report generated by the PDCP layer of the first terminal device: the PDCP entity corresponding to the PDCP layer of the first terminal device is configured to be delivered in order. In the case that the PDCP entity is configured to deliver in order, the PDCP layer of the first terminal device generates the PDCP status report when it receives at least one of the first information and the RTP status report.

In the embodiment of this application, the PDCP status report may include one or more of the following:

The third data packet sequence number; the second bitmap; the fourth information.

Among them, the third data packet sequence number refers to the sequence number of the first data packet not received by the PDCP layer of the first terminal device; the second bitmap is used to indicate the first data packet of the PDCP layer of the first terminal device. For the received data packet and the reception status of P data packets after the first unreceived data packet, P is an integer greater than 0.

The fourth information is used to indicate the number of data packets received by the PDCP layer of the first terminal device but not delivered to the RTP layer of the first terminal device; or the fourth information is used to indicate the PDCP layer of the first terminal device The total number of bits of the data packet received by the layer but not delivered to the RTP layer of the first terminal device.

For example, in combination with the foregoing description, assuming P=9, as shown in FIG. 5, the data packet sequence number of the first unreceived data packet of the PDCP layer of the first terminal device is 49. The data packet sequence numbers of the data packets received by the PDCP layer of the first terminal device are 50, 51, 52, 53, 55, 56 and 58 respectively.

With reference to Figure 6, the second bitmap corresponding to the reception status of the next 9 data packets of the data packet whose sequence number is 49 is 0111101101, where 1 means that the data packet corresponding to this bit has been received, and 0 means this bit The data packet corresponding to the bit has not been received yet.

Of course, the above is just an example. The PDCP status report can also indicate other information, such as indicating the number of data packets correctly received by the PDCP layer of the first terminal device and the number of data packets incorrectly received, without indicating which data packet has been received. To, which data packet has not been received yet. For example, in the situation corresponding to Figure 5, the content of the PDCP status report includes: there are 10 packets in the PDCP buffer, 3 of which have not been received, and 7 of them have been received.

For another example, the PDCP status report may also indicate one or more of the total number of bits of the data packet correctly received by the PDCP layer and the total number of bits of the data packet incorrectly received by the PDCP layer, and other situations will not be repeated.

Step 6: The first terminal device sends one or more of the first information, the RTP status report, and the PDCP status report to the network device.

Step 7: When the network device receives the first information and the RTP status report, it forwards the first information and the RTP status report to the server; when receiving the PDCP status report, the control layer feedback information can be determined according to the PDCP status report, and Send the control layer feedback information to the server.

Wherein, the control layer feedback information may be used to indicate the data reception status of the PDCP layer of the first terminal device.

It should be noted that, from the schematic diagram of the protocol stack in FIG. 2, since there is no PDCP protocol layer in the server, the PDCP status report of the first terminal device cannot be parsed. For this reason, the network device needs to convert the PDCP status report into control layer feedback information.

In this embodiment of the application, the control layer feedback information may include one or more of the following:

The third bit map; the first data packet; the fifth information.

Wherein, the third bitmap is used to indicate the reception status of the first unreceived data packet of the PDCP layer of the first terminal device and the P data packets after the first unreceived data packet ；

The first data packet is the first unreceived data packet of the PDCP layer of the first terminal device;

The fifth information is used to indicate the number of data packets received by the PDCP layer of the first terminal device but not delivered to the RTP layer of the first terminal device; or, the fifth information is used to indicate the number of data packets of the first terminal device The number of data packets received by the PDCP layer but not delivered to the RTP layer of the first terminal device; or the fifth information is used to indicate that the PDCP layer of the first terminal device has received but not delivered to the RTP layer of the first terminal device The total number of bits in the data packet delivered by the layer.

It should be noted that the third bitmap may be determined according to the second bitmap in the PDCP status report. For example, the network device may directly use the second bitmap in the PDCP status report as the third bitmap. Alternatively, the network device may also convert the second bitmap in the PDCP status report into a third bitmap. For example, the second bitmap is 0111101101, where 1 indicates that the data packet corresponding to this bit has been received, and 0 indicates that the data packet corresponding to this bit has not been received. The third bitmap determined by the network device may be 1000010010, where 0 indicates that the data packet corresponding to this bit has been received, and 1 indicates that the data packet corresponding to this bit has not been received. Of course, this is just an example, and other cases will not be illustrated one by one.

In this embodiment of the present application, the first data packet may be determined in multiple ways. In a possible implementation manner, the first data packet may be determined according to the third data packet sequence number in the PDCP status report. For example, the PDCP entity of the network device records the data packet sequence number of the data packet before sending the data packet of the PDCP layer to the first terminal device. When the network device obtains the third data packet sequence in the PDCP status report, the data packet corresponding to the third data packet sequence number may be used as the first data packet.

It should be noted that for a certain protocol layer, a data packet from an upper protocol layer above the protocol layer can be called a service data unit (SDU), and after being processed by the protocol layer, it is sent to The data packets of the lower protocol layer can be called PDU. For example, the data packet from the upper protocol layer received by the PDCP layer can be called PDCP SDU, and the data packet sent to the lower protocol layer after PDCP layer processing can be called PDCP PDU. The PDCP layer processing here may include operations such as assigning data packet sequence numbers, header compression, encryption, integrity protection, and adding headers.

In the above implementation, the PDCP entity of the network device receives a data packet from the upper protocol layer, saves it as a PDCP SDU, and allocates a PDCP sequence number to the PDCP SDU. The third data packet sequence number in the PDCP status report received by the network device is the PDCP sequence number allocated by the network device, so the first data packet determined by the network device according to the third data packet sequence number is the PDCP SDU.

It should be noted that the PDCP layer of the network device may also buffer multiple data packets, and the network device may extract the first data packet from the data packets buffered by the PDCP layer according to the third data packet sequence number.

In another possible implementation manner, the first data packet may be determined according to the third bitmap in the PDCP status report. For example, the PDCP entity of the network device records the data packet sequence number of the data packet before sending the data packet of the PDCP layer to the first terminal device. When the network device obtains the third bitmap in the PDCP status report, it can determine the first unreceived data packet of the PDCP layer of the first terminal device according to the third bitmap, so that the first data packet can be determined.

In another possible implementation manner, the network device may generate a PDCP layer data packet transmission record result. Each time the PDCP layer of a specific network device sends a PDCP layer data packet to the first terminal device, it records the data packet transmission on the air interface. Therefore, the PDCP layer data packet transmission record result generated by the network device can determine the PDCP layer of the network device Whether the data packet of the layer is correctly received by the first terminal device. For example, after the PDCP layer of the network device sends a PDCP layer data packet to the first terminal device, if it receives an Acknowledgement (ACK) corresponding to the data packet, it can be determined that the first terminal device has correctly received the data packet; If a negative acknowledgement (Negative Acknowledgement, NACK) corresponding to the data packet is received, it can be determined that the first terminal device did not correctly receive the data packet. Among them, if the data packet is divided into multiple segments for transmission, when all segments receive the ACK, it can be determined that the data packet is received correctly.

In this implementation manner, when the network device receives the PDCP status report, it can determine the first unreceived data packet of the PDCP layer of the first terminal device according to the PDCP layer data packet transmission record result.

Optionally, in this implementation manner, the network device may also periodically send the PDCP layer data packet transmission record result to the server. Or, when the network device determines that the trigger condition is satisfied, it sends the PDCP layer data packet transmission record result to the server. For example, the trigger condition is: the number of data packet transmission failures is equal to the preset threshold. At this time, when the network device determines that the number of transmission failures is equal to the preset threshold, it sends the PDCP layer packet transmission record result to the server. Of course, the trigger condition may also be in other forms, which will not be listed here.

Step 8: The server determines the reception status of the service data according to at least one of the first information, the RTP status report, and the control layer feedback information.

Specifically, when the first information is used to indicate the data reception status of the first protocol layer of the first terminal device, the server may determine which data packets are received by the first protocol layer of the first terminal device according to the first information; the server It may be determined according to the RTP status report which data packets are received by the RTP layer of the first terminal device, and which data packets among the received data packets have not been delivered to the application layer of the first terminal device.

When the first information is used to indicate at least one of the position change and the viewing angle change of the XR display device connected to the first terminal device, the server may according to at least one of the position change and the viewing angle change of the XR display device, Determine how to encode the data.

Similarly, the server can determine which data packets are received by the PDCP layer of the first terminal device according to the PDCP status report, and which data packets of the received data packets have not been delivered to the RTP layer.

The server may generate sixth information according to at least one of the first information, the RTP status report, and the control layer feedback information. The sixth information is used to indicate one of the application layer, the RTP layer, and the PDCP layer of the first terminal device or A plurality of service data receiving states, and at least one of a position change and a viewing angle change of the XR display device connected to the first terminal device. The server may send the sixth information to the second terminal device.

The second terminal device may adjust the compression mode of the data packet according to the sixth information. For example, the second terminal device determines that the data packet corresponding to the first video frame has been correctly received, but it has not been delivered to the application layer of the first terminal device, and the second terminal device can check the data packet associated with the first video frame. The video frame is differentially encoded, or the associated video frame is compressed more aggressively, thereby reducing the amount of data encoding and data transmission.

For another example, after determining the position change and viewing angle change of the XR display device according to the sixth information, the second terminal device can perform high-precision coding on the data of the area that the XR display device needs to display, and/or, The data within the viewing angle range is encoded with high precision; correspondingly, the second terminal device can perform low-precision encoding on data in other areas or within the viewing angle range, or not encoding data in other areas or within the viewing angle range. Therefore, the purpose of reducing the amount of coding and reducing the amount of transmitted data can be achieved without reducing the user experience.

The various embodiments described in this document may be independent solutions, or may be combined according to internal logic, and these solutions fall within the protection scope of the present application.

It can be understood that, in the foregoing method embodiments, the methods and operations implemented by the terminal device can also be implemented by components (such as chips or circuits) that can be used in the terminal device, and the methods and operations implemented by the network device can also be implemented by It can be implemented by components (such as chips or circuits) of network devices.

In the foregoing embodiments provided in the present application, the methods provided in the embodiments of the present application are respectively introduced from the perspective of interaction between various devices. In order to realize each function in the method provided in the above embodiments of the present application, the terminal device and the network device may include a hardware structure and/or software module, and the above functions are implemented in the form of a hardware structure, a software module, or a hardware structure plus a software module. . Whether a certain function among the above-mentioned functions is executed by a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraint conditions of the technical solution.

The division of modules in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation. In addition, the functional modules in the various embodiments of the present application may be integrated in one processor, or may exist alone physically, or two or more modules may be integrated in one module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules.

Similar to the above-mentioned concept, as shown in FIG. 6, an embodiment of the present application further provides an apparatus 600 for implementing the function of the first terminal device or network device or server in the above-mentioned method. For example, the device may be a software module or a chip system. In the embodiments of the present application, the chip system may be composed of chips, or may include chips and other discrete devices. The apparatus 600 may include: a processing unit 601 and a communication unit 602.

In the embodiment of the present application, the communication unit may also be referred to as a transceiver unit, and may include a sending unit and/or a receiving unit, which are respectively configured to perform the sending and receiving steps of the terminal device or the network device in the above method embodiment.

Hereinafter, the communication device provided by the embodiment of the present application will be described in detail with reference to FIGS. 6 to 7. It should be understood that the description of the device embodiment and the description of the method embodiment correspond to each other. Therefore, for the content that is not described in detail, please refer to the above method embodiment. For brevity, it will not be repeated here.

In a possible design, the apparatus 600 can implement the steps or processes executed by the terminal device or the network device in the above method embodiment, which are described separately below.

Exemplarily, when the apparatus 600 implements the function of the first terminal device in the process shown in FIG. 3:

The processing unit 601 is configured to generate second information when the second protocol layer of the device receives the first information of the first protocol layer of the device; the second protocol layer is that of the first protocol layer Lower protocol layer;

The communication unit 602 is configured to send the first information and the second information.

In a possible implementation manner, the processing unit 601 is specifically configured to:

The second protocol layer of the device receives the first information from the first protocol layer of the device, and when it is determined that the Internet Protocol IP quintuple corresponding to the first information is a preset IP quintuple When grouping, generate the second information;

Alternatively, when the second protocol layer of the device receives the first information from the first protocol layer of the device, the second information is generated.

In a possible implementation manner, the first information is used to indicate the data reception status of the first protocol layer of the device, or the first information is used to indicate an extended reality XR display device connected to the device At least one of the position change and the viewing angle change;

In a possible implementation manner, when the second protocol layer is an RTP layer, the second information includes a first sequence number or a second sequence number or third information;

The third information is used to indicate the number of data packets buffered by the second protocol layer N or the total number of bits of the buffered data packets; the first sequence number is the N data packets buffered by the second protocol layer The smallest data packet sequence number among the corresponding N data packet sequence numbers, where the second sequence number is the largest data packet sequence number among the N data packet sequence numbers corresponding to the N data packets buffered by the second protocol layer , N is an integer greater than 0.

In a possible implementation manner, when the second information includes the first sequence number or the second sequence number, the second information further includes a first bitmap;

The first bitmap is used to indicate the N data packets buffered by the second protocol layer, and the unreceived data whose sequence numbers are located among the N data packets buffered by the second protocol layer package.

In a possible implementation manner, when the second protocol layer is a PDCP layer, the second information includes a second bitmap or fourth information;

The second bitmap is used to indicate the reception status of the first unreceived data packet of the second protocol layer and the P data packets after the first unreceived data packet, and P is An integer greater than 0;

Exemplarily, when the apparatus 600 implements the function of the network device in the process shown in FIG. 3:

The communication unit 602 is configured to receive second information from the first terminal device;

The processing unit 601 is configured to determine control layer feedback information according to the second information;

The communication unit 602 is configured to send the control layer feedback information to the server.

In a possible implementation manner, the second protocol layer is a PDCP layer.

Exemplarily, when the device 600 implements the function of the server in the process shown in FIG. 3:

The communication unit 602 is configured to send service data to the first terminal device through the network device; receive at least one of the first information, the second information, and control layer feedback information;

The processing unit 601 is configured to determine the reception status of the service data according to at least one of the first information, the second information, and the control layer feedback information.

FIG. 7 shows a device 700 provided by an embodiment of the application, and the device shown in FIG. 7 may be a hardware circuit implementation of the device shown in FIG. 6. The communication device can be applied to the flowchart shown in FIG. 3 to perform the functions of the first terminal device or the network device or the server in the foregoing method embodiment. For ease of description, FIG. 7 only shows the main components of the communication device.

The apparatus 700 shown in FIG. 7 includes at least one processor 701, configured to implement any method in FIG. 2 provided in the embodiment of the present application.

The device 700 may also include at least one memory 703 for storing program instructions and/or data. The memory 703 and the processor 701 are coupled. The coupling in the embodiments of the present application is an indirect coupling or communication connection between devices, units or modules, and may be in electrical, mechanical or other forms, and is used for information exchange between devices, units or modules. The processor 701 may cooperate with the memory 703 to operate. The processor 701 may execute program instructions stored in the memory 703. At least one of the at least one memory may be included in the processor.

In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or instructions in the form of software. The steps of the method disclosed in combination with the embodiments of the present application may be embodied as being executed and completed by a hardware processor, or executed and completed by a combination of hardware and software modules in the processor. The software module can be located in a mature storage medium in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.

It should be noted that the processor in the embodiment of the present application may be an integrated circuit chip with signal processing capability. In the implementation process, the steps of the foregoing method embodiments can be completed by hardware integrated logic circuits in the processor or instructions in the form of software. The above-mentioned processor may be a general-purpose processor, a digital signal processing circuit (digital signal processor, DSP), a dedicated integrated circuit (application specific integrated circuit, ASIC), a field programmable gate array (field programmable gate array, FPGA) or other Programming logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application may be embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

It can be understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. Among them, the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electrically available Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory. The volatile memory may be random access memory (RAM), which is used as an external cache. By way of exemplary but not restrictive description, many forms of RAM are available, such as static random access memory (static RAM, SRAM), dynamic random access memory (dynamic RAM, DRAM), and synchronous dynamic random access memory (synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (synchlink DRAM, SLDRAM) ) And direct memory bus random access memory (direct rambus RAM, DR RAM). It should be noted that the memories of the systems and methods described herein are intended to include, but are not limited to, these and any other suitable types of memories.

The apparatus 700 may further include a communication interface 702 for communicating with other devices through a transmission medium, so that the apparatus used in the apparatus 700 can communicate with other devices. In the embodiment of the present application, the communication interface may be a transceiver, circuit, bus, module, or other type of communication interface. In the embodiment of the present application, when the communication interface is a transceiver, the transceiver may include an independent receiver and an independent transmitter; it may also be a transceiver with integrated transceiver functions, or an interface circuit.

The device 700 may also include a communication line 704. Among them, the communication interface 702, the processor 701, and the memory 703 may be connected to each other through a communication line 704; the communication line 704 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (extended industry standard architecture). , Referred to as EISA) bus and so on. The communication line 704 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is used in FIG. 7, but it does not mean that there is only one bus or one type of bus.

Exemplarily, when the apparatus 700 implements the function of the first terminal device in the process shown in FIG. 3:

The processor 701 is configured to generate second information when the second protocol layer of the device receives the first information of the first protocol layer of the device; the second protocol layer is that of the first protocol layer Lower protocol layer;

The communication interface 702 is used to send the first information and the second information.

In a possible implementation manner, the processor 701 is specifically configured to:

Exemplarily, when the apparatus 700 implements the function of the network device in the process shown in FIG. 3:

The communication interface 702 is used to receive the second information from the first terminal device;

The processor 701 is configured to determine control layer feedback information according to the second information;

The communication interface 702 is used to send the control layer feedback information to the server.

In a possible implementation manner, the second protocol layer is a PDCP layer.

Exemplarily, when the device 700 implements the function of the server in the process shown in FIG. 3:

The communication interface 702 is configured to send service data to a first terminal device through a network device; receive at least one of the first information, the second information, and control layer feedback information;

The processor 701 is configured to determine the reception status of the service data according to at least one of the first information, the second information, and the control layer feedback information.

Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.

This application is described with reference to flowcharts and/or block diagrams of methods, equipment (systems), and computer program products according to this application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

Obviously, those skilled in the art can make various changes and modifications to the application without departing from the scope of the application. In this way, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, then this application is also intended to include these modifications and variations.

Claims

A feedback method, characterized in that it includes:

The second protocol layer of the first terminal device receives the first information of the first protocol layer of the first terminal device, and the first terminal device generates second information; the second protocol layer is the first protocol The lower protocol layer of the layer;

The first terminal device sends the first information and the second information.
The method according to claim 1, wherein the second protocol layer of the first terminal device receives the first information of the first protocol layer of the first terminal device, and the first terminal device generates the first information of the first protocol layer of the first terminal device. Two information, including:

The second protocol layer of the first terminal device receives the first information from the first protocol layer of the first terminal device, when it is determined that the Internet Protocol IP quintuple corresponding to the first information When it is a preset IP quintuple, generating the second information;

Or, when the second protocol layer of the first terminal device receives the first information from the first protocol layer of the first terminal device, the second information is generated.
The method according to claim 1 or 2, wherein the first information is used to indicate the data receiving status of the first protocol layer of the first terminal device, or the first information is used to indicate the At least one of a position change and a viewing angle change of the extended reality XR display device connected to the first terminal device;

The second information is used to indicate the data receiving status of the second protocol layer of the first terminal device.
The method according to any one of claims 1 to 3, wherein the first protocol layer is an application layer, and the second protocol layer is at least one of a transmission control protocol RTP layer and a packet convergence data protocol PDCP layer item;

Or the first protocol layer is at least one of an application layer and an RTP layer, and the second protocol layer is a PDCP layer.
The method according to any one of claims 1 to 4, wherein when the second protocol layer is an RTP layer, the second information includes a first sequence number or a second sequence number or third information;

The third information is used to indicate the number of data packets buffered by the second protocol layer N or the total number of bits of the buffered data packets; the first sequence number is the N data packets buffered by the second protocol layer The smallest data packet sequence number among the corresponding N data packet sequence numbers, where the second sequence number is the largest data packet sequence number among the N data packet sequence numbers corresponding to the N data packets buffered by the second protocol layer , N is an integer greater than 0.
The method according to claim 5, wherein when the second information includes the first serial number or the second serial number, the second information further includes a first bitmap;

The first bitmap is used to indicate the N data packets buffered by the second protocol layer, and the unreceived data whose sequence numbers are located among the N data packets buffered by the second protocol layer package.
The method according to any one of claims 1 to 6, wherein when the second protocol layer is a PDCP layer, the second information includes a second bitmap or fourth information;

The second bitmap is used to indicate the reception status of the first unreceived data packet of the second protocol layer and the P data packets after the first unreceived data packet, and P is An integer greater than 0;

The fourth information is used to indicate the number of data packets received by the second protocol layer but not delivered to the first protocol layer; or the fourth information is used to indicate that the second protocol layer received , But not the total number of bits of the data packet submitted to the first protocol layer.
A feedback method, characterized in that it includes:

The network device receives the second information from the first terminal device;

Determining, by the network device, control layer feedback information according to the second information;

Wherein, the control layer feedback information is used to indicate the data reception status of the second protocol layer of the first terminal device;

The network device sends the control layer feedback information to the server.
The method according to claim 8, wherein the second information is used to indicate the data receiving status of the second protocol layer of the first terminal device.
The method according to claim 9, wherein the second information comprises a second bitmap or fourth information;

The second bitmap is used to indicate the first unreceived data packet of the second protocol layer of the first terminal device, and P data packets after the first unreceived data packet The receiving status of the data packet, P is an integer greater than 0;

The fourth information is used to indicate the number of data packets received by the second protocol layer but not delivered to the first protocol layer; or the fourth information is used to indicate that the second protocol layer has received it, but The total number of bits of data packets that are not delivered to the first protocol layer; the second protocol layer is a lower protocol layer of the first protocol layer.
The method according to claim 10, wherein the control layer feedback information includes the third bitmap and the first data packet;

Alternatively, the control layer feedback information includes the fifth information and the first data packet;

Wherein, the third bitmap is used to indicate the reception status of the first unreceived data packet of the second protocol layer and the P data packets after the first unreceived data packet; The first data packet is the first unreceived data packet of the second protocol layer;

The fifth information is used to indicate the number of data packets received by the second protocol layer but not delivered to the first protocol layer of the first terminal device; or the fifth information is used to indicate the first protocol layer The total number of bits of the data packet received by the second protocol layer but not delivered to the first protocol layer of the first terminal device.
The method according to any one of claims 8 to 11, wherein the second protocol layer is a PDCP layer.
A feedback method, characterized in that it includes:

The server sends service data to the first terminal device through the network device;

The server receives at least one of the first information, the second information, and the control layer feedback information;

Wherein, the control layer feedback information is used to indicate the data reception status of the second protocol layer of the first terminal device;

The server determines the reception status of the service data according to at least one of the first information, the second information, and the control layer feedback information.
The method according to claim 13, wherein the first information is used to indicate the data reception status of the first protocol layer of the first terminal device, or the extended reality XR connected to the first terminal device At least one of the position change and the viewing angle change of the display device;

The second information is used to indicate the data receiving status of the second protocol layer of the first terminal device.
The method according to any one of claims 13 to 14, wherein the first protocol layer is an application layer, and the second protocol layer is at least one of a transmission control protocol RTP layer and a packet convergence data protocol PDCP layer item;

Or the first protocol layer is at least one of an application layer and an RTP layer, and the second protocol layer is a PDCP layer.
A communication device, characterized in that it comprises:

The processing unit is configured to generate second information when the second protocol layer of the device receives the first information of the first protocol layer of the device; the second protocol layer is a lower layer of the first protocol layer Protocol layer

The communication unit is configured to send the first information and the second information.
The device according to claim 16, wherein the processing unit is specifically configured to:

The second protocol layer of the device receives the first information from the first protocol layer of the device, and when it is determined that the Internet Protocol IP quintuple corresponding to the first information is a preset IP quintuple When grouping, generate the second information;

Alternatively, when the second protocol layer of the device receives the first information from the first protocol layer of the device, the second information is generated.
The device according to claim 16 or 17, wherein the first information is used to indicate the data reception status of the first protocol layer of the device, or the first information is used to indicate the connection with the device At least one of the position change and the viewing angle change of the extended reality XR display device;

The second information is used to indicate the data receiving status of the second protocol layer of the first terminal device.
The device according to any one of claims 16 to 18, wherein the first protocol layer is an application layer, and the second protocol layer is at least one of a transmission control protocol RTP layer and a packet convergence data protocol PDCP layer item;

Or the first protocol layer is at least one of an application layer and an RTP layer, and the second protocol layer is a PDCP layer.
The apparatus according to any one of claims 16 to 19, wherein when the second protocol layer is an RTP layer, the second information includes a first sequence number or a second sequence number or third information;

The third information is used to indicate the number of data packets buffered by the second protocol layer N or the total number of bits of the buffered data packets; the first sequence number is the N data packets buffered by the second protocol layer The smallest data packet sequence number among the corresponding N data packet sequence numbers, where the second sequence number is the largest data packet sequence number among the N data packet sequence numbers corresponding to the N data packets buffered by the second protocol layer , N is an integer greater than 0.
The device according to claim 20, wherein when the second information includes the first serial number or the second serial number, the second information further includes a first bitmap;

The first bitmap is used to indicate the N data packets buffered by the second protocol layer, and the unreceived data whose sequence numbers are located among the N data packets buffered by the second protocol layer package.
The apparatus according to any one of claims 16 to 21, wherein when the second protocol layer is a PDCP layer, the second information includes a second bitmap or fourth information;

The second bitmap is used to indicate the reception status of the first unreceived data packet of the second protocol layer and the P data packets after the first unreceived data packet, and P is An integer greater than 0;

The fourth information is used to indicate the number of data packets received by the second protocol layer but not delivered to the first protocol layer; or the fourth information is used to indicate that the second protocol layer received , But not the total number of bits of the data packet submitted to the first protocol layer.
A communication device, characterized in that it comprises:

The communication unit is configured to receive second information from the first terminal device;

A processing unit, configured to determine control layer feedback information according to the second information;

Wherein, the control layer feedback information is used to indicate the data reception status of the second protocol layer of the first terminal device;

The communication unit is configured to send the control layer feedback information to the server.
The apparatus according to claim 23, wherein the second information is used to indicate the data reception status of the second protocol layer of the first terminal device.
The device according to claim 24, wherein the second information comprises a second bitmap or fourth information;

The second bitmap is used to indicate the first unreceived data packet of the second protocol layer of the first terminal device, and P data packets after the first unreceived data packet The receiving status of the data packet, P is an integer greater than 0;

The fourth information is used to indicate the number of data packets received by the second protocol layer but not delivered to the first protocol layer; or the fourth information is used to indicate that the second protocol layer has received it, but The total number of bits of data packets that are not delivered to the first protocol layer; the second protocol layer is a lower protocol layer of the first protocol layer.
The device according to claim 25, wherein the control layer feedback information includes the third bitmap and the first data packet;

Alternatively, the control layer feedback information includes the fifth information and the first data packet;

Wherein, the third bitmap is used to indicate the reception status of the first unreceived data packet of the second protocol layer and the P data packets after the first unreceived data packet; The first data packet is the first unreceived data packet of the second protocol layer;

The fifth information is used to indicate the number of data packets received by the second protocol layer but not delivered to the first protocol layer of the first terminal device; or the fifth information is used to indicate the first protocol layer The total number of bits of the data packet received by the second protocol layer but not delivered to the first protocol layer of the first terminal device.
The device according to any one of claims 23 to 26, wherein the second protocol layer is a PDCP layer.
A communication device, characterized in that it comprises:

The communication unit is configured to send service data to the first terminal device through the network device; receive at least one of the first information, the second information, and control layer feedback information;

Wherein, the control layer feedback information is used to indicate the data reception status of the second protocol layer of the first terminal device;

The processing unit is configured to determine the reception status of the service data according to at least one of the first information, the second information, and the control layer feedback information.
The apparatus according to claim 28, wherein the first information is used to indicate the data reception status of the first protocol layer of the first terminal device, or the extended reality XR connected to the first terminal device At least one of the position change and the viewing angle change of the display device;

The second information is used to indicate the data receiving status of the second protocol layer of the first terminal device.
The device according to any one of claims 28 to 29, wherein the first protocol layer is an application layer, and the second protocol layer is at least one of a transmission control protocol RTP layer and a packet convergence data protocol PDCP layer item;

Or the first protocol layer is at least one of an application layer and an RTP layer, and the second protocol layer is a PDCP layer.
A communication device, comprising: a memory and a processor, the memory is used to store instructions, the processor is used to execute the instructions stored in the memory, and the execution of the instructions stored in the memory is such that The processor is configured to execute the method according to any one of claims 1 to 7 or 8 to 12 or 13 to 15.
A computer-readable storage medium, characterized by comprising computer-readable instructions, when a communication device reads and executes the computer-readable instructions, the communication device causes the communication device to execute claims 1 to 7 or 8 to 12 or The method of any one of 13 to 15.
A computer program product, characterized by comprising computer-readable instructions, when a communication device reads and executes the computer-readable instructions, the communication device executes claims 1 to 7 or 8 to 12 or 13 to 15 The method of any one of.