WO2022242362A1

WO2022242362A1 - Image data sending method, image data receiving method, terminal, chip, and storage medium

Info

Publication number: WO2022242362A1
Application number: PCT/CN2022/085779
Authority: WO
Inventors: 许超杰
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-05-19
Filing date: 2022-04-08
Publication date: 2022-11-24
Also published as: CN115379231A

Abstract

Disclosed in embodiments of the present application are an image data sending method, an image data receiving method, a terminal, a chip, and a storage medium. A first wireless terminal performs hierarchical encoding on image data to obtain a first data component and a second data component, modulates the first data component according to a first modulation order to obtain first processed data, modulates the second data component according to a second modulation order to obtain second processed data, and generates a data packet corresponding to the image data according to the first processed data and the second processed data and sends the data packet to a second wireless terminal. The second wireless terminal demodulates the first processed data to obtain the first data component and verifies the first data component to obtain a verification result, if the verification result is "succeeding in verification", demodulates the second processed data to obtain the second data component, and combines and decodes the first data component and the second data component to obtain the image data.

Description

Image data sending and receiving method, terminal, chip and storage medium

Cross References to Related Applications

This application is based on a Chinese patent application with application number 202110546189.4 and a filing date of May 19, 2021, and claims the priority of this Chinese patent application. The entire content of this Chinese patent application is hereby incorporated by reference into this application.

technical field

The present application relates to the technical field of communication, and in particular to a method for sending and receiving image data, a terminal, a chip and a storage medium.

Background technique

At present, in the wireless communication system, the WLAN technology based on 802.11 (Wi-Fi) screen projection solution is based on the traditional Wi-Fi Direct (Wi-Fi Direct) technology, and the video data is processed by the video encoding module. compression.

However, the existing Wi-Fi projection technology has the disadvantage of large delay, so it can only be applied to scenarios that do not require real-time performance, such as playing movies, etc., but cannot be applied to scenarios that require real-time performance, such as online mobile games, etc. .

It can be seen that how to reduce the delay of the Wi-Fi screen projection technology, thereby improving the projection effect and expanding the application scenarios of the screen projection has become an urgent problem to be solved.

Contents of the invention

Embodiments of the present application provide a method for sending and receiving image data, a terminal, a chip, and a storage medium.

The technical scheme of the embodiment of the application is realized in this way:

In a first aspect, an embodiment of the present application provides a method for sending image data in a first wireless terminal, the method including:

performing layered encoding processing on the image data to obtain a first data component and a second data component; wherein, the first data component represents contour data in the image data; the second data component represents the image details in the data;

performing modulation processing on the first data component according to a first modulation order to obtain first processed data; performing modulation processing on the second data component according to a second modulation order to obtain second processed data; wherein, the first modulation order is smaller than the second modulation order;

Generate a data packet corresponding to the image data according to the first processed data and the second processed data, and send the data packet to a second wireless terminal.

In a second aspect, the embodiment of the present application provides a method for receiving image data in a second wireless terminal, the method is applied in the second wireless terminal, and the method includes:

Receive a data packet corresponding to the image data sent by the first wireless terminal; wherein the data packet includes first processed data and second processed data;

Demodulating the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data;

performing verification processing on the first data component to obtain a verification result;

If the verification result is a successful verification, demodulating the second processed data to obtain a second data component; wherein the second data component represents the detail data in the image data;

performing combined decoding processing on the first data component and the second data component to obtain the image data.

In a third aspect, an embodiment of the present application provides a first wireless terminal, where the first wireless terminal includes: a coding unit, a modulating unit, a generating unit, and a sending unit,

The coding unit is configured to perform layered coding processing on image data to obtain a first data component and a second data component; wherein, the first data component represents contour data in the image data; the second The data component characterizes detail data in the image data;

The modulation unit is configured to perform modulation processing on the first data component according to a first modulation order to obtain first processed data; perform modulation processing on the second data component according to a second modulation order to obtain second processed data; wherein, the first modulation order is smaller than the second modulation order;

The generating unit is configured to generate a data packet corresponding to the image data according to the first processed data and the second processed data;

The sending unit is configured to send the data packet to a second wireless terminal.

In a fourth aspect, the embodiment of the present application provides a first wireless terminal. The first wireless terminal includes a first processor and a first memory storing instructions executable by the first processor. When the instructions are executed When the first processor executes, implement the method as described in the first aspect.

In a fifth aspect, the embodiment of the present application provides a second wireless terminal, where the second wireless terminal includes: a receiving unit, a checking unit, a demodulating unit, and a decoding unit,

The receiving unit is configured to receive a data packet corresponding to the image data sent by the first wireless terminal; wherein the data packet includes first processed data and second processed data;

The demodulation unit is configured to demodulate the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data;

The verification unit is configured to perform verification processing on the first data component to obtain a verification result;

The demodulation unit is further configured to demodulate the second processed data to obtain a second data component if the verification result is a successful verification; wherein the second data component represents detail data in said image data;

The decoding unit is configured to perform combined decoding processing on the first data component and the second data component to obtain the image data.

In a sixth aspect, the embodiment of the present application provides a second wireless terminal, where the second wireless terminal includes a second processor and a second memory storing instructions executable by the second processor. When the instructions are executed When the second processor executes, implement the method as described in the second aspect.

In the seventh aspect, the embodiment of the present application provides a chip, the chip includes a processor and an interface, the processor obtains program instructions through the interface, and the processor is used to run the program instructions to execute the The method described in one aspect or the second aspect.

Description of drawings

Figure 1 is a schematic diagram of the implementation of Wi-Fi projection;

FIG. 2 is a first schematic diagram of the implementation flow of the method for sending image data;

FIG. 3 is a second schematic diagram of the implementation flow of the method for sending image data;

FIG. 4 is a schematic diagram of a first implementation flow of a method for receiving image data;

FIG. 5 is a second schematic diagram of the implementation flow of the image data receiving method;

FIG. 6 is a schematic diagram of an implementation flow of a method for sending and receiving image data;

7 is a schematic structural diagram of a first wireless terminal performing screen projection processing of image data;

FIG. 8 is a schematic structural diagram of a second wireless terminal performing screen projection processing of image data;

Fig. 9 is a schematic diagram of verification processing;

FIG. 10 is a first structural diagram of a first wireless terminal;

FIG. 11 is a second structural schematic diagram of the first wireless terminal;

FIG. 12 is a first structural diagram of a second wireless terminal;

FIG. 13 is a second structural schematic diagram of a second wireless terminal.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the specific embodiments described here are only used to explain the related application, not to limit the application. It should also be noted that, for the convenience of description, only the parts related to the relevant application are shown in the drawings.

With the development of electronic technology, it is becoming more and more common to transfer data from one device to another device for display, such as transferring a video played on a mobile phone or a tablet to a smart TV for display and playback.

The current Wi-Fi projection solution is based on the traditional Wi-Fi direct connection technology, and the video data is compressed by the video encoding module.

Miracast is a wireless display standard based on Wi-Fi Direct. 3C devices (Communication, Computer, Consumer) that support this standard can share video screens wirelessly, for example, mobile phones can directly transfer videos or photos to TVs or Other devices do not need any connection wires, and do not need to go through a wireless hotspot (Access Point, AP).

Taking the Miracast standard formulated by the Wi-Fi Alliance as an example, the data output from the source terminal (Source) to the screen will be directly transmitted to the receiver terminal (Sink) through Wi-Fi peer-to-peer (Peer-to-Peer) technology. Since video data usually requires a large throughput, video or image data at the source end is usually compressed using a video encoder (H.264 or H.265) to reduce throughput.

Figure 1 is a schematic diagram of the implementation of Wi-Fi projection. As shown in Figure 1, taking the mobile phone as the signal source and the smart TV as the receiving end as an example, the mobile phone can play video image data on the configured screen. At the same time, it can also pass The encoder encodes the video image data, and then sends the encoded data to the Wi-Fi transmitter to be sent to the smart TV through the transmitting antenna. Correspondingly, the smart TV receives the encoded data sent by the mobile phone through the receiving antenna and Wi-Fi receiver, and then sends the encoded data to the decoder, and decodes to obtain the corresponding video image data, and the smart TV can process the video image data Display and playback, so that Wi-Fi projection can be realized.

There are also some screen projection solutions that use the Joint Source-Channel Coding (JSCC) coding technology, but the wireless transmission technology is not built on Wi-Fi, but an incompatible dedicated physical layer is developed , such as using different Modulation Coding Scheme (MCS) modulation technologies in different time slots for video layered transmission, and the JSCC technology built on the dedicated wireless physical layer, similar schemes cannot maximize the use of existing protocol standards and Industrial supporting, high cost, difficult to promote. .

At present, the Wi-Fi projection technology has the disadvantage of large delay. The delay mainly comes from two aspects: one is the encoding delay and the retransmission delay of signal transmission. Among them, only the encoding delay of H.264 technology will bring On the other hand, because Wi-Fi communication technology is based on the technology of Carrier Sense Multiple Access and Collision Avoidance (CSMA/CA), each transmission needs to compete for the air interface, especially for video data. The required throughput rate is high, and high-order modulated Wi-Fi signals need to be used for carrying. However, high-order modulated signals have high requirements on the signal-to-noise ratio. Once there is interference or non-ideal characteristics in the communication environment, it is easy to cause error packets ( Frame Check Sequence (FCS) verification failure) triggers retransmission, resulting in a large delay.

Furthermore, the current Wi-Fi projection technology still has the problem of unstable image quality. The H.264 encoding technology required for screen projection encodes images into I frames, B frames, and P frames. Among them, the I frame is a key frame. Once the I frame is lost, the subsequent 29 frames will not be able to be decoded (calculated based on the usual I frame interval of 30), which will lead to problems such as video freezes and blurred screens. The projection effect is poor and serious. affect user experience.

It can be seen that due to the existence of problems such as large delays and video freezes, the current Wi-Fi screen projection technology can actually only be applied to scenarios that do not require real-time performance, such as playing movies, but cannot be applied to scenarios that require real-time performance. Scenarios, such as online mobile games, etc.

In order to solve the problems of large delay, poor projection effect, and limited application scenarios in Wi-Fi projection technology, the image sending and receiving method proposed in this application uses Wi-Fi, OFDMA technology and video image layered transmission Combined, it can simultaneously take into account the image clarity and real-time performance of the projection screen. Among them, the improvement of real-time performance mainly comes from: improving transmission robustness, reducing retransmission, and reducing the frequency of air interface competition.

In some embodiments of the present application, in conventional solutions, a single Wi-Fi packet can only support a single MCS mode, so a high MCS mode is required for video projection. However, if the high MCS mode is used, the channel signal-to-noise ratio is required to be higher, and the retransmission is usually increased. However, in this application, the retransmission rate of the system is equal to the retransmission rate of the low-order MCS mode corresponding to the profile data, thereby greatly reducing the retransmission rate.

In some embodiments of the present application, in the conventional solution, the outline data and the detail data are separately packaged and sent, so they must compete for the air interface respectively. In this application, profile data and detail data can be sent together in the same packet, and only need to compete for the air interface once; in addition, after the retransmission rate is reduced, the frequency of air interface competition is also effectively reduced.

In other words, the image sending and receiving method proposed in this application has high transmission robustness, low retransmission rate, and less air interface competition, which can greatly reduce transmission delay, thereby improving the effect of screen projection and effectively expanding the application of screen projection Scenes.

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

An embodiment of the present application provides a method for sending an image, and the method can be applied to a first wireless terminal, wherein the first wireless terminal can be any terminal device equipped with a display screen and supporting the Wi-Fi 6 protocol, for example: Tablet computer, mobile phone, e-reader, personal computer (Personal Computer, PC), notebook computer, car equipment, Internet TV, wearable device, personal digital assistant (Personal Digital Assistant, PDA), portable media player (Portable Media Player, PMP), navigation device, etc.

FIG. 2 is a first schematic diagram of an implementation flow of a method for sending image data. As shown in FIG. 2 , in an embodiment of the present application, the method for sending image data by a first wireless terminal may include the following steps:

Step 101: Perform layered encoding on image data to obtain a first data component and a second data component; wherein, the first data component represents contour data in the image data; the second data component represents detail data in the image data.

In the embodiment of the present application, the first wireless terminal may perform layered coding processing on the image data, so as to obtain the first data component and the second data component corresponding to the image data.

It should be noted that, in this application, the first wireless terminal may also display the image data through a display screen while performing layered coding processing on the image data.

Further, in the embodiment of the present application, while displaying target video or image data, the display screen configured by the first wireless terminal may also perform layered coding processing on the image data to obtain different data components after layered coding. Wherein, the first wireless terminal may be configured with a layered encoder for performing layered encoding processing, so that the layered encoder may be used to perform layered encoding processing on the image data.

It should be noted that, in the embodiment of the present application, the above image data may be image data of an image signal being displayed by the first wireless terminal, or may be image data of a video signal being played by the first wireless terminal.

It can be understood that, in the embodiment of the present application, different data components obtained after image data undergoes layered encoding can be used to represent different features in the image data, wherein the first data component can represent the image Contour data in the data; the second data component may represent detail data in the image data.

Exemplarily, in the embodiment of the present application, the layered encoder configured in the first wireless terminal may be a conventional JSCC encoder, a wavelet transform encoder, or other types of encoders. For this This application does not make specific limitations.

Among them, the JSCC encoder adopts joint coding technology, which can comprehensively consider source coding and channel coding. Wherein, the first wireless terminal may be configured with a JSCC encoder, and after the first wireless terminal uses the JSCC encoder to perform layered encoding processing on the image data, it can obtain the first data component Coarse used to represent the contour data in the image data, At the same time, the second data component Fine used to characterize the detail data in the image data can be obtained.

Wherein, the wavelet transform encoder is a video encoder based on wavelet transform. In some embodiments of the present application, the first wireless terminal can be configured with a wavelet transform encoder, and the first wireless terminal can generate data with different resolutions after using the wavelet transform encoder to perform layered encoding processing on the image data, wherein It may include a first data component Coarse for characterizing outline data in the image data, and may also include a second data component Fine for characterizing detail data in the image data.

Correspondingly, after the first wireless terminal performs layered coding processing on the image data by using other types of configured encoders with layered coding functions, it can also generate data with different resolutions, which may include The first data component Coarse of the outline data in can also include the second data component Fine used to characterize the detail data in the image data.

Step 102: Perform modulation processing on the first data component according to the first modulation order to obtain first processed data; perform modulation processing on the second data component according to the second modulation order to obtain second processed data; wherein, the first A modulation order is smaller than a second modulation order.

In the embodiment of the present application, after the first wireless terminal performs layered coding processing on the image data and obtains the first data component and the second data component corresponding to the image data, it can encode the second data component according to the first modulation order A data component is modulated to obtain first processed data; meanwhile, the second data component may be modulated according to a second modulation order to obtain second processed data.

It should be noted that, in the embodiments of the present application, different modulation and coding strategies (Modulation Coding Scheme, MCS) can be applied to modulate different data components, that is, the first modulation order and the second adjustment order Different, where the first modulation order is used to modulate the first data component representing the contour data in the image data, and the second modulation order is used to modulate the second data component representing the detail data in the image data deal with.

Wherein, the modulation scheme may include QPSK, 16QAM, 64QAM, 256QAM, 1024QAM, 4096QAM, etc., which are not specifically limited in this application. Preferably, the first wireless terminal can modulate the first data component according to a modulation scheme of QPSK, 16QAM or 64QAM; preferably, the first wireless terminal can modulate the second data component according to a modulation scheme of 256QAM, 1024QAM or 4096QAM deal with.

It can be understood that in the embodiments of the present application, in order to ensure the real-time and effectiveness of data transmission, the criticality of outline data is often higher than that of detail data, therefore, low-order MCS can be used for the first data component , so as to ensure high transmission robustness even in non-ideal environments. Correspondingly, high-order MCS can be used for the second data component, and the detailed data in the image data can be restored in an ideal environment, and the transmission effect is good, but in a non-ideal environment, even if an error occurs, it is only the image data There are errors in the direct data in , which will not cause blurred screen or freeze.

It can be seen that, in the embodiment of the present application, when performing modulation processing on the first data component and the second data component respectively, the first modulation order used may be smaller than the second adjustment order. Wherein, the first modulation order and the second modulation order may include 4, 16, 64, 256, 1024, 4096, etc., which are not specifically limited in this application.

Further, in the embodiment of the present application, the first data component is modulated by using the first modulation order to produce the first processed data corresponding to the contour data in the image data, and the first processed data is produced by using the second modulation order The two data components are modulated to produce second processed data corresponding to contour data in the image data.

Step 103: Generate a data packet corresponding to the image data according to the first processed data and the second processed data, and send the data packet to the second wireless terminal.

In the embodiment of the present application, the first wireless terminal performs modulation processing on the first data component according to the first modulation order to obtain the first processed data; at the same time, the second The data component is modulated, and after the second processed data is obtained, a data packet corresponding to the image data may be further generated according to the first processed data and the second processed data, and then the data packet is sent to a second wireless terminal.

Further, in the embodiment of the present application, after the first wireless terminal obtains the first data component and the second data component corresponding to the image data through the layered coding process, it can assign the first data component and the second data component respectively Subsequent processing is performed on the resource units (Resource Unit, RU) corresponding to two users (User) of the same Orthogonal Frequency Division Multiple Access (OFDMA) packet.

Among them, OFDMA divides the entire frequency band into many subcarriers, and converts the frequency selective fading channel into several flat fading subchannels, so that it can effectively resist the frequency selective fading in the wireless mobile environment. Because sub-carriers overlap and occupy spectrum, OFDM can provide higher spectrum utilization and higher information transmission rate. By assigning different subcarriers to different users, OFDMA provides a natural multiple access mode, and since different subcarriers are occupied, users are mutually orthogonal and there is no intra-cell interference. At the same time, OFDMA can support two subcarrier allocation modes: distributed and centralized. In the subcarrier distributed allocation mode, the independence of frequency selective fading of different subcarriers can be exploited to obtain diversity gain.

OFDMA subdivides the channel into smaller RUs. Through OFDMA resource subdivision, multiple clients can perform parallel transmission by occupying different RU resources.

It can be seen that based on the same OFDMA packet, the first wireless terminal can use different resource units RU to perform parallel transmission of the first processed data and the second processed data.

Exemplarily, in this application, when the first wireless terminal sends the data packet to the second wireless terminal, it may send the first processed data to the second wireless terminal through the first resource unit; at the same time, it may Sending the second processed data to the second wireless terminal through a second resource unit.

It can be understood that, in this application, the first resource unit and the second resource unit may include different time-frequency resource blocks.

Optionally, in the embodiments of the present application, to implement the method for sending and receiving image data proposed in the present application, the first wireless terminal may perform the first processed data and the second processed data based on the Wi-Fi 6 protocol. generation and dispatch. That is, the first wireless terminal modulates the first data component and the second data component based on the Wi-Fi 6 protocol; and sends the first processed data and the second processed data based on the Wi-Fi 6 protocol.

Optionally, in the embodiments of the present application, to implement the method for sending and receiving image data proposed in the present application, the first wireless terminal may perform the first processed data and the second processed data based on the Wi-Fi 7 protocol. generation and dispatch. That is, the first wireless terminal performs modulation processing on the first data component and the second data component based on the Wi-Fi 7 protocol; and sends the first processed data and the second processed data based on the Wi-Fi 7 protocol.

Among them, Wi-Fi 6 is the sixth generation of wireless network technology, which is the name of the Wi-Fi standard. It is a wireless local area network technology created by the Wi-Fi Alliance based on the IEEE 802.11 standard. Wi-Fi 6 mainly uses technologies such as OFDMA and multi-user-multiple-input multiple-output (Multi-User Multiple-Input Multiple-Output, MU-MIMO). MU-MIMO technology allows routers to communicate with multiple devices at the same time, instead of sequentially to communicate. MU-MIMO allows routers to communicate with four devices at once, and Wi-Fi 6 will allow communication with up to eight devices. Wi-Fi 6 also utilizes OFDMA (Orthogonal Frequency Division Multiple Access) and transmit beamforming, both of which work to improve efficiency and network capacity, respectively. Wi-Fi 6 can reach a maximum rate of 9.6Gbps.

A new technology in Wi-Fi 6 allows devices to schedule communications with routers, reducing the time it takes to keep antennas powered up to transmit and search for signals, which means less battery drain and improved battery life.

Since both the Wi-Fi 6 protocol and the Wi-Fi 7 protocol support OFDMA and support different users to use different MCSs, in this application, based on the Wi-Fi 6 protocol or the Wi-Fi 7 protocol, the first wireless terminal can The first resource unit corresponding to the first data component adopts a low-order modulation mode, and the second resource unit corresponding to the second data component adopts a high-order modulation mode.

It should be noted that, in the embodiment of the present application, the first wireless terminal may also configure resource sizes for the first resource unit and the second resource unit respectively.

Correspondingly, in this application, the first wireless terminal may also configure and adjust the MCS corresponding to the first data component and the second data component, that is, set the first modulation order and the second modulation order.

That is to say, in this application, the first wireless terminal can flexibly allocate bandwidth to the first data component and the second data component by adjusting the resource size of the RU and adjusting the MCS corresponding to different RUs.

It can be understood that, in the embodiment of the present application, the first wireless terminal generates a data packet corresponding to the image data according to the first processed data and the second processed data, and then directly sends the data packet to the second wireless terminal, Therefore, different data components of the image data can be sent in the same frame, thereby ensuring synchronous sending of the outline data and the detail data in the image data.

It should be noted that, in the embodiment of the present application, the second wireless terminal may be a screen projection device, that is, after receiving the data packet corresponding to the image data, the second wireless terminal may display the same image synchronously with the first wireless terminal data.

Further, in the embodiment of the present application, FIG. 3 is a schematic diagram of the second implementation flow of the image data sending method. As shown in FIG. Before generating the data packet corresponding to the image data, that is, before step 103, the method for sending image data by the first wireless terminal may further include the following steps:

Step 104, calculating a check value corresponding to the first data component.

Step 105: Generate a frame check sequence according to the check value, and add the frame check sequence to the first processed data.

In the embodiment of the present application, before the first wireless terminal generates the data packet according to the first processed data and the second processed data, it can calculate the check value for the first data component, and then can calculate the check value according to the check value The value generates a frame check sequence, so that the frame check sequence can be added to the first processed data, so that the second wireless terminal can perform check processing on the first data component.

It should be noted that, in the embodiment of the present application, the first wireless terminal may use a variety of different methods to calculate the check value of the first data component, for example, the first wireless terminal may use a cyclic redundancy check (Cyclic redundancy check) check, CRC) to calculate the check value.

Wherein, CRC is a kind of checksum, and the check value obtained by the first wireless terminal using CRC calculation is the remainder obtained by dividing two byte data streams by binary division (no carry, XOR is used instead of subtraction). Wherein, the dividend is the binary representation of the information data stream that needs to calculate the checksum, that is, the first processed data, and the divisor is a predefined (short) binary number with a length of , usually represented by a coefficient of a polynomial.

Correspondingly, in the present application, the first wireless terminal may use the remainder obtained by CRC calculation as the frame check sequence FCS, and directly add the FCS after the first processed data.

It can be understood that, in the embodiment of the present application, the first wireless terminal may also use other verification methods to generate the verification value, which is not specifically limited in the present application.

It should be noted that, in the embodiment of the present application, in order to reduce the delay, the second wireless terminal may only perform an FCS check on the first processed data corresponding to the first data component and reply, correspondingly, the first wireless terminal Before the data packet corresponding to the image data is generated, the FCS may be generated and added only to the first processed data.

It can be understood that, in this application, after the first wireless terminal sends the data packet generated based on the first processed data and the second processed data to the second wireless terminal, the second wireless terminal can use the first processed The frame check sequence added in the data is checked, and after the check is successful, the first wireless terminal can receive the confirmation response sent by the second wireless terminal.

To sum up, in the embodiment of the present application, according to the image data sending and receiving method proposed in step 101 to step 105, on the one hand, since the more important contour data is modulated by using low-order MCS, in In non-ideal conditions, the robustness of transmission can be greatly improved; on the other hand, the profile data and detail data are sent simultaneously in the same packet, which effectively reduces the frequency of air interface competition; on the other hand, only the profile data corresponding After the first processing, the data is checked by FCS, so the retransmission rate can be effectively reduced.

The embodiment of the present application provides a method for sending and receiving image data, which separates the contour data and detail data in the image data through layered coding processing, and uses low-order MCS to modulate the more important contour data, so that it can Improve transmission robustness. At the same time, use resource units in the same OFDMA packet to transmit profile data and detail data, and only perform FCS check on the first processed data corresponding to the profile data. On the basis of effectively reducing the retransmission rate, It can also reduce the frequency of air interface competition, that is to say, the method for sending and receiving image data proposed by this application has high transmission robustness, low retransmission rate, and less air interface competition, which can greatly reduce transmission delay, thereby improving The effect of screen projection effectively expands the application scenarios of screen projection.

Yet another embodiment of the present application provides a method for sending and receiving image data, and the method can be applied to a second wireless terminal, wherein the second wireless terminal can be any terminal device supporting the Wi-Fi 6 protocol, for example: Tablet PC, mobile phone, e-reader, personal computer PC, notebook computer, car equipment, Internet TV, wearable device, personal digital assistant PDA, portable media player PMP, navigation device, etc.

FIG. 4 is a schematic diagram of a first implementation flow of a method for receiving image data. As shown in FIG. 4 , in an embodiment of the present application, the method for receiving image data by a second wireless terminal may include the following steps:

Step 201. Receive a data packet corresponding to image data sent by a first wireless terminal; wherein, the data packet includes first processed data and second processed data.

In the embodiment of the present application, the second wireless terminal may first receive a data packet corresponding to the image data sent by the first wireless terminal, and the data packet carries the first processed data and the second processed data. Wherein, the first processed data and the second processed data are modulated data.

Further, in the embodiment of the present application, when the second wireless terminal receives the data packet sent by the first wireless terminal and includes the first processed data and the second processed data, it can simultaneously use different resource units to perform The first processed data and the second processed data are received. For example, the second wireless terminal may receive the first processed data sent by the first wireless terminal through the first resource unit; meanwhile, the second wireless terminal may receive the second processed data sent by the first wireless terminal through the second resource unit.

It should be noted that, in this application, the first wireless terminal allocates the first processed data and the second processed data to two different RUs corresponding to two users of the same OFDMA packet for transmission processing, corresponding Specifically, the second wireless terminal also receives data packets through two different RUs. That is to say, based on the same OFDMA packet, the second wireless terminal can use the first resource unit and the second resource unit to receive the first processed data and the second processed data in parallel.

It should be noted that, in the embodiment of the present application, the first resource unit and the second resource unit may include different time-frequency resource blocks.

Further, in the embodiment of the present application, the first processed data and the second processed data may be generated by performing modulation processing based on different MCSs. In some embodiments of the present application, the MCS corresponding to the first processed data and the MCS corresponding to the second processed data are different modulation schemes. Wherein, the modulation scheme may include QPSK, 16QAM, 64QAM, 256QAM, 1024QAM, 4096QAM, etc., which are not specifically limited in this application. Preferably, the first processed data may use an MCS of QPSK, 16QAM, or 64QAM; the second processed data may use an MCS of 256QAM, 1024QAM, or 4096QAM.

Exemplarily, in the embodiment of the present application, when generating the first processed data, the first wireless terminal may use a low-order modulation mode, and when generating the second processed data, the first wireless terminal may use a high-order modulation mode model. That is to say, the first modulation order used by the first wireless terminal to generate the first processed data may be smaller than the second modulation order used to generate the second processed data. Wherein, the first modulation order and the second modulation order may include 4, 16, 64, 256, 1024, 4096, etc., which are not specifically limited in this application.

Further, in the embodiments of the present application, to implement the method for sending and receiving image data proposed in the present application, the second wireless terminal needs to perform the first processed data and the described data based on the Wi-Fi 6 protocol or the Wi-Fi 7 protocol. Receiving of the second processed data.

Among them, Wi-Fi 6 mainly uses technologies such as OFDMA and MU-MIMO. It is precisely because both Wi-Fi 6 and Wi-Fi 7 protocols support OFDMA and support different users to use different MCS, so in this application , based on the Wi-Fi 6 protocol or the Wi-Fi 7 protocol, the second wireless terminal may receive the first processed data and the second processed data modulated by different MCSs through the first resource unit and the second resource unit.

Step 202: Perform demodulation processing on the first processed data to obtain a first data component; wherein, the first data component represents contour data in the image data.

In the embodiment of the present application, after receiving the data packet sent by the first wireless terminal and including the first processed data and the second processed data, the second wireless terminal may first demodulate the first processed data processing, so as to obtain the first data component corresponding to the image data.

Further, in the embodiment of the present application, since the first processed data corresponds to the contour data in the image data, the first data component obtained by the second wireless terminal after demodulating the first processed data may be Characterize contour data in image data.

That is to say, in this application, the second wireless terminal can obtain different data components corresponding to the image data and representing different features by analyzing the data packets.

Step 203: Perform verification processing on the first data component to obtain a verification result.

In the embodiment of the present application, after the second wireless terminal performs demodulation processing on the first processed data to obtain the first data component, it may perform verification processing on the first data component, thereby obtaining a verification result.

Further, in the embodiment of the present application, after acquiring the first data component, the second wireless terminal may first perform verification processing on the first data component, so as to determine whether the data transmission is correct according to the generated verification result.

Exemplarily, in the embodiment of the present application, when performing verification processing on the first data component, the second wireless terminal may first calculate the verification value corresponding to the first data component; The check value and the frame check sequence of the first processed data determine the check result.

It can be understood that, in the embodiment of the present application, the method for calculating the check value of the first data component by the first wireless terminal is the same as the method for calculating the check value of the first data component by the second wireless terminal. For example, if the first wireless terminal calculates the check value using CRC, the second wireless terminal may calculate the check value using CRC.

Further, in the embodiment of the present application, after the second wireless terminal calculates and obtains the check value, it may determine the check result in combination with the frame check sequence FCS included in the first processed data. In some embodiments of the present application, since the first wireless terminal directly determines the check value as FCS, the second wireless terminal can directly compare the check value with FCS, and if the check value is the same as FCS, determine the check result is the verification success; if the verification value is different from the FCS, it is determined that the verification result is a verification failure.

It can be understood that, in the embodiment of the present application, the first wireless terminal and the second wireless terminal may also use other verification methods to generate the check value, which is not specifically limited in the present application.

It should be noted that, in the embodiment of the present application, on the one hand, the first processed data corresponds to the contour data in the image data, and the second processed data corresponds to the detail data in the image data. In order to ensure the real-time data transmission The degree of criticality of contour data is often higher than that of detail data; on the other hand, low-order modulation modes are used when generating the first processed data, and high-order modulation modes are used when generating the second processed data . Therefore, the second wireless terminal may choose to only perform verification processing on the first data component, and determine whether retransmission is required according to the obtained verification result, without performing verification processing on the second data component, that is, regardless of the second processing Whether there is a transmission error in the final data, as long as the verification result corresponding to the first data component is a successful verification, the second processed data will be demodulated, thereby reducing the probability of retransmission and further reducing the delay. Purpose.

That is to say, in this application, in order to reduce the delay, the second wireless terminal can only perform FCS check on the received first processed data and reply. Before the generation, the FCS may be generated and added only to the first processed data.

Step 204, if the verification result is that the verification is successful, demodulate the second processed data to obtain a second data component, where the second data component represents the detail data in the image data.

In the embodiment of the present application, after the second wireless terminal performs verification processing on the first data component to obtain the verification result, if the verification result is a successful verification, then the second wireless terminal can perform verification on the second processed data. Demodulate to obtain the corresponding second data component.

Further, in the embodiment of the present application, if the second wireless terminal determines that the verification result corresponding to the first data component is a successful verification, then it can be considered that the first processed data has not been damaged during the transmission process, so The second wireless terminal may directly perform demodulation processing on the second processed data, so as to obtain a second data component corresponding to the image data.

It can be understood that, in this application, the basis for the second wireless terminal to determine whether to demodulate the second processed data is only the verification result corresponding to the first data component, that is, no matter whether the second processed data is Destruction, as long as the verification result of the first data component is a successful verification, the second wireless terminal will perform demodulation processing.

Further, in the embodiment of the present application, since the first processed data corresponds to the contour data in the image data, the first data component obtained by the second wireless terminal after demodulating the first processed data may be Characterize the contour data in the image data; since the second processed data corresponds to the detail data in the image data, the second data component obtained after the second wireless terminal demodulates the second processed data can represent the image data details in the data.

Further, in the embodiment of the present application, FIG. 5 is a schematic diagram of the second implementation flow of the image data receiving method. As shown in FIG. 5, the second wireless terminal is performing verification processing on the first data component to obtain the verification result Afterwards, that is, after step 203, the method for the second wireless terminal to send image data may also include the following steps:

Step 206: If the verification result is that the verification is successful, send an acknowledgment response to the first wireless terminal.

In the embodiment of the present application, after the second wireless terminal performs verification processing on the first data component to obtain the verification result, if the verification result is a successful verification, then it can be considered that the first processed data is in the process of being sent is not destroyed, then the second wireless terminal can send an acknowledgment response to the first wireless terminal.

It can be seen that in this application, the basis for the second wireless terminal to determine whether to send an acknowledgment response to the first wireless terminal is only the verification result corresponding to the first data component, that is, no matter whether the second processed data is destroyed during transmission, As long as the verification result of the first data component is a successful verification, the second wireless terminal will send an acknowledgment response.

It can be understood that, in the embodiment of the present application, after the second wireless terminal performs verification processing on the first data component to obtain the verification result, if the verification result is a successful verification, then the second wireless terminal may send the first The wireless terminal sends an acknowledgment (Acknowledgment, ACK); if the verification result is a verification failure, then the second wireless terminal can send a negative acknowledgment (Negative-Acknowledgment, NACK) to the first wireless terminal, and discard the data packet corresponding to the image data , not performing demodulation processing on the second processed data.

Among them, the ACK character is a character used as a confirmation message under some communication protocols, and some communication protocols use other characters; NACK is a protocol message used in digital communication. Its function is as a response to confirm the receipt of data, but it is a message signal indicating that there is a small error.

Step 205: Perform combined decoding processing on the first data component and the second data component to obtain image data.

In the embodiment of the present application, after the second wireless terminal performs demodulation processing on the first processed data and the second processed data respectively, and obtains the first data component representing the profile data and the second data component representing the detail data , the combined decoding process can be performed on the first data component and the second data component, so that image data can be obtained.

Further, in the embodiment of the present application, the second wireless terminal may be configured with a layered decoder for performing combined decoding processing, so that the layered decoder may be used to perform combined decoding of the first data component and the second data component deal with.

Exemplarily, in the embodiment of the present application, the layered decoder configured in the second wireless terminal may be a conventional JSCC decoder, a wavelet transform decoder, or other types of decoders. This application does not make specific limitations.

Wherein, the second wireless terminal may be configured with a JSCC decoder, and after the second wireless terminal simultaneously inputs the first data component Coarse representing the outline data and the second data component Fine representing the detail data into the JSCC decoder for combined decoding processing , the corresponding image data can be obtained.

Wherein, the second wireless terminal may be configured with a wavelet transform decoder, and the second wireless terminal simultaneously inputs the first data component Coarse representing the contour data and the second data component Fine representing the detail data into the wavelet transform decoder for combined decoding After processing, the corresponding image data can be obtained.

Correspondingly, the second wireless terminal may be configured with other types of decoders with a layered decoding function, and the decoder may also perform combined decoding processing on data with different resolutions at the same time, for example, the first data component representing contour data Coarse and the second data component Fine representing the detail data are decoded to obtain corresponding image data.

Further, in the embodiment of the present application, based on the above-mentioned FIG. 5, after performing combined decoding processing on the first data component and the second data component to obtain the image data, that is, after step 205, the second The method for the wireless terminal to send image data may also include the following steps:

Step 207, display image data.

In the embodiment of the present application, after the second wireless terminal completes the analysis and acquisition of the image data, it can display the image data synchronously with the first wireless terminal, so that the image data transfer from the first wireless terminal to the second wireless terminal can be completed. Screencasting processing. Wherein, the first wireless terminal is a screen projection device, and the second wireless terminal is a screen projection device.

To sum up, in the embodiment of this application, according to the image data sending and receiving method proposed in step 201 to step 206, on the one hand, since the more important contour data is modulated by using low-order MCS, the In non-ideal conditions, the robustness of transmission can be greatly improved; on the other hand, the profile data and detail data are sent simultaneously in the same packet, which effectively reduces the frequency of air interface competition; on the other hand, only the profile data corresponding After the first processing, the data is checked by FCS, so the retransmission rate can be effectively reduced.

Based on the above embodiments, another embodiment of the present application provides a method for sending and receiving image data, the method can be applied to the first wireless terminal and the second wireless terminal, wherein the first wireless terminal can be any The display screen, the terminal device supporting the Wi-Fi 6 protocol, the second wireless terminal can be any terminal device supporting the Wi-Fi 6 protocol, the first wireless terminal is the screen projection device, and the second wireless terminal is the screen projected device.

Fig. 6 is a schematic diagram of an implementation process of a method for sending and receiving image data. As shown in Fig. 6, in an embodiment of the present application, the method for sending and receiving image data by a first wireless terminal and a second wireless terminal may include the following steps :

Step 301, the first wireless terminal performs layered coding processing on image data to obtain a first data component and a second data component.

In the embodiment of the present application, the first wireless terminal may perform layered coding processing on the image data, so as to obtain the first data component and the second data component corresponding to the image data. Wherein, the first wireless terminal may be configured with a layered encoder for performing layered encoding processing, so that the layered encoder may be used to perform layered encoding processing on the image data.

It should be noted that, in the embodiment of the present application, the above image data may be image data of an image signal being displayed by the first wireless terminal, or may be image data of a video signal being played by the first wireless terminal. Wherein, the first data component may represent contour data in the image data; the second data component may represent detail data in the image data.

Step 302, the first wireless terminal modulates the first data component according to the first modulation order to obtain the first processed data; performs modulation processing on the second data component according to the second modulation order to obtain the second processed data .

In the embodiment of the present application, after the first wireless terminal performs layered coding processing on the image data and obtains the first data component and the second data component corresponding to the image data, it can encode the first data according to the first modulation order The component is modulated to obtain the first processed data; at the same time, the second data component can be modulated according to the second modulation order to obtain the second processed data.

Step 303, the first wireless terminal calculates a check value corresponding to the first data component.

Step 304, the first wireless terminal generates a frame check sequence according to the check value, and adds the frame check sequence to the first processed data.

In the embodiment of the present application, the first wireless terminal can calculate the check value for the first processed data, and then can generate a frame check sequence according to the check value, so that the frame check sequence can be added to the first processing In the latter data, the second wireless terminal can perform verification processing on the first data component.

Step 305, the first wireless terminal sends the first processed data and the second processed data to the second wireless terminal.

In an embodiment of the present application, after obtaining the first processed data and the second processed data, the first wireless terminal may further generate the image data according to the first processed data and the second processed data corresponding data packets, and then send the data packets to the second wireless terminal.

Exemplarily, in this application, based on the same OFDMA packet, the first wireless terminal may use different RUs to send the first processed data and the second processed data in parallel. For example, when the first wireless terminal sends the data packet to the second wireless terminal, it can send the first processed data to the second wireless terminal through the first resource unit; The second processed data is sent to the second wireless terminal.

Correspondingly, in this application, when the second wireless terminal receives the data packet sent by the first wireless terminal and includes the first processed data and the second processed data, it can simultaneously use different resource units to perform the first processing The post data and the reception of the second processed data. For example, the second wireless terminal may receive the first processed data sent by the first wireless terminal through the first resource unit; at the same time, the second wireless terminal may receive the first processed data sent by the first wireless terminal through the second resource unit. The second processed data.

Step 306, the second wireless terminal demodulates the first processed data to obtain the first data component.

In the embodiment of the present application, after receiving the data packet sent by the first wireless terminal and including the first processed data and the second processed data, the second wireless terminal may first demodulate the first processed data processing, so as to obtain the first data component corresponding to the image data. Wherein, the first data component represents contour data in the image data.

Step 307, the second wireless terminal performs verification processing on the first data component, and obtains a verification result.

In the embodiment of the present application, after the second wireless terminal performs demodulation processing on the first processed data to obtain the first data component, it may perform verification processing on the first data component to obtain a verification result, and then according to The generated checksum results determine whether the data transfer was correct.

Step 308: If the verification result is that the verification is successful, the second wireless terminal sends an ACK to the first wireless terminal.

Step 309, the second wireless terminal demodulates the second processed data to obtain a second data component.

In the embodiment of the present application, if it is determined that the verification result corresponding to the first data component is a successful verification, then the second wireless terminal may send an ACK to the first wireless terminal, and at the same time, the second wireless terminal may send an ACK to the second processed The data is demodulated to obtain the second data component. Wherein, the order of performing step 308 and step 309 is not limited.

Step 310, the second wireless terminal performs combined decoding processing on the first data component and the second data component to obtain image data.

In the embodiment of the present application, the second wireless terminal may be configured with a layered decoder for performing combined decoding processing, so that the layered decoder may be used to perform combined decoding processing on the first data component and the second data component, and obtain image data.

Step 311, the second wireless terminal displays image data.

In the embodiment of the present application, after the second wireless terminal completes the analysis and acquisition of the image data, it can display the image data synchronously with the first wireless terminal, so that the image data transfer from the first wireless terminal to the second wireless terminal can be completed. Screencasting processing.

Based on the above-mentioned embodiments, in another embodiment of the present application, FIG. 7 is a schematic structural diagram of the first wireless terminal performing screen projection processing of image data. As shown in FIG. 7, the first wireless terminal may be equipped with a display, a layered coding device and a Wi-Fi transmitting module, wherein, for the input image data, the first wireless terminal may use a layered encoder to perform layered encoding processing on the image data while using the display to display the image data, so as to obtain the Coarse component ( The first data component used to characterize the outline data) and the Fine component (the second data component used to characterize the detail data), and then the Coarse component and the Fine component are sent to the Wi-Fi transmitting module together, and the Wi-Fi transmitting module will The Coarse component and the Fine component are assigned to two different resource units RU (the first resource unit RU1 and the second resource unit RU2) corresponding to the User (the first user User1 and the second user User2) of the same OFDMA packet for transmission . Among them, both Wi-Fi 6 protocol and Wi-Fi 7 protocol support OFDMA, and support different users to use different MCS. Therefore, RU1 corresponding to the Coarse component can adopt a low-order modulation mode, corresponding to generated data 1 (first processed data), and RU2 corresponding to the Fine component can adopt a high-order modulation mode, corresponding to generated data 2 (second processed data).

In some embodiments of the present application, the layered encoder can be a conventional JSCC encoder (for generating Coarse components, Fine components), or a wavelet transform encoder, or other types of encoders (for generating multi-resolution rate data, corresponding to the outline and detail parts of the image respectively).

It can be understood that, in the embodiment of the present application, the Coarse component represents the contour part of the image and belongs to key data. The Coarse component can be modulated by low-order MCS, and can maintain high transmission robustness in non-ideal environments. property; the Fine component represents the microscopic details of the image, and is sent using high-order MCS modulation. In the case of a good channel, the receiver can solve all the detailed data, and the image quality is good; while in the case of an unsatisfactory channel, The decoded data contains some erroneous bit information, and the corresponding image quality is degraded. In the case of few error bits, although there is a certain error in the QAM demodulation constellation judgment, it will not deviate too far, so the image quality degradation is not obvious, and there will be no serious freeze and blur caused by retransmission.

Further, in the embodiment of the present application, the first wireless terminal can implement flexible bandwidth allocation for the Coarse component and the Fine component by adjusting the sizes of RU1 and RU2 and the MCS modes used by different components. In addition, the data 1 corresponding to the Coarse component and the data 2 corresponding to the Fine component are sent to the second wireless terminal in the same frame, which can also ensure the synchronous sending of the Coarse component and the Fine component.

Fig. 8 is a schematic structural diagram of the second wireless terminal performing screen projection processing of image data. As shown in Fig. 8, the second wireless terminal may be configured with a layered decoder and a Wi-Fi receiving module, wherein the Wi-Fi receiving module receives After the first wireless terminal sends the data packets including data 1 and data 2 through the first resource unit RU1 and the second resource unit RU2 of two users User (the first user User1 and the second user User2), the data 1 and data 2 are analyzed to obtain the Coarse component corresponding to data 1 and the Fine component corresponding to data 2, and then, the second wireless terminal further combines the Coarse component (used to characterize the first data component of the contour data) and the Fine component (used to The second data component representing the detail data) is input to the layered decoder for combined decoding processing, so that the corresponding image data can be restored, and the image data is displayed, so as to complete the image processing from the first wireless terminal to the second wireless terminal. Screen projection processing of data.

Wherein, since the data format of the physical layer (Physical, PHY) layer of the existing port is borrowed, both the time domain and the frequency domain of the circuit can be multiplexed, and only the decoding circuit needs to be set separately for the two users.

Further, in the embodiments of the present application, the second wireless terminal can also make certain adaptations to the Wi-Fi response mechanism to achieve the purpose of reducing delay. In some embodiments of the present application, the second wireless terminal The Wi-Fi receiving module can only perform FCS check on the data of the Coarse component and send ACK, and does not perform FCS check on the data of the Fine component, thereby reducing the probability of retransmission and reducing the delay.

Exemplarily, FIG. 9 is a schematic diagram of verification processing. As shown in FIG. 9, the first wireless terminal sends a data packet including data 1 and data 2 to the second wireless terminal, wherein the first wireless terminal passes the first user The first resource unit RU1 corresponding to User1 transmits data 1, and at the same time transmits data 2 through the second resource unit RU2 corresponding to the second user User2.

In some embodiments of the present application, a request to send (Require To Send, RTS) is an output signal used to indicate that the device is ready to receive; a clear to send (CTS) is an input signal, which stops sending when valid. For example, the RTS of the first wireless terminal is connected to the CTS of the second wireless terminal; the CTS of the first wireless terminal is connected to the RTS of the second wireless terminal. The former signal controls the transmission of the second wireless terminal, and the latter signal controls the transmission of the first wireless terminal. For the transmission of the second wireless terminal (receiving by the first wireless terminal), if the first wireless terminal sends an RTS signal (meaning to notify the second wireless terminal to stop sending) when the receiving buffer is almost full, the second wireless terminal detects it through CTS The signal stops sending; after a period of time, the first wireless terminal receives a free buffer and sends an RTS signal to instruct the second wireless terminal to start sending data. The first wireless terminal sends (the second wireless terminal receives) similarly.

It should be noted that, in this application, after receiving the data packet sent by the second wireless terminal and including data 1 and data 2, the second wireless terminal may perform an FCS check on data 1 in the data packet and send an ACK, That is, only the data corresponding to the Coarse component is ACKed.

In some embodiments of the present application, the ACK implementation scheme includes but is not limited to the following forms: the second wireless terminal only sends a single-packet ACK; or, the second wireless terminal sends an ACK in MU format, and the data of the two users are simultaneously processed ACK.

It can be understood that, in the embodiment of the present application, in the point-to-point data transmission, although the actual receiver is a user, the data format of the PHY layer and the MAC layer borrows the data format of multiple users for transmission . The data of different users (Coarse component and Fine component) use different MCS modes: the Coarse component has a small amount of data, but requires high reliability, that is, the ACK mechanism; the Fine component has a large amount of data, but because it is detailed data, some data is allowed to be lost. Therefore no ACK mechanism is required. Correspondingly, the second wireless terminal only performs an FCS checksum response to the Coarse component.

In some embodiments of the present application, after the second wireless terminal receives the data of the Coarse component and checks that the FCS is passed, it will respond with ACK/BA; the second wireless terminal can send ACKs in various formats, all of which are considered equivalent Behavior, because actually only do ACK for the Coarse component.

It can be understood that the method for sending and receiving image data proposed in this application can capture air interface packets for confirmation in the Wi-Fi projection scenario of point-to-point communication, that is, this application uses a multi-user data frame format based on point-to-point communication ; and the receiver side replies with a single-packet ACK (if the receiver replies with MU-ACK, it is considered equivalent).

Based on the above-mentioned embodiments, in another embodiment of the present application, FIG. 10 is a first schematic diagram of the composition and structure of the first wireless terminal. As shown in FIG. 10 , the first wireless terminal 10 proposed in the embodiment of the present application may include a coding unit 11, Modulation unit 12, generating unit 13, sending unit 14,

The encoding unit 11 is configured to perform layered encoding processing on image data to obtain a first data component and a second data component; wherein, the first data component represents contour data in the image data; the second The two data components characterize the detail data in the image data;

The modulation unit 12 is configured to perform modulation processing on the first data component according to a first modulation order to obtain first processed data; perform modulation processing on the second data component according to a second modulation order, Obtaining second processed data; wherein, the first modulation order is smaller than the second modulation order;

The generating unit 13 is configured to generate a data packet corresponding to the image data according to the first processed data and the second processed data;

The sending unit 14 is configured to send the data packet to the second wireless terminal.

In the embodiment of the present application, further, FIG. 11 is a second schematic diagram of the composition structure of the first wireless terminal. As shown in FIG. 11 , the first wireless terminal 10 proposed in the embodiment of the present application may also include a first processor 15, a There is a first memory 16 with instructions executable by the first processor 15. Further, the first wireless terminal 10 may also include a first communication interface 17, and is used to connect the first processor 15, the first memory 16 and the first communication interface. The first bus 18 of the interface 17 .

Further, in the embodiment of the present application, the first processor 15 is configured to perform layered coding processing on the image data to obtain a first data component and a second data component; wherein, the first data component Representing contour data in the image data; the second data component representing detail data in the image data; performing modulation processing on the first data component according to a first modulation order to obtain first processed data; Perform modulation processing on the second data component according to a second modulation order to obtain second processed data; wherein, the first modulation order is smaller than the second modulation order; according to the first processed data and the obtained Generate a data packet corresponding to the image data from the second processed data, and send the data packet to the second wireless terminal.

Further, in the embodiment of the present application, FIG. 12 is a schematic diagram of the composition and structure of the second wireless terminal. As shown in FIG. 12 , the second wireless terminal 20 proposed in the embodiment of the present application may include a receiving unit 21 and a verification unit 22 , demodulation unit 23, decoding unit 24,

The receiving unit 21 is configured to receive a data packet corresponding to the image data sent by the first wireless terminal; wherein, the data packet includes first processed data and second processed data;

The demodulation unit 23 is configured to demodulate the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data;

The verification unit 22 is configured to perform verification processing on the first data component to obtain a verification result;

The demodulation unit 23 is further configured to demodulate the second processed data to obtain a second data component if the verification result is a successful verification; wherein the second data component characterizing detail data in the image data;

The decoding unit 24 is configured to perform combined decoding processing on the first data component and the second data component to obtain the image data.

In the embodiment of the present application, further, FIG. 13 is a second schematic diagram of the composition structure of the second wireless terminal. As shown in FIG. 13, the second wireless terminal 20 proposed in the embodiment of the present application may also include a second processor 25, a memory There is a second memory 26 with instructions executable by the second processor 25. Further, the second wireless terminal 20 may also include a second communication interface 27, and is used to connect the second processor 25, the second memory 26 and the second communication interface. A second bus 28 for the interface 27 .

Further, in the embodiment of the present application, the second processor 25 is configured to receive a data packet corresponding to the image data sent by the first wireless terminal; wherein, the data packet includes the first processed data and the second Two processed data; performing demodulation processing on the first processed data to obtain a first data component; wherein, the first data component represents the contour data in the image data; performing a demodulation process on the first data component Verifying processing to obtain a verification result; if the verification result is a successful verification, demodulate the second processed data to obtain a second data component; wherein the second data component represents the The detailed data in the image data; performing combined decoding processing on the first data component and the second data component to obtain the image data.

In the embodiment of the present application, the above-mentioned processor may be an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a digital signal processor (Digital Signal Processor, DSP), a digital signal processing device (Digital Signal Processing Device, DSPD) , Programmable Logic Device (ProgRAMmable Logic Device, PLD), Field Programmable Gate Array (Field ProgRAMmable Gate Array, FPGA), Central Processing Unit (Central Processing Unit, CPU), controller, microcontroller, microprocessor in at least one. It can be understood that, for different devices, the electronic device used to implement the above processor function may also be other, which is not specifically limited in this embodiment of the present application. The memory may be connected to the processor, wherein the memory is used to store executable program code, the program code includes computer operation instructions, the memory may include a high-speed RAM memory, and may also include a non-volatile memory, for example, at least two magnetic disk memories .

In the embodiment of the present application, the bus is used to connect the communication interface, the processor and the memory, and the mutual communication between these devices.

In the embodiments of the present application, the memory is used to store instructions and data.

In practical applications, the above-mentioned memory can be a volatile memory (volatile memory), such as a random access memory (Random-Access Memory, RAM); or a non-volatile memory (non-volatile memory), such as a read-only memory ( Read-Only Memory, ROM), flash memory (flash memory), hard disk (Hard Disk Drive, HDD) or solid-state drive (Solid-State Drive, SSD); or a combination of the above types of memory, and provide instructions to the processor and data.

In addition, each functional module in this embodiment may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software function modules.

If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or The part contributed by the prior art or the whole or part of the technical solution can be embodied in the form of software products, the computer software products are stored in a storage medium, and include several instructions to make a computer device (which can be a personal A computer, a server, or a network device, etc.) or a processor (processor) executes all or part of the steps of the method of this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other various media that can store program codes.

The embodiment of the present application provides a first wireless terminal and a second wireless terminal, which separate the contour data and detail data in the image data through layered coding processing, and use low-order MCS to modulate the more important contour data, In this way, the robustness of the transmission can be improved. At the same time, the resource unit in the same OFDMA packet is used to transmit the outline data and the detail data, and only the FCS check is performed on the first processed data corresponding to the outline data, on the basis of effectively reducing the retransmission rate In addition, it can also reduce the frequency of air interface competition, that is to say, the method for sending and receiving image data proposed in this application has high transmission robustness, low retransmission rate, and less air interface competition, which can greatly reduce transmission delay, thereby It can improve the effect of screen projection and effectively expand the application scenarios of screen projection.

An embodiment of the present application provides a computer-readable storage medium on which a program is stored, and when the program is executed by a processor, the method for sending and receiving image data as described above is implemented.

Specifically, the program instructions corresponding to a method for sending and receiving image data in this embodiment may be stored on a storage medium such as an optical disc, a hard disk, or a USB flash drive. When the program instruction corresponding to the receiving method is read or executed by the first wireless terminal, the following steps are included:

When the program instructions corresponding to a method for sending and receiving image data in the storage medium are read or executed by the second wireless terminal, the following steps are included:

An embodiment of the present application provides a chip, which includes a processor and an interface, the processor acquires program instructions through the interface, and the processor is used to run the program instructions to implement the method for sending and receiving image data as described above.

Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) having computer-usable program code embodied therein.

The present application is described with reference to the implementation flow diagrams and/or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and/or block in the schematic flowchart and/or block diagram, and a combination of processes and/or blocks in the schematic flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a Means for realizing the functions specified in one or more steps of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in implementing one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in implementing the process flow or processes of the flowchart diagrams and/or the block or blocks of the block diagrams.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the protection scope of the present application.

Industrial Applicability

In the embodiment of the present application, the contour data and detail data in the image data are separated through layered coding processing, and the more important contour data is modulated by using low-order MCS, so that the robustness of transmission can be improved. At the same time, Use resource units in the same OFDMA packet to transmit profile data and detail data, and only perform FCS check on the first processed data corresponding to the profile data. On the basis of effectively reducing the retransmission rate, it can also reduce the frequency of air interface competition. In other words, the image sending and receiving method proposed in this application has high transmission robustness, low retransmission rate, and less air interface competition, which can greatly reduce transmission delay, thereby improving the effect of screen projection and effectively expanding the application of screen projection Scenes.

Claims

A method of sending image data in a first wireless terminal, comprising:

performing layered encoding processing on the image data to obtain a first data component and a second data component; wherein, the first data component represents contour data in the image data; the second data component represents the image details in the data;

performing modulation processing on the first data component according to a first modulation order to obtain first processed data; performing modulation processing on the second data component according to a second modulation order to obtain second processed data; wherein, the first modulation order is smaller than the second modulation order;

Generate a data packet corresponding to the image data according to the first processed data and the second processed data, and send the data packet to a second wireless terminal.
The method according to claim 1, wherein the sending the data packet to the second wireless terminal comprises:

sending the first processed data to the second wireless terminal through a first resource unit;

Sending the second processed data to the second wireless terminal through a second resource unit.
The method of claim 2, wherein,

The first resource unit and the second resource unit include different time-frequency resource blocks.
The method according to claim 3, wherein the method further comprises:

Configuring resource sizes for the first resource unit and the second resource unit respectively.
The method according to claim 1, wherein, before generating the data packet corresponding to the image data according to the first processed data and the second processed data, the method further comprises:

calculating a check value corresponding to the first data component;

A frame check sequence is generated according to the check value, and the frame check sequence is added to the first processed data.
The method according to any one of claims 1 to 5, wherein the method further comprises:

performing modulation processing on the first data component and the second data component based on the Wi-Fi 6 protocol;

Sending the first processed data and the second processed data based on the Wi-Fi 6 protocol.
The method according to any one of claims 1 to 5, wherein the method further comprises:

Modulating the first data component and the second data component based on the Wi-Fi 7 protocol;

Sending the first processed data and the second processed data based on the Wi-Fi 7 protocol.
The method according to claim 5, wherein the method further comprises:

Receive an acknowledgment response sent by the second wireless terminal.
A method of receiving image data in a second wireless terminal, the method comprising:

Receive a data packet corresponding to the image data sent by the first wireless terminal; wherein the data packet includes first processed data and second processed data;

Demodulating the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data;

performing verification processing on the first data component to obtain a verification result;

If the verification result is a successful verification, demodulating the second processed data to obtain a second data component; wherein the second data component represents the detail data in the image data;

performing combined decoding processing on the first data component and the second data component to obtain the image data.
The method according to claim 9, wherein the receiving the data packet corresponding to the image data sent by the first wireless terminal comprises:

receiving the first processed data sent by the first wireless terminal through a first resource unit;

The second processed data sent by the first wireless terminal is received by using a second resource unit.
The method of claim 10, wherein,

The first resource unit and the second resource unit include different time-frequency resource blocks.
The method according to claim 9, wherein said performing verification processing on said first data component to obtain a verification result comprises:

calculating a check value corresponding to the first data component;

The check result is determined according to the check value and the frame check sequence of the first processed data.
The method according to claim 12, wherein said determining the verification result according to the verification value and the frame verification sequence of the first processed data comprises:

If the check value is the same as the frame check sequence, it is determined that the check result is a successful check;

If the check value is different from the frame check sequence, it is determined that the check result is a check failure.
The method according to claim 13, wherein, after performing verification processing on the first data component, after obtaining the verification result, the method further comprises:

If the verification result is that the verification is successful, sending an acknowledgment response to the first wireless terminal.
The method according to claim 9, wherein, after performing combined decoding processing on the first data component and the second data component, after obtaining the image data, the method further comprises:

The image data is displayed.
The method according to any one of claims 9 to 15, wherein the method further comprises:

The first processed data and the second processed data are received based on the Wi-Fi 6 protocol or the Wi-Fi 7 protocol.
A first wireless terminal, the first wireless terminal comprising: a coding unit, a modulating unit, a generating unit, a sending unit,

The coding unit is configured to perform layered coding processing on image data to obtain a first data component and a second data component; wherein, the first data component represents contour data in the image data; the second The data component characterizes detail data in the image data;

The modulation unit is configured to perform modulation processing on the first data component according to a first modulation order to obtain first processed data; perform modulation processing on the second data component according to a second modulation order to obtain second processed data; wherein, the first modulation order is smaller than the second modulation order;

The generating unit is configured to generate a data packet corresponding to the image data according to the first processed data and the second processed data;

The sending unit is configured to send the data packet to a second wireless terminal.
A second wireless terminal, the second wireless terminal comprising: a receiving unit, a checking unit, a demodulating unit, a decoding unit,

The receiving unit is configured to receive a data packet corresponding to the image data sent by the first wireless terminal; wherein the data packet includes first processed data and second processed data;

The demodulation unit is configured to demodulate the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data;

The verification unit is configured to perform verification processing on the first data component to obtain a verification result;

The demodulation unit is further configured to demodulate the second processed data to obtain a second data component if the verification result is a successful verification; wherein the second data component represents detail data in said image data;

The decoding unit is configured to perform combined decoding processing on the first data component and the second data component to obtain the image data.
A first wireless terminal, the first wireless terminal includes a first processor and a first memory storing instructions executable by the first processor, and when the instructions are executed by the first processor, the The method according to any one of claims 1-8.
A second wireless terminal, the second wireless terminal includes a second processor and a second memory storing instructions executable by the second processor, and when the instructions are executed by the second processor, the The method according to any one of claims 9-16.
A chip, the chip includes a processor and an interface, the processor obtains program instructions through the interface, and the processor is used to run the program instructions to perform any one of claims 1-8 or 9-16 method described in the item.