KR20180087859A - Method for transmitting data and transmitter therefor - Google Patents

Abstract

According to an embodiment of the present invention, a data transmission method, which is a method of transmitting video data for a display panel by a transmitter in electronic communication with a receiver via a wireless communication channel, comprises the following steps: receiving, by the transmitter, a data signal from a data source; receiving, by the transmitter, a return signal from the receiver; generating a layered encoded data stream by encoding the data signal using a plurality of encoder blocks by the transmitter based on the return signal; and transmitting, by the transmitter, the layered encoded data stream to the receiver for decoding and display on the display panel, wherein a first encoder block of the plurality of encoder blocks encodes the data signal and each of subsequent encoder blocks encodes the difference between the input of the preceding encoder block and the output of a quantizer of the preceding encoder block.

Description

[0001] METHOD FOR TRANSMITTING DATA AND TRANSMITTER THEREFOR [0002]

The present disclosure is directed to a data transmission method and a transmitter.

The demand for video transmission over wireless is increasing due to the emergence of new applications and use cases. The technological advances of high resolution display screens and the advent of high quality video (HD, FHD, UHD, etc.) have increased bandwidth requirements for high throughput transmissions in recent years. For example, uncompressed Ultra High Definition (UHD) video requires 12 Gbps of bandwidth.

In addition to high data rate constraints, wireless video transmission is also time / delay sensitive. If providing 60 frames per second, the inter-frame time is 1/60 = 16.6 ms. Thus, any portion of the frame that is not received within 16.6 ms should be dropped so that the display device can begin rendering the next frame, and data retransmission is typically not a viable option. In addition to high bandwidth and latency requirements, wireless channels are susceptible to interference, which can cause the quality of the wireless channel to fluctuate unpredictably over time. Thus, it may be difficult to provide guaranteed quality of service (QoS) to transmit high quality video data over wireless channels.

It should be understood that the above description is merely intended to enhance the understanding of the background of the described technology, and accordingly, it may include information that does not constitute prior art already known to those skilled in the art.

The embodiment of the present disclosure is intended to provide a data transmission method and system thereof.

According to one embodiment, a method of transmitting video data for a display panel by a transmitter in electronic communication with a receiver via a wireless communication channel, the method comprising: receiving, by the transmitter, a data signal from a data source; Receiving, by the transmitter, a return signal from the receiver; Generating a layered encoded data stream by encoding the data signal using a plurality of encoder blocks by the transmitter based on the return signal, And transmitting the layered encoded data stream to a receiver for display on a panel, wherein a first encoder block of the plurality of encoder blocks encodes the data signal and each subsequent encoder block comprises a pre- And encodes the difference between the input of the encoder block and the output of the quantizer of the preceding encoder block.

At least one parameter of the plurality of encoder blocks for subsequent encoding and transmission of the data signal is changed dynamically by the transmitter based on at least one of channel quality, video quality, codec requirements, compression ratio requirements, The method comprising the steps of:

And modifying the one or more parameters of the plurality of encoder blocks may comprise adjusting the number of encoder blocks.

And modifying the one or more parameters of the plurality of encoder blocks may comprise adjusting the compression ratio of the encoder block.

Wherein modifying the one or more parameters of the plurality of encoder blocks comprises adjusting at least one of the transform operations, adjusting a quantization table, or adjusting a variable length encoder algorithm used in the encoder blocks .

And selecting one of the plurality of profiles based on the return signal, wherein each of the profiles may have different predefined parameters corresponding to the plurality of encoder blocks.

The different predefined parameters may include a difference in the number of encoder blocks for at least two of the plurality of profiles.

The return signal may include an indication of the quality of the wireless communication channel measured by the receiver.

The return signal may include an indicator of the visual quality measured by the receiver.

A transmitter according to an embodiment is a transmitter for transmitting data on a display panel to a receiver via a wireless communication channel, the transmitter receiving a data signal from a data source; Receive a return signal from the receiver; Generating a layered encoded data stream by ding-coding the data signal using a plurality of encoder blocks based on the return signal; Wherein the first encoder block of the plurality of encoder blocks encodes the data signal and transmits the encoded data stream to a subsequent encoder block, Each encoding the difference between the input of the preceding encoder block and the output of the quantizer of the preceding encoder block.

The transmitter may dynamically change one or more parameters of the plurality of encoder blocks for subsequent encoding and transmission of the data signal based on at least one of channel quality, video quality, codec requirements, compression ratio requirements, .

Modifying the one or more parameters of the plurality of encoder blocks may comprise adjusting the number of encoder blocks.

Modifying the one or more parameters of the plurality of encoder blocks may comprise adjusting the compression ratio of the encoder block.

Modifying the one or more parameters of the plurality of encoder blocks may include adjusting at least one of the transform operations, adjusting a quantization table, or adjusting a variable length encoder algorithm used in the encoder blocks .

The transmitter is further configured to select one of a plurality of profiles based on the return signal, and each of the profiles may have different predefined parameters corresponding to the plurality of encoder blocks.

The different predefined parameters may include a difference in the number of encoder blocks for at least two of the plurality of profiles.

The return signal may include an indication of the quality of the wireless communication channel measured by the receiver.

The return signal may include an indicator of the visual quality measured by the receiver.

A receiver according to an exemplary embodiment includes a receiver for receiving data for a display panel from a transmitter via a wireless communication channel, the receiver for receiving a layered encoded data stream from the transmitter via the wireless communication channel; Transmit a return signal to the transmitter; Decoding the layered encoded data stream according to parameters of corresponding encoder blocks of the transmitter using a plurality of decoder blocks to generate a decoded data stream; Wherein the first layer of the layered encoded data stream is a compressed version of the input data stream and the first layer of the layered encoded data stream is a compressed version of the layered encoded data stream. Each subsequent layer is a compressed version of the difference between the input of the preceding encoder block and the output of the quantizer of the preceding encoder block.

According to the embodiment of the present invention, data can be efficiently transmitted with a low delay.

1 is a block diagram illustrating a wireless data transmission system illustrating a high level overview of a cross-layer optimization system, in accordance with some embodiments of the present invention.
Figure 2 illustrates an exemplary layer-based compression scheme utilized in accordance with some embodiments of the present invention.
Figure 3 is a block diagram illustrating an example architecture of a cross-layer optimization system and additional details of some components, in accordance with some embodiments of the present invention.
Figure 4 illustrates an example of partitioning pixels into different types, according to some embodiments of the present invention.
Figure 5 illustrates an example of a view of one eye in accordance with some embodiments of the present invention.
6 illustrates an example of a reconstruction of a packet or layer structure in accordance with some embodiments of the present invention.
Figure 7 illustrates a header structure according to some embodiments of the present invention.
Figure 8 illustrates an exemplary reconfiguration of data in accordance with some embodiments of the present invention.
9 illustrates an exemplary reconfiguration of pixel bits and packets in accordance with some embodiments of the present invention.
Figure 10 illustrates header fields available under a wireless communication standard.
Figure 11 is a flow chart illustrating a process for cross-layer image optimization, in accordance with some embodiments of the present invention.
12A illustrates a transmitter structure for a dynamic layering compression system and method in accordance with some embodiments of the present invention.
12B illustrates a receiver structure for a dynamic layering compression system and method in accordance with some embodiments of the present invention.
Figure 13 shows a simplified example of how data blocks of size W x H bits can be processed (e.g., encoded and decoded) in parallel, in accordance with an embodiment of the present invention.
Figure 14 illustrates various exemplary configurations for different data transmission profiles in accordance with some embodiments of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Referring to the accompanying drawings, embodiments of the present invention will be described in detail.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following detailed description is an example of a system and method for cross-layer image optimization (CLIO) for wireless video transmission over a multi-gigabit channel provided in accordance with the present invention And does not represent a unique form of the present invention. The description sets forth features of the invention in connection with the illustrated embodiment. It is to be understood, however, that the same or equivalent functions and structures may be accomplished by the different embodiments, which are also intended to be included within the spirit and scope of the present invention. As indicated elsewhere herein, like reference numerals designate like parts or features.

The future of display technology encompasses a world full of inexpensive displays provided by various wireless streaming devices (cell phones, set-top boxes, projectors, etc.). Transmission of high quality video over wireless links has proven to be a challenge. While wireless devices are non-static, wireless links are lacking in bandwidth and vulnerable to various types of noise. The degree of delay (latency) is also high and variable, which is particularly harmful to video. A common design method in which different layers (e.g., application (APP) layer, medium access control (MAC) layer and physical (PHY) layer) are independently designed due to the stringent requirements of video transmission, It does not enable wireless data transmission. Thus, embodiments of the present invention provide a cross-layer approach in which information at one layer is used to change parameters of different layers. This flexibility allows for rapid adaptation to rapid changes in the wireless link.

The IEEE 802.11ad standard can provide the required bit rate for uncompressed full high definition (FHD) wireless video. 802.11ad operates in a 60 GHz band using a channel with a bandwidth of 2.16 GHz and uses a single carrier to provide up to 4.6 Gbps bandwidth on the physical layer (PHY), which is sufficient for uncompressed FHD video transmission. However, IEEE 802.11ad can only acquire maximum bandwidth in a specific deployment. For example, IEEE 802.11ad requires that the transmitter and the receiver be located within short distances and within a line of sight (LoS). Thus, embodiments of the present invention provide an improved approach to wireless data transmission.

According to some embodiments, various aspects of the present invention may be used to improve and guarantee QoS for video streaming over a wireless network, including physical (PHY), medium access control (MAC) or application (APP) Can be used. Thus, information from one layer (e.g., the MAC layer) can be used to optimize the parameters of another layer (e.g., the APP layer). For example, in video streaming, the APP layer may use information about channel quality in rate control (network awareness). The lower layer may also be configured to use information regarding video traffic characteristics. According to various embodiments, the system may include dynamic profile partitioning, dynamic tagging for packets, unequal error protection for different layers in layer-based compression techniques, and importance level aware modulation / coding selection, packetization and bit or pixel Use pruning.

According to one embodiment, the cross-layer method can be used to optimize perceptual quality in delay limited scalable video transmission. In addition, Unequal Error Protection (UEP) may be used depending on the packet loss visibility of the PHY layer for each video layer. There is also a buffer-aware source adaptation in the APP layer. The rate adaptation scheme is used for the QoS-driven seamless handoff scheme based on the IEEE 802.11 media independent handover (MIH) framework. To control the rate, the quantization parameter QP is adapted for single layer coding (AVC / H.264) and the enhancement layer is dropped for scalable coding (SVC / H.264). Rate and traffic adaptation are also included with admission control and automatic layer management to optimize QoS in terms of the number of sessions authorized for wireless video transmission and video quality. Traffic management, path selection and frame filtering are included as cross-layer optimization techniques for video streaming over UDP / RTP in cellular networks. The cross-layer framework is optimized for video codec optimization, time-sliced optimization for layer coded transmission to optimize the energy efficiency of a wireless multimedia broadcast receiver that takes into account the user's QoS level, display size and energy constraints, Adaptive Modulation and Coding Scheme (MCS).

In essence, compression removes redundancy from the source, and consequently inherently more susceptible to transmission errors. There are several methods that a compression system can use to mitigate the effects of transmission errors in a video stream. If the video stream is of quality, spatial or temporal scalability, we can use the concept of Unequal Error Protection (UEP) to provide a higher level of protection for more important information bits. On the receiver side, if the video stream has the property of error resilience, the error propagation is minimized and a good proportion of errors can be ignored. After decoding, an error concealment may be applied to the decoded output. One technique that uses temporal error concealment is to save the previous frame and play the frame if the current frame is corrupted. Another possibility is to use the neighboring pixels of the region of error to predict the current pixel. In general, error concealment is used as a last resort when other methods fail.

1 is a block diagram illustrating a wireless data transmission system 100 in accordance with some example embodiments of the present invention. The wireless data transmission system 100 includes a transmitter 102 and a receiver 106. The transmitter 102 receives data (e.g., uncompressed video data) from the data source 104 (e.g., an external data source such as a video card computer system) at the input terminal 103. Receiver 106 may be integrated into a user device or electronic device 108 (e.g., electronic display, smartphone, television, tablet, etc.) having a display panel 110 for displaying images and video. The display panel 110 includes a plurality of pixels, each pixel comprising a plurality of different color components (or sub-pixels) (e.g., each pixel may comprise a red component, a green component, and a blue component ). ≪ / RTI >

In terms of video, each frame of video is displayed (e.g., briefly displayed) as an image on the display panel 110. In some embodiments, the display panel 110 may include any display device having an integrated display, such as, for example, a television, monitor, cellular phone, tablet computer, wearable device, augmented reality (AR) headset, or virtual reality (VR) May be included as part of the electronic device 108.

The transmitter 102 and the receiver 106 also incorporate wireless radios 112 and 114 and the transmitter 102 wirelessly communicates with the receiver 106 via the wireless radios 112 and 114. Thus, the transmitter 102 and the receiver 106 exchange data with each other using any suitable wireless data spectrum and standard (e.g., Institute of Electrical and Electronics Engineers (IEEE) 802.11 standard). For example, the transmitter 102 may be coupled to the receiver 106 via a direct (e.g., data) channel 130 (e.g., a wireless communication channel) And the receiver 106 transmits feedback data or a return signal (including, for example, channel or visual quality data) to the transmitter 102 over the return channel 132.

Among other elements, the transmitter 102 includes an application (APP) layer 116 (e.g., including a display protocol and a video encoder module), a medium access control (MAC) layer 118, and a physical (PHY) 120). According to an embodiment of the present invention, various aspects of cross-layer image optimization are performed or performed in the APP layer 116, the MAC layer 118, and the physical layer 120. Likewise, the receiver 106 includes an APP layer 122, a MAC layer 124, and a PHY layer 126.

The wireless data transmission system 100 may be implemented as a cross-layer image optimization (CLIO) module or engine (e.g., a wireless local area network) that operates either as part of the transmitter 102 or in cooperation with the transmitter 102 to control the cross- 134). The CLIO module 134 may include, for example, a processor and memory coupled to the processor, which stores instructions executed by the processor, which instructions cause the processor to determine whether the cross- Thereby enabling the various operations of the optimization system and method to be performed. For example, the CLIO module 134 communicates data and instructions in electronic communication with the APP layer 116, the MAC layer 118 and the PHY layer 120 to provide a cross-layer image optimization system and method as described herein Can be performed.

1, the wireless data transmission system 100 implements various mechanisms for cross-layer image optimization in the APP layer 116, the MAC layer 118, and the PHY layer 126 , And is configured to receive data at transmitter 102 and transmit data to receiver 106.

Video compression / decompression systems or codecs can be evaluated essentially in six different ways: compression, quality (distortion), complexity, delay, quality scalability and error tolerance.

. According to one embodiment, a layer-based compression architecture (equal or similar to the JPEG 2000 standard) in which a video or data stream is parsed or divided into a plurality of quality layers, resolution layers, spatial locations or color components is called a cross- May be used for data or video compression as part of an optimization system and method (e.g., implemented by CLIO module 134). A layer-based encoder according to an embodiment of the present invention comprises the following steps: color conversion for a component, wavelet transform on each color channel, quantization of wavelet coefficients and finally, code-block Arithmetic coding of a rectangular area of wavelet coefficients can be used. These encoders provide flexibility in the structure of the encoded data by allowing various sequences of these code-blocks based on color components, resolution levels, spatial block positions or layers. The individual code blocks may be independently decodable, but the header for these code blocks may depend on the previous header and therefore be decoded in sequence.

The layer-based compressed encoded data stream used in accordance with embodiments of the present invention may begin with a frame header followed by a sequence of packet headers and data bits. As noted, the data stream may be partitioned in multiple quality layers, resolution levels, spatial positions, and color components. The example of FIG. 2 shows an example of a layer-based compressed encoded data stream generated at a layer, where the first layer may correspond to a compression level of 8: 1; At the end of the second layer (which decoded all the first layer packets), compression is set to 4: 1. Finally, decoding the third layer packet may be equivalent to transmitting the stream in 2: 1 compression. Embodiments of the present invention are not limited to the above-described compression ratio or the number of layers. Rather, the embodiment of the present invention has the data that the compression ratio is lower than the compression ratio of the first layer when the first or top layer has the highest compression ratio and the next layer is added to the first layer, When the last layer is added to each of the preceding layers, it has data that makes it relatively low, visually lossless, or visually almost lossless (e.g., 1: 1, 1.5: 1, 2: 1) Any suitable number of layers having any suitable compression ratio may be used depending on the design and function of the cross-layer image optimization system and method, so that it is done until the end of the cross-layer image optimization system and method.

According to some embodiments, in the context of the display of a VR display, when a stereoscopic image is transmitted to a receiver, the error of the data transmission affects both the left and right images, even if the error is on only one side You can give. Thus, in some embodiments of the present invention, the cross-layer image optimization system and method (e.g., CLIO module 134 and / or video encoder module of APP layer 116) }, And then ensures that the {different left image + right image difference} slice is encoded as a multiplexed stream. This procedure can reduce (e.g., by half) the number of cases where an error in the transmission of data impacts the visibility of the artifact.

An embodiment of the present invention in a cross-layer algorithm for improving the quality of video streaming includes a modulation and coding scheme (MCS) based on one or more features of the PHY layer, e.g., an indicator of the channel quality of the PHY layer, The dynamic adaptive modulation and coding (AMC) can be further utilized. A lower MCS value provides a lower bit error rate, but also achieves lower throughput. In one embodiment, the MAC layer with dynamic AMC can inform the APP layer about the MCS to adjust the compression rate based on the MCS.

Loss of different bits and packets gives a different impact on video quality, and embodiments of the present invention provide more protection for most significant bits (MSBs) in uncompressed / compressed video, more protection for packet headers in JPEG 2000, It works to protect more important bits in video reception using the UEP approach, including more protection for MPEG-4 I-frames. Protection can be achieved by using more robust MCS, retransmission, or additional error correction codes such as Reed-Solomon.

3 illustrates an exemplary structure of a cross-layer optimization system of a data transmission system 100 including control schemes at the APP, MAC and PHY layers and additional details of some components, according to some exemplary embodiments of the present invention Fig. The measurement and feedback blocks are used to estimate conditions such as bit error rate, video quality, and available bandwidth of a particular service class. The model of the APP layer and MAC layer can then minimize the distortion of the video quality by optimal bit allocation, reduce the number of bits required for forward error correction, and determine the priority of the packet according to the impact of its loss .

In some embodiments, as illustrated in FIG. 3, at the APP layer, the system may be based on feedback and measurements from a receiver (e.g., based on data received on return channel 132 from receiver 106) To enable / disable optical compression. The feedback may be based, for example, on video quality, and the measurement of video quality may be based on, for example, To-noise ratio (SNR) or peak signal-to-noise ratio (PSNR) reported by the receiver.

The MAC layer of FIG. 3 may include a number of functions, modules or procedures, including, for example, pixel partitioning, retransmission and multiple CRC checking, packetization using features such as MSB / LSB separation, and different priority buffers. Based on the feedback received from the PHY layer or the parameters of the APP layer, the system (e.g., CLIO module 134) may change the parameters of these functions at the MAC layer and determine how those functions, modules, . For example, there is a method in which a partition is divided into packets, whether pixel partitioning is performed and pixel partitioning is performed. The system may also be configured to determine or select whether retransmission is enabled.

According to some embodiments, a system (e.g., CLIO module 134) may utilize these features in a UEP implementation. For example, some of the packets may include such features as retransmissions, or these features may have different parameters for different packets, such as different MCS or MSB / LSB separations.

The PHY layer (e.g., the PHY layer 302, in addition to the corresponding PHY layer 304 in the receiver) may also include multiple layers for implementation of the UEP, as illustrated in FIG. Different packets may be sent on different layers with different MCS values. Different layers may also be associated with different buffers with different priorities. According to some exemplary embodiments, the system (e.g., CLIO module 134) may associate different packets with different layers and preference buffers according to video quality and measurement feedback.

According to some exemplary embodiments of the present invention, the first step of cross-layer image optimization for uncompressed or compressed transmission is layering or partitioning. Embodiments of the present invention utilize a plurality of predefined layering and / or partitioning profiles that are described in more detail below. As part of the data transmission session, one of the different layering and / or partitioning profiles may include, for example, a type of display device, a different criteria for video quality of view or an indicator (including peak signal to noise ratio (PSNR)), Channel quality, codec requirements or selection, MCS and data rate requirements, and the like. Each profile is dictated by or defined by a different set of procedures at the transmitter and receiver, including, for example, other error correction techniques, compression or packetization.

Embodiments of the present invention may also employ a Unequal Error Protection (UEP) method as part of a cross-layer image optimization for ordered layers of different bitstreams. The ordering of the bitstream or packet may be performed on layered-based compressed video or non-compressed video. Different MCS values are used for different layers depending on the channel quality.

According to some exemplary embodiments of the present invention, dynamic tagging of packets (e.g., as in IEEE 802.11ad) can be used as part of a cross-layer image optimization system and method of the present invention have. Since the importance level recognition procedure is implemented in the MAC packetizer for the transmitter and in the depacketizer at the receiver, the importance level and the corresponding information can be sent or signaled to the receiver.

As described above, in embodiments of the present invention, the system may utilize dynamic layering and partitioning profiles as part of a cross-layer image optimization system and method of the present invention. Transmitters and receivers (e.g., transmitter 102 and receiver 106) may utilize or agree upon a plurality of predefined layering / partitioning profiles. Such a profile may be selected based on different criteria for video visual quality (including PSNR), channel quality, codec requirements or selection, MCS, data rate requirements, and so on. The receiver then reverses the layering method and selects the corresponding algorithm (s) to be executed to further correct any transmission errors using the error concealment algorithm corresponding to the selected profile.

In one embodiment, the system uses seven profiles for use with various channel conditions, but the number of profiles is not limited to this, and any suitable number of profiles may be utilized depending on the design and functionality of the wireless data transmission system .

For example, profile "00" may be defined for when the channel operates in ideal or near ideal conditions, while profile "06 " may be defined for when the channel operates in very inferior conditions. The profile between "00 " and" 06 "is then defined for various intermediate conditions.

For example, one profile (e. G., Profile "00" or ideal / near ideal condition profile) may be defined for uncompressed video transmission when the channel quality is high. For such a profile, it can be assumed that the pixel partitioning technique has a high probability that neighboring pixels will contain very similar content. If any pixels from the group of four are missing, it can be recalculated from the other three captured pixels. The profile "00" can be selected by splitting the image into four types of pixels as illustrated in FIG. The three colors of a pixel in one type are packed into one packet. All 4 type packets are sent to the receiver. A receiver that knows that profile "00" is being sent can improve image quality. For example, if pixel data (or any color in a pixel) of any of the pixels is missing, the receiver may average the group of surrounding pixels of 4 or 8 (the number of pixels to average may be dynamic) Perform an averaging method that replaces missing pixels or colors. The image compression method also relies on the idea that neighboring pixels have correlated values. This method is simpler to implement than the entropy-coding compression algorithm and can be more robust to bit errors.

A second profile (e.g., profile "01") may be selected by splitting the image into four types of pixels, similar to the first profile (profile "00"). However, three types of pixels are selected for transmission. The system calculates if the resulting distortion is lower than the threshold by dropping one type of pixel. If this profile is signaled to the receiver, the receiver will estimate the missing pixel data value from the average of three (or more) other pixels in each of the four pixel types. The threshold may be selected based on different criteria including, for example, visual quality (e.g., PSNR). The selection and threshold of pixel types that are not transmitted may also be signaled.

The third profile (e.g., profile "02") may operate on a lower bandwidth than the first two profiles described above (e.g., profiles "00" and "01" Can be selected). For example, the third profile may not transmit the least significant bit (LSB) of a pixel in one or all packets. Then, at the receiver, the averaging algorithm can compensate for this bit. The other threshold level for distortion may be a third profile (e.g., profile "02") instead of the first or second profile (e.g., profile "01" "). ≪ / RTI >

Other profiles can be considered for compressed video when the quality of the channel is low and the PHY layer signals a lower value for MCS. For example, multiple quality-layering may be used to define a new profile for wireless video transmission. In layered-based compression, multiple layers may be generated as described above. According to an embodiment of the present invention, the highest layer may include data having the highest compression ratio among a plurality of layers, and the lowest layer may include a relatively low compression ratio (for example, 1: 1 or 1: 1: 1.5 or any suitable or visual lossless compression ratio). For example, in a three layer compression scheme (e.g., as illustrated in FIG. 2), layer 1 may include compressed image data having a compression ratio of 4: 1. Layer 2 may contain data forming a compressed image with a compression ratio of 2: 1 when added to layer 1. Layer 3 may include a bitstream with a 1: 1 compression ratio (or 1.5: 1 or other visually lossless compression ratio) if the resulting image is added to Layer 1 and Layer 2.

The transmitter selects a layer to transmit according to channel quality, visual quality, codec requirements, and the like. We have a fourth profile (e.g., profile "03") when transmitting layers 1, 2 and 3 (or all layers) (E.g., profile "04") and a layer 1 or a layer having the highest compression ratio, it is possible to define a sixth profile (e.g., profile "05"). For the seventh profile (e.g., profile "06"), the transmitter may transmit only one portion of the layer, e.g., both Layer 1 and Layer 2 and only a portion of Layer 3. The receiver will detect missing data information or implement an additional correction algorithm by recognizing that a seventh profile (e.g., profile "06") is transmitted. The transmitter may indicate the length of the original packet, and also the length of the packet transmitted in the packet header. The receiver can thus infer that a portion of the layer has not been received and deduce the correct size of the received packet. The receiver also warns the decoder that a portion of the packet has not been received and may request that the extra information be retransmitted or retransmitted by the transmitter.

The additional profile may be set according to the type of data to be transmitted, the nature of the display device on which the image is to be displayed, or the importance of certain parts of the image to other parts of the same image. For example, in accordance with some embodiments, a particular portion or region of an image may have an error in the data transmission for a bit corresponding to a portion of the image, rather than an error in data transmission for a bit corresponding to another portion of the image May be more important than other parts of the image in the sense that it may be more perceptible.

According to some embodiments, the cross-layer image optimization system and method may be deployed, for example, in the context of a VR display system in which a display device (e.g., display panel 110) is a VR display. In this situation, most of the viewer's image perception (e.g., 90%) focuses on and around the center of the image (e.g., the center of the field of view 15 degrees) Because they tend to move their heads to focus on the parts. 5, a cross-layer image optimization system and method (e. G., CLIO module 134) may generate a second region of the image (e. G., Labeled " B " (E.g., a region between the first region and the second field of view outside the first region, or between 15 and 20 degrees of the field of view) than the first or central region of the image 5, an area labeled 15, for example, an area of 15 degrees of the visual field). Also, both of the first and second regions of the image may be located in a third region of the image (e.g., a region labeled "C" in Figure 5, e.g., outside the first and second regions, (I.e., the area of the first area).

Another way of identifying regions of an image with higher importance or priority is described in U.S. Patent Application Serial No. 15 / 288,977, which is hereby incorporated by reference in its entirety. For example, according to some embodiments, data corresponding to an area of an image having a higher importance may have a higher level of importance or a higher degree of error protection Lt; / RTI > The area of the image with higher significance may vary depending on the type of display device corresponding to the receiver, for example, as described herein with respect to FIG.

The cross-layer image optimization system and method (e.g., CLIO module 134) may compare data in other regions of the image so that the data in the first region is < RTI ID = 0.0 > (E. G., A layering / partitioning profile as described above) or a UEP scheme (described in more detail below) with the lowest level of error and the second area of the image is the equation with the second lowest level of error ) Can be selected. In addition, according to some embodiments, a cross-layer image optimization system and method (e.g., CLIO module 134) may allow an error from an outer region or region Lt; RTI ID = 0.0 > a < / RTI >

According to some embodiments, the cross-layer image optimization system may use a lower number profile (e.g., a lower error-prone profile) to prioritize different portions of the image, for example, ) Are selected for the higher priority portion of the image and a higher number profile (e.g., a higher error probability profile) is selected for the lower priority portion of the image, The first profile to the seventh profile) may be used. According to some embodiments, a separate profile may be specifically predefined according to the type of display device (e.g., television, VR display, AR display, wireless medical display, etc.) (E. G., Compression, encoding, packetization, bit dropping or pruning) or reception (e. G., Decompression, decoding, Correction, de-packetization, retransmission).

In one embodiment, the selection criteria for the layering or partitioning profile may be based on video visual quality (e.g., PSNR) and / or channel quality (e.g., SNR). Layering identifies whether uncompressed video, uncompressed video with some dropped packets, or compressed video with a different compression ratio should be transmitted. Different layers may be handled differently in terms of queue priority, delay tolerance, error protection and / or reliability. Correspondingly, the transmitter and the receiver may transmit (e.g., compress, encode, packetize, bit drop or prune) or receive (e.g., decompress, Decode, error correction, de-packetization), or prior to that.

According to some embodiments, the selection of the profile may be sent to the receiver by bit selection of the MAC or PHY header packet. Based on the bit selection, the receiver can identify the method selected for layering. In addition to the profile number, any other information required for the selected profile, for example, the number of layers in compression and / or the number of packets / bytes in each layer, may be transmitted to the receiver. The extra information may be transmitted by a bit pattern of the packet header or over a secure channel or may be predefined.

Thus, one or more embodiments of the present invention provide a system for selecting a set of predefined layering and / or partitioning profiles for transmitting data (e.g., uncompressed video data) from a transmitter to a receiver over a wireless data communication channel And methods. The profile may include, for example, the channel quality, the video quality, the codec requirements or selection, the MCS and data rate requirements, the nature or characteristics of the data being transmitted, the nature of the display of the receiver stage (e.g. May be selected according to various conditions or parameters including characteristics. The selection of the profile may be transmitted from the transmitter to the receiver, for example, by a bit sequence of the MAC layer and / or the PHY layer header packet. Depending on the selected profile, additional information indicating one or more parameters for decompression, decoding, error correction, etc. may also be transmitted from the transmitter to the receiver (e.g., in the MAC layer and / or PHY layer header packet). Based on the information (e.g., bit sequence) transmitted from the transmitter to the receiver, the receiver may identify the method and / or protocol used in the transmitter for data layering and / or partitioning and / or compression, It may be possible to reverse the partitioning and / or compression and / or to select a corresponding algorithm or procedure to be executed to also correct any errors during transmission using an error concealment algorithm or other procedure corresponding to the selected profile .

Embodiments of the present invention may additionally utilize priority-based disparity error protection (UEP), for example, to protect more significant bits for video decoding (e.g., to facilitate proper transmission of the bits) . For example, in layer-based compression, bits that correspond to a higher compression rate (e.g., corresponding to base layer or layer 1) or associated bits are more important in video decoding and therefore require more protection . In addition, a bit error in the packet header or frame header prevents the video decoder from decoding the subsequent data bits. In one embodiment of a cross-layer image optimization system and method, a packet header is moved to the beginning of each frame as illustrated in FIG. In addition, the packet header can be identified by a unique start and end value as illustrated in FIG. When the header is moved to the head of the frame, the identifier is also moved so as to separate the headers from each other. The ending identifier may also be removed in accordance with some exemplary embodiments. The last end identifier may be maintained to distinguish between the end of the header information and the data information of the next layer.

According to some embodiments, a cross-layer image optimization system and method (e.g., CLIO module 134) may utilize different protection techniques against loss or error of wireless media for these headers and base layers. For example, according to some embodiments, different MCS values may be used for different layers, or different forward error correction (FEC) algorithms may be used at different coding rates. In addition, the unequal error protection operation may be performed at the MAC layer, so that an embodiment of the present invention may enhance or optimize the reconstruction engine and apply it to different codecs. For example, although the APP layer delivers the entire data to the MAC layer, the MAC layer has more flexibility to perform the various cross-layer image optimization operations described herein. Also, by implementing UEP at the MAC layer, the system is relatively more dynamic because different functions can be implemented with different parameters (e.g., frame by frame or within one frame), as described herein It can be changed. Furthermore, embodiments of the present invention may thus be enabled to perform only partial reconfiguration based on the state of the wireless channel.

The compression techniques employed in accordance with embodiments of the present invention may provide additional partitioning techniques in addition to layers of different compression ratios by providing different data components as illustrated in FIG. For example, various similar pixel bits (e.g., pixel bits with the same or similar MCS values) may be reconstructed in the packet to be grouped together. Any suitable compression technique that can also partition its output into multiple layers with different priorities can be used. The same approach can be used for header and data movement. An FEC with a different MCS value or a different coding rate may be used for the header or partition of the data.

In one embodiment, the header includes information about the length of the data packet that follows the header in the frame. In some examples, a cross-layer image optimization system and method may transmit portions of data bits in each layer or partition according to channel conditions, MCS conditions, bandwidth conditions, and the like. Thus, the length of the data stream that can be transmitted may also be appended to the header information and sent to the receiver. For example, a fixed or predetermined number of bytes (N bytes) may be reserved to identify this length. According to some embodiments, the length of the data stream may be at the end of each header for easy identification.

Thus, a system and method according to some embodiments of the present invention can be used to repartition or resynchronize bits in a layer or level-based compression system according to priority, delay tolerance, and / or protection or reliability level for transmission on a wireless data communication channel Lt; / RTI > The data frame includes a frame header and a packet header bit, which requires a higher level of protection compared to the data bits. The data bits of the frame may also be partitioned into different priority, protection and / or reliability levels. The header may be identified according to a predefined or known bit string, and the data bits may be arranged in order of importance. According to some embodiments, a higher priority or lower delay tolerance bit may be moved to the beginning of the data frame or reconfigured. For example, a frame of data may start with a frame header (e.g., in order of priority or importance), followed by a packet header, followed by a data bit. The packet header may be separated or identified by a predefined or predetermined bit string. Also, according to some embodiments, the length of the pruned and transmitted data bitstream may be indicated by inserting an indicator of length corresponding to each packet header in front of or behind the packet header. The decoder of the receiver reconstructs the frame, for example, by moving the packet header and other data bits to its original position (prior to reconstruction) and eliminating any further inserted data, such as data length bits, Data is used.

Thus, embodiments of the present invention can provide an implementation of unequal error protection for any layer and / or level-based compression technique for cross-layer image optimization. The header, layer and / or data partitions can be reconfigured according to priority or priority level, and such reconfiguration can be performed at the MAC layer of the transmitter. Depending on the cross-layer image optimization scheme, a portion of the data from each packet may be removed or dropped, and information about this data may be incorporated into the header information. Additionally, embodiments of the present invention may utilize disparity error protection, for example, by using different MCS values for forward error correction to protect information at different importance levels or differently. As part of the unequal error protection in accordance with some exemplary embodiments of the present invention, since all headers can be reconfigured to be grouped together (e.g., in one location), all headers can be included in each header of the frame Rather than use multiple small forward error corrections individually, one can experience one unequal error protection algorithm.

In accordance with some embodiments of the present invention, loss of different packets affects visual quality differently, since different packets can be protected differently using UEP and layer / partition-based compression. For example, if a particular packet in the header or base layer is lost, the system may not be able to reconstruct the video on the receiver side. On the other hand, some packet loss may result in a PSNR degradation. Further, as described above, depending on the type of display device used in the system, different portions of the image data may have a higher priority than other portions of the image data in terms of minimizing errors. Thus, embodiments of the present invention may further utilize dynamic UEP and importance awareness tagging, as described in more detail below.

As described above, a cross-layer image optimization system and method according to an embodiment of the present invention operates to partition packets at different importance levels based on priority, delay tolerance, protection or reliability. Each level of importance can be handled differently during transmission and / or reception.

In one embodiment, each frame is divided into a number of video packets having different importance levels. The system then tags each packet with a corresponding significance level and the corresponding bit corresponds to the aggregated MAC PDU (A-MPDU) subframe and the physical layer convergence procedure (PLCP) protocol data unit PPDU ) ≪ / RTI > frame. In one example, the PPDUs can be tagged with importance levels and dynamically packed with packets of the same importance level and A-MPDU subframes. Once retransmission is enabled, the A-MPDU subframe that needs to be retransmitted needs to be queued and placed in the appropriate PPDU with the appropriate importance level.

According to another embodiment, each A-MPDU subframe may be tagged according to the importance level. In this case, all PPDUs are considered equally in terms of importance level and they are packed with A-MPDUs having different importance levels. In a delay sensitive scenario requiring retransmission, it may be advantageous to tag the A-MPDU subframe rather than the PPDU packet. Although tagging in the A-MPDU sub-frame rather than the PPDU packet may use more overhead for the tag information, this approach may be easier to manage for packets of multiple importance levels.

According to various embodiments, a bit pattern may be added to the header of the A-MPDU or PPDU to tag the packet. The bit pattern may be M bits, where 0 ... 0 represents the highest significance and 1 ... 1 represents the lowest significance. According to some embodiments, the value M may be predefined or the value M may be signaled as part of the header information. According to some embodiments, the transmitter and the receiver may define different procedures for the 2 ^ M importance level and each level.

For guaranteed quality of service for wireless video transmission over IEEE 802.11ad or IEEE 802.11ay, a cross-layer image optimization system and method in accordance with some exemplary embodiments of the present invention provides a dynamic importance weight for each tagged importance level UEP can be implemented through level aware AMC. The different significance levels can be modulated with different MCS values or they can be encoded with different forward error correction (FEC) values or with the same but different FEC values.

In the related art system, the PHY can recommend an appropriate MCS index for the current channel situation. However, according to some embodiments of the present invention, a cross-layer image optimization system and method may adapt the recommended MCS for most of the bitstream. For example, the system can reduce the MCS index for more important layers or packets and increase the MCS index for less important layers or packets. 9 shows an example for an uncompressed video transmission where the system selects a different MCS value for the MSB / LSB part of the bits representing the RGB color at the pixel. The four MSB bits are transmitted to MCS-1, the next two bits are transmitted to MCS, and the last two LSB bits are transmitted to MCS + 1. It also includes regrouping bits into packet / A-MPDU subframes such that bits with the same MCS index are grouped into the same packet / A-MPDU subframe.

For example, in compressed video transmission, as described above with respect to FIGS. 6 and 8, after layer-based compression is performed and the bits are reconstructed according to the importance level of the transmission, 1, Layer 2 is sent to the MCS, and finally Layer 3 can be sent to the MCS or MCS + 1. The header and layer 1 are thus more protected and transmitted with little error. Since this information bit is transmitted to the MCS-1, the required bandwidth may exceed the supported bandwidth of the channel for the MCS. For compensation, a portion of layer 3 may be dropped and / or the layer 3 bit may be modulated to MCS + 1.

In IEEE 802.11ad, the MCS index is signaled only for each PPDU packet of 262,143 bytes. Thus, if the PPDUs are tagged with an importance level, embodiments of the present invention may use the IEEE 802.11ad procedure to use the recommended or modified MCS index for each packet. According to some embodiments, signaling in IEEE 802.11ad may be modified such that the MCS is signaled for each A-MPDU sub-frame. For example, the currently reserved bit or unused information in the header of each packet may be used. According to the IEEE 802.11ad standard, the header includes the field of FIG. As an example, in a peer-to-peer connection, embodiments of the present invention use "address 4" to signal the MCS. Embodiments of the present invention may additionally add new bytes to the header to signal the MCS for each A-MPDU.

Thus, a cross-layer image optimization system and method in accordance with some exemplary embodiments of the present invention can be used to optimize data for a video frame (e.g., a video frame) in different importance categories based on, for example, priority, delay tolerance, protection and / For example, pixel data, packets, etc.). Each video frame may be divided into a plurality of importance levels and the corresponding bits may be packed into A-MPDU subframes. Different packets (e.g., A-MPDU subframes, PPDU subframes, etc.) may be tagged according to their importance level, and according to some embodiments different packets may be sent to the receiver in order of their importance. Different packets (e.g., A-MPDU subframes) may be grouped (e.g., in PPDU packets) according to their importance level. A value or tag indicating the importance level can be sent from the transmitter to the receiver and added to the header of the packet. At the receiver end, the receiver may be enabled to determine the tag level, thereby further enabling different error recovery and / or concealment procedures depending on the tagging. In addition, data with different significance levels can be differently protected by selecting different modulation and coding scheme (MCS) values for each packet. The corresponding MCS value may be inserted in the header for the packet in addition to the tag.

Thus, embodiments of the present invention may be applied to dynamic partitioning and / or tagging of packets at transmitters and receivers for wireless data transmission, as well as AMC for wireless cross-layer image optimization (e.g., in IEEE multi-gigabit 802.11 ) And the importance recognition procedure. Embodiments of the present invention may enable tagging of each small packet in an A-MPDU (data) packet using multiple content driven tags. The tag may be transmitted and signaled to the receiver. Different procedures or parameters may be associated with tags for incorporating various aspects of the cross-layer image optimization mechanism described herein. Embodiments of the present invention may also use an unequal error protection based tag, such as AMC (MCS Adaptation to Tag).

According to various embodiments of the present invention, the system can continuously monitor and adjust various parameters and factors for cross-layer image optimization continuously. For example, the system may monitor the return signal from the receiver and may select a different profile, compression or error correction technique as described above for subsequent data transmission, for example, as the environment changes, You can adjust the layer image optimizations accordingly.

11 is an exemplary flow chart illustrating various operations of a method for cross-layer image optimization, in accordance with some exemplary embodiments of the present invention. However, the number and order of operations illustrated in FIG. 11 are not limited to the illustrated flow charts. For example, according to some embodiments, the order of operations may be changed (unless otherwise indicated), or the process may include additional operations or fewer operations without departing from the spirit and scope of the present invention. have. For example, various other features and operations described in this disclosure and corresponding drawings may be incorporated into the process, or particular operations may be omitted in accordance with some exemplary embodiments of the present invention.

Once the process is started, at step 1200, the system (e.g., wireless data transmission system 100 and / or transmitter 102) receives data (e.g., Video data signal). In step 1202, return data including various information about the data transmission to the receiver, including, for example, channel quality, visual quality, and the type of display connected to the receiver, )). Next, in step 1204, the system can identify the type of display device. In step 1206, the layering and / or partitioning profile may be determined based on, for example, the type of display device, different criteria for video visual quality or indicators (including peak signal-to-noise ratio (PSNR) Requirements or selections, MCS and data rate requirements, etc., and then transmitted.

In step 1208, layer or level-based compression may be performed on the data, for example, according to the selected layering / partitioning profile. Then, in step 1210, the bits of the layer, partition, packet or data are reconstructed into groups or packets according to their importance levels as described above.

At step 1212, the data may be tagged to indicate the level of importance of the packet and / or data of the data. Then, in step 1214, based on the importance level of the different types of data, unequal error protection may be performed to transmit the data to the receiver. In step 1216, the data is transmitted to the receiver, for example, for display on the display panel.

As described above, according to some embodiments of the present invention, the cross-layer image optimization system may be configured to optimize various predetermined data transmission profiles or parameters (e.g., profile "00" To "07"), compression techniques, and / or error correction techniques for data transmission. To this end, a dynamic layering compression scheme for data compression and decompression may be used as part of a cross-layer image optimization system, according to an embodiment of the present invention.

In the prior art, layer-based compression schemes can be inherently iterative and can be complex and difficult to implement in real-time hardware, especially in the context of a cross-layer design with multiple quality layers. Accordingly, some embodiments of the present invention may provide systems and methods for real-time implementation of layer-based compression. Using one or more layers to encode and decode data may require relatively low latency and may be used in a cross-layer image optimization system (e.g., as part of the wireless data transmission system 100 shown in FIG. 1) ) Can be relatively easily implemented. In addition, the dynamic layering compression system may utilize block compression parameters configurable in real time (e.g., on a frame basis) in accordance with the cross-layer image optimization and / or compression profile.

12A and 12B illustrate transmitter and receiver structures for a dynamic layering compression system and method, respectively, in accordance with some embodiments of the present invention. 12A, the transmitter 102 receives data (uncompressed video data) from a data source 104 (e.g., an external data source such as a video card computer system) 100 according to one or more parameters. For example, as described above, the parameters of a given data transmission profile (e.g., profiles "00" through "07") and / or the parameters indicated by the data received by return channel 132 Depending on the channel or video quality, the system can dynamically change how the data is compressed and decompressed for transmission.

According to some embodiments, the CLIO module 134 of the transmitter 102 and / or the encoder of the APP layer 116 may adjust the compression ratio of the compressed data and the number of compression layers according to the parameters of the data transmission profile ( For example as described in connection with FIG. 2).

As shown in FIG. 12A, according to the selected data transmission profile, the system may use M (M is an integer greater than or equal to 1) compressed or encoder blocks or layers 1220-1 through 1220-M. For example, according to some embodiments, the selected data transmission profile may utilize a single compressed block 1220-1. Each encoder block 1220-1 through 1220-M includes a transform module or wavelet modules 1222-1 through 1222-M, quantization modules 1224-1 through 1224-M, and a variable length coder VLC module 1226-1 through 1226-M, respectively. In the transform modules 1222-1 through 1222-M, a transform operation using any suitable transform algorithm known in the art is performed on the input data on a block of size W x H bits, Quantization modules 1224-1 through 1224-M. Quantization modules 1224-1 through 1224-M perform quantization operations on the transformed data, and the outputs thereof are provided to VLC modules 1226-1 through 1226-M, where VLC operation is performed. For forward error correction in the corresponding forward error correction modules 1227-1 through 1227-M according to the parameters of the selected data transmission profile, for the data from the VLC modules 1226-1 through 1226- And the corresponding compressed data layers 1228-1 through 1227-M may each be sent to a compressed stream multiplexer 1230 and transmitted to the receiver.

The outputs of quantization modules 1224-1 through 1224-M are also sent to inverse quantization modules 1232-2 through 1232-M, where inverse quantization operations are performed. The outputs of the dequantization modules 1232-2 through 1232-M are transmitted to the inverse wavelet modules 1234-2 through 1234-M.

The difference between the input data of each of the encoder blocks 1220-1 through 1220- (M-1) and the output of the inverse wavelet modules 1234-2 through 1234-M is, for example, Is calculated at operations 1240-2 through 1240-M and is provided as input data to the next or subsequent encoder block. Thus, in each operation 1240-2 through 1240-M, the system compares the missing data after the quantization operation with the original input of the preceding encoder block and stores the missing difference data in a subsequent input encoder block Can be provided as an input.

As shown in FIG. 12A, each of the encoder blocks 1220-1 to 1220-M has compression ratios (for example, N: 1, P: 1, Q: 1) The total compression ratio for the blocks may be the sum of the compression ratios. For example, for a data transmission profile with four encoder blocks, the first encoder block compresses the data by 1/8, the second by 1/8, the third by 1/4, the fourth by 1 / 4, the total compression ratio may be 3/4 (1/8 + 1/8 + 1/4 + 1/4), and the compression ratio of uncompressed data versus compressed data may be 1.333: 1 .

According to some embodiments of the present invention, each of the encoder blocks 1220-1 through 1220-M is independently set as part of the hardware of the encoder to match the bit rate required for the MAC layer to properly transmit data to the receiver The data can be encoded. Thus, as long as the system specifies or identifies which functional encoder block is used in the bitstream, the system can switch parameters of the encoder in real time (e.g., on a frame-by-frame basis). For example, depending on the compression ratio requirements from the MAC layer, additional encoder layers may be added or removed, certain conversions, quantization tables and variable length encoders may be modified, and / or compression ratio parameters of each encoder block The compression ratio requests from the MAC layer, the type of data being transmitted, and / or the selected data transmission profile.

12B, the decoder of the receiver 106 and / or the APP layer 122 of the receiver 106 may be coupled to the transmitter 102 (e.g., via the data channel 130 in the compressed stream multiplexer 1244) Lt; RTI ID = 0.0 > layered < / RTI > Initially, forward error correction may be performed for each layer, e.g., in the corresponding forward error correction modules 1246-1 through 1246-M, depending on whether forward error correction was performed at the transmitter. Then, for each of the encoder modules 1220-1 through 1220-M, the corresponding decoder modules 1250-1 through 1250-M perform a decoding operation on each compressed layer of data. For each decoder module 1250-1 through 1250-M, the corresponding layer of compressed data is first transmitted to the VLC modules 1252-1 through 1252-M where the VLC operation is performed first, Quantization modules 1254-1 to 1254-M, respectively, and inverse quantization is performed. The outputs of the de-quantization modules 1254-1 through 1254-M are transmitted to the inverse transform or wavelet modules 1256-1 through 1256-M where the inverse transform operation is performed. Finally, the outputs of the respective decoder blocks 1250-1 through 1250-M are combined into a data stream, for example in combining modules or operations 1260 and 1262, for display on the display panel 110 .

According to embodiments, at the receiver side, the layered encoded compressed data stream received by the receiver may comprise information and parameters relating to the encoding scheme used at the transmitter side. For example, the layered encoded compressed data stream may include parameters (e.g., compression ratio, transform algorithm, etc.) used to generate layered encoded compressed data and the number of encoder block layers . According to some embodiments, such information and parameters regarding the encoding scheme may be conveyed to the header file of the data stream and / or to information regarding the selected data transmission profile. When the information is transmitted by transmitting the selected data transmission profile, the parameters of the encoding scheme can be prestored in the memory of the receiver side.

Figure 13 shows a simple example of how data blocks of size W x H bits can be processed (e.g., encoded and decoded) in parallel. For example, as shown in FIG. 13, in an embodiment where the system uses encoder and decoder modules of three layers (first layer, second layer, third layer), the data block is processed by one encoder / decoder layer The subsequent encoder / decoder layer may process the corresponding block while at the same time the previous encoder / decoder layer may process the other data block. Thus, multiple blocks of data can be processed in parallel by different encoder / decoder layers, thereby greatly reducing the overall delay of the layered compression system.

Figure 14 illustrates various exemplary configurations for different data transmission profiles in accordance with some embodiments of the present invention. The abscissa or x-axis direction represents the frame time and the longitudinal or y-axis direction represents the data rate (e.g., bits per pixel), the total area of each rectangle being the relative total Lt; / RTI > For example, in the first configuration (configuration 1), the third compression layer (layer 3) may have half the total number of bits in the first and second compression layers (layer 1, layer 2). The first configuration may be used in an environment where there is a very high reliability wireless channel for transmitting relatively high quality video data, for example. For the second configuration (configuration 2), the total number of bits of data in the first layer (layer 1) and the forward error correction (layer 1 FEC) in layer 1 are the second layer (layer 2) May be the same as the number of bits of the data of " The second configuration (configuration 2) may be used, for example, in a situation where there is a highly reliable wireless channel, but there are occasional bad channel statistics and relatively high quality video data is transmitted. In the third configuration (configuration 3), the second layer (layer 2) is associated with the same amount of forward error correction data for the first and second layers (layer 1, layer 2) It has twice the number of bits of data, and there is no layer of other data. The third configuration (configuration 3) may be used, for example, in a situation where there is a low-reliability channel for transmitting medium quality video.

Thus, embodiments of the present invention can provide an efficient layered data compression system compatible with the cross-layer image optimization system described above, including a decoder at the encoder and receiver at the transmitter. For example, the encoding of the layer of compressed data can be achieved with relatively low latency, and can also be implemented relatively easily in hardware. In addition, the block compression parameters may be configured in real time (e.g., on a frame-by-frame basis) to accommodate cross-layer image compression goals.

The wireless data transmission system and / or any other related device or component in accordance with embodiments of the invention described herein may be implemented in any suitable hardware, firmware (e.g., application specific integrated circuit), software, or software, firmware, And the like. For example, various components of a wireless data transmission system may be formed on one integrated circuit (IC) chip or on a separate IC chip. In addition, various components of the display device may be implemented on a flexible printed circuit film, a tape carrier package (TCP), a printed circuit board (PCB), or on the same substrate as the display device. In addition, various components of a wireless data transmission system may be implemented on one or more processors and may be implemented in one or more computing devices, such as a process or thread that executes computer program instructions and interacts with other system components to perform the various functionality described herein Lt; / RTI > The computer program instructions are stored in a memory that can be implemented in a computing device using, for example, a standard memory device, such as random access memory (RAM). The computer program instructions may also be stored in other non-volatile computer readable media, such as, for example, CD-ROMs, flash drives, and the like. Those skilled in the art will also appreciate that the functionality of the various computing devices may be integrated into or coupled to a single computing device, or the functionality of a particular computing device may be distributed across one or more computing devices, without departing from the scope of the exemplary embodiments of the invention It should be recognized.

While the present invention has been described with reference to particular embodiments, those skilled in the art will be able to devise variations on the described embodiments without departing from the scope and spirit of the invention. It will also be appreciated by those skilled in the art that the invention itself may propose solutions to other tasks and adaptations to other applications. It should be understood that the intention herein is to be selected for purposes of this disclosure without departing from the spirit and scope of the present invention and all such uses of the invention and that variations and modifications that may be made to the embodiments of the invention herein are encompassed by the claims . Accordingly, these embodiments are to be considered in all respects as illustrative and not restrictive, and the scope of the present invention will be indicated by the appended claims and their equivalents rather than the foregoing description.

Claims (10)

A method of transmitting video data for a display panel by a transmitter in electronic communication with a receiver via a wireless communication channel,
Receiving, by the transmitter, a data signal from a data source;
Receiving, by the transmitter, a return signal from the receiver;
Generating a layered encoded data stream by encoding the data signal using a plurality of encoder blocks by the transmitter based on the return signal;
And transmitting, by the transmitter, the layered encoded data stream to the receiver for decoding and display on the display panel,
Wherein a first one of the plurality of encoder blocks encodes the data signal and each subsequent encoder block encodes a difference between an input of a preceding encoder block and an output of a quantizer of the preceding encoder block
Data transmission method. The method of claim 1,
At least one parameter of the plurality of encoder blocks for subsequent encoding and transmission of the data signal is changed dynamically by the transmitter based on at least one of channel quality, video quality, codec requirements, compression ratio requirements, Further comprising the steps of: 3. The method of claim 2,
Wherein modifying the one or more parameters of the plurality of encoder blocks comprises adjusting the number of encoder blocks. 3. The method of claim 2,
Wherein modifying the one or more parameters of the plurality of encoder blocks comprises adjusting a compression ratio of the encoder block. 3. The method of claim 2,
Wherein modifying the one or more parameters of the plurality of encoder blocks comprises adjusting at least one of the transform operations, adjusting a quantization table, or adjusting a variable length encoder algorithm used in the encoder blocks / RTI > The method of claim 1,
Further comprising selecting one of a plurality of profiles based on the return signal, wherein each of the profiles has different predefined parameters corresponding to the plurality of encoder blocks. The method of claim 6,
Wherein the different predefined parameters include a difference in the number of encoder blocks for at least two of the plurality of profiles. The method of claim 6,
Wherein the return signal comprises an indicator of the quality of the wireless communication channel measured by the receiver. 3. The method of claim 2,
Wherein the return signal comprises an indicator of visual quality measured by the receiver. A transmitter for transmitting data for a display panel to a receiver via a wireless communication channel, the transmitter comprising:
Receive a data signal from a data source;
Receive a return signal from the receiver;
Generating a layered encoded data stream by ding-coding the data signal using a plurality of encoder blocks based on the return signal;
And transmit the layered encoded data stream to the receiver for decoding and display the layered encoded data stream on the display panel,
Wherein a first one of the plurality of encoder blocks encodes the data signal and each subsequent encoder block encodes a difference between an input of a preceding encoder block and an output of a quantizer of the preceding encoder block
transmitter.

Images