WO2015058718A1 - Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events - Google Patents

Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events Download PDF

Info

Publication number
WO2015058718A1
WO2015058718A1 PCT/CN2014/089477 CN2014089477W WO2015058718A1 WO 2015058718 A1 WO2015058718 A1 WO 2015058718A1 CN 2014089477 W CN2014089477 W CN 2014089477W WO 2015058718 A1 WO2015058718 A1 WO 2015058718A1
Authority
WO
WIPO (PCT)
Prior art keywords
transmission
slice
encoded data
synchronization event
image processing
Prior art date
Application number
PCT/CN2014/089477
Other languages
French (fr)
Inventor
Kun-Bin Lee
Tung-Hsing Wu
Han-Liang Chou
Original Assignee
Mediatek Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mediatek Inc. filed Critical Mediatek Inc.
Priority to CN201480058507.0A priority Critical patent/CN105659593B/en
Priority to KR1020187024164A priority patent/KR101994599B1/en
Priority to JP2016524402A priority patent/JP2016539550A/en
Priority to EP14856655.7A priority patent/EP3036903A4/en
Priority to US15/031,281 priority patent/US10038904B2/en
Priority to BR112016009085-3A priority patent/BR112016009085B1/en
Priority to AU2014339383A priority patent/AU2014339383B2/en
Priority to KR1020167009207A priority patent/KR20160053988A/en
Publication of WO2015058718A1 publication Critical patent/WO2015058718A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/115Selection of the code volume for a coding unit prior to coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/184Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/436Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • H04N19/463Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/04Synchronising
    • H04N5/08Separation of synchronising signals from picture signals

Definitions

  • the disclosed embodiments of the present invention relate to transmitting compressed data over a transmission channel, and more particularly, to a method and apparatus for controlling transmission of a compressed picture according to transmission synchronization events.
  • a display interface may be disposed between an application processor (AP) and a display driver integrated circuit (DDIC) to transmit display data from the AP to the DDIC for further processing.
  • AP application processor
  • DDIC display driver integrated circuit
  • a display panel supports a higher display resolution
  • 2D/3D display with higher resolution can be realized.
  • the display data transmitted over the display interface would have a larger data size/data rate, which increases the power consumption of the display interface inevitably.
  • the AP and the DDIC are both located at a portable device (e.g., a smartphone) powered by a battery device, the battery life is shortened due to the increased power consumption of the display interface.
  • a camera interface may be disposed between a camera module and an image signal processor (ISP) to transmit multimedia data from the camera module to the ISP for further processing.
  • the ISP may be part of an application processor.
  • the captured image data transmitted over the camera interface would have a larger data size/data rate, which increases the power consumption of the camera interface inevitably.
  • the camera module and the ISP are both located at a portable device (e.g., a smartphone) powered by a battery device, the battery life is shortened due to the increased power consumption of the camera interface.
  • Data compression may be employed to reduce the data size/data rate of data transmitted over a transmission interface such as the display interface or the camera interface.
  • a transmission interface such as the display interface or the camera interface.
  • there is a need for an innovative design which can meet the requirements while transmitting a compressed picture from an encoder side to a decoder side.
  • an image processing method for controlling transmission of a compressed picture according to transmission synchronization events and a related image processing apparatus are proposed.
  • an exemplary image processing method includes: partitioning a picture into a plurality of slices, wherein each slice row in the picture includes at least one slice; generating a compressed picture by encoding each of the slices; and controlling at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row according to a transmission synchronization event.
  • an exemplary image processing apparatus includes a compressor and an output interface.
  • the compressor is configured to partition a picture into a plurality of slices, and generate a compressed picture by encoding each of the slices, wherein each slice row in the picture includes at least one slice.
  • the output interface is configured to control at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row according to a transmission synchronization event.
  • an exemplary method of transmitting a compressed picture includes: partitioning a picture into multiple slices; encoding each of slices; and controlling transmission of compressed data of a vertical adjacent slice to synchronize with a synchronization event.
  • FIG. 1 is a block diagram illustrating an image processing apparatus according to an embodiment of the present invention.
  • FIG. 2 is a diagram illustrating a first partitioning setting of a picture according to an embodiment of the present invention.
  • FIG. 3 is a diagram illustrating a second partitioning setting of a picture according to an embodiment of the present invention.
  • FIG. 4 is a diagram illustrating a compressed data transmission controlled by the output interface shown in FIG. 1 according to an embodiment of the present invention.
  • FIG. 5 is a diagram illustrating another compressed data transmission controlled by the output interface shown in FIG. 1 according to an embodiment of the present invention.
  • FIG. 6 is a diagram illustrating the operation of aligning at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row towards a transmission synchronization event.
  • the present invention proposes applying data compression to a picture and then transmitting a compressed picture over a transmission channel.
  • the data compression may be standardized by a Video Electronics Standards Association (VESA) display stream compression (DSC) .
  • VESA Video Electronics Standards Association
  • DSC Video Electronics Standards Association
  • the present invention further proposes controlling transmission of the compressed picture according to transmission synchronization events.
  • At least one of the start and the end of transmission of encoded data (i.e., compressed data) of a slice row is intentionally aligned towards a transmission synchronization event.
  • encoded data i.e., compressed data
  • a slice row which may include one or more slices, depending upon the partitioning design of the picture
  • FIG. 1 is a block diagram illustrating an image processing apparatus according to an embodiment of the present invention.
  • the image processing apparatus 100 includes a compressor 102, an output interface 104, and a configuration register 105. It should be noted that only the circuit components pertinent to the present invention are shown in FIG. 1. In practice, the image processing apparatus 100 may be configured to have additional circuit components.
  • the image processing apparatus 100 is located at an encoder side, and generates a bitstream BS to a decoder side through one transmission port 108 of a transmission interface 101. Hence, the bitstream BS is transmitted from the encoder side to the decoder side via a transmission channel 106 of the transmission interface 101.
  • the image processing apparatus 100 may be part of a camera module, and a picture IMG to be processed by the proposed image processing apparatus 100 may be derived from an output of a camera sensor implemented in the camera module.
  • the transmission interface 101 may be a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI) .
  • MIPI Mobile Industry Processor Interface
  • the transmission port 108 is a camera port of the CSI.
  • the picture IMG is one complete captured image generated from the camera sensor, and a single-port compressed data transmission is employed by the camera module.
  • the picture IMG is part of one complete captured image generated from the camera sensor.
  • the camera module may be configured to have multiple image processing apparatuses 100 included therein.
  • the image processing apparatuses 100 are used for processing different image regions of one complete captured image and transmitting compressed data of the different image regions to the ISPs, respectively. Therefore, the transmission port 108 is one of the camera ports of the CSI, and a multi-port compressed data transmission is employed by the camera module.
  • the image processing apparatus 100 may be part of an application processor (AP) , and the picture IMG to be processed by the proposed image processing apparatus 100 may be generated at the AP.
  • the transmission interface 101 may be a display serial interface (DSI) standardized by a Mobile Industry Processor Interface (MIPI) .
  • MIPI Mobile Industry Processor Interface
  • the transmission port 108 is one display port of the DSI.
  • the AP is coupled to a single display driver integrated circuit (DDIC) through the transmission port 108 only, the picture IMG is one complete image to be displayed on a display screen driven by the DDIC, and a single-port compressed data transmission is employed by the AP.
  • DDIC display driver integrated circuit
  • the picture IMG is part of one complete image to be displayed on a display screen.
  • the AP may be configured to have multiple image processing apparatuses 100 included therein.
  • the image processing apparatuses 100 are used for processing different image regions of one complete image and transmitting compressed data of the different image regions to the DDICs, respectively.
  • Different display areas of the display screen are driven by the DDICs, respectively. Therefore, the transmission port 108 is one of the display ports of the DSI, and a multi-port compressed data transmission is employed by the AP.
  • the configuration register 105 may be programmed to store a control setting used for configuring the compressor 102 and the output interface 104. In other words, behaviors of the compressor 102 and the output interface 104 depend on the control setting programmed in the configuration register 105.
  • the compressor 102 receives the picture IMG, partitions the picture IMG into a plurality of slices, and generates a compressed picture IMG’by encoding each of the slices. After partitioning is applied to the picture IMG, the picture IMG may be regarded as having slice rows arranged vertically. Each slice row in the picture IMG includes at least one slice.
  • the term “slice row” mentioned hereinafter may mean a single slice or a combination of slices arranged horizontally.
  • FIG. 2 is a diagram illustrating a first partitioning setting of the picture IMG according to an embodiment of the present invention.
  • the compressor 102 partitions the picture IMG into four slices Slice_1, Slice_2, Slice_3, Slice_4 that are arranged vertically. It is possible that the original picture height PS of the picture IMG is not divisible by the slice height HS.
  • the compressor 102 may add padding pixels below the last line (i.e., the last pixel row) of the picture IMG to serve as part of the slice Slice_4 with the slice height HS. In this way, each of the slices Slice_1, Slice_2, Slice_3, Slice_4 has the same slice height HS. After the pseudo picture region is added due to pixel padding, the picture height PS is extended to cover this pseudo picture region.
  • FIG. 3 is a diagram illustrating a second partitioning setting of the picture IMG according to an embodiment of the present invention.
  • the compressor 102 partitions the picture IMG into eight slices including Slice (H1, V1) , Slice (H1, V2) , Slice (H1, V3) , Slice (H1, V4) arranged vertically and Slice (H2, V1) , Slice (H2, V2) , Slice (H2, V3) , Slice (H2, V4) arranged vertically.
  • each slice row includes multiple slices arranged horizontally.
  • each slice includes a plurality of groups, and each group includes a plurality of pixels.
  • the compressor 102 outputs encoded data of each slice to the output interface 104 for transmission. It should be noted that when one slice row includes multiple slices, encoded data of the slices are multiplexed and then transmitted. Hence, encoded data of one slice row having a single slice only and encoded data of one slice row having multiple slices may be transmitted in the same way. For clarity and simplicity, the following assumes that first partitioning setting of the picture IMG is employed such that each slice row is one slice.
  • the output interface 104 is configured to control at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row according to a transmission synchronization event SYNC.
  • the transmission synchronization event SYNC may be a horizontal synchronization event used to indicate that one line of the picture is transmitted.
  • the transmission synchronization event SYNC may be a vertical synchronization event used to indicate that one entire picture is transmitted. It should be noted that, the first line of a current picture may start with a vertical synchronization event due to the end of a previous picture, and all other lines of the picture may start with a horizontal synchronization event due to the end of a previous line.
  • the start of transmission of encoded data of any slice row in the picture IMG and/or the end of transmission of encoded data of any slice row in the picture IMG may be controlled to be synchronized with closest horizontal synchronization events.
  • the start of transmission of encoded data of the first slice row in the picture IMG and/or the end of transmission of encoded data of the last slice row in the picture IMG may be controlled to be synchronized with closest vertical synchronization events;
  • the end of transmission of encoded data of the first slice row in the picture IMG and/or the start of transmission of encoded data of the last slice row in the picture IMG may be controlled to be synchronized with closest horizontal synchronization events;
  • the start of transmission of encoded data of other slice rows in the picture IMG and/or the end of transmission of encoded data of other slice rows in the picture IMG may be controlled to be synchronized with closest horizontal synchronization events.
  • the compressor 102 may include an encoder 112 and a rate controller 114, where the encoder 112 may perform lossy compression upon each slice, and the rate controller 114 may apply bit rate control to each compression operation to ensure that encoded data of a slice satisfies a bit budget allocated to the slice.
  • the rate controller 114 may employ a fixed rate control method, and the encoder 112 may generate the compressed picture IMG’through a lossy compression method with the fixed rate control method applied thereto.
  • a bit budget allocated to a slice row (which may include one or more slices, depending upon the employed partitioning setting of the picture) is determined, where
  • the fixed rate control method is performed by the rate controller 114 such that each of the slices is assigned with the same bit budget calculated based at least partly on the picture size of the picture IMG and the desired compression ratio CR. Therefore, the ratio of the size of encoded data of a slice row to the size of original data of the slice row is equal to CR.
  • a transmission rate controller 116 implemented in the output interface 104 may refer to compression-related parameters (e.g., picture size and compression ratio) to adjust transmission rate and timing of the transmission channel 106 to thereby make the start of transmission of encoded data of a slice row be aligned towards one transmission synchronization event SYNC and/or the end of transmission of encoded data of the slice row be aligned towards another transmission synchronization event SYNC. More specifically, compressed data transmission may be correlated to data compression, especially the compression ratio.
  • the transmission synchronization event used for controlling transmission timing of one slice row may be a horizontal synchronization event or a vertical synchronization event, depending upon actual design consideration.
  • FIG. 4 is a diagram illustrating a compressed data transmission controlled by the output interface shown in FIG. 1 according to an embodiment of the present invention.
  • the slice height HS is set by 8.
  • each of the slices has 8 lines (i.e., pixel rows) .
  • the transmission rate and timing of the transmission channel 106 is adjusted by the transmission rate controller 116 according to the compression ratio CR of the compressed picture IMG’, such that encoded data of each slice row is ensured to be transmitted within an integer number of transmission time slots that is smaller than the slice height (i.e., the number of lines in each slice row) .
  • the start of transmission of encoded data of a slice row is aligned towards one transmission synchronization event SYNC, and the end of transmission of encoded data of the slice row is aligned towards another transmission synchronization event SYNC.
  • the output interface 104 may transmit the compressed picture IMG’by using a transmission time slot size originally used for transmitting the picture IMG.
  • the size of data allowed to be transmitted in each transmission time slot with an active period T 1 may be equal to the size of original data of one line (i.e., one pixel row) in the picture IMG.
  • the output interface 104 transmits encoded data of one slice row (e.g., Slice_1 in FIG. 2) within three consecutive transmission time slots, and transmits encoded data of the next slice row (e.g., Slice_2 in FIG. 2) within three consecutive transmission time slots.
  • there is one horizontal synchronization event e.g., HSYNC and HSYNC 1 -HSYNC 6
  • there is one vertical synchronization event at the end of one entire picture (e.g., VSYNC) .
  • the output interface 104 properly controls timing of the transmission channel 106.
  • the start of transmission of encoded data of the slice row (e.g., Slice_1 in FIG. 2) is aligned towards a horizontal synchronization event HSYNC generated due to the end of the last line in the previous entire picture or a vertical synchronization event VSYNC generated due to the end of the previous entire picture, and/or the end of transmission of encoded data of the slice row (e.g., Slice_1 in FIG. 2) is aligned towards a horizontal synchronization event HSYNC 3 generated due to the end of the last line in the slice row.
  • the start of transmission of encoded data of another slice row (e.g., Slice_2 in FIG.
  • the transmission rate of the transmission channel 106 may be derived from calculating as a positive integer, where the value of the positive integer depends on the actual design consideration.
  • the transmission rate of the transmission channel 106 may be derived from calculating as a positive integer, where the value of the positive integer depends on the actual design consideration.
  • the bitrate of encoded data in one slice row (or the bitrate of the compressed picture IMG’) may be estimated using the compression-related parameters, including picture size, compression ratio, etc. It should be noted that the transmission clock should be adjusted accordingly.
  • the setting of the transmission rate may further consider the channel bandwidth occupied by the transmission synchronization events SYNC.
  • the transmission rate also needs to be adjusted accordingly.
  • the initial transmission rate of the transmission channel 106 may be derived from calculating as a positive integer, where the value of the positive integer depends on the actual design consideration.
  • the bitrate of encoded data in one slice row may be estimated using the compression-related parameters, including picture size, compression ratio, etc. Then the transmission clock should be adjusted accordingly with consideration of synchronization event and transmission protocols.
  • an initial transmission rate of the transmission channel 106 may be set by a positive value which is an integer multiple of a bitrate of encoded data in one slice row, a bitrate of compressed picture IMG’or a bitrate of compressed group line in one slice.
  • the initial transmission rate of the transmission channel 106 may be fine tuned (e.g., increased or decreased) to a final transmission rate actually set to the transmission channel 106 for compressed data transmission based on certain factors taken into consideration. For example, the channel bandwidth occupied by the transmission synchronization events SYNC and/or whether the transmission channel is shared by multiple devices may be taken into consideration.
  • the final transmission rate may not be necessarily divisible by bitrate of encoded data in one slice row/bitrate of compressed picture IMG’/bitrate of compressed group line in one slice.
  • a positive integer derived from applying a floor function (or a ceiling function) to may be equal to a positive integer derived from applying a floor function (or a ceiling function) to may be equal to and a positive integer derived from applying a floor function (or a ceiling function) to may be equal to
  • this is for illustrative purposes only, and is not meant to be a limitation of the present invention.
  • FIG. 5 is a diagram illustrating another compressed data transmission controlled by the output interface shown in FIG. 1 according to an embodiment of the present invention.
  • the transmission rate and timing of the transmission channel 106 is adjusted by the transmission rate controller 116 according to the compression ratio CR of the compressed picture IMG’, such that encoded data of each slice row is ensured to be transmitted within an integer number of transmission time slots that is equal to the slice height (i.e., the number of lines in each slice row) .
  • the start of transmission of encoded data of a slice row is aligned towards one transmission synchronization event SYNC, and the end of transmission of encoded data of the slice row is aligned towards another transmission synchronization event SYNC.
  • partial encoded data of one slice row and partial encoded data of another slice row are not transmitted within the same transmission time slot.
  • the output interface 104 knows the bit budget allocated to each of the slice rows (e.g., Slice_1-Slice_4 in FIG. 2) , and then divides the bit budget by the number of lines in each slice row to determine the amount of encoded data required to be transmitted within one transmission time slot.
  • the transmission rate controller 116 of the output interface 104 may adjust transmission rate and timing of the transmission channel 106 to thereby make the start of transmission of encoded data of a slice row aligned towards one transmission synchronization event SYNC and/or the end of transmission of encoded data of the slice row aligned towards another transmission synchronization event SYNC.
  • the encoded data of one slice row (e.g., Sclice_2 in FIG. 2) is evenly divided into 8 payload sections P 1 -P 8 , such that the payload sections P 1 -P 8 have the same size.
  • each slice includes a plurality of groups, and each group includes a plurality of pixels.
  • the total size of all encoded group rows corresponding to the same slice row is equal to the bit budget allocated to compression of the slice row.
  • each of the encoded group rows may have different bitstream sizes.
  • each of the payload sections P 1 -P 8 may include encoded data belonging to the same group row only, or may include encoded data belonging to adjacent group rows.
  • the payload section P 1 may include all encoded data of group row 1 and partial encoded data of group row 2; and the payload section P 2 may include remaining encoded data of group row 2.
  • the payload section P 1 may include all encoded data of group row 1 and partial encoded data of group row 2; the payload section P 2 may include another partial encoded data of group row 2; and the payload section P 3 may include remaining partial encoded data of group row 2.
  • the size of data transmitted in each transmission time slot with an active period T 2 is equal to
  • the output interface 104 transmits encoded data of the slice row (e.g., Slice_2 in FIG. 2) within eight transmission time slots. Specifically, the equal-sized payload sections P 1 -P 8 are transmitted within the transmission time slots, respectively. As can be seen from FIG. 5, there is one horizontal synchronization event at the start of each transmission time slot.
  • the transmission rate controller 116 of the output interface 104 properly controls transmission rate and timing of the transmission channel 106. In this way, the start of transmission of encoded data of the slice row (e.g., slice Slice_2 in FIG.
  • N th horizontal synchronization event e.g., HSYNC 8
  • the end of transmission of encoded data of the slice row e.g., Slice_2 in FIG. 2
  • N+M th horizontal synchronization event e.g., HSYNC 16
  • M corresponds to the slice height. More specifically, the value of M is equal to the slice height.
  • FIG. 6 is a diagram illustrating the operation of aligning at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row towards a transmission synchronization event.
  • a data packet of the bitstream BS may include a header section, a payload section, and a footer section.
  • the payload section is used to carry the encoded slice data.
  • the header section is used to carry header information of the data packet and has a fixed length (e.g., 4 bytes) .
  • HBP Horizontal Back Porch
  • HSS Horizontal Sync Start
  • the output interface 104 determines the start time T S to ensure that an interval TP 1 between a preceding transmission synchronization event (e.g., a horizontal synchronization event HSYNC_1) and the start time T S of transmitting the encoded slice data (e.g., the timing when the first bit of encoded data of one slice row) is a predetermined value.
  • a preceding transmission synchronization event e.g., a horizontal synchronization event HSYNC_1
  • the start time T S of transmitting the encoded slice data e.g., the timing when the first bit of encoded data of one slice row
  • the footer section may be used to carry checksum information for CRC check and has a fixed length (e.g., 2 bytes) .
  • the output interface 104 determines the end time T E to ensure that an interval TP 2 between a following transmission synchronization event (e.g., a horizontal synchronization event HSYNC_2) and the end time T E of transmission of encoded slice data (e.g., the last bit of encoded data of the slice row) is a predetermined value.
  • a following transmission synchronization event e.g., a horizontal synchronization event HSYNC_2
  • the end time T E of transmission of encoded slice data e.g., the last bit of encoded data of the slice row
  • the encoded data of one slice row shown in FIG. 4 is transmitted using three data packets, each having the packet structure shown in FIG. 6 and transmitted within one transmission time slot.
  • the output interface 104 controls the start time of transmitting the first bit of encoded data of one slice row based on the predetermined time interval TP 1 .
  • the output interface 104 controls the end time of transmitting the last bit of encoded data of one slice row based on the predetermined time interval TP 2 .
  • the packet sections P 1 -P 8 shown in FIG. 5 are carried by a plurality of data packets, each having the packet structure shown in FIG. 6.
  • the output interface 104 controls the start time of transmitting the first bit of encoded data of one slice row based on the predetermined time interval TP 1 .
  • the output interface 104 controls the end time of transmitting the last bit of encoded data of one slice row based on the predetermined time interval TP 2 .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

An image processing method includes at least the following steps: partitioning a picture into a plurality of slices, wherein each slice row in the picture includes at least one slice; generating a compressed picture by encoding each of the slices; and controlling at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row according to a transmission synchronization event.

Description

METHOD AND APPARATUS FOR CONTROLLING TRANSMISSION OF COMPRESSED PICTURE ACCORDING TO TRANSMISSION SYNCHRONIZATION EVENTS
CROSS REFERENCE TO RELATED APPLICATIONS
This application claims the benefit of U.S. provisional application No. 61/904,490 (filed on 11/15/2013) , U.S. provisional application No. 61/895,454 (filed on 10/25/2013) , and U.S. provisional application No. 61/895,461 (filed on 10/25/2013) . The entire contents of the related applications are incorporated herein by reference.
TECHNICAL FIELD
The disclosed embodiments of the present invention relate to transmitting compressed data over a transmission channel, and more particularly, to a method and apparatus for controlling transmission of a compressed picture according to transmission synchronization events.
BACKGROUND
A display interface may be disposed between an application processor (AP) and a display driver integrated circuit (DDIC) to transmit display data from the AP to the DDIC for further processing. When a display panel supports a higher display resolution, 2D/3D display with higher resolution can be realized. Hence, the display data transmitted over the display interface would have a larger data size/data rate, which increases the power consumption of the display interface inevitably. If the AP and the DDIC are both located at a portable device (e.g., a smartphone) powered by a battery device, the battery life is shortened due to the increased power consumption of the display interface.
Similarly, a camera interface may be disposed between a camera module and an image signal processor (ISP) to transmit multimedia data from the camera module to  the ISP for further processing. The ISP may be part of an application processor. When a camera sensor with a higher resolution is employed in the camera module, the captured image data transmitted over the camera interface would have a larger data size/data rate, which increases the power consumption of the camera interface inevitably. If the camera module and the ISP are both located at a portable device (e.g., a smartphone) powered by a battery device, the battery life is shortened due to the increased power consumption of the camera interface.
Data compression may be employed to reduce the data size/data rate of data transmitted over a transmission interface such as the display interface or the camera interface. However, there may be certain requirements for decoding and transmission of the compressed data. Hence, there is a need for an innovative design which can meet the requirements while transmitting a compressed picture from an encoder side to a decoder side.
SUMMARY
In accordance with exemplary embodiments of the present invention, an image processing method for controlling transmission of a compressed picture according to transmission synchronization events and a related image processing apparatus are proposed.
According to a first aspect of the present invention, an exemplary image processing method is disclosed. The exemplary image processing method includes: partitioning a picture into a plurality of slices, wherein each slice row in the picture includes at least one slice; generating a compressed picture by encoding each of the slices; and controlling at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row according to a transmission synchronization event.
According to a second aspect of the present invention, an exemplary image processing apparatus is disclosed. The exemplary image processing apparatus includes a compressor and an output interface. The compressor is configured to partition a picture into a plurality of slices, and generate a compressed picture by encoding each of the slices, wherein each slice row in the picture includes at least one slice. The output interface is configured to control at least one of start of transmission  of encoded data of a slice row and end of the transmission of encoded data of the slice row according to a transmission synchronization event.
According to a third aspect of the present invention, an exemplary method of transmitting a compressed picture is disclosed. The exemplary method includes: partitioning a picture into multiple slices; encoding each of slices; and controlling transmission of compressed data of a vertical adjacent slice to synchronize with a synchronization event.
These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
BRIEF DESCRIPTION OF DRAWINGS
FIG. 1 is a block diagram illustrating an image processing apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a first partitioning setting of a picture according to an embodiment of the present invention.
FIG. 3 is a diagram illustrating a second partitioning setting of a picture according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating a compressed data transmission controlled by the output interface shown in FIG. 1 according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating another compressed data transmission controlled by the output interface shown in FIG. 1 according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating the operation of aligning at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row towards a transmission synchronization event.
DETAILED DESCRIPTION
Certain terms are used throughout the description and following claims to refer  to particular components. As one skilled in the art will appreciate, manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms "include" and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to ... ". Also, the term "couple" is intended to mean either an indirect or direct electrical connection. Accordingly, if one device is coupled to another device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.
The present invention proposes applying data compression to a picture and then transmitting a compressed picture over a transmission channel. As the data size/data rate of the compressed picture is smaller than that of the original un-compressed picture, the power consumption of a transmission interface is reduced correspondingly. In addition, the data compression may be standardized by a Video Electronics Standards Association (VESA) display stream compression (DSC) . Hence, in accordance with VESA DSC, there is a requirement requesting that the delay from the start of transmission to the start of decoding and the delay from the end of transmission to the end of decoding must be the same as one another and the same for each slice. The present invention further proposes controlling transmission of the compressed picture according to transmission synchronization events. For example, at least one of the start and the end of transmission of encoded data (i.e., compressed data) of a slice row (which may include one or more slices, depending upon the partitioning design of the picture) is intentionally aligned towards a transmission synchronization event. In this way, the requirement specified in VESA DSC may be partially or fully satisfied. Further details of the proposed image processing design with transmission synchronization event based control of compressed data transmission will be described as below.
FIG. 1 is a block diagram illustrating an image processing apparatus according to an embodiment of the present invention. The image processing apparatus 100 includes a compressor 102, an output interface 104, and a configuration register 105. It should be noted that only the circuit components pertinent to the present invention are shown in FIG. 1. In practice, the image processing apparatus 100 may be configured to have additional circuit components. The image processing apparatus 100 is located at an encoder side, and generates a bitstream BS to a decoder side through one transmission  port 108 of a transmission interface 101. Hence, the bitstream BS is transmitted from the encoder side to the decoder side via a transmission channel 106 of the transmission interface 101.
In one exemplary implementation, the image processing apparatus 100 may be part of a camera module, and a picture IMG to be processed by the proposed image processing apparatus 100 may be derived from an output of a camera sensor implemented in the camera module. In addition, the transmission interface 101 may be a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI) . Hence, the transmission port 108 is a camera port of the CSI. In a case where the camera module is coupled to a single image signal processor (ISP) through the transmission port 108 only, the picture IMG is one complete captured image generated from the camera sensor, and a single-port compressed data transmission is employed by the camera module. In another case where the camera module is coupled to multiple ISPs through multiple camera ports, the picture IMG is part of one complete captured image generated from the camera sensor. In other words, the camera module may be configured to have multiple image processing apparatuses 100 included therein. The image processing apparatuses 100 are used for processing different image regions of one complete captured image and transmitting compressed data of the different image regions to the ISPs, respectively. Therefore, the transmission port 108 is one of the camera ports of the CSI, and a multi-port compressed data transmission is employed by the camera module.
In another exemplary implementation, the image processing apparatus 100 may be part of an application processor (AP) , and the picture IMG to be processed by the proposed image processing apparatus 100 may be generated at the AP. In addition, the transmission interface 101 may be a display serial interface (DSI) standardized by a Mobile Industry Processor Interface (MIPI) . Hence, the transmission port 108 is one display port of the DSI. In a case where the AP is coupled to a single display driver integrated circuit (DDIC) through the transmission port 108 only, the picture IMG is one complete image to be displayed on a display screen driven by the DDIC, and a single-port compressed data transmission is employed by the AP. In another case where the AP is coupled to multiple DDICs through multiple display ports, the picture IMG is part of one complete image to be displayed on a display screen. In other words, the AP may be configured to have multiple image processing apparatuses 100 included therein. The image processing apparatuses 100 are used for processing  different image regions of one complete image and transmitting compressed data of the different image regions to the DDICs, respectively. Different display areas of the display screen are driven by the DDICs, respectively. Therefore, the transmission port 108 is one of the display ports of the DSI, and a multi-port compressed data transmission is employed by the AP.
The configuration register 105 may be programmed to store a control setting used for configuring the compressor 102 and the output interface 104. In other words, behaviors of the compressor 102 and the output interface 104 depend on the control setting programmed in the configuration register 105. The compressor 102 receives the picture IMG, partitions the picture IMG into a plurality of slices, and generates a compressed picture IMG’by encoding each of the slices. After partitioning is applied to the picture IMG, the picture IMG may be regarded as having slice rows arranged vertically. Each slice row in the picture IMG includes at least one slice. The term “slice row” mentioned hereinafter may mean a single slice or a combination of slices arranged horizontally.
FIG. 2 is a diagram illustrating a first partitioning setting of the picture IMG according to an embodiment of the present invention. In this case, the compressor 102 partitions the picture IMG into four slices Slice_1, Slice_2, Slice_3, Slice_4 that are arranged vertically. It is possible that the original picture height PS of the picture IMG is not divisible by the slice height HS. The compressor 102 may add padding pixels below the last line (i.e., the last pixel row) of the picture IMG to serve as part of the slice Slice_4 with the slice height HS. In this way, each of the slices Slice_1, Slice_2, Slice_3, Slice_4 has the same slice height HS. After the pseudo picture region is added due to pixel padding, the picture height PS is extended to cover this pseudo picture region.
In this example shown in FIG. 2, each slice row includes a single slice only. However, it is possible that more than one slice is created in the horizontal direction. FIG. 3 is a diagram illustrating a second partitioning setting of the picture IMG according to an embodiment of the present invention. In this case, the compressor 102 partitions the picture IMG into eight slices including Slice (H1, V1) , Slice (H1, V2) , Slice (H1, V3) , Slice (H1, V4) arranged vertically and Slice (H2, V1) , Slice (H2, V2) , Slice (H2, V3) , Slice (H2, V4) arranged vertically. Similarly, the compressor 102 may add padding pixels below the last line (i.e., the last pixel row) of the picture IMG to serve as part of the slice Slice (H1, V4) and Slice (H2, V4) , thereby making each of  the slices has the same slice height HS. In this example, each slice row includes multiple slices arranged horizontally.
The number of lines (i.e., pixel rows) included in one slice is equal to the slice height HS. In addition, each slice includes a plurality of groups, and each group includes a plurality of pixels. For example, each group may be an mxn pixel block, where m and n are positive integers. When m=1, each group is a one-dimensional pixel block. When m>1, each group is a two-dimensional pixel block.
The compressor 102 outputs encoded data of each slice to the output interface 104 for transmission. It should be noted that when one slice row includes multiple slices, encoded data of the slices are multiplexed and then transmitted. Hence, encoded data of one slice row having a single slice only and encoded data of one slice row having multiple slices may be transmitted in the same way. For clarity and simplicity, the following assumes that first partitioning setting of the picture IMG is employed such that each slice row is one slice.
The output interface 104 is configured to control at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row according to a transmission synchronization event SYNC. For example, the transmission synchronization event SYNC may be a horizontal synchronization event used to indicate that one line of the picture is transmitted. For another example, the transmission synchronization event SYNC may be a vertical synchronization event used to indicate that one entire picture is transmitted. It should be noted that, the first line of a current picture may start with a vertical synchronization event due to the end of a previous picture, and all other lines of the picture may start with a horizontal synchronization event due to the end of a previous line. In one exemplary embodiment of the present invention, the start of transmission of encoded data of any slice row in the picture IMG and/or the end of transmission of encoded data of any slice row in the picture IMG may be controlled to be synchronized with closest horizontal synchronization events. In another exemplary embodiment of the present invention, the start of transmission of encoded data of the first slice row in the picture IMG and/or the end of transmission of encoded data of the last slice row in the picture IMG may be controlled to be synchronized with closest vertical synchronization events; the end of transmission of encoded data of the first slice row in the picture IMG and/or the start of transmission of encoded data of the last slice row in the picture IMG may be controlled to be synchronized with  closest horizontal synchronization events; and the start of transmission of encoded data of other slice rows in the picture IMG and/or the end of transmission of encoded data of other slice rows in the picture IMG may be controlled to be synchronized with closest horizontal synchronization events.
As shown in FIG. 1, the compressor 102 may include an encoder 112 and a rate controller 114, where the encoder 112 may perform lossy compression upon each slice, and the rate controller 114 may apply bit rate control to each compression operation to ensure that encoded data of a slice satisfies a bit budget allocated to the slice. In this embodiment, the rate controller 114 may employ a fixed rate control method, and the encoder 112 may generate the compressed picture IMG’through a lossy compression method with the fixed rate control method applied thereto. Hence, based on a desired compression ratio CR of the compressed picture IMG’, a bit budget allocated to a slice row (which may include one or more slices, depending upon the employed partitioning setting of the picture) is determined, where 
Figure PCTCN2014089477-appb-000001
In one exemplary design, the fixed rate control method is performed by the rate controller 114 such that each of the slices is assigned with the same bit budget calculated based at least partly on the picture size of the picture IMG and the desired compression ratio CR. Therefore, the ratio of the size of encoded data of a slice row to the size of original data of the slice row is equal to CR. Since the encoded data of the slice row is transmitted over the transmission channel 106, a transmission rate controller 116 implemented in the output interface 104 may refer to compression-related parameters (e.g., picture size and compression ratio) to adjust transmission rate and timing of the transmission channel 106 to thereby make the start of transmission of encoded data of a slice row be aligned towards one transmission synchronization event SYNC and/or the end of transmission of encoded data of the slice row be aligned towards another transmission synchronization event SYNC. More specifically, compressed data transmission may be correlated to data compression, especially the compression ratio. The transmission synchronization event used for controlling transmission timing of one slice row may be a horizontal synchronization event or a vertical synchronization event, depending upon actual design consideration.
FIG. 4 is a diagram illustrating a compressed data transmission controlled by the output interface shown in FIG. 1 according to an embodiment of the present invention.  Suppose that the slice height HS is set by 8. Hence, each of the slices has 8 lines (i.e., pixel rows) . In this embodiment, the transmission rate and timing of the transmission channel 106 is adjusted by the transmission rate controller 116 according to the compression ratio CR of the compressed picture IMG’, such that encoded data of each slice row is ensured to be transmitted within an integer number of transmission time slots that is smaller than the slice height (i.e., the number of lines in each slice row) . In this example, the start of transmission of encoded data of a slice row is aligned towards one transmission synchronization event SYNC, and the end of transmission of encoded data of the slice row is aligned towards another transmission synchronization event SYNC. Hence, it is possible that partial encoded data of one slice row and partial encoded data of another slice row are not transmitted within the same transmission time slot. The output interface 104 may transmit the compressed picture IMG’by using a transmission time slot size originally used for transmitting the picture IMG. Hence, the size of data allowed to be transmitted in each transmission time slot with an active period T1 may be equal to the size of original data of one line (i.e., one pixel row) in the picture IMG. Suppose that the compression ratio CR of the compressed picture IMG’is equal to
Figure PCTCN2014089477-appb-000002
The output interface 104 transmits encoded data of one slice row (e.g., Slice_1 in FIG. 2) within three consecutive transmission time slots, and transmits encoded data of the next slice row (e.g., Slice_2 in FIG. 2) within three consecutive transmission time slots. As can be seen from FIG. 4, there is one horizontal synchronization event (e.g., HSYNC and HSYNC1-HSYNC6) at the end of each transmission time slot; in addition, there is one vertical synchronization event at the end of one entire picture (e.g., VSYNC) . The output interface 104 properly controls timing of the transmission channel 106. In this way, the start of transmission of encoded data of the slice row (e.g., Slice_1 in FIG. 2) is aligned towards a horizontal synchronization event HSYNC generated due to the end of the last line in the previous entire picture or a vertical synchronization event VSYNC generated due to the end of the previous entire picture, and/or the end of transmission of encoded data of the slice row (e.g., Slice_1 in FIG. 2) is aligned towards a horizontal synchronization event HSYNC3 generated due to the end of the last line in the slice row. The start of transmission of encoded data of another slice row (e.g., Slice_2 in FIG. 2) is aligned towards a horizontal synchronization event HSYNC3 generated due to the end of the last line in the previous slice row, and/or the  end of transmission of encoded data of another slice row (e.g., Slice_2 in FIG. 2) is aligned towards a horizontal synchronization event HSYNC6 generated due to the end of the last line in the another slice row.
Further, to fully utilize the bandwidth of the transmission channel 106, the transmission rate of the transmission channel 106 may be derived from calculating 
Figure PCTCN2014089477-appb-000003
as a positive integer, where the value of the positive integer depends on the actual design consideration. Alternatively, the transmission rate of the transmission channel 106 may be derived from calculating 
Figure PCTCN2014089477-appb-000004
as a positive integer, where the value of the positive integer depends on the actual design consideration. The bitrate of encoded data in one slice row (or the bitrate of the compressed picture IMG’) may be estimated using the compression-related parameters, including picture size, compression ratio, etc. It should be noted that the transmission clock should be adjusted accordingly. Moreover, since transmission synchronization events SYNC are also transmitted via the transmission channel 106, the setting of the transmission rate may further consider the channel bandwidth occupied by the transmission synchronization events SYNC. Besides, if the transmission channel is shared by multiple devices, the transmission rate also needs to be adjusted accordingly. In another embodiment, the initial transmission rate of the transmission channel 106 may be derived from calculating 
Figure PCTCN2014089477-appb-000005
as a positive integer, where the value of the positive integer depends on the actual design consideration. The bitrate of encoded data in one slice row may be estimated using the compression-related parameters, including picture size, compression ratio, etc. Then the transmission clock should be adjusted accordingly with consideration of synchronization event and transmission protocols.
In one exemplary implementation, an initial transmission rate of the transmission channel 106 may be set by a positive value which is an integer multiple of a bitrate of encoded data in one slice row, a bitrate of compressed picture IMG’or a bitrate of compressed group line in one slice. Next, the initial transmission rate of the transmission channel 106 may be fine tuned (e.g., increased or decreased) to a final transmission rate actually set to the transmission channel 106 for compressed data  transmission based on certain factors taken into consideration. For example, the channel bandwidth occupied by the transmission synchronization events SYNC and/or whether the transmission channel is shared by multiple devices may be taken into consideration. Hence, the final transmission rate may not be necessarily divisible by bitrate of encoded data in one slice row/bitrate of compressed picture IMG’/bitrate of compressed group line in one slice. By way of example, a positive integer derived from applying a floor function (or a ceiling function) to 
Figure PCTCN2014089477-appb-000006
may be equal to
Figure PCTCN2014089477-appb-000007
a positive integer derived from applying a floor function (or a ceiling function) to
Figure PCTCN2014089477-appb-000008
may be equal to
Figure PCTCN2014089477-appb-000009
and a positive integer derived from applying a floor function (or a ceiling function) to 
Figure PCTCN2014089477-appb-000010
may be equal to
Figure PCTCN2014089477-appb-000011
However, this is for illustrative purposes only, and is not meant to be a limitation of the present invention.
FIG. 5 is a diagram illustrating another compressed data transmission controlled by the output interface shown in FIG. 1 according to an embodiment of the present invention. In this example, the transmission rate and timing of the transmission channel 106 is adjusted by the transmission rate controller 116 according to the compression ratio CR of the compressed picture IMG’, such that encoded data of each slice row is ensured to be transmitted within an integer number of transmission time slots that is equal to the slice height (i.e., the number of lines in each slice row) . In this example, the start of transmission of encoded data of a slice row is aligned towards one transmission synchronization event SYNC, and the end of transmission of encoded data of the slice row is aligned towards another transmission synchronization event SYNC. Hence, partial encoded data of one slice row and partial encoded data of another slice row are not transmitted within the same transmission time slot.
For example, based on the picture size and the compression ratio, the output interface 104 knows the bit budget allocated to each of the slice rows (e.g., Slice_1-Slice_4 in FIG. 2) , and then divides the bit budget by the number of lines in each slice row to determine the amount of encoded data required to be transmitted within one transmission time slot. Next, the transmission rate controller 116 of the output interface 104 may adjust transmission rate and timing of the transmission channel 106 to thereby make the start of transmission of encoded data of a slice row aligned towards one transmission synchronization event SYNC and/or the end of transmission of encoded data of the slice row aligned towards another transmission synchronization event SYNC.
In this example, the encoded data of one slice row (e.g., Sclice_2 in FIG. 2) is evenly divided into 8 payload sections P1-P8, such that the payload sections P1-P8 have the same size. As mentioned above, each slice includes a plurality of groups, and each group includes a plurality of pixels. The total size of all encoded group rows corresponding to the same slice row is equal to the bit budget allocated to compression of the slice row. However, due to lossy compression employed by the encoder 112, each of the encoded group rows may have different bitstream sizes. Hence, each of the payload sections P1-P8 may include encoded data belonging to the same group row only, or may include encoded data belonging to adjacent group rows. For example, the payload section P1 may include all encoded data of group row 1 and partial encoded data of group row 2; and the payload section P2 may include remaining encoded data of group row 2. For another example, the payload section P1 may include all encoded data of group row 1 and partial encoded data of group row 2; the payload section P2 may include another partial encoded data of group row 2; and the payload section P3 may include remaining partial encoded data of group row 2.
As shown in FIG. 5, the size of data transmitted in each transmission time slot with an active period T2 is equal to
Figure PCTCN2014089477-appb-000012
The output interface 104 transmits encoded data of the slice row (e.g., Slice_2 in FIG. 2) within eight transmission time slots. Specifically, the equal-sized payload sections P1-P8 are transmitted within the transmission time slots, respectively. As can be seen from FIG. 5, there is one horizontal synchronization event at the start of each transmission time slot. The transmission rate controller 116 of the output interface 104 properly controls  transmission rate and timing of the transmission channel 106. In this way, the start of transmission of encoded data of the slice row (e.g., slice Slice_2 in FIG. 2) is aligned towards an Nth horizontal synchronization event (e.g., HSYNC8) , and/or the end of transmission of encoded data of the slice row (e.g., Slice_2 in FIG. 2) is aligned towards an (N+M) th horizontal synchronization event (e.g., HSYNC16) , where M corresponds to the slice height. More specifically, the value of M is equal to the slice height.
It should be noted that the aforementioned transmission timing alignment operation depends on the packet structure of the bitstream BS. FIG. 6 is a diagram illustrating the operation of aligning at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row towards a transmission synchronization event. A data packet of the bitstream BS may include a header section, a payload section, and a footer section. The payload section is used to carry the encoded slice data. The header section is used to carry header information of the data packet and has a fixed length (e.g., 4 bytes) . In addition, there may be other pre-defined comments/packets (e.g., HBP (Horizontal Back Porch) Packet) transmitted between a transmission synchronization event (e.g., HSS (Horizontal Sync Start) Packet) and the data packet (which carries encoded slice data) . Hence, when the function of aligning start of transmission of encoded data of a slice row towards a transmission synchronization event is enabled, the output interface 104 determines the start time TS to ensure that an interval TP1 between a preceding transmission synchronization event (e.g., a horizontal synchronization event HSYNC_1) and the start time TS of transmitting the encoded slice data (e.g., the timing when the first bit of encoded data of one slice row) is a predetermined value.
The footer section may be used to carry checksum information for CRC check and has a fixed length (e.g., 2 bytes) . Similarly, when the function of aligning end of transmission of encoded data of a slice row towards a transmission synchronization event is enabled, the output interface 104 determines the end time TE to ensure that an interval TP2 between a following transmission synchronization event (e.g., a horizontal synchronization event HSYNC_2) and the end time TE of transmission of encoded slice data (e.g., the last bit of encoded data of the slice row) is a predetermined value.
For example, the encoded data of one slice row shown in FIG. 4 is transmitted using three data packets, each having the packet structure shown in FIG. 6 and  transmitted within one transmission time slot. Regarding the data packet transmitted within the first one of the three consecutive transmission time slots, the output interface 104 controls the start time of transmitting the first bit of encoded data of one slice row based on the predetermined time interval TP1. Regarding the data packet transmitted within the last one of the three consecutive transmission time slots, the output interface 104 controls the end time of transmitting the last bit of encoded data of one slice row based on the predetermined time interval TP2.
For another example, the packet sections P1-P8 shown in FIG. 5 are carried by a plurality of data packets, each having the packet structure shown in FIG. 6. Regarding the data packet carrying the payload section P1, the output interface 104 controls the start time of transmitting the first bit of encoded data of one slice row based on the predetermined time interval TP1. Regarding the data packet carrying the payload section P8, the output interface 104 controls the end time of transmitting the last bit of encoded data of one slice row based on the predetermined time interval TP2.
Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.

Claims (20)

  1. An image processing method, comprising:
    partitioning a picture into a plurality of slices, wherein each slice row in the picture includes at least one slice;
    generating a compressed picture by encoding each of the slices; and
    controlling at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row according to a transmission synchronization event.
  2. The image processing method of clam 1, wherein the transmission synchronization event is a horizontal synchronization event.
  3. The image processing method of clam 1, wherein the transmission synchronization event is a vertical synchronization event.
  4. The image processing method of clam 1, wherein the step of controlling at least one of the start of the transmission of encoded data of the slice row and the end of the transmission of encoded data of the slice row according to the transmission synchronization event comprises:
    aligning at least one of the start of the transmission of encoded data of the slice row and the end of the transmission of encoded data of the slice row towards the transmission synchronization event.
  5. The image processing method of claim 4, wherein encoded data of the slice row is transmitted over a transmission channel, and the step of aligning at least one of the start of the transmission of encoded data of the slice row and the end of the transmission of encoded data of the slice row towards the transmission synchronization event comprises:
    adjusting transmission rate and timing of the transmission channel for aligning the start of the transmission of encoded data of the slice row towards the transmission synchronization event and aligning the end of the transmission of encoded data of the slice row towards another transmission synchronization event.
  6. The image processing method of clam 5, wherein the transmission synchronization event is an Nth transmission synchronization event, the another transmission synchronization event is an (N+M) th transmission synchronization event, N and M are positive integers, and M corresponds to a slice height of the slice row. 
  7. The image processing method of clam 1, wherein the transmission of encoded data of the slice row is controlled to start or end at a specific time point, wherein an interval between the specific time point and the transmission synchronization event is a predetermined value.
  8. The image processing method of claim 1, wherein encoded data of the slice row is transmitted over a transmission channel, and the image processing method further comprises:
    adjusting transmission rate and timing of the transmission channel according to a compression ratio of the compressed picture.
  9. The image processing method of claim 1, wherein the step of generating the compressed picture further comprises:
    generating the compressed picture by a lossy compression method with a fixed rate control method applied thereto.
  10. An image processing apparatus, comprising:
    a compressor, configured to partition a picture into a plurality of slices, and generate a compressed picture by encoding each of the slices, wherein each slice row in the picture includes at least one slice; and
    an output interface, configured to control at least one of start of transmission of encoded data of a slice row and end of the transmission of encoded data of the slice row according to a transmission synchronization event.
  11. The image processing apparatus of clam 10, wherein the transmission synchronization event is a horizontal synchronization event.
  12. The image processing apparatus of clam 10, wherein the transmission synchronization event is a vertical synchronization event.
  13. The image processing apparatus of clam 10, wherein the output interface aligns at least one of the start of the transmission of encoded data of the slice row and the end of the transmission of encoded data of the slice row towards the transmission synchronization event.
  14. The image processing apparatus of claim 13, wherein encoded data of the slice row is transmitted over a transmission channel; and the output interface comprises a transmission rate controller configured to adjust transmission rate and timing of the transmission channel for aligning the start of the transmission of encoded data of the slice row towards the transmission synchronization event and aligning the end of the transmission of encoded data of the slice row towards another  transmission synchronization event.
  15. The image processing apparatus of clam 14, wherein the transmission synchronization event is an Nth transmission synchronization event, the another transmission synchronization event is an (N+M) th transmission synchronization event, N and M are positive integers, and M corresponds to a slice height of the slice row.
  16. The image processing apparatus of clam 10, wherein the output interface controls the transmission of encoded data of the slice row to start or end at a specific time point, and an interval between the specific time point and the transmission synchronization event is a predetermined value.
  17. The image processing apparatus of claim 10, wherein encoded data of the slice row is transmitted over a transmission channel, and the output interface comprises a transmission rate controller configured to adjust transmission rate and timing of the transmission channel according to a compression ratio of the compressed picture.
  18. The image processing apparatus of claim 10, wherein the compressor comprises:
    a rate controller, configured to perform a fixed rate control method; and
    an encoder, configured to generate the compressed picture by a lossy compression method with the fixed rate control method applied thereto.
  19.  Amethod of transmitting a compressed picture comprising
    partitioning a picture into multiple slices;
    encoding each of slices; and
    controlling transmission of compressed data of a vertical adjacent slice to synchronize with a synchronization event.
  20. The method of claim 19, further comprising:
    compressing the picture through a fixed rate control method with a compression ratio; and
    adjusting transmission rate and timing of a transmission channel according to the compression ratio.
PCT/CN2014/089477 2013-10-25 2014-10-24 Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events WO2015058718A1 (en)

Priority Applications (8)

Application Number Priority Date Filing Date Title
CN201480058507.0A CN105659593B (en) 2013-10-25 2014-10-24 The method and apparatus of the transmission of compression image is controlled according to transmission synchronous event
KR1020187024164A KR101994599B1 (en) 2013-10-25 2014-10-24 Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events
JP2016524402A JP2016539550A (en) 2013-10-25 2014-10-24 Method and apparatus for controlling transmission of compressed pictures according to transmission synchronization events
EP14856655.7A EP3036903A4 (en) 2013-10-25 2014-10-24 Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events
US15/031,281 US10038904B2 (en) 2013-10-25 2014-10-24 Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events
BR112016009085-3A BR112016009085B1 (en) 2013-10-25 2014-10-24 METHOD AND APPARATUS FOR CONTROLLING COMPRESSED IMAGE TRANSMISSION ACCORDING TO TRANSMISSION SYNCHRONIZATION EVENTS
AU2014339383A AU2014339383B2 (en) 2013-10-25 2014-10-24 Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events
KR1020167009207A KR20160053988A (en) 2013-10-25 2014-10-24 Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201361895461P 2013-10-25 2013-10-25
US201361895454P 2013-10-25 2013-10-25
US61/895,454 2013-10-25
US61/895,461 2013-10-25
US201361904490P 2013-11-15 2013-11-15
US61/904,490 2013-11-15

Publications (1)

Publication Number Publication Date
WO2015058718A1 true WO2015058718A1 (en) 2015-04-30

Family

ID=52992296

Family Applications (3)

Application Number Title Priority Date Filing Date
PCT/CN2014/089477 WO2015058718A1 (en) 2013-10-25 2014-10-24 Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events
PCT/CN2014/089483 WO2015058719A1 (en) 2013-10-25 2014-10-24 Method and apparatus for processing picture having picture height not evenly divisible by slice height and/or slice width not evenly divisible by pixel group width
PCT/CN2014/089488 WO2015058722A1 (en) 2013-10-25 2014-10-24 Method and apparatus for improving visual quality by using neighboring pixel information in flatness check and/or applying smooth function to quantization parameters/pixel values

Family Applications After (2)

Application Number Title Priority Date Filing Date
PCT/CN2014/089483 WO2015058719A1 (en) 2013-10-25 2014-10-24 Method and apparatus for processing picture having picture height not evenly divisible by slice height and/or slice width not evenly divisible by pixel group width
PCT/CN2014/089488 WO2015058722A1 (en) 2013-10-25 2014-10-24 Method and apparatus for improving visual quality by using neighboring pixel information in flatness check and/or applying smooth function to quantization parameters/pixel values

Country Status (8)

Country Link
US (4) US10523938B2 (en)
EP (2) EP3036689B8 (en)
JP (3) JP6309092B2 (en)
KR (3) KR102070484B1 (en)
CN (3) CN105659257B (en)
AU (2) AU2014339383B2 (en)
BR (2) BR112016009085B1 (en)
WO (3) WO2015058718A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105828082A (en) * 2016-03-25 2016-08-03 北京环境特性研究所 Video image rapid compression system and method
CN111147689A (en) * 2018-11-06 2020-05-12 意法半导体(鲁塞)公司 Method for generating a trigger signal for controlling a multimedia interface
CN113056912A (en) * 2019-10-09 2021-06-29 株式会社 Xris Method for encoding/decoding image signal and apparatus therefor
US11205377B2 (en) 2018-11-06 2021-12-21 Stmicroelectronics (Rousset) Sas Method of monitoring a task for an electronic module
RU2800595C1 (en) * 2019-11-28 2023-07-25 ЭлДжи ЭЛЕКТРОНИКС ИНК. Image/video coding method and equipment

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150355818A1 (en) 2014-06-04 2015-12-10 Sonos, Inc. Continuous Playback Queue
US9720642B2 (en) 2014-06-04 2017-08-01 Sonos, Inc. Prioritizing media content requests
US9363255B2 (en) 2014-06-04 2016-06-07 Sonos, Inc. Cloud queue playhead
CN104506381A (en) * 2014-12-16 2015-04-08 新余兴邦信息产业有限公司 Method and device for monitoring file uploading through instrument
EP3317973A4 (en) * 2015-07-03 2019-03-06 INTEL Corporation Apparatus and method for data compression in a wearable device
GB2544800A (en) 2015-11-27 2017-05-31 V-Nova Ltd Adaptive bit rate ratio control
KR102603110B1 (en) * 2016-05-20 2023-11-17 삼성디스플레이 주식회사 Image compression device and image decompression device
JP6387511B2 (en) * 2016-06-17 2018-09-12 株式会社アクセル Image data processing method
CN107113430B (en) * 2016-10-12 2019-04-30 深圳市大疆创新科技有限公司 Method, computer system and the device of code rate control
WO2018105515A1 (en) 2016-12-09 2018-06-14 株式会社アクセル Image data processing method
JP6732337B2 (en) 2016-12-09 2020-07-29 株式会社アクセル Image data processing method
JP7161470B2 (en) * 2017-06-08 2022-10-26 キヤノン株式会社 Image processing device and its control method
US10721469B2 (en) * 2017-11-28 2020-07-21 Qualcomm Incorporated Line buffer reduction for adaptive loop filtering in video coding
KR102618692B1 (en) * 2018-06-15 2024-01-02 삼성전자주식회사 Display driver circuit and method for reducing influence of noise or dither
US10790932B2 (en) * 2018-01-12 2020-09-29 Apple Inc. Padding bits for CSI report coding
WO2019208677A1 (en) * 2018-04-27 2019-10-31 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Coding device, decoding device, coding method, and decoding method
WO2020209478A1 (en) * 2019-04-08 2020-10-15 엘지전자 주식회사 Method and device for partitioning picture into plurality of tiles
MX2021012283A (en) 2019-04-08 2022-01-18 Lg Electronics Inc Picture partitioning-based coding method and device.
US11259040B1 (en) * 2019-04-25 2022-02-22 Amazon Technologies, Inc. Adaptive multi-pass risk-based video encoding
CA3163400A1 (en) * 2019-11-28 2021-06-03 Lg Electronics Inc. Image/video coding method and apparatus
AU2020393728B2 (en) * 2019-11-28 2024-03-14 Lg Electronics Inc. Image/video coding method and apparatus on basis of picture division structure
WO2021107623A1 (en) * 2019-11-28 2021-06-03 엘지전자 주식회사 Image/video encoding/decoding method and device
WO2021107621A1 (en) * 2019-11-28 2021-06-03 엘지전자 주식회사 Slice and tile configuration for image/video coding
EP4068786A4 (en) * 2019-11-28 2023-10-11 LG Electronics Inc. Method and device for signaling information related to slice in image/video encoding/decoding system
CN118396992B (en) * 2024-06-26 2024-10-11 爱芯元智半导体股份有限公司 Apparatus, method and device for adaptively checking bit width of data

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6963608B1 (en) * 1998-10-02 2005-11-08 General Instrument Corporation Method and apparatus for providing rate control in a video encoder
CN101053258A (en) * 2004-11-04 2007-10-10 皇家飞利浦电子股份有限公司 Method and device for processing coded video data
CN102696229A (en) * 2009-12-17 2012-09-26 晶像股份有限公司 Transmission and handling of three-dimensional video content

Family Cites Families (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR940011605B1 (en) * 1991-12-20 1994-12-22 삼성전자 주식회사 Image compressing method
JP2959353B2 (en) * 1993-09-07 1999-10-06 三菱電機株式会社 Echo canceller device
CA2157066C (en) * 1994-10-21 1999-09-21 Nelson Botsford Iii Method for controlling a compressed data buffer
JPH10224792A (en) * 1997-02-12 1998-08-21 Hitachi Ltd Method and device for encoding picture signal
FI106071B (en) * 1997-03-13 2000-11-15 Nokia Mobile Phones Ltd Adaptive filter
FI103003B1 (en) * 1997-06-13 1999-03-31 Nokia Mobile Phones Ltd Filtering procedure, filter and mobile terminal
TW416220B (en) * 1998-01-23 2000-12-21 Matsushita Electric Ind Co Ltd Image transmitting method, image processing method, image processing device, and data storing medium
JP2000152174A (en) 1998-11-09 2000-05-30 Sony Corp Image data processor its method and image data recorder
US7061878B2 (en) * 1999-11-24 2006-06-13 Lg Electronics Inc. Method and apparatus for stopping data/packet transmission
US7003174B2 (en) * 2001-07-02 2006-02-21 Corel Corporation Removal of block encoding artifacts
JP2003037737A (en) * 2001-07-23 2003-02-07 Matsushita Electric Ind Co Ltd Image processor
US7426315B2 (en) * 2001-09-05 2008-09-16 Zoran Microelectronics Ltd. Method for reducing blocking artifacts
US6983079B2 (en) * 2001-09-20 2006-01-03 Seiko Epson Corporation Reducing blocking and ringing artifacts in low-bit-rate coding
ATE419713T1 (en) * 2001-11-29 2009-01-15 Panasonic Corp METHOD FOR ELIMINATION OF CODING DISTORTION AND METHOD FOR VIDEO CODING AND DECODING
US7412109B2 (en) * 2003-11-07 2008-08-12 Mitsubishi Electric Research Laboratories, Inc. System and method for filtering artifacts in images
US7460596B2 (en) * 2004-04-29 2008-12-02 Mediatek Incorporation Adaptive de-blocking filtering apparatus and method for MPEG video decoder
US20060013315A1 (en) * 2004-07-19 2006-01-19 Samsung Electronics Co., Ltd. Filtering method, apparatus, and medium used in audio-video codec
EP1638333A1 (en) * 2004-09-17 2006-03-22 Mitsubishi Electric Information Technology Centre Europe B.V. Rate adaptive video coding
US7839933B2 (en) * 2004-10-06 2010-11-23 Microsoft Corporation Adaptive vertical macroblock alignment for mixed frame video sequences
US7746928B2 (en) 2004-12-30 2010-06-29 General Instruments Corporation Method and apparatus for providing rate control
US7602974B2 (en) * 2005-10-21 2009-10-13 Mobilic Technology (Cayman) Corp. Universal fixed-pixel-size ISP scheme
JP4455487B2 (en) * 2005-12-16 2010-04-21 株式会社東芝 Decoding device, decoding method, and program
WO2007110814A1 (en) * 2006-03-27 2007-10-04 Koninklijke Philips Electronics N.V. Encoding and decoding apparatuses and methods
CN1968410A (en) * 2006-11-23 2007-05-23 中兴通讯股份有限公司 Adaptive video data splitting method
JP4607856B2 (en) * 2006-12-26 2011-01-05 富士通株式会社 Encoding / decoding system and encoding / decoding method
CN101321277A (en) * 2007-06-09 2008-12-10 华为技术有限公司 Method and apparatus for removing block effect
JP4967921B2 (en) * 2007-08-10 2012-07-04 セイコーエプソン株式会社 Apparatus, method, and program for image processing
EP2183922A4 (en) 2007-08-16 2011-04-27 Nokia Corp A method and apparatuses for encoding and decoding an image
US8457214B2 (en) * 2007-09-10 2013-06-04 Cisco Technology, Inc. Video compositing of an arbitrary number of source streams using flexible macroblock ordering
CN101453651B (en) * 2007-11-30 2012-02-01 华为技术有限公司 A deblocking filtering method and apparatus
JP5593596B2 (en) * 2008-02-04 2014-09-24 ソニー株式会社 Video signal transmitting apparatus and video signal transmitting method
US9118944B2 (en) * 2009-02-05 2015-08-25 Cisco Technology, Inc. System and method for rate control in a network environment
WO2010111261A1 (en) * 2009-03-23 2010-09-30 Azuki Systems, Inc. Method and system for efficient streaming video dynamic rate adaptation
US8891609B2 (en) * 2009-03-24 2014-11-18 Samsung Electronics Co., Ltd. System and method for measuring blockiness level in compressed digital video
JP2010226672A (en) * 2009-03-25 2010-10-07 Nippon Hoso Kyokai <Nhk> Image dividing device, divided image encoder and program
JP5554831B2 (en) * 2009-04-28 2014-07-23 テレフオンアクチーボラゲット エル エム エリクソン(パブル) Distortion weighting
CN101610417B (en) * 2009-07-09 2013-06-12 华为技术有限公司 Image filling method, device and equipment
US20110030025A1 (en) * 2009-07-31 2011-02-03 Azure Communications Inc. High speed wireless video transmission
EP2285112A1 (en) 2009-08-07 2011-02-16 Canon Kabushiki Kaisha Method for sending compressed data representing a digital image and corresponding device
US8879623B2 (en) * 2009-09-02 2014-11-04 Sony Computer Entertainment Inc. Picture-level rate control for video encoding a scene-change I picture
CN104661026B (en) * 2009-10-21 2018-03-27 Sk电信有限公司 Image coding and decoding apparatus and method
KR101452713B1 (en) 2009-10-30 2014-10-21 삼성전자주식회사 Method and apparatus for encoding and decoding coding unit of picture boundary
US8885969B2 (en) * 2010-03-29 2014-11-11 Sony Corporation Method and apparatus for detecting coding artifacts in an image
JP2011216968A (en) * 2010-03-31 2011-10-27 Sony Corp Image processing control device and method
KR101791242B1 (en) * 2010-04-16 2017-10-30 에스케이텔레콤 주식회사 Video Coding and Decoding Method and Apparatus
US8711933B2 (en) * 2010-08-09 2014-04-29 Sony Computer Entertainment Inc. Random access point (RAP) formation using intra refreshing technique in video coding
US20120243602A1 (en) * 2010-09-23 2012-09-27 Qualcomm Incorporated Method and apparatus for pipelined slicing for wireless display
CN103339932B (en) * 2010-10-01 2017-05-31 谷歌技术控股有限责任公司 The code filled up using picture boundary in flexible piecemeal and decoding
US9414065B2 (en) * 2010-11-01 2016-08-09 Nec Corporation Dynamic image distribution system, dynamic image distribution method and dynamic image distribution program
MX2013006130A (en) * 2010-12-07 2013-06-28 Sony Corp Image processing device and image processing method.
ES2767966T3 (en) * 2010-12-21 2020-06-19 Ntt Docomo Inc Intra-prediction coding under flat representations
MA34911B1 (en) 2011-01-14 2014-02-01 Telefonaktieblaget L M Ericsson UNBLOCKING FILTERING
US9560355B2 (en) * 2011-02-25 2017-01-31 Sun Patent Trust Efficient decisions for deblocking
EP2533537A1 (en) * 2011-06-10 2012-12-12 Panasonic Corporation Transmission of picture size for image or video coding
US20120314767A1 (en) * 2011-06-13 2012-12-13 Qualcomm Incorporated Border pixel padding for intra prediction in video coding
JP2013031024A (en) * 2011-07-29 2013-02-07 Hitachi Consumer Electronics Co Ltd Image transmission device, image transmission method, image receiving device, and image receiving method
EP4436183A2 (en) * 2011-11-03 2024-09-25 Sun Patent Trust Efficient rounding for deblocking
US20130128986A1 (en) * 2011-11-23 2013-05-23 Mediatek Inc. Method and Apparatus of Slice Boundary Padding for Loop Filtering
US9510021B2 (en) * 2013-05-24 2016-11-29 Electronics And Telecommunications Research Institute Method and apparatus for filtering pixel blocks
US20140362098A1 (en) * 2013-06-10 2014-12-11 Sharp Laboratories Of America, Inc. Display stream compression
JP6305279B2 (en) * 2014-08-26 2018-04-04 株式会社東芝 Video compression device and video playback device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6963608B1 (en) * 1998-10-02 2005-11-08 General Instrument Corporation Method and apparatus for providing rate control in a video encoder
CN101053258A (en) * 2004-11-04 2007-10-10 皇家飞利浦电子股份有限公司 Method and device for processing coded video data
CN102696229A (en) * 2009-12-17 2012-09-26 晶像股份有限公司 Transmission and handling of three-dimensional video content

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3036903A4 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105828082A (en) * 2016-03-25 2016-08-03 北京环境特性研究所 Video image rapid compression system and method
CN105828082B (en) * 2016-03-25 2018-12-04 北京环境特性研究所 Video image Fast Compression system and method
CN111147689A (en) * 2018-11-06 2020-05-12 意法半导体(鲁塞)公司 Method for generating a trigger signal for controlling a multimedia interface
EP3650980A3 (en) * 2018-11-06 2020-07-01 STMicroelectronics (Rousset) SAS Method for manufacturing activating signals for controlling a multimedia interface, and corresponding integrated circuit
US11205377B2 (en) 2018-11-06 2021-12-21 Stmicroelectronics (Rousset) Sas Method of monitoring a task for an electronic module
CN111147689B (en) * 2018-11-06 2022-10-25 意法半导体(鲁塞)公司 Method for generating a trigger signal for controlling a multimedia interface
US11637947B2 (en) 2018-11-06 2023-04-25 Stmicroelectronics (Rousset) Sas Method of producing triggering signals for control of a multimedia interface
US11895423B2 (en) 2018-11-06 2024-02-06 Stmicroelectronics (Rousset) Sas Method of producing triggering signals for a control of a multimedia interface
CN113056912A (en) * 2019-10-09 2021-06-29 株式会社 Xris Method for encoding/decoding image signal and apparatus therefor
CN113056912B (en) * 2019-10-09 2023-03-24 苹果公司 Method for encoding/decoding image signal and apparatus therefor
US12028522B2 (en) 2019-10-09 2024-07-02 Apple Inc. Method for encoding/decoding image signal, and device for same
RU2800595C1 (en) * 2019-11-28 2023-07-25 ЭлДжи ЭЛЕКТРОНИКС ИНК. Image/video coding method and equipment

Also Published As

Publication number Publication date
US20160277735A1 (en) 2016-09-22
JP2016537873A (en) 2016-12-01
US10523938B2 (en) 2019-12-31
US20180020213A1 (en) 2018-01-18
KR101994599B1 (en) 2019-06-28
BR112016009083A2 (en) 2017-08-01
EP3036689A4 (en) 2016-12-07
US10038904B2 (en) 2018-07-31
KR20160053988A (en) 2016-05-13
US9807389B2 (en) 2017-10-31
CN104871538B (en) 2018-01-19
CN104871538A (en) 2015-08-26
CN105659593A (en) 2016-06-08
EP3036689B8 (en) 2020-11-11
JP2018082490A (en) 2018-05-24
US20150304674A1 (en) 2015-10-22
CN105659257B (en) 2019-11-12
KR102070484B1 (en) 2020-01-29
AU2014339383B2 (en) 2017-03-30
JP2016539550A (en) 2016-12-15
CN105659593B (en) 2018-12-11
BR112016009083B1 (en) 2022-06-28
WO2015058722A1 (en) 2015-04-30
EP3036903A4 (en) 2016-11-09
US20160261880A1 (en) 2016-09-08
KR20160048986A (en) 2016-05-04
CN105659257A (en) 2016-06-08
WO2015058719A1 (en) 2015-04-30
BR112016009085A2 (en) 2017-08-01
BR112016009083B8 (en) 2022-07-19
JP6488030B2 (en) 2019-03-20
JP6309092B2 (en) 2018-04-11
AU2014339384A1 (en) 2016-05-12
AU2014339384B2 (en) 2017-08-17
KR20180096831A (en) 2018-08-29
BR112016009085B1 (en) 2023-04-04
EP3036689B1 (en) 2020-10-07
EP3036903A1 (en) 2016-06-29
EP3036689A1 (en) 2016-06-29

Similar Documents

Publication Publication Date Title
US10038904B2 (en) Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events
AU2014339383A1 (en) Method and apparatus for controlling transmission of compressed picture according to transmission synchronization events
US9875723B2 (en) Data processing apparatus for transmitting/receiving randomly accessible compressed pixel data groups over display interface and related data processing method
US8773469B2 (en) Video multiviewer system with serial digital interface and related methods
US20040184523A1 (en) Method and system for providing reduced bandwidth for picture in picture video transmissions
US20160234513A1 (en) Data processing apparatus and method for compressed pixel data groups
CA2661760C (en) Video multiviewer system with switcher and distributed scaling and related methods
US20120147976A1 (en) Video Transmission On A Serial Interface
US9288418B2 (en) Video signal transmitter apparatus and receiver apparatus using uncompressed transmission system of video signal
CA2661768C (en) Video multiviewer system with distributed scaling and related methods
JP4940030B2 (en) Transmission device, reception device, and program
US8937999B2 (en) Moving image compression encoding apparatus, method, and control program
CN105989789B (en) Method for transmitting data from time schedule controller, time schedule controller and display system
KR101739822B1 (en) Method and apparatus for compressing analog image signal
US9781438B2 (en) Standardized hot-pluggable transceiving unit with signal encoding or decoding capabilities
US20110199456A1 (en) Apparatus for image reproduction and method therefor
CN104702970A (en) Video data synchronization method, device and system
US8115823B2 (en) Image processing system capable of reducing image data needed to be transmitted and method thereof
US20160057436A1 (en) Video processing apparatus and video display apparatus
JP2013183391A (en) Image processing apparatus, image processing method, electronic apparatus and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14856655

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2014856655

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20167009207

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2016524402

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 15031281

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112016009085

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2014339383

Country of ref document: AU

Date of ref document: 20141024

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 112016009085

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20160422