EP2905964B1 - Verfahren und vorrichtung zur verarbeitung eines videosignals - Google Patents

Verfahren und vorrichtung zur verarbeitung eines videosignals Download PDF

Info

Publication number
EP2905964B1
EP2905964B1 EP13844143.1A EP13844143A EP2905964B1 EP 2905964 B1 EP2905964 B1 EP 2905964B1 EP 13844143 A EP13844143 A EP 13844143A EP 2905964 B1 EP2905964 B1 EP 2905964B1
Authority
EP
European Patent Office
Prior art keywords
current
block
unit
prediction unit
prediction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP13844143.1A
Other languages
English (en)
French (fr)
Other versions
EP2905964A1 (de
EP2905964A4 (de
Inventor
Moonmo Koo
Jiwook JUNG
Sehoon Yea
Jin Heo
Taesup KIM
Jaewon Sung
Eunyong SON
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Publication of EP2905964A1 publication Critical patent/EP2905964A1/de
Publication of EP2905964A4 publication Critical patent/EP2905964A4/de
Application granted granted Critical
Publication of EP2905964B1 publication Critical patent/EP2905964B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/43—Hardware specially adapted for motion estimation or compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/436—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H04N19/52—Processing of motion vectors by encoding by predictive encoding

Definitions

  • the present invention relates to a method and device for processing a video signal.
  • Compression refers to a signal processing technique for transmitting digital information through a communication line or storing the digital information in a form suitable for a storage medium.
  • Compression targets include audio, video and text information.
  • a technique of compressing images is called video compression.
  • Multiview video has characteristics of spatial redundancy, temporal redundancy and inter-view redundancy.
  • Document No. M23698 of ISO/IEC JTC1/SC29/WG11 with the title "3D-HEVC-CE3 results on inter-view motion parameter prediction by HHI" of Heiko Schwarz, Heribert House and Thomas Wiegand discloses results on a proposal for inter-view motion parameter prediction.
  • coded depth maps are used for deriving disparity vectors, by which motion parameters for a current block in a dependent view are derived based on motion parameters in an already coded view.
  • the video is coded independent of depth data.
  • An object of the present invention is to improve video signal coding efficiency.
  • the present invention can obtain an inter-view motion vector of a current coding unit using parallel processing information in a multiview video image and acquire motion vectors of current prediction units in parallel using the inter-view motion vector of the current coding unit.
  • the present invention can acquire a motion vector prediction value of a current prediction unit by comparing a picture order count of a reference picture corresponding to the current prediction unit with a picture order count of a reference picture of a corresponding block.
  • the present invention can acquire the motion vector prediction value of the current prediction unit using motion information corresponding to the reference picture of the corresponding block when the picture order count of the reference picture corresponding to the current prediction unit is identical to the picture order count of the reference picture of the corresponding block.
  • the present invention can acquire the motion vector prediction value of the current prediction unit using the picture order count of the reference picture corresponding to the current prediction unit, the picture order count of the reference picture of the corresponding block and motion information corresponding to the reference picture of the corresponding block when the picture order count of the reference picture corresponding to the current prediction unit is not identical to the picture order count of the reference picture of the corresponding block.
  • the present invention can rapidly restore a video image by obtaining an inter-view motion vector of a current coding unit and a motion vector of a current prediction unit through parallel processing in a multiview video image.
  • the present invention can acquire a correct motion vector prediction value using motion information corresponding to a reference picture of a corresponding block of a different view from the current prediction unit.
  • the present invention provides a method and a device for processing a video signal, which acquire an inter-view motion vector of a current coding unit included in a current parallel processing unit using an inter-view motion vector of a neighboring block corresponding to the current coding unit and acquire motion vectors of one or more current prediction units in parallel using the inter-view motion vector of the current coding unit, wherein a size of the current parallel processing unit is determined using parallel processing information, and the neighboring block corresponding to the current coding unit is included in a parallel processing unit adjacent to the current parallel processing unit, wherein the current coding unit includes the one or more current prediction units.
  • the parallel processing unit adjacent to the current parallel processing unit may be at least one of a left-bottom parallel processing unit, a left parallel processing unit, a left-top parallel processing unit, a top parallel processing unit and a right-top parallel processing unit of the current parallel processing unit.
  • the current prediction units may include a first prediction unit, a second prediction unit, a third prediction unit and a fourth prediction unit, wherein a motion vector prediction value of the first prediction unit is acquired using motion information of a left-top block, a top block, a right-top block, a left block and a left-bottom block of the first prediction unit, a motion vector prediction value of the second prediction unit is acquired using motion information of a left-top block, a top block and a right-top block of the second prediction unit, a motion vector prediction value of the third prediction unit is acquired using motion information of a left-top block, a left block and a left-bottom block of the third prediction unit, and a motion vector prediction value of the fourth prediction unit is acquired using motion information of a right-top block and a left-bottom block of the fourth prediction unit.
  • the current prediction units may include a fifth prediction unit and a sixth prediction unit, wherein a motion vector prediction value of the fifth prediction unit is acquired using motion information of a left-top block, a top block, a right-top block, a left block and a left-bottom block of the fifth prediction unit, and a motion vector prediction value of the sixth prediction unit is acquired using motion information of a left-top block, a top block, a right-top block and a left-bottom block of the sixth prediction unit.
  • the current prediction units may include a seventh prediction unit and an eighth prediction unit, wherein a motion vector prediction value of the seventh prediction unit is acquired using motion information of a left-top block, a top block, a right-top block, a left block and a left-bottom block of the seventh prediction unit, and a motion vector prediction value of the eighth prediction unit is acquired using motion information of a left-top block, a right-top block, a left block and a left-bottom block of the eighth prediction unit.
  • the method for processing a video signal may include: obtaining information on a picture order count of a reference picture corresponding to the current prediction unit; obtaining information on picture order counts of reference pictures of a corresponding block using the inter-view motion vector; comparing the picture order counts of the reference pictures of the corresponding block with the picture order count of the reference picture corresponding to the current prediction unit; and obtaining a motion vector prediction value of the current prediction unit on the basis of a comparison result, wherein the reference picture corresponding to the current prediction unit is positioned at the same view as the current prediction unit and at a different time from the current prediction unit, the corresponding block is positioned at a different view from the current prediction unit and at the same time as the current prediction unit, and the reference pictures of the corresponding block are positioned at the same view as the corresponding block and at a different time from the corresponding block.
  • the motion vector prediction value of the current prediction unit may be acquired using motion vectors corresponding to the reference pictures of the corresponding block.
  • the motion vector prediction value of the current prediction unit may be acquired using the picture order counts of the reference pictures of the corresponding block, the picture order count of the reference picture corresponding to the current prediction unit and the motion vectors corresponding to the reference pictures of the corresponding block.
  • the motion vector prediction value of the current prediction unit may be acquired using the motion vectors corresponding to the reference pictures of the corresponding block.
  • multiview texture images captured at two or more views can be coded in order to generate a three-dimensional image.
  • depth data corresponding to the multiview texture images may be coded as necessary.
  • the depth data can be compressed in consideration of spatial redundancy, temporal redundancy or inter-view redundancy.
  • Depth data is information on the distance between a camera and a corresponding pixel.
  • the depth data can be flexibly interpreted as depth related information such as depth information, a depth image, a depth picture, a depth sequence and a depth bitstream in the specification.
  • coding can include both the concepts of encoding and decoding in the specification and can be flexibly interpreted within the technical scope of the present invention.
  • FIG. 1 is a block diagram of a broadcast receiver to which depth coding is applied according to an embodiment to which the present invention is applied.
  • the broadcast receiver receives terrestrial broadcast signals to reproduce images.
  • the broadcast receiver can generate three-dimensional content using received depth related information.
  • the broadcast receiver includes a tuner 100, a demodulator/channel decoder 102, a transport demultiplexer 104, a depacketizer 106, an audio decoder 108, a video decoder 110, a PSI/PSIP processor 114, a 3D renderer 116, a formatter 120 and a display 122.
  • the tuner 100 selects a broadcast signal of a channel tuned by a user from among a plurality of broadcast signals input through an antenna (not shown) and outputs the selected broadcast signal.
  • the demodulator/channel decoder 102 demodulates the broadcast signal from the tuner 100 and performs error correction decoding on the demodulated signal to output a transport stream TS.
  • the transport demultiplexer 104 demultiplexes the transport stream so as to divide the transport stream into a video PES and an audio PES and extract PSI/PSIP information.
  • the depacketizer 106 depacketizes the video PES and the audio PES to restore a video ES and an audio ES.
  • the audio decoder 108 outputs an audio bitstream by decoding the audio ES.
  • the audio bitstream is converted into an analog audio signal by a digital-to-analog converter (not shown), amplified by an amplifier (not shown) and then output through a speaker (not shown).
  • the video decoder 110 decodes the video ES to restore the original image.
  • the decoding processes of the audio decoder 108 and the video decoder 110 can be performed on the basis of a packet ID (PID) confirmed by the PSI/PSIP processor 114.
  • PID packet ID
  • the video decoder 110 can extract depth information.
  • the video decoder 110 can extract additional information necessary to generate an image of a virtual camera view, for example, camera information or information for estimating an occlusion hidden by a front object (e.g.
  • the depth information and/or the additional information may be separated from each other by the transport demultiplexer 104 in other embodiments of the present invention.
  • the PSI/PSIP processor 114 receives the PSI/PSIP information from the transport demultiplexer 104, parses the PSI/PSIP information and stores the parsed PSI/PSIP information in a memory (not shown) or a register so as to enable broadcasting on the basis of the stored information.
  • the 3D renderer 116 can generate color information, depth information and the like at a virtual camera position using the restored image, depth information, additional information and camera parameters.
  • the 3D renderer 116 generates a virtual image at the virtual camera position by performing 3D warping using the restored image and depth information regarding the restored image. While the 3D renderer 116 is configured as a block separated from the video decoder 110 in the present embodiment, this is merely an exemplary and the 3D renderer 116 may be included in the video decoder 110.
  • the formatter 120 formats the image restored in the decoding process, that is, the actual image captured by a camera, and the virtual image generated by the 3D renderer 116 according to the display mode of the broadcast receiver such that a 3D image is displayed through the display 122.
  • synthesis of the depth information and virtual image at the virtual camera position by the 3D renderer 116 and image formatting by the formatter 120 may be selectively performed in response to a user command. That is, the user may manipulate a remote controller (not shown) such that a composite image is not displayed and designate an image synthesis time.
  • the depth information for generating the 3D image is used by the 3D renderer 116.
  • the depth information may be used by the video decoder 110 in other embodiments. A description will be given of various embodiments in which the video decoder 110 uses the depth information.
  • FIG. 2 is a block diagram of the video decoder according to an embodiment to which the present invention is applied.
  • the video decoder 110 may include an entropy decoding unit 210, an inverse quantization unit 220, an inverse transform unit 230, a deblocking filter unit 240, a decoded picture buffer unit 250, an inter prediction unit 260 and an intra prediction unit 270.
  • solid lines represent flow of color picture data and dotted lines represent flow of depth picture data. While the color picture data and the depth picture data are separately represented in FIG. 2 , separate representation of the color picture data and the depth picture data may refer to separate bitstreams or separate flows of data in one bitstream. That is, the color picture data and the depth picture data can be transmitted as one bitstream or separate bitstreams.
  • FIG. 2 only shows data flows and does not limit operations to operation performed in one decoder.
  • the depth bitstream 200 is parsed per NAL.
  • various types of attribute information regarding depth may be included in an NAL header region, an extended region of the NAL header, a sequence header region (e.g. sequence parameter set), an extended region of the sequence header, a picture header region (e.g. picture parameter set), an extended region of the picture header, a slice header region, an extended region of the slice header, a slice data region or a macro block region.
  • sequence header region e.g. sequence parameter set
  • a picture header region e.g. picture parameter set
  • an extended region of the picture header e.g. picture parameter set
  • a slice header region e.g. picture parameter set
  • depth identification information for identifying a depth bitstream can be added to the sequence header region (e.g. sequence parameter set) or the extended region of the sequence header. Attribute information regarding a depth sequence can be added only when an input bitstream is a depth coded bitstream, according to the depth identification information.
  • the parsed depth bitstream 200 is entropy-decoded through the entropy decoding unit 210 and a coefficient, a motion vector and the like of each macro block are extracted.
  • the inverse quantization unit 220 multiplies a received quantized value by a predetermined constant so as to obtain a transformed coefficient and the inverse transform unit 230 inversely transforms the coefficient to restore depth information of a depth picture.
  • the intra prediction unit 270 performs intra prediction using the restored depth information of the current depth picture.
  • the deblocking filter unit 240 applies deblocking filtering to each coded macro block in order to reduce block distortion.
  • the deblocking filter unit improves the texture of a decoded frame by smoothing edges of blocks. A filtering process is selected depending on boundary strength and an image sample gradient around a boundary. Filtered depth pictures are output or stored in the decoded picture buffer unit 250 to be used as reference pictures.
  • the decoded picture buffer unit 250 stores or opens previously coded depth pictures for inter prediction.
  • frame_num and POC Picture Order Count
  • the previously coded pictures may include depth pictures corresponding to views different from the current depth picture, depth view information for identifying views of depth pictures as well as frame num and POC can be used in order to use the previously coded pictures as reference pictures in depth coding.
  • the decoded picture buffer unit 250 may use the depth view information in order to generate a reference picture list for inter-view prediction of depth pictures.
  • the decoded picture buffer unit 250 can use depth-view reference information.
  • the depth-view reference information refers to information used to indicate dependence between views of depth pictures.
  • the depth-view reference information may include the number of depth views, a depth view identification number, the number of depth-view reference pictures, depth view identification numbers of depth-view reference pictures and the like.
  • the decoded picture buffer unit 250 manages reference pictures in order to implement more flexible inter prediction. For example, a memory management control operation method and a sliding window method can be used. Reference picture management unifies a reference picture memory and a non-reference picture memory into one memory and manages the unified memory so as to achieve efficient management with a small-capacity memory. In depth coding, depth pictures can be separately marked to be discriminated from color pictures in the decoded picture buffer unit and information for identifying each depth picture can be used in the marking process. Reference pictures managed through the aforementioned procedure can be used for depth coding in the inter prediction unit 260.
  • the inter prediction unit 260 may include a motion compensation unit 261, a virtual view synthesis unit 262 and a depth picture generation unit 263.
  • the motion compensation unit 261 compensates for motion of the current block using information transmitted from the entropy decoding unit 210.
  • the motion compensation unit 261 extracts motion vectors of neighboring blocks of the current block from a video signal and acquires a motion vector prediction value of the current block.
  • the motion compensation unit 261 compensates for motion of the current block using the motion vector prediction value and a differential vector extracted from the video signal.
  • Motion compensation may be performed using one reference picture or a plurality of pictures. In depth coding, motion compensation can be performed using information on a reference picture list for inter-view prediction of depth pictures stored in the decoded picture buffer unit 250 when the current depth picture refers to a depth picture of a different view. Further, motion compensation may be performed using depth view information for identifying the view of the depth picture.
  • the virtual view synthesis unit 262 synthesizes a color picture of a virtual view using color pictures of neighboring views of the view of the current color picture.
  • view identification information indicating the views of the color pictures can be used.
  • flag information indicating whether the color picture of the virtual view is generated can be defined.
  • the color picture of the virtual view can be generated using the view identification information.
  • the color picture of the virtual view, acquired through the virtual view synthesis unit 262, may be used as a reference picture. In this case, the view identification information can be assigned to the color picture of the virtual view.
  • the virtual view synthesis unit 262 can synthesize a depth picture of a virtual view using depth pictures corresponding to neighboring views of the view of the current depth picture.
  • depth view identification information indicating the view of a depth picture can be used.
  • the depth view identification information can be derived from view identification information of a corresponding color picture.
  • the corresponding color picture can have the same picture output order information and the same view identification information as those of the current depth picture.
  • the depth picture generation unit 263 can generate the current depth picture using depth coding information.
  • the depth coding information may include a distance parameter indicating a distance between a camera and an object (e.g. a Z-coordinate value on a camera coordinate system or the like), macro block type information for depth coding, information for identifying a boundary in a depth picture, information indicating whether data in RBSP includes depth-coded data, information indicating whether a data type is depth picture data, color picture data or parallax data and the like.
  • the current depth picture may be predicted using the depth coding information. That is, inter prediction using neighboring depth pictures of the current depth picture can be performed and intra prediction using decoded depth information in the current depth picture can be performed.
  • unit can refer to a block, a sub-block, a macro block, a slice, a picture, a frame, a picture group, a sequence, etc. when applied to a video signal. Accordingly, the meaning of "unit” should be interpreted according to application thereof. Furthermore, when the unit is applied to a signal other than the video signal, the unit may be interpreted as having a meaning suitable for the signal.
  • a coding unit refers to a basic unit in a video signal processing procedure. The coding unit may not have a fixed size in video processing.
  • a prediction unit refers to a basic unit for prediction.
  • the prediction unit can have a size of a square form (2Nx2N or NxN) or a size of a rectangular form (2NxN or Nx2N).
  • the size of the prediction unit may be identical to or smaller than the coding unit.
  • the coding unit may be segmented into a plurality of prediction units.
  • a current unit can be defined as including a current coding unit and a current prediction unit in the present invention.
  • parallel processing may refer to simultaneous coding of a plurality of units.
  • FIG. 3 is a flowchart illustrating a method for obtaining inter-view motion vectors of current units in parallel using parallel processing information and obtaining motion vectors of current prediction units.
  • the parallel processing information can be acquired from a bitstream (S300).
  • the parallel processing information may indicate whether parallel processing is performed and include information about the size of a parallel processing unit.
  • the parallel processing unit may refer to a basic unit to which parallel processing is applied.
  • the parallel processing information may be acquired per picture, frame, picture group or sequence.
  • Inter-view motion vectors of current units can be acquired using the parallel processing information (S310). Whether parallel processing is applied to a highest current coding unit can be determined through the parallel processing information.
  • the highest current coding unit is a coding unit including a current coding unit, and the current coding unit can be acquired through segmentation of the highest current coding unit.
  • an inter-view motion vector of the current coding unit included in the highest current coding unit can be acquired using inter-view motion vectors of neighboring blocks of the current coding unit.
  • the neighboring blocks of the current coding unit are included in a parallel processing unit adjacent to a current parallel processing unit including the current coding unit.
  • the parallel processing unit adjacent to the current parallel processing unit may be at least one of a left-bottom parallel processing unit, a left parallel processing unit, a left-top parallel processing unit, a top parallel processing unit and a right-top parallel processing unit of the current parallel processing unit.
  • the current coding unit may include current prediction units.
  • Inter-view motion vectors of the current prediction units can be acquired using the acquired inter-view motion vector of the current coding unit.
  • the inter-view motion vectors of the current prediction units may be acquired using inter-view motion vectors of neighboring blocks of the current prediction units.
  • Motion vectors of the current prediction units can be acquired in parallel using the inter-view motion vector of the current coding unit (S320).
  • the motion vectors of the current prediction units can be acquired using motion information of neighboring blocks of the current prediction units.
  • An example of parallel processing of the current prediction units included in the current coding unit will be described with reference to FIGS. 5 , 6 and 7 and an example of obtaining the motion vectors of the current prediction units using the inter-view motion vector of the current coding unit will be described with reference to FIGS. 8 , 9 and 10 .
  • FIG. 4 illustrates an example of obtaining the inter-view motion vector of the current coding unit using the parallel processing information according to an embodiment of the present invention.
  • the inter-view motion vector of the current coding unit can be acquired using inter-view motion vectors of neighboring blocks.
  • FIG. 4 shows an example in which the highest current coding unit has a size of 16Nx16N, the current coding unit has a size of 2Nx2N and the parallel processing block has a size of 8Nx8N.
  • the inter-view motion vector of the current coding unit can be acquired using inter-view motion vectors of neighboring units which are not processed simultaneously with the current coding unit.
  • the inter-view motion vector of the current coding unit can be acquired using inter-view motion vectors of a left-top block 400, a left block 410 and a left-bottom block 420 of the current coding unit.
  • the inter-view motion vector of the current coding unit may be acquired using only the inter-view motion vector of the left block 410 of the current coding unit.
  • the inter-view motion vector of the current coding unit can be acquired using the inter-view motion vectors of the neighboring blocks.
  • top block 430 and the right-top block 440 of the current coding unit are neighboring blocks of the current coding unit
  • the top block 430 and the right-top block 440 are included in a unit which is processed simultaneously with the current coding unit. Accordingly, the top block 430 and the right-top block 440 are not used for the procedure of obtaining the inter-view motion vector of the current coding unit.
  • Inter-view motion vectors of all coding units included in the current highest coding unit can be acquired using the aforementioned method.
  • FIG. 5 illustrates an example of parallel processing of current prediction units included in the current coding unit in units of NxN according to an embodiment of the present invention.
  • the current coding unit When the current coding unit has a size of 2Nx2N and a current prediction unit included in the current coding unit has a size of NxN, the current coding unit includes four current prediction units and motion vector prediction values of the four current prediction units can be simultaneously acquired using motion vectors of neighboring blocks thereof.
  • the current coding unit includes a first prediction unit, a second prediction unit, a third prediction unit and a fourth prediction unit. Each prediction unit has neighboring blocks thereof.
  • a motion vector prediction value of the first prediction unit can be acquired using motion vectors of neighboring blocks of the first prediction unit, that is, a left-top block 500, a top block 501, a right-top block 502, a left block 505 and a left-bottom block 510.
  • a motion vector prediction value of the second prediction unit can be acquired using motion vectors of neighboring blocks of the second prediction unit, that is, a left-top block 501, a top block 503 and a right-top block 504.
  • a left block 506 and a left-bottom block 511 from among the neighboring blocks of the second prediction unit are included in the current coding unit and motion vectors of the left block 506 and the left-bottom block 511 may not be used for parallel processing.
  • a motion vector prediction value of the third prediction unit can be acquired using motion vectors of neighboring blocks of the third prediction unit, that is, a left-top block 505, a left block 512 and a left-bottom block 514.
  • a top block 506 and a right-top block 507 from among the neighboring blocks of the third prediction unit are included in the current coding unit and motion vectors of the top block 506 and the right-top block 507 may not be used for parallel processing.
  • a motion vector prediction value of the fourth prediction unit can be acquired using motion vectors of neighboring blocks of the fourth prediction unit, that is, a right-top block 509 and a left-bottom block 515.
  • a left-top block 506, a top block 508 and a left block 513 from among the neighboring blocks of the fourth prediction unit are included in the current coding unit and motion vectors of the left-top block 506, the top block 508 and the left block 513 may not be used for parallel processing.
  • FIG. 6 illustrates an example of parallel processing of current prediction units included in the current coding unit in units of Nx2N according to an embodiment of the present invention.
  • the current coding unit When the current coding unit has a size of 2Nx2N and a current prediction unit included in the current coding unit has a size of Nx2N, the current coding unit includes two current prediction units and motion vector prediction values of the two current prediction units can be simultaneously acquired using motion vectors of neighboring blocks thereof.
  • the current coding unit includes a fifth prediction unit and a sixth prediction unit. Each prediction unit has neighboring blocks thereof.
  • a motion vector prediction value of the fifth prediction unit can be acquired using motion vectors of neighboring blocks of the fifth prediction unit, that is, a left-top block 600, a top block 601, a right-top block 602, a left block 605 and a left-bottom block 610.
  • a motion vector prediction value of the sixth prediction unit can be acquired using motion vectors of neighboring blocks of the sixth prediction unit, that is, a left-top block 601, a top block 603, a right-top block 604 and a left-bottom block 615.
  • a left block 613 from among the neighboring blocks of the sixth prediction unit is included in the current coding unit and the motion vector of the left block 613 may not be used for parallel processing.
  • FIG. 7 illustrates an example of parallel processing of current prediction units included in the current coding unit in units of 2NxN according to an embodiment of the present invention.
  • the current coding unit When the current coding unit has a size of 2Nx2N and a current prediction unit included in the current coding unit has a size of 2NxN, the current coding unit includes two current prediction units and motion vector prediction values of the two current prediction units can be simultaneously acquired using motion vectors of neighboring blocks thereof
  • the current coding unit includes a seventh prediction unit and an eighth prediction unit. Each prediction unit has neighboring blocks thereof.
  • a motion vector prediction value of the seventh prediction unit can be acquired using motion vectors of neighboring blocks of the seventh prediction unit, that is, a left-top block 700, a top block 703, a right-top block 704, a left block 705 and a left-bottom block 710.
  • a motion vector prediction value of the eighth prediction unit can be acquired using motion vectors of neighboring blocks of the eighth prediction unit, that is, a left-top block 705, a right-top block 709, a left block 712 and a left-bottom block 714.
  • a top block 708 from among the neighboring blocks of the eighth prediction unit is included in the current coding unit and the motion vector of the top block 708 may not be used for parallel processing.
  • FIG. 8 is a flowchart illustrating a method for obtaining a motion vector of a current prediction unit using a picture order count and a motion vector corresponding to a reference picture of a corresponding block according to an embodiment of the present invention.
  • Picture order count information of a reference picture corresponding to the current prediction unit can be acquired (S800).
  • Picture order count information may include information about a picture order count.
  • the picture order count (POC) refers to a picture output order when video is output.
  • the reference picture corresponding to the current prediction unit can be positioned at the same view as a current picture including the current prediction unit and at a different time from the current picture. Accordingly, pictures at the same view cannot have the same picture order count.
  • a picture order count of a picture including the current prediction unit can be assumed to be POC0 and the picture order count of the reference picture corresponding to the current prediction unit can be assumed to be POC1.
  • Picture order count information of a reference picture corresponding to a corresponding block and a motion vector corresponding to the reference picture of the corresponding block can be acquired using an inter-view motion vector (S810).
  • the inter-view motion vector of the current prediction unit can be acquired using the inter-view motion vector of the current coding unit, obtained in step S310.
  • a corresponding block of the current prediction unit can be acquired using the inter-view motion vector.
  • the corresponding block can be positioned at a different view from the current prediction unit and at the same time as the current prediction unit.
  • the picture order count information of the reference picture of the corresponding block and the motion vector corresponding to the reference picture of the corresponding block can be acquired.
  • the corresponding block detected using the inter-view motion vector can be coded according to temporal inter prediction using a plurality of reference pictures. It may be assumed that a picture count order of a reference picture in direction L0, which corresponds to the corresponding block, is POC2L0 and a picture count order of a reference picture in direction L1, which corresponds to the corresponding block, is POC2L1. In addition, it may be assumed that a motion vector corresponding to the L0 direction reference picture of the corresponding block is mv2L0 and a motion vector corresponding to the L1 direction reference picture of the corresponding block is mv2L1.
  • a motion vector prediction value of the current prediction unit can be acquired by comparing the picture order count of the reference picture corresponding to the current prediction unit with the picture order count of reference pictures of the corresponding block (S820).
  • the picture order count of the reference picture corresponding to the current prediction unit may be preferentially compared with the picture order count of the L0 direction reference picture of the corresponding block.
  • the picture order count of the reference picture corresponding to the current prediction unit may be preferentially compared with the picture order count of the L1 direction reference picture of the corresponding block.
  • the picture order count POC1 of the reference picture corresponding to the current prediction unit is compared with the picture order counts POC2L0 and POC2L1 of the reference pictures of the corresponding block, the picture count orders of the reference pictures of the corresponding block equal or differ from the picture order count of the reference picture corresponding to the current prediction unit.
  • the motion vector of the current prediction unit can be acquired using motion vectors of the reference pictures of the corresponding block on the basis of the comparison result.
  • the motion vector of the current prediction unit can be acquired using a motion vector prediction value (S830).
  • the motion vector prediction value can be obtained using motion vectors of neighboring blocks of the current prediction unit.
  • One of the motion vectors of the neighboring blocks can be acquired as the motion vector prediction value of the neighboring blocks.
  • the average of the motion vectors of the neighboring blocks may be acquired as the motion vector prediction value of the neighboring block.
  • the motion vector of the current prediction unit can be acquired using the motion vector prediction value.
  • the motion vector prediction value can be directly used as the motion vector of the current prediction unit.
  • the motion vector prediction value may be included in a motion vector list of the current prediction unit.
  • the motion vector of the current prediction unit can be acquired using priority in the motion vector list or a motion vector index of the current prediction unit.
  • FIG. 9 illustrates an exemplary method for obtaining the motion vector prediction value of the current prediction unit when the picture order count of a reference picture of the corresponding block equal the picture order count of a reference picture corresponding to the current prediction unit.
  • a motion vector corresponding to the reference picture of the corresponding block which has the same picture order count as that of the reference picture corresponding to the current prediction unit, can be acquired as the motion vector prediction value of the current prediction unit.
  • a reference picture 910 of the current prediction unit is positioned at the same view as the current prediction unit and at a different time from the current prediction unit.
  • An inter-view motion vector 900 of the current prediction unit can be acquired from neighboring blocks.
  • the inter-view motion vector 900 of the current prediction unit indicates the corresponding block and reference pictures 920 and 930 of the corresponding block are positioned at the same view as the corresponding block and at a different time from the corresponding block.
  • the picture order count POC1 of the reference picture 910 corresponding to the current prediction unit and the picture order count POC2L2 of the L0-direction reference picture 920 of the corresponding block are identical to each other as 1. Accordingly, the motion vector prediction value of the current prediction unit can be determined as the motion vector mv2L0 corresponding to the L0-direction reference picture 920 of the corresponding block.
  • FIG. 10 illustrates an exemplary method for obtaining the motion vector prediction value of the current prediction unit when the picture order count of a reference picture of the corresponding block does not equal the picture order count of the reference picture corresponding to the current prediction unit.
  • the motion vector prediction value of the current prediction unit can be acquired by scaling a motion vector corresponding to the reference picture of the corresponding block.
  • a reference picture 1010 of the current prediction unit is positioned at the same view as the current prediction unit and at a different time from the current prediction unit.
  • An inter-view motion vector 1000 of the current prediction unit can be acquired from neighboring blocks.
  • the inter-view motion vector 1000 of the current prediction unit indicates the corresponding block and reference pictures 1020 and 1030 of the corresponding block are positioned at the same view as the corresponding block and at a different time from the corresponding block.
  • the motion vector prediction value mv1 of the current prediction unit can be acquired by scaling the motion vectors mv2L0 and mv2L1 corresponding to the reference pictures of the corresponding block according to Equation 1.
  • mv 1 mv 2 ⁇ L ⁇ X ⁇ s POC 1 ⁇ POC 0 POC 2 LX ⁇ POC 0
  • Equation 1 X can be 0 when the direction of a reference picture of the corresponding block is L0 and 1 when the direction is L1.
  • the method for obtaining the motion vector prediction value of the current prediction unit may depend on inter prediction type of a neighboring block from which the inter-view motion vector indicating the corresponding block is acquired.
  • the inter-view motion vector of the current prediction unit can be acquired from neighboring blocks coded according to inter-view inter prediction or neighboring blocks coded according to reference view temporal inter prediction. Neighboring blocks coded according to inter-view inter prediction can provide an inter-view motion vector with higher accuracy than neighboring blocks coded according to reference view temporal inter prediction.
  • the motion vector prediction value of the current prediction unit can be acquired using the method described above with reference to FIG. 9 if the picture order count of a reference picture of the corresponding block equals the picture order count of a reference picture corresponding to the current prediction unit and obtained using the method described above with reference to FIG. 10 if the picture order count of the reference picture of the corresponding block differs from the picture order count of the reference picture corresponding to the current prediction unit.
  • the motion vector prediction value of the current prediction unit can be acquired using the method described above with reference to FIG. 9 if the picture order count of a reference picture of the corresponding block equals the picture order count of a reference picture corresponding to the current prediction unit, and the method described above with reference to FIG. 10 may not be used when the picture order count of a reference picture of the corresponding block differs from the picture order count of a reference picture corresponding to the current prediction unit.
  • a motion vector prediction value acquired through the method of FIG. 9 and a motion vector prediction value obtained through the method of FIG. 10 may be added to the motion vector prediction value list of the current prediction unit.
  • a motion vector prediction value, obtained when the picture order count of a reference picture corresponding to the current prediction unit is identical to the picture order count of a reference picture of the corresponding block, can be added to the motion vector prediction value list with higher priority than a motion vector prediction value acquired when the picture order count of the reference picture corresponding to the current prediction unit is not identical to the picture order count of the reference picture of the corresponding block.
  • the motion vector prediction value can be added to the third place of the motion vector prediction value list.
  • the motion vector prediction value can be added to the fifth place of the motion vector prediction value list.
  • the decoding/encoding apparatus to which the present invention is applied may be included in a multimedia broadcast transmission/reception apparatus such as a DMB (digital multimedia broadcast) system to be used to decode video signals, data signals and the like.
  • the multimedia broadcast transmission/reception apparatus may include a mobile communication terminal.
  • the decoding/encoding method to which the present invention is applied may be implemented as a computer-executable program and stored in a computer-readable recording medium and multimedia data having a data structure according to the present invention may also be stored in a computer-readable recording medium.
  • the computer-readable recording medium includes all kinds of storage devices storing data readable by a computer system. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and a medium using a carrier wave (e.g. transmission through the Internet).
  • a bitstream generated according to the encoding method may be stored in a computer-readable recording medium or transmitted using a wired/wireless communication network.
  • the present invention can be used to code a video signal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Claims (15)

  1. Verfahren zur Verarbeitung eines Videosignals, umfassend:
    (S300) Erhalten von Parallelverarbeitungsinformationen aus dem Videosignal, wobei die Parallelverarbeitungsinformationen Größeninformationen über eine Größe einer aktuellen Parallelverarbeitungseinheit beinhalten, die in einem aktuellen Bild enthalten ist, wobei die aktuelle Parallelverarbeitungseinheit eine oder mehrere aktuelle Codiereinheiten beinhaltet, wobei jede aktuelle Codiereinheit eine oder mehrere aktuelle Vorhersageeinheiten beinhaltet;
    Bestimmen der Größe der aktuellen Parallelverarbeitungseinheit unter Verwendung der Parallelverarbeitungsinformationen;
    (S310) Erhalten eines Inter-View-Bewegungsvektors jeder aktuellen Codiereinheit, die in der aktuellen Parallelverarbeitungseinheit enthalten ist, unter Verwendung eines Inter-View-Bewegungsvektors eines benachbarten Blocks der aktuellen Codiereinheit, worin der benachbarte Block der aktuellen Codiereinheit ein Block ist, der an die aktuelle Parallelverarbeitungseinheit angrenzt und somit nicht in der aktuellen Parallelverarbeitungseinheit enthalten ist; und
    (S320) paralleles Erhalten von Bewegungsvektoren der einen oder mehreren aktuellen Vorhersageeinheiten unter Verwendung des Inter-View-Bewegungsvektors der aktuellen Codiereinheit, wobei der Inter-View-Bewegungsvektor einen entsprechenden Block angibt, der in einer anderen Ansicht als die eine oder mehreren aktuellen Vorhersageeinheiten und in einem Bild mit einem gleichen Bildreihenfolgezählwert wie das aktuelle Bild positioniert ist.
  2. Verfahren nach Anspruch 1, wobei der an die aktuelle Parallelverarbeitungseinheit angrenzende Block in mindestens einer von einer links-unten Parallelverarbeitungseinheit, einer linken Parallelverarbeitungseinheit, einer linken-oberen Parallelverarbeitungseinheit, einer links-oberen Parallelverarbeitungseinheit, einer oberen Parallelverarbeitungseinheit und einer rechts-oberen Parallelverarbeitungseinheit der aktuellen Parallelverarbeitungseinheit positioniert ist.
  3. Verfahren nach Anspruch 1,
    wobei, wenn die aktuelle Codiereinheit eine Größe von 2Nx2N aufweist, jede aktuelle Vorhersageeinheit eine Größe von NxN aufweist und die aktuellen Vorhersageeinheiten parallel verarbeitet werden, die aktuellen Vorhersageeinheiten eine erste Vorhersageeinheit, eine zweite Vorhersageeinheit, eine dritte Vorhersageeinheit und eine vierte Vorhersageeinheit beinhalten,
    wobei die erste Vorhersageeinheit ein links-oberer Block ist, der in der aktuellen Codiereinheit enthalten ist, die zweite Vorhersageeinheit ein rechts-oberer Block ist, der in der aktuellen Codiereinheit enthalten ist, die dritte Vorhersageeinheit ein links-unterer Block ist, der in der aktuellen Codiereinheit enthalten ist, und die vierte Vorhersageeinheit ein rechts-unterer Block ist, der in der aktuellen Codiereinheit enthalten ist,
    wobei ein Bewegungsvektor-Vorhersagewert der ersten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (500), eines oberen Blocks (501), eines rechts-oberen Blocks (502), eines linken Blocks (505) und eines links-unteren Blocks (510) der ersten Vorhersageeinheit erhalten wird, ein Bewegungsvektor-Vorhersagewert der zweiten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (501), eines oberen Blocks (503) und eines rechts-oberen Blocks (504) der zweiten Vorhersageeinheit erhalten wird, ein Bewegungsvektor-Vorhersagewert der dritten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (505), eines linken Blocks (512) und eines links-unteren Blocks (514) der dritten Vorhersageeinheit erhalten wird, und ein Bewegungsvektor-Vorhersagewert der vierten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines rechts-oberen Blocks (509) und eines links-unteren Blocks (515) der vierten Vorhersageeinheit erhalten wird.
  4. Verfahren nach Anspruch 1,
    wobei, wenn die aktuelle Codiereinheit eine Größe von 2Nx2N aufweist, jede aktuelle Vorhersageeinheit eine Größe von Nx2N aufweist und die aktuellen Vorhersageeinheiten parallel verarbeitet werden, die aktuellen Vorhersageeinheiten eine fünfte Vorhersageeinheit und eine sechste Vorhersageeinheit beinhalten,
    wobei die fünfte Vorhersageeinheit ein linker Block ist, der in der aktuellen Codiereinheit enthalten ist, und die sechste Vorhersageeinheit ein rechter Block ist, der in der aktuellen Codiereinheit enthalten ist,
    wobei ein Bewegungsvektor-Vorhersagewert der fünften Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (600), eines oberen Blocks (601), eines rechts-oberen Blocks (602), eines linken Blocks (605) und eines links-unteren Blocks (610) der fünften Vorhersageeinheit erhalten wird, und ein Bewegungsvektor-Vorhersagewert der sechsten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (601), eines oberen Blocks (603), eines rechts-oberen Blocks (604) und eines links-unteren Blocks (615) der sechsten Vorhersageeinheit erhalten wird.
  5. Verfahren nach Anspruch 1,
    wobei, wenn die aktuelle Codiereinheit eine Größe von 2Nx2N aufweist, jede aktuelle Vorhersageeinheit eine Größe von 2NxN aufweist und die aktuellen Vorhersageeinheiten parallel verarbeitet werden, die aktuellen Vorhersageeinheiten eine siebte Vorhersageeinheit und eine achte Vorhersageeinheit beinhalten,
    wobei die siebte Vorhersageeinheit ein oberer Block ist, der in der aktuellen Codiereinheit enthalten ist, und die achte Vorhersageeinheit ein unterer Block ist, der in der aktuellen Codiereinheit enthalten ist,
    wobei ein Bewegungsvektor-Vorhersagewert der siebten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (700), eines oberen Blocks (703), eines rechts-oberen Blocks (704), eines linken Blocks (705) und eines links-unteren Blocks (710) der siebten Vorhersageeinheit erhalten wird, und ein Bewegungsvektor-Vorhersagewert der achten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (705), eines rechts-oberen Blocks (709), eines linken Blocks (712) und eines links-unteren Blocks (714) der achten Vorhersageeinheit erhalten wird.
  6. Verfahren nach Anspruch 1, wobei das parallele Erhalten der Bewegungsvektoren der einen oder mehreren aktuellen Vorhersageeinheiten umfasst:
    Erhalten von Informationen über einen Bildreihenfolgezählwert eines Referenzbildes, das einer aktuellen Vorhersageeinheit der einen oder mehreren aktuellen Vorhersageeinheiten entspricht;
    Erhalten von Informationen über die Bildreihenfolgezählwerte von Referenzbildern des entsprechenden Blocks, der durch den Inter-View-Bewegungsvektor angegeben wird;
    Vergleichen der Bildreihenfolgezählwerte der Referenzbilder des entsprechenden Blocks mit dem Bildreihenfolgezählwert des der aktuellen Vorhersageeinheit entsprechenden Referenzbildes; und
    Erhalten eines Bewegungsvektor-Vorhersagewerts der aktuellen Vorhersageeinheit auf der Grundlage eines Vergleichsergebnisses,
    wobei das Referenzbild, das der aktuellen Vorhersageeinheit entspricht, in einer gleichen Ansicht wie die aktuelle Vorhersageeinheit positioniert ist und einen anderen Bildreihenfolgezählwert als das aktuelle Bild aufweist und die Referenzbilder des entsprechenden Blocks in einer gleichen Ansicht wie der entsprechende Block positioniert sind und Bildreihenfolgezählwerte aufweisen, die von dem Referenzbild einschließlich des entsprechenden Blocks verschieden sind.
  7. Verfahren nach Anspruch 6, wobei, wenn der benachbarte Block ein Inter-View-Vorhersageblock ist und ein Referenzbild des entsprechenden Blocks einen gleichen Bildreihenfolgezählwert wie das Referenzbild, das der aktuellen Bildeinheit entspricht, aufweist, beim Erhalten des Bewegungsvektor-Vorhersagewertes der aktuellen Vorhersageeinheit der Bewegungsvektor-Vorhersagewert der aktuellen Vorhersageeinheit unter Verwendung eines Bewegungsvektors erhalten wird, der dem Referenzbild des entsprechenden Blocks entspricht.
  8. Verfahren nach Anspruch 6, wobei, wenn der benachbarte Block ein Inter-View-Vorhersageblock ist und ein Referenzbild des entsprechenden Blocks einen anderen Bildreihenfolgezählwert als das Referenzbild, das der aktuellen Bildeinheit entspricht, aufweist, beim Erhalten des Bewegungsvektor-Vorhersagewertes der aktuellen Vorhersageeinheit der Bewegungsvektor-Vorhersagewert der aktuellen Vorhersageeinheit unter Verwendung der Bildreihenfolgezählwerte der Referenzbilder des entsprechenden Blocks, des Bildreihenfolgezählwerts des Referenzbildes, welches der aktuellen Vorhersageeinheit entspricht und einem dem Referenzbild des entsprechenden Blocks entsprechenden Bewegungsvektor erhalten wird.
  9. Verfahren nach Anspruch 1, wobei der Bildreihenfolgezählwert eine Bildausgabereihenfolge angibt, wenn Video ausgegeben wird.
  10. Videodecoder, umfassend:
    eine Inter-Vorhersageeinheit, die ausgebildet ist,
    um Parallelverarbeitungsinformationen aus dem Videosignal zu erhalten, wobei die Parallelverarbeitungsinformationen Größeninformationen über eine Größe einer in einem aktuellen Bild enthaltenen aktuellen Parallelverarbeitungseinheit beinhalten, wobei die aktuelle Parallelverarbeitungseinheit eine oder mehrere aktuelle Codiereinheiten beinhaltet, wobei jede aktuelle Codiereinheit eine oder mehrere aktuelle Vorhersageeinheiten beinhaltet,
    um die Größe der aktuellen Parallelverarbeitungseinheit anhand der Parallelverarbeitungsinformationen zu bestimmen,
    um einen Inter-View-Bewegungsvektor jeder aktuellen Codiereinheit, die in der aktuellen Parallelverarbeitungseinheit enthalten ist, unter Verwendung eines Inter-View-Bewegungsvektors eines der aktuellen Codiereinheit benachbarten Blocks zu erhalten, und
    um Bewegungsvektoren der einen oder mehreren aktuellen Vorhersageeinheiten unter Verwendung des Inter-View-Bewegungsvektors der aktuellen Codiereinheit parallel zu erhalten,
    wobei der Inter-View-Bewegungsvektor einen entsprechenden Block angibt, der in einer anderen Ansicht als die eine oder die mehreren aktuellen Vorhersageeinheiten und in einem Bild mit einem gleichen Bildreihenfolgezählwert wie das aktuelle Bild positioniert ist.
  11. Videodecoder nach Anspruch 10, wobei der an die aktuelle Parallelverarbeitungseinheit angrenzende Block in mindestens einer von einer links-unten Parallelverarbeitungseinheit, einer linken Parallelverarbeitungseinheit, einer linken Parallelverarbeitungseinheit, einer links-oberen Parallelverarbeitungseinheit, einer oberen Parallelverarbeitungseinheit und einer rechts-oberen Parallelverarbeitungseinheit der aktuellen Parallelverarbeitungseinheit positioniert ist.
  12. Videodecoder nach Anspruch 10,
    wobei, wenn die aktuelle Codiereinheit eine Größe von 2Nx2N aufweist, jede aktuelle Vorhersageeinheit eine Größe von NxN aufweist und die aktuellen Vorhersageeinheiten parallel verarbeitet werden, die aktuellen Vorhersageeinheiten eine erste Vorhersageeinheit, eine zweite Vorhersageeinheit, eine dritte Vorhersageeinheit und eine vierte Vorhersageeinheit beinhalten,
    wobei die erste Vorhersageeinheit ein links-oberer Block ist, der in der aktuellen Codiereinheit enthalten ist, die zweite Vorhersageeinheit ein rechts-oberer Block ist, der in der aktuellen Codiereinheit enthalten ist, die dritte Vorhersageeinheit ein links-unterer Block ist, der in der aktuellen Codiereinheit enthalten ist, und die vierte Vorhersageeinheit ein rechts-unterer Block ist, der in der aktuellen Codiereinheit enthalten ist,
    wobei die Inter-Vorhersageeinheit einen Bewegungsvektor-Vorhersagewert der ersten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (500), eines oberen Blocks (501), eines rechts-oberen Blocks (502), eines linken Blocks (505) und eines links-unteren Blocks (510) der ersten Vorhersageeinheit erhält, einen Bewegungsvektor-Vorhersagewert der zweiten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (501), eines oberen Blocks (503) und eines rechts-oberen Blocks (504) der zweiten Vorhersageeinheit erhält, einen Bewegungsvektor-Vorhersagewert der dritten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (505), eines linken Blocks (512) und eines links-unteren Blocks (514) der dritten Vorhersageeinheit erhält, und einen Bewegungsvektor-Vorhersagewert der vierten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines rechts-oberen Blocks (509) und eines links-unteren Blocks (515) der vierten Vorhersageeinheit erhält.
  13. Videodecoder nach Anspruch 10,
    wobei, wenn die aktuelle Codiereinheit eine Größe von 2Nx2N aufweist, jede aktuelle Vorhersageeinheit eine Größe von Nx2N aufweist und die aktuellen Vorhersageeinheiten parallel verarbeitet werden, die aktuellen Vorhersageeinheiten eine fünfte Vorhersageeinheit und eine sechste Vorhersageeinheit beinhalten,
    wobei die fünfte Vorhersageeinheit ein linker Block ist, der in der aktuellen Codiereinheit enthalten ist, und die sechste Vorhersageeinheit ein rechter Block ist, der in der aktuellen Codiereinheit enthalten ist,
    wobei die Inter-Vorhersageeinheit einen Bewegungsvektor-Vorhersagewert der fünften Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (600), eines oberen Blocks (601), eines rechts-oberen Blocks (602), eines linken Blocks (605) und eines links-unteren Blocks (610) der fünften Vorhersageeinheit erhält und einen Bewegungsvektor-Vorhersagewert der sechsten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (601), eines oberen Blocks (603), eines rechts-oberen Blocks (604) und eines links-unteren Blocks (615) der sechsten Vorhersageeinheit erhält.
  14. Videodecoder nach Anspruch 10,
    wobei, wenn die aktuelle Codiereinheit eine Größe von 2Nx2N aufweist, jede aktuelle Vorhersageeinheit eine Größe von 2NxN aufweist und die aktuellen Vorhersageeinheiten parallel verarbeitet werden, die aktuellen Vorhersageeinheiten eine siebte Vorhersageeinheit und eine achte Vorhersageeinheit beinhalten,
    wobei die siebte Vorhersageeinheit ein oberer Block ist, der in der aktuellen Codiereinheit enthalten ist, und die achte Vorhersageeinheit ein unterer Block ist, der in der aktuellen Codiereinheit enthalten ist,
    wobei die Inter-Vorhersageeinheit einen Bewegungsvektor-Vorhersagewert der siebten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (700), eines oberen Blocks (703), eines rechts-oberen Blocks (704), eines linken Blocks (705) und eines links-unteren Blocks (710) der siebten Vorhersageeinheit erhält und einen Bewegungsvektor-Vorhersagewert der achten Vorhersageeinheit unter Verwendung von Bewegungsinformationen eines links-oberen Blocks (705), eines rechts-oberen Blocks (709), eines linken Blocks (712) und eines links-unteren Blocks (714) der achten Vorhersageeinheit erhält.
  15. Videodecoder nach Anspruch 10,
    wobei die Inter-Vorhersageeinheit Informationen über einen Bildordnungszählwert eines Referenzbildes, das einer aktuellen Vorhersageeinheit der einen oder mehreren aktuellen Vorhersageeinheiten entspricht, erhält, Informationen über Bildordnungszählwerte von Referenzbildern eines entsprechenden Blocks erhält, der durch den Interview-Bewegungsvektor angezeigt wird, die Bildordnungszählwerte der Referenzbilder des entsprechenden Blocks mit dem Bildordnungszählwert des Referenzbildes, das der aktuellen Vorhersageeinheit entspricht, vergleicht, und einen Bewegungsvektor-Vorhersagewert der aktuellen Vorhersageeinheit auf der Grundlage eines Vergleichsergebnisses erhält,
    wobei das Referenzbild, das der aktuellen Vorhersageeinheit entspricht, in einer gleichen Ansicht wie die aktuelle Vorhersageeinheit positioniert ist und einen anderen Bildreihenfolgezählwert als das aktuelle Bild aufweist, und die Referenzbilder des entsprechenden Blocks in einer gleichen Ansicht wie der entsprechende Block positioniert sind und von dem Referenzbild einschließlich des entsprechenden Blocks verschiedene Bildreihenfolgezählwerte aufweisen.
EP13844143.1A 2012-10-07 2013-10-04 Verfahren und vorrichtung zur verarbeitung eines videosignals Active EP2905964B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261710759P 2012-10-07 2012-10-07
PCT/KR2013/008864 WO2014054896A1 (ko) 2012-10-07 2013-10-04 비디오 신호 처리 방법 및 장치

Publications (3)

Publication Number Publication Date
EP2905964A1 EP2905964A1 (de) 2015-08-12
EP2905964A4 EP2905964A4 (de) 2016-03-16
EP2905964B1 true EP2905964B1 (de) 2020-01-22

Family

ID=50435185

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13844143.1A Active EP2905964B1 (de) 2012-10-07 2013-10-04 Verfahren und vorrichtung zur verarbeitung eines videosignals

Country Status (8)

Country Link
US (1) US10171836B2 (de)
EP (1) EP2905964B1 (de)
JP (1) JP6594773B2 (de)
KR (1) KR102248074B1 (de)
CN (1) CN104782127B (de)
CA (1) CA2887120C (de)
ES (1) ES2775202T3 (de)
WO (1) WO2014054896A1 (de)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10757437B2 (en) 2014-07-17 2020-08-25 Apple Inc. Motion estimation in block processing pipelines
US9762919B2 (en) 2014-08-28 2017-09-12 Apple Inc. Chroma cache architecture in block processing pipelines
US10701396B2 (en) 2015-11-23 2020-06-30 Electronics And Telecommunications Research Institute Multi-viewpoint video encoding/decoding method
KR102601689B1 (ko) 2018-10-12 2023-11-15 삼성디스플레이 주식회사 전자 장치

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100846780B1 (ko) 2003-11-10 2008-07-16 삼성전자주식회사 움직임 벡터 추정 방법 및 장치
JP4898415B2 (ja) 2006-12-19 2012-03-14 キヤノン株式会社 動画像符号化装置及び動画像符号化方法
KR20080060188A (ko) 2006-12-26 2008-07-01 엘지전자 주식회사 비디오 신호 디코딩 방법 및 장치
EP2135454A4 (de) 2007-03-02 2010-09-01 Lg Electronics Inc Verfahren und vorrichtung zum decodieren/codieren eines videosignals
US20100166073A1 (en) 2008-12-31 2010-07-01 Advanced Micro Devices, Inc. Multiple-Candidate Motion Estimation With Advanced Spatial Filtering of Differential Motion Vectors
JP2012191298A (ja) 2011-03-09 2012-10-04 Fujitsu Ltd 動画像復号装置、動画像符号化装置、動画像復号方法、動画像符号化方法、動画像復号プログラム及び動画像符号化プログラム
KR20120118780A (ko) * 2011-04-19 2012-10-29 삼성전자주식회사 다시점 비디오의 움직임 벡터 부호화 방법 및 장치, 그 복호화 방법 및 장치
US9549180B2 (en) 2012-04-20 2017-01-17 Qualcomm Incorporated Disparity vector generation for inter-view prediction for video coding

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
JP6594773B2 (ja) 2019-10-23
CN104782127A (zh) 2015-07-15
JP2015536109A (ja) 2015-12-17
EP2905964A1 (de) 2015-08-12
US10171836B2 (en) 2019-01-01
CN104782127B (zh) 2021-05-28
KR102248074B1 (ko) 2021-05-04
CA2887120C (en) 2017-08-22
ES2775202T3 (es) 2020-07-24
KR20150090053A (ko) 2015-08-05
EP2905964A4 (de) 2016-03-16
US20150281734A1 (en) 2015-10-01
WO2014054896A1 (ko) 2014-04-10
CA2887120A1 (en) 2014-04-10

Similar Documents

Publication Publication Date Title
EP2986000A1 (de) Verfahren und vorrichtung zur verarbeitung von videosignalen
EP2905964B1 (de) Verfahren und vorrichtung zur verarbeitung eines videosignals
US9955166B2 (en) Method and device for processing video signal
AU2014205860B2 (en) Method and apparatus for processing video signal
US20160165259A1 (en) Method and apparatus for processing video signal
US9998762B2 (en) Method and apparatus for processing video signals
US9781442B2 (en) Method and apparatus for processing video signal
EP2919464A1 (de) Vorrichtung und verfahren zur verarbeitung von videosignalen
US10129560B2 (en) Method and apparatus for processing video signal
KR20150095679A (ko) 비디오 신호 처리 방법 및 장치
US20160050438A1 (en) Video signal processing method and device
EP2986002B1 (de) Videosignalverarbeitungsverfahren und -vorrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150415

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIN1 Information on inventor provided before grant (corrected)

Inventor name: HEO, JIN

Inventor name: JUNG, JIWOOK

Inventor name: KIM, TAESUP

Inventor name: KOO, MOONMO

Inventor name: SON, EUNYONG

Inventor name: SUNG, JAEWON

Inventor name: YEA, SEHOON

DAX Request for extension of the european patent (deleted)
RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20160216

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 19/43 20140101ALI20160210BHEP

Ipc: H04N 19/597 20140101ALI20160210BHEP

Ipc: H04N 19/52 20140101ALI20160210BHEP

Ipc: H04N 19/436 20140101ALI20160210BHEP

Ipc: H04N 19/00 20140101ALI20160210BHEP

Ipc: H04N 13/00 20060101ALI20160210BHEP

Ipc: H04N 19/50 20140101AFI20160210BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20170719

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602013065370

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04N0019500000

Ipc: H04N0013161000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 19/436 20140101ALI20190607BHEP

Ipc: H04N 19/43 20140101ALI20190607BHEP

Ipc: H04N 19/52 20140101ALI20190607BHEP

Ipc: H04N 19/597 20140101ALI20190607BHEP

Ipc: H04N 13/161 20180101AFI20190607BHEP

INTG Intention to grant announced

Effective date: 20190628

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAL Information related to payment of fee for publishing/printing deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

INTC Intention to grant announced (deleted)
GRAR Information related to intention to grant a patent recorded

Free format text: ORIGINAL CODE: EPIDOSNIGR71

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

INTG Intention to grant announced

Effective date: 20191212

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013065370

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1227709

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200215

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200122

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2775202

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20200724

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200614

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200422

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200422

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200522

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200423

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013065370

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1227709

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200122

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20201023

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201004

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20201031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201031

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201031

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201004

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200122

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230524

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230906

Year of fee payment: 11

Ref country code: GB

Payment date: 20230905

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230905

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20231110

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230905

Year of fee payment: 11