WO2019157717A1 - 运动补偿的方法、装置和计算机系统 - Google Patents

运动补偿的方法、装置和计算机系统 Download PDF

Info

Publication number
WO2019157717A1
WO2019157717A1 PCT/CN2018/076852 CN2018076852W WO2019157717A1 WO 2019157717 A1 WO2019157717 A1 WO 2019157717A1 CN 2018076852 W CN2018076852 W CN 2018076852W WO 2019157717 A1 WO2019157717 A1 WO 2019157717A1
Authority
WO
WIPO (PCT)
Prior art keywords
coefficient
parameter
predetermined value
image block
mapping relationship
Prior art date
Application number
PCT/CN2018/076852
Other languages
English (en)
French (fr)
Inventor
王钊
马思伟
郑萧桢
Original Assignee
北京大学
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京大学, 深圳市大疆创新科技有限公司 filed Critical 北京大学
Priority to PCT/CN2018/076852 priority Critical patent/WO2019157717A1/zh
Priority to CN201880012508.XA priority patent/CN110337811A/zh
Publication of WO2019157717A1 publication Critical patent/WO2019157717A1/zh
Priority to US16/993,243 priority patent/US11272204B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • H04N19/122—Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors

Definitions

  • the present invention relates to the field of information technology and, more particularly, to a method, apparatus and computer system for motion compensation.
  • Prediction is an important module of the video coding framework, which is realized by motion compensation.
  • a frame of image it is first divided into equal-sized Coding Tree Units (CTUs), such as 64x64, 128x128 size coding regions.
  • CTUs Coding Tree Units
  • Each CTU may be further divided into square or rectangular coded image blocks, each of which finds the most similar image block in the reference frame (typically a reconstructed frame near the time domain) as the predicted image block of the current image.
  • the relative position between the current image block and the similar image block is a motion vector (Motion Vector, MV).
  • MV Motion Vector
  • the process of finding a similar image block as a predicted value of the current image block in the reference frame is motion compensation.
  • the image block may be a coding unit (CU) or a prediction unit (PU).
  • a general motion compensation is to acquire a predicted image block from the motion vector of the image block for each image block. Based on this, an Overlapped Block Motion Compensation (OBMC) technique has appeared. That is, for the pixels of the current image block boundary portion, the motion vector of the current image block and the motion vector weighted prediction of the adjacent image block are used to obtain the predicted value.
  • OBMC Overlapped Block Motion Compensation
  • Embodiments of the present invention provide a method, apparatus, and computer system for motion compensation, which can improve performance of motion compensation.
  • a method for motion compensation comprising: determining, according to a first parameter and/or a second parameter, a weighting coefficient of a predicted value of a pixel to be processed, wherein the pixel to be processed is a boundary pixel block of a current image block a pixel in which the first parameter is a size of the current image block or a distance of the pixel to be processed to a center position of the current image block, and the second parameter is an adjacent image of the current image block a size of the block or a distance from the pixel to be processed to a center position of the adjacent image block; determining a predicted value of the pixel to be processed according to the weighting coefficient.
  • a device for motion compensation comprising: a weighting coefficient determining unit, configured to determine, according to a first parameter and/or a second parameter, a weighting coefficient of a pixel predicted value to be processed, wherein the pixel to be processed is a current image a pixel in a boundary pixel block of the block, the first parameter is a size of the current image block or a distance of the pixel to be processed to a center position of the current image block, and the second parameter is the current image a size of an adjacent image block of the block or a distance from the pixel to be processed to a center position of the adjacent image block; a predicted value determining unit configured to determine a predicted value of the pixel to be processed according to the weighting coefficient.
  • a computer system comprising: a memory for storing computer executable instructions; a processor for accessing the memory and executing the computer executable instructions to perform the method of the first aspect above The operation in .
  • a computer storage medium having stored therein program code, the program code being operative to indicate a method of performing the first aspect described above.
  • the weighting coefficient of the predicted value of the pixel in the boundary pixel block of the current image block is determined according to the influence of the current image block and/or the adjacent image block, so that the adjacent image block can be better utilized.
  • the motion vector processes the predicted value of the pixel, thereby improving the performance of motion compensation.
  • FIG. 1 is an architectural diagram of a technical solution to which an embodiment of the present invention is applied.
  • FIG. 2 is a processing architecture diagram of an encoder according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of data to be encoded according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a boundary pixel block in accordance with an embodiment of the present invention.
  • FIG. 5 is a schematic flowchart of a method of motion compensation according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of the size of a current image block and adjacent image blocks in an embodiment of the present invention.
  • Figure 7 is a schematic block diagram of an apparatus for motion compensation in accordance with an embodiment of the present invention.
  • Figure 8 is a schematic block diagram of a computer system in accordance with an embodiment of the present invention.
  • the size of the sequence numbers of the processes does not imply a sequence of executions, and the order of execution of the processes should be determined by its function and internal logic, and should not be construed as an embodiment of the present invention.
  • the implementation process constitutes any limitation.
  • FIG. 1 is an architectural diagram of a technical solution to which an embodiment of the present invention is applied.
  • system 100 can receive data to be processed 102 and process data to be processed 102 to produce processed data 108.
  • system 100 can receive data to be encoded, encode the data to be encoded to produce encoded data, or system 100 can receive the data to be decoded and decode the data to be decoded to produce decoded data.
  • components in system 100 may be implemented by one or more processors, which may be processors in a computing device or processors in a mobile device (eg, a drone).
  • the processor may be any type of processor, which is not limited in this embodiment of the present invention.
  • the processor may include an encoder or decoder or the like.
  • One or more memories may also be included in system 100.
  • the memory can be used to store instructions and data, such as computer executable instructions to implement the technical solution of the embodiments of the present invention, data to be processed 102, processed data 108, and the like.
  • the memory may be any kind of memory, which is not limited in this embodiment of the present invention.
  • the data to be encoded may include text, images, graphic objects, animation sequences, audio, video, or any other data that needs to be encoded.
  • the data to be encoded may include sensory data from sensors, which may be vision sensors (eg, cameras, infrared sensors), microphones, near field sensors (eg, ultrasonic sensors, radar), position sensors, temperature Sensors, touch sensors, etc.
  • the data to be encoded may include information from a user, such as biometric information, which may include facial features, fingerprint scans, retinal scans, voice recordings, DNA sampling, and the like.
  • Encoding is necessary for efficient and/or secure transmission or storage of data.
  • the encoding of the encoded data may include data compression, encryption, error correction coding, format conversion, and the like.
  • compression of multimedia data such as video or audio
  • Sensitive data such as financial information and personally identifiable information, can be encrypted to protect confidentiality and/or privacy prior to transmission and storage. In order to reduce the bandwidth occupied by video storage and transmission, it is necessary to encode and compress the video data.
  • Any suitable coding technique can be used to encode the data to be encoded.
  • the type of encoding depends on the data being encoded and the specific coding requirements.
  • the encoder can implement one or more different codecs.
  • Each codec may include code, instructions or a computer program that implements different encoding algorithms. Based on various factors, including the type and/or source of the data to be encoded, the receiving entity of the encoded data, the available computing resources, the network environment, the business environment, the rules and standards, etc., a suitable encoding algorithm can be selected to encode the given Data to be encoded.
  • the encoder can be configured to encode a series of video frames. Encoding the data in each frame can take a series of steps.
  • the encoding step can include processing steps such as prediction, transform, quantization, entropy encoding, and the like.
  • the prediction includes two types of intra prediction and inter prediction, and the purpose is to use the prediction block information to remove redundant information of the current image block to be encoded.
  • Intra prediction uses the information of the current frame image to obtain prediction block data.
  • Inter prediction uses the information of the reference frame to obtain prediction block data, the process comprising dividing the image block to be encoded into a plurality of sub image blocks; and then, for each sub image block, searching the reference image for the image that best matches the current sub image block.
  • the block is used as a prediction block; thereafter, the sub-image block is subtracted from the corresponding pixel value of the prediction block to obtain a residual, and the obtained residuals of the respective sub-image blocks are combined to obtain a residual of the image block.
  • Transforming the residual block of the image using the transformation matrix can remove the correlation of the residual of the image block, that is, remove the redundant information of the image block, so as to improve the coding efficiency
  • the transformation of the data block in the image block usually adopts a two-dimensional transformation. That is, the residual information of the data block is multiplied by an NxM transform matrix and its transposed matrix at the encoding end, and the transform coefficients are obtained after multiplication.
  • the transform coefficients are quantized to obtain quantized coefficients, and finally the quantized coefficients are entropy encoded, and finally the entropy-encoded bit stream and the encoded coding mode information, such as intra prediction mode and motion vector information, are performed.
  • the decoder Store or send to the decoder.
  • the entropy-encoded bit stream is first obtained and entropy decoded to obtain a corresponding residual, according to the predicted image block corresponding to the information image block such as the motion vector or the intra prediction obtained by decoding, according to the predicted image block and the image block.
  • the residual is obtained by the value of each pixel in the current sub-image block.
  • FIG. 2 is a block diagram showing the processing architecture of an encoder according to an embodiment of the present invention.
  • the prediction process may include intra prediction and inter prediction.
  • a residual corresponding to the data unit for example, a pixel point
  • the pixel obtained by reconstructing the reference pixel point can be obtained from the stored context, according to the reference pixel point.
  • the pixel obtained after the reconstruction and the pixel of the pixel point obtain the pixel residual corresponding to the pixel point.
  • the pixel residual is subjected to entropy coding by transforming and quantization.
  • the control of the quantization rate can be achieved by controlling the quantization parameter.
  • the quantized pixel residual corresponding to a certain pixel point may also be subjected to inverse quantization inverse transform processing, and then reconstructed to obtain a pixel reconstructed by the pixel, and the reconstructed pixel of the pixel is stored, so that When the pixel is used as the reference pixel, the pixel reconstructed by the pixel acquires the pixel residual corresponding to the other pixel.
  • the quantization parameter may include a quantization step size indicating a quantization step size or a value related to the quantization step size, for example, a quantization parameter (QP) in an H.264, H.265, or similar encoder, or a quantization matrix. Or its reference matrix, etc.
  • QP quantization parameter
  • an operation corresponding to the encoding end is performed to decode the encoded data to obtain original data, that is, data to be encoded.
  • FIG. 3 shows a schematic diagram of data to be encoded in an embodiment of the present invention.
  • the data 302 to be encoded may include a plurality of frames 304.
  • multiple frames 304 may represent consecutive image frames in a video stream.
  • Each frame 304 can include one or more stripes or tiles 306.
  • Each strip or tile 306 may include one or more macroblocks or encoding units 308.
  • Each macroblock or coding unit 308 can include one or more blocks 310.
  • Each block 310 can include one or more pixels 312.
  • Each pixel 312 can include one or more data sets corresponding to one or more data portions, such as a luminance data portion and a chrominance data portion.
  • the data unit can be a frame, a stripe, a tile, a coding unit, a macroblock, a block, a pixel, or a group of any of the above.
  • the size of the data unit can vary.
  • one frame 304 may include 100 strips 306, each strip 306 may include 10 macroblocks 308, each macroblock 308 may include 4 (eg, 2x2) blocks 310, each block 310 may include 64 (eg, 8x8) pixels 312.
  • the technical solution of the embodiment of the present invention may be used for motion compensation of pixels in a boundary pixel block of an image block in a prediction process of encoding or decoding.
  • the existing OBMC technique is to divide the current coded image block into individual 4x4 pixel blocks.
  • the existing OBMC is also divided into two types: normal mode and sub-block mode: when the current image block has only one motion vector (for example, normal inter prediction, normal merge mode), OBMC uses normal mode; current image
  • Each 4x4 pixel block of a block has its own motion vector (eg, sub-block merge mode, affine mode and decoder-side motion vector derivation mode), and OBMC also uses sub-block mode.
  • the existing OBMC technology is shown in Figure 4.
  • the normal OBMC mode processes the boundary 4x4 pixel block of the current block, and the predicted value of the 4 row/column pixel of each 4x4 boundary pixel block is changed according to the motion vector of the adjacent 4x4 pixel block.
  • the sub-block OBMC mode processes each 4x4 pixel block of the current image block, and the predicted value of the 2 row/column pixels of each 4x4 block is changed according to the motion vector of the adjacent 4x4 pixel block.
  • the predicted value after the change is obtained by:
  • P cur and P ner represent the predicted values obtained from the motion vector of the current 4 ⁇ 4 block (the motion vector of the current image block) and the motion vector of the adjacent 4 ⁇ 4 block (the motion vector of the adjacent image block), respectively, and a and b correspond to each other.
  • the weighting factor, the sum of a and b is 1.
  • P is the final predicted value.
  • Existing OBMC techniques use fixed weighting coefficients. For example, a and b can take the following values:
  • the second line 7/8, 1/8;
  • the fourth line 31/32, 1/32.
  • the use of fixed weighting coefficients neglects the effect of image block size and limits the improvement of coding efficiency. For example, if the current image block is relatively small, the motion vector of the current image block correspondingly accurately describes the real motion of the current image block, and the motion compensation coefficient of the motion vector of the adjacent image block to the boundary pixel of the current image block should be reduced; Conversely, when the current image block is relatively large, the real motion of the boundary pixel may not be accurately described by the motion vector of the current image block. In this case, the motion compensation coefficient of the motion vector of the adjacent image block to the boundary pixel may be increased.
  • embodiments of the present invention provide a method for motion compensation, which considers the influence of image block size to improve the performance of motion compensation.
  • FIG. 5 shows a schematic flow chart of a method 500 of motion compensation in accordance with an embodiment of the present invention.
  • the method 500 can be performed by the system 100 shown in FIG.
  • 510 Determine a weighting coefficient of a pixel prediction value to be processed according to the first parameter and/or the second parameter, where the pixel to be processed is a pixel in a boundary pixel block of a current image block, and the first parameter is the current parameter. a size of the image block or a distance from the pixel to be processed to a center position of the current image block, the second parameter being a size of an adjacent image block of the current image block or the pixel to be processed to the phase The distance from the center of the adjacent image block.
  • the center position of the image block can be the geometric center of the image block.
  • the pixel coordinates in the upper left corner of the image block are (0, 0)
  • the pixel coordinates in the lower right corner are (w, h)
  • the center position is (w/2, h/2).
  • the fixed weighting coefficient is no longer used, and the size of the weighting coefficient is adaptively adjusted in consideration of the influence of the image block size.
  • the size of the current image block or the distance of the pixel to be processed to the center position of the current image block may be considered, and/or the size of the adjacent image block or the pixel to be processed to the adjacent image block.
  • the distance of the center position ie the second parameter).
  • the size of the current image block is a height of the current image block
  • the size of the adjacent image block is the The height of the adjacent image block
  • the size of the current image block is the width of the current image block
  • the size of the adjacent image block Is the width of the adjacent image block.
  • the weighting coefficient may include a first coefficient and a second coefficient, the first coefficient is used to weight a first predicted value of the pixel to be processed determined according to a motion vector of the current image block (ie, a formula (1) a), the second coefficient is used to weight a second predicted value of the pixel to be processed determined according to a motion vector of the adjacent image block (ie, b in the formula (1)).
  • the first coefficient or the second coefficient may be determined according to the first parameter and a first mapping relationship, where the first mapping relationship is a preset An inverse mapping relationship between the first parameter and the first coefficient, and an inverse mapping relationship between the first parameter and the first coefficient indicates that the first coefficient increases with the first parameter Decrease, or the first mapping relationship is a forward mapping relationship between the first parameter and the second coefficient, and a forward mapping relationship between the first parameter and the second coefficient indicates The second coefficient increases as the first parameter increases.
  • the forward mapping relationship of the variable x and the variable y indicates that y increases as x increases, and y decreases as x decreases; accordingly, the inverse mapping of x and y The relationship indicates that y decreases with the increase of x, and y increases with the decrease of x.
  • the specific functional relationship adopted by the forward mapping relationship or the reverse mapping relationship is not limited in the embodiment of the present invention.
  • the first parameter is inversely mapped to the first coefficient, or the first parameter and the second coefficient are in a forward mapping relationship. That is to say, the first coefficient decreases as the first parameter increases, decreases and increases; or, the second coefficient increases as the first parameter increases, decreases and decreases.
  • the first parameter as the size of the current image block as an example (the first parameter is similar to the distance of the pixel to be processed to the center position of the current image block)
  • the first coefficient can adopt a smaller value (for example, a value smaller than the value of a currently fixed a)
  • the second coefficient can adopt a larger value (for example, a value smaller than the current fixed b).
  • the first coefficient can take a larger value (for example, a value larger than the value of a currently fixed a),
  • the two coefficients can take a smaller value (for example, a value smaller than the value of b which is currently fixed).
  • the first parameter is between the first threshold and the second threshold, determining that the first coefficient is a first predetermined value, and/or the second The coefficient is a second predetermined value, wherein the first threshold is greater than the second threshold; or
  • the first parameter is greater than the first threshold, determining that the first coefficient is a third predetermined value, and/or the second coefficient is a fourth predetermined value, wherein the third predetermined value is less than The first predetermined value, the fourth predetermined value is greater than the second predetermined value; or
  • the first parameter is less than the second threshold, determining that the first coefficient is a fifth predetermined value, and/or the second coefficient is a sixth predetermined value, wherein the fifth predetermined value is greater than The first predetermined value, the sixth predetermined value is less than the second predetermined value.
  • first coefficients and second coefficients are used for different ranges in which the first parameter is located.
  • the first coefficient and the second coefficient may respectively adopt a predetermined value of the intermediate value, for example, the current fixed a may be used respectively.
  • the first coefficient when the first parameter is greater than the first threshold, the first coefficient may adopt a smaller predetermined value, for example, a value smaller than the value of the currently fixed a may be used, and the second coefficient may be a larger predetermined
  • the value for example, may be a value larger than the value of the currently fixed b; when the first parameter is smaller than the second threshold, the first coefficient may adopt a larger predetermined value, for example, a value of a fixed than the current value may be adopted.
  • the second coefficient may take a smaller predetermined value, for example, a value smaller than the value of b that is currently fixed may be employed.
  • the first threshold may be 64 and the second threshold may be 8.
  • the OBMC coefficient a of the first row of pixels can be reduced from the original 3/4 to 2/. 3
  • the coefficient b is increased from 1/4 of the original to 1/3; if the height of the current image block is less than or equal to 8, the OBMC coefficient a of the first row of pixels can be increased from the original 3/4 to 4/5.
  • the coefficient b is reduced from 1/4 of the original to 1/5.
  • the motion vector of the image block can also be better.
  • the weighting coefficient a may be appropriately reduced on the original coefficient value, and the weighting coefficient b may be increased; otherwise, when the current image block is relatively small, the weighting coefficient a may be moderately increased on the original coefficient value, and decreased. Weighting factor b. In this way, the weighting coefficient used can better reflect the real motion vector of the boundary pixel, thereby improving the performance of motion compensation.
  • the threshold in the present invention may be used as a preset value of the encoding end and the decoding end, or the threshold information may be written into the code stream at the encoding end, and the decoding end obtains the threshold information from the code stream.
  • the encoding end it can be written in the video parameter set (VPS, video parameter set), sequence parameter set (SPS, sequence parameter set), picture parameter set (PPS, picture parameter set), sequence header, image header, strip header, etc.
  • VPS video parameter set
  • SPS sequence parameter set
  • PPS picture parameter set
  • sequence header image header
  • strip header etc.
  • the first coefficient or the second coefficient may be determined according to the second parameter and the second mapping relationship, where the second mapping relationship is a preset a forward mapping relationship between the second parameter and the first coefficient, and a forward mapping relationship between the second parameter and the first coefficient indicates that the first coefficient increases with the second parameter Increase, or the second mapping relationship is a reverse mapping relationship between the second parameter and the second coefficient, and the reverse mapping relationship between the second parameter and the second coefficient indicates The second coefficient decreases as the second parameter increases.
  • the second parameter is in a forward mapping relationship with the first coefficient, or the second parameter and the second coefficient are in a reverse mapping relationship. That is to say, the first coefficient increases as the second parameter increases, decreases and decreases; or, the second coefficient decreases as the second parameter increases, decreases and increases.
  • the second parameter as the size of the adjacent image block as an example (the second parameter is similar to the distance of the pixel to be processed to the center position of the adjacent image block)
  • the first coefficient may adopt a larger value (for example, a value larger than the value of a currently fixed a), and the second coefficient may adopt a smaller value (for example, using a fixed b than the current one)
  • the size of the adjacent image block is small (for example, greater than the preset threshold)
  • the first coefficient can take a smaller value (for example, using a smaller value than the currently fixed a) Value)
  • the second coefficient can take a larger value (such as using a value larger than the current fixed b value).
  • the threshold in the present invention may be used as a preset value of the encoding end and the decoding end, or the threshold information may be written into the code stream at the encoding end, and the decoding end obtains the threshold information from the code stream.
  • the encoding end it can be written in the video parameter set (VPS, video parameter set), sequence parameter set (SPS, sequence parameter set), picture parameter set (PPS, picture parameter set), sequence header, image header, strip header, etc.
  • VPS video parameter set
  • SPS sequence parameter set
  • PPS picture parameter set
  • sequence header image header
  • strip header etc.
  • the second parameter is between the first threshold and the second threshold, determining that the first coefficient is a first predetermined value, and/or the second The coefficient is a second predetermined value, wherein the first threshold is greater than the second threshold;
  • the second parameter is greater than the first threshold, determining that the first coefficient is a fifth predetermined value, and/or the second coefficient is a sixth predetermined value, wherein the fifth predetermined value is greater than The first predetermined value, the sixth predetermined value is smaller than the second predetermined value; or
  • the second parameter is less than the second threshold, determining that the first coefficient is a third predetermined value, and/or the second coefficient is a fourth predetermined value, wherein the third predetermined value is less than The first predetermined value, the fourth predetermined value is greater than the second predetermined value.
  • first coefficients and second coefficients are used for different ranges in which the second parameter is located.
  • the first coefficient and the second coefficient may respectively adopt a predetermined value of the intermediate value, for example, the current fixed a may be used respectively.
  • the first coefficient when the second parameter is less than the second threshold, the first coefficient may adopt a smaller predetermined value, for example, a value smaller than the value of the currently fixed a may be used, and the second coefficient may be a larger predetermined
  • the value for example, may be a value larger than the value of the currently fixed b; when the second parameter is greater than the first threshold, the first coefficient may adopt a larger predetermined value, for example, a value of a fixed than the current value may be adopted.
  • the second coefficient may take a smaller predetermined value, for example, a value smaller than the value of b that is currently fixed may be employed.
  • the motion vector of the adjacent image block is also It can better represent the motion of the boundary pixels of the current image block. Therefore, when the adjacent image blocks are relatively small, the weighting coefficient a may be appropriately reduced on the original coefficient value, and the weighting coefficient b may be increased; otherwise, when the adjacent image blocks are relatively large, the weighting coefficient a may be moderately increased on the original coefficient value. Reduce the weighting factor b. In this way, the weighting coefficient used can better reflect the real motion vector of the boundary pixel, thereby improving the performance of motion compensation.
  • the threshold in the present invention may be used as a preset value of the encoding end and the decoding end, or the threshold information may be written into the code stream at the encoding end, and the decoding end obtains the threshold information from the code stream.
  • the encoding end it can be written in the video parameter set (VPS, video parameter set), sequence parameter set (SPS, sequence parameter set), picture parameter set (PPS, picture parameter set), sequence header, image header, strip header, etc.
  • VPS video parameter set
  • SPS sequence parameter set
  • PPS picture parameter set
  • sequence header image header
  • strip header etc.
  • the weighting coefficient may be determined according to a ratio of the first parameter to the second parameter.
  • the adjustment of the weighting coefficients only considers the influence of one of the first parameter and the second parameter, that is, only one factor in the current image block and the adjacent image block is considered.
  • the effects of the two parameters of the first parameter and the second parameter are considered simultaneously, that is, the two factors of the current image block and the adjacent image block are jointly considered.
  • the weighting coefficient may be adjusted according to a ratio of the first parameter to the second parameter, and different weighting coefficients may be used for different ratios.
  • the first coefficient or the second coefficient may be determined according to a ratio of the first parameter to the second parameter, and a third mapping relationship, where
  • the third mapping relationship is a reverse mapping relationship between the ratio and the first coefficient, and the inverse mapping relationship between the ratio and the first coefficient indicates that the first coefficient increases with the ratio.
  • Larger and smaller, or the third mapping relationship is a forward mapping relationship between the preset ratio and the second coefficient, and a forward mapping relationship between the ratio and the second coefficient indicates the first mapping
  • the two coefficients increase as the ratio increases.
  • the ratio of the first parameter to the second parameter is inversely mapped to the first coefficient, or the ratio is positively mapped to the second coefficient. That is to say, the first coefficient decreases as the ratio increases, decreases and increases; or, the second coefficient increases as the ratio increases, decreases and decreases.
  • the first coefficient may adopt a smaller value (for example, a value smaller than the value of a currently fixed a), and the second coefficient may adopt a larger value (for example, using a fixed ratio than the current one)
  • the value of b is a large value
  • the first coefficient can take a larger value (for example, a value larger than the value of a currently fixed a), and the second coefficient can be smaller. Value (such as a value smaller than the value of b that is currently fixed).
  • the second coefficient b can be determined according to the following formula:
  • h c represents the first parameter
  • h n represents the second parameter
  • the maximum value of log 2 h n /h c can be taken as max ⁇ log 2 H n /H c ⁇
  • b org represents the currently fixed second coefficient
  • the value space of h n /h c may also be different.
  • the image block size can vary from 4x4 to 128x128, and the value space of h n /h c is ⁇ 1/32, 1/16, 1/8, 1/4, 1/2, 1 , 2, 4, 8, 16, 32 ⁇ .
  • the logarithm of h n /h c is taken, and the value space of log 2 h n /h c is ⁇ -5,-4,-3,-2,-1,0,1,2,3,4,5 ⁇ . It can be obtained from equations (2) and (3), and the adjusted b is in the range of (b org /2, 2b org ).
  • the first coefficient a can be obtained according to the sum of a and b.
  • the values of a and/or b may be pre-calculated according to the above calculation formula and the values of h c and h n , or a and/or b are integers. Approximate values after the transformation.
  • the lookup table is pre-set in the encoding and decoding system, and the corresponding values are obtained by looking up the table according to h c and h n .
  • the weighting coefficient b of the first row/column pixel of the boundary pixel block the following table can be used:
  • the weighting coefficient is used to determine the predicted value of the pixel to be processed.
  • a first predicted value of the pixel to be processed may be determined according to a motion vector of the current image block; and a second predicted value of the pixel to be processed is determined according to a motion vector of the adjacent image block; And weighting the first predicted value and the second predicted value according to the weighting coefficient to obtain a predicted value of the pixel to be processed.
  • the corresponding similar block may be determined according to the motion vector of the current image block, and the value of the corresponding pixel of the pixel in the similar block is the first predicted value P cur ;
  • the second predicted value P ner can be obtained according to the motion vector of the adjacent image block; and the weighting coefficients a and b are obtained by the foregoing manner, and the predicted value P of the pixel is obtained according to the formula (1).
  • the encoding end may perform encoding based on the predicted value, and for the decoding end, decoding may be performed based on the predicted value.
  • the weighting coefficient of the predicted value of the pixel in the boundary pixel block of the current image block is determined according to the influence of the current image block and/or the adjacent image block, so that the adjacent image block can be better utilized.
  • the motion vector processes the predicted value of the pixel, thereby improving the performance of motion compensation.
  • the encoding end and the decoding end use the same method to determine the weighting coefficient, so the weighting coefficient does not need to be written into the code stream, so that no additional overhead is incurred.
  • FIG. 7 shows a schematic block diagram of a motion compensated device 700 in accordance with an embodiment of the present invention.
  • the apparatus 700 can perform the method of motion compensation of the embodiments of the present invention described above.
  • the apparatus 700 can include:
  • the weighting coefficient determining unit 710 is configured to determine, according to the first parameter and/or the second parameter, a weighting coefficient of the pixel prediction value to be processed, where the pixel to be processed is a pixel in a boundary pixel block of the current image block, where the a parameter is a size of the current image block or a distance of the pixel to be processed to a center position of the current image block, and the second parameter is a size of the adjacent image block of the current image block or the Processing a distance from a pixel to a center position of the adjacent image block;
  • the predicted value determining unit 720 is configured to determine a predicted value of the pixel to be processed according to the weighting coefficient.
  • the predicted value determining unit 720 is specifically configured to:
  • the predicted value weighting coefficient includes a first coefficient and a second a coefficient, the first coefficient is used to weight the first predicted value, and the second coefficient is used to weight the second predicted value.
  • the weighting coefficient determining unit 710 is configured to:
  • the reverse mapping relationship between the first parameter and the first coefficient indicates that the first coefficient decreases as the first parameter increases, or the first mapping relationship is a pre- a forward mapping relationship between the first parameter and the second coefficient, and a forward mapping relationship between the first parameter and the second coefficient indicates that the second coefficient increases with the first parameter And increase.
  • the weighting coefficient determining unit 710 is configured to:
  • the first parameter is between the first threshold and the second threshold, determining that the first coefficient is a first predetermined value, and/or the second coefficient is a second predetermined value, wherein the a threshold greater than the second threshold; or
  • the first parameter is greater than the first threshold, determining that the first coefficient is a third predetermined value, and/or the second coefficient is a fourth predetermined value, wherein the third predetermined value is less than The first predetermined value, the fourth predetermined value is greater than the second predetermined value; or
  • the first parameter is less than the second threshold, determining that the first coefficient is a fifth predetermined value, and/or the second coefficient is a sixth predetermined value, wherein the fifth predetermined value is greater than The first predetermined value, the sixth predetermined value is less than the second predetermined value.
  • the threshold in the present invention may be used as a preset value of the encoding end and the decoding end, or the threshold information may be written into the code stream at the encoding end, and the decoding end obtains the threshold information from the code stream.
  • the encoding end it can be written in the video parameter set (VPS, video parameter set), sequence parameter set (SPS, sequence parameter set), picture parameter set (PPS, picture parameter set), sequence header, image header, strip header, etc.
  • VPS video parameter set
  • SPS sequence parameter set
  • PPS picture parameter set
  • sequence header image header
  • strip header etc.
  • the weighting coefficient determining unit 710 is configured to:
  • the forward mapping relationship between the second parameter and the first coefficient indicates that the first coefficient increases as the second parameter increases, or the second mapping relationship is a pre- a reverse mapping relationship between the second parameter and the second coefficient, and an inverse mapping relationship between the second parameter and the second coefficient indicates an increase of the second coefficient with the second parameter And decrease.
  • the weighting coefficient determining unit 710 is configured to:
  • the second parameter is between the first threshold and the second threshold, determining that the first coefficient is a first predetermined value, and/or the second coefficient is a second predetermined value, wherein the a threshold greater than the second threshold;
  • the second parameter is greater than the first threshold, determining that the first coefficient is a fifth predetermined value, and/or the second coefficient is a sixth predetermined value, wherein the fifth predetermined value is greater than The first predetermined value, the sixth predetermined value is smaller than the second predetermined value; or
  • the second parameter is less than the second threshold, determining that the first coefficient is a third predetermined value, and/or the second coefficient is a fourth predetermined value, wherein the third predetermined value is less than The first predetermined value, the fourth predetermined value is greater than the second predetermined value.
  • the threshold in the present invention may be used as a preset value of the encoding end and the decoding end, or the threshold information may be written into the code stream at the encoding end, and the decoding end obtains the threshold information from the code stream.
  • the encoding end it can be written in the video parameter set (VPS, video parameter set), sequence parameter set (SPS, sequence parameter set), picture parameter set (PPS, picture parameter set), sequence header, image header, strip header, etc.
  • VPS video parameter set
  • SPS sequence parameter set
  • PPS picture parameter set
  • sequence header image header
  • strip header etc.
  • the weighting coefficient determining unit 710 is configured to:
  • the weighting coefficient determining unit 710 is configured to:
  • the third mapping relationship is a preset ratio and The inverse mapping relationship of the first coefficient, the inverse mapping relationship between the ratio and the first coefficient indicates that the first coefficient decreases as the ratio increases, or the third mapping relationship
  • a forward mapping relationship between the ratio and the second coefficient indicates that the second coefficient increases as the ratio increases.
  • the size of the current image block is a height of the current image block
  • the phase The size of the adjacent image block is the height of the adjacent image block
  • the size of the current image block is the width of the current image block
  • the size of the adjacent image block is the adjacent image block. The width.
  • the apparatus for motion compensation may be a chip, which may be specifically implemented by a circuit, but the specific implementation manner of the embodiment of the present invention is not limited.
  • the embodiment of the invention further provides an encoder comprising the motion compensation device of the embodiment of the invention described above.
  • the embodiment of the invention further provides a decoder, which comprises the motion compensation device of the embodiment of the invention described above.
  • FIG. 8 shows a schematic block diagram of a computer system 800 in accordance with an embodiment of the present invention.
  • the computer system 800 can include a processor 810 and a memory 820.
  • computer system 800 may also include components that are generally included in other computer systems, such as input and output devices, communication interfaces, and the like, which are not limited by the embodiments of the present invention.
  • Memory 820 is for storing computer executable instructions.
  • the memory 820 may be various kinds of memories, for example, may include a high speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk memory, which is implemented by the present invention. This example is not limited to this.
  • RAM high speed random access memory
  • non-volatile memory such as at least one disk memory
  • the processor 810 is configured to access the memory 820 and execute the computer executable instructions to perform the operations in the motion compensation method of the embodiment of the present invention described above.
  • the processor 810 can include a microprocessor, a field-programmable gate array (FPGA), a central processing unit (CPU), a graphics processing unit (GPU), etc., and is implemented by the present invention. This example is not limited to this.
  • the motion compensated apparatus and computer system of an embodiment of the present invention may correspond to an execution subject of the motion compensation method of the embodiment of the present invention, and the above and other operations and/or functions of the motion compensation apparatus and each module in the computer system respectively
  • the above and other operations and/or functions of the motion compensation apparatus and each module in the computer system respectively
  • no further details are provided herein.
  • Embodiments of the present invention also provide an electronic device that can include the motion compensated device or computer system of the various embodiments of the present invention described above.
  • the embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores program code, and the program code can be used to indicate a method for performing motion compensation according to the embodiment of the invention.
  • the term "and/or” is merely an association relationship describing an associated object, indicating that there may be three relationships.
  • a and/or B may indicate that A exists separately, and A and B exist simultaneously, and B cases exist alone.
  • the character "/" in this article generally indicates that the contextual object is an "or" relationship.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, or an electrical, mechanical or other form of connection.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Discrete Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

公开了一种运动补偿的方法、装置和计算机系统。该方法包括：根据第一参数和/或第二参数，确定待处理像素预测值的加权系数，其中所述待处理像素为当前图像块的边界像素块中的像素，所述第一参数为所述当前图像块的大小或所述待处理像素到所述当前图像块的中心位置的距离，所述第二参数为所述当前图像块的相邻图像块的大小或所述待处理像素到所述相邻图像块的中心位置的距离；根据所述加权系数确定所述待处理像素的预测值。本发明实施例的技术方案，能够提高运动补偿的性能。

Description

运动补偿的方法、装置和计算机系统
版权申明
本专利文件披露的内容包含受版权保护的材料。该版权为版权所有人所有。版权所有人不反对任何人复制专利与商标局的官方记录和档案中所存在的该专利文件或者该专利披露。
技术领域
本发明涉及信息技术领域，并且更具体地，涉及一种运动补偿的方法、装置和计算机系统。
背景技术
预测是视频编码框架的重要模块，通过运动补偿的方式来实现。对于一帧图像，先分成等大的编码区域(Coding Tree Unit,CTU)，例如64x64、128x128大小的编码区域。每个CTU可以进一步划分成方形或矩形的编码图像块，每个图像块在参考帧中(一般为时域附近的已重构帧)寻找最相似图像块作为当前编像的预测图像块。当前图像块与相似图像块之间的相对位置为运动矢量(Motion Vector,MV)。在参考帧中寻找相似图像块作为当前图像块的预测值的过程就是运动补偿。一般来说，所述的图像块可以为编码单元(Coding Unit，CU)或预测单元(Prediction Unit，PU)。
一般的运动补偿是对于每个图像块根据该图像块的运动矢量获取预测图像块。基于此，出现了重叠块运动补偿(Overlapped Block Motion Compensation,OBMC)技术。即对于当前图像块边界部分的像素，使用当前图像块的运动矢量和相邻图像块的运动矢量加权预测得到预测值。
然而，现有的OBMC技术使用固定的加权系数，限制了OBMC的性能。因此，需要一种改进的运动补偿的方法，以提高运动补偿的性能。
发明内容
本发明实施例提供了一种运动补偿的方法、装置和计算机系统，能够提高运动补偿的性能。
第一方面，提供了一种运动补偿的方法，包括：根据第一参数和/或第 二参数，确定待处理像素预测值的加权系数，其中所述待处理像素为当前图像块的边界像素块中的像素，所述第一参数为所述当前图像块的大小或所述待处理像素到所述当前图像块的中心位置的距离，所述第二参数为所述当前图像块的相邻图像块的大小或所述待处理像素到所述相邻图像块的中心位置的距离；根据所述加权系数确定所述待处理像素的预测值。
第二方面，提供了运动补偿的装置，包括：加权系数确定单元，用于根据第一参数和/或第二参数，确定待处理像素预测值的加权系数，其中所述待处理像素为当前图像块的边界像素块中的像素，所述第一参数为所述当前图像块的大小或所述待处理像素到所述当前图像块的中心位置的距离，所述第二参数为所述当前图像块的相邻图像块的大小或所述待处理像素到所述相邻图像块的中心位置的距离；预测值确定单元，用于根据所述加权系数确定所述待处理像素的预测值。
第三方面，提供了一种计算机系统，包括：存储器，用于存储计算机可执行指令；处理器，用于访问所述存储器，并执行所述计算机可执行指令，以进行上述第一方面的方法中的操作。
第四方面，提供了一种计算机存储介质，该计算机存储介质中存储有程序代码，该程序代码可以用于指示执行上述第一方面的方法。
本发明实施例的技术方案，根据当前图像块和/或相邻图像块的影响，确定当前图像块的边界像素块中的像素的预测值的加权系数，能够更好地利用相邻图像块的运动矢量对该像素的预测值进行处理，从而能够提高运动补偿的性能。
附图说明
图1是应用本发明实施例的技术方案的架构图。
图2是本发明实施例的编码器的处理架构图。
图3是本发明实施例的待编码数据的示意图。
图4是本发明实施例的边界像素块的示意图。
图5是本发明实施例的运动补偿的方法的示意性流程图。
图6是本发明实施例的当前图像块和相邻图像块的大小的示意图。
图7是本发明实施例的运动补偿的装置的示意性框图。
图8是本发明实施例的计算机系统的示意性框图。
具体实施方式
下面将结合附图，对本发明实施例中的技术方案进行描述。
应理解，本文中的具体的例子只是为了帮助本领域技术人员更好地理解本发明实施例，而非限制本发明实施例的范围。
还应理解，本发明实施例中的公式只是一种示例，而非限制本发明实施例的范围，各公式可以进行变形，这些变形也应属于本发明保护的范围。
还应理解，在本发明的各种实施例中，各过程的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本发明实施例的实施过程构成任何限定。
还应理解，本说明书中描述的各种实施方式，既可以单独实施，也可以组合实施，本发明实施例对此并不限定。
除非另有说明，本发明实施例所使用的所有技术和科学术语与本发明的技术领域的技术人员通常理解的含义相同。本申请中所使用的术语只是为了描述具体的实施例的目的，不是旨在限制本申请的范围。本申请所使用的术语“和/或”包括一个或多个相关的所列项的任意的和所有的组合。
图1是应用本发明实施例的技术方案的架构图。
如图1所示，系统100可以接收待处理数据102，对待处理数据102进行处理，产生处理后数据108。例如，系统100可以接收待编码数据，对待编码数据进行编码以产生编码后的数据，或者，系统100可以接收待解码数据，对待解码数据进行解码以产生解码后的数据。在一些实施例中，系统100中的部件可以由一个或多个处理器实现，该处理器可以是计算设备中的处理器，也可以是移动设备(例如无人机)中的处理器。该处理器可以为任意种类的处理器，本发明实施例对此不做限定。在一些可能的设计中，该处理器可以包括编码器或解码器等。系统100中还可以包括一个或多个存储器。该存储器可用于存储指令和数据，例如，实现本发明实施例的技术方案的计算机可执行指令，待处理数据102、处理后数据108等。该存储器可以为任意种类的存储器，本发明实施例对此也不做限定。
待编码数据可以包括文本，图像，图形对象，动画序列，音频，视频，或者任何需要编码的其他数据。在一些情况下，待编码数据可以包括来自传感器的传感数据，该传感器可以为视觉传感器(例如，相机、红外传感器)， 麦克风，近场传感器(例如，超声波传感器、雷达)，位置传感器，温度传感器，触摸传感器等。在一些情况下，待编码数据可以包括来自用户的信息，例如，生物信息，该生物信息可以包括面部特征，指纹扫描，视网膜扫描，嗓音记录，DNA采样等。
编码对于高效和/或安全的传输或存储数据是必需的。对待编码数据的编码可以包括数据压缩，加密，纠错编码，格式转换等。例如，对多媒体数据(例如视频或音频)压缩可以减少在网络中传输的比特数量。敏感数据，例如金融信息和个人标识信息，在传输和存储前可以加密以保护机密和/或隐私。为了减少视频存储和传输所占用的带宽，需要对视频数据进行编码压缩处理。
任何合适的编码技术都可以用于编码待编码数据。编码类型依赖于被编码的数据和具体的编码需求。
在一些实施例中，编码器可以实现一种或多种不同的编解码器。每种编解码器可以包括实现不同编码算法的代码，指令或计算机程序。基于各种因素，包括待编码数据的类型和/或来源，编码数据的接收实体，可用的计算资源，网络环境，商业环境，规则和标准等，可以选择一种合适的编码算法编码给定的待编码数据。
例如，编码器可以被配置为编码一系列视频帧。编码每个帧中的数据可以采用一系列步骤。在一些实施例中，编码步骤可以包括预测、变换、量化、熵编码等处理步骤。
预测包括帧内预测和帧间预测两种类型，其目的在于利用预测块信息去除当前待编码图像块的冗余信息。帧内预测利用本帧图像的信息获得预测块数据。帧间预测利用参考帧的信息获得预测块数据，其过程包括将待编码图像块划分成若干个子图像块；然后，针对每个子图像块，在参考图像中搜索与当前子图像块最匹配的图像块作为预测块；其后，将该子图像块与预测块的相应像素值相减得到残差，并将得到的各子图像块对应的残差组合在一起，得到图像块的残差。
使用变换矩阵对图像的残差块进行变换可以去除图像块的残差的相关性，即去除图像块的冗余信息，以便提高编码效率，图像块中的数据块的变换通常采用二维变换，即在编码端将数据块的残差信息分别与一个NxM的变换矩阵及其转置矩阵相乘，相乘之后得到的是变换系数。变换系数经量 化可得到量化后的系数，最后将量化后的系数进行熵编码，最后将熵编码得到的比特流及进行编码后的编码模式信息，如帧内预测模式、运动矢量信息等，进行存储或发送到解码端。在图像的解码端，首先获得熵编码比特流后进行熵解码，得到相应的残差，根据解码得到的运动矢量或帧内预测等信息图像块对应的预测图像块，根据预测图像块与图像块的残差得到当前子图像块中各像素点的值。
图2示出了本发明实施例的编码器的处理架构图。如图2所示，预测处理可以包括帧内预测和帧间预测。通过预测处理，可以得到数据单元(例如像素点)对应的残差，其中，在对某一像素点进行预测时，可以从存储的上下文中获取参考像素点重建后得到的像素，按照参考像素点重建后得到的像素与该像素点的像素，得到该像素点对应的像素残差。像素残差通过变换、量化后再进行熵编码。在量化处理时，可以通过对量化参数的控制，实现对码率的控制。对某一像素点对应的量化处理后的像素残差还可以进行反量化反变换处理，再进行重建处理，得到该像素点重建后的像素，并将该像素点重建后的像素进行存储，以便于在该像素点作为参考像素点时，利用该像素点重建后的像素获取其他像素点对应的像素残差。
量化参数可以包括量化步长，表示量化步长或者与量化步长相关的值，例如，H.264、H.265或者类似的编码器中的量化参数(Quantization Parameter，QP)，或者，量化矩阵或其参考矩阵等。
对于解码端，则进行与编码端相对应的操作，以对编码后数据解码，得到原始数据，即待编码数据。
图3示出了本发明实施例的待编码数据的示意图。
如图3所示，待编码数据302可以包括多个帧304。例如，多个帧304可以表示视频流中的连续的图像帧。每个帧304可以包括一个或多个条带或贴砖(tile)306。每个条带或tile306可以包括一个或多个宏块或编码单元308。每个宏块或编码单元308可以包括一个或多个块310。每个块310可以包括一个或多个像素312。每个像素312可以包括一个或多个数据集，对应于一个或多个数据部分，例如，亮度数据部分和色度数据部分。数据单元可以为帧，条带，tile，编码单元，宏块，块，像素或以上任一种的组。在不同的实施例中，数据单元的大小可以变化。作为举例，一个帧304可以包括100个条带306，每个条带306可以包括10个宏块308，每个宏块308可以包括4 个(例如，2x2)块310，每个块310可以包括64个(例如，8x8)像素312。
本发明实施例的技术方案可以用于编码或解码的预测过程中，对图像块的边界像素块中的像素进行运动补偿。
现有的OBMC技术是将当前编码图像块分成一个个地4x4像素块。根据当前图像块的预测模式，现有OBMC也分成了普通模式及子块模式两种：当前图像块只有一个运动矢量时(例如普通帧间预测、普通合并模式)，OBMC使用普通模式；当前图像块的每个4x4像素块拥有各自的运动矢量时(例如子块合并模式，仿射模式和解码端运动矢量导出模式)，OBMC也使用子块模式。现有OBMC技术如图4所示。普通OBMC模式对当前块的边界4x4像素块进行处理，每个4x4边界像素块的4行/列像素的预测值会根据相邻4x4像素块的运动矢量进行改变。子块OBMC模式对当前图像块的每个4x4像素块都会进行处理，每个4x4块的2行/列像素的预测值会根据相邻4x4像素块的运动矢量进行改变。
改变后的预测值由下式得到：
P＝a·P cur+b·P ner          (1)
P cur和P ner分别代表由当前4x4块的运动矢量(当前图像块的运动矢量)和相邻4x4块的运动矢量(相邻图像块的运动矢量)分别得到的预测值，a和b是对应的加权系数，a与b的和为1。P是最终的预测值。现有的OBMC技术使用固定的加权系数，例如，a和b可以采用以下值：
第一行：3/4，1/4；
第二行：7/8,1/8；
第三行：15/16,1/16；
第四行：31/32，1/32。
使用固定的加权系数，忽视了图像块大小的影响，限制了编码效率的提高。例如，若当前图像块比较小时，当前图像块的运动矢量相应较为准确地描述当前图像块的真实运动，此时应当减小相邻图像块的运动矢量对当前图像块边界像素的运动补偿系数；反之，当前图像块比较大时，边界像素的真实运动很可能无法被当前图像块的运动矢量准确描述，此时可以增加相邻图像块的运动矢量对边界像素的运动补偿系数。
鉴于此，本发明实施例提供了一种运动补偿的方法，考虑图像块大小的影响，以提高运动补偿的性能。
图5示出了本发明实施例的运动补偿的方法500的示意性流程图。该方法500可以由图1所示的系统100执行。
510，根据第一参数和/或第二参数，确定待处理像素预测值的加权系数，其中所述待处理像素为当前图像块的边界像素块中的像素，所述第一参数为所述当前图像块的大小或所述待处理像素到所述当前图像块的中心位置的距离，所述第二参数为所述当前图像块的相邻图像块的大小或所述待处理像素到所述相邻图像块的中心位置的距离。
图像块的中心位置可以是该图像块的几何中心。例如，记该图像块左上角像素坐标为(0，0)，右下角像素坐标为(w,h)，中心位置则为(w/2,h/2)。
在本发明实施例中，对于图像块的边界像素块中的像素，不再采用固定的加权系数，而是考虑图像块大小的影响，自适应地调整加权系数的大小。可选地，可以考虑当前图像块的大小或待处理像素到当前图像块的中心位置的距离(即第一参数)，和/或，相邻图像块的大小或待处理像素到相邻图像块的中心位置的距离(即第二参数)。
可选地，当所述相邻图像块与所述当前图像块为上下相邻时，所述当前图像块的大小为所述当前图像块的高度，所述相邻图像块的大小为所述相邻图像块的高度；当所述相邻图像块与所述当前图像块为左右相邻时，所述当前图像块的大小为所述当前图像块的宽度，所述相邻图像块的大小为所述相邻图像块的宽度。
所述加权系数可以包括第一系数和第二系数，所述第一系数用于对根据所述当前图像块的运动矢量确定的所述待处理像素的第一预测值进行加权(即式(1)中的a)，所述第二系数用于对根据所述相邻图像块的运动矢量确定的所述待处理像素的第二预测值进行加权(即式(1)中的b)。
可选地，在本发明一个实施例中，可以根据所述第一参数，以及第一映射关系，确定所述第一系数或所述第二系数，其中，所述第一映射关系为预设的所述第一参数与所述第一系数的反向映射关系，所述第一参数与所述第一系数的反向映射关系表示所述第一系数随所述第一参数的增大而减小，或者，所述第一映射关系为预设的所述第一参数与所述第二系数的正向映射关系，所述第一参数与所述第二系数的正向映射关系表示所述第二系数随所述第一参数的增大而增大。
在本发明各种实施例中，变量x与变量y的正向映射关系表示y随x的增大而增大，y随x的减小而减小；相应地，x与y的反向映射关系表示y随x的增大而减小，y随x的减小而增大，但本发明实施例对正向映射关系或反向映射关系采用的具体的函数关系不做限定。
在本实施例中，所述第一参数与所述第一系数为反向映射关系，或者，所述第一参数与所述第二系数为正向映射关系。也就是说，第一系数随第一参数的增大而减小，减小而增大；或者，第二系数随第一参数的增大而增大，减小而减小。
以第一参数为当前图像块的大小为例(第一参数为待处理像素到当前图像块的中心位置的距离的情况与此类似)，若当前图像块的大小取值较大(如大于预设阈值)时，第一系数可以采用较小的值(如采用比目前固定的a的取值小的值)，第二系数可以采用较大的值(如采用比目前固定的b的取值大的值)；若当前图像块的大小取值较小(如小于预设阈值)时，第一系数可以采用较大的值(如采用比目前固定的a的取值大的值)，第二系数可以采用较小的值(如采用比目前固定的b的取值小的值)。
可选地，在本发明一个实施例中，若所述第一参数在第一阈值和第二阈值之间，则确定所述第一系数为第一预定值，和/或，所述第二系数为第二预定值，其中，所述第一阈值大于所述第二阈值；或者
若所述第一参数大于所述第一阈值，则确定所述第一系数为第三预定值，和/或，所述第二系数为第四预定值，其中，所述第三预定值小于所述第一预定值，所述第四预定值大于所述第二预定值；或者，
若所述第一参数小于所述第二阈值，则确定所述第一系数为第五预定值，和/或，所述第二系数为第六预定值，其中，所述第五预定值大于所述第一预定值，所述第六预定值小于所述第二预定值。
在本实施例中，对于第一参数所处的不同范围，采用不同的第一系数和第二系数。第一参数在第一阈值和第二阈值之间时，即第一参数在中间范围时，第一系数和第二系数可分别采用中间取值的预定值，例如，可以分别采用目前固定的a和b的取值；第一参数大于第一阈值时，第一系数可采用较小的预定值，例如，可以采用比目前固定的a的取值小的值，第二系数可采用较大预定值，例如，可以采用比目前固定的b的取值大的值；第一参数小于第二阈值时，第一系数可采用较大的预定值，例如，可以采用比目前固 定的a的取值大的值，第二系数可采用较小预定值，例如，可以采用比目前固定的b的取值小的值。
可选地，作为一个举例，第一阈值可以为64，第二阈值可以为8。
举例来说，当对当前图像块的上边4x4像素块进行OBMC处理时，若当前图像块的高度大于或等于64，可以将第一行像素的OBMC系数a由原本的3/4降低为2/3，系数b由原本的1/4增加为1/3；若当前图像块的高度小于或等于8，则可以将第一行像素的OBMC系数a由原本的3/4增加为4/5，系数b由原本的1/4降低为1/5。
当前图像块越大时，该图像块边界像素的运动趋势与该图像块的运动矢量之间会有较大的偏差；反之，当前图像块比较小时，该图像块的运动矢量也能较好的表示边界像素的运动。因此，当前图像块比较大时，可以在原有系数值上适度减小加权系数a，增大加权系数b；反之，当前图像块比较小时，可以在原有系数值上适度增加加权系数a,减小加权系数b。这样，所采用的加权系数能更好的体现边界像素的真实运动矢量，从而能够提高运动补偿的性能。
可选的，本发明中的阈值可以作为编码端和解码端的预设值，也可以在编码端将阈值信息写入码流中，解码端从码流中获得阈值信息。在编码端可在视频参数集(VPS,video parameter set)，序列参数集(SPS,sequence parameter set)，图像参数集(PPS,picture parameter set)，序列头，图像头，条带头等地方写入所述的阈值信息。
可选地，在本发明一个实施例中，可以根据所述第二参数，以及第二映射关系，确定所述第一系数或所述第二系数，其中，所述第二映射关系为预设的所述第二参数与所述第一系数的正向映射关系，所述第二参数与所述第一系数的正向映射关系表示所述第一系数随所述第二参数的增大而增大，或者，所述第二映射关系为预设的所述第二参数与所述第二系数的反向映射关系，所述第二参数与所述第二系数的反向映射关系表示所述第二系数随所述第二参数的增大而减小。
在本实施例中，所述第二参数与所述第一系数为正向映射关系，或者，所述第二参数与所述第二系数为反向映射关系。也就是说，第一系数随第二参数的增大而增大，减小而减小；或者，第二系数随第二参数的增大而减小，减小而增大。
以第二参数为相邻图像块的大小为例(第二参数为待处理像素到相邻图像块的中心位置的距离的情况与此类似)，若相邻图像块的大小取值较大(如大于预设阈值)时，第一系数可以采用较大的值(如采用比目前固定的a的取值大的值)，第二系数可以采用较小的值(如采用比目前固定的b的取值小的值)；若相邻图像块的大小取值较小(如大于预设阈值)时，第一系数可以采用较小的值(如采用比目前固定的a的取值小的值)，第二系数可以采用较大的值(如采用比目前固定的b的取值大的值)。
可选的，本发明中的阈值可以作为编码端和解码端的预设值，也可以在编码端将阈值信息写入码流中，解码端从码流中获得阈值信息。在编码端可在视频参数集(VPS,video parameter set)，序列参数集(SPS,sequence parameter set)，图像参数集(PPS,picture parameter set)，序列头，图像头，条带头等地方写入所述的阈值信息。
可选地，在本发明一个实施例中，若所述第二参数在第一阈值和第二阈值之间，则确定所述第一系数为第一预定值，和/或，所述第二系数为第二预定值，其中，所述第一阈值大于所述第二阈值；或者
若所述第二参数大于所述第一阈值，则确定所述第一系数为第五预定值，和/或，所述第二系数为第六预定值，其中，所述第五预定值大于所述第一预定值，所述第六预定值小于所述第二预定值；或者，
若所述第二参数小于所述第二阈值，则确定所述第一系数为第三预定值，和/或，所述第二系数为第四预定值，其中，所述第三预定值小于所述第一预定值，所述第四预定值大于所述第二预定值。
在本实施例中，对于第二参数所处的不同范围，采用不同的第一系数和第二系数。第二参数在第一阈值和第二阈值之间时，即第二参数在中间范围时，第一系数和第二系数可分别采用中间取值的预定值，例如，可以分别采用目前固定的a和b的取值；第二参数小于第二阈值时，第一系数可采用较小的预定值，例如，可以采用比目前固定的a的取值小的值，第二系数可采用较大预定值，例如，可以采用比目前固定的b的取值大的值；第二参数大于第一阈值时，第一系数可采用较大的预定值，例如，可以采用比目前固定的a的取值大的值，第二系数可采用较小预定值，例如，可以采用比目前固定的b的取值小的值。
相邻图像块越大时，当前图像块边界像素的运动趋势与相邻图像块的 运动矢量之间会有较大的偏差；反之，相邻图像块比较小时，相邻图像块的运动矢量也能较好的表示当前图像块边界像素的运动。因此，相邻图像块比较小时，可以在原有系数值上适度减小加权系数a，增大加权系数b；反之，相邻图像块比较大时，可以在原有系数值上适度增加加权系数a,减小加权系数b。这样，所采用的加权系数能更好的体现边界像素的真实运动矢量，从而能够提高运动补偿的性能。
可选的，本发明中的阈值可以作为编码端和解码端的预设值，也可以在编码端将阈值信息写入码流中，解码端从码流中获得阈值信息。在编码端可在视频参数集(VPS,video parameter set)，序列参数集(SPS,sequence parameter set)，图像参数集(PPS,picture parameter set)，序列头，图像头，条带头等地方写入所述的阈值信息。
可选地，在本发明一个实施例中，可以根据所述第一参数与所述第二参数的比值，确定所述加权系数。
在前述实施例中，加权系数的调整只考虑第一参数和第二参数中一个参数的影响，即只考虑当前图像块和相邻图像块中一个因素。在本实施例中，同时考虑第一参数和第二参数两个参数的影响，即联合考虑当前图像块和相邻图像块两个因素。具体地，可以根据所述第一参数与所述第二参数的比值，调整所述加权系数，对于不同的比值，可以采用不同的加权系数。
可选地，在本发明一个实施例中，可以根据所述第一参数与所述第二参数的比值，以及第三映射关系，确定所述第一系数或所述第二系数，其中，所述第三映射关系为预设的所述比值与所述第一系数的反向映射关系，所述比值与所述第一系数的反向映射关系表示所述第一系数随所述比值的增大而减小，或者，所述第三映射关系为预设的所述比值与所述第二系数的正向映射关系，所述比值与所述第二系数的正向映射关系表示所述第二系数随所述比值的增大而增大。
在本实施例中，第一参数与第二参数的比值，与所述第一系数为反向映射关系，或者，所述比值与所述第二系数为正向映射关系。也就是说，第一系数随所述比值的增大而减小，减小而增大；或者，第二系数随所述比值的增大而增大，减小而减小。
例如，若所述比值较大时，第一系数可以采用较小的值(如采用比目前固定的a的取值小的值)，第二系数可以采用较大的值(如采用比目前固 定的b的取值大的值)；若所述比值较小时，第一系数可以采用较大的值(如采用比目前固定的a的取值大的值)，第二系数可以采用较小的值(如采用比目前固定的b的取值小的值)。
可选地，可以根据以下公式确定第二系数b：
Figure PCTCN2018076852-appb-000001
Figure PCTCN2018076852-appb-000002
其中，h c表示第一参数，h n表示第二参数，log 2h n/h c可取的最大值记为max{log 2H n/H c}，b org表示目前固定的第二系数。
如图6所示，以h c和h n分别为当前图像块和相邻图像块的大小为例，根据编码器支持的图像块尺寸不同，h n/h c的取值空间也会有所不同，一般而言，图像块大小可以在4x4～128x128之间变化，h n/h c的取值空间为{1/32,1/16,1/8,1/4,1/2,1,2,4,8,16,32}。对h n/h c取对数，log 2h n/h c的取值空间为{-5,-4,-3,-2,-1,0,1,2,3,4,5}。由式(2)和(3)可以得到，调整后的b处于(b org/2,2b org)的范围内。
采用式(2)和(3)得到第二系数b后，可以再根据a与b的和为1，得到第一系数a。
应理解，上述公式(2)和(3)中，分h n>h c和h c>h n两种情况分别给出了不同的公式，但本发明实施例对此并不限定。也就是说，可以不区分h n>h c和h c>h n两种情况，而统一采用其中一个公式。
可选地，为了降低在编码和解码系统中的实现复杂度，可以根据上述计算公式及h c和h n的数值预先计算出a和/或b的数值，或者，a和/或b经整数化之后的近似数值。在编码和解码系统中预先设定查找表，根据h c和h n通过查表得到相应数值。例如，可以通过查表获得b的值，而后由a+b＝1获得a的值。作为一个举例，对于边界像素块第一行/列像素的加权系数b可以采用如下表格：
表1
Figure PCTCN2018076852-appb-000003
Figure PCTCN2018076852-appb-000004
520，根据所述加权系数确定所述待处理像素的预测值。
在采用前述方式得到加权系数后，采用该加权系数确定待处理像素的预测值。
具体地，可以根据所述当前图像块的运动矢量，确定所述待处理像素的第一预测值；根据所述相邻图像块的运动矢量，确定所述待处理像素的第二预测值；再根据所述加权系数，对所述第一预测值和所述第二预测值进行加权求和，得到所述待处理像素的预测值。
例如，对于当前图像块的边界像素块中的一个像素，可以根据当前图像块的运动矢量，确定对应的相似块，该像素在该相似块中对应的像素的值为第一预测值P cur；类似地，可以根据相邻图像块的运动矢量，得到第二预测值P ner；再利用通过前述方式得到加权系数a和b，根据式(1)得到该像素的预测值P。
在采用上述方式得到像素的预测值后，对于编码端，可以基于该预测值进行编码，对于解码端，可以基于该预测值进行解码。
本发明实施例的技术方案，根据当前图像块和/或相邻图像块的影响，确定当前图像块的边界像素块中的像素的预测值的加权系数，能够更好地利用相邻图像块的运动矢量对该像素的预测值进行处理，从而能够提高运动补偿的性能。
另外，采用本发明实施例的技术方案时，编码端和解码端使用同样的方法确定加权系数，因此加权系数无需写入码流，从而不会带来额外的开销。
上文中详细描述了本发明实施例的运动补偿的方法，下面将描述本发明实施例的运动补偿的装置和计算机系统。
图7示出了本发明实施例的运动补偿的装置700的示意性框图。该装置700可以执行上述本发明实施例的运动补偿的方法。
如图7所示，该装置700可以包括：
加权系数确定单元710，用于根据第一参数和/或第二参数，确定待处 理像素预测值的加权系数，其中所述待处理像素为当前图像块的边界像素块中的像素，所述第一参数为所述当前图像块的大小或所述待处理像素到所述当前图像块的中心位置的距离，所述第二参数为所述当前图像块的相邻图像块的大小或所述待处理像素到所述相邻图像块的中心位置的距离；
预测值确定单元720，用于根据所述加权系数确定所述待处理像素的预测值。
可选地，在本发明一个实施例中，所述预测值确定单元720具体用于：
根据所述当前图像块的运动矢量，确定所述待处理像素的第一预测值；
根据所述相邻图像块的运动矢量，确定所述待处理像素的第二预测值；
根据所述加权系数，对所述第一预测值和所述第二预测值进行加权求和，得到所述待处理像素的预测值，其中，所述预测值加权系数包括第一系数和第二系数，所述第一系数用于对所述第一预测值进行加权，所述第二系数用于对所述第二预测值进行加权。
可选地，在本发明一个实施例中，所述加权系数确定单元具体710用于：
根据所述第一参数，以及第一映射关系，确定所述第一系数或所述第二系数，其中，所述第一映射关系为预设的所述第一参数与所述第一系数的反向映射关系，所述第一参数与所述第一系数的反向映射关系表示所述第一系数随所述第一参数的增大而减小，或者，所述第一映射关系为预设的所述第一参数与所述第二系数的正向映射关系，所述第一参数与所述第二系数的正向映射关系表示所述第二系数随所述第一参数的增大而增大。
可选地，在本发明一个实施例中，所述加权系数确定单元具体710用于：
若所述第一参数在第一阈值和第二阈值之间，则确定所述第一系数为第一预定值，和/或，所述第二系数为第二预定值，其中，所述第一阈值大于所述第二阈值；或者
若所述第一参数大于所述第一阈值，则确定所述第一系数为第三预定值，和/或，所述第二系数为第四预定值，其中，所述第三预定值小于所 述第一预定值，所述第四预定值大于所述第二预定值；或者，
若所述第一参数小于所述第二阈值，则确定所述第一系数为第五预定值，和/或，所述第二系数为第六预定值，其中，所述第五预定值大于所述第一预定值，所述第六预定值小于所述第二预定值。
可选的，本发明中的阈值可以作为编码端和解码端的预设值，也可以在编码端将阈值信息写入码流中，解码端从码流中获得阈值信息。在编码端可在视频参数集(VPS,video parameter set)，序列参数集(SPS,sequence parameter set)，图像参数集(PPS,picture parameter set)，序列头，图像头，条带头等地方写入所述的阈值信息。
可选地，在本发明一个实施例中，所述加权系数确定单元具体710用于：
根据所述第二参数，以及第二映射关系，确定所述第一系数或所述第二系数，其中，所述第二映射关系为预设的所述第二参数与所述第一系数的正向映射关系，所述第二参数与所述第一系数的正向映射关系表示所述第一系数随所述第二参数的增大而增大，或者，所述第二映射关系为预设的所述第二参数与所述第二系数的反向映射关系，所述第二参数与所述第二系数的反向映射关系表示所述第二系数随所述第二参数的增大而减小。
可选地，在本发明一个实施例中，所述加权系数确定单元具体710用于：
若所述第二参数在第一阈值和第二阈值之间，则确定所述第一系数为第一预定值，和/或，所述第二系数为第二预定值，其中，所述第一阈值大于所述第二阈值；或者
若所述第二参数大于所述第一阈值，则确定所述第一系数为第五预定值，和/或，所述第二系数为第六预定值，其中，所述第五预定值大于所述第一预定值，所述第六预定值小于所述第二预定值；或者，
若所述第二参数小于所述第二阈值，则确定所述第一系数为第三预定值，和/或，所述第二系数为第四预定值，其中，所述第三预定值小于所述第一预定值，所述第四预定值大于所述第二预定值。
可选的，本发明中的阈值可以作为编码端和解码端的预设值，也可以在编码端将阈值信息写入码流中，解码端从码流中获得阈值信息。在编码端可在视频参数集(VPS,video parameter set)，序列参数集(SPS,sequence  parameter set)，图像参数集(PPS,picture parameter set)，序列头，图像头，条带头等地方写入所述的阈值信息。
可选地，在本发明一个实施例中，所述加权系数确定单元具体710用于：
根据所述第一参数与所述第二参数的比值，确定所述预测值加权系数。
可选地，在本发明一个实施例中，所述加权系数确定单元具体710用于：
根据所述第一参数与所述第二参数的比值，以及第三映射关系，确定所述第一系数或所述第二系数，其中，所述第三映射关系为预设的所述比值与所述第一系数的反向映射关系，所述比值与所述第一系数的反向映射关系表示所述第一系数随所述比值的增大而减小，或者，所述第三映射关系为预设的所述比值与所述第二系数的正向映射关系，所述比值与所述第二系数的正向映射关系表示所述第二系数随所述比值的增大而增大。
可选地，在本发明一个实施例中，当所述相邻图像块与所述当前图像块为上下相邻时，所述当前图像块的大小为所述当前图像块的高度，所述相邻图像块的大小为所述相邻图像块的高度；
当所述相邻图像块与所述当前图像块为左右相邻时，所述当前图像块的大小为所述当前图像块的宽度，所述相邻图像块的大小为所述相邻图像块的宽度。
应理解，上述本发明实施例的运动补偿的装置可以是芯片，其具体可以由电路实现，但本发明实施例对具体的实现形式不做限定。
本发明实施例还提供了一种编码器，该编码器包括上述本发明实施例的运动补偿的装置。
本发明实施例还提供了一种解码器，该解码器包括上述本发明实施例的运动补偿的装置。
图8示出了本发明实施例的计算机系统800的示意性框图。
如图8所示，该计算机系统800可以包括处理器810和存储器820。
应理解，该计算机系统800还可以包括其他计算机系统中通常所包括的部件，例如，输入输出设备、通信接口等，本发明实施例对此并不限定。
存储器820用于存储计算机可执行指令。
存储器820可以是各种种类的存储器，例如可以包括高速随机存取存储器(Random Access Memory，RAM)，还可以包括非不稳定的存储器(non-volatile memory)，例如至少一个磁盘存储器，本发明实施例对此并不限定。
处理器810用于访问该存储器820，并执行该计算机可执行指令，以进行上述本发明实施例的运动补偿的方法中的操作。
处理器810可以包括微处理器，现场可编程门阵列(Field－Programmable Gate Array，FPGA)，中央处理器(Central Processing unit，CPU)，图形处理器(Graphics Processing Unit，GPU)等，本发明实施例对此并不限定。
本发明实施例的运动补偿的装置和计算机系统可对应于本发明实施例的运动补偿的方法的执行主体，并且运动补偿的装置和计算机系统中的各个模块的上述和其它操作和/或功能分别为了实现前述各个方法的相应流程，为了简洁，在此不再赘述。
本发明实施例还提供了一种电子设备，该电子设备可以包括上述本发明各种实施例的运动补偿的装置或者计算机系统。
本发明实施例还提供了一种计算机存储介质，该计算机存储介质中存储有程序代码，该程序代码可以用于指示执行上述本发明实施例的运动补偿的方法。
应理解，在本发明实施例中，术语“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系。例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、计算机软件或者二者的结合来实现，为了清楚地说明硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。
所属领域的技术人员可以清楚地了解到，为了描述的方便和简洁，上述描述的系统、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另外，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口、装置或单元的间接耦合或通信连接，也可以是电的，机械的或其它的形式连接。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本发明实施例方案的目的。
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以是两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分，或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到各种等效的修改或替换，这些修改或替换都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以权利要求的保护范围为准。

Claims (19)

  1. 一种运动补偿的方法，其特征在于，包括：
    根据第一参数和/或第二参数，确定待处理像素预测值的加权系数，其中所述待处理像素为当前图像块的边界像素块中的像素，所述第一参数为所述当前图像块的大小或所述待处理像素到所述当前图像块的中心位置的距离，所述第二参数为所述当前图像块的相邻图像块的大小或所述待处理像素到所述相邻图像块的中心位置的距离；
    根据所述加权系数确定所述待处理像素的预测值。
  2. 根据权利要求1所述的方法，其特征在于，所述根据所述加权系数确定所述待处理像素的预测值，包括：
    根据所述当前图像块的运动矢量，确定所述待处理像素的第一预测值；
    根据所述相邻图像块的运动矢量，确定所述待处理像素的第二预测值；
    根据所述加权系数，对所述第一预测值和所述第二预测值进行加权求和，得到所述待处理像素的预测值，其中，所述加权系数包括第一系数和第二系数，所述第一系数用于对所述第一预测值进行加权，所述第二系数用于对所述第二预测值进行加权。
  3. 根据权利要求2所述的方法，其特征在于，所述确定待处理像素预测值的加权系数，包括：
    根据所述第一参数，以及第一映射关系，确定所述第一系数或所述第二系数，其中，所述第一映射关系为预设的所述第一参数与所述第一系数的反向映射关系，所述第一参数与所述第一系数的反向映射关系表示所述第一系数随所述第一参数的增大而减小，或者，所述第一映射关系为预设的所述第一参数与所述第二系数的正向映射关系，所述第一参数与所述第二系数的正向映射关系表示所述第二系数随所述第一参数的增大而增大。
  4. 根据权利要求2所述的方法，其特征在于，所述确定待处理像素预测值的加权系数，包括：
    若所述第一参数在第一阈值和第二阈值之间，则确定所述第一系数为第一预定值，和/或，所述第二系数为第二预定值，其中，所述第一阈值大于所述第二阈值；或者
    若所述第一参数大于所述第一阈值，则确定所述第一系数为第三预定值，和/或，所述第二系数为第四预定值，其中，所述第三预定值小于所述第一预 定值，所述第四预定值大于所述第二预定值；或者，
    若所述第一参数小于所述第二阈值，则确定所述第一系数为第五预定值，和/或，所述第二系数为第六预定值，其中，所述第五预定值大于所述第一预定值，所述第六预定值小于所述第二预定值。
  5. 根据权利要求2所述的方法，其特征在于，所述确定待处理像素的预测值加权系数，包括：
    根据所述第二参数，以及第二映射关系，确定所述第一系数或所述第二系数，其中，所述第二映射关系为预设的所述第二参数与所述第一系数的正向映射关系，所述第二参数与所述第一系数的正向映射关系表示所述第一系数随所述第二参数的增大而增大，或者，所述第二映射关系为预设的所述第二参数与所述第二系数的反向映射关系，所述第二参数与所述第二系数的反向映射关系表示所述第二系数随所述第二参数的增大而减小。
  6. 根据权利要求2所述的方法，其特征在于，所述确定待处理像素预测值的加权系数，包括：
    若所述第二参数在第一阈值和第二阈值之间，则确定所述第一系数为第一预定值，和/或，所述第二系数为第二预定值，其中，所述第一阈值大于所述第二阈值；或者
    若所述第二参数大于所述第一阈值，则确定所述第一系数为第五预定值，和/或，所述第二系数为第六预定值，其中，所述第五预定值大于所述第一预定值，所述第六预定值小于所述第二预定值；或者，
    若所述第二参数小于所述第二阈值，则确定所述第一系数为第三预定值，和/或，所述第二系数为第四预定值，其中，所述第三预定值小于所述第一预定值，所述第四预定值大于所述第二预定值。
  7. 根据权利要求2所述的方法，其特征在于，所述确定待处理像素预测值的加权系数，包括：
    根据所述第一参数与所述第二参数的比值，确定所述加权系数。
  8. 根据权利要求7所述的方法，其特征在于，所述确定所述加权系数，包括：
    根据所述第一参数与所述第二参数的比值，以及第三映射关系，确定所述第一系数或所述第二系数，其中，所述第三映射关系为预设的所述比值与所述第一系数的反向映射关系，所述比值与所述第一系数的反向映射关系表 示所述第一系数随所述比值的增大而减小，或者，所述第三映射关系为预设的所述比值与所述第二系数的正向映射关系，所述比值与所述第二系数的正向映射关系表示所述第二系数随所述比值的增大而增大。
  9. 根据权利要求1至8中任一项所述的方法，其特征在于，当所述相邻图像块与所述当前图像块为上下相邻时，所述当前图像块的大小为所述当前图像块的高度，所述相邻图像块的大小为所述相邻图像块的高度；
    当所述相邻图像块与所述当前图像块为左右相邻时，所述当前图像块的大小为所述当前图像块的宽度，所述相邻图像块的大小为所述相邻图像块的宽度。
  10. 一种运动补偿的装置，其特征在于，包括：
    加权系数确定单元，用于根据第一参数和/或第二参数，确定待处理像素预测值的加权系数，其中所述待处理像素为当前图像块的边界像素块中的像素，所述第一参数为所述当前图像块的大小或所述待处理像素到所述当前图像块的中心位置的距离，所述第二参数为所述当前图像块的相邻图像块的大小或所述待处理像素到所述相邻图像块的中心位置的距离；
    预测值确定单元，用于根据所述加权系数确定所述待处理像素的预测值。
  11. 根据权利要求10所述的装置，其特征在于，所述预测值确定单元具体用于：
    根据所述当前图像块的运动矢量，确定所述待处理像素的第一预测值；
    根据所述相邻图像块的运动矢量，确定所述待处理像素的第二预测值；
    根据所述加权系数，对所述第一预测值和所述第二预测值进行加权求和，得到所述待处理像素的预测值，其中，所述预测值加权系数包括第一系数和第二系数，所述第一系数用于对所述第一预测值进行加权，所述第二系数用于对所述第二预测值进行加权。
  12. 根据权利要求11所述的装置，其特征在于，所述加权系数确定单元具体用于：
    根据所述第一参数，以及第一映射关系，确定所述第一系数或所述第二系数，其中，所述第一映射关系为预设的所述第一参数与所述第一系数的反向映射关系，所述第一参数与所述第一系数的反向映射关系表示所述第一系数随所述第一参数的增大而减小，或者，所述第一映射关系为预设的所述第一参数与所述第二系数的正向映射关系，所述第一参数与所述第二系数的正 向映射关系表示所述第二系数随所述第一参数的增大而增大。
  13. 根据权利要求11所述的装置，其特征在于，所述加权系数确定单元具体用于：
    若所述第一参数在第一阈值和第二阈值之间，则确定所述第一系数为第一预定值，和/或，所述第二系数为第二预定值，其中，所述第一阈值大于所述第二阈值；或者
    若所述第一参数大于所述第一阈值，则确定所述第一系数为第三预定值，和/或，所述第二系数为第四预定值，其中，所述第三预定值小于所述第一预定值，所述第四预定值大于所述第二预定值；或者，
    若所述第一参数小于所述第二阈值，则确定所述第一系数为第五预定值，和/或，所述第二系数为第六预定值，其中，所述第五预定值大于所述第一预定值，所述第六预定值小于所述第二预定值。
  14. 根据权利要求11所述的装置，其特征在于，所述加权系数确定单元具体用于：
    根据所述第二参数，以及第二映射关系，确定所述第一系数或所述第二系数，其中，所述第二映射关系为预设的所述第二参数与所述第一系数的正向映射关系，所述第二参数与所述第一系数的正向映射关系表示所述第一系数随所述第二参数的增大而增大，或者，所述第二映射关系为预设的所述第二参数与所述第二系数的反向映射关系，所述第二参数与所述第二系数的反向映射关系表示所述第二系数随所述第二参数的增大而减小。
  15. 根据权利要求11所述的装置，其特征在于，所述加权系数确定单元具体用于：
    若所述第二参数在第一阈值和第二阈值之间，则确定所述第一系数为第一预定值，和/或，所述第二系数为第二预定值，其中，所述第一阈值大于所述第二阈值；或者
    若所述第二参数大于所述第一阈值，则确定所述第一系数为第五预定值，和/或，所述第二系数为第六预定值，其中，所述第五预定值大于所述第一预定值，所述第六预定值小于所述第二预定值；或者，
    若所述第二参数小于所述第二阈值，则确定所述第一系数为第三预定值，和/或，所述第二系数为第四预定值，其中，所述第三预定值小于所述第一预定值，所述第四预定值大于所述第二预定值。
  16. 根据权利要求11所述的装置，其特征在于，所述加权系数确定单元具体用于：
    根据所述第一参数与所述第二参数的比值，确定所述预测值加权系数。
  17. 根据权利要求16所述的装置，其特征在于，所述加权系数确定单元具体用于：
    根据所述第一参数与所述第二参数的比值，以及第三映射关系，确定所述第一系数或所述第二系数，其中，所述第三映射关系为预设的所述比值与所述第一系数的反向映射关系，所述比值与所述第一系数的反向映射关系表示所述第一系数随所述比值的增大而减小，或者，所述第三映射关系为预设的所述比值与所述第二系数的正向映射关系，所述比值与所述第二系数的正向映射关系表示所述第二系数随所述比值的增大而增大。
  18. 根据权利要求10至17中任一项所述的装置，其特征在于，当所述相邻图像块与所述当前图像块为上下相邻时，所述当前图像块的大小为所述当前图像块的高度，所述相邻图像块的大小为所述相邻图像块的高度；
    当所述相邻图像块与所述当前图像块为左右相邻时，所述当前图像块的大小为所述当前图像块的宽度，所述相邻图像块的大小为所述相邻图像块的宽度。
  19. 一种计算机系统，其特征在于，包括：
    存储器，用于存储计算机可执行指令；
    处理器，用于访问所述存储器，并执行所述计算机可执行指令，以进行根据权利要求1至9中任一项所述的方法中的操作。
PCT/CN2018/076852 2018-02-14 2018-02-14 运动补偿的方法、装置和计算机系统 WO2019157717A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/CN2018/076852 WO2019157717A1 (zh) 2018-02-14 2018-02-14 运动补偿的方法、装置和计算机系统
CN201880012508.XA CN110337811A (zh) 2018-02-14 2018-02-14 运动补偿的方法、装置和计算机系统
US16/993,243 US11272204B2 (en) 2018-02-14 2020-08-13 Motion compensation method and device, and computer system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/076852 WO2019157717A1 (zh) 2018-02-14 2018-02-14 运动补偿的方法、装置和计算机系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/993,243 Continuation US11272204B2 (en) 2018-02-14 2020-08-13 Motion compensation method and device, and computer system

Publications (1)

Publication Number Publication Date
WO2019157717A1 true WO2019157717A1 (zh) 2019-08-22

Family

ID=67620144

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/076852 WO2019157717A1 (zh) 2018-02-14 2018-02-14 运动补偿的方法、装置和计算机系统

Country Status (3)

Country Link
US (1) US11272204B2 (zh)
CN (1) CN110337811A (zh)
WO (1) WO2019157717A1 (zh)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113994671B (zh) 2019-06-14 2024-05-10 北京字节跳动网络技术有限公司 基于颜色格式处理视频单元边界和虚拟边界
BR112022005046A2 (pt) 2019-09-18 2022-07-05 Beijing Bytedance Network Tech Co Ltd Método de processamento de dados de vídeo, aparelho para processar dados de vídeo, meio de armazenamento não transitório legível por computador e meio de gravação não transitório legível por computador
CN114430902B (zh) 2019-09-22 2023-11-10 北京字节跳动网络技术有限公司 自适应环路滤波中的填充过程
KR20220063177A (ko) 2019-09-27 2022-05-17 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 상이한 비디오 유닛들 간의 적응적 루프 필터링
CN117956146A (zh) 2019-10-10 2024-04-30 北京字节跳动网络技术有限公司 自适应环路滤波中不可用样点位置处的填充处理
WO2021083257A1 (en) 2019-10-29 2021-05-06 Beijing Bytedance Network Technology Co., Ltd. Cross-component adaptive loop filter
JP7393550B2 (ja) 2019-12-11 2023-12-06 北京字節跳動網絡技術有限公司 クロス成分適応ループフィルタリングのためのサンプルパディング
JP2023531223A (ja) 2020-06-30 2023-07-21 北京字節跳動網絡技術有限公司 適応ループフィルタリングのための境界位置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009150793A1 (ja) * 2008-06-09 2009-12-17 パナソニック株式会社 撮像装置、撮像方法
CN102984525A (zh) * 2012-12-18 2013-03-20 北京大学 一种视频码流错误隐藏方法
US8478057B1 (en) * 2010-01-22 2013-07-02 Google Inc. Image compression and decompression using block prediction
CN106600544A (zh) * 2016-11-10 2017-04-26 北京暴风魔镜科技有限公司 基于纹理贴图的抗锯齿方法及系统
CN107465923A (zh) * 2016-06-06 2017-12-12 谷歌公司 在可变块尺寸的视频译码中的自适应重叠块预测

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100672592B1 (ko) * 2005-01-14 2007-01-24 엘지전자 주식회사 디스플레이 장치의 영상 보상장치 및 보상방법
WO2008084817A1 (ja) * 2007-01-09 2008-07-17 Kabushiki Kaisha Toshiba 画像符号化と復号化の方法及び装置
CN103281542B (zh) * 2007-06-29 2017-07-14 夏普株式会社 图像编码装置、图像编码方法、图像译码装置、图像译码方法
EP2595387A4 (en) * 2010-07-15 2014-11-05 Sharp Kk IMAGE INTRA-PREDICTION MODE ESTIMATING DEVICE, IMAGE ENCODING DEVICE, IMAGE DECODING DEVICE, AND IMAGE ENCODING DATA
CN105959706B (zh) * 2011-01-12 2021-01-08 三菱电机株式会社 图像编码装置和方法、以及图像译码装置和方法
US20130336398A1 (en) * 2011-03-10 2013-12-19 Electronics And Telecommunications Research Institute Method and device for intra-prediction
CN103650496B (zh) * 2011-07-12 2018-09-21 华为技术有限公司 用于在hevc中编码的基于像素的帧内预测
US9253508B2 (en) * 2011-11-04 2016-02-02 Futurewei Technologies, Inc. Differential pulse code modulation intra prediction for high efficiency video coding
US9883203B2 (en) * 2011-11-18 2018-01-30 Qualcomm Incorporated Adaptive overlapped block motion compensation
US9781447B1 (en) * 2012-06-21 2017-10-03 Google Inc. Correlation based inter-plane prediction encoding and decoding
CN102801972B (zh) * 2012-06-25 2017-08-29 北京大学深圳研究生院 基于特征的运动矢量估计和传递方法
EP3021575B1 (en) * 2013-07-09 2020-06-17 Hitachi Kokusai Electric Inc. Image processing device and image processing method
CN104702962B (zh) * 2015-03-03 2019-04-16 华为技术有限公司 帧内编解码方法、编码器和解码器
KR20180020965A (ko) * 2015-04-27 2018-02-28 엘지전자 주식회사 비디오 신호의 처리 방법 및 이를 위한 장치
US10250904B2 (en) * 2015-05-05 2019-04-02 Avago Technologies International Sales Pte. Limited Apparatus and method for overlapped motion compensation for video coding
KR20170058838A (ko) * 2015-11-19 2017-05-29 한국전자통신연구원 화면간 예측 향상을 위한 부호화/복호화 방법 및 장치
WO2018062702A1 (ko) * 2016-09-30 2018-04-05 엘지전자 주식회사 영상 코딩 시스템에서 인트라 예측 방법 및 장치
US10419777B2 (en) * 2016-12-22 2019-09-17 Google Llc Non-causal overlapped block prediction in variable block size video coding

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009150793A1 (ja) * 2008-06-09 2009-12-17 パナソニック株式会社 撮像装置、撮像方法
US8478057B1 (en) * 2010-01-22 2013-07-02 Google Inc. Image compression and decompression using block prediction
CN102984525A (zh) * 2012-12-18 2013-03-20 北京大学 一种视频码流错误隐藏方法
CN107465923A (zh) * 2016-06-06 2017-12-12 谷歌公司 在可变块尺寸的视频译码中的自适应重叠块预测
CN106600544A (zh) * 2016-11-10 2017-04-26 北京暴风魔镜科技有限公司 基于纹理贴图的抗锯齿方法及系统

Also Published As

Publication number Publication date
US20200374540A1 (en) 2020-11-26
US11272204B2 (en) 2022-03-08
CN110337811A (zh) 2019-10-15

Similar Documents

Publication Publication Date Title
WO2019157717A1 (zh) 运动补偿的方法、装置和计算机系统
US10412393B2 (en) Intra-frame encoding method, intra-frame decoding method, encoder, and decoder
ES2866894T3 (es) Predicción de coeficientes de filtro a partir de filtros fijos para codificación de video
WO2019105179A1 (zh) 颜色分量的帧内预测方法及装置
US10542265B2 (en) Self-adaptive prediction method for multi-layer codec
WO2021203394A1 (zh) 环路滤波的方法与装置
JP2022526400A (ja) ビデオコーディングのための方法および装置
WO2021134706A1 (zh) 环路滤波的方法与装置
US11394966B2 (en) Video encoding and decoding method and apparatus
JP2022524916A (ja) 適応的な数の領域を伴う幾何学的分割のための形状適応離散コサイン変換
WO2022266955A1 (zh) 图像解码及处理方法、装置及设备
KR20230107627A (ko) 후처리 제어를 이용한 비디오 디코딩
JP2023513772A (ja) ビデオコーディングのための方法、装置およびコンピュータプログラム
JP2021515494A (ja) 適応乗算係数を用いた画像フィルタリングのための方法および装置
WO2019127100A1 (zh) 视频编码的方法、装置和计算机系统
US20220353547A1 (en) Entropy coding of sign map for transform coefficients
WO2019157718A1 (zh) 运动补偿的方法、装置和计算机系统
WO2018222239A1 (en) Adaptation of scan order for entropy coding
JP2023525214A (ja) 変換パーティショニングとプライマリ／セカンダリ変換タイプ選択との間の相互作用
JP5809574B2 (ja) 符号化方法、復号方法、符号化装置、復号装置、符号化プログラム及び復号プログラム
WO2020147226A1 (zh) 信息处理方法及装置、设备、存储介质
JP2022540982A (ja) 情報処理方法及び装置、設備、記憶媒体
WO2019191887A1 (zh) 运动补偿的方法、装置和计算机系统
WO2019191888A1 (zh) 环路滤波的方法、装置和计算机系统
CN111279706B (zh) 环路滤波的方法、装置、计算机系统和可移动设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18906088

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18906088

Country of ref document: EP

Kind code of ref document: A1