CN114189693A - Method and device for determining pixel position, electronic equipment and storage medium - Google Patents
Method and device for determining pixel position, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114189693A CN114189693A CN202111477364.5A CN202111477364A CN114189693A CN 114189693 A CN114189693 A CN 114189693A CN 202111477364 A CN202111477364 A CN 202111477364A CN 114189693 A CN114189693 A CN 114189693A
- Authority
- CN
- China
- Prior art keywords
- sub
- pixel
- block
- predicted
- pixel position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000004364 calculation method Methods 0.000 claims abstract description 36
- 238000011156 evaluation Methods 0.000 claims abstract description 26
- 230000006835 compression Effects 0.000 claims abstract description 15
- 238000007906 compression Methods 0.000 claims abstract description 15
- 230000008569 process Effects 0.000 claims abstract description 13
- 230000000875 corresponding effect Effects 0.000 claims description 38
- 238000004590 computer program Methods 0.000 claims description 18
- 230000002596 correlated effect Effects 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 3
- 238000006073 displacement reaction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 229910021389 graphene Inorganic materials 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The application relates to a pixel position determining method, a pixel position determining device, an electronic device and a storage medium, wherein the pixel position determining method comprises the following steps: in the motion estimation process of display stream compression coding, sequentially calculating position evaluation parameters of all predicted pixel positions according to the calculation sequence of all predicted pixel positions of M x N sub-blocks of a current coding block, and stopping the calculation of the residual predicted pixel positions until the position evaluation parameters meet the preset requirement; and selecting one of the calculated predicted pixel positions as a target pixel position of the M x N sub-block for motion estimation. The method can reduce the complexity of motion estimation of pixel positions.
Description
Technical Field
The present application relates to the field of display stream compression technologies, and in particular, to a method and an apparatus for determining a pixel position, an electronic device, and a storage medium.
Background
In order to achieve low-cost, visually lossless and efficient video compression in a display link, many advanced compression coding tools such as Block Prediction (BP) are used in VDC-M, which divides a coding Block into M × N sub-blocks, for example, a coding Block of 8 × 2, and divides the coding Block into 4 sub-blocks of 2x2 and 8 sub-blocks of 2x1, each sub-Block of 2x2 and 2x1 performs 64-position motion estimation at adjacent coded pixel positions of the current coding Block, and selects an optimal position as an optimal Prediction position of the sub-Block, thereby removing spatial information redundancy.
However, motion estimation is required for all pixel positions, resulting in a high complexity of motion estimation for determining pixel positions.
Disclosure of Invention
The embodiment of the application provides a method and a device for determining a pixel position, electronic equipment and a storage medium, which can reduce the complexity of motion estimation of the pixel position.
In a first aspect, the present application provides a method for determining a pixel position, including:
in the motion estimation process of display stream compression coding, sequentially calculating position evaluation parameters of all predicted pixel positions according to the calculation sequence of all predicted pixel positions of M x N sub-blocks of a current coding block, and stopping the calculation of the residual predicted pixel positions until the position evaluation parameters meet the preset requirement;
and selecting one of the calculated predicted pixel positions as a target pixel position for motion estimation of the M x N sub-block.
In one embodiment, the location estimation parameter includes at least one of:
the sum of the predicted losses of the color components of each pixel in the M x N sub-block;
the position evaluation parameter meets preset requirements, including:
and the sum of the predicted losses is less than a loss threshold corresponding to the M x N sub-blocks.
In one embodiment, the calculating the position estimation parameter for each predicted pixel position includes:
extracting original pixel values and prediction residual values of each color component of each pixel in the M x N sub-blocks;
and determining the sum of the prediction losses according to the original pixel value and the prediction residual value.
In one embodiment, the sum of the predicted losses is determined according to the following equation:
wherein:
wherein, w and h are the width and brightness of the M N sub-block respectively, i and j are the abscissa and ordinate of the pixel point in the M N sub-block respectively, k belongs to {0,1,2} and represents three color components corresponding to the pixels in the M N sub-block,
which represents the value of the original pixel or pixels,
represents the prediction residual value, and sum represents the sum of prediction losses.
In one embodiment, the loss threshold is positively correlated with the magnitude of N.
In one embodiment, the M × N sub-blocks are 2 × 2 sub-blocks or 2 × 1 sub-blocks, the loss threshold includes a first loss threshold corresponding to the 2 × 2 sub-blocks and a second loss threshold corresponding to the 2 × 1 sub-blocks, and the first loss threshold/the second loss threshold is 2.
In a second aspect, the present application provides an apparatus for determining a pixel position, including:
the calculation module is used for sequentially calculating position evaluation parameters of all prediction pixel positions according to the calculation sequence of all prediction pixel positions of the M x N sub-block of the current coding block in the motion estimation process of display stream compression coding, and stopping the calculation of the residual prediction pixel positions until the position evaluation parameters meet the preset requirements;
and the pixel position determining module is used for selecting one of the calculated predicted pixel positions as a target pixel position of the M x N sub-block for motion estimation.
In a third aspect, the present application provides an electronic device comprising a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to perform the steps of the method as described above.
In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method as described above.
In a fifth aspect, the present application provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of the method described above.
The pixel position determining method, the device, the electronic device and the storage medium comprise: in the motion estimation process of display stream compression coding, sequentially calculating position evaluation parameters of all predicted pixel positions according to the calculation sequence of all predicted pixel positions of M x N sub-blocks of a current coding block, and stopping the calculation of the residual predicted pixel positions until the position evaluation parameters meet the preset requirement; selecting one of the calculated predicted pixel positions as a target pixel position for motion estimation of the M × N sub-block, wherein in the process of determining the target pixel position, position estimation parameters of each predicted pixel position are sequentially calculated, the calculation is stopped if the position estimation parameters of one predicted pixel position meet preset requirements, and one of the calculated predicted pixel positions is selected as the target pixel position of the M × N sub-block, so that the number of the calculated predicted pixel positions is certainly not more than the total number of all the predicted pixel positions, and generally, the number of the calculated predicted pixel positions is less than the total number of all the predicted pixel positions, and therefore, one of the calculated predicted pixel positions is selected as the target pixel position to be compared with one of all the predicted pixel positions as the target pixel position, the complexity of motion estimation is lower, the technical problem that the complexity of motion estimation for determining the pixel position is higher due to the fact that motion estimation needs to be carried out on all the pixel positions is solved, and the complexity of motion estimation of the pixel position is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative work.
FIG. 1 is a flow diagram illustrating a method for determining pixel locations in one embodiment;
FIG. 2 is a flow chart illustrating a method for determining pixel locations in another embodiment;
FIG. 3 is a schematic diagram of an embodiment of a device for determining pixel locations;
fig. 4 is a schematic diagram of an internal structure of the electronic device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, a first client may be referred to as a second client, and similarly, a second client may be referred to as a first client, without departing from the scope of the present application. Both the first client and the second client are clients, but they are not the same client.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for determining a pixel location according to an embodiment. In an embodiment, as shown in fig. 1, a method for determining a pixel position is provided, and this embodiment is exemplified by applying the method to an electronic device, and it is to be understood that the method may also be applied to a server, and may also be applied to a system including an electronic device and a server, and is implemented by interaction between the electronic device and the server. In this embodiment, the method includes steps 110 to 120.
And step 110, in the motion estimation process of display stream compression coding, sequentially calculating position evaluation parameters of all predicted pixel positions according to the calculation sequence of all predicted pixel positions of M × N sub-blocks of a current coding block, and stopping the calculation of the residual predicted pixel positions until the position evaluation parameters meet preset requirements.
The basic idea of motion estimation is to divide each frame of an image sequence into a plurality of non-overlapping macro blocks, consider the displacement of all pixels in the macro blocks to be the same, and then find out the block most similar to the current block, i.e. the matching block, from each macro block to a reference frame within a given specific search range according to a certain matching criterion, wherein the relative displacement between the matching block and the current block is the motion vector. When the video is compressed, the current block can be completely restored only by storing the motion vector and the residual data. Video coding is performed on a block basis, a frame of video is divided into different blocks, and then each block is subjected to coding processing, wherein a coding block refers to a block obtained by dividing the frame of video and used for coding. The M × N subblocks refer to subblocks of the current coding block and may be considered as constituting a part of the current coding block. The specific values of M and N may be set as desired. For example, an 8x2 coded block may be divided into 4 sub-blocks of 2x2 and 8 sub-blocks of 2x 1; each sub-block of 2x2 and 2x1 performs 64-position motion estimation at the adjacent coded pixel position of the current coding block, thereby determining the optimal pixel position.
The calculation order of the prediction pixel positions may be a default, or may be related to the possibility that the prediction pixel position is the optimal pixel position, and the higher the possibility that the prediction pixel position is the optimal pixel position, the earlier the calculation order is. The position estimation parameter refers to a parameter obtained by calculating the predicted pixel position. The position estimation parameter can be considered as a parameter used to estimate whether to continue the calculation of the remaining predicted pixel positions. Specifically, the calculation of the remaining predicted pixel positions is stopped when the position estimation parameter satisfies a preset requirement. The remaining prediction pixel positions refer to prediction pixel positions other than the calculated prediction pixel positions among the prediction pixel positions.
The method comprises the following steps of exemplarily comprising a predicted pixel position A, a predicted pixel position B and a predicted pixel position C, wherein the possibility of the best pixel position is the predicted pixel position A, the predicted pixel position B and the predicted pixel position C from high to low, the position evaluation parameter of the predicted pixel position A is calculated firstly, whether the position evaluation parameter of the predicted pixel position A meets the preset requirement or not is judged, and if the position evaluation parameter of the predicted pixel position A meets the preset requirement, the calculation of the predicted pixel position B and the predicted pixel position C is stopped; and if the position evaluation parameter of the predicted pixel position A does not meet the preset requirement, calculating the position evaluation parameter of the predicted pixel position B, judging whether the position evaluation parameter of the predicted pixel position B meets the preset requirement, and repeating the steps until the position evaluation parameter of a certain predicted pixel position meets the preset requirement, and stopping the calculation of the residual pixel positions.
And step 120, selecting one of the calculated predicted pixel positions as a target pixel position of the M × N sub-block for motion estimation.
And after the target pixel position is determined, the M-N sub-block carries out motion estimation according to the target pixel position. In this step, for example, if the position estimation parameter of the predicted pixel position a meets the preset requirement, the predicted pixel position a is used as the target pixel position of the current coding block for performing the transform mode; and if the position evaluation parameter of the predicted pixel position B meets the preset requirement, taking one of the predicted pixel position A and the predicted pixel position B as an M x N sub-block to carry out motion estimation on the target pixel position.
In the technical scheme of this embodiment, in the motion estimation process of display stream compression coding, according to the calculation sequence of each predicted pixel position of M × N sub-block of the current coding block, position estimation parameters of each predicted pixel position are sequentially calculated, and the calculation of the remaining predicted pixel positions is stopped until the position estimation parameters meet the preset requirements; selecting one of the calculated predicted pixel positions as a target pixel position for motion estimation of the M × N sub-block, wherein in the process of determining the target pixel position, position estimation parameters of each predicted pixel position are sequentially calculated, the calculation is stopped if the position estimation parameters of one predicted pixel position meet preset requirements, and one of the calculated predicted pixel positions is selected as the target pixel position of the M × N sub-block, so that the number of the calculated predicted pixel positions is certainly not more than the total number of all the predicted pixel positions, generally, the number of the calculated predicted pixel positions is less than the total number of all the predicted pixel positions, and therefore, one of the calculated predicted pixel positions is selected as the target pixel position to be compared with one of all the predicted pixel positions, the complexity of motion estimation is lower, the technical problem that the complexity of motion estimation for determining the pixel position is higher due to the fact that motion estimation needs to be carried out on all the pixel positions is solved, and the complexity of motion estimation of the pixel position is reduced. Accordingly, the complexity is reduced, so that the efficiency of compression coding is higher, the real-time performance of display stream transmission is improved, and the energy consumption of a display stream compression standard hardware circuit can be reduced.
It should be noted that, one of the calculated predicted pixel positions may be selected as a target pixel position for transformation of the current coding block, and an error of motion estimation of each calculated predicted pixel position may be calculated, and the calculated predicted pixel position with the smallest error of motion estimation may be selected as the target pixel position.
The following example illustrates how the order of calculation of each predicted pixel position is determined.
In one possible embodiment, the method for determining the pixel position further includes:
determining the optimal pixel position which appears when the M x N sub-blocks carry out motion estimation;
taking the optimal pixel position as a prediction pixel position, and counting the occurrence times corresponding to each prediction pixel position;
and determining a calculation sequence corresponding to each prediction pixel position according to the occurrence frequency corresponding to each prediction pixel position, wherein the occurrence frequency is more, and the calculation sequence is more advanced.
In one possible embodiment, the location estimation parameter includes at least one of:
the sum of the predicted losses of the color components of each pixel in the M x N sub-block.
Correspondingly, the position evaluation parameter meets the preset requirement, and comprises the following steps:
and the sum of the predicted losses is less than a loss threshold corresponding to the M x N sub-blocks.
Wherein the sum of the prediction losses is the sum of the prediction losses of the respective color components of each pixel. Optionally, the larger the loss threshold, the easier the preset requirement is to meet, and therefore the easier it is to stop the computation, the lower the complexity, the worse the quality of the compression coding.
Note that, when the value of N is different, the corresponding loss threshold value is different.
In one possible embodiment, the loss threshold is positively correlated with the size of N. Specifically, the loss threshold is positively correlated with the size of N, which means that the larger N is, the larger the size of the loss threshold is. Alternatively, the positive correlation between the loss threshold and the size of N may be a linear positive correlation between the loss threshold and the size of N.
It can be understood that, in the embodiment, by dynamically adjusting the size of the loss threshold according to the value of N, the determined stopping time is also more accurate, and accordingly, the obtained calculated predicted pixel position is also more accurate, so that the target pixel position selected from the calculated predicted pixel positions is also more accurate, and the accuracy of motion estimation is improved.
In this embodiment, the size of the M × N sub-block may be determined first, so as to determine the value of N, and further determine the loss threshold corresponding to the M × N sub-block.
In one possible embodiment, the M × N sub-blocks are 2 × 2 sub-blocks or 2 × 1 sub-blocks, the loss threshold includes a first loss threshold corresponding to the 2 × 2 sub-blocks and a second loss threshold corresponding to the 2 × 1 sub-blocks, and the first loss threshold/the second loss threshold is 2.
It should be noted that the loss threshold corresponding to the M × N sub-block may be adaptively adjusted according to needs. Specifically, the average value of the plurality of statistical loss thresholds may be used as the loss threshold corresponding to the M × N sub-block, or the maximum value of the plurality of statistical loss thresholds may be used as the loss threshold corresponding to the M × N sub-block, or the minimum value of the plurality of statistical loss thresholds may be used as the loss threshold corresponding to the M × N sub-block, which is not limited in this embodiment.
Furthermore, the M × N sub-blocks may set different thresholds for different predicted pixel positions. For example, the loss threshold corresponding to predicted pixel position a is different from the loss threshold corresponding to predicted pixel position B. Specifically, the sum of prediction losses when different prediction pixel positions are the optimal pixel positions can be counted to be used as the threshold values corresponding to the different prediction pixel positions respectively.
Illustratively, when the predicted pixel position a of the M × N sub-block is the optimal pixel position, the sum of the prediction losses of the optimal predicted pixel position a is used as the threshold corresponding to the predicted pixel position a; and when the prediction pixel position B of the M x N sub-block is the optimal pixel position, taking the sum of the prediction losses of the optimal prediction pixel position B as the threshold corresponding to the prediction pixel position B.
The following embodiments are provided to explain how to determine the location estimation parameter based on any of the above embodiments.
In one possible embodiment, calculating the location estimation parameter for each predicted pixel location comprises:
extracting original pixel values and prediction residual values of each color component of each pixel in the M x N sub-blocks;
and determining the sum of the prediction losses according to the original pixel value and the prediction residual value.
Wherein an original pixel value refers to an original value of a pixel in an image block. The sum of the prediction loss refers to a sum value of the prediction loss of each color component of each pixel. Definition of prediction residual: if such predicted value is close to the current actual value, the difference between them is called the prediction residual, and the size of the prediction residual is the prediction residual value. The prediction parameter value of the present embodiment refers to the original value of the pixel in the image block minus the predicted value of the pixel in the image block.
The original pixel value and the prediction residual value of this embodiment may be obtained by direct extraction, and the sum of prediction losses is determined according to the original pixel value and the prediction residual value.
In one possible embodiment, the sum of the predicted losses is determined according to the following formula:
wherein:
wherein, w and h are the width and brightness of the M N sub-block respectively, i and j are the abscissa and ordinate of the pixel point in the M N sub-block respectively, k belongs to {0,1,2} and represents three color components corresponding to the pixels in the M N sub-block,
which represents the value of the original pixel or pixels,
represents the prediction residual value, and sum represents the sum of prediction losses.
Referring to fig. 2, fig. 2 is a flowchart illustrating a method for determining a pixel location according to another embodiment. In one embodiment, as shown in fig. 2, the method for determining the pixel position includes steps 210 to 270.
Generally, n is 1 in the first calculation.
And step 230, judging whether the M x N subblocks are 2x2 subblocks or not.
In this step, if the M × N sub-block is a 2 × 2 sub-block, step 240 is executed; if the M × N sub-block is a 2 × 1 sub-block, step 250 is performed.
And step 240, judging whether the sum of the predicted losses is smaller than a corresponding first loss threshold value.
In this step, if the sum of the predicted losses is less than the corresponding first loss threshold, step 270 is executed; if the sum of the predicted losses is greater than or equal to the corresponding first loss threshold, then step 260 is performed.
In this step, if the sum of the predicted losses is less than the corresponding second loss threshold, step 270 is executed; if the sum of the predicted losses is greater than or equal to the corresponding second loss threshold, then step 260 is performed.
And step 260, stopping the calculation of the residual predicted pixel positions, and selecting one of the calculated predicted pixel positions as a target pixel position of the M x N sub-block for motion estimation.
In this step, the sum of the prediction losses is greater than or equal to the threshold corresponding to the M × N sub-block, and the calculation cannot be stopped at this time, so that N +1, and the step 220 is returned to calculate the position estimation parameter of the N +1 th predicted pixel position, and further determine whether the preset requirement is met.
It should be understood that although the various steps in the flow charts of fig. 1-2 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1-2 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
Based on the same inventive concept, the embodiment of the present application further provides a pixel position determining apparatus for implementing the above-mentioned pixel position determining method. The implementation scheme for solving the problem provided by the apparatus is similar to the implementation scheme described in the above method, so that specific limitations in the following embodiments of the apparatus for determining one or more pixel positions may refer to the limitations in the above method for determining pixel positions, and are not described herein again.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a pixel position determining apparatus in an embodiment. As shown in fig. 3, the pixel position determining apparatus includes a calculating module 310 and a pixel position determining module 320, wherein:
the calculating module 310 is configured to sequentially calculate, in a motion estimation process of display stream compression coding, position estimation parameters of prediction pixel positions according to a calculation sequence of the prediction pixel positions of the M × N sub-block of the current coding block, and stop calculation of remaining prediction pixel positions until the position estimation parameters meet a preset requirement;
the pixel position determining module 320 is configured to select one of the calculated predicted pixel positions as a target pixel position for motion estimation of the M × N sub-block.
In one embodiment, the location estimation parameter includes at least one of:
the sum of the predicted losses of the color components of each pixel in the M x N sub-block;
the position evaluation parameter meets preset requirements, including:
and the sum of the predicted losses is less than a loss threshold corresponding to the M x N sub-blocks.
In one embodiment, the calculation module 310 includes:
a calculating unit, configured to extract an original pixel value and a prediction residual value of each color component of each pixel in the M × N sub-blocks; and determining the sum of the prediction losses according to the original pixel value and the prediction residual value.
In one embodiment, the calculation unit is specifically configured to determine the sum of the predicted losses according to the following formula:
wherein:
wherein, w and h are the width and brightness of the M N sub-block respectively, i and j are the abscissa and ordinate of the pixel point in the M N sub-block respectively, k belongs to {0,1,2} and represents three color components corresponding to the pixels in the M N sub-block,
which represents the value of the original pixel or pixels,
represents the prediction residual value, and sum represents the sum of prediction losses.
In one embodiment, the loss threshold is positively correlated with the magnitude of N.
In one embodiment, the M × N sub-blocks are 2 × 2 sub-blocks or 2 × 1 sub-blocks, the loss threshold includes a first loss threshold corresponding to the 2 × 2 sub-blocks and a second loss threshold corresponding to the 2 × 1 sub-blocks, and the first loss threshold/the second loss threshold is 2.
The division of each module in the above-mentioned device for determining pixel position is only used for illustration, and in other embodiments, the device for determining pixel position may be divided into different modules as needed to complete all or part of the functions of the above-mentioned device for determining pixel position.
For the specific definition of the pixel position determination device, reference may be made to the above definition of the pixel position determination method, which is not described herein again. The modules in the above-mentioned pixel position determining device can be implemented in whole or in part by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the electronic device, or can be stored in a memory in the electronic device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, an electronic device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 4. The electronic device comprises a processor, a memory, a communication interface, a display screen and an input device which are connected through a system bus. Wherein the processor of the electronic device is configured to provide computing and control capabilities. The memory of the electronic equipment comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the electronic device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a method of determining a pixel position. The display screen of the electronic equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the electronic equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the configuration shown in fig. 4 is a block diagram of only a portion of the configuration associated with the present application, and does not constitute a limitation on the electronic device to which the present application is applied, and a particular electronic device may include more or less components than those shown in the drawings, or combine certain components, or have a different arrangement of components.
The implementation of each module in the pixel position determination apparatus provided in the embodiments of the present application may be in the form of a computer program. The computer program may be run on an electronic device or a server. The computer program may constitute program modules that may be stored on a memory of the electronic device. Which when executed by a processor, performs the steps of the method described in the embodiments of the present application.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of the method for determining pixel locations.
A computer program product comprising instructions which, when run on a computer, cause the computer to perform a method of determining pixel locations.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high-density embedded nonvolatile Memory, resistive Random Access Memory (ReRAM), Magnetic Random Access Memory (MRAM), Ferroelectric Random Access Memory (FRAM), Phase Change Memory (PCM), graphene Memory, and the like. Volatile Memory can include Random Access Memory (RAM), external cache Memory, and the like. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others. The databases referred to in various embodiments provided herein may include at least one of relational and non-relational databases. The non-relational database may include, but is not limited to, a block chain based distributed database, and the like. The processors referred to in the various embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, quantum computing based data processing logic devices, etc., and are not limited thereto.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.
Claims (10)
1. A method for determining a pixel location, comprising:
in the motion estimation process of display stream compression coding, sequentially calculating position evaluation parameters of all predicted pixel positions according to the calculation sequence of all predicted pixel positions of M x N sub-blocks of a current coding block, and stopping the calculation of the residual predicted pixel positions until the position evaluation parameters meet the preset requirement;
and selecting one of the calculated predicted pixel positions as a target pixel position of the M x N sub-block for motion estimation.
2. The method of claim 1, wherein the location estimation parameter comprises at least one of:
the sum of the predicted losses of the color components of each pixel in the M x N sub-block;
the position evaluation parameter meets preset requirements, including:
and the sum of the predicted losses is less than a loss threshold corresponding to the M x N sub-blocks.
3. The method of claim 2, said calculating a location estimation parameter for each predicted pixel location, comprising:
extracting original pixel values and prediction residual values of each color component of each pixel in the M x N sub-blocks;
and determining the sum of the prediction losses according to the original pixel value and the prediction residual value.
4. The method of claim 3, wherein the sum of predicted losses is determined according to the following equation:
wherein:
wherein, w and h are the width and brightness of the M N sub-block respectively, i and j are the abscissa and ordinate of the pixel point in the M N sub-block respectively, k belongs to {0,1,2} to represent three color components corresponding to the pixels in the M N sub-block,
which represents the value of the original pixel or pixels,
represents the prediction residual value, and sum represents the sum of prediction losses.
5. The method of claim 2, wherein the loss threshold is positively correlated with the magnitude of N.
6. The method of claim 5, wherein the M x N sub-blocks are 2x2 sub-blocks or 2x1 sub-blocks, and wherein the loss threshold comprises a first loss threshold corresponding to the 2x2 sub-blocks and a second loss threshold corresponding to the 2x1 sub-blocks, and wherein the first loss threshold/the second loss threshold is 2.
7. An apparatus for determining a pixel location, comprising:
the calculation module is used for sequentially calculating position evaluation parameters of all prediction pixel positions according to the calculation sequence of all prediction pixel positions of the M x N sub-block of the current coding block in the motion estimation process of display stream compression coding until the position evaluation parameters meet the preset requirement and stopping the calculation of the residual prediction pixel positions;
and the pixel position determining module is used for selecting one of the calculated predicted pixel positions as a target pixel position of the M x N sub-block for motion estimation.
8. An electronic device comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of the method according to any one of claims 1 to 6.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 6.
10. A computer program product comprising a computer program, characterized in that the computer program realizes the steps of the method of any one of claims 1 to 6 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111477364.5A CN114189693A (en) | 2021-12-06 | 2021-12-06 | Method and device for determining pixel position, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111477364.5A CN114189693A (en) | 2021-12-06 | 2021-12-06 | Method and device for determining pixel position, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114189693A true CN114189693A (en) | 2022-03-15 |
Family
ID=80542388
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111477364.5A Pending CN114189693A (en) | 2021-12-06 | 2021-12-06 | Method and device for determining pixel position, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114189693A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109413426A (en) * | 2018-11-05 | 2019-03-01 | 建湖云飞数据科技有限公司 | Video coding processing method |
| CN109544591A (en) * | 2018-10-31 | 2019-03-29 | 北京金山云网络技术有限公司 | A kind of method for estimating, device, electronic equipment and storage medium |
| CN112601091A (en) * | 2020-12-02 | 2021-04-02 | 上海顺久电子科技有限公司 | Motion estimation method in frame rate conversion and display equipment |
| CN113382249A (en) * | 2021-04-21 | 2021-09-10 | 浙江大华技术股份有限公司 | Image/video encoding method, apparatus, system, and computer-readable storage medium |
-
2021
- 2021-12-06 CN CN202111477364.5A patent/CN114189693A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109544591A (en) * | 2018-10-31 | 2019-03-29 | 北京金山云网络技术有限公司 | A kind of method for estimating, device, electronic equipment and storage medium |
| CN109413426A (en) * | 2018-11-05 | 2019-03-01 | 建湖云飞数据科技有限公司 | Video coding processing method |
| CN112601091A (en) * | 2020-12-02 | 2021-04-02 | 上海顺久电子科技有限公司 | Motion estimation method in frame rate conversion and display equipment |
| CN113382249A (en) * | 2021-04-21 | 2021-09-10 | 浙江大华技术股份有限公司 | Image/video encoding method, apparatus, system, and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8467451B2 (en) | Methods for selecting a prediction mode | |
| US11115672B2 (en) | Video encoding method and apparatus, video decoding method and apparatus, computer device, and storage medium | |
| CN110913219A (en) | Video frame prediction method and device and terminal equipment | |
| US20230336733A1 (en) | Sample Adaptive Offset | |
| CN112218076A (en) | Video coding method, device and system and computer readable storage medium | |
| CN110913230A (en) | Video frame prediction method and device and terminal equipment | |
| US9232222B2 (en) | Lossless color image compression adaptively using spatial prediction or inter-component prediction | |
| CN113573056A (en) | Method, device, storage medium and terminal for optimizing and quantizing rate distortion | |
| CN111083479A (en) | Video frame prediction method and device and terminal equipment | |
| JP7218796B2 (en) | Neural network data compression device and data compression method | |
| CN114189693A (en) | Method and device for determining pixel position, electronic equipment and storage medium | |
| CN115662346B (en) | Demura compensation value compression method and system | |
| CN116258782A (en) | Image compression method, image encoding method, image decoding method and device | |
| CN113038131B (en) | Video encoding method, video encoding device, computer equipment and storage medium | |
| CN114501029B (en) | Image encoding method, image decoding method, image encoding device, image decoding device, computer device, and storage medium | |
| CN114339240A (en) | Direction selection method and device for conversion mode, electronic equipment and storage medium | |
| CN114339233A (en) | Method and device for determining display stream division mode, electronic equipment and storage medium | |
| JP2014099848A (en) | Image division system and image division method | |
| Alshehri | Video compression using frame redundancy elimination and discrete cosine transform coefficient reduction | |
| CN105706447A (en) | Moving image coding device, moving image decoding device, moving image coding method, moving image decoding method, and program | |
| CN112508187A (en) | Machine learning model compression method, device and equipment | |
| CN110830806A (en) | Video frame prediction method and device and terminal equipment | |
| Paul et al. | Image compression scheme based on histogram equalization and convolution neural network | |
| CN107172425B (en) | Thumbnail generation method and device and terminal equipment | |
| CN110968832A (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 518101 District D and E, 7th Floor, Building 3, Tingwei Industrial Park, 6 Liufang Road, Xin'an Street, Baoan District, Shenzhen City, Guangdong Province Applicant after: Shenzhen Aixiesheng Technology Co.,Ltd. Address before: 518101 District D and E, 7th Floor, Building 3, Tingwei Industrial Park, 6 Liufang Road, Xin'an Street, Baoan District, Shenzhen City, Guangdong Province Applicant before: SHENZHEN AIXIESHENG TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information |