CN113115042A - Intra-frame decision-making method, device, equipment and medium based on ISP optimization - Google Patents
Intra-frame decision-making method, device, equipment and medium based on ISP optimization Download PDFInfo
- Publication number
- CN113115042A CN113115042A CN202110330871.XA CN202110330871A CN113115042A CN 113115042 A CN113115042 A CN 113115042A CN 202110330871 A CN202110330871 A CN 202110330871A CN 113115042 A CN113115042 A CN 113115042A
- Authority
- CN
- China
- Prior art keywords
- gradient
- horizontal
- condition
- vertical
- isp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
- H04N19/122—Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Discrete Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses an intra-frame decision method, a device, equipment and a medium based on ISP optimization, wherein the method comprises the following steps: acquiring a coding unit to be tested; performing convolution calculation on the coding unit to be detected through a Sobe l operator, and extracting a horizontal gradient and a vertical gradient in image characteristics; performing first condition judgment on the horizontal gradient through a first judgment condition, and performing second condition judgment on the vertical gradient through a second judgment condition to generate a condition judgment result; and determining a horizontal tendency degree and a vertical tendency degree according to the condition judgment result, and performing ISP division on the horizontal gradient or the vertical gradient. The invention can reduce the time complexity of the decision process. The invention can be widely applied to the technical field of computers.
Description
Technical Field
The invention relates to the technical field of computers, in particular to an intra-frame decision method, an intra-frame decision device, intra-frame decision equipment and an intra-frame decision medium based on ISP optimization.
Background
The h.266/VVC is a latest generation video coding standard, and aims to improve compression performance by 50% compared with the h.265/HEVC coding standard, and increase applicable scenes, such as HDR video, 360 degree video, and the like. The H.266/VVC can help users store more high-definition videos on the device, so that data traffic on a network is reduced, and functions of high resolution, high dynamic range, screen content coding and the like are supported in main10 profile. The H.266/VVC still uses the hybrid coding framework of H.265/HEVC, but new coding techniques are introduced in modules such as transformation, quantization, entropy coding, intra-frame prediction, inter-frame prediction, loop filtering and the like.
The VVC also changes greatly in the intra prediction mode. First, the angular modes are extended from 35 to 67 in HEVC, and the wide angular modes are added for the rectangular blocks for replacement. Secondly, prediction modes such as MIP, ISP, MRL and the like are introduced, and separate and independent prediction of a luminance block and a chrominance block is supported, namely, a new CCLM technology is added. The newly introduced technologies improve the coding performance, and also support the compression coding of the higher resolution video, so that the transmission delay and the quality of the video are improved, and the rapid development of the video industry is promoted.
Intra-frame prediction is a coding technique that uses neighboring coding blocks for prediction, and can reduce spatial redundancy, thereby reducing the transmission coding bit rate. In the intra-frame prediction process, firstly two times of rough selection are carried out, SATD and SAD optimal cost screening is carried out on 37 angle modes, and the first N modes with the minimum coding cost are selected. And then, according to coding needs, making decisions of modes such as MRL, ISP, MIP and the like, and writing the optimal M modes into a prediction mode candidate list. Finally, traversing the candidate list to obtain a unique optimal mode, and transmitting the mode index number to a decoding end.
In the above process, the time complexity of decision making is high due to the long time consumption of the ISP coding tool.
Disclosure of Invention
In view of this, embodiments of the present invention provide an intra-frame decision method, an intra-frame decision device, an intra-frame decision apparatus, and an intra-frame decision medium based on ISP optimization, so as to reduce the time complexity of the decision process.
One aspect of the present invention provides an intra-frame decision method based on ISP optimization, including:
acquiring a coding unit to be tested;
performing convolution calculation on the coding unit to be detected through a Sobel operator, and extracting a horizontal gradient and a vertical gradient in image characteristics;
performing first condition judgment on the horizontal gradient through a first judgment condition, and performing second condition judgment on the vertical gradient through a second judgment condition to generate a condition judgment result;
and determining a horizontal tendency degree and a vertical tendency degree according to the condition judgment result, and performing ISP division on the horizontal gradient or the vertical gradient.
Optionally, the performing convolution calculation on the coding unit to be detected through a Sobel operator to extract a horizontal gradient and a vertical gradient in the image feature includes:
carrying out convolution calculation on the image unit of the coding unit to be detected through a Sobel operator to obtain image characteristics;
extracting horizontal and vertical gradients in the image feature.
Optionally, the extracting a horizontal gradient and a vertical gradient in the image feature includes:
filling edge pixels of each encoding unit to be detected with the number of 32 multiplied by 32;
performing convolution calculation on the adjacent 3 x 3 pixel matrix of each pixel and the corresponding convolution kernel to obtain a gradient value of each original pixel position;
and adding the gradient values of all pixel positions to obtain a horizontal gradient or a vertical gradient.
Alternatively,
the expression formula of the horizontal gradient is as follows:
the calculation formula of the vertical gradient is as follows:
wherein G isxRepresents a horizontal gradient; gyRepresents a vertical gradient; i denotes a 3 × 3 matrix of adjacent pixels centered around each pixel of the encoded block.
Optionally, the performing a first conditional determination on the horizontal gradient by a first determination condition and performing a second conditional determination on the vertical gradient by a second determination condition may generate a conditional determination result, where an expression of the first determination condition is:
Max(Gx,Gy)/Min(Gx,Gy)>Th1&&Gx>Gy
the expression of the second determination condition is:
Max(Gx,Gy)/Min(Gx,Gy)>Th1&&Gx<Gy
wherein G isxRepresents a horizontal gradient; gyRepresents a vertical gradient; th1 denotes a threshold;
when the first judgment condition is satisfied, determining that the condition judgment result is that the horizontal trend is obvious;
and when the second judgment condition is established, the judgment result of the judgment condition is that the vertical trend is obvious.
Optionally, the determining a horizontal tendency degree and a vertical tendency degree according to the condition determination result, and performing ISP division on the horizontal gradient or the vertical gradient includes:
when the condition judgment result shows that the horizontal trend is obvious, the angle mode in the vertical division MPM list in the RD-cost candidate list is forbidden, and the angle mode in the horizontal division MPM list in the RD-cost candidate list is divided;
and when the condition judgment result shows that the vertical trend is obvious, the angle mode in the horizontal division MPM list in the RD-cost candidate list is forbidden, and the angle mode in the vertical division MPM list in the RD-cost candidate list is divided.
Optionally, the RD-cost candidate list includes a horizontally-partitioned MPM list and a vertically-partitioned MPM list, and the horizontally-partitioned MPM list and the vertically-partitioned MPM list respectively have 6 angle modes therein.
Another aspect of the embodiments of the present invention further provides an intra-frame decision device based on ISP optimization, including:
the acquisition module is used for acquiring the coding unit to be tested;
the extraction module is used for performing convolution calculation on the coding unit to be detected through a Sobel operator and extracting a horizontal gradient and a vertical gradient in image characteristics;
the judging module is used for carrying out first condition judgment on the horizontal gradient through a first judging condition and carrying out second condition judgment on the vertical gradient through a second judging condition to generate a condition judging result;
and the ISP division module is used for determining the horizontal tendency degree and the vertical tendency degree according to the condition judgment result and carrying out ISP division on the horizontal gradient or the vertical gradient.
Another aspect of the embodiments of the present invention further provides an electronic device, including a processor and a memory;
the memory is used for storing programs;
the processor executes the program to implement the method as described above.
Yet another aspect of the embodiments of the present invention provides a computer-readable storage medium, which stores a program, which is executed by a processor to implement the method as described above.
The embodiment of the invention also discloses a computer program product or a computer program, which comprises computer instructions, and the computer instructions are stored in a computer readable storage medium. The computer instructions may be read by a processor of a computer device from a computer-readable storage medium, and the computer instructions executed by the processor cause the computer device to perform the foregoing method.
The embodiment of the invention firstly obtains a coding unit to be tested; performing convolution calculation on the coding unit to be detected through a Sobel operator, and extracting a horizontal gradient and a vertical gradient in image characteristics; performing first condition judgment on the horizontal gradient through a first judgment condition, and performing second condition judgment on the vertical gradient through a second judgment condition to generate a condition judgment result; and determining a horizontal tendency degree and a vertical tendency degree according to the condition judgment result, and performing ISP division on the horizontal gradient or the vertical gradient. The invention can reduce the time complexity of the decision process.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a diagram illustrating an example of a coding unit and a pixel matrix according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating an example of ISP partitioning provided by an embodiment of the present invention;
fig. 3 is a flowchart illustrating a method for intra-frame decision according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Aiming at the problems in the prior art, the embodiment of the invention provides an intra-frame decision method based on ISP optimization, which comprises the following steps:
acquiring a coding unit to be tested;
performing convolution calculation on the coding unit to be detected through a Sobel operator, and extracting a horizontal gradient and a vertical gradient in image characteristics;
performing first condition judgment on the horizontal gradient through a first judgment condition, and performing second condition judgment on the vertical gradient through a second judgment condition to generate a condition judgment result;
and determining a horizontal tendency degree and a vertical tendency degree according to the condition judgment result, and performing ISP division on the horizontal gradient or the vertical gradient.
Optionally, the performing convolution calculation on the coding unit to be detected through a Sobel operator to extract a horizontal gradient and a vertical gradient in the image feature includes:
carrying out convolution calculation on the image unit of the coding unit to be detected through a Sobel operator to obtain image characteristics;
extracting horizontal and vertical gradients in the image feature.
Optionally, the extracting a horizontal gradient and a vertical gradient in the image feature includes:
filling edge pixels of each encoding unit to be detected with the number of 32 multiplied by 32;
performing convolution calculation on the adjacent 3 x 3 pixel matrix of each pixel and the corresponding convolution kernel to obtain a gradient value of each original pixel position;
and adding the gradient values of all pixel positions to obtain a horizontal gradient or a vertical gradient.
Alternatively,
the expression formula of the horizontal gradient is as follows:
the calculation formula of the vertical gradient is as follows:
wherein G isxRepresents a horizontal gradient; gyRepresents a vertical gradient; i denotes a 3 × 3 matrix of adjacent pixels centered around each pixel of the encoded block.
Optionally, the performing a first conditional determination on the horizontal gradient by a first determination condition and performing a second conditional determination on the vertical gradient by a second determination condition may generate a conditional determination result, where an expression of the first determination condition is:
Max(Gx,Gy)/Min(Gx,Gy)>Th1&&Gx>Gy
the expression of the second determination condition is:
Max(Gx,Gy)/Min(Gx,Gy)>Th1&&Gx<Gy
wherein G isxRepresents a horizontal gradient; gyRepresents a vertical gradient; th1 denotes a threshold;
when the first judgment condition is satisfied, determining that the condition judgment result is that the horizontal trend is obvious;
and when the second judgment condition is established, the judgment result of the judgment condition is that the vertical trend is obvious.
Optionally, the determining a horizontal tendency degree and a vertical tendency degree according to the condition determination result, and performing ISP division on the horizontal gradient or the vertical gradient includes:
when the condition judgment result shows that the horizontal trend is obvious, the angle mode in the vertical division MPM list in the RD-cost candidate list is forbidden, and the angle mode in the horizontal division MPM list in the RD-cost candidate list is divided;
and when the condition judgment result shows that the vertical trend is obvious, the angle mode in the horizontal division MPM list in the RD-cost candidate list is forbidden, and the angle mode in the vertical division MPM list in the RD-cost candidate list is divided.
Optionally, the RD-cost candidate list includes a horizontally-partitioned MPM list and a vertically-partitioned MPM list, and the horizontally-partitioned MPM list and the vertically-partitioned MPM list respectively have 6 angle modes therein.
Another aspect of the embodiments of the present invention further provides an intra-frame decision device based on ISP optimization, including:
the acquisition module is used for acquiring the coding unit to be tested;
the extraction module is used for performing convolution calculation on the coding unit to be detected through a Sobel operator and extracting a horizontal gradient and a vertical gradient in image characteristics;
the judging module is used for carrying out first condition judgment on the horizontal gradient through a first judging condition and carrying out second condition judgment on the vertical gradient through a second judging condition to generate a condition judging result;
and the ISP division module is used for determining the horizontal tendency degree and the vertical tendency degree according to the condition judgment result and carrying out ISP division on the horizontal gradient or the vertical gradient.
Another aspect of the embodiments of the present invention further provides an electronic device, including a processor and a memory;
the memory is used for storing programs;
the processor executes the program to implement the method as described above.
Yet another aspect of the embodiments of the present invention provides a computer-readable storage medium, which stores a program, which is executed by a processor to implement the method as described above.
The embodiment of the invention also discloses a computer program product or a computer program, which comprises computer instructions, and the computer instructions are stored in a computer readable storage medium. The computer instructions may be read by a processor of a computer device from a computer-readable storage medium, and the computer instructions executed by the processor cause the computer device to perform the foregoing method.
The following describes in detail the implementation process of the intra-frame decision method provided by the embodiment of the present invention with reference to the drawings in the specification:
firstly, in the process of the prior art, because the ISP coding tool consumes a long time, the invention provides a quick decision algorithm for optimization aiming at the process, and can effectively reduce the time complexity.
The encoding complexity of intra prediction for H.266/VVC is largely derived from the number of prediction candidate lists. In the intra-frame prediction process, an encoder traverses an angle mode, an MIP mode, an ISP mode and the like, each mode needs to go through the complete processes of prediction, transformation quantization, entropy coding and the like, and finally the optimal mode is obtained through the comparison of rate-distortion cost. Therefore, the unnecessary candidate modes are eliminated by using the image texture characteristics, the number of the candidate modes is reduced, and the encoding time is reduced.
Regions of similar texture tend to select the same pattern. The invention uses an effective Sobel operator to carry out convolution calculation on image units, extracts horizontal gradient and vertical gradient in image characteristics to carry out quick judgment, and removes intra-frame candidate modes which do not accord with image texture characteristics. The calculations in which the horizontal and vertical gradients are extracted are as follows:
where I represents a 3 × 3 matrix of adjacent pixels centered around each pixel of the coding block, and equation (1) and equation (2) yield the horizontal and vertical gradients of the luminance block, respectively.
The specific implementation process is to fill each 32 × 32 CU with edge pixels, as shown in the gray part in fig. 1. The adjacent 3 x 3 pixel matrix (e.g., the portion within the dashed box in fig. 1) of each pixel is then convolved with the different convolution kernels of equations (1) (2), so that each original pixel position yields a gradient value, and finally all the gradient values are summed. For example, the horizontal gradient calculation for the red pixel location in FIG. 1 is demonstrated as follows:
Gx＝A×(-1)+A×(-2)+C×(-1)+0×A+0×A+0×C+B×1+B×2+D×1
ISP is an intra-frame prediction coding tool newly introduced by H.266/VVC. And when the ISP tool is started, cutting according to the aspect ratio of the brightness block to obtain sub-blocks with pixel points larger than 16. The division mode is divided into a vertical division mode and a horizontal division mode, and the division depths of the coding blocks with different sizes are different. As shown in fig. 2.
The ISP mode divides the original coding blocks into smaller blocks, and the distance between the reference pixel and the prediction pixel is shortened, so that the transformed residual error is smaller, the code rate is saved, and the coding performance is improved.
In the actual encoding process, the sub-blocks are first divided. The 4 x 4 block is not partitioned, i.e. ISP mode is not used. The encoder actually divides the 4 × 8 and 8 × 4 coded blocks into 4 sub-blocks, halving the remaining size. Then, a candidate MPM list in the horizontal and vertical directions is respectively constructed, and each list has 6 angle modes, namely { Planar, DC, V, H, V-4 and V +4 }. The encoder will write these 12 patterns into the RD-cost candidate list, waiting for the final fine selection phase mode decision.
In the above process, it can be found that when the ISP mode is enabled, 12 modes need to be occupied in the RD-cost candidate list, far exceeding the angle mode, MIP mode, etc. that are joined previously. Therefore, the present invention calculates horizontal and vertical textures using the sobel operator mentioned above, and disables the ISP partitioning mode in the opposite direction except DC and PLANAR when the luma coding block has a significant texture direction. DC and planet are special angular patterns numbered 0 and 1 that cannot be easily excluded.
Max(Gx,Gy)/Min(Gx,Gy)>Th1&&Gx>Gy (3)
Max(Gx,Gy)/Min(Gx,Gy)>Th1&&Gx<Gy (4)
Where Th1 denotes a threshold value, and the value is 5. When formula (3) is satisfied, considering that the horizontal trend is obvious, selecting an angle mode in the MPM list of the vertical division skipping ISP; when equation (4) is satisfied, the vertical trend is considered significant, and the angle mode in the horizontally partitioned MPM list is chosen to skip the ISP. The general flow of the algorithm is shown in fig. 3.
In alternative embodiments, the functions/acts noted in the block diagrams may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Furthermore, the embodiments presented and described in the flow charts of the present invention are provided by way of example in order to provide a more thorough understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed and in which sub-operations described as part of larger operations are performed independently.
Furthermore, although the present invention is described in the context of functional modules, it should be understood that, unless otherwise stated to the contrary, one or more of the described functions and/or features may be integrated in a single physical device and/or software module, or one or more functions and/or features may be implemented in a separate physical device or software module. It will also be appreciated that a detailed discussion of the actual implementation of each module is not necessary for an understanding of the present invention. Rather, the actual implementation of the various functional modules in the apparatus disclosed herein will be understood within the ordinary skill of an engineer, given the nature, function, and internal relationship of the modules. Accordingly, those skilled in the art can, using ordinary skill, practice the invention as set forth in the claims without undue experimentation. It is also to be understood that the specific concepts disclosed are merely illustrative of and not intended to limit the scope of the invention, which is defined by the appended claims and their full scope of equivalents.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.
While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. An ISP optimization-based intra-frame decision method is characterized by comprising the following steps:
acquiring a coding unit to be tested;
performing convolution calculation on the coding unit to be detected through a Sobel operator, and extracting a horizontal gradient and a vertical gradient in image characteristics;
performing first condition judgment on the horizontal gradient through a first judgment condition, and performing second condition judgment on the vertical gradient through a second judgment condition to generate a condition judgment result;
and determining a horizontal tendency degree and a vertical tendency degree according to the condition judgment result, and performing ISP division on the horizontal gradient or the vertical gradient.
2. The ISP-optimization-based intra-frame decision method as claimed in claim 1, wherein the extracting horizontal gradients and vertical gradients in image features by performing convolution calculation on the coding unit to be tested through a Sobel operator comprises:
carrying out convolution calculation on the image unit of the coding unit to be detected through a Sobel operator to obtain image characteristics;
extracting horizontal and vertical gradients in the image feature.
3. The ISP-optimization-based intra-frame decision method as claimed in claim 2, wherein the extracting horizontal gradients and vertical gradients in the image features comprises:
filling edge pixels of each encoding unit to be detected with the number of 32 multiplied by 32;
performing convolution calculation on the adjacent 3 x 3 pixel matrix of each pixel and the corresponding convolution kernel to obtain a gradient value of each original pixel position;
and adding the gradient values of all pixel positions to obtain a horizontal gradient or a vertical gradient.
4. The ISP-based optimized intra decision method as claimed in claim 3,
the expression formula of the horizontal gradient is as follows:
the calculation formula of the vertical gradient is as follows:
wherein G isxRepresents a horizontal gradient; gyRepresents a vertical gradient; i denotes a 3 × 3 matrix of adjacent pixels centered around each pixel of the encoded block.
5. The ISP-based optimized intra decision method according to claim 1, wherein the conditional decision result is generated by performing a first conditional decision on the horizontal gradient through a first decision condition and performing a second conditional decision on the vertical gradient through a second decision condition, wherein the first decision condition is expressed as:
Max(Gx,Gy)/Min(Gx,Gy)>Th1&&Gx>Gy
the expression of the second determination condition is:
Max(Gx,Gy)/Min(Gx,Gy)>Th1&&Gx<Gy
wherein G isxRepresents a horizontal gradient; gyRepresents a vertical gradient; th1 denotes a threshold;
when the first judgment condition is satisfied, determining that the condition judgment result is that the horizontal trend is obvious;
and when the second judgment condition is established, the judgment result of the judgment condition is that the vertical trend is obvious.
6. The ISP-optimization-based intra-frame decision method as claimed in claim 5, wherein the determining a horizontal tendency degree and a vertical tendency degree according to the condition judgment result and performing ISP division on the horizontal gradient or the vertical gradient comprises:
when the condition judgment result shows that the horizontal trend is obvious, the angle mode in the vertical division MPM list in the RD-cost candidate list is forbidden, and the angle mode in the horizontal division MPM list in the RD-cost candidate list is divided;
and when the condition judgment result shows that the vertical trend is obvious, the angle mode in the horizontal division MPM list in the RD-cost candidate list is forbidden, and the angle mode in the vertical division MPM list in the RD-cost candidate list is divided.
7. The ISP-based optimized intra decision method as claimed in claim 6, wherein the RD-cost candidate list comprises a horizontally partitioned MPM list and a vertically partitioned MPM list, and the horizontally partitioned MPM list and the vertically partitioned MPM list have 6 angle modes therein respectively.
8. An ISP optimization-based intra decision device, comprising:
the acquisition module is used for acquiring the coding unit to be tested;
the extraction module is used for performing convolution calculation on the coding unit to be detected through a Sobel operator and extracting a horizontal gradient and a vertical gradient in image characteristics;
the judging module is used for carrying out first condition judgment on the horizontal gradient through a first judging condition and carrying out second condition judgment on the vertical gradient through a second judging condition to generate a condition judging result;
and the ISP division module is used for determining the horizontal tendency degree and the vertical tendency degree according to the condition judgment result and carrying out ISP division on the horizontal gradient or the vertical gradient.
9. An electronic device comprising a processor and a memory;
the memory is used for storing programs;
the processor executing the program realizes the method according to any one of claims 1-7.
10. A computer-readable storage medium, characterized in that the storage medium stores a program, which is executed by a processor to implement the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110330871.XA CN113115042B (en) | 2021-03-26 | 2021-03-26 | Intra-frame decision-making method, device, equipment and medium based on ISP optimization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110330871.XA CN113115042B (en) | 2021-03-26 | 2021-03-26 | Intra-frame decision-making method, device, equipment and medium based on ISP optimization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113115042A true CN113115042A (en) | 2021-07-13 |
| CN113115042B CN113115042B (en) | 2022-06-24 |
Family
ID=76712601
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110330871.XA Active CN113115042B (en) | 2021-03-26 | 2021-03-26 | Intra-frame decision-making method, device, equipment and medium based on ISP optimization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113115042B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108881904A (en) * | 2018-06-25 | 2018-11-23 | 中山大学 | Quick decision method, device and storage medium in frame based on Sobel operator |
| CN110708546A (en) * | 2019-09-20 | 2020-01-17 | 中山大学 | Intra-frame mode selection and division method, system and storage medium for multifunctional video coding |
| CN111683245A (en) * | 2020-06-23 | 2020-09-18 | 北京工业职业技术学院 | Texture similarity based CU partition decision |
| CN111698504A (en) * | 2019-03-11 | 2020-09-22 | 杭州海康威视数字技术股份有限公司 | Encoding method, decoding method and device |
| US20200336746A1 (en) * | 2019-04-16 | 2020-10-22 | Tencent America LLC | Method and apparatus for video coding |
| CN112188196A (en) * | 2020-09-28 | 2021-01-05 | 长沙理工大学 | Method for rapid intra-frame prediction of general video coding based on texture |
-
2021
- 2021-03-26 CN CN202110330871.XA patent/CN113115042B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108881904A (en) * | 2018-06-25 | 2018-11-23 | 中山大学 | Quick decision method, device and storage medium in frame based on Sobel operator |
| CN111698504A (en) * | 2019-03-11 | 2020-09-22 | 杭州海康威视数字技术股份有限公司 | Encoding method, decoding method and device |
| US20200336746A1 (en) * | 2019-04-16 | 2020-10-22 | Tencent America LLC | Method and apparatus for video coding |
| CN110708546A (en) * | 2019-09-20 | 2020-01-17 | 中山大学 | Intra-frame mode selection and division method, system and storage medium for multifunctional video coding |
| CN111683245A (en) * | 2020-06-23 | 2020-09-18 | 北京工业职业技术学院 | Texture similarity based CU partition decision |
| CN112188196A (en) * | 2020-09-28 | 2021-01-05 | 长沙理工大学 | Method for rapid intra-frame prediction of general video coding based on texture |
Non-Patent Citations (2)
| Title |
|---|
| 王娇娇: "H.266/VVC快速编码算法研究", 《杭州电子科技大学》 * |
| 王娇娇: "H.266/VVC快速编码算法研究", 《杭州电子科技大学》, 1 March 2021 (2021-03-01), pages 1 - 66 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113115042B (en) | 2022-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2665237C1 (en) | Moving image encoding device, moving image decoding device, moving image encoding method and moving image decoding method | |
| JP6820115B2 (en) | A recording medium on which an image coding device, an image decoding device, an image coding method, an image decoding method, and a coded bit stream are recorded. | |
| RU2703229C1 (en) | Image decoding device, image encoding device, image decoding method and image encoding method | |
| US7813428B2 (en) | Method of encoding and decoding video signals | |
| US8855203B2 (en) | Video encoding apparatus and video decoding apparatus | |
| RU2680194C1 (en) | Image encoding device, image decoding device, image encoding method and image decoding method | |
| US10645410B2 (en) | Video decoding apparatus | |
| EP3376768B1 (en) | Image decoding method and apparatus | |
| CN109068142B (en) | 360-degree video intra-frame prediction rapid decision-making method, device, coder-decoder and medium | |
| CN110087083B (en) | Method for selecting intra chroma prediction mode, image processing apparatus, and storage apparatus | |
| CN105306957A (en) | Adaptive loop filtering method and device | |
| CN111432212B (en) | Intra-frame division method and system based on texture features and storage medium | |
| CN110312127B (en) | Method for constructing most probable prediction mode list, image coding method and processing device | |
| CN113365059B (en) | Image redundancy removing method, image redundancy removing device, storage medium and apparatus | |
| CN110971897B (en) | Method, apparatus and system for encoding and decoding intra prediction mode of chrominance component | |
| CN113115042B (en) | Intra-frame decision-making method, device, equipment and medium based on ISP optimization | |
| CN113365080B (en) | Encoding and decoding method, device and storage medium for string coding technology | |
| CN114827606A (en) | Quick decision-making method for coding unit division | |
| CN113794884B (en) | Encoding and decoding method, device and equipment | |
| CN114615498A (en) | Video decoding method, video encoding method, related device and storage medium | |
| CN116250240A (en) | Image encoding method, image decoding method and related devices | |
| CN110312126B (en) | Method for constructing most probable prediction mode list, image coding method and processing device | |
| CN111614958B (en) | Video steganography method based on half-pixel motion compensation | |
| CN109889842B (en) | Virtual reality video CU partitioning algorithm based on KNN classifier |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |