CN111432212B - Intra-frame division method and system based on texture features and storage medium - Google Patents

Intra-frame division method and system based on texture features and storage medium Download PDF

Info

Publication number
CN111432212B
CN111432212B CN202010351187.5A CN202010351187A CN111432212B CN 111432212 B CN111432212 B CN 111432212B CN 202010351187 A CN202010351187 A CN 202010351187A CN 111432212 B CN111432212 B CN 111432212B
Authority
CN
China
Prior art keywords
index
coding unit
mad
texture
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010351187.5A
Other languages
Chinese (zh)
Other versions
CN111432212A (en
Inventor
梁凡
谭敏仪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sun Yat Sen University
Original Assignee
Sun Yat Sen University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sun Yat Sen University filed Critical Sun Yat Sen University
Priority to CN202010351187.5A priority Critical patent/CN111432212B/en
Publication of CN111432212A publication Critical patent/CN111432212A/en
Application granted granted Critical
Publication of CN111432212B publication Critical patent/CN111432212B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96—Tree coding, e.g. quad-tree coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention discloses an intra-frame division method, a system and a storage medium based on texture features, wherein the method comprises the following steps: extracting first texture information of a coding unit through a first index, a second index and a third index, and dividing the coding unit into a first coding unit, a second coding unit or a third coding unit; wherein, the first coding unit is a coding unit capable of terminating division; then determining a division mode of the second coding unit according to a fourth index and a fifth index; and finally, determining the dividing mode of the third coding unit through a sixth index and a seventh index. The invention deletes redundant partition modes by determining the partition modes of each code and determining the optimal partition mode, thereby reducing the complexity of the encoder and being widely applied to the technical field of data processing.

Description

Intra-frame division method and system based on texture features and storage medium
Technical Field
The invention relates to the technical field of data processing, in particular to an intra-frame division method, an intra-frame division system and a storage medium based on texture features.
Background
VVC/h.266 is a next generation video coding standard that is further developed based on the HEVC/h.265 coding standard. The VVC standard is currently being formulated, and it inherits most of the traditional coding tools and hybrid coding frameworks, including intra (inter) prediction, transform quantization, entropy coding and loop filtering, but also adopts many new techniques while continuing most of the coding tools, so that the coding efficiency is greatly improved. The aim of the H.266/VVC is to reduce the coding rate of the H.266/VVC to half of that of the H.265/HEVC compared with the H.265/HEVC under the same quality condition.
In order to better describe the texture of video content, H.266/VVC introduces MTT partition on the basis of H.265/HEVC, i.e. BT and TT partitions are added on the basis of QT partition. The QT division is the same as that specified in the H.265/HEVC standard, namely, a CU is divided into four sub-blocks with equal areas, and the length and width of the CU of each sub-node are half of those of the CU of the original parent node. And the newly introduced BT and TT divisions have both horizontal and vertical directions, wherein the BT division divides a CU into two sub-blocks with equal areas, if the BT division is divided horizontally, the length of the CU of the sub-block is consistent with that of the CU of a parent node, and the width of the CU of the sub-block is half of that of the CU of the parent node, and otherwise, if the BT division is divided vertically, the width of the CU of the sub-block is consistent with that of the CU of the parent node, and the length of the CU of the sub-block is half of that of the CU of the parent node. TT division instead divides the CU into three sub-blocks with an area ratio of 1:2: 1.
In addition to introducing a new partitioning pattern, the H.266/VVC improves the intra-coded portion. First the h.266/VVC refines the angular modes, extending from 33 angular modes of HEVC to 65. Besides, VVCs introduce wide-angle prediction mode, PDPC prediction mode, MRL prediction mode, ISP prediction mode, and other techniques. The newly introduced prediction mode can better describe the texture in the video image and improve the compression efficiency. The features of the image include color features, texture features, shape features, spatial relationship features, and the like of the image, which may comprehensively describe the content and properties of different aspects of an image, and the content and properties of the image are related to the result of the division of the encoding unit.
However, the VVC has great complexity while improving the compression efficiency, which makes it difficult to put the VVC into practical use.
Disclosure of Invention
In view of the above, embodiments of the present invention provide an intra frame division method, system and storage medium based on texture features, which can improve the complexity of an encoder.
The invention provides an intra-frame division method based on texture features, which comprises the following steps:
extracting first texture information of a coding unit through a first index, a second index and a third index, and dividing the coding unit into a first coding unit, a second coding unit or a third coding unit; the first coding unit is a coding unit capable of terminating partitioning, the second coding unit is a coding unit for executing trifurcate partitioning, and the third coding unit is a coding unit for executing binary or quaternary partitioning;
determining a partition mode of the second coding unit according to a fourth index and a fifth index;
determining a partition mode of the third encoding unit by a sixth index and a seventh index;
wherein the first index is used for determining the pixel consistency of the coding unit;
the second index is used for determining first texture information of the coding unit in the vertical direction;
the third index is used for determining first texture information of the coding unit in the horizontal direction;
the fourth index and the fifth index are used for determining the texture direction of the coding unit;
the sixth index and the seventh index are used to determine the consistency of the texture direction between the sub-blocks.
In some embodiments, the extracting the first texture information of the coding unit according to the first index, the second index and the third index, and dividing the coding unit into the first coding unit, the second coding unit or the third coding unit includes:
when the first texture information is smaller than a first threshold value, determining the coding unit as a first coding unit;
when the first texture information is larger than a second threshold value, determining the coding unit as a second coding unit;
and when the first texture information is larger than a first threshold and smaller than a second threshold, determining the coding unit as a third coding unit.
In some embodiments, the determining the partition mode of the second coding unit according to the fourth index and the fifth index specifically includes:
when the fourth index is larger than the fifth index, determining that the second coding unit executes trifurcate horizontal division;
and when the fourth index is smaller than the fifth index, determining that the second coding unit executes the three-fork vertical division.
In some embodiments, the step of determining the partition mode of the third coding unit according to a sixth index and a seventh index specifically includes:
calculating second texture information of the coding unit according to the sixth index and the seventh index;
when the second texture information is larger than a third threshold value, determining that the third coding unit executes quad-fork division;
when the second texture information is smaller than a fourth threshold value, determining that the third coding unit executes binary partitioning;
and when the second texture information is larger than a fourth threshold and smaller than a third threshold, determining that the third coding unit executes binary division or quad division.
In some embodiments, the first index is determined according to a pixel value of each position on the coding unit, a height value of the coding unit, a width value of the coding unit and a mean value of pixel values in the coding unit;
the calculation formula of the first index is as follows:
Figure BDA0002471882060000031
wherein p (x, y) represents a pixel value located at the position of the x-th column and the y-th row in the coding unit; u height of the coding unit; v represents the width of the coding unit; m represents the mean value of the pixel values in the coding unit.
In some embodiments, the second index is determined according to a pixel value of each position on the coding unit, a height value of the coding unit, a width value of the coding unit and an average value of pixel values of each row in the coding unit;
the calculation formula of the second index is as follows:
Figure BDA0002471882060000032
wherein m isyIs the average of the pixels of the y-th row in the coding unit; p (x, y) represents a pixel value located at the position of the x-th column and the y-th row in the coding unit; u height of the coding unit; v represents the width of the coding unit;
the third index is determined according to the pixel value of each position on the coding unit, the height value of the coding unit, the width value of the coding unit and the average value of the pixel values of each column in the coding unit;
the calculation formula of the third index is as follows:
Figure BDA0002471882060000033
wherein m isxIs the average of the pixels of the x-th column in the coding unit; p (x, y) represents in coding unitPixel values located at the x-th column and y-th row; u height of the coding unit; v represents the width of the coding unit.
In some embodiments, the fourth metric is calculated from the first metric and the second metric;
the fifth index is obtained by calculation according to the first index and the third index;
wherein the calculation formula of the fourth index is as follows:
LENH＝|MAD-MADH|
MAD represents a first index; MADHRepresents a second index;
wherein the calculation formula of the fifth index is:
LENV＝|MAD-MADV|
MAD represents a first index; MADVRepresenting a third index.
In some embodiments, the sixth index is calculated from the second index of each sub-block;
the seventh index is obtained by calculation according to the third index of each sub-block;
wherein the calculation formula of the sixth index is:
diffH＝|MADH1-MADH2|+|MADH3-MADH4|
MADH1a second index representing the first sub-block; MADH2A second index representing a second sub-block; MADH3A second index representing a third sub-block; MADH4A second index representing a fourth sub-block;
the calculation formula of the seventh index is as follows:
diffV＝|MADV1-MADV3|+|MADV2-MADV4|
MADV1a third index representing the first sub-block; MADV2A third index representing the second sub-block; MADV3A third index representing a third sub-block; MADV4Representing the third index of the fourth sub-block.
According to the second aspect of the present invention, there is also provided a texture feature-based intra partition system, including:
the extraction module is used for extracting the first texture information of the coding unit through the first index, the second index and the third index, and dividing the coding unit into a first coding unit, a second coding unit or a third coding unit; the first coding unit is a coding unit capable of terminating partitioning, the second coding unit is a coding unit for executing trifurcate partitioning, and the third coding unit is a coding unit for executing binary or quaternary partitioning;
the first division module is used for determining the division mode of the second coding unit according to a fourth index and a fifth index;
a second dividing module, configured to determine a dividing mode of the third encoding unit according to a sixth index and a seventh index;
wherein the first index is used for determining the pixel consistency of the coding unit;
the second index is used for determining first texture information of the coding unit in the vertical direction;
the third index is used for determining first texture information of the coding unit in the horizontal direction;
the fourth index and the fifth index are used to determine a texture direction of the coding unit.
According to a third aspect of the present invention, there is also provided a storage medium storing a program which is executed by a processor to perform the method according to the first aspect.
The embodiment of the invention extracts the first texture information of the coding unit through the first index, the second index and the third index, and divides the coding unit into a first coding unit, a second coding unit or a third coding unit; wherein, the first coding unit is a coding unit capable of terminating division; then determining a division mode of the second coding unit according to a fourth index and a fifth index; and finally, determining the dividing mode of the third coding unit through a sixth index and a seventh index. The invention deletes redundant division modes by determining the division modes of each code and determining the optimal division mode, thereby reducing the complexity of the encoder.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a flowchart illustrating the overall steps of an embodiment of the present invention;
fig. 2 is a schematic diagram of four sub-blocks according to an embodiment of the invention.
Detailed Description
The invention will be further explained and explained with reference to the drawings and the embodiments in the description. The step numbers in the embodiments of the present invention are set for convenience of illustration only, the order between the steps is not limited at all, and the execution order of each step in the embodiments can be adaptively adjusted according to the understanding of those skilled in the art.
Aiming at the problems in the prior art, the texture of the coding unit is described by adopting 7 indexes, namely MAD and MADH、MADV、LENH、LENv、diffHAnd diffVThe definition and the meaning of these seven indices are explained first below:
1. the first index: MAD;
Figure BDA0002471882060000051
wherein p (x, y) represents the pixel value in the coding unit at the position of (x, y), i.e. the x-th column and the y-th row, u and v represent the Height (Height) and Width (Width) of the coding unit, m represents the mean value of the pixel values in the coding unit, and m is defined as follows
Figure BDA0002471882060000052
Wherein the MAD is used to describe the consistency of pixels of the coding unit. The larger the MAD, the more complex the texture representing the prediction unit, and the greater the probability of further partitioning, whereas the smaller the MAD, the more similar the pixel values in the coding unit, and the more the partitioning tends to terminate.
2. And (3) second index: MADH；
MADHIs defined as follows
Figure BDA0002471882060000053
Wherein m isyIs the average value of the pixels of the y-th row in the coding unit, which is defined as follows
Figure BDA0002471882060000054
MADHFor measuring the vertical texture of the coding unit, if MADHThe larger the size, the more complex it is to say that the texture in the vertical direction on the coding unit is.
3. The third index: MADV；
MADVIs defined as follows
Figure BDA0002471882060000061
Wherein m isxIs the average value of the pixels in the x-th column in the coding unit, which is defined as follows
Figure BDA0002471882060000062
MADvFor measuring the texture in the horizontal direction on the coding unit, if MADvThe larger the size, the horizontal square on the coding unit is indicatedThe texture is complex.
4. Fourth index LENHAnd a fifth index LENv；
LENHAnd LENvIs defined as follows
LENH＝|MAD-MADH|
LENV＝|MAD-MADV|
LENHAnd LENvFor measuring the main direction of the texture in a coding unit. This is because the LENHIs defined as MADHAbsolute value of difference from MAD, LENvIs defined as MADvThe absolute value of the difference from the MAD. If LENH>LENvIt is noted that the MAD value in the coding unit is mainly caused by the texture in the horizontal direction, i.e., it is noted that there is more texture in the horizontal direction in the coding unit. The H.266/VVC encoder VTM is more prone to horizontal binary or trifurcate divisions when encoding the cell. On the contrary, if LENH<LENvIt is noted that the MAD value in the coding unit is mainly caused by the texture in the vertical direction, i.e. the coding unit has more texture in the vertical direction. VTMs are more prone to vertical binary or trifurcate partitioning when encoding the cell.
5. Sixth index diffHAnd a seventh index diffV；
diffHAnd diffVIs defined as follows
diffH＝|MADH1-MADH2|+|MADH3-MADH4|
diffV＝|MADV1-MADV3|+|MADV2-MADV4|
In a coding unit of 32 × 32 size, the embodiment of the present invention divides the CU into four sub-blocks of the same size, as shown in fig. 2, and sequentially marks the upper left, upper right, lower left, and lower right sub-blocks as 1, 2, 3, and 4. After dividing the sub-blocks into four same sub-blocks, the MAD and MAD of each sub-block are calculatedHAnd MADVValue, and is denoted as MADi、MADHiAnd MADViWhere i is the index in each sub-block.
These two metrics are used to measure whether the texture directions of sub-blocks 1, 2, 3 and 4 are consistent. If min (diff)H,diffV) If the size is large, the texture of the CU in both the horizontal and vertical directions is complex, and in this case, the optimal division method is quad division. In the case that the texture directions are relatively consistent, if the texture of the coding unit is mainly in the horizontal direction, the texture direction is usually diffH<diffV. Then the VTM is more inclined to divide the coding unit horizontally when coding. Conversely, if the texture of the coding unit is mainly vertical, then in general diffH>diffVIn this case, the VTM is more apt to vertically divide the coding unit.
The following describes the overall procedure of the steps of the embodiment of the present invention in detail with reference to the attached drawing 1 of the specification:
since the encoding unit of size 32 × 32 is VTM enabled binary and trifurcated partition modes. Like h.265/HEVC, h.266/VVC also uses a recursive approach to obtain the optimal partitioning pattern by traversing all possible partitioning patterns and by rate-distortion optimization. The present embodiment processes the 32 × 32 coding unit to reduce the complexity of coding it by eliminating some redundant partition patterns on the node. Specifically, the present invention can be divided into three processes, and a specific algorithm is as follows.
S1, passing MAD, MADH、MADVThe three indexes extract first texture information texture of the encoding unit1And texture is to be determined1Is defined as texture1＝min(MAD,MADH,MADV)
Then passes through the first threshold th1And a second threshold th2Coding units are classified into A, B and C. The pixel table of the coding unit of the class A (namely, the first coding unit) is flat, and the division can be terminated early; the B type coding unit (namely the second coding unit) has complex texture and then performs trifurcate division; class C coding units (i.e., third coding units) with texture complexity between class A and class B, which are subsequently performed onlyThe row is divided into two or four branches.
In particular, if texture1<th1, then the coding unit is classified as class A; if texture is found1>th2, then the coding unit is classified as class B; if th1<texture1<th2, the coding unit is classified as class C.
S2, the partition pattern of the coding unit of class B is further simplified.
This embodiment is achieved by using LENHAnd LENVThese two metrics describe texture. When LEN is inH>LENVDetermining that the second coding unit performs trifurcated horizontal division; when LEN is inH<LENVAnd determining that the second coding unit performs the trifurcated vertical division.
S3, the partition pattern of the coding unit of class C is further simplified.
This example passes diffHAnd diffVSecond texture information texture for class C coding units2Performing analysis while analyzing texture2Is defined as texture2＝min(diffH,diffV)
Then passes through a third threshold th3And a fourth threshold th4The class C coding units are divided into three classes. If texture is found2>th3, then a quad partition is performed; if texture is found2<th4, then the texture is binary partitioned; finally, if th4<texture2<th3, then the quad and binary split modes compete.
The embodiment of the invention also provides an intra-frame division system based on texture features, which comprises:
the extraction module is used for extracting the first texture information of the coding unit through the first index, the second index and the third index, and dividing the coding unit into a first coding unit, a second coding unit or a third coding unit; the first coding unit is a coding unit capable of being divided in a terminating way, the second coding unit is a coding unit for executing trifurcate division, and the third coding unit is a coding unit for executing binary or quadtree division;
the first division module is used for determining the division mode of the second coding unit according to a fourth index and a fifth index;
a second dividing module, configured to determine a dividing mode of the third encoding unit according to a sixth index and a seventh index;
wherein the first index is used for determining the pixel consistency of the coding unit;
the second index is used for determining first texture information of the coding unit in the vertical direction;
the third index is used for determining first texture information of the coding unit in the horizontal direction;
the fourth index and the fifth index are used to determine a texture direction of the coding unit.
There is also provided, in accordance with an embodiment of the present invention, a storage medium storing a program, the program being executed by a processor to perform the method shown in fig. 1.
In summary, the present invention eliminates redundant partition modes by determining the partition modes of each code and determining the optimal partition mode, thereby reducing the complexity of the encoder.
In alternative embodiments, the functions/acts noted in the block diagrams may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Furthermore, the embodiments presented and described in the flow charts of the present invention are provided by way of example in order to provide a more thorough understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed and in which sub-operations described as part of larger operations are performed independently.
Furthermore, although the present invention is described in the context of functional modules, it should be understood that, unless otherwise stated to the contrary, one or more of the described functions and/or features may be integrated in a single physical device and/or software module, or one or more functions and/or features may be implemented in a separate physical device or software module. It will also be appreciated that a detailed discussion of the actual implementation of each module is not necessary for an understanding of the present invention. Rather, the actual implementation of the various functional modules in the apparatus disclosed herein will be understood within the ordinary skill of an engineer given the nature, function, and interrelationships of the modules. Accordingly, those skilled in the art can, using ordinary skill, practice the invention as set forth in the claims without undue experimentation. It is also to be understood that the specific concepts disclosed are merely illustrative of and not intended to limit the scope of the invention, which is defined by the appended claims and their full scope of equivalents.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention or a part thereof which substantially contributes to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.
While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. The method for dividing the frame based on the texture features is characterized by comprising the following steps:
extracting the minimum value of the first index, the second index and the third index to obtain first texture information, comparing the first texture information with a threshold value, and dividing a coding unit into a first coding unit, a second coding unit or a third coding unit according to the comparison result; the first coding unit is a coding unit capable of terminating partitioning, the second coding unit is a coding unit for executing trifurcate partitioning, and the third coding unit is a coding unit for executing binary or quaternary partitioning;
determining that the second coding unit performs trifurcated horizontal division or trifurcated vertical division according to the size comparison result of the fourth index and the fifth index;
extracting the minimum value of the sixth index and the seventh index to obtain second texture information, comparing the second texture information with a threshold value, and determining that the third coding unit executes quad partitioning or binary partitioning according to the comparison result;
wherein, the first index is used for measuring the pixel consistency of the coding unit;
the second index is used for measuring the texture complexity of the coding unit in the vertical direction;
the third index is used for measuring the texture complexity of the coding unit in the horizontal direction;
the fourth index is the absolute value of the difference between the first index and the second index;
the fifth index is the absolute value of the difference between the first index and the third index;
comparing the fourth index with the fifth index, and dividing the coding unit into four subblocks with the same size, wherein the fourth index is used for measuring the main direction of the texture in the coding unit;
the sixth index is obtained by calculation according to the second index of each sub-block;
the seventh index is obtained by calculation according to the third index of each sub-block;
and comparing the sixth index with the seventh index for measuring the consistency of the texture directions among the sub-blocks.
2. The texture feature-based intra partition method according to claim 1, wherein the step of extracting the first texture information of the coding unit by the first index, the second index and the third index and dividing the coding unit into the first coding unit, the second coding unit or the third coding unit comprises:
when the first texture information is smaller than a first threshold value, determining the coding unit as a first coding unit;
when the first texture information is larger than a second threshold value, determining the coding unit as a second coding unit;
and when the first texture information is larger than a first threshold and smaller than a second threshold, determining the coding unit as a third coding unit.
3. The texture feature-based intra partition method according to claim 1, wherein the step of determining the partition mode of the second coding unit according to a fourth index and a fifth index specifically comprises:
when the fourth index is larger than the fifth index, determining that the second coding unit executes trifurcate horizontal division;
and when the fourth index is smaller than the fifth index, determining that the second coding unit executes the three-fork vertical division.
4. The texture feature-based intra partition method according to claim 1, wherein the step of determining the partition mode of the third coding unit according to a sixth index and a seventh index specifically comprises:
calculating second texture information of the coding unit according to the sixth index and the seventh index;
when the second texture information is larger than a third threshold value, determining that the third coding unit executes quad-fork division;
when the second texture information is smaller than a fourth threshold value, determining that the third coding unit executes binary partitioning;
and when the second texture information is larger than a fourth threshold and smaller than a third threshold, determining that the third coding unit executes binary division or quad division.
5. The texture feature-based intra partition method according to claim 1, wherein the first index is determined according to a pixel value of each position on the coding unit, a height value of the coding unit, a width value of the coding unit, and a mean value of pixel values in the coding unit;
the calculation formula of the first index is as follows:
Figure FDA0003475255790000021
wherein p (x, y) represents a pixel value located at the position of the x-th column and the y-th row in the coding unit; u height of the coding unit; v represents the width of the coding unit; m represents the mean value of the pixel values in the coding unit.
6. The texture feature-based intra partition method according to claim 1, wherein the second index is determined according to pixel values of respective positions on the coding unit, a height value of the coding unit, a width value of the coding unit, and a mean value of pixel values of each row in the coding unit;
the calculation formula of the second index is as follows:
Figure FDA0003475255790000022
wherein m isyIs the average of the pixels of the y-th row in the coding unit; p (x, y) represents a pixel value located at the position of the x-th column and the y-th row in the coding unit; u height of the coding unit; v represents the width of the coding unit;
the third index is determined according to the pixel value of each position on the coding unit, the height value of the coding unit, the width value of the coding unit and the average value of the pixel values of each column in the coding unit;
the calculation formula of the third index is as follows:
Figure FDA0003475255790000023
wherein m isxIs the average of the pixels of the x-th column in the coding unit; p (x, y) represents a pixel value located at the position of the x-th column and the y-th row in the coding unit; u height of the coding unit; v represents the width of the coding unit.
7. The texture feature-based intra frame division method of claim I,
the fourth index is obtained by calculation according to the first index and the second index;
the fifth index is obtained by calculation according to the first index and the third index;
wherein the calculation formula of the fourth index is as follows:
LENH＝|MAD-MADH|
MAD represents a first index; MADHRepresents a second index;
wherein the calculation formula of the fifth index is:
LENV＝|MAD-MADV|
MAD represents a first index; MADVRepresenting a third index.
8. The texture feature-based intra frame division method of claim I,
the sixth index is obtained by calculation according to the second index of each sub-block;
the seventh index is obtained by calculation according to the third index of each sub-block;
wherein the calculation formula of the sixth index is:
diffH＝｜MADH1-MADH2|+|MADH3-MADH4|
MADH1a second index representing the first sub-block; MADH2A second index representing a second sub-block; MADH3A second index representing a third sub-block; MADH4A second index representing a fourth sub-block;
the calculation formula of the seventh index is as follows:
diffV＝|MADV1-MADV3|+|MADV2-MADV4|
MADV1a third index representing the first sub-block; MADV2A third index representing the second sub-block; MADV3A third index representing a third sub-block; MADV4Representing the third index of the fourth sub-block.
9. An intra-frame partitioning system based on texture features, comprising:
the extraction module is used for extracting the minimum value of the first index, the second index and the third index to obtain first texture information, comparing the first texture information with a threshold value, and dividing a coding unit into a first coding unit, a second coding unit or a third coding unit according to a comparison result; the first coding unit is a coding unit capable of terminating partitioning, the second coding unit is a coding unit for executing trifurcate partitioning, and the third coding unit is a coding unit for executing binary or quaternary partitioning;
the first division module is used for determining that the second coding unit executes trifurcate horizontal division or trifurcate vertical division according to the size comparison result of the fourth index and the fifth index;
the second dividing module is used for extracting the minimum value of the sixth index and the seventh index to obtain second texture information, comparing the second texture information with a threshold value, and determining that the third coding unit executes four-fork division or two-fork division according to the comparison result;
wherein, the first index is used for measuring the pixel consistency of the coding unit;
the second index is used for measuring the texture complexity of the coding unit in the vertical direction;
the third index is used for measuring the texture complexity of the coding unit in the horizontal direction;
the fourth index is the absolute value of the difference between the first index and the second index;
the fifth index is the absolute value of the difference between the first index and the third index;
comparing the fourth index with the fifth index, and dividing the coding unit into four subblocks with the same size, wherein the fourth index is used for measuring the main direction of the texture in the coding unit;
the sixth index is obtained by calculation according to the second index of each sub-block;
the seventh index is obtained by calculation according to the third index of each sub-block;
and comparing the sixth index with the seventh index, and measuring the consistency of the texture directions among the sub-blocks.
10. A storage medium, characterized in that the storage medium stores a program, which is executed by a processor to perform the method according to any one of claims 1-8.
CN202010351187.5A 2020-04-28 2020-04-28 Intra-frame division method and system based on texture features and storage medium Active CN111432212B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010351187.5A CN111432212B (en) 2020-04-28 2020-04-28 Intra-frame division method and system based on texture features and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010351187.5A CN111432212B (en) 2020-04-28 2020-04-28 Intra-frame division method and system based on texture features and storage medium

Publications (2)

Publication Number Publication Date
CN111432212A CN111432212A (en) 2020-07-17
CN111432212B true CN111432212B (en) 2022-05-10

Family

ID=71554697

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010351187.5A Active CN111432212B (en) 2020-04-28 2020-04-28 Intra-frame division method and system based on texture features and storage medium

Country Status (1)

Country Link
CN (1) CN111432212B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112954321B (en) * 2021-02-01 2022-09-16 中山大学 Image feature intra-frame division method, device, equipment and medium
CN113747177B (en) * 2021-08-05 2023-06-20 中山大学 Intra-frame coding speed optimization method, device and medium based on historical information
CN115802044B (en) * 2023-02-06 2023-08-18 深流微智能科技(深圳)有限公司 Determination device, apparatus and storage medium for coding block division mode

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110446036B (en) * 2019-07-29 2021-11-16 中南大学 Coding unit rapid partitioning method based on intra-frame coding in multipurpose coding
CN110650338B (en) * 2019-09-20 2021-11-16 中山大学 Method, system and storage medium for dividing multifunctional video coding frame
CN110691254B (en) * 2019-09-20 2022-01-18 中山大学 Quick judgment method, system and storage medium for multifunctional video coding

Also Published As

Publication number Publication date
CN111432212A (en) 2020-07-17

Similar Documents

Publication Publication Date Title
CN111432212B (en) Intra-frame division method and system based on texture features and storage medium
CN110087087B (en) VVC inter-frame coding unit prediction mode early decision and block division early termination method
CN103621079B (en) Intra-prediction method, and encoder and decoder using same
CN108712648B (en) Rapid intra-frame coding method for depth video
Saldanha et al. Configurable fast block partitioning for VVC intra coding using light gradient boosting machine
WO2021232251A1 (en) Point cloud encoding/decoding method, encoder, decoder, and storage medium
CN103947208B (en) Reduce the method and device of deblocking filter
CN110312127B (en) Method for constructing most probable prediction mode list, image coding method and processing device
CN106170093B (en) Intra-frame prediction performance improving coding method
CN112738511B (en) Fast mode decision method and device combined with video analysis
CN111031319B (en) Local illumination compensation prediction method, terminal equipment and computer storage medium
BRPI0923603B1 (en) image decoding device
CN104754362B (en) Image compression method using fine-divided block matching
CN108028945A (en) The apparatus and method of conversion are performed by using singleton coefficient update
CN111586405B (en) Prediction mode rapid selection method based on ALF filtering in multifunctional video coding
CN110971897B (en) Method, apparatus and system for encoding and decoding intra prediction mode of chrominance component
CN105306957A (en) Adaptive loop filtering method and device
CN114040211B (en) AVS 3-based intra-frame prediction fast decision method
CN110290383B (en) Intra-frame prediction mode selection method, encoder and storage device
CN1917645B (en) Method for encoding block of coefficient
CN110352599A (en) Method for video processing and equipment
CN103828366B (en) A kind of coding and decoding methods, coding and decoding equipment
CN114040210B (en) AVS 3-based intra-frame CU rapid partitioning method
CN113115042B (en) Intra-frame decision-making method, device, equipment and medium based on ISP optimization
CN113395516A (en) Intra-frame prediction method and device and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant