CN111754487B - Black frame region cutting method and device and electronic equipment - Google Patents
Black frame region cutting method and device and electronic equipment Download PDFInfo
- Publication number
- CN111754487B CN111754487B CN202010590037.XA CN202010590037A CN111754487B CN 111754487 B CN111754487 B CN 111754487B CN 202010590037 A CN202010590037 A CN 202010590037A CN 111754487 B CN111754487 B CN 111754487B
- Authority
- CN
- China
- Prior art keywords
- black frame
- picture
- frame region
- position information
- region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/136—Segmentation; Edge detection involving thresholding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20112—Image segmentation details
- G06T2207/20132—Image cropping
Abstract
The embodiment of the invention provides a black frame region cutting method, a black frame region cutting device and electronic equipment, which are applied to the technical field of picture processing, wherein the method comprises the following steps: obtaining a target picture of a black frame area to be cut; the target picture is any picture in a picture set formed by frame extraction; determining initial position information of a black frame area of the target picture in a pixel statistics mode; judging whether the determined black frame region of the target picture meets an excessive cutting condition or not based on the difference between the initial position information and the standard position information about the black frame region corresponding to the picture set; when the judgment result is yes, cutting a black frame area of the target picture according to the standard position information; otherwise, cutting the black frame area of the target picture according to the initial position information. By applying the scheme, the probability of excessive cutting of the black frame area of the picture in the picture set can be reduced.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a black frame region clipping method and apparatus, and an electronic device.
Background
For image display effects, it is often necessary to crop black frame areas on the edges of each picture in a picture set for a picture set formed by framing a video. Although the black frame areas of the pictures in the picture set are consistent in size, the color difference of each picture in the picture set may be large, so in order to avoid the problem of inaccurate clipping caused by improper size selection of the black frame areas, when the black frame areas are clipped for the pictures in the picture set, the black frame areas are usually analyzed for each picture, and clipping processing is performed by using the analyzed black frame areas.
In the prior art, the black frame region clipping method comprises the following steps: and determining the position information of the black frame region of the picture in a pixel statistics mode, and then cutting the black frame region from the picture according to the determined position information of the black frame region to obtain the cut picture. The method comprises the steps of determining position information of a black frame area of a picture in a pixel statistics mode, wherein the position information specifically refers to: converting the picture into a gray scale picture, counting the proportion of the designated non-black pixels in each row to the row from the upper edge of the gray scale picture, and determining the row as an upper black frame area boundary when a row with the proportion being larger than a designated proportion threshold value is detected for the first time; in a similar manner, starting from the lower edge, the left edge and the right edge of the picture, the boundaries of the black frame area on the other sides of the black frame area are searched row by row or column by column, and then the position information of the black frame area is obtained.
However, since the method determines the boundary of the black frame region by counting the proportion of non-black pixels in each row/column of the picture, the clipping method in the prior art is applied to some pictures with darker brightness or full black, and the part belonging to the picture content in the picture is clearly clipped, that is, the phenomenon of excessive clipping occurs.
Disclosure of Invention
The embodiment of the invention aims to provide a black frame region clipping method, a black frame region clipping device and electronic equipment, so as to reduce the probability of excessive clipping of a black frame region of a picture in a picture set. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides a black frame region clipping method, which is applied to an electronic device, and the method includes:
obtaining a target picture of a black frame area to be cut; the target picture is any picture in a picture set formed by frame extraction;
determining initial position information of a black frame area of the target picture in a pixel statistics mode;
judging whether the determined black frame region of the target picture meets a preset excessive cutting condition or not based on the difference of the initial position information and the standard position information about the black frame region corresponding to the picture set; the standard position information is position information of a black frame region which accords with a preset non-excessive cutting condition after each picture of the picture set is divided according to a specified black frame region dividing mode;
When the judgment result is yes, cutting a black frame area of the target picture according to the standard position information; otherwise, cutting the black frame area of the target picture according to the initial position information.
Optionally, the initial position information includes: the standard position information includes, with respect to initial position information of each side black frame region boundary: standard position information on the boundary of each side black frame region;
the determining whether the determined black frame region of the target picture meets a predetermined over-clipping condition based on the difference between the initial position information and the standard position information about the black frame region corresponding to the picture set includes: calculating a difference between the initial position information and the standard position information about the boundary of each side black frame region;
and when the determined difference value is larger than a first preset threshold value, judging that the determined black frame area of the target picture meets a preset excessive cutting condition, otherwise, judging that the determined black frame area of the target picture does not meet the preset excessive cutting condition.
Optionally, before the obtaining the target picture of the black frame region to be cropped, the method further includes:
Dividing each picture in the picture set according to a designated black frame region dividing mode to obtain a black frame region of each picture;
selecting a target black frame area which meets a preset non-excessive cutting condition from the black frame areas of the pictures;
and acquiring the position information of the target black frame area as standard position information about the black frame area corresponding to the picture set.
Optionally, the dividing the pictures in the picture set according to the specified black frame region dividing manner to obtain black frame regions of the pictures includes:
performing binarization processing on each picture in the picture set to obtain each binarized picture;
and determining the black frame area of each picture by utilizing the size relation between the pixel value of each binarized picture and the second preset threshold value.
Optionally, selecting a target black frame area meeting a predetermined non-overstailors condition from the black frame areas of the pictures, including:
calculating an inter-region difference index of a black frame region and a non-black frame region except the black frame region in the same picture aiming at the black frame region of each picture as a difference index corresponding to the black frame region, wherein the inter-region difference index is used for representing the gray level difference between the black frame region and the non-black frame region;
And selecting a black frame region with the corresponding difference index larger than a preset index value from the black frame regions of the pictures as a target black frame region which meets a preset non-excessive cutting condition.
Optionally, the method further comprises:
and when the black frame region with the corresponding difference index larger than the preset index value is not selected, determining the black frame region with the largest corresponding difference index from the black frame regions of the pictures, and taking the black frame region as a target black frame region which meets the preset non-excessive cutting condition.
Optionally, for the black frame region of each picture, calculating a difference index between the black frame region and a non-black frame region other than the black frame region in the same picture, as a difference index corresponding to the black frame region, including:
for a black frame region of each picture, calculating a difference index between the black frame region and a non-black frame region except the black frame region in the same picture by using a preset formula, and taking the difference index as a difference index corresponding to the black frame region;
wherein the predetermined formula is:
wherein DIR is an inter-region variability index, f (R 1 ) Is the average gray level of the non-black frame region except the black frame region in the same picture, f (R 2 ) MAX is the maximum gray level of the picture to which the black frame region belongs, and MIN is the minimum gray level of the picture to which the black frame region belongs.
In a second aspect, an embodiment of the present invention provides a black frame region clipping device, which is applied to an electronic device, and the device includes:
the acquisition module is used for acquiring a target picture of the black frame area to be cut; the target picture is any picture in a picture set formed by frame extraction;
the first determining module is used for determining initial position information of a black frame area of the target picture in a pixel statistics mode;
the judging module is used for judging whether the determined black frame area of the target picture meets a preset excessive cutting condition or not based on the difference of the initial position information and the standard position information about the black frame area corresponding to the picture set; the standard position information is position information of a black frame region which accords with a preset non-excessive cutting condition after each picture of the picture set is divided according to a specified black frame region dividing mode;
the clipping module is used for clipping the black frame area of the target picture according to the standard position information when the judgment result is yes; otherwise, cutting the black frame area of the target picture according to the initial position information.
Optionally, the initial position information includes: the standard position information includes, with respect to initial position information of each side black frame region boundary: standard position information on the boundary of each side black frame region;
the judging module comprises:
a first determination sub-module for calculating a difference between initial position information and standard position information about each side black frame region boundary;
and the judging sub-module is used for judging that the determined black frame area of the target picture meets the preset excessive cutting condition when the determined difference value is larger than a first preset threshold value, otherwise, judging that the determined black frame area of the target picture does not meet the preset excessive cutting condition.
Optionally, the apparatus further comprises:
the second determining module is used for dividing each picture in the picture set according to a designated black frame region dividing mode before the obtaining module obtains the target picture of the black frame region to be cut, so as to obtain the black frame region of each picture;
the region determining module is used for selecting a target black frame region which meets a preset non-excessive cutting condition from the black frame regions of the pictures;
And the information determining module is used for acquiring the position information of the target black frame area and taking the position information as the standard position information of the black frame area corresponding to the picture set.
Optionally, the second determining module is specifically configured to:
performing binarization processing on each picture in the picture set to obtain each binarized picture;
and determining the black frame area of each picture by utilizing the size relation between the pixel value of each binarized picture and the second preset threshold value.
Optionally, the area determining module is specifically configured to:
calculating an inter-region difference index of a black frame region and a non-black frame region except the black frame region in the same picture aiming at the black frame region of each picture as a difference index corresponding to the black frame region, wherein the inter-region difference index is used for representing the gray level difference between the black frame region and the non-black frame region;
and selecting a black frame region with the corresponding difference index larger than a preset index value from the black frame regions of the pictures as a target black frame region which meets a preset non-excessive cutting condition.
Optionally, the area determining module is further configured to:
and when the black frame region with the corresponding difference index larger than the preset index value is not selected, determining the black frame region with the largest corresponding difference index from the black frame regions of the pictures as the black frame region meeting the preset non-excessive cutting condition.
Optionally, the area determining module calculates, for a black frame area of each picture, an inter-area difference index between the black frame area and a non-black frame area other than the black frame area in the same picture, as a difference index corresponding to the black frame area, including:
for a black frame region of each picture, calculating a difference index between the black frame region and a non-black frame region except the black frame region in the same picture by using a preset formula, and taking the difference index as a difference index corresponding to the black frame region; wherein the predetermined formula is:
wherein DIR is an inter-region variability index, f (R 1 ) Is the average gray level of the non-black frame region except the black frame region in the same picture, f (R 2 ) MAX is the maximum gray level of the picture to which the black frame region belongs, and MIN is the minimum gray level of the picture to which the black frame region belongs.
In a third aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;
a memory for storing a computer program; and the processor is used for realizing the step of the black frame region clipping method when executing the program stored in the memory.
In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium having a computer program stored therein, which when executed by a processor, implements the steps of the black frame region clipping method described above.
The embodiment of the invention has the beneficial effects that:
in the scheme provided by the embodiment of the invention, after the position information of the black frame area is determined based on the pixel statistics mode, the black frame area is cut out not directly according to the position information of the black frame area, but by taking the determined position information as initial position information, comparing the initial position information with the standard position information, corresponding to the picture set, of the black frame area, determining whether the determined black frame area of the target picture meets the excessive cutting condition or not, and selecting different modes according to the determination result to cut out the black frame area. Therefore, through the scheme, the probability of excessive clipping of the black frame area of the picture in the picture set can be reduced.
Of course, it is not necessary for any one product or method of practicing the invention to achieve all of the advantages set forth above at the same time.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of a black frame region clipping method according to an embodiment of the present invention;
FIG. 2 is another flowchart of a black frame region clipping method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a black frame region clipping method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a black frame region clipping device according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In order to reduce the probability of excessive cutting of a black frame region of a picture in a picture set, the embodiment of the invention provides a black frame region cutting method. The black frame region clipping method is applied to an electronic device, and in a specific application, the electronic device may be a server, and of course, the electronic device may also be a terminal device, for example: smart phones, tablet computers, notebook computers, desktop computers, and the like. When the electronic device is a server, the execution body of the execution method may specifically be a server program corresponding to a client having a picture processing function running in the server. And when the electronic device is a terminal device, the execution subject of the execution method may specifically be a client having a picture processing function. In addition, it will be appreciated that the client may be a web page type client, or a APP (Application) type client, as is reasonable.
In addition, in the method for clipping a black frame area provided by the embodiment of the invention, the black frame area is a black frame area on the edge of each picture in the picture set. In practical applications, a picture set is formed by frame-extracting a video, and black frame areas of each picture in the picture set are consistent in size, and one picture set typically contains millions to tens of millions of pictures. Although the black frame areas of the pictures in the picture set are consistent in size, the color difference of each picture in the picture set may be large, so in order to avoid the problem of inaccurate clipping caused by improper size selection of the black frame areas, when the black frame areas are clipped for the pictures in the picture set, the black frame areas are usually analyzed for each picture, and clipping processing is performed by using the analyzed black frame areas.
As shown in fig. 1, the method for clipping a black frame area provided by the embodiment of the invention may include the following steps:
s101, obtaining a target picture of a black frame area to be cut; the target picture is any picture in a picture set formed by frame extraction;
s102, determining initial position information of a black frame area of the target picture in a pixel statistics mode;
S103, judging whether the determined black frame area of the target picture meets a preset excessive cutting condition or not based on the difference of the initial position information and the standard position information about the black frame area corresponding to the picture set;
the standard position information is position information of a black frame region which accords with a preset non-excessive cutting condition after each picture of the picture set is divided according to a specified black frame region division mode.
S104, when the judgment result is yes, cutting a black frame area of the target picture according to the standard position information; otherwise, cutting the black frame area of the target picture according to the initial position information.
In S101, the number of target pictures may be one or more. When the number of the target pictures is multiple, the multiple target pictures can be processed in parallel through multiple processes, so that the aim of accelerating processing is fulfilled.
In S102, the initial position information of the black frame region of the determined target picture includes: initial position information about the boundary of each side black frame region.
The method for determining the initial position information of the black frame area of the target picture by means of pixel statistics may include:
Converting the target picture into a gray picture;
counting the proportion of the designated non-black pixels in each row from the upper edge of the gray picture row by row, determining the row as a side black frame area boundary when a row with the proportion larger than a designated first proportion threshold value is detected for the first time, wherein the row number of the row or the pixel point number value of the row, which is away from the upper edge, can be used as initial position information about the upper side black frame area boundary;
counting the proportion of the designated non-black pixels in each row from the lower edge of the gray picture row by row, determining the row as a lower black frame area boundary when a row with the proportion being larger than a designated second proportion threshold value is detected for the first time, wherein the row number of the row or the pixel number value of the row, which is away from the lower edge, can be used as initial position information about the lower black frame area boundary;
counting the proportion of the designated non-black pixels in each column from the left edge of the gray picture to the column, determining the column as a left black frame region boundary when a column with the proportion larger than a designated third proportion threshold value is detected for the first time, wherein the column number of the column or the pixel number value of the column away from the left edge can be used as initial position information about the left black frame region boundary;
Starting from the right edge of the gray picture, counting the proportion of the designated non-black pixels in each column to the column, determining the column as the right black frame region boundary when a column with the proportion larger than the designated fourth proportion threshold value is detected for the first time, wherein the column number of the column or the pixel number value of the column away from the right edge can be used as initial position information about the right black frame region boundary.
The non-black pixels may be pixels having a value of 10 to 255, or 9 to 255, although not limited thereto. In addition, the first, second, third, and fourth ratio thresholds may be the same or different ratio thresholds, and each ratio threshold may be, for example, a ratio value in 0.1, 0.15, 0.2, or the like.
The initial position information about the boundary of each side black frame region may be expressed in the form of (X 11 ，X 21 ，Y 11 ，Y 21 ) Wherein X is 11 Indicating initial position information about upper black frame region boundary, X 21 Representing initial position information about the boundary of the lower black frame region, Y 11 Representation about left blackInitial position information of frame region boundary, Y 21 Indicating position information about the boundary of the right black frame region.
In S103, in order to reduce the probability of excessive cropping of the black frame region of the picture in the picture set, standard position information about the black frame region, that is, a black frame region standard, may be set for the picture set, and then, by the magnitude of the difference between the standard position information and the initial position information, it is determined whether the determined black frame region of the target picture meets a predetermined excessive cropping condition. Specifically, since the standard position information is the position information of the black frame region that meets the predetermined non-overstock condition, when the initial position information and the standard position information differ greatly, it can be determined that the determined black frame region of the target picture meets the predetermined overstock condition.
Further, each picture used in determining the standard position information may be a small number of pictures of a specified scale in the picture set. Alternatively, the specified ratio may be 10%, 5%, 3%, or the like.
Wherein, the standard position information may include: the standard position information about each side black frame region boundary is the same as the information type of the above-described initial position information about each side black frame region boundary. In addition, the standard position information about the boundary of each side black frame region may be represented as: (X) 12 ，X 22 ，Y 12 ，Y 22 ) Wherein X is 12 Representing standard position information about the boundary of the upper black frame region, X 22 Representing standard position information about the boundary of the lower black frame region, Y 12 Representing standard position information about the boundary of the left black frame region, Y 22 Standard position information about the boundary of the right black frame region is indicated.
The specified black frame region division method used for each picture in the picture set may be a different division method from the pixel value statistics method, and of course, may also be a pixel statistics method, which is also reasonable. For the case that the black frame region division manner is different from the pixel value statistics manner, how to divide the black frame region by using the black frame region division manner will be described later in connection with the specific embodiment.
Wherein, any black frame area meets the predetermined condition of not excessive cutting, can include: the gray scale difference between the black frame region and the non-black frame region except for the black frame region in the same picture is the largest, or the gray scale difference between the black frame region and the non-black frame region is larger than a predetermined difference threshold. How to select the black frame region meeting the predetermined non-overscut condition will be described later in connection with the embodiment.
There are various implementations of judging whether the determined black frame region of the target picture meets a predetermined over-clipping condition based on the difference between the initial position information and the standard position information on the black frame region corresponding to the picture set.
In an implementation manner, the determining whether the determined black frame region of the target picture meets the predetermined over-clipping condition based on the difference between the initial position information and the standard position information about the black frame region corresponding to the picture set may include:
calculating a difference between the initial position information and the standard position information about the boundary of each side black frame region;
and when the determined difference value is larger than a first preset threshold value, judging that the black frame area of the determined target picture meets the preset overstock condition, otherwise, judging that the black frame area of the determined target picture does not meet the preset overstock condition.
Based on the above representation form of the standard position information and the initial position information about the boundary of each side black frame region, the difference D between the standard position information and the initial position information about the boundary of each side black frame region 1 、D 2 、D 3 、D 4 The method comprises the following steps:
D 1 ＝X 11 -X 12 ；D 2 ＝X 21 -X 22 ；D 3 ＝Y 11 -Y 12 ；D 4 ＝Y 21 -Y 22 。
it is also possible that there is a difference above the first predetermined threshold among the determined differences, at least one difference above the first predetermined threshold among the determined differences, or a plurality of differences above the first predetermined threshold among the determined differences.
In addition, considering that the probability of overspecking exists at the boundary of a certain side black frame region is far higher than the probability of overspecking exists at the boundary of other side black frame regions, only the boundary of the certain side black frame region can be analyzed. Based on such a processing idea, calculating the difference between the initial position information and the standard position information about the boundary of each side black frame region may include: and calculating the difference value between the initial position information and the standard position information of the first side black frame region boundary, wherein the first side black frame region boundary is the black frame region boundary with the highest possibility of overspecking.
In S104, when it is determined that the determined black frame region of the target picture meets the excessive clipping condition by comparing the standard position information and the initial position information, the black frame region of the target picture may be clipped according to the standard position information; and when the determined black frame region of the target picture does not meet the excessive clipping condition, the black frame region of the target picture can be clipped according to the initial position information.
In the scheme provided by the embodiment of the invention, after the position information of the black frame area is determined based on the pixel statistics mode, the black frame area is cut out not directly according to the position information of the black frame area, but by taking the determined position information as initial position information, comparing the initial position information with the standard position information, corresponding to the picture set, of the black frame area, determining whether the determined black frame area of the target picture meets the excessive cutting condition or not, and selecting different modes according to the determination result to cut out the black frame area. Therefore, through the scheme, the probability of excessive clipping of the black frame area of the picture in the picture set can be reduced.
As shown in fig. 2, the embodiment of the present invention further provides a black frame region clipping method, which may include the following steps:
s201, dividing each picture in a picture set according to a designated black frame region division mode to obtain a black frame region of each picture;
s202, selecting a target black frame area which meets a preset non-excessive cutting condition from the black frame areas of each picture;
s203, acquiring the position information of the target black frame area as standard position information about the black frame area corresponding to the picture set;
s204, obtaining a target picture of a black frame area to be cut; the target picture is any picture in a picture set formed by frame extraction;
s205, determining initial position information of a black frame area of the target picture in a pixel statistics mode;
s206, judging whether the determined black frame area of the target picture meets a preset excessive cutting condition or not based on the difference of the initial position information and the standard position information about the black frame area corresponding to the picture set;
the standard position information is the position information of a black frame region which accords with a preset non-excessive cutting condition after each picture of the picture set is divided according to a specified black frame region dividing mode;
S207, when the judgment result is yes, cutting a black frame area of the target picture according to the standard position information; otherwise, cutting the black frame area of the target picture according to the initial position information.
In S201, there are various implementations of dividing each picture in the picture set according to the designated black frame region division method to obtain the black frame region of each picture. In an implementation manner, dividing each picture in the picture set according to a designated black frame region division manner to obtain a black frame region of each picture may include:
performing binarization processing on each picture in the picture set to obtain each binarized picture;
and determining the black frame area of each picture by utilizing the size relation between the pixel value of each binarized picture and the second preset threshold value.
This implementation is based on threshold segmentation. The determining the black frame area of each picture by using the size relationship between the pixel value of each binarized picture and the second predetermined threshold value may be: and calling an adaptive threshold segmentation algorithm function of opencv, and carrying out threshold segmentation on each binarized picture by utilizing a second preset threshold value to obtain a black frame area and a non-black frame area of each binarized picture.
In another implementation, the dividing each picture in the picture set according to the designated black frame region dividing manner to obtain the black frame region of each picture may include:
performing binarization processing on each picture in the picture set to obtain each binarized picture;
for each binarized picture, counting the range of the connected bodies belonging to the black pixels in the binarized picture, and taking the connected bodies of the black pixels at the edge of the image as the black frame area of the binarized image.
In S202, after the black frame area of each picture is obtained, since the black frame standard needs to be selected for the picture set, a target black frame area that meets a predetermined non-excessive clipping condition may be selected from the black frame areas of each picture, and then the position information of the target black frame area is used as standard position information.
Optionally, in an implementation manner, selecting a target black frame area meeting a predetermined non-overstailors condition from the black frame areas of the pictures may include:
calculating an inter-region difference index of a black frame region and a non-black frame region except the black frame region in the same picture aiming at the black frame region of each picture as a difference index corresponding to the black frame region, wherein the inter-region difference index is used for representing the gray level difference between the black frame region and the non-black frame region;
And selecting a black frame region with the corresponding difference index larger than a preset index value from the black frame regions of each picture as a target black frame region which meets a preset non-overstailors condition.
In such an implementation, there may be a case where a black frame region corresponding to a difference index greater than a predetermined index value is not selected. In this case, a black frame region having the largest corresponding difference index may be determined from among black frame regions of each picture as a target black frame region that meets a predetermined non-overscut condition.
Optionally, in another implementation manner, selecting a target black frame area meeting a predetermined non-overstailors condition from the black frame areas of the pictures may include:
calculating an inter-region difference index of a black frame region and a non-black frame region except the black frame region in the same picture aiming at the black frame region of each picture as a difference index corresponding to the black frame region, wherein the inter-region difference index is used for representing the gray level difference between the black frame region and the non-black frame region;
and selecting a black frame region with the maximum corresponding difference index from the black frame regions of each picture as a target black frame region which meets the preset non-excessive cutting condition.
For example, for a black frame region of each picture, calculating an inter-region difference index between the black frame region and a non-black frame region other than the black frame region in the same picture as a difference index corresponding to the black frame region includes:
for a black frame region of each picture, calculating a difference index between the black frame region and a non-black frame region except the black frame region in the same picture by using a preset formula, and taking the difference index as a difference index corresponding to the black frame region;
wherein the predetermined formula is:
wherein DIR is an inter-region variability index, f (R 1 ) Is the average gray level of the non-black frame region except the black frame region in the same picture, f (R 2 ) Is the black frame areaMAX is the maximum gray level of the picture to which the black frame region belongs, and MIN is the minimum gray level of the picture to which the black frame region belongs.
The predetermined formula is simplified by the following formula:
where I represents the image, M is the number of segmented regions,the number of combinations of the regions is (x, y) the pixel coordinates, and g (x, y) the gray function. Since the binarized picture is divided into two regions, it can be simplified as a formula:
wherein, when the inter-region difference index is calculated by the predetermined formula, the predetermined index value may be 0.6, 0.8, or the like.
Steps S204 to S207 are the same as steps S101 to S104, and are not described here.
In the scheme provided by the embodiment of the invention, after the position information of the black frame area is determined based on the pixel statistics mode, the black frame area is cut out not directly according to the position information of the black frame area, but by taking the determined position information as initial position information, comparing the initial position information with the standard position information, corresponding to the picture set, of the black frame area, determining whether the determined black frame area of the target picture meets the excessive cutting condition or not, and selecting different modes according to the determination result to cut out the black frame area. Therefore, through the scheme, the probability of excessive clipping of the black frame area of the picture in the picture set can be reduced.
In addition, when it is required to be described, since the picture set usually contains millions to tens of millions of pictures, in order to process each picture in the picture set more quickly, the python's multiprocessing pool may be called in the whole method of processing each picture in the picture set, so as to perform acceleration processing. For example, when using 200 process pools for acceleration, the speed of processing pictures can reach 200 tens of thousands of sheets/10 min.
In order to more clearly describe the black frame region clipping method provided by the embodiment of the present invention, in the following, with reference to the schematic diagram in fig. 3, an example is described for how to clip a black frame region for a plurality of pictures in a plurality of picture sets:
accelerating binarization processing of each picture of the picture set by using a multi-process pool;
threshold segmentation is carried out on each picture after binarization processing, and a black frame area and a non-black frame area of the binarized picture are obtained; that is, the above-mentioned magnitude relation between the pixel value of each binarized picture and the second predetermined threshold value is used to determine the black frame area of each picture, and the black frame area is determined as a non-black frame area except for the black frame area;
selecting black frame areas with the difference index larger than 0.6 from the black frame areas of each picture:
under the selected condition, taking the position information of the selected black frame area as standard position information;
under the condition of not selecting, taking the position information of the black frame area with the maximum difference index as the standard position information;
accelerating by adopting a multi-process pool, and traversing each picture of the picture set;
counting the proportion of the pixel gray scale in each row/column in the number of 10-255 pixels from the upper, lower, left and right edges of the picture for each picture of the traversed picture set;
When the duty ratio is judged to be larger than 0.15, taking the boundary as the position information of the boundary of the black frame area, if the duty ratio is not larger than 0.15, counting the proportion of the pixel gray scale in the next row/column in the number of 10-250 pixels until the edge with the duty ratio being larger than 0.15 is found, and until the initial position information of the boundary of the black frame area at each side is obtained;
judging whether a black frame area boundary with a difference value between standard position information and initial position information larger than 30 exists in the black frame area boundaries at each side;
if yes, carrying out black frame region cutting on the picture by using the standard position information, and if not, carrying out black frame region cutting on the picture by using the initial position information;
judging whether each picture in each picture set is cut, if yes, ending, if not, returning to traverse each picture in the picture set, and counting the proportion of the pixel gray level in each row/column in the number of 10-250 pixels from the upper, lower, left and right edges of each picture in the picture set.
In the scheme provided by the embodiment of the invention, after the position information of the black frame area is determined based on the pixel statistics mode, the black frame area is cut out not directly according to the position information of the black frame area, but by taking the determined position information as initial position information, comparing the initial position information with the standard position information, corresponding to the picture set, of the black frame area, determining whether the determined black frame of the target picture meets the excessive cutting condition or not, and selecting different modes according to the determination result to cut out the black frame area. Therefore, through the scheme, the probability of excessive clipping of the black frame area of the picture in the picture set can be reduced.
Corresponding to the above method embodiment, the embodiment of the present invention further provides a black frame region clipping device, as shown in fig. 4, applied to an electronic device, where the device includes:
an obtaining module 410, configured to obtain a target picture of a black frame area to be cut; the target picture is any picture in a picture set formed by frame extraction;
a first determining module 420, configured to determine initial position information of a black frame area of the target picture by using a pixel statistics manner;
a judging module 430, configured to judge whether the determined black frame area of the target picture meets a predetermined excessive clipping condition based on a difference between the initial position information and standard position information about the black frame area corresponding to the picture set; the standard position information is position information of a black frame region which accords with a preset non-excessive cutting condition after each picture of the picture set is divided according to a specified black frame region dividing mode;
the cropping module 440 is configured to crop the black frame area of the target picture according to the standard position information when the determination result is yes; otherwise, cutting the black frame area of the target picture according to the initial position information.
In the scheme provided by the embodiment of the invention, after the position information of the black frame area is determined based on the pixel statistics mode, the black frame area is cut out not directly according to the position information of the black frame area, but by taking the determined position information as initial position information, comparing the initial position information with the standard position information, corresponding to the picture set, of the black frame area, determining whether the determined black frame area of the target picture meets the excessive cutting condition or not, and selecting different modes according to the determination result to cut out the black frame area. Therefore, through the scheme, the probability of excessive clipping of the black frame area of the picture in the picture set can be reduced.
Optionally, the initial position information includes: the standard position information includes, with respect to initial position information of each side black frame region boundary: standard position information on the boundary of each side black frame region;
the judging module 430 may include:
a first determination sub-module for calculating a difference between initial position information and standard position information about each side black frame region boundary;
and the judging sub-module is used for judging that the determined black frame area of the target picture meets the preset excessive cutting condition when the determined difference value is larger than a first preset threshold value, otherwise, judging that the determined black frame area of the target picture does not meet the preset excessive cutting condition.
Optionally, the apparatus may further include:
the second determining module is used for dividing each picture in the picture set according to a designated black frame region dividing mode before the obtaining module obtains the target picture of the black frame region to be cut, so as to obtain the black frame region of each picture;
the region determining module is used for selecting a target black frame region which meets a preset non-excessive cutting condition from the black frame regions of the pictures;
and the information determining module is used for acquiring the position information of the target black frame area and taking the position information as the standard position information of the black frame area corresponding to the picture set.
Optionally, the second determining module is specifically configured to:
performing binarization processing on each picture in the picture set to obtain each binarized picture;
and determining the black frame area of each picture by utilizing the size relation between the pixel value of each binarized picture and the second preset threshold value.
Optionally, the area determining module is specifically configured to:
calculating an inter-region difference index of a black frame region and a non-black frame region except the black frame region in the same picture aiming at the black frame region of each picture as a difference index corresponding to the black frame region, wherein the inter-region difference index is used for representing the gray level difference between the black frame region and the non-black frame region;
And selecting a black frame region with the corresponding difference index larger than a preset index value from the black frame regions of the pictures as a target black frame region which meets a preset non-excessive cutting condition.
Optionally, the area determining module is further configured to:
and when the black frame region with the corresponding difference index larger than the preset index value is not selected, determining the black frame region with the largest corresponding difference index from the black frame regions of the pictures as the black frame region meeting the preset non-excessive cutting condition.
Optionally, the area determining module calculates, for a black frame area of each picture, an inter-area difference index between the black frame area and a non-black frame area other than the black frame area in the same picture, as a difference index corresponding to the black frame area, including:
for a black frame region of each picture, calculating a difference index between the black frame region and a non-black frame region except the black frame region in the same picture by using a preset formula, and taking the difference index as a difference index corresponding to the black frame region; wherein the predetermined formula is:
wherein DIR is an inter-region variability index, f (R 1 ) Is the average gray level of the non-black frame region except the black frame region in the same picture, f (R 2 ) MAX is the maximum gray level of the picture to which the black frame region belongs, and MIN is the minimum gray level of the picture to which the black frame region belongs.
The embodiment of the invention also provides an electronic device, as shown in fig. 5, which comprises a processor 501, a communication interface 502, a memory 503 and a communication bus 504, wherein the processor 501, the communication interface 502 and the memory 503 complete communication with each other through the communication bus 504,
a memory 503 for storing a computer program;
the processor 501 is configured to implement the steps of the black frame region clipping method provided by the embodiment of the present invention when executing the program stored in the memory 503.
The communication bus mentioned above for the electronic devices may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the electronic device and other devices.
The Memory may include random access Memory (Random Access Memory, RAM) or may include Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
In yet another embodiment of the present invention, there is also provided a computer readable storage medium having stored therein a computer program which, when executed by a processor, implements the steps of any of the black frame region clipping methods described above.
In yet another embodiment of the present invention, there is also provided a computer program product containing instructions that, when run on a computer, cause the computer to perform any of the black box region clipping methods of the above embodiments.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments in part.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.
Claims (10)
1. A black frame region clipping method, characterized by being applied to an electronic device, the method comprising:
obtaining a target picture of a black frame area to be cut; the target picture is any picture in a picture set formed by frame extraction;
determining initial position information of a black frame area of the target picture in a pixel statistics mode;
judging whether the determined black frame region of the target picture meets a preset excessive cutting condition or not based on the difference of the initial position information and the standard position information about the black frame region corresponding to the picture set; the standard position information is position information of a black frame region which accords with a preset non-excessive cutting condition after each picture of the picture set is divided according to a specified black frame region dividing mode; the predetermined over-clipping condition is: among the differences between the initial position information and the standard position information regarding the boundary of each side black frame region, there is a difference greater than a first predetermined threshold; any black frame region predetermined non-overscrapping condition comprising: the difference index between the black frame region and the non-black frame region in the same picture is the largest, or the difference index between the black frame region and the non-black frame region is larger than a preset index value; the inter-region difference index is used for representing gray level difference between a black frame region and a non-black frame region in the same picture;
When the judgment result is yes, cutting a black frame area of the target picture according to the standard position information; otherwise, cutting the black frame area of the target picture according to the initial position information.
2. The method of claim 1, wherein the initial position information comprises: the standard position information includes, with respect to initial position information of each side black frame region boundary: standard position information on the boundary of each side black frame region;
the determining whether the determined black frame region of the target picture meets a predetermined over-clipping condition based on the difference between the initial position information and the standard position information about the black frame region corresponding to the picture set includes: calculating a difference between the initial position information and the standard position information about the boundary of each side black frame region;
and when the determined difference value is larger than a first preset threshold value, judging that the determined black frame area of the target picture meets a preset excessive cutting condition, otherwise, judging that the determined black frame area of the target picture does not meet the preset excessive cutting condition.
3. The method according to claim 1 or 2, wherein before the target picture of the black frame region to be cropped is obtained, the method further comprises:
Dividing each picture in the picture set according to a designated black frame region dividing mode to obtain a black frame region of each picture;
selecting a target black frame area which meets a preset non-excessive cutting condition from the black frame areas of the pictures;
and acquiring the position information of the target black frame area as standard position information about the black frame area corresponding to the picture set.
4. A method according to claim 3, wherein said dividing each picture in the picture set according to the specified black frame region division manner to obtain the black frame region of each picture comprises:
performing binarization processing on each picture in the picture set to obtain each binarized picture;
and determining the black frame area of each picture by utilizing the size relation between the pixel value of each binarized picture and the second preset threshold value.
5. A method according to claim 3, wherein selecting a target black frame region that meets a predetermined non-overscrapping condition from the black frame regions of the respective pictures comprises:
for a black frame region of each picture, calculating a difference index between the black frame region and a non-black frame region except the black frame region in the same picture, and taking the difference index as a difference index corresponding to the black frame region;
And selecting a black frame region with the corresponding difference index larger than a preset index value from the black frame regions of the pictures as a target black frame region which meets a preset non-excessive cutting condition.
6. The method as recited in claim 5, further comprising:
and when the black frame region with the corresponding difference index larger than the preset index value is not selected, determining the black frame region with the largest corresponding difference index from the black frame regions of the pictures, and taking the black frame region as a target black frame region which meets the preset non-excessive cutting condition.
7. The method according to claim 5, wherein the calculating, for each black frame region of the picture, an inter-region difference index between the black frame region and a non-black frame region other than the black frame region in the same picture as the difference index corresponding to the black frame region includes:
for a black frame region of each picture, calculating a difference index between the black frame region and a non-black frame region except the black frame region in the same picture by using a preset formula, and taking the difference index as a difference index corresponding to the black frame region;
wherein the predetermined formula is:
wherein DIR is an inter-region variability index, f (R 1 ) Is the average gray level of the non-black frame region except the black frame region in the same picture, f (R 2 ) For the average gray level of the black frame region, MAX is the maximum gray level of the picture to which the black frame region belongs, MIN is the minimum gray level of the picture to which the black frame region belongsDegree.
8. A black frame region clipping device, characterized by being applied to an electronic apparatus, the device comprising:
the acquisition module is used for acquiring a target picture of the black frame area to be cut; the target picture is any picture in a picture set formed by frame extraction;
the first determining module is used for determining initial position information of a black frame area of the target picture in a pixel statistics mode;
the judging module is used for judging whether the determined black frame area of the target picture meets a preset excessive cutting condition or not based on the difference of the initial position information and the standard position information about the black frame area corresponding to the picture set; the standard position information is position information of a black frame region which accords with a preset non-excessive cutting condition after each picture of the picture set is divided according to a specified black frame region dividing mode; the predetermined over-clipping condition is: among the differences between the initial position information and the standard position information regarding the boundary of each side black frame region, there is a difference greater than a first predetermined threshold; any black frame region predetermined non-overscrapping condition comprising: the difference index between the black frame region and the non-black frame region in the same picture is the largest, or the difference index between the black frame region and the non-black frame region is larger than a preset index value; the inter-region difference index is used for representing gray level difference between a black frame region and a non-black frame region in the same picture;
The clipping module is used for clipping the black frame area of the target picture according to the standard position information when the judgment result is yes; otherwise, cutting the black frame area of the target picture according to the initial position information.
9. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
a memory for storing a computer program; a processor for carrying out the method steps of any one of claims 1-7 when executing a program stored on a memory.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored therein a computer program which, when executed by a processor, implements the method steps of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010590037.XA CN111754487B (en) | 2020-06-24 | 2020-06-24 | Black frame region cutting method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010590037.XA CN111754487B (en) | 2020-06-24 | 2020-06-24 | Black frame region cutting method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111754487A CN111754487A (en) | 2020-10-09 |
| CN111754487B true CN111754487B (en) | 2023-07-25 |
Family
ID=72677206
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010590037.XA Active CN111754487B (en) | 2020-06-24 | 2020-06-24 | Black frame region cutting method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111754487B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106327541A (en) * | 2016-08-17 | 2017-01-11 | 努比亚技术有限公司 | Image cutting method and device |
| CN110298858A (en) * | 2019-07-01 | 2019-10-01 | 北京奇艺世纪科技有限公司 | A kind of image cropping method and device |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102254302B (en) * | 2011-06-07 | 2013-01-02 | 盛乐信息技术（上海）有限公司 | Picture trimming system and method thereof |
| US9060106B1 (en) * | 2012-06-19 | 2015-06-16 | Google Inc. | Border detection in videos |
| WO2016101767A1 (en) * | 2014-12-24 | 2016-06-30 | 北京奇虎科技有限公司 | Picture cropping method and device and image detecting method and device |
| CN105100646B (en) * | 2015-08-31 | 2018-09-11 | 北京奇艺世纪科技有限公司 | Method for processing video frequency and device |
| JP7005290B2 (en) * | 2017-11-07 | 2022-01-21 | シャープ株式会社 | Image processing equipment |
| JP7130436B2 (en) * | 2018-05-25 | 2022-09-05 | キヤノン株式会社 | IMAGE PROCESSING APPARATUS FOR MULTI-CROP PROCESSING, METHOD AND PROGRAM FOR GENERATING IMAGE IN UNIT OF DOCUMENT USING MULTI-CROP PROCESSING |
| CN108769803B (en) * | 2018-06-29 | 2021-06-22 | 北京字节跳动网络技术有限公司 | Recognition method, cutting method, system, equipment and medium for video with frame |
| CN111062317A (en) * | 2019-12-16 | 2020-04-24 | 中国计量大学上虞高等研究院有限公司 | Method and system for cutting edges of scanned document |
-
2020
- 2020-06-24 CN CN202010590037.XA patent/CN111754487B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106327541A (en) * | 2016-08-17 | 2017-01-11 | 努比亚技术有限公司 | Image cutting method and device |
| CN110298858A (en) * | 2019-07-01 | 2019-10-01 | 北京奇艺世纪科技有限公司 | A kind of image cropping method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111754487A (en) | 2020-10-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10896349B2 (en) | Text detection method and apparatus, and storage medium | |
| CN109308463B (en) | Video target identification method, device and equipment | |
| CN110399842B (en) | Video processing method and device, electronic equipment and computer readable storage medium | |
| US20210158488A1 (en) | Image edge processing method, electronic device, and computer readable storage medium | |
| CN110708568B (en) | Video content mutation detection method and device | |
| CN110298858B (en) | Image clipping method and device | |
| WO2015106700A1 (en) | Method and apparatus for implementing image denoising | |
| US20160132995A1 (en) | Structure Aware Image Denoising and Noise Variance Estimation | |
| CN111079793A (en) | Icon similarity determining method and electronic equipment | |
| CN111368587A (en) | Scene detection method and device, terminal equipment and computer readable storage medium | |
| CN111553302B (en) | Key frame selection method, device, equipment and computer readable storage medium | |
| CN110827248A (en) | Method and device for identifying screen area of electronic device | |
| CN111031359B (en) | Video playing method and device, electronic equipment and computer readable storage medium | |
| CN115357155A (en) | Window identification method, device, equipment and computer readable storage medium | |
| CN113129298B (en) | Method for identifying definition of text image | |
| CN114494775A (en) | Video segmentation method, device, equipment and storage medium | |
| CN110751156A (en) | Method, system, device and medium for table line bulk interference removal | |
| CN111754487B (en) | Black frame region cutting method and device and electronic equipment | |
| CN110689565B (en) | Depth map determination method and device and electronic equipment | |
| CN111161299B (en) | Image segmentation method, storage medium and electronic device | |
| CN111489344A (en) | Method, system and related device for determining image definition | |
| CN114596210A (en) | Noise estimation method, device, terminal equipment and computer readable storage medium | |
| CN111630558A (en) | Image processing and matching method and device and storage medium | |
| CN112580638B (en) | Text detection method and device, storage medium and electronic equipment | |
| CN111080550B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |