Summary of the invention
The object of the present invention is to provide a kind of method that is used for recovering catching at the visual texture description symbol of the texture structure of image perceptually.
Another object of the present invention is to provide a kind of computer-readable recording medium that wherein has computer program, and this program is arranged so that computing machine execution graph image texture descriptor restoration methods.
Another purpose more of the present invention is to provide a kind of visual texture description symbol recovery device of execution graph image texture descriptor restoration methods.
For achieving the above object, a kind of method that is used to recover describe the describing texture of image symbol of image texture features is provided, comprising: the systematicness designator that (a) produces the indicating image systematicness; (b) the direction designator of generation indicating image direction; (c) the scale designator of the texel scale of generation indicating image; (d) service regeulations designator, direction designator and scale designator, the texture description symbol of presentation video.
For achieving the above object, a kind of device that is used to recover describe the describing texture of image symbol of image texture features is provided, comprise: generation unit, the scale designator of the texel scale of the systematicness designator of generation indicating image systematicness, the direction designator of indicating image direction and indicating image; With expression unit, service regeulations designator, direction designator and scale designator, the texture description symbol of presentation video.
For achieving the above object, a kind of method that is used to recover to be used to describe the visual texture description symbol of visual textural characteristics is provided, comprise step: (a) use predetermined filters to filter input imagery with different orientation coefficient, (b) the filtered image of projection is gone up to obtain the data set that comprises each direction pixel value to the axle of each predetermined direction, (c) in data set, select the candidate data group by the predtermined category method, (d) based on the orientation coefficient of the wave filter that is used to filter the candidate data group, determine a plurality of designators and (e) determine that a plurality of designators are as the texture description of image symbol.
Step (a) may further include step: (a-1) use the predetermined filters with different scales (scale) coefficient to filter input imagery, and step (d) further comprises step: (d-1) determine a plurality of designators based on the scaling ratio of the wave filter that is used to filter the candidate data group.
Image texture description symbol restoration methods may further include step: another designator is determined in the existence based on the data set that filters by the wave filter with scaling ratio or orientation coefficient, and this scaling ratio or orientation coefficient are approaching or identical with the scaling ratio and the orientation coefficient of the wave filter that is used to filter selected candidate data group.
Image texture description symbol restoration methods may further include step: about the mean value and the deviate of filtered visual calculating pixel with use the mean value and the deviate that calculate to recover predetermined vector.
According to another aspect of the present invention, a kind of method that is used to recover to be used to describe the visual texture description symbol of visual textural characteristics is provided, comprise step: (a) use predetermined filters to filter input imagery with different scaling ratios, (b) the filtered image of projection is gone up to obtain the average data set that comprises each direction pixel value to the axle of each predetermined direction, (c) determine a plurality of designators based on the scaling ratio of the wave filter that is used for filtering the data set of selecting at data set by predetermined system of selection, (d) determine the texture description symbol of a plurality of designators as image.
According to another aspect more of the present invention, be provided for recovering being used to describing the method for visual texture description symbol of the textural characteristics of image, comprise step: (a) use predetermined wave filter to filter input imagery with different orientation coefficient and different scaling ratios, (b) the filtered image of projection is gone up to obtain figure of transverse axis drop shadow curve and the figure of Z-axis drop shadow curve to level and vertical axle, (c) calculate the normalized autocorrelation value of each curve map, (d) obtain the local maximum and the local minimum of each normalized autocorrelation value, the normalized autocorrelation value that calculates forms local peaking and local valley at predetermined portions, (e) mean value of definition local maximum and the mean value of local minimum are spent as a comparison, (f) selecting wherein, the ratio of the mean value of standard deviation and local maximum is less than or equal to the curve map of predetermined threshold as first candidate's curve map, (g) determine the type of second candidate's curve map according to the quantity of the curve map that filters by wave filter with scaling ratio or orientation coefficient, this scaling ratio or orientation coefficient near or be same as the scaling ratio or the orientation coefficient of the wave filter that is used to filter second selected candidate's curve map, (h) calculate the type separately belong to second candidate's curve map curve map quantity and determine the predefined weight of each type of second candidate's curve map, (i) calculate institute's number curve map quantity that goes out and the weight of determining product and number, to determine that the result of calculation value is as first designator that constitutes the texture description symbol, (j) determine to have the orientation coefficient of second candidate's curve map of maximum-contrast and scaling ratio and as second to five designator and (k) determine to comprise the texture description symbol of the designator of first designator and second to five designator as corresponding image.
Image texture description symbol restoration methods may further include step: about the mean value and the deviate of filtered visual calculating pixel, the acquisition predetermined vector of mean value that use calculates and deviate, wherein step (k) comprises step: determine to comprise first designator, the designator of second to five designator and predetermined vector are as the texture description symbol of corresponding image.
NAC (k) represents normalized autocorrelation, can optimally calculate by following formula:
Wherein N is the positive integer of being scheduled to, and an input imagery comprises the NxN pixel, and pixel location represented by i, and wherein i is 1 to N number, and the figure of drop shadow curve that represents by the pixel of pixel location i is by P (i) expression, k be one from 1 to N number.
Contrast is defined as:
Wherein P_magn (i) and V_magn (i) are local maximum and the local minimums of determining in step (d).
In step (f), the curve map that satisfies following formula is selected as first candidate's curve map:
Wherein d and S are the mean value and the standard deviations of local maximum, and α is a predetermined threshold.
Step (g) comprises substep: if (g-1) one or more curve maps with the scale identical with the scale of relevant candidate's curve map or orientation coefficient or orientation coefficient and one or morely have the scale close with the scale of relevant candidate's curve maps or orientation coefficient or a curve map of orientation coefficient are arranged, relevant candidate's curve map is categorized as first kind curve map, (g-2) if one or more the have scale identical with the scale of relevant candidate's curve map or orientation coefficient or the curve maps of orientation coefficient are arranged, but do not have the scale close or the curve map of orientation coefficient with the scale of relevant candidate's curve map or orientation coefficient, relevant candidate's curve map is categorized as the second type curve map, if (g-3) do not have the scale identical or close or the curve map of orientation coefficient, relevant candidate's curve map be categorized as the 3rd type curve map with the scale of relevant candidate's curve map or orientation coefficient.
Step (h) comprises that numeration belongs to the numeral of curve map of each type of first to the three type curve map, and determines the predefined weight of each curve map type.
After the step (f), may further include step: use pre-defined algorithm to first candidate's curve map to select second candidate's curve map.
The cohesion that pre-defined algorithm is preferably revised.
Be preferably in the step (j), in the figure of transverse axis drop shadow curve, have the orientation coefficient of the curve map of maximum-contrast, be confirmed as second designator; In the figure of Z-axis drop shadow curve, have the orientation coefficient of the curve map of maximum-contrast, be confirmed as second designator; In the figure of transverse axis drop shadow curve, have the scaling ratio of the curve map of maximum-contrast, be confirmed as the 4th designator; In the figure of Z-axis drop shadow curve, have the scaling ratio of the curve map of maximum-contrast, be confirmed as the 5th designator.
Step (j) can comprise the designator of determining to comprise first designator, second to the 5th designator and the predetermined vector step as the texture description symbol of corresponding image.
Predetermined filters preferably includes the Gabor wave filter.
For reaching second purpose of the present invention, provide a kind of computer readable medium with the program code that can carry out by computing machine, the method that is used to describe the visual texture description symbol of visual textural characteristics with execution, the method comprising the steps of: (a) use the predetermined filters with different orientation coefficient and different scaling ratios to filter input imagery, (b) the filtered image of projection is to level and Z-axis, to obtain figure of transverse axis drop shadow curve and the figure of Z-axis drop shadow curve, (c) calculate the normalized autocorrelation value for each curve map, (d) obtain local maximum and local minimum for each normalized autocorrelation value, the normalized autocorrelation value that calculates forms a local peaking and valley at predetermined portions, (e) mean value of definition local maximum and the mean value of local minimum are spent as a comparison, (f) selecting wherein, the ratio of the mean value of standard deviation and local maximum is less than or equal to the curve map of predetermined threshold as first candidate's curve map, (g) determine the type of second candidate's curve map according to the quantity of the curve map that filters by wave filter with scaling ratio or orientation coefficient, this scaling ratio or orientation coefficient near or be same as the scaling ratio or the orientation coefficient of the wave filter that is used to filter second selected candidate's curve map, (h) according to the quantity of the calculated curve of the type separately figure of second candidate's curve map with determine the predefined weight of each type of second candidate's curve map, (i) calculate institute's number curve map quantity that goes out and the weight of determining product and number, to determine that the result of product value is as first designator that constitutes a texture description symbol, (j) determine to have the orientation coefficient of second candidate's curve map of maximum-contrast and scaling ratio as second to five designator, and the designator of (k) determining to comprise first designator and second to five designator accords with as the texture description of relevant image.
For reaching the 3rd purpose of the present invention, a kind of installation method that is used to recover describe the visual texture description symbol of visual textural characteristics is provided, this device comprises filtration unit, is used to use the predetermined filters with different orientation coefficient to filter input imagery; Projection arrangement is used for the filtered image of projection and goes up the data set that comprises the mean value of each direction pixel value with acquisition to the axle of each predetermined direction; Sorter is used for selecting the candidate data group at data set by the predetermined classification method; First designator is determined device, be used for determining another designator based on the number of the curve map that filters by wave filter with scaling ratio or orientation coefficient, this scaling ratio or orientation coefficient near or be equal to the scaling ratio or the orientation coefficient of the wave filter that is used to filter selected candidate's curve map; Determine device with second designator, be used for determining a plurality of designators based on the scaling ratio and the orientation coefficient of the wave filter that is used to filter definite candidate's curve map.
A ground then provides a kind of device that is used to recover describe the visual texture description symbol of visual textural characteristics, and this device comprises a filter element, is used to use the predetermined wave filter with different orientation coefficient and different scaling ratios to filter input imagery; An image averaging value/deviate computing unit is used to calculate mean value and deviate about the pixel of each filtered image, and uses the mean value and the deviate that calculate to obtain predetermined vector; A projecting cell is used for the filtered image of projection on level and Z-axis, to obtain figure of transverse axis drop shadow curve and the figure of Z-axis drop shadow curve; A computing unit is for each curve map calculates the normalized autocorrelation value; A peak value detection/analytic unit, for each autocorrelation value detects local maximum and local minimum, the normalized autocorrelation value that calculates forms local peaking and local valley in predetermined part; A mean value/deviate computing unit is used to calculate the mean value of local maximum and the mean value of local minimum; One first candidate's curve map selection/storage unit, the ratio that is used to select to satisfy the mean value of standard deviation and local maximum is less than or equal to the curve map of the requirement of predetermined threshold, as first candidate's curve map; One second candidate's curve map selection/storage unit is used to use a pre-defined algorithm to first candidate's curve map, to select and the identical curve map of second candidate's curve map; A taxon, be used to count each number of type curve map separately that belongs to second candidate's curve map, the data-signal of the number of each type curve map of output indication, determine to belong to each separately type the predefined weight of curve map and the data-signal that the output indication is applied to the weight of each type; One first designator determining unit, be used to calculate the data of number that expression belongs to the curve map of each type, with expression be applied to each type weight data product and number, determine and output result of calculation as first designator that constitutes the texture description symbol; A contrast computing unit is used for using from the mean value calculation contrast of mean value/deviate computing unit output according to formula (2), and to export the contrast that an index gauge calculates be maximum signal; One second candidate's curve map selection/storage unit, being used to respond this contrast that calculates of indication is maximum signal, output has maximum-contrast in second candidate's curve map of storage therein candidate's curve map; One second to five designator determining unit is used for determining to have at the figure of transverse axis drop shadow curve the orientation coefficient of the curve map of maximum-contrast; The orientation coefficient that has the curve map of maximum-contrast in the figure of Z-axis drop shadow curve is second designator; In the figure of transverse axis drop shadow curve, have the scaling ratio of the curve map of maximum-contrast, be confirmed as the 4th designator; The scaling ratio that in the figure of Z-axis drop shadow curve, has the curve map of maximum-contrast, be confirmed as the 5th designator, with a texture description symbol output unit, make up first designator, second to the 5th designator and predetermined vector are also exported the texture description symbol of combined result as corresponding image.
Embodiment
At this, describe embodiments of the invention with reference to the accompanying drawings in detail.
Figure 1A with reference to showing visual texture description symbol restoration methods of the present invention supposes that N is a predetermined positive integer, and by N x N pixel, for example the input imagery of 128 x, 128 pixels composition uses the Gabor wave filter to be filtered (step 100).The Gabor wave filter is made up of the wave filter with different orientation coefficient and different scaling ratios.Suppose that C1 and C2 are predetermined positive, the wave filter that input imagery is had C1 kind orientation coefficient and C2 kind scaling ratio filters and the filtered image of wave filter output C1 x C2 kind.
Next, to the mean value and the deviate of the filtered visual calculating pixel of each C1 x C2, use this mean value and deviate to obtain vector Z (step 102) then.
Then, filtered image is projected on X and the Y-axis, to obtain figure of X-axis drop shadow curve and the figure of Y-axis drop shadow curve (step 104).Calculate normalized autocorrelation (NAC) value of each the curve map P (i) (i is the number from 1 to N) that represents by NAC (k) by following formula (1):
Wherein pixel location is represented by i, and the figure of drop shadow curve that represents by the pixel of pixel location i is by P (i) expression, k be one from 1 to N number (N is a positive integer).
Next, obtain (step 108) local maximum P_magn (i) and local minimum V_magn (i), the NAC that wherein calculates (k) forms peak value and valley partly at predetermined portions.
Contrast is defined as by following formula (2):
(step 110)
In addition, the curve map of selecting to satisfy following formula (3) is as first candidate's curve map (step 112):
Wherein d and S are mean value and the standard deviations of local maximum P_magn (i), and α is a predetermined threshold.
With reference to Figure 1B, the cohesion of modification is applied to first candidate's curve map to select second candidate's curve map (step 114).The agglomerative algorithm of revising be by R.O.Duda and P.E.Hart at " PatternClassification and Scene Analysis (pattern classification and scene analysis); John Wileyand Sons; New York; 1973; " the algorithm that the warp of middle cohesion of announcing is suitably revised will briefly be described below.At first, at N curve map P
1...., P
NIn, allow the mean value of the distance between peak value and the deviate be d
iAnd S
i, each curve map has corresponding to (d
i, S
i) bivector.Now, use corresponding to (d
i, S
i) bivector by following grouping P
iAbout the initial number of the N that troops, suppose that the desirable number of trooping is M
c, each C that troops
iCan be expressed as C
1={ P
1, C
2={ P
2..., C
N={ P
N.If the number of trooping is less than M
c, grouping stops.Next, obtain two C that troop of wide apart
iAnd C
jIf C
iAnd C
jBetween distance greater than predetermined threshold, grouping stops.On the contrary, merge C
iAnd C
jTo remove two in trooping one.Repeat this process and reach predetermined number up to the number of trooping.Then, through the trooping of grouping, select to have trooping and being chosen in curve map in selected the trooping as candidate's curve map of maximum curve maps.
Now, second candidate's curve map is divided into three classes (step 116).According to the curve map number that filters by wave filter, carry out classification with the scale close or identical or orientation coefficient with the scale of the wave filter that is used to filter second candidate's curve map or orientation coefficient.Below for explain convenient for the purpose of, the curve map that filters by the wave filter with definite scaling ratio and constant orientation coefficient will be called determines scaling ratio curve map or definite orientation coefficient curve map.
More specifically, at first, if one or more curve maps with the scale identical with the scale of relevant candidate's curve map or orientation coefficient or orientation coefficient are arranged and one or morely have the scale close or a curve map of orientation coefficient with the scale of relevant candidate's curve maps or orientation coefficient, relevant candidate's curve map is categorized as C1 type curve map, secondly, if one or more the have scale identical with the scale of relevant candidate's curve map or orientation coefficient or the curve maps of orientation coefficient are arranged, but do not have the scale close or the curve map of orientation coefficient with the scale of relevant candidate's curve map or orientation coefficient, relevant candidate's curve map is categorized as C2 type curve map, once more, if do not have the scale identical or close or the curve map of orientation coefficient, relevant candidate's curve map be categorized as C3 type curve map with the scale of relevant candidate's curve map or orientation coefficient.Then, counting belongs to C1, and the number of the curve map of each of C2 and C3 type to be using N1 respectively, and N2 and N3 represent, and counting belongs to C1, and the weight of the curve map of each of C2 and C3 type is to use W1 respectively, and W2 and W3 represent that it will be described below:
Now, use the several N1 that determine, N2, and N3 and weights W 1, W2, and W3, carry out column count down:
Determine that wherein M is as first indicator V that constitutes the texture description symbol as a result
1(step 118).
About second candidate's curve map, orientation coefficient and the scaling ratio of determining to have the curve map of maximum-contrast are second to the 5th designator (step 120).More specifically, the orientation coefficient of determining to have the curve map of maximum-contrast in x axial projection curve map is second indicator V
2In addition, determining to have the orientation coefficient of the curve map of maximum-contrast in y axial projection curve map, is the 3rd indicator V
3In x axial projection curve map, have the scaling ratio of the curve map of maximum-contrast, be confirmed as the 4th indicator V
4In addition, in y axial projection curve map, have the scaling ratio of the curve map of maximum-contrast, be confirmed as the 5th indicator V
5
First indicator V that use is determined in step 118
1, second to the 5th indicator V
2, V
3, V
4And V
5And, the texture description symbol is set in the vector Z that step 102 is determined, promptly texture feature vector is { [V
1, V
2, V
3, V
4, V
5], Z} (step 122).
The first big indicator V
1The senior structure of the texture of indication image.Confirmed experimentally that first designator represented the structure of visual texture well.The second and the 3rd indicator V
2And V
3Two maximum therein quantification orientations that make up of catching have been represented.The the 4th and the 5th indicator V
4And V
5Two maximum therein quantitative calibrations that make up of catching have been represented.
The texture description symbol is used as the index of image in the application of browsing or searching for recovery.Especially, the visual texture description symbol that recovers by visual texture description symbol restoration methods of the present invention is used for checker suitably, and wherein browse mode is regular, or based on the browsing of structure, even the embroidery pattern.Therefore, structurally search in the parallel pattern, can allow more to be adapted to the image search of eyes perception by using visual texture description symbol restoration methods of the present invention to based on the application of browsing based on structure.Therefore, in the designator that constitutes the texture description symbol that recovers by visual texture description symbol restoration methods of the present invention, first to the 5th indicator V
1, V
2, V
3, V
4And V
5Can be called perception and browse composition (PBCs).
In addition, about each filtered image, the mean value of calculating pixel values and deviate.By using this mean value to be called similar recovery component (SRCs) with the vector Z that deviate obtains.
In other words, in visual texture description symbol restoration methods of the present invention, the texture description symbol allows various texture structures to appear in the image of will be caught perceptually.
First indicator V of the good designator that makes up as visual texture has been described
1, represented two maximum therein the second and the 3rd indicator V of catching the quantification orientation that makes up
2And V
3, represented two maximum therein the 4th and the 5th indicator V of catching the quantitative calibration that makes up
4And V
5The texture description symbol that is used as image.Yet embodiment described above only is used to the sensation of describing and is not used as the purpose that limits.The single designator that is very suitable for the characteristic of selected arbitrarily a plurality of designators and image also can be as the texture description symbol of image.Therefore, above-described embodiment is not the restriction on the scope of the invention.
In addition, visual texture description symbol restoration methods can be programmed by computer program.Those skilled in the art can easily derive code and the sign indicating number section that constitutes computer program.In addition, program is stored in the computer-readable medium and is by computer-readable and executable, therefore, has embodied visual texture description symbol restoration methods.Medium comprises magnetic recording media, optical recording media, carrier media or the like.
Visual in addition texture description symbol restoration methods can specify by visual texture description symbol recovery device.Fig. 2 is the block scheme of the present invention's image texture description symbol recovery device.With reference to Fig. 2, visual texture description symbol recovery device comprises Gabor wave filter 200, image averaging value/deviate computing unit 202, x axial projection device 204, y axial projection device 205, NAC computing unit 206 and peak value detection/analytic unit 208.In addition, image texture description symbol recovery device comprises mean value/deviate computing unit 210, first candidate's curve map selection/storage unit 212, second candidate's curve map selection/storage unit 214, taxon 216, the first designator determining unit 218, contrast computing unit 220, the second to the 5th designator determining units 222 and texture description symbol output unit 224.
In the operation of visual texture description symbol recovery device, suppose that N is a predetermined positive, Gabor wave filter 200 uses the wave filter (not shown) with different orientation coefficient and different scaling ratios to filter by N x N pixel, the input imagery formed of 128 x, 128 pixels for example, and export filtered image (image_filtered).Suppose that C1 and C2 are predetermined positive, the wave filter that input imagery is had C1 kind orientation coefficient and C2 kind scaling ratio filters and the filtered image of wave filter output C1 x C2 kind.
Image averaging value/deviate computing unit uses this mean value and deviate to obtain the vector Z of vector Z and output acquisition to the mean value and the deviate of the filtered visual calculating pixel of each C1 x C2 then.
X axial projection device 204 and the y axial projection filtered image of device 205 projections are on X and Y-axis, to obtain figure of X-axis drop shadow curve and the figure of Y-axis drop shadow curve.In other words, suppose that pixel location represents (i is the number from 1 to N) by i, x axial projection device 204 and 205 outputs of y axial projection device by pixel location i (i-1 ..., the figure of drop shadow curve that pixel N) is represented is by P (i).
NAC computing unit 206 uses formula (1) to calculate normalized autocorrelation (NAC) value of each the curve map P (i) that is represented by NAC (k).
Peak value detection/analytic unit 208 detects local maximum P_magn (i) and local minimum V_magn (i), and the NAC that wherein calculates (k) forms local peaking and local valley at predetermined portions.
Mean value/deviate computing unit 210 calculates local maximum P_magn (i) mean value d and standard deviation S and exports them.First candidate's curve map selection/storage unit 212 receives mean value d and standard deviation S, and the curve map of selecting to satisfy formula (3) is first candidate's curve map (1st_CAND) and stores first selected candidate's curve map that wherein α is a predetermined threshold.
Second candidate's curve map selection/storage unit 214 is used modified cohesion and is grouped into first candidate's curve map to select and the identical curve map of second candidate's curve map (2nd-CAND).
Taxon 216 is described as reference Figure 1B, and about second candidate's curve map, counting belongs to C1, and the number of the curve map of each of C2 and C3 type is to use N1 respectively, and N2 and N3 represent, and the data-signal N of the number of each class curve map of output indication
iIn addition, taxon 216 determines to belong to C1, and the predefined weight of the curve map of each of C2 and C3 type is to use W1 respectively, and W2 and W3 represent, and the output indication is applied to the data-signal W of the weight of each class curve map
i
The definite several N1 of the first indicator determining unit, 218 uses, N2, and N3 and weights W 1, the M of W2 and W3 computing formula (4) expression, and first indicator V definite and that output result of calculation accords with as the formation texture description
1
The contrast that contrast computing unit 220 is calculated by formula (2) calculating contrast and output indication is maximum signal Cont_max.
Has candidate's curve map to the second of maximum-contrast to the 5th designator determining unit 222 in second candidate's curve map of second candidate's curve map selection/storage unit, 214 outputs storage therein.
Second to the 5th designator determining unit 222 determines to have the orientation coefficient of curve map of maximum-contrast and scaling ratio as second to the 5th designator.In other words, the orientation coefficient of determining to have the curve map of maximum-contrast in x axial projection curve map is second indicator V
2In addition, determining to have the orientation coefficient of the curve map of maximum-contrast in y axial projection curve map, is the 3rd indicator V
3In x axial projection curve map, have the scaling ratio of the curve map of maximum-contrast, be confirmed as the 4th indicator V
4In addition, in y axial projection curve map, have the scaling ratio of the curve map of maximum-contrast, be confirmed as the 5th indicator V
5
Texture description symbol output unit 224 uses from first indicator V of the first designator determining unit, 218 outputs
1, second to the 5th indicator V of from second to the 5th designator determining unit 222 outputs
2, V
3, V
4And V
5With vector Z from image averaging value/deviate computing unit 202 outputs, be provided with and output texture description symbol, promptly texture feature vector is { [V
1, V
2, V
3, V
4, V
5], Z}.
Fig. 3 shows that according with restoration methods based on visual texture description of the present invention browses composition (PBCs) by simulation from the perception that the Brodatz texture image extracts.
As mentioned above, according to visual texture description symbol restoration methods of the present invention, the texture description symbol that allows various texture structures to appear in the image of will be caught by perception can be resumed.