CN104299208B - The processing method and device of a kind of adapting to image brightness - Google Patents

The processing method and device of a kind of adapting to image brightness Download PDF

Info

Publication number
CN104299208B
CN104299208B CN201410468044.7A CN201410468044A CN104299208B CN 104299208 B CN104299208 B CN 104299208B CN 201410468044 A CN201410468044 A CN 201410468044A CN 104299208 B CN104299208 B CN 104299208B
Authority
CN
China
Prior art keywords
image
component
gray scale
interval
scale interval
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410468044.7A
Other languages
Chinese (zh)
Other versions
CN104299208A (en
Inventor
秦文礼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHENZHEN YUNZHOU MULTIMEDIA TECHNOLOGY Co Ltd
Original Assignee
SHENZHEN YUNZHOU MULTIMEDIA TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN YUNZHOU MULTIMEDIA TECHNOLOGY Co Ltd filed Critical SHENZHEN YUNZHOU MULTIMEDIA TECHNOLOGY Co Ltd
Priority to CN201410468044.7A priority Critical patent/CN104299208B/en
Publication of CN104299208A publication Critical patent/CN104299208A/en
Application granted granted Critical
Publication of CN104299208B publication Critical patent/CN104299208B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The present invention discloses a kind for the treatment of method and apparatus of adapting to image brightness, and methods described includes:Image a is obtained, image a is normalized, image A is obtained;Image A is converted into HSI spaces from rgb space and obtains image F;Image F component I is handled by ad hoc fashion and obtains component I ';By the component I ' and image F component S, component H merges into new image b;Image b is obtained into image B from HSI spatial transformations for rgb space;Output image B.The present invention is by the way that from single channel histogram analysis, adjustment component I value, the gray-level structure of appropriate adjustment source images realizes the enhanced effect of image local.

Description

The processing method and device of a kind of adapting to image brightness
Technical field
The present invention relates to the processing method and dress of technical field of image processing, more particularly to a kind of adapting to image brightness Put.
Background technology
It is kept as a souvenir with mobile phone, camera seeing that scenery, personage are taken, is a kind of incomparable satisfied thing, can It is due to that we can not compare with the photographer of specialty, the lightness taken often occurs not enough, whole poor effect, The even dull face of picture can not all be differentiated.In brightness too strong place, image too bright, it is impossible to differentiate some thin Section.At this moment we are accomplished by carrying out picture simple brightness enhancing processing, and traditional brightness enhancing processing can allow dark Picture becomes to brighten, but original brighter image can become after treatment it is brighter, while some details can also lose.Instead It, originally can also lose some details after bright image procossing excessively.
The content of the invention
The purpose of the embodiment of the present invention is to propose a kind of processing method of adapting to image brightness, it is intended to solve existing skill The problem of art brightness enhancing processing can lose image detail.
The embodiment of the present invention is achieved in that a kind of processing method of adapting to image brightness, and methods described includes:
Image a is obtained, image a is normalized, image A is obtained;
Image A is converted into HSI spaces from rgb space and obtains image F;
Image F component I is handled by ad hoc fashion and obtains component I ';
By the component I ' and image F component S, component H merges into new image b;
Image b is obtained into image B from HSI spatial transformations for rgb space;
Output image B.
Further, described " handled by ad hoc fashion image F component I and obtain component I ' " is specially:
Statistics with histogram is carried out to component I, and is normalized and obtains histogram P;
Nogata distribution function p after normalized is divided into n gray scale interval by gray level, and calculates each gray area Between gray level weight riWith the interval weight w for calculating each gray scale intervali;Wherein, i represents to carry out gray scale fraction to histogram P Qu Hou, the sequence number for the gray scale interval being divided into, 1≤i≤n.
Pass through ri, wiNew gray scale interval is built, and draws each interval weight w ' of corresponding new gray scale intervali
By wi, w 'iFunction sampling point is calculated, and constructs Nogata and returns fixedization function f, and meets function f for monotonically increasing function;
Fixedization function f is returned to calculate I ' by Nogata image F component I.
The another object of the embodiment of the present invention is to propose a kind of processing unit of adapting to image brightness, described device bag Include:
Image collection module, for obtaining image a;
First normalized module, for image a to be normalized, obtains image A;
First space conversion module, image F is obtained for image A to be converted into HSI spaces from rgb space;
Component processing unit, is handled by ad hoc fashion for the component I to image F, obtains I ';
Component merging module, for by the component I ' and image F component S, component H to merge into new image b;
Second space modular converter, for image b to be obtained into image B for rgb space from HSI spatial transformations;
Output module, for output image B.
Further, the component processing unit also includes:
Statistics with histogram module, for carrying out statistics with histogram to component I;
Second normalized module, histogram is obtained for the component I after statistics with histogram to be normalized P;
Division module, for the Nogata distribution function p after normalized to be carried out into subregion by gray level;
Interval gray level weight computation module, is used for and calculates the gray level weight r of each gray scale intervali
Interval weight computing module, the interval weight w for calculating each gray scale intervali
Gray scale interval builds module, for passing through ri, wiBuild new gray scale interval;
Interval weight computing module, the interval weight w ' for calculating each new gray scale intervali
Nogata returns determining function construction module, for by wi, w 'iFunction sampling point is calculated, and constructs Nogata and returns fixedization function f, And function f is met for monotonically increasing function;
Component computing module, returns fixedization function f to calculate I ' for the component I to image F by Nogata.
Beneficial effects of the present invention
Much excessively dark, excessively bright image can't see details, the gray scale of usual this part of the image table in histogram Show that gray scale span is narrow, gray value is excessively concentrated.Therefore in order that the image section of excessive details has bigger ash Spend span, while in downscaled images unimportant part gray scale range.The inventive method is crossed from single channel histogram analysis, is adjusted Whole component I value, the gray-level structure of appropriate adjustment source images, realizes the enhanced effect of image local.
Brief description of the drawings
Fig. 1 is a kind of process flow figure of adapting to image brightness of the preferred embodiment of the present invention;
Fig. 2 is the method detailed flow chart of step S103 in Fig. 1 flow charts;
Fig. 3 is that the histogram after gray level subregion is carried out to histogram P with threshold value partition method;
Fig. 4 is by wi, w 'iThe Nogata for calculating function sampling point construction returns fixedization linear function f;
Fig. 5 is by wi, w 'iThe Nogata for calculating function sampling point construction returns fixedization spline smooth function f;
Fig. 6 is the new histogram P ' returned to image F component I by Nogata after fixedization function f calculating;
Fig. 7 is a kind of processing unit structure chart of adapting to image brightness of the preferred embodiment of the present invention;
Fig. 8 is the detailed structure view of component processing unit in Fig. 7 structure charts.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and examples The present invention is further elaborated, for convenience of description, illustrate only the part related to the embodiment of the present invention.It should manage Solution, the specific embodiment that this place is described is used only for explaining the present invention, is not intended to limit the invention.
Much excessively dark, excessively bright image can't see details, the gray scale of usual this part of the image table in histogram Show that gray scale span is narrow, gray value is excessively concentrated.Therefore in order that the image section of excessive details has bigger ash Spend span, while in downscaled images unimportant part gray scale range.The embodiment of the present invention from single channel histogram by dividing Analysis, adjustment component I value, the gray-level structure of appropriate adjustment source images realizes the enhanced effect of image local.
Embodiment one
Fig. 1 is a kind of process flow figure of adapting to image brightness of the preferred embodiment of the present invention;Methods described includes Following steps:
S101, obtains image a, image a is normalized, and obtains image A;
S102, is converted into HSI spaces from rgb space by image A and obtains image F;
S103, is handled image F component I by ad hoc fashion, obtains I ';
Specially:(Fig. 2 is the method detailed flow chart of step S103 in Fig. 1 flow charts)
S1031, carries out statistics with histogram, and be normalized and obtain histogram P to component I;
S1032, carries out subregion by gray level by the Nogata distribution function p after normalized, is divided into n gray scale interval, And calculate the gray level weight r of each gray scale intervaliWith the interval weight w for calculating each gray scale intervali(i.e. interval length), Wherein, i represents to carry out after gray level subregion histogram P, the sequence number for the gray scale interval being divided into;1≤i≤n;
Threshold value can be used to the methods for carrying out subregion of the Nogata distribution function p after normalized, the method such as cluster;Make With threshold value, the method for cluster subregion is technology well-known in the art, the present invention only threshold value partition method is illustrated and Citing.
Threshold value partition method is to set a threshold value ρ, the intersection point of threshold value ρ straight lines and grey value profile curve in histogram P The abscissa at place is the critical point of gray scale interval;And threshold value ρ needs to meet:Work as p>During ρ, interval gray value is continuous, works as p<ρ When interval gray value it is continuous.Wherein threshold value ρ is the threshold value of (0,1), and p represents Nogata distribution function.
It is illustrated in figure 3 and carries out the histogram after gray level subregion to histogram P with threshold value partition method, P points of histogram Into 8 gray scale intervals;Wherein abscissa is normalized gray value, and ordinate is that the curve in gray value weight, figure is straight Square distribution function p, k1、k2、k3、k4、k5、k6、k7For the critical point of gray scale interval.
Calculate the gray level weight r of each gray scale intervaliMethod be:
Wherein, riRepresent p all in i-th of gray scale interval integration, 1≤i≤n;1st gray scale interval is [k0, k1), the 2nd gray scale interval is [k1,k2) ... ... n-th of gray scale interval is [kn-1,kn];
S1033, passes through ri, wiNew gray scale interval is built, and draws each interval weight w ' of corresponding new gray scale intervali
w′i=(1- λ) ri+λ·wi, wherein λ is weight coefficient λ ∈ (0,1);
S1034, by wi, w 'iFunction sampling point is calculated, and constructs Nogata and returns fixedization function f, and meets function f for monotonic increase Function.
The method for calculating function sampling point is as follows:
Wherein, N (xi,yi) represent f sampling point, xiRepresent the abscissa of sampling point, yiRepresent the ordinate of sampling point;wjRepresent former The weight of j-th of gray scale interval of gray scale interval, w 'jRepresent the weight of new j-th of gray scale interval of gray scale interval, i is represented pair Histogram P is carried out after gray level subregion, the sequence number for the gray scale interval being divided into;∑ represents summation.
Construction Nogata returns fixedization functional based method to be linear or spline smooth, Hermite interpolation etc..Such as Fig. 4 is simple linear function, and Fig. 5 is spline smooth function;S1035, returns fixedization function f to count image F component I by Nogata Calculate I ';
It is illustrated in figure 6 the new histogram P ' returned to image F component I by Nogata after fixedization function f calculating.Fig. 6 Middle abscissa represents gray level, and ordinate is distribution density.Origin, k ' on abscissa1、k′2、k′3、k′4、k′5、k′6、k′7 Represent the critical point of new gray scale interval.
S104, by the component I ' and image F component S, component H merges into new image b;
S105, image B is obtained by image b from HSI spatial transformations for rgb space;
S106, output image B.
Embodiment two
Fig. 7 is a kind of processing unit structure chart of adapting to image brightness of the preferred embodiment of the present invention, and described device includes:
Image collection module, for obtaining image a;
First normalized module, for image a to be normalized, obtains image A;
First space conversion module, image F is obtained for image A to be converted into HSI spaces from rgb space;
Component processing unit, is handled by ad hoc fashion for the component I to image F, obtains I ';
Component merging module, for by the component I ' and image F component S, component H to merge into new image b;
Second space modular converter, for image b to be obtained into image B for rgb space from HSI spatial transformations;
Output module, for output image B.
Further, the component processing unit is also including (Fig. 8 is the detailed knot of component processing module in Fig. 7 structure charts Composition):
Statistics with histogram module, for carrying out statistics with histogram to component I;
Second normalized module, histogram is obtained for the component I after statistics with histogram to be normalized P;
Division module, for the Nogata distribution function p after normalized to be carried out into subregion by gray level;
Interval gray level weight computation module, is used for and calculates the gray level weight r of each gray scale intervali
Interval weight computing module, the interval weight w for calculating each gray scale intervali
Gray scale interval builds module, for passing through ri, wiBuild new gray scale interval;
Interval weight computing module, the interval weight w ' for calculating each new gray scale intervali
Nogata returns determining function construction module, for by wi, w 'iFunction sampling point is calculated, and constructs Nogata and returns fixedization function f, And function f is met for monotonically increasing function;
Component computing module, returns fixedization function f to calculate I ' for the component I to image F by Nogata;
Can it will be understood by those skilled in the art that realizing that all or part of step in above-described embodiment method is With what is completed by programmed instruction related hardware, described program can be stored in a computer read/write memory medium, Described storage medium can be ROM, RAM, disk, CD etc..
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention Any modifications, equivalent substitutions and improvements made within refreshing and principle etc., should be included in the scope of the protection.

Claims (8)

1. a kind of processing method of adapting to image brightness, it is characterised in that methods described includes:
Image a is obtained, image a is normalized, image A is obtained;
Image A is converted into HSI spaces from rgb space and obtains image F;
Image F component I is handled by ad hoc fashion and obtains component I';
By the component I' and image F component S, component H merges into new image b;
Image b is obtained into image B from HSI spatial transformations for rgb space;
Output image B;
It is described " image F component I to be handled by ad hoc fashion and obtains component I' " and is specially:
Statistics with histogram is carried out to component I, and is normalized and obtains histogram P;
Nogata distribution function p after normalized is divided into n gray scale interval by gray level, and calculates each gray scale interval Gray level weight riWith the interval weight w for calculating each gray scale intervali;Wherein, i represents to carry out gray level subregion to histogram P Afterwards, the sequence number for the gray scale interval being divided into, 1≤i≤n;
Pass through ri, wiNew gray scale interval is built, and draws each interval weight w ' of corresponding new gray scale intervali
By wi, w 'iFunction sampling point is calculated, and constructs Nogata and returns fixedization function f, and meets function f for monotonically increasing function;
Fixedization function f is returned to calculate I' by Nogata image F component I.
2. the processing method of adapting to image brightness as claimed in claim 1, it is characterised in that to straight after normalized The method that square distribution function p carries out subregion uses threshold value or clustering method.
3. the processing method of adapting to image brightness as claimed in claim 2, it is characterised in that
Threshold value partition method is:Set a threshold value ρ, the intersection point place of threshold value ρ straight lines and grey value profile curve in histogram P Abscissa be gray scale interval critical point;
And threshold value ρ is met:Work as p>During ρ, interval gray value is continuous, works as p<Interval gray value is continuous during ρ, and threshold value ρ is (0,1) Threshold value, p represents Nogata distribution function.
4. the processing method of adapting to image brightness as claimed in claim 1, it is characterised in that
Calculate the gray level weight r of each gray scale intervaliMethod be:
<mrow> <msub> <mi>r</mi> <mi>i</mi> </msub> <mo>=</mo> <msubsup> <mo>&amp;Integral;</mo> <msub> <mi>k</mi> <mrow> <mi>i</mi> <mo>-</mo> <mn>1</mn> </mrow> </msub> <msub> <mi>k</mi> <mi>i</mi> </msub> </msubsup> <mi>p</mi> </mrow>
Wherein, riRepresent p all in i-th of gray scale interval integration, 1≤i≤n;1st gray scale interval is [k0,k1), the 2nd Individual gray scale interval is [k1,k2) ... ... n-th of gray scale interval is [kn-1,kn]。
5. the processing method of adapting to image brightness as claimed in claim 1, it is characterised in that
It is described " to pass through ri, wiNew gray scale interval is built, and draws each interval weight w ' of corresponding new gray scale intervali" specific For:
w′i=(1- λ) ri+λ·wi, wherein λ is weight coefficient, λ ∈ (0,1).
6. the processing method of adapting to image brightness as claimed in claim 1, it is characterised in that
The step is " by wi, w 'iFunction sampling point is calculated, and constructs Nogata and is returned in fixedization function f ",
The method for calculating function sampling point is as follows:
<mrow> <mi>N</mi> <mrow> <mo>(</mo> <msub> <mi>x</mi> <mi>i</mi> </msub> <mo>,</mo> <msub> <mi>y</mi> <mi>i</mi> </msub> <mo>)</mo> </mrow> <mo>=</mo> <mrow> <mo>(</mo> <munderover> <mi>&amp;Sigma;</mi> <mrow> <mi>j</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>i</mi> </munderover> <msub> <mi>w</mi> <mi>j</mi> </msub> <mo>,</mo> <munderover> <mi>&amp;Sigma;</mi> <mrow> <mi>j</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>i</mi> </munderover> <msubsup> <mi>w</mi> <mi>j</mi> <mo>&amp;prime;</mo> </msubsup> <mo>)</mo> </mrow> </mrow>
Wherein, N (xi,yi) represent f sampling point, xiRepresent the abscissa of sampling point, yiRepresent the ordinate of sampling point;wjRepresent former ash degree The weight of j-th interval of gray scale interval, w 'jThe weight of new j-th of gray scale interval of gray scale interval is represented, i is represented to Nogata Scheme P to carry out after gray level subregion, the sequence number for the gray scale interval being divided into, ∑ represents summation.
7. the processing method of adapting to image brightness as claimed in claim 6, it is characterised in that
Construction Nogata returns fixedization functional based method to be linear, spline smooth or Hermite interpolation.
8. a kind of processing unit of adapting to image brightness, it is characterised in that described device includes:
Image collection module, for obtaining image a;
First normalized module, for image a to be normalized, obtains image A;
First space conversion module, image F is obtained for image A to be converted into HSI spaces from rgb space;
Component processing unit, is handled by ad hoc fashion for the component I to image F, obtains component I';
Component merging module, for by the component I' and image F component S, component H to merge into new image b;
Second space modular converter, for image b to be obtained into image B for rgb space from HSI spatial transformations;
Output module, for output image B;
The component processing unit also includes:
Statistics with histogram module, for carrying out statistics with histogram to component I;
Second normalized module, histogram P is obtained for the component I after statistics with histogram to be normalized;
Division module, for the Nogata distribution function p after normalized to be carried out into subregion by gray level;
Interval gray level weight computation module, is used for and calculates the gray level weight r of each gray scale intervali
Interval weight computing module, the interval weight w for calculating each gray scale intervali
Gray scale interval builds module, for passing through ri, wiBuild new gray scale interval;
Interval weight computing module, the interval weight w ' for calculating each new gray scale intervali
Nogata returns determining function construction module, for by wi, w 'iFunction sampling point is calculated, and constructs Nogata and returns fixedization function f, and it is full Sufficient function f is monotonically increasing function;
Component computing module, returns fixedization function f to calculate I' for the component I to image F by Nogata.
CN201410468044.7A 2014-09-15 2014-09-15 The processing method and device of a kind of adapting to image brightness Expired - Fee Related CN104299208B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410468044.7A CN104299208B (en) 2014-09-15 2014-09-15 The processing method and device of a kind of adapting to image brightness

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410468044.7A CN104299208B (en) 2014-09-15 2014-09-15 The processing method and device of a kind of adapting to image brightness

Publications (2)

Publication Number Publication Date
CN104299208A CN104299208A (en) 2015-01-21
CN104299208B true CN104299208B (en) 2017-10-13

Family

ID=52318929

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410468044.7A Expired - Fee Related CN104299208B (en) 2014-09-15 2014-09-15 The processing method and device of a kind of adapting to image brightness

Country Status (1)

Country Link
CN (1) CN104299208B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110110638B (en) * 2019-04-29 2019-12-17 江苏省人民医院(南京医科大学第一附属医院) control command analysis system for hospital disinfection room

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101620727A (en) * 2009-08-10 2010-01-06 电子科技大学 Self-adaptive enhancement algorithm of weighted histogram of infrared image
CN101783888A (en) * 2010-03-23 2010-07-21 中国科学院西安光学精密机械研究所 Automatic exposure method based on analogous column diagram
CN101951523A (en) * 2010-09-21 2011-01-19 北京工业大学 Adaptive colour image processing method and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101620727A (en) * 2009-08-10 2010-01-06 电子科技大学 Self-adaptive enhancement algorithm of weighted histogram of infrared image
CN101783888A (en) * 2010-03-23 2010-07-21 中国科学院西安光学精密机械研究所 Automatic exposure method based on analogous column diagram
CN101951523A (en) * 2010-09-21 2011-01-19 北京工业大学 Adaptive colour image processing method and system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Color Image Enhancement With Exact HSI Color Model;Chun-Liang Chien et al;《International Journal of Innovative Computing, Information and Control》;20111231;第7卷(第12期);全文 *
基于直方图均衡化的彩色图像增强;姜冬琴 等;《电脑知识与技术》;20130228;第9卷(第4期);第1-2节 *

Also Published As

Publication number Publication date
CN104299208A (en) 2015-01-21

Similar Documents

Publication Publication Date Title
CN104574495B (en) A kind of image rendering method and device
CN103440646A (en) Similarity obtaining method for color distribution and texture distribution image retrieval
CN104301624B (en) A kind of image taking brightness control method and device
CN110119687A (en) Detection method based on the road surface slight crack defect that image procossing and convolutional neural networks combine
CN108961303A (en) A kind of image processing method, device, electronic equipment and computer-readable medium
EP2706507B1 (en) Method and apparatus for generating morphing animation
CN104134191B (en) Image de-noising method and its device
CN107146198A (en) A kind of intelligent method of cutting out of photo and device
RU2481640C1 (en) Method and system of generation of animated art effects on static images
CN104899845A (en) Method for fusing multiple exposure images based on 1 alphabeta space scene migration
CN101794454B (en) Oil painting stylizing method based on image
TWI458341B (en) Method of improving image quality for display device
JP2010529779A5 (en)
CN103218619A (en) Image aesthetics evaluating method
WO2017049703A1 (en) Image contrast enhancement method
EP1302898A3 (en) System and method for digital image tone mapping using an adaptive sigmoidal function based on perceptual preference guidelines
CN111127360B (en) Gray image transfer learning method based on automatic encoder
EP1755082A3 (en) Image processing apparatus for reducing noise from image
US11886979B1 (en) Shifting input values within input buffer of neural network inference circuit
CN106652008A (en) Method automatically forming grid and shader multi-layer detail
CN107945200A (en) Image binaryzation dividing method
CN103702116B (en) A kind of dynamic range compression method and apparatus of image
CN109117806B (en) Gesture recognition method and device
Nayak et al. A modified triangle box-counting with precision in error fit
CN103400340A (en) Method for converting picture into cartoon

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C53 Correction of patent for invention or patent application
CB02 Change of applicant information

Address after: The central Shenzhen city of Guangdong Province, 518057 Keyuan Road, Nanshan District science and Technology Park No. 15 Science Park Sinovac A Building 1 unit 403, No. 405 unit

Applicant after: Shenzhen Yunzhou Multimedia Technology Co., Ltd.

Address before: Unit B4 9 building 518057 Guangdong city of Shenzhen province Nanshan District high in the four EVOC Technology Building No. 31

Applicant before: Shenzhen Yunzhou Multimedia Technology Co., Ltd.

GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20171013

Termination date: 20200915

CF01 Termination of patent right due to non-payment of annual fee