JPH0759089B2 - Automatic color temperature tracking device - Google Patents
Automatic color temperature tracking deviceInfo
- Publication number
- JPH0759089B2 JPH0759089B2 JP2007945A JP794590A JPH0759089B2 JP H0759089 B2 JPH0759089 B2 JP H0759089B2 JP 2007945 A JP2007945 A JP 2007945A JP 794590 A JP794590 A JP 794590A JP H0759089 B2 JPH0759089 B2 JP H0759089B2
- Authority
- JP
- Japan
- Prior art keywords
- color temperature
- illuminance
- color
- temperature change
- detecting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Description
【発明の詳細な説明】 〔産業上の利用分野〕 本発明は、カラービデオカメラの自動色温度追従装置に
関する。The present invention relates to an automatic color temperature tracking device for a color video camera.
カラービデオカメラにおいては、被写体を照らす光源の
色温度の変化に応じて白バランス補正を行うことが必須
である。In a color video camera, it is essential to perform white balance correction according to changes in the color temperature of a light source that illuminates a subject.
また、光学的に色温度を変化させる色温度変換フィルタ
を２個以上有するカラービデオカメラにおいても、色温
度変換フィルタを切り換える度に白色の被写体を撮像し
白バランス補正を行う必要がある。Further, even in a color video camera having two or more color temperature conversion filters that optically change the color temperature, it is necessary to image a white subject and perform white balance correction each time the color temperature conversion filters are switched.
この様な白バランス補正の方法として、例えば特開昭62
−126793号に記載されるような自動直電式の白バランス
補正回路が知られている。これは赤、緑、青色の映像信
号から各信号レベルを検出し、レベル可変器を用いて、
例えば緑色信号を基準にし、成分の赤、青色信号のレベ
ルを調整するものである。As such a white balance correction method, for example, Japanese Patent Laid-Open No.
There is known an automatic direct-current white balance correction circuit as described in Japanese Patent No. 126793. This detects each signal level from red, green, and blue video signals, and uses a level variable
For example, with the green signal as a reference, the levels of the red and blue signals of the components are adjusted.
上述した様な色温度変換フィルタの切換えや白バランス
調整は、色温度を検出し、そ検出結果に応じて制御され
る。色温度の検出方法には様々な方法が考えられている
が、色温度が変化したと見なす条件は限定されているた
め、次の様な問題点がある。The switching of the color temperature conversion filters and the white balance adjustment as described above are controlled by detecting the color temperature and depending on the detection result. Although various methods have been considered for detecting the color temperature, there are the following problems because the conditions under which the color temperature is changed are limited.
（イ）色温度変換フィルタの切換え時及び低照度時、色
温度に対するレベル検出値が変化するため、色温度変化
を認識できず、白バランス誤差の大きい画像となる。(B) When the color temperature conversion filter is switched and when the illuminance is low, the level detection value with respect to the color temperature changes, so the change in color temperature cannot be recognized, and the image has a large white balance error.
（ロ）白バランス調整の応答画像は視覚上目立たないよ
うに比較的遅い速度に決められているが、色温度変換フ
ィルタ切換え時や、極端な色温度変化に応答速度が追従
しきれず、白バランス調整の時間が長くなり、調整中の
画像が見苦しい画像となる。(B) The response image of white balance adjustment is set to a relatively slow speed so that it is not visually noticeable, but the response speed cannot keep up with extreme changes in color temperature when the color temperature conversion filter is switched, and the white balance is not adjusted. The adjustment time becomes long and the image being adjusted becomes unsightly.
本発明の自動色温度追従装置は、カラービデオカメラの
赤、緑、青の各色信号の相対的なレベルを制御して白バ
ランス調整を行う自動色温度追従装置おいて、被写体の
照度を検出する照度検出手段（例えば第１図の照度検出
部22）と、色温度変化フィルタの切換を検出する色温度
変換フィルタ切換検出手段（例えば第１図の色温度変換
フィルタ切換検出部21）と、各色信号のレベルを検出す
るレベル検出手段（例えば第１図のレベル検出部15、1
6、17）と、低照度時の色温度変化を検出する第１の色
温度変化検出手段（例えば第１図の色温度変化検出部2
3）と、低照度時よりも高い基準照度時の色温度変化を
検出する第２の色温度変化検出手段（例えば第１図の色
温度変化検出部24）と、色温度変換フィルタ切換時の色
温度変化を検出する第３の色温度変化検出手段（例えば
第１図の色温度変化検出部25）と、照度検出手段、色温
度変換フィルタ切換検出手段、及びレベル検出手段の出
力に基づいて、白バランス調整の応答速度を演算する応
答速度演算手段（例えば第１図の応答速度演算部19）
と、照度検出手段及び色温度変換フィルタ切換検出手段
の出力に基づいて、前記第１乃至第３の色温度検出手段
のいずれか１にレベル検出手段の出力を供給する供給手
段（例えば第１図の状態判別部18）と、応答速度演算手
段及び供給手段の出力に基づいて、白バランス調整を行
う調整手段（例えば第１図のVCA制御部26、VCA10、11）
とを備えることを特徴とする。The automatic color temperature tracking device of the present invention detects the illuminance of a subject in the automatic color temperature tracking device that controls the relative levels of the red, green and blue color signals of the color video camera to adjust the white balance. Illuminance detection means (for example, illuminance detection section 22 in FIG. 1), color temperature conversion filter switching detection means (for example, color temperature conversion filter switching detection section 21 in FIG. 1) that detects switching of color temperature change filters, and each color Level detecting means for detecting the level of the signal (for example, the level detecting units 15 and 1 in FIG. 1)
6 and 17) and a first color temperature change detecting means for detecting a color temperature change at low illuminance (for example, the color temperature change detecting unit 2 in FIG. 1).
3), a second color temperature change detecting means (for example, the color temperature change detecting unit 24 in FIG. 1) that detects a change in color temperature when the reference illuminance is higher than that when the illuminance is low, and a color temperature conversion filter switching time. Based on the outputs of the third color temperature change detecting means (for example, the color temperature change detecting section 25 in FIG. 1) for detecting the color temperature change, the illuminance detecting means, the color temperature conversion filter switching detecting means, and the level detecting means. , Response speed calculation means for calculating the response speed of white balance adjustment (for example, the response speed calculation unit 19 in FIG. 1)
And a supply means for supplying the output of the level detection means to any one of the first to third color temperature detection means based on the outputs of the illuminance detection means and the color temperature conversion filter switching detection means (for example, FIG. 1). State determining section 18) and adjusting means for performing white balance adjustment based on the outputs of the response speed calculating means and the supplying means (for example, VCA control section 26, VCA10, 11 in FIG. 1).
And is provided.
本発明の自動色温度追従装置によれば、被写体の色温
度、照度、又は色温度変換フィルタの切換状態を検出
し、これら検出パラメータから総合的に適当な色温度検
出手段を選択し、さらに白バランス調整の応答速度を可
変にするようにしたので、被写体の状態等の変化に対し
てスムーズに白バランス調整を行うことができる。According to the automatic color temperature tracking device of the present invention, the color temperature of the subject, the illuminance, or the switching state of the color temperature conversion filter is detected, and an appropriate color temperature detecting means is comprehensively selected from these detection parameters. Since the response speed of the balance adjustment is variable, the white balance adjustment can be performed smoothly with respect to changes in the condition of the subject.
以下、本発明の一実施例を、第１図を参照して説明す
る。図において、１は被写体を撮像する撮像レンズ、２
は光学的に色温度を変換する色温度変換フィルタ、３は
撮像した光を、赤、緑、青の３色に分解する色分解プリ
ズム、又４、５、６は夫々色分解された青、緑、赤の各
々の光景に比例した電気信号を発生する固体撮像素子で
ある。An embodiment of the present invention will be described below with reference to FIG. In the figure, 1 is an imaging lens for imaging a subject, 2
Is a color temperature conversion filter that optically converts the color temperature, 3 is a color separation prism that separates the imaged light into three colors of red, green, and blue, and 4, 5, 6 are color separated blue, respectively. It is a solid-state image sensor that generates an electric signal proportional to each scene of green and red.
固体撮像素子４、５、６の出力は夫々増幅器７、８、９
で増幅された後、青色信号及び赤色信号は夫々電圧制御
増幅器（VCA）10、11を介して、緑色信号は直接、映像
信号処理回路12、13、14に供給される。The outputs of the solid-state image pickup devices 4, 5, 6 are amplifiers 7, 8, 9 respectively.
After being amplified by, the blue signal and the red signal are directly supplied to the video signal processing circuits 12, 13 and 14 via the voltage controlled amplifiers (VCA) 10 and 11, respectively.
映像処理回路12、13、14の各出力はRGBコンポーネント
信号として図示せぬ回路に出力される他、各色信号のレ
ベルを検出するレベル検出部15、16、17に供給されてお
り、各レベル検出部の出力は状態判別部18に供給される
とともに、応答速度演算部19、比較部20に供給されてい
る。Each output of the video processing circuits 12, 13, 14 is output as an RGB component signal to a circuit (not shown), and is also supplied to level detection units 15, 16, 17 for detecting the level of each color signal, and each level detection The output of the unit is supplied to the state determination unit 18, and also to the response speed calculation unit 19 and the comparison unit 20.
22は各映像信号処理回路12、13、14によって処理される
情報から被写体の照度を検出する照度検出部であり、照
度検出部22の出力は状態判別部18及び応答速度演算部19
に供給されている。また、色温度変換フィルタ２の切換
えを検出する色温度変換フィルタ切換検出部21の出力も
同様に状態判別部18、及び応答速度演算部19に供給され
る。Reference numeral 22 denotes an illuminance detection unit that detects the illuminance of the subject from the information processed by the video signal processing circuits 12, 13, and 14. The output of the illuminance detection unit 22 is the state determination unit 18 and the response speed calculation unit 19
Is being supplied to. Further, the output of the color temperature conversion filter switching detection unit 21 that detects the switching of the color temperature conversion filter 2 is also supplied to the state determination unit 18 and the response speed calculation unit 19 in the same manner.
23乃至25は夫々第１乃至第３の色温度変化検出部であ
り、第１の色温度変化検出部23は所定の照度以下の低照
度時に、第２の色温度変化検出部24は、前記所定の照度
以上の照度（通常照度）時に、第３の色温度変化検出部
25は色温度変換フィルタ２の切換時に、夫々状態判別部
18から発生される制御信号によっていずれか１が選択さ
れる。そして、状態判別部18を介してレベル検出部15、
16、17より入力される色信号から色温度変化を検出す
る。Reference numerals 23 to 25 denote first to third color temperature change detection units, respectively. When the first color temperature change detection unit 23 has a low illuminance equal to or lower than a predetermined illuminance, the second color temperature change detection unit 24 A third color temperature change detection unit when the illuminance is higher than a predetermined illuminance (normal illuminance)
25 is a state determination unit when switching the color temperature conversion filter 2
Either one is selected by the control signal generated from 18. Then, the level detection unit 15 via the state determination unit 18,
The color temperature change is detected from the color signals input from 16 and 17.
VCA制御部26は、前記VCA10、及び11のゲインを制御する
ものであって、前記第１乃至第３の色温度変化検出部2
3、24、25、応答速度演算部19、比較部20の出力に応じ
てVCA10、及び11のゲイン及び時定数を制御する。The VCA control unit 26 controls the gains of the VCAs 10 and 11, and includes the first to third color temperature change detection units 2
The gains and time constants of the VCAs 10 and 11 are controlled according to the outputs of 3, 24, 25, the response speed calculation unit 19, and the comparison unit 20.
固体撮像素子４より出力された青色信号成分は、増幅器
７、VCA10を介して映像信号処理回路12に入力される。
映像信号処理回路12は入力信号を処理し、青色信号を出
力する。同様に、固体撮像素子５より出力された信号か
ら映像信号処理回路13が、また固体撮像素子６より出力
された信号から映像信号処理回路14が、夫々緑色信号と
赤色信号とを出力する。The blue signal component output from the solid-state image sensor 4 is input to the video signal processing circuit 12 via the amplifier 7 and the VCA 10.
The video signal processing circuit 12 processes the input signal and outputs a blue signal. Similarly, the video signal processing circuit 13 outputs a signal output from the solid-state image sensor 5, and the video signal processing circuit 14 outputs a green signal and a red signal from the signal output from the solid-state image sensor 6.
レベル検出部15、16、17は各色信号のレベルを検出し、
その検出信号を状態判別部18に出力する。状態判別部18
は通常この検出信号を色温度変化検出部24に供給する。
色温度変化検出部24は入力された各色信号のレベルに対
応した信号をモニタし、色温度の変化の有無を検出す
る。色温度の変化を検出したとき、色温度変化検出部24
はVCA制御部26に制御信号を出力し、ホワイトバランス
の調整動作を実行させる。The level detection units 15, 16 and 17 detect the level of each color signal,
The detection signal is output to the state determination unit 18. State determination unit 18
Normally supplies this detection signal to the color temperature change detection unit 24.
The color temperature change detection unit 24 monitors the signal corresponding to the level of each input color signal to detect the presence or absence of a change in color temperature. When a change in color temperature is detected, the color temperature change detection unit 24
Outputs a control signal to the VCA control unit 26 to execute the white balance adjustment operation.
すなわち、このとき、比較部20はレベル検出部15、16、
17の出力から、青色信号の緑色信号に対するレベルの差
と、赤色信号の緑色信号に対するレベルの差に、夫々対
応する信号を生成し、VCA制御部26に出力している。VCA
制御部26はこのレベル差が零になるようにVCA10、11を
制御する。That is, at this time, the comparison unit 20 has the level detection units 15, 16,
From the output of 17, the signals corresponding to the level difference between the blue signal and the green signal and the level difference between the red signal and the green signal are generated and output to the VCA control unit 26. VCA
The control unit 26 controls the VCAs 10 and 11 so that the level difference becomes zero.
また、このとき、VCA制御部26は、応答速度演算部19か
らの信号に対応する速度でVCA10、11を制御する。Further, at this time, the VCA control unit 26 controls the VCAs 10 and 11 at a speed corresponding to the signal from the response speed calculation unit 19.
応答速度演算部19は、レベル検出部15、16、17の出力か
ら、色信号のレベル変化をモニタしている。そしてこの
変化量が所定の基準値より小さいとき、ホワイトバラン
ス調整がゆっくり行なわれるようにVCA制御部26に制御
信号を出力する。変化量が基準値より大きいとき、調整
は迅速に行なわれる。The response speed calculator 19 monitors the level change of the color signal from the outputs of the level detectors 15, 16, 17. When the amount of change is smaller than the predetermined reference value, the control signal is output to the VCA control unit 26 so that the white balance adjustment is performed slowly. When the change amount is larger than the reference value, the adjustment is performed quickly.
また、照度が小さいときは、大きいときに較べて色信号
のレベルの変化量が小さくなる。そこで、この基準値
は、照度検出部22より出力される信号に対応して、照度
が小さいとき基準値も小さくなるように制御される。Further, when the illuminance is small, the amount of change in the level of the color signal is smaller than when the illuminance is large. Therefore, this reference value is controlled so as to correspond to the signal output from the illuminance detection unit 22 so that the reference value also decreases when the illuminance is small.
さらに、照度が小さくなったことが照度検出部22の出力
より検出されたとき、状態判別部18はレベル検出部15、
16、17の出力を色温度変化検出部23に出力するようにス
イッチングする。従って、このとき色温度変化検出部24
に代えて色温度変化検出部23が色温度の変化を検出する
ことになる。Furthermore, when it is detected from the output of the illuminance detection unit 22 that the illuminance has decreased, the state determination unit 18, the level detection unit 15,
The outputs of 16 and 17 are switched so as to be output to the color temperature change detection unit 23. Therefore, at this time, the color temperature change detection unit 24
Instead, the color temperature change detection unit 23 detects a change in color temperature.
色温度変化検出部23が色温度の変化を検出した場合も、
応答速度演算部19の出力に対応する速度で、比較部20の
出力が零になるように調整が行なわれる。Even when the color temperature change detection unit 23 detects a change in color temperature,
Adjustment is performed so that the output of the comparison unit 20 becomes zero at a speed corresponding to the output of the response speed calculation unit 19.
色温度変換フィルタ切り換え検出部21が色温度変換フィ
ルタ２の切り換えを検出したとき、色温度変化検出部25
にレベル検出部15、16、17の出力が供給されるように状
態判別部18が切り換えられる。応答速度演算部19は色温
度変換フィルタ２の切り換えが検出されたとき、迅速な
対応速度の制御信号を出力する。When the color temperature conversion filter switching detector 21 detects the switching of the color temperature conversion filter 2, the color temperature change detector 25
The state determination unit 18 is switched so that the outputs of the level detection units 15, 16 and 17 are supplied to. When the switching of the color temperature conversion filter 2 is detected, the response speed calculator 19 outputs a control signal of a quick corresponding speed.
尚、色温度変化検出部23、24、25は、夫々の状況におい
て色温度の変化を最適に検出できるように構成されるの
はもとよりである。It should be noted that the color temperature change detecting units 23, 24 and 25 are naturally configured to be able to optimally detect the change in color temperature in each situation.
以上のように、本考案の自動色温度追従装置によれば、
照度を検出し、照度に対応して色信号のレベルを検出す
るようにしたので、低照度時においてもホワイトバラン
スの調整が可能となる。As described above, according to the automatic color temperature tracking device of the present invention,
Since the illuminance is detected and the level of the color signal is detected corresponding to the illuminance, the white balance can be adjusted even when the illuminance is low.
また、色温度変化フィルタの切り換えや、色信号のレベ
ル変化量の急激な変化も検出するようにしたので、これ
らの場合には迅速なホワイトバランスの調整が可能とな
る。Further, since the color temperature change filter is switched and the abrupt change in the level change amount of the color signal is detected, the white balance can be adjusted quickly in these cases.
第１図は本発明の自動色温度追従装置の実施例の構成を
示すブロック図である。 ４、５、６……固体撮像素子、10、11……VCA、12、1
3、14……映像信号処理回路、15、16、17……レベル検
出部、18……状態判別部、19……応答速度制御部、20…
…比較部、21……色温度変換フィルタ切換検出部、22…
…照度検出部、23、24、25……色温度変化検出部、26…
…VCA制御部。FIG. 1 is a block diagram showing the configuration of an embodiment of an automatic color temperature tracking device of the present invention. 4, 5, 6 ... Solid-state image sensor, 10, 11 ... VCA, 12, 1
3, 14 ... Video signal processing circuit, 15, 16, 17 ... Level detection unit, 18 ... Status determination unit, 19 ... Response speed control unit, 20 ...
… Comparison section, 21 …… Color temperature conversion filter switching detection section, 22 ・ ・ ・
… Illuminance detector, 23, 24, 25 …… Color temperature change detector, 26…
… VCA controller.
Claims (1)
号の相対的なレベルを制御して白バランス調整を行う自
動色温度追従装置において、 被写体の照度を検出する照度検出手段と、 色温度変化フィルタの切換を検出する色温度変換フィル
タ切換検出手段と、 前記各色信号のレベルを検出するレベル検出手段と、 低照度時の色温度変化を検出する第１の色温度変化検出
手段と、 前記低照度時よりも高い基準照度時の色温度変化を検出
する第２の色温度変化検出手段と、 前記色温度変換フィルタ切換時の色温度変化を検出する
第３の色温度変化検出手段と、 前記照度検出手段、色温度変換フィルタ切換検出手段及
びレベル検出手段の出力に基づいて、白バランス調整の
応答速度を演算する応答速度演算手段と、 前記照度検出手段及び色温度変換フィルタ切換検出手段
の出力に基づいて、前記第１乃至第３の色温度検出手段
のいずれか１に前記レベル検出手段の出力を供給する供
給手段と、 前記応答速度演算手段及び供給手段の出力に基づいて、
白バランス調整を行う調整手段と、 を備えることを特徴とする自動色温度追従装置。1. An automatic color temperature tracking device for controlling white balance by controlling relative levels of red, green and blue color signals of a color video camera, and an illuminance detecting means for detecting illuminance of an object, and a color A color temperature conversion filter switching detection unit that detects switching of the temperature change filter; a level detection unit that detects the level of each color signal; a first color temperature change detection unit that detects a color temperature change at low illuminance; Second color temperature change detecting means for detecting a color temperature change when the reference illuminance is higher than when the illuminance is low; and third color temperature change detecting means for detecting a color temperature change when the color temperature conversion filter is switched. A response speed calculation means for calculating a response speed of white balance adjustment based on the outputs of the illuminance detection means, the color temperature conversion filter switching detection means and the level detection means, and the illuminance detection means and the color temperature. Supplying means for supplying the output of the level detecting means to any one of the first to third color temperature detecting means based on the output of the conversion filter switching detecting means, and outputs of the response speed calculating means and the supplying means. On the basis of,
An automatic color temperature tracking device, comprising: an adjusting unit for adjusting white balance.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2007945A JPH0759089B2 (en) | 1990-01-16 | 1990-01-16 | Automatic color temperature tracking device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2007945A JPH0759089B2 (en) | 1990-01-16 | 1990-01-16 | Automatic color temperature tracking device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPH03211989A JPH03211989A (en) | 1991-09-17 |
| JPH0759089B2 true JPH0759089B2 (en) | 1995-06-21 |
Family
ID=11679633
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2007945A Expired - Lifetime JPH0759089B2 (en) | 1990-01-16 | 1990-01-16 | Automatic color temperature tracking device |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JPH0759089B2 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999020053A1 (en) | 1997-10-09 | 1999-04-22 | Mitsubishi Denki Kabushiki Kaisha | Digital convergence correcting device and display device |
-
1990
- 1990-01-16 JP JP2007945A patent/JPH0759089B2/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| JPH03211989A (en) | 1991-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5398058A (en) | Color image pickup device having color temperature converting filters | |
| JP3004382B2 (en) | TV camera device with variable shutter | |
| JPH0628478B2 (en) | Color imaging device | |
| JPH0759089B2 (en) | Automatic color temperature tracking device | |
| JPH09307913A (en) | White balance controller | |
| JPH0898200A (en) | Video camera | |
| JP4440562B2 (en) | Video signal processing device | |
| KR940007801Y1 (en) | Auto back-balance circuit | |
| JP2512665Y2 (en) | Video camera auto white balance circuit | |
| JPS60246193A (en) | High brightness correcting device of color video camera | |
| JP3867572B2 (en) | Imaging device | |
| JP3049439B2 (en) | White balance correction device | |
| JP2746400B2 (en) | Automatic aperture device for video cameras | |
| JP2614542B2 (en) | White balance adjustment device | |
| JPH0693781B2 (en) | Automatic white balance control circuit | |
| JP2558400B2 (en) | Auto white balance correction device | |
| JPH0628479B2 (en) | White balance circuit | |
| JPS61101188A (en) | Color television camera | |
| JPH02279085A (en) | Automatic white balance adjusting device for video camera | |
| JP3704909B2 (en) | Imaging device | |
| WO2005120082A1 (en) | Camera device | |
| JPS63141488A (en) | White balance correcting device | |
| JPH074018B2 (en) | Auto white balance adjustment circuit | |
| JP4026225B2 (en) | Color signal processing circuit and camera system using the same | |
| JPH06101853B2 (en) | Color imaging device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20090621 Year of fee payment: 14 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20090621 Year of fee payment: 14 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20100621 Year of fee payment: 15 |
|
| EXPY | Cancellation because of completion of term | ||
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20100621 Year of fee payment: 15 |