JP4345349B2 - In-vehicle sound reproduction device - Google Patents

In-vehicle sound reproduction device Download PDF

Info

Publication number
JP4345349B2
JP4345349B2 JP2003134086A JP2003134086A JP4345349B2 JP 4345349 B2 JP4345349 B2 JP 4345349B2 JP 2003134086 A JP2003134086 A JP 2003134086A JP 2003134086 A JP2003134086 A JP 2003134086A JP 4345349 B2 JP4345349 B2 JP 4345349B2
Authority
JP
Japan
Prior art keywords
sound
microphone
speaker
vehicle
sound reproduction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2003134086A
Other languages
Japanese (ja)
Other versions
JP2004338430A (en
Inventor
昭典 長谷川
文靖 今野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Corp
Panasonic Holdings Corp
Original Assignee
Panasonic Corp
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Corp, Matsushita Electric Industrial Co Ltd filed Critical Panasonic Corp
Priority to JP2003134086A priority Critical patent/JP4345349B2/en
Publication of JP2004338430A publication Critical patent/JP2004338430A/en
Application granted granted Critical
Publication of JP4345349B2 publication Critical patent/JP4345349B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Description

【0001】
【発明の属する技術分野】
本発明は自動車の走行状態による車室内の音響特性の変化を自動的に補正して良好なスピーカ再生音を得るための車載用再生装置に関するものである。
【0002】
【従来の技術】
周囲の騒音レベルの変動に応じてスピーカから再生される出力レベルを補正する従来の車載用音響再生装置のブロック図を図7に示す。同図において入力端子1から入力された信号は、入力信号の増幅率を変える可変利得増幅器2を通り電力増幅器3で電力増幅され、スピーカボックス6内のスピーカ4で再生される。
【0003】
そして、スピーカボックス6の周辺に配置された第1のマイクロホン7の信号とスピーカボックス6の内部に配置された第2のマイクロホン8の信号は、それぞれ最低共振周波数(f0)が同一な第1の低域通過フィルタ9と第1の高域通過フィルタ10を通り演算増幅器11に入力される。第1の低域通過フィルタ9と第1の高域通過フィルタ10の最低共振周波数(f0)をスピーカ4の最低共振周波数(f0)に合わせることにより、第1の低域通過フィルタ9と第1の高域通過フィルタ10の出力特性は周波数に対してほぼ同じ帯域通過特性でかつ位相が逆位相となる。第1の低域通過フィルタ9と第1の高域通過フィルタ10の出力信号を演算増幅器11にて演算し、第1の低域通過フィルタ9の出力信号からスピーカ4の再生音を減少させることにより受聴点でのスピーカ4の再生音と騒音の混合音を模擬する。そして第1の増幅器12により可変利得増幅器2の出力信号と同じ大きさになるように調整される。
【0004】
一方、可変利得増幅器2の出力信号は第2の低域通過フィルタ15と第2の高域通過フィルタ16により、騒音がない場合の演算増幅器11の出力特性と同じ帯域通過特性に調整される。
【0005】
上記2つの信号はそれぞれ第1の絶対値回路13および第2の絶対値回路17で正、負それぞれの絶対値に変換され、第1の積分器14、第2の積分器18で積分される。積分された正、負の絶対値信号は加算器19で加算されることにより2つの信号の差が比較演算され、第2の増幅器20から可変利得増幅器2の増幅率を変化させる信号が可変利得増幅器2に出力される。そして、スピーカボックス6の周辺に配置された第1のマイクロホン7とスピーカボックス6の内部に配置された第2のマイクロホン8の信号から得られる信号と、可変利得増幅器2の出力信号から得られる信号の差が無くなるまで可変利得増幅器2に第2の増幅器20から信号が出力される可変利得増幅器2の増幅率を変化させる。
【0006】
なお、この出願の発明に関連する先行技術文献情報としては、例えば特許文献1が知られている。
【0007】
【特許文献1】
特開2003−9276号公報
【0008】
【発明が解決しようとする課題】
しかしながら、この従来の車載用音響再生装置を車室内に設置する場合、スピーカボックス6を設置する場所によっては、スピーカ4及び第1のマイクロホン7の前面に荷物や乗員の身体などが接近する場合がある。この場合、スピーカ4及び第1のマイクロホン7の前面空間における音響特性に変化が生じ、第1のマイクロホン7が検出する信号と第2のマイクロホン8が検出する信号との相関が崩れてしまう。このような場合、乗員の受聴点でのスピーカ再生音と騒音の混合音を擬似した信号が実際の受聴点での信号と異なることとなり、スピーカ4から再生される音と実際の騒音の大きさに異差が発生したり、最悪の場合にはスピーカ4の再生音で可変利得増幅器2の増幅率が上がっていくという異常動作に至る問題があった。
【0009】
本発明はこの問題を解決するものであり、車室内の荷物の有無や乗員の有無に関わらず、スピーカからの再生音と騒音とから可変利得増幅器の増幅率を正確に変化させ、受聴点におけるマスキングに対して自然な補正を行う車載用音響再生装置を提供することを目的とする。
【0010】
【課題を解決するための手段】
上記目的を達成するために、本発明は以下の構成を有するものであり、その特徴部分について列挙する。
【0011】
本発明の請求項1に記載の発明は、車室内の騒音に応じて自動的に音量を調整する車載用音響再生装置であり、高音再生用スピーカと、中低音再生用スピーカと、前記高音再生用スピーカ近傍に設けられ、前記高音再生用スピーカからの出力音、前記中低音再生用スピーカからの出力音、および車室内の騒音との混合音を検出する第1のマイクロホンと、前記中低音再生用スピーカの近傍に設けられ、前記中低音再生用スピーカの再生音を検出する第2のマイクロホンと、前記第1のマイクロホンに接続された低域通過フィルタと、前記第2のマイクロホンに接続された増幅器と、前記低域通過フィルタに接続された第1の積分器と、前記増幅器に接続された第2の積分器と前記高音再生用スピーカと前記中低音再生用スピーカを駆動する電力増幅器に入る入力信号を自動的に調整する可変利得増幅器とを有し、前記第1のマイクロホンの出力信号は、前記低域通過フィルタで高域周波数成分を除去された後、前記第1の積分器で積分され、前記第2のマイクロホンの出力信号は、前記増幅器にて出力信号レベルを前記第1のマイクロホンの出力信号レベルと同じ大きさに調整された後、前記第2の積分器で積分され、これら積分された前記第1のマイクロホンの出力信号と前記第2のマイクロホンの出力信号とを比較し、前記第1のマイクロホンからの出力信号が大きい場合は前記可変利得増幅器の利得を上げ、前記第2のマイクロホンからの出力信号が大きい場合は前記可変利得増幅器の利得を下げる車載用音響再生装置であり、車室内の中低音再生用スピーカの再生音と車室内の騒音の混合音と、中低音再生用スピーカの再生音を検出して両者の信号を直接比較し、中低音再生用スピーカの再生音と騒音の混合音のレベルに追従して可変利得増幅器の増幅率を変化させることにより、車室内の荷物の有無や乗員の有無に関わらず受聴点における騒音のマスキングに対して自然な補正ができるという作用を有する。
【0012】
本発明の請求項2に記載の発明は、車室内の中低音再生用スピーカの再生音と騒音の混合音を検出するための第1のマイクロホンを近傍に設置した高音再生用スピーカを、車両のインストルメントパネル上面の左右端に第1のマイクロホンと高音再生用スピーカの振動面をフロントガラス面側に向けて設置した構成としており、正確に受聴点と同等の中低音再生用スピーカの再生音と騒音の混合音を検出できるという作用を有する。
【0013】
本発明の請求項3に記載の発明は、車室内の中低音再生用スピーカの再生音と騒音の混合音を検出するための第1のマイクロホンを近傍に設置した高音再生用スピーカを、車両の左右のフロントピラーに設置した構成を有しており、請求項2に記載の発明と同様の作用を有するとともに、車室内の定在波と反射あるいは吸音による音響特性のピークやディップを検出できるという作用を有する。
【0014】
本発明の請求項4に記載の発明は、車室内の中低音再生用スピーカの再生音と騒音の混合音を検出するための第1のマイクロホンを近傍に設置した高音再生用スピーカを、車両の左右ドアの車室内面の上部に設置した構成を有しており、請求項3に記載の発明と同様の作用を有するとともに、中低音再生用スピーカと高音再生用スピーカが同一の車両ドアに設置されることにより、電力増幅器との配線が容易になるという効果が得られる。
【0015】
本発明の請求項5に記載の発明は、車室内の中低音再生用スピーカの再生音と騒音の混合音を検出するための第1のマイクロホンを近傍に設置した高音再生用スピーカを、車両の左右のドアミラー部の車室内面に設置した構成を有しており、請求項4に記載の発明と同様の作用効果を有する。
【0016】
本発明の請求項6に記載の発明は、高音再生用スピーカの近傍に配置され車室内の中低音再生用スピーカの再生音と騒音の混合音を検出するための第1のマイクロホンの信号から、車室内の定在波成分と反射あるいは吸音による音響特性のピークやディップ成分を取出すための信号処理回路と帰還制御回路を追加した構成を有しており、請求項1に記載の発明と同様の作用を有するとともに車室内の定在波の抑制と車室内の音響特性のピークやディップを自動的に補正することを可能にする作用を有する。
【0017】
【発明の実施の形態】
以下、本発明の実施の形態について図1から図6を用いて説明する。
【0018】
(実施の形態1)
図1は本発明の実施の形態1における車載用音響再生装置のブロック図を示す。図1において、入力端子21に入力された信号は可変利得増幅器22に加えられ、この可変利得増幅器22は後述する車室内騒音と高音再生用スピーカ26および中低音再生用スピーカ24からの再生音の混合音に応じて生成される制御信号により制御される。可変利得増幅器22の出力信号は電力増幅器23に入力され、この電力増幅器23の出力信号は車両のドアに取付けられた中低音再生用スピーカ24と高音再生用スピーカ26により再生される。高音再生用スピーカ26の入力線にはコンデンサ27が挿入されていて、このコンデンサ27により中低域の信号が遮断され高域信号のみが高音再生用スピーカ26に入力され再生される。高音再生用スピーカ26の近傍には第1のマイクロホン28が配置され、車室内の周辺の騒音と高音再生用スピーカ26および中低音再生用スピーカ24からの再生音の混合音を検出する。一方、車両のドアに取付けられた中低音再生用スピーカ24の振動板25の近傍には、第2のマイクロホン29が配置され中低音再生用スピーカ24の再生音を検出する。
【0019】
高音再生用スピーカ26の近傍に設置された第1のマイクロホン28の出力信号の高域レベルは、高音再生用スピーカ26に近いため受聴点に比べ高くなる。一方、中低域レベルは車両ドアに取付けられた中低音再生用スピーカ24の振動板25の近傍に設けられた第2のマイクロホン29の出力信号に対し、中低音再生用スピーカ24の距離や位置などにより定まる伝達関数に応じてレベルが下がる。この高音再生用スピーカ26の近傍に設置された第1のマイクロホン28の出力信号を、低域通過フィルタ30にて高域周波数成分を遮断すると、上記2つのマイクロホン28,29の信号は一定のレベル差を持った相似信号と見なすことができる。
【0020】
中低音再生用スピーカ24の振動板25の近傍に設けられた第2のマイクロホン29の出力信号レベルを増幅器32にて調整し、高音再生用スピーカ26の近傍に設置された第1のマイクロホン28の信号レベルと同じ大きさに調整する。高音再生用スピーカ26の近傍に設置された第1のマイクロホン28の出力信号は低域通過フィルタ30で高域周波数成分を除去され第1の積分器31で積分される。車両のドアに取付けられた中低音再生用スピーカ24の振動板25の近傍に設けられた第2のマイクロホン29の出力信号は第2の積分器33にて積分され、2つの積分された信号は比較器34で比較される。上記2つの積分器31,33の出力信号差により、第1の積分器31の出力値が大きい場合は利得制御信号発生器35により可変利得増幅器22の利得を上げ、第2の積分器33の出力値が大きい場合は利得制御信号発生器35により可変利得増幅器22の利得を下げるように制御し、上記2つのマイクロホン28,29の信号の積分値が同じになるまで可変利得増幅器22の利得を制御する。
【0021】
車室内に騒音がない場合、上記2つのマイクロホン28,29の信号の積分値は同じになり可変利得増幅器22の利得は変化しない。車室内に騒音が生じたとき、第1の積分器31の出力値は第2の積分器33の出力値より騒音の分だけ大きくなり、第2の積分器33の出力値が第1の積分器31の出力値と同じになるまで可変利得増幅器22の利得を制御する。
【0022】
通常、高音再生用スピーカ26は音像を乗員の前方に定位させるために車両のハンドルの中心より上部の前方に設置するため、この高音再生用スピーカ26の近傍に設けた第1のマイクロホン28は荷物や乗員の身体の状態の影響を受けにくい。
【0023】
以上のように本実施の形態1における車載用音響再生装置は、車室内の荷物の有無や乗員の有無に関わらず、車室内の騒音と中低音再生用スピーカ24からの再生音とから自動的に制御目標値を定め、騒音の変化に追従して可変利得増幅器22の利得を変化させることにより、受聴点におけるマスキングに対して自然な補正ができるという効果を得ることが出来る。
【0024】
(実施の形態2)
図2は本発明の実施の形態2における車室内の中低音再生用スピーカ24と高音再生用スピーカ26とそれぞれの近傍に設置したマイクロホン28,29の位置関係を示した図である。図2において中低音再生用スピーカ24の再生音と騒音の混合音を検出するための第1のマイクロホン28を近傍に設置した高音再生用スピーカ26は車両のインストルメントパネル52の上面の左右端に配置され、振動板25の近傍に第2のマイクロホン29を設置した中低音再生用スピーカ24はフロントドア50の下部に配置される。
【0025】
このような構成において中低音再生用スピーカ24から再生される再生音は、中低音再生用スピーカ24と受聴者の耳とほぼ同じ距離にある高音再生用スピーカ26の近傍に設置された第1のマイクロホン28で検出される。一方、車室内の騒音は狭い車室内の空間では検出する場所によるレベル差はないものとみなして良い。ゆえに車両のインストルメントパネル52の上面に設置した第1のマイクロホン28で検出される車室内の騒音と中低音再生用スピーカ24の再生音の混合音は、高音再生用スピーカ26の再生音を除くと受聴者の耳の位置での車室内騒音と中低音再生用スピーカ24の再生音の混合音と同等となり、この信号を用いて可変利得増幅器22の利得を制御することで違和感のない自然な制御を可能とする。
【0026】
(実施の形態3)
図3は本発明の実施の形態3における車室内の中低音再生用スピーカ24と高音再生用スピーカ26とそれぞれの近傍に設置したマイクロホン28,29の位置関係を示した図である。図3において、中低音再生用スピーカ24の再生音と騒音の混合音を検出するための第1のマイクロホン28を近傍に設置した高音再生用スピーカ26は車室内のフロントピラー51に、フロントドア50の下部に配置された振動板25の近傍に第2のマイクロホン29を設置した中低音再生用スピーカ24の取付け面と第1のマイクロホン28の検出面が平行になるように取付けられている。
【0027】
第1のマイクロホン28で検出される車室内の騒音と中低音再生用スピーカ24の再生音の混合音と受聴者の耳の位置での車室内の騒音と中低音再生用スピーカ24の再生音の混合音との関係は実施の形態2と同様である。さらに第1のマイクロホン28がフロントドア50の下部に配置された中低音再生用スピーカ24の取付け面と向かい合った構成となるため、向かい合った面の距離に対応した波長の1/2や1/4の定在波を検出することが可能となる。更に車室内の左右両端の面により近づくことで、反射や吸音の影響を受けやすくなり音響特性のピークやディップの検出も可能となる。
【0028】
(実施の形態4)
図4は本発明の実施の形態4における車室内の中低音再生用スピーカ24と高音再生用スピーカ26とそれぞれの近傍に設置したマイクロホン28、29の位置関係を示した図である。図4において中低音再生用スピーカ24の再生音と騒音の混合音を検出するための第1のマイクロホン28を近傍に設置した高音再生用スピーカ26は、車両の左右フロントドア50の車室内面の上部に、フロントドア50の下部に配置された振動板25の近傍に第2のマイクロホン29を設置した中低音再生用スピーカ24の取付け面と第1のマイクロホン28の検出面が平行になるように取付けられている。
【0029】
実施の形態3と同様の効果を有するとともに、上記2つのスピーカ24,26を同じフロントドア50に配置することでスピーカの配線が容易にできるという効果も得られる。
【0030】
(実施の形態5)
図5は本発明の実施の形態5における車室内の中低音再生用スピーカ24と高音再生用スピーカ26とそれぞれの近傍に設置したマイクロホン28,29の位置関係を示した図である。図5において中低音再生用スピーカ24の再生音と騒音の混合音を検出するための第1のマイクロホン28を近傍に設置した高音再生用スピーカ26は車両の左右のドアミラー部54の車室内面に、フロントドア50の下部に配置された振動板25の近傍に第2のマイクロホン29を設置した中低音再生用スピーカ24の取付け面と第1のマイクロホン28の検出面が平行になるように取付けられている。効果については実施の形態4と同様である。
【0031】
(実施の形態6)
図6は本発明の実施の形態6におけるブロック図を示す。本発明の実施の形態1と異なるところは、高音再生用スピーカ26の近傍に配置され、車室内の中低音再生用スピーカ24の再生音と騒音の混合音を検出するための第1のマイクロホン28の信号から車室内の定在波成分と反射あるいは吸音による音響特性のピークやディップ成分を取出すための信号処理回路37と、減算器36および演算増幅器38からなる帰還制御回路を追加した構成となっている。
【0032】
実施の形態3から5で述べたように、中低音再生用スピーカ24の再生音と騒音の混合音を検出するための第1のマイクロホン28を近傍に設置した高域再生用スピーカ26を配置すると車室内の定在波と反射および吸音による音響特性のピークやディップが検出される。この第1のマイクロホン28の信号から信号処理回路37により定在波とピーク成分やディップ成分を取出し、可変利得増幅器22の前段に設けた減算器36に帰還させることで自動的に車室内の定在波と音響特性のピークやディップを補正できるという効果を有するものである。
【0033】
【発明の効果】
以上のように、本発明は車室内の荷物の有無や乗員の有無に関わらず、中低音再生用スピーカからの再生音と騒音とから可変利得増幅器の増幅率を正確に変化させ、受聴点におけるマスキングに対して自然な補正を行うことができる車載用音響再生装置を提供するものである。
【図面の簡単な説明】
【図1】本発明の実施の形態1における車載用音響再生装置を示すブロック図
【図2】同実施の形態2のスピーカとマイクロホンの位置関係を示す図
【図3】同実施の形態3のスピーカとマイクロホンの位置関係を示す図
【図4】同実施の形態4のスピーカとマイクロホンの位置関係を示す図
【図5】同実施の形態5のスピーカとマイクロホンの位置関係を示す図
【図6】同実施の形態6における車載用音響再生装置を示すブロック図
【図7】従来の車載用音響再生装置を示すブロック図
【符号の説明】
21 入力端子
22 可変利得増幅器
23 電力増幅器
24 中低音再生用スピーカ
25 振動板
26 高音再生用スピーカ
27 コンデンサ
28 第1のマイクロホン
29 第2のマイクロホン
30 低域通過フィルタ
31 第1の積分器
32 増幅器
33 第2の積分器
34 比較器
35 利得制御信号発生器
36 減算器
37 信号処理回路
38 演算増幅器
[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an in-vehicle reproduction apparatus for automatically correcting a change in acoustic characteristics in a vehicle interior due to a running state of an automobile and obtaining a good speaker reproduction sound.
[0002]
[Prior art]
FIG. 7 shows a block diagram of a conventional on-vehicle sound reproducing device that corrects an output level reproduced from a speaker in accordance with fluctuations in ambient noise level. In the figure, the signal input from the input terminal 1 passes through the variable gain amplifier 2 that changes the amplification factor of the input signal, is amplified by the power amplifier 3, and is reproduced by the speaker 4 in the speaker box 6.
[0003]
The signal of the first microphone 7 arranged around the speaker box 6 and the signal of the second microphone 8 arranged inside the speaker box 6 have the same lowest resonance frequency (f 0 ). The low-pass filter 9 and the first high-pass filter 10 are input to the operational amplifier 11. By matching the lowest resonance frequency of the first low-pass filter 9 and the first high-pass filter 10 (f 0) to the minimum resonance frequency of the speaker 4 (f 0), a first low-pass filter 9 The output characteristics of the first high-pass filter 10 are substantially the same band-pass characteristics with respect to frequency, and the phase is opposite. The output signals of the first low-pass filter 9 and the first high-pass filter 10 are calculated by the operational amplifier 11, and the reproduced sound of the speaker 4 is reduced from the output signal of the first low-pass filter 9. This simulates the mixed sound of the reproduction sound and noise of the speaker 4 at the listening point. Then, the first amplifier 12 is adjusted so as to have the same magnitude as the output signal of the variable gain amplifier 2.
[0004]
On the other hand, the output signal of the variable gain amplifier 2 is adjusted by the second low-pass filter 15 and the second high-pass filter 16 to the same band pass characteristic as the output characteristic of the operational amplifier 11 when there is no noise.
[0005]
The two signals are converted into positive and negative absolute values by the first absolute value circuit 13 and the second absolute value circuit 17, respectively, and integrated by the first integrator 14 and the second integrator 18. . The integrated positive and negative absolute value signals are added by an adder 19 so that the difference between the two signals is compared and a signal for changing the amplification factor of the variable gain amplifier 2 from the second amplifier 20 is variable gain. It is output to the amplifier 2. Then, a signal obtained from the signals of the first microphone 7 arranged around the speaker box 6 and the second microphone 8 arranged inside the speaker box 6 and a signal obtained from the output signal of the variable gain amplifier 2 The gain of the variable gain amplifier 2 from which the signal is output from the second amplifier 20 is changed to the variable gain amplifier 2 until the difference is eliminated.
[0006]
For example, Patent Document 1 is known as prior art document information related to the invention of this application.
[0007]
[Patent Document 1]
Japanese Patent Laid-Open No. 2003-9276
[Problems to be solved by the invention]
However, when this conventional in-vehicle sound reproducing device is installed in the vehicle interior, depending on the location where the speaker box 6 is installed, luggage or the body of an occupant may approach the front surface of the speaker 4 and the first microphone 7. is there. In this case, the acoustic characteristics in the front space of the speaker 4 and the first microphone 7 change, and the correlation between the signal detected by the first microphone 7 and the signal detected by the second microphone 8 is lost. In such a case, the signal simulating the mixed sound of the speaker reproduction sound and noise at the occupant's listening point is different from the signal at the actual listening point, and the sound reproduced from the speaker 4 and the actual noise level are different. In the worst case, the gain of the variable gain amplifier 2 is increased by the reproduced sound of the speaker 4.
[0009]
The present invention solves this problem. Regardless of the presence or absence of luggage in the passenger compartment or the presence or absence of passengers, the amplification factor of the variable gain amplifier is accurately changed from the reproduced sound and noise from the speaker, so that It is an object of the present invention to provide an on-vehicle sound reproducing device that performs natural correction for masking.
[0010]
[Means for Solving the Problems]
In order to achieve the above object, the present invention has the following configuration, and its characteristic parts are listed.
[0011]
The invention according to claim 1 of the present invention is an on-vehicle sound reproduction device that automatically adjusts the volume according to noise in the vehicle interior, and includes a high-frequency sound reproduction speaker, a mid-low-frequency sound reproduction speaker, and the high-frequency sound reproduction device. A first microphone provided in the vicinity of the speaker for detecting a mixed sound of an output sound from the high sound reproduction speaker, an output sound from the medium / low sound reproduction speaker, and a vehicle interior noise; and the medium / low sound reproduction A second microphone that is provided in the vicinity of the speaker for detecting the reproduction sound of the middle / low sound reproduction speaker, a low-pass filter that is connected to the first microphone, and a second microphone that is connected to the second microphone An amplifier, a first integrator connected to the low-pass filter, a second integrator connected to the amplifier, the high-frequency sound reproduction speaker, and the middle-low sound reproduction speaker A variable gain amplifier that automatically adjusts an input signal entering the amplifier, and the output signal of the first microphone is subjected to the first integration after the high-frequency component is removed by the low-pass filter. And the output signal level of the second microphone is adjusted to the same level as the output signal level of the first microphone by the amplifier, and then integrated by the second integrator. And comparing the integrated output signal of the first microphone and the output signal of the second microphone, and if the output signal from the first microphone is large, increasing the gain of the variable gain amplifier, wherein when the output signal from the second microphone is large is vehicle audio reproducing apparatus to reduce the gain of the variable gain amplifier, the reproduced sound of the low-frequency sound reproducing speaker in the car compartment and passenger compartment The mixed sound of the noise and the reproduction sound of the middle / low frequency reproduction speaker are detected and directly compared, and the level of the mixed sound of the reproduction sound and noise of the middle / low frequency reproduction speaker is tracked. By changing the amplification factor, a natural correction can be made for noise masking at the listening point regardless of the presence or absence of luggage in the passenger compartment or the presence or absence of passengers.
[0012]
According to a second aspect of the present invention, there is provided a high sound reproduction speaker in which a first microphone for detecting a mixed sound of a reproduction sound and a noise of a middle / low sound reproduction speaker in a vehicle interior is installed in the vicinity of the vehicle. The first microphone and the vibration surface of the high-frequency sound reproduction speaker are installed on the left and right edges of the top surface of the instrument panel with the windshield surface facing the windshield surface. It has the effect that a mixed sound of noise can be detected.
[0013]
According to a third aspect of the present invention, there is provided a high sound reproduction speaker in which a first microphone for detecting a mixed sound of a reproduction sound and a noise of a medium / low sound reproduction speaker in a vehicle interior is installed in the vicinity of the vehicle. It has a configuration installed on the left and right front pillars, has the same effect as the invention of claim 2, and can detect peaks and dips of acoustic characteristics due to standing waves and reflection or sound absorption in the passenger compartment. Has an effect.
[0014]
According to a fourth aspect of the present invention, there is provided a high sound reproduction speaker in which a first microphone for detecting a mixed sound of reproduced sound and noise of a medium / low sound reproduction speaker in a vehicle interior is installed in the vicinity of the vehicle. It has the structure installed in the upper part of the vehicle interior surface of the left and right doors, and has the same operation as that of the invention according to claim 3, and the middle and low tone reproduction speakers are installed in the same vehicle door. By doing so, the effect that wiring with a power amplifier becomes easy is acquired.
[0015]
According to a fifth aspect of the present invention, there is provided a high sound reproduction speaker in which a first microphone for detecting a mixed sound of a reproduction sound and a noise of a medium / low sound reproduction speaker in a vehicle interior is installed in the vicinity of the vehicle. It has the structure installed in the vehicle interior surface of the left-right door mirror part, and has the same effect as the invention of Claim 4.
[0016]
The invention according to claim 6 of the present invention is based on the signal from the first microphone for detecting the mixed sound of the reproduction sound and the noise of the middle / low sound reproduction speaker arranged in the vicinity of the high sound reproduction speaker. A signal processing circuit and a feedback control circuit for extracting a standing wave component in a vehicle interior and a peak or dip component of acoustic characteristics due to reflection or sound absorption are added, and the configuration is the same as that of the invention according to claim 1. It has the effect of suppressing the standing wave in the passenger compartment and automatically correcting the peak and dip of the acoustic characteristics in the passenger compartment.
[0017]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to FIGS.
[0018]
(Embodiment 1)
FIG. 1 is a block diagram of an in-vehicle sound reproducing device according to Embodiment 1 of the present invention. In FIG. 1, a signal input to an input terminal 21 is applied to a variable gain amplifier 22, and this variable gain amplifier 22 is used to generate vehicle interior noise and a reproduced sound from a high sound reproduction speaker 26 and a medium / low sound reproduction speaker 24 described later. It is controlled by a control signal generated according to the mixed sound. The output signal of the variable gain amplifier 22 is input to a power amplifier 23, and the output signal of the power amplifier 23 is reproduced by a medium / low sound reproduction speaker 24 and a high sound reproduction speaker 26 attached to a vehicle door. A capacitor 27 is inserted in the input line of the high-frequency sound reproduction speaker 26, and the low-frequency signal is cut off by the capacitor 27, and only the high-frequency signal is input to the high-frequency sound reproduction speaker 26 and reproduced. A first microphone 28 is disposed in the vicinity of the high sound reproduction speaker 26 to detect a mixed sound of ambient noise in the vehicle interior and reproduction sound from the high sound reproduction speaker 26 and the medium / low sound reproduction speaker 24. On the other hand, a second microphone 29 is disposed in the vicinity of the diaphragm 25 of the medium / low sound reproduction speaker 24 attached to the door of the vehicle to detect the reproduction sound of the medium / low sound reproduction speaker 24.
[0019]
The high level of the output signal of the first microphone 28 installed in the vicinity of the high sound reproduction speaker 26 is close to the high sound reproduction speaker 26 and thus becomes higher than the listening point. On the other hand, the mid-low range level is the distance and position of the mid-low sound reproduction speaker 24 with respect to the output signal of the second microphone 29 provided in the vicinity of the diaphragm 25 of the mid-low sound reproduction speaker 24 attached to the vehicle door. The level decreases according to the transfer function determined by the above. When the output signal of the first microphone 28 installed in the vicinity of the high sound reproduction speaker 26 is blocked by the low-pass filter 30, the signals of the two microphones 28 and 29 have a certain level. It can be regarded as a similar signal with a difference.
[0020]
The output signal level of the second microphone 29 provided in the vicinity of the diaphragm 25 of the middle / low sound reproduction speaker 24 is adjusted by the amplifier 32, and the first microphone 28 installed in the vicinity of the high sound reproduction speaker 26 is adjusted. Adjust to the same size as the signal level. The output signal of the first microphone 28 installed in the vicinity of the high sound reproduction speaker 26 is removed by the low-pass filter 30 and is integrated by the first integrator 31. The output signal of the second microphone 29 provided in the vicinity of the diaphragm 25 of the medium / low sound reproduction speaker 24 attached to the vehicle door is integrated by the second integrator 33, and the two integrated signals are obtained. Comparison is performed by the comparator 34. When the output value of the first integrator 31 is large due to the difference between the output signals of the two integrators 31 and 33, the gain of the variable gain amplifier 22 is increased by the gain control signal generator 35, and the second integrator 33 When the output value is large, the gain control signal generator 35 controls the gain of the variable gain amplifier 22 to decrease, and the gain of the variable gain amplifier 22 is increased until the integrated values of the signals of the two microphones 28 and 29 become the same. Control.
[0021]
When there is no noise in the passenger compartment, the integrated values of the signals of the two microphones 28 and 29 are the same, and the gain of the variable gain amplifier 22 does not change. When noise occurs in the passenger compartment, the output value of the first integrator 31 is larger than the output value of the second integrator 33 by the amount of noise, and the output value of the second integrator 33 is the first integration value. The gain of the variable gain amplifier 22 is controlled until the output value of the amplifier 31 becomes the same.
[0022]
Usually, the high sound reproduction speaker 26 is installed in front of the center of the handle of the vehicle so as to localize the sound image in front of the occupant. Therefore, the first microphone 28 provided in the vicinity of the high sound reproduction speaker 26 is a luggage. And is not easily affected by the condition of the passenger's body.
[0023]
As described above, the on-vehicle sound reproduction device according to the first embodiment automatically uses the vehicle interior noise and the reproduced sound from the middle / low sound reproduction speaker 24 regardless of the presence or absence of luggage or the presence of passengers. By setting the control target value and changing the gain of the variable gain amplifier 22 following the change in noise, it is possible to obtain an effect that natural correction can be performed for masking at the listening point.
[0024]
(Embodiment 2)
FIG. 2 is a diagram showing the positional relationship between the middle / low sound reproduction speaker 24 and the high sound reproduction speaker 26 and the microphones 28 and 29 installed in the vicinity of the vehicle interior according to the second embodiment of the present invention. In FIG. 2, the high sound reproduction speaker 26 in which the first microphone 28 for detecting the mixed sound of the reproduction sound and the noise of the medium / low sound reproduction speaker 24 is installed in the vicinity is provided on the left and right ends of the upper surface of the instrument panel 52 of the vehicle. The middle / low-pitched sound reproduction speaker 24 that is disposed and has the second microphone 29 disposed in the vicinity of the diaphragm 25 is disposed below the front door 50.
[0025]
In such a configuration, the reproduced sound reproduced from the medium / low sound reproduction speaker 24 is a first sound installed in the vicinity of the high / low sound reproduction speaker 26 at approximately the same distance as the medium / low sound reproduction speaker 24 and the listener's ear. It is detected by the microphone 28. On the other hand, the noise in the vehicle interior may be regarded as having no level difference depending on where it is detected in a narrow vehicle interior space. Therefore, the mixed sound of the vehicle interior noise detected by the first microphone 28 installed on the upper surface of the instrument panel 52 of the vehicle and the reproduction sound of the middle / low sound reproduction speaker 24 excludes the reproduction sound of the high sound reproduction speaker 26. And the mixed sound of the vehicle interior noise at the position of the listener's ear and the reproduced sound of the middle / low sound reproducing speaker 24, and by using this signal to control the gain of the variable gain amplifier 22, there is no sense of incongruity. Allows control.
[0026]
(Embodiment 3)
FIG. 3 is a diagram showing the positional relationship between the middle / low sound reproducing speaker 24 and the high sound reproducing speaker 26 and the microphones 28 and 29 installed in the vicinity of the vehicle interior according to the third embodiment of the present invention. In FIG. 3, a high sound reproduction speaker 26 in which a first microphone 28 for detecting a mixed sound of the reproduction sound and noise of the medium / low sound reproduction speaker 24 is installed in the vicinity of the front pillar 51 in the vehicle interior and the front door 50. Are attached so that the mounting surface of the speaker for medium / low sound reproduction 24 in which the second microphone 29 is installed in the vicinity of the diaphragm 25 arranged in the lower part of the first microphone 28 and the detection surface of the first microphone 28 are parallel to each other.
[0027]
The mixed sound of the vehicle interior noise detected by the first microphone 28 and the reproduction sound of the middle / low sound reproduction speaker 24, the vehicle interior noise at the position of the listener's ear and the reproduction sound of the middle / low sound reproduction speaker 24 The relationship with the mixed sound is the same as in the second embodiment. Further, since the first microphone 28 is configured to face the mounting surface of the mid / low-pitched sound reproduction speaker 24 disposed at the lower part of the front door 50, the wavelength of the wavelength corresponding to the distance of the facing surface is ½ or ¼. It is possible to detect standing waves. Furthermore, by approaching the left and right end surfaces of the vehicle interior, it is easy to be affected by reflection and sound absorption, and the peak and dip of the acoustic characteristics can be detected.
[0028]
(Embodiment 4)
FIG. 4 is a diagram showing the positional relationship between the middle / low sound reproduction speaker 24 and the high sound reproduction speaker 26 and microphones 28 and 29 installed in the vicinity of the vehicle interior according to the fourth embodiment of the present invention. In FIG. 4, the high sound reproduction speaker 26 in which the first microphone 28 for detecting the mixed sound of the reproduction sound and the noise of the medium / low sound reproduction speaker 24 is installed in the vicinity of the vehicle interior surface of the left and right front doors 50 of the vehicle. In the upper part, the mounting surface of the middle / low sound reproducing speaker 24 in which the second microphone 29 is installed in the vicinity of the diaphragm 25 disposed at the lower part of the front door 50 and the detection surface of the first microphone 28 are parallel to each other. Installed.
[0029]
In addition to the same effects as those of the third embodiment, arranging the two speakers 24 and 26 on the same front door 50 also provides an effect that the wiring of the speakers can be easily performed.
[0030]
(Embodiment 5)
FIG. 5 is a diagram showing the positional relationship between the middle / low sound reproduction speaker 24 and the high sound reproduction speaker 26 and microphones 28 and 29 installed in the vicinity of the vehicle interior according to the fifth embodiment of the present invention. In FIG. 5, the high sound reproduction speaker 26 in which the first microphone 28 for detecting the mixed sound of the reproduction sound and the noise of the middle / low sound reproduction speaker 24 is installed in the vicinity is provided on the vehicle interior surface of the left and right door mirror portions 54 of the vehicle. The mounting surface of the middle / low sound reproducing speaker 24 in which the second microphone 29 is installed in the vicinity of the diaphragm 25 disposed at the lower part of the front door 50 and the detection surface of the first microphone 28 are mounted in parallel. ing. The effect is the same as in the fourth embodiment.
[0031]
(Embodiment 6)
FIG. 6 shows a block diagram in the sixth embodiment of the present invention. A difference from the first embodiment of the present invention is that the first microphone 28 is arranged in the vicinity of the high sound reproduction speaker 26 and detects the mixed sound of the reproduction sound and the noise of the medium / low sound reproduction speaker 24 in the vehicle interior. The signal processing circuit 37 for extracting the standing wave component in the vehicle interior, the peak of the acoustic characteristic due to reflection or sound absorption, and the dip component from the above signal, and the feedback control circuit comprising the subtractor 36 and the operational amplifier 38 are added. ing.
[0032]
As described in the third to fifth embodiments, when the high frequency reproduction speaker 26 in which the first microphone 28 for detecting the mixed sound of the reproduction sound and the noise of the medium / low sound reproduction speaker 24 is installed is disposed. Peaks and dips in acoustic characteristics due to standing waves, reflections and sound absorption in the passenger compartment are detected. A standing wave, a peak component, and a dip component are extracted from the signal of the first microphone 28 by the signal processing circuit 37, and are automatically fed back to the subtractor 36 provided in the preceding stage of the variable gain amplifier 22 to automatically determine the interior of the vehicle interior. This has the effect of correcting the peak and dip of the standing wave and the acoustic characteristics.
[0033]
【The invention's effect】
As described above, the present invention accurately changes the amplification factor of the variable gain amplifier from the reproduction sound and noise from the middle / low sound reproduction speaker regardless of the presence or absence of luggage in the passenger compartment or the presence or absence of a passenger, and at the listening point. It is an object of the present invention to provide an in-vehicle sound reproducing apparatus capable of performing natural correction for masking.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an in-vehicle sound reproducing device according to Embodiment 1 of the present invention. FIG. 2 is a diagram showing a positional relationship between a speaker and a microphone according to Embodiment 2. FIG. FIG. 4 is a diagram showing the positional relationship between the speaker and the microphone. FIG. 4 is a diagram showing the positional relationship between the speaker and the microphone according to the fourth embodiment. FIG. 5 is a diagram showing the positional relationship between the speaker and the microphone according to the fifth embodiment. FIG. 7 is a block diagram showing a vehicle-mounted sound reproducing device according to the sixth embodiment. FIG. 7 is a block diagram showing a conventional vehicle-mounted sound reproducing device.
21 Input terminal 22 Variable gain amplifier 23 Power amplifier 24 Medium / low sound reproduction speaker 25 Diaphragm 26 High sound reproduction speaker 27 Capacitor 28 First microphone 29 Second microphone 30 Low-pass filter 31 First integrator 32 Amplifier 33 Second integrator 34 Comparator 35 Gain control signal generator 36 Subtractor 37 Signal processing circuit 38 Operational amplifier

Claims (6)

車室内の騒音に応じて自動的に音量を調整する車載用音響再生装置であり、
高音再生用スピーカと、
中低音再生用スピーカと、
前記高音再生用スピーカ近傍に設けられ、前記高音再生用スピーカからの出力音、前記中低音再生用スピーカからの再生音、および車室内の騒音との混合音を検出する第1のマイクロホンと、
前記中低音再生用スピーカの近傍に設けられ、前記中低音再生用スピーカの再生音を検出する第2のマイクロホンと、
前記第1のマイクロホンに接続された低域通過フィルタと、
前記第2のマイクロホンに接続された増幅器と、
前記低域通過フィルタに接続された第1の積分器と、
前記増幅器に接続された第2の積分器と
前記高音再生用スピーカと前記中低音再生用スピーカを駆動する電力増幅器に入る入力信号を自動的に調整する可変利得増幅器とを有し、
前記第1のマイクロホンの出力信号は、前記低域通過フィルタで高域周波数成分を除去された後、前記第1の積分器で積分され、
前記第2のマイクロホンの出力信号は、前記増幅器にて出力信号レベルを前記第1のマイクロホンの出力信号レベルと同じ大きさに調整された後、前記第2の積分器で積分され、
これら積分された前記第1のマイクロホンの出力信号と前記第2のマイクロホンの出力信号とを比較し、前記第1のマイクロホンからの出力信号が大きい場合は前記可変利得増幅器の利得を上げ、前記第2のマイクロホンからの出力信号が大きい場合は前記可変利得増幅器の利得を下げる車載用音響再生装置。
It is an in-vehicle sound reproduction device that automatically adjusts the volume according to the noise in the passenger compartment,
A speaker for high-pitched sound reproduction;
A mid-low range speaker,
A first microphone that is provided in the vicinity of the high-frequency sound reproduction speaker and detects a mixed sound of the output sound from the high-frequency sound reproduction speaker, the reproduction sound from the medium-low sound reproduction speaker, and the vehicle interior noise;
A second microphone provided in the vicinity of the middle / low sound reproduction speaker and detecting a reproduction sound of the middle / low sound reproduction speaker;
A low pass filter connected to the first microphone;
An amplifier connected to the second microphone;
A first integrator connected to the low pass filter;
A second integrator connected to the amplifier;
A variable gain amplifier that automatically adjusts an input signal that enters a power amplifier that drives the high-pitched sound reproduction speaker and the mid-low sound reproduction speaker;
The output signal of the first microphone is integrated by the first integrator after the high-frequency component is removed by the low-pass filter,
The output signal of the second microphone is adjusted by the amplifier to have the same output signal level as the output signal level of the first microphone, and then integrated by the second integrator.
The integrated output signal of the first microphone and the output signal of the second microphone are compared, and when the output signal from the first microphone is large, the gain of the variable gain amplifier is increased, and the first A vehicle-mounted sound reproduction device that reduces the gain of the variable gain amplifier when the output signal from the microphone of 2 is large .
前記高音再生用スピーカを車両のインストルメントパネル上面の左右端に前記第1のマイクロホンと前記高音再生用スピーカの振動面をフロントガラス面に向けて設置する構成とした請求項1に記載の車載用音響再生装置。 The in-vehicle use according to claim 1, wherein the high sound reproduction speaker is installed on left and right ends of an upper surface of an instrument panel of a vehicle with a vibration surface of the first microphone and the high sound reproduction speaker facing a windshield surface. Sound playback device. 前記高音再生用スピーカを車両の左右のフロントピラーに設置する構成とした請求項1に記載の車載用音響再生装置。 The in-vehicle sound reproducing device according to claim 1, wherein the high sound reproducing speaker is installed on left and right front pillars of a vehicle. 前記高音再生用スピーカを車両の左右ドアの車室内面の上部に設置する構成とした請求項1に記載の車載用音響再生装置。 The on- vehicle sound reproduction device according to claim 1, wherein the high-frequency sound reproduction speaker is installed on an upper portion of a vehicle interior surface of the left and right doors of the vehicle. 前記高音再生用スピーカを車両の左右のドアミラー部の車室内面に設置する構成とした請求項1に記載の車載用音響再生装置。 The in-vehicle sound reproducing apparatus according to claim 1, wherein the high-frequency sound reproducing speaker is installed on a vehicle interior surface of the left and right door mirror portions of the vehicle. 前記可変利得増幅器の前段に減算器をさらに設け、
前記第1のマイクロホンの信号から車室内の定在波と反射あるいは吸音による音響特性のピーク成分およびディップ成分を検出し、これらを前記減算器に帰還させることで、定在波、ピークおよびディップがなくなるように電力増幅器の入力特性を自動補正させるようにした請求項1に記載の車載用音響再生装置。
A subtractor is further provided in front of the variable gain amplifier,
Detecting a peak component and a dip component of said first acoustic characteristics from the microphone signal by a standing wave and the reflection or sound absorption in the vehicle interior, these by feeding back to the subtracter, the standing wave, the peak and dip The in-vehicle sound reproducing apparatus according to claim 1, wherein the input characteristics of the power amplifier are automatically corrected so as to be eliminated.
JP2003134086A 2003-05-13 2003-05-13 In-vehicle sound reproduction device Expired - Fee Related JP4345349B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2003134086A JP4345349B2 (en) 2003-05-13 2003-05-13 In-vehicle sound reproduction device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2003134086A JP4345349B2 (en) 2003-05-13 2003-05-13 In-vehicle sound reproduction device

Publications (2)

Publication Number Publication Date
JP2004338430A JP2004338430A (en) 2004-12-02
JP4345349B2 true JP4345349B2 (en) 2009-10-14

Family

ID=33524740

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2003134086A Expired - Fee Related JP4345349B2 (en) 2003-05-13 2003-05-13 In-vehicle sound reproduction device

Country Status (1)

Country Link
JP (1) JP4345349B2 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4657872B2 (en) * 2005-09-28 2011-03-23 クラリオン株式会社 REPRODUCTION DEVICE, REPRODUCTION METHOD, AND PROGRAM
JP4900686B2 (en) * 2006-10-16 2012-03-21 スズキ株式会社 Voice collecting device for vehicle

Also Published As

Publication number Publication date
JP2004338430A (en) 2004-12-02

Similar Documents

Publication Publication Date Title
CN107025910B (en) Active noise control by adaptive noise filtering
JP3533092B2 (en) Audio system
JPH0389706A (en) Automatic sound volume adjustment device
JP2003061198A (en) Audio reproducing device
EP1486947A2 (en) A noise reduction apparatus in a car-mounted sound reproduction system
US20160295325A1 (en) Method and device
CN106911982A (en) Outside coupling speaker system
JP2007180896A (en) Voice signal processor and voice signal processing method
US20050286727A1 (en) Apparatus for expanding sound image upward
JP3461813B2 (en) Audio system
JP2008070878A (en) Voice signal pre-processing device, voice signal processing device, voice signal pre-processing method and program for voice signal pre-processing
JP4345349B2 (en) In-vehicle sound reproduction device
JP2018182480A (en) Noise spectrum distribution detection method and noise volume sound quality control method
JP2926679B2 (en) On-board audio equipment
JP4977551B2 (en) Active noise control device
JP2008070877A (en) Voice signal pre-processing device, voice signal processing device, voice signal pre-processing method and program for voice signal pre-processing
JP4522509B2 (en) Audio equipment
JP2976284B2 (en) Bass enhancement device for speaker system
JPH0535284A (en) On-vahicle acoustic device with noise reducing function
JPH0767196A (en) On-vehicle speaker system
JPH10224887A (en) On-vehicle speaker system
JP2017030671A (en) Noise reduction device, noise reduction method, and on-vehicle system
JP2009015209A (en) Speech articulation improving system and speech articulation improving method
WO2011083610A1 (en) Acoustic characteristic adjuster for vehicle
JP3475909B2 (en) Sound reproduction system

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20060126

RD01 Notification of change of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7421

Effective date: 20060214

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20080916

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20080918

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20081105

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20090428

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20090522

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20090623

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20090706

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120724

Year of fee payment: 3

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120724

Year of fee payment: 3

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130724

Year of fee payment: 4

LAPS Cancellation because of no payment of annual fees