JP3895621B2 - Accident sound detection device - Google Patents

Accident sound detection device Download PDF

Info

Publication number
JP3895621B2
JP3895621B2 JP2002079200A JP2002079200A JP3895621B2 JP 3895621 B2 JP3895621 B2 JP 3895621B2 JP 2002079200 A JP2002079200 A JP 2002079200A JP 2002079200 A JP2002079200 A JP 2002079200A JP 3895621 B2 JP3895621 B2 JP 3895621B2
Authority
JP
Japan
Prior art keywords
signal
sound
pitch
accident
accident sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
JP2002079200A
Other languages
Japanese (ja)
Other versions
JP2003281679A (en
Inventor
登 興野
俊光 瀬利
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Engineering Co Ltd
Original Assignee
Mitsubishi Electric Engineering Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Engineering Co Ltd filed Critical Mitsubishi Electric Engineering Co Ltd
Priority to JP2002079200A priority Critical patent/JP3895621B2/en
Publication of JP2003281679A publication Critical patent/JP2003281679A/en
Application granted granted Critical
Publication of JP3895621B2 publication Critical patent/JP3895621B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Landscapes

  • Traffic Control Systems (AREA)

Description

【0001】
【発明の属する技術分野】
この発明は、交差点などにおける交通音、事故音(衝突等の事故音や事故につながるような急ブレーキ音等も含む)から事故音のみを効率良く検出するための事故音検出装置に関するものである。
【0002】
【従来の技術】
一般に、交差点では交通事故が多く発生するので、従来から事故発生の状況を記録する交通事故状況記録装置が考えられてきた。
図9は、例えば特開平4−338900号公報に開示された従来の交通事故状況記録装置を示すブロック図である。
図9において1、4は交通信号機、1B、1Y、1R、4B、4Y、4Rは信号灯、2B、2Y、2Rは信号線、3は信号灯点滅装置、5は信号灯記号発生装置、6は時刻文字発生部、7は加算部、8は撮像装置、9はエンドレス記録装置、10は周囲音検出装置、11は衝突音検出回路、12は記録制御装置、13は磁気記録再生装置である。
【0003】
ここで、事故音を検出する部分は周囲音検出装置10および衝突音検出回路11である。すなわち周囲音検出装置10で音響信号が検出され、衝突音検出回路11に送られる。衝突音検出回路11では検出された音響信号が車両の衝突音か否かを判別し、衝突音と判別した時には衝突音検出信号が記録制御装置12に送られる。
衝突音検出回路11において、検出された交通音が事故(衝突)音であるか否かは、入力された音響信号のレベルとあらかじめ定められた閾値とを比較し、そのレベルが閾値以上になった場合に事故と判断している。また誤動作対策としては周囲音検出装置10には指向性マイクロホンが使用されるとともに、音響信号の経路中に帯域除去フィルタが設けられている。
【0004】
【発明が解決しようとする課題】
ところで、上記公報に記載の衝突音検出回路では、衝突音の判別に検出された音響信号とあらかじめ設定された固定の閾値とのレベル比較を行っている。しかしながら一般の交通音では例えば急ブレーキ音、警笛音、暴走音など、事故音以外でもレベルの大きな音が多く存在している。そのため、このような検出された音響信号と固定の閾値とのレベル比較を行う方法では、実際の事故音に加えてその他多くの交通音も事故音と判別してしまうという問題点があった。
また、検出される事故音に関して衝突音であるか、あるいは急ブレーキ音であるかといった種類に関する情報はまったく得られない等の問題点もあった。
【0005】
この発明は、上記のような問題点を解消するためになされたもので、事故音の判別に信号レベルの閾値を利用するのではなく、入力された事故音の基本周波数の変動を計算し、ピッチ変動が大きい場合はサイレン音と判断して事故音から除外することによって、これまで識別不可能であった急ブレーキ音とサイレン音との識別が可能とし、事故音の検出能力を向上できる事故音検出装置を提供することを目的とする。
【0006】
【課題を解決するための手段】
請求項1の発明に係る事故音検出装置は、外部からの音響信号を用いて事故音を検出するための事故音検出装置であって、上記事故音を異なる時間に2つの信号として取り込む事故音取込手段と、該事故音取込手段からの異なる時間に取り込まれた信号からそれぞれの基本周波数を求め、上記2つの基本周波数の比率をピッチ変動率として求め、該ピッチ変動率の大小を判定するピッチ変動判定演算手段と、上記事故音から該ピッチ変動率が所定のピッチ変動率よりも大きい出力信号を除外するピッチ変動音除去手段とを備え、上記事故音取込手段は、上記外部からの音響信号の波形を整形する波形整形回路と、該波形整形回路のアナログ信号をディジタル信号に変換するA/D変換器と、該A/D変換器からの出力信号から差分信号を取り出す差分演算手段と、該差分演算手段からの差分信号とあらかじめ値が設定された基準差分値とを比較し、その比較結果に応じてトリガ信号を発生する比較回路と、該比較回路からのトリガ信号に基づいて上記A/D変換器からの出力信号を相互に所定の遅延時間を有する複数の出力信号として上記ピッチ変動判定演算手段に取り込むスイッチ手段とを有するものである。
【0007】
請求項2の発明に係る事故音検出装置は、上記事故音取込手段が、上記外部からの音響信号の波形を整形する波形整形回路と、該波形整形回路のアナログ信号をディジタル信号に変換するA/D変換器と、該A/D変換器からの出力信号から差分信号を取り出す差分演算手段と、該差分演算手段からの差分信号とあらかじめ値が設定された基準差分値とを比較し、その比較結果に応じてトリガ信号を発生する比較回路と、該比較回路からのトリガ信号に基づいて上記A/D変換器からの出力信号を相互に所定の遅延時間を有する複数の出力信号として上記ピッチ変動判定演算手段に取り込むスイッチ手段とを有するものである。
【0008】
請求項3の発明に係る事故音検出装置は、上記ピッチ変動判定演算手段が、上記事故音取込手段から取り込まれた複数の出力信号からそれぞれその自己相関関数を算出する複数の自己相関演算手段と、該複数の自己相関演算手段からの各自己相関関数に基づいて対応する基本周波数を算出する複数の基本周波数演算手段と、該複数の基本周波数演算手段からの各基本周波数に基づいて上記A/D変換器からの出力信号のピッチ変動を判定するピッチ変動判定手段とを有するものである。
【0009】
請求項4の発明に係る事故音検出装置は、上記ピッチ変動判定手段が、上記複数の基本周波数演算手段からの各基本周波数に基づいてピッチ変動率を求め、該ピッチ変動率が所定値より小さい場合は事故音と判定し、所定値より大きい場合は事故音外のピッチ変動音であると判定するものである。
【0010】
請求項5の発明に係る事故音検出装置は、上記スイッチ手段が、上記比較回路からのトリガ信号に基づいて上記A/D変換器からの出力信号を取り込む第1のスイッチと、上記比較回路からのトリガ信号を所定時間遅延する遅延回路と、該遅延回路からの所定時間遅延された出力信号に基づいて上記A/D変換器からの出力信号を取り込む第2のスイッチとからなるものである。
【0011】
【発明の実施の形態】
以下、この発明の一実施の形態を、図面を参照しながら説明する。
実施の形態1.
図1は、この発明の実施の形態1を示す機能ブロック図である。
図1において、20は事故音取込手段、100は周囲音検出装置10(図9参照)からの音響入力信号、110は事故音取込手段20の出力信号、30は事故音取込手段20からの出力信号110からピッチ変動の大小を判定するピッチ変動判定演算手段、120はピッチ変動判定演算手段30の出力信号、40はピッチ変動判定演算手段30の出力信号120に基づいて事故音取込手段20の出力信号110からピッチ変動音例えばサイレン音を除去するピッチ変動音除去手段、130はピッチ変動音除去手段40の出力信号である。
【0012】
図2は、事故音取込手段20の具体的回路構成の一例を示す回路構成図である。
図2において、21は外部からの音響入力信号100の波形を整形する波形整形回路、101は波形整形回路21からの出力信号、22は波形整形回路21からの出力信号101をアナログ信号からディジタル信号に変換するためのA/D変換器、102はA/D変換器22のディジタル出力信号、23はディジタル出力信号102から差分信号を取り出すための差分演算手段、103は差分演算手段23からの差分信号、25は基準とするレベルの差分信号(基準差分値)を発生させる基準差分値発生回路、24は差分演算手段23からの差分信号103と、基準差分値発生回路25からの基準差分値とを比較し、差分演算手段23からの差分信号103が設定された基準差分値より大きい場合にトリガ信号Trgを発生する比較回路である。26は比較回路24からのトリガ信号Trgに基づいてA/D変換器22の出力信号102を取り込むための第1のスイッチ、111はスイッチ26により取り込まれた出力信号(OUT1)、27は比較回路24からのトリガ信号Trgを所定時間Δtだけ遅延する遅延回路、28は遅延回路27の出力信号に基づいてA/D変換器22の出力信号102を取り込む第2のスイッチ、112はスイッチ28により取り込まれた出力信号(OUT2)である。なお、スイッチ26,28と遅延回路27は、スイッチ手段を構成する。
【0013】
図3は、ピッチ変動判定演算手段30の具体的回路構成の一例を示す回路構成図である。
図3において、31はスイッチ26で取り込まれた出力信号111即ち入力信号IN1の自己相関関数を算出する自己相関演算手段、32は自己相関演算手段31からの出力信号の基本周波数(ピッチ)f1を演算する基本周波数演算手段、33は同様にスイッチ28で取り込まれた出力信号112即ちが入力信号IN2の自己相関関数を算出する自己相関演算手段、34は自己相関演算手段33からの出力信号の基本周波数(ピッチ)f2を演算する基本周波数演算手段、35は基本周波数演算手段32からの基本周波数f1と基本周波数演算手段34からの基本周波数f2からピッチ変動の大小を判定するピッチ変動判定手段である。
【0014】
次に動作について、図4〜図8を参照して説明する。
いま、事故発生時に音響入力信号100が発生し、事故音取込手段20に入力されると、波形整形回路21により不要な信号成分が除去され、出力信号101が生成される。
出力信号101はA/D変換器22でアナログ信号からディジタル信号102に変換される。出力されたディジタル信号102は差分演算手段23に入力され、差分演算手段23からディジタル出力信号102の差分信号103が出力される。差分信号103は一般に信号レベルの変化分を表し、急激なレベル変化があるほど大きな信号レベルを発生する。逆に信号レベルが大くてもレベル変化が小さい場合にはそのレベルが小さい。従って、例えば事故発生時のように突発的な現象が起こると差分信号103は大きなレベル変化を示す。そこで、あらかじめ基準差分値発生回路25により基準とする基準差分値を発生し、比較回路24を用いて差分信号103と基準差分値とを比較する。そして、差分信号103が基準差分値より大きい場合には信号レベルが急激に変化する交通事故音が発生したものと判断し、トリガ信号Trgを発生させる。
【0015】
この比較回路24からのトリガ信号Trgによりスイッチ26をONしてA/D変換器22の出力信号102を取り込み、出力信号111としてピッチ変動判定演算手段30の自己相関演算手段31へ入力する。また、遅延回路27で所定時間Δtだけ遅延した比較回路24からのトリガ信号Trgによりスイッチ28をONしてA/D変換器22の出力信号102を取り込み、出力信号112としてピッチ変動判定演算手段30の自己相関演算手段33へ入力する。
【0016】
自己相関演算手段31および33は入力された出力信号111および112の自己相関関数を算出するが、自己相関演算手段31および33に入力される各出力信号のスペクトルグラムみると、図4に示すように、時間の経過と共に周波数即ちピッチが変動する場合と、図5に示すように、時間の経過に関係なく周波数即ちピッチが一定の場合がある。なお、図4および図5において、太線で表している特性は、各出力信号の一番低い周波数即ち基本周波数f0(ピッチ)を表している。
そこで、自己相関演算手段31および33では、図6に示すような自己相関関数を計算する。ここで、自己相関関数は時間0を中心にして対称で、正の時間についてみれば時間と共に山谷を繰り返す関数である。この自己相関関数で最初の山の位置に与える時間をt0とすると、その逆数1/t0が基本周波数(ピッチ)f0となる。
【0017】
自己相関演算手段31および33の出力信号はそれぞれ基本周波数演算手段32および34に供給され、上記のように自己相関関数から基本周波数(ピッチ)が求められる。従って、比較回路24からのトリガ信号Trgによりスイッチ26をONして取り込まれた出力信号111に対して取り込み時間をt1とする基本周波数f1が演算され、同様に、遅延回路27で出力信号111に対して所定時間Δtだけ遅延された比較回路24からのトリガ信号Trgによりスイッチ28をONして取り込まれた出力信号112に対して取り込み時間をt2とするする基本周波数f2が演算される。
【0018】
図7は、このときの基本周波数演算手段32および34で演算された基本周波数f1とf2の関係を示したもので、時間t1は基本周波数f1に関して出力信号111を取り込んだときの時間を実質的に表し、時間t2は基本周波数f2に関して出力信号112を取り込んだときの時間を実質的に表し、時間t1とt2の差はΔtである。
【0019】
このようにして、基本周波数演算手段32および34で求められた基本周波数f1とf2はピッチ変動判定手段35に供給され、ここで、ピッチ変動率rpが求められる。このピッチ変動率rpは基本周波数f2をf1で除した値即ちrp=f2/f1より算出される。
【0020】
次に、ピッチ変動判定手段35では、図8に示すように、この算出されたピッチ変動率rpが所定のピッチ変動率Δrより大きいかどうかを判別し、ピッチ変動率rpが所定のピッチ変動率Δrより大きい場合は、事故音取込手段20からピッチ変動判定演算手段30に取り込まれた信号はピッチ変動がある、つまりピッチ変動音と判定し、ピッチ変動率rpが所定のピッチ変動率Δrより小さい場合は、事故音取込手段20からピッチ変動判定演算手段30に取り込まれた信号はピッチ変動がない、つまり事故音と判定して、その判定結果をピッチ変動音除去手段40へ出力信号120として供給する。
【0021】
ピッチ変動音除去手段40では、入力された出力信号120がピッチ変動の大きいことを表す信号の場合は、これはピッチ変動音例えばサイレン音であるので、その信号成分を事故音から除外した出力信号130を出力する。また、ピッチ変動音除去手段40では、入力された出力信号120がピッチ変動の小さいことを表す信号の場合は、事故音であるので、その信号成分を何等除去することなく例えばこの事故音を記録するためのトリガ信号用の出力信号130として出力する。
【0022】
このように本実施の形態では、入力される事故音などの音響信号の中で、急ブレーキ音とサイレン音とを識別するため、基本周波数(ピッチ)の変動を計算し、そのピッチ変動が所定の値より大きい場合はサイレン音と判断して事故音から除外し、ピッチ変動が所定の値より小さい場合は事故音として記録するためのトリガ信号を出力するようにしたので、これまで識別不可能であった急ブレーキ音とサイレン音との識別が可能となり、事故音のみ効率よく検出して事故音の検出能力を向上できる。
【0023】
【発明の効果】
以上に述べたように、請求項1の発明によれば、外部からの音響信号を用いて事故音を検出するための事故音検出装置であって、上記事故音を異なる時間に2つの信号として取り込む事故音取込手段と、該事故音取込手段からの異なる時間に取り込まれた信号からそれぞれの基本周波数を求め、上記2つの基本周波数の比率をピッチ変動率として求め、該ピッチ変動率の大小を判定するピッチ変動判定演算手段と、上記事故音から該ピッチ変動率が所定のピッチ変動率よりも大きい出力信号を除外するピッチ変動音除去手段とを備え、上記事故音取込手段は、上記外部からの音響信号の波形を整形する波形整形回路と、該波形整形回路のアナログ信号をディジタル信号に変換するA/D変換器と、該A/D変換器からの出力信号から差分信号を取り出す差分演算手段と、該差分演算手段からの差分信号とあらかじめ値が設定された基準差分値とを比較し、その比較結果に応じてトリガ信号を発生する比較回路と、該比較回路からのトリガ信号に基づいて上記A/D変換器からの出力信号を相互に所定の遅延時間を有する複数の出力信号として上記ピッチ変動判定演算手段に取り込むスイッチ手段とを有するので、これまで識別不可能であった急ブレーキ音とサイレン音との識別が可能となり、事故音のみ効率よく検出して事故音の検出能力を向上できるという効果がある。
【0024】
また、請求項2の発明によれば、上記事故音取込手段が、上記外部からの音響信号の波形を整形する波形整形回路と、該波形整形回路のアナログ信号をディジタル信号に変換するA/D変換器と、該A/D変換器からの出力信号から差分信号を取り出す差分演算手段と、該差分演算手段からの差分信号とあらかじめ値が設定された基準差分値とを比較し、その比較結果に応じてトリガ信号を発生する比較回路と、該比較回路からのトリガ信号に基づいて上記A/D変換器からの出力信号を相互に所定の遅延時間を有する複数の出力信号として上記ピッチ変動判定演算手段に取り込むスイッチ手段とを有するので、事故音のみ効率よく検出するのに寄与できるという効果がある。
【0025】
また、請求項3の発明によれば、上記ピッチ変動判定演算手段が、上記事故音取込手段から取り込まれた複数の出力信号からそれぞれその自己相関関数を算出する複数の自己相関演算手段と、該複数の自己相関演算手段からの各自己相関関数に基づいて対応する基本周波数を算出する複数の基本周波数演算手段と、該複数の基本周波数演算手段からの各基本周波数に基づいて上記A/D変換器からの出力信号のピッチ変動を判定するピッチ変動判定手段とを有するので、急ブレーキ音とサイレン音との識別を可能して、事故音の検出能力の向上に寄与できるという効果がある。
【0026】
また、請求項4の発明によれば、上記ピッチ変動判定手段が、上記複数の基本周波数演算手段からの各基本周波数に基づいてピッチ変動率を求め、該ピッチ変動率が所定値より小さい場合は事故音と判定し、所定値より大きい場合は事故音外のピッチ変動音であると判定するので、事故音のピッチ変動を効率よく且つ確実に判断することができるという効果がある。
【0027】
また、請求項5の発明によれば、上記スイッチ手段が、上記比較回路からのトリガ信号に基づいて上記A/D変換器からの出力信号を取り込む第1のスイッチと、上記比較回路からのトリガ信号を所定時間遅延する遅延回路と、該遅延回路からの所定時間遅延された出力信号に基づいて上記A/D変換器からの出力信号を取り込む第2のスイッチとからなるので、事故音のみ効率よく検出するのに寄与できるという効果がある。
【図面の簡単な説明】
【図1】 この発明の実施の形態1を示す機能ブロック図である。
【図2】 この発明の実施の形態1における事故音取込手段の一例を示すブロック構成図である。
【図3】 この発明の実施の形態1におけるピッチ変動判定演算手段の一例を示すブロック図である。
【図4】 この発明の実施の形態1における自己相関演算手段の動作説明に供するための図である。
【図5】 この発明の実施の形態1における自己相関演算手段の動作説明に供するための図である。
【図6】 この発明の実施の形態1における自己相関演算手段の動作説明に供するための図である。
【図7】 この発明の実施の形態1における基本周波数演算手段の動作説明に供するための図である。
【図8】 図この発明の実施の形態1におけるピッチ変動判定手段の動作説明に供するための図である。
【図9】 従来の交通事故状況記録装置を示すブロック図である。
【符号の説明】
20 事故音取込手段、21波形整形回路、22 A/D変換器、23 差分演算手段、24 比較回路、25 基準差分値発生回路、26,28 スイッチ、27 遅延回路、30 ピッチ変動判定演算手段、31,32 自己相関演算手段、32,34 基本周波数演算手段、35 ピッチ変動判定手段、40 ピッチ変動音除去手段。
[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an accident sound detection apparatus for efficiently detecting only accident sounds from traffic sounds and accident sounds (including accident sounds such as collisions and sudden brake sounds that lead to accidents) at intersections and the like. .
[0002]
[Prior art]
In general, since many traffic accidents occur at intersections, a traffic accident status recording apparatus that records the status of accidents has been conventionally considered.
FIG. 9 is a block diagram showing a conventional traffic accident situation recording apparatus disclosed in, for example, Japanese Patent Laid-Open No. 4-338900.
9, 1 and 4 are traffic lights, 1B, 1Y, 1R, 4B, 4Y, 4R are signal lights, 2B, 2Y, 2R are signal lines, 3 is a signal light blinking device, 5 is a signal light symbol generator, and 6 is a time letter. A generating unit, 7 is an adding unit, 8 is an imaging device, 9 is an endless recording device, 10 is an ambient sound detecting device, 11 is a collision sound detecting circuit, 12 is a recording control device, and 13 is a magnetic recording / reproducing device.
[0003]
Here, the part that detects the accident sound is the ambient sound detection device 10 and the collision sound detection circuit 11. That is, the ambient sound detection device 10 detects an acoustic signal and sends it to the collision sound detection circuit 11. The collision sound detection circuit 11 determines whether or not the detected acoustic signal is a vehicle collision sound. When it is determined as a collision sound, the collision sound detection signal is sent to the recording control device 12.
In the collision sound detection circuit 11, whether or not the detected traffic sound is an accident (collision) sound is compared with the level of the input acoustic signal and a predetermined threshold value, and the level becomes equal to or higher than the threshold value. In the event of an accident. As a countermeasure against malfunction, a directional microphone is used for the ambient sound detection device 10, and a band elimination filter is provided in the path of the acoustic signal.
[0004]
[Problems to be solved by the invention]
By the way, in the collision sound detection circuit described in the above publication, a level comparison is made between an acoustic signal detected in the determination of the collision sound and a preset fixed threshold value. However, in general traffic sounds, there are many sounds with high levels other than accident sounds, such as sudden braking sounds, horn sounds, and runaway sounds. For this reason, the method of comparing the level of the detected acoustic signal with a fixed threshold value has a problem that many traffic sounds are determined as accident sounds in addition to the actual accident sounds.
In addition, there is a problem that information regarding the type of whether the detected accident sound is a collision sound or a sudden braking sound cannot be obtained at all.
[0005]
The present invention was made to solve the above-described problems, and does not use a signal level threshold to determine the accident sound, but calculates the fluctuation of the fundamental frequency of the input accident sound, If the pitch fluctuation is large, it is judged as a siren sound and excluded from the accident sound. This makes it possible to distinguish between sudden braking sound and siren sound, which could not be identified before, and to improve accident sound detection capability. An object is to provide a sound detection device.
[0006]
[Means for Solving the Problems]
An accident sound detection device according to the invention of claim 1 is an accident sound detection device for detecting an accident sound using an external acoustic signal, and the accident sound is obtained as two signals at different times. Obtain the respective fundamental frequencies from the capture means and signals acquired at different times from the accident sound capture means , determine the ratio of the two fundamental frequencies as the pitch fluctuation rate , and determine the magnitude of the pitch fluctuation rate And a pitch fluctuation sound removing means for excluding an output signal having a pitch fluctuation rate larger than a predetermined pitch fluctuation rate from the accident sound, and the accident sound capturing means is externally provided. A waveform shaping circuit for shaping the waveform of the acoustic signal, an A / D converter for converting the analog signal of the waveform shaping circuit into a digital signal, and a difference signal from the output signal from the A / D converter. A difference calculation means, a comparison circuit for comparing a difference signal from the difference calculation means with a reference difference value set in advance, and generating a trigger signal according to the comparison result, and a trigger from the comparison circuit Switch means for taking the output signal from the A / D converter based on the signal into the pitch fluctuation determination calculating means as a plurality of output signals having a predetermined delay time .
[0007]
In the accident sound detection apparatus according to the second aspect of the invention, the accident sound capturing means converts a waveform shaping circuit for shaping the waveform of the external acoustic signal, and converts an analog signal of the waveform shaping circuit into a digital signal. Comparing the A / D converter, the difference calculation means for extracting the difference signal from the output signal from the A / D converter, the difference signal from the difference calculation means and a reference difference value set in advance; A comparison circuit that generates a trigger signal according to the comparison result, and an output signal from the A / D converter based on the trigger signal from the comparison circuit as a plurality of output signals having a predetermined delay time. Switch means to be taken into the pitch fluctuation determination calculation means.
[0008]
According to a third aspect of the present invention, there is provided an accident sound detection device, wherein the pitch fluctuation determination calculating means calculates a plurality of autocorrelation functions for calculating autocorrelation functions from a plurality of output signals acquired from the accident sound capturing means. A plurality of fundamental frequency computing means for calculating a corresponding fundamental frequency based on each autocorrelation function from the plurality of autocorrelation computing means, and A based on each fundamental frequency from the plurality of fundamental frequency computing means And a pitch variation determining means for determining the pitch variation of the output signal from the / D converter.
[0009]
According to a fourth aspect of the present invention, there is provided an accident sound detection apparatus, wherein the pitch variation determination means obtains a pitch variation rate based on each fundamental frequency from the plurality of fundamental frequency calculation units, and the pitch variation rate is smaller than a predetermined value. If it is determined that the sound is an accident sound, and if it is greater than a predetermined value, it is determined that the sound is a pitch fluctuation sound outside the accident sound.
[0010]
According to a fifth aspect of the present invention, there is provided an accident sound detection apparatus comprising: a first switch that captures an output signal from the A / D converter based on a trigger signal from the comparison circuit; And a second switch for taking in an output signal from the A / D converter based on an output signal delayed from the delay circuit for a predetermined time.
[0011]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
Embodiment 1 FIG.
FIG. 1 is a functional block diagram showing Embodiment 1 of the present invention.
In FIG. 1, 20 is an accident sound capturing means, 100 is an acoustic input signal from the ambient sound detection device 10 (see FIG. 9), 110 is an output signal of the accident sound capturing means 20, and 30 is an accident sound capturing means 20. Pitch fluctuation determination calculating means for determining the magnitude of the pitch fluctuation from the output signal 110 from 120, 120 is the output signal of the pitch fluctuation determination calculating means 30, and 40 is an accident sound capture based on the output signal 120 of the pitch fluctuation determination calculating means 30. Pitch fluctuation sound removing means for removing pitch fluctuation sound, for example, siren sound, from the output signal 110 of the means 20, and 130 is an output signal of the pitch fluctuation sound removing means 40.
[0012]
FIG. 2 is a circuit configuration diagram showing an example of a specific circuit configuration of the accident sound capturing means 20.
In FIG. 2, 21 is a waveform shaping circuit for shaping the waveform of the external acoustic input signal 100, 101 is an output signal from the waveform shaping circuit 21, and 22 is an output signal 101 from the waveform shaping circuit 21 that is converted from an analog signal to a digital signal. A is a digital output signal of the A / D converter 22, 23 is a difference calculation means for extracting a difference signal from the digital output signal 102, and 103 is a difference from the difference calculation means 23. 25, a reference difference value generation circuit for generating a difference signal (reference difference value) at a reference level, 24, a difference signal 103 from the difference calculation means 23, and a reference difference value from the reference difference value generation circuit 25 And the trigger signal Trg is generated when the difference signal 103 from the difference calculation means 23 is larger than the set reference difference value. . 26 is a first switch for taking in the output signal 102 of the A / D converter 22 based on the trigger signal Trg from the comparison circuit 24, 111 is an output signal (OUT1) taken in by the switch 26, and 27 is a comparison circuit. A delay circuit that delays the trigger signal Trg from 24 by a predetermined time Δt, 28 is a second switch that captures the output signal 102 of the A / D converter 22 based on the output signal of the delay circuit 27, and 112 is captured by the switch 28. Output signal (OUT2). The switches 26 and 28 and the delay circuit 27 constitute switch means.
[0013]
FIG. 3 is a circuit configuration diagram showing an example of a specific circuit configuration of the pitch variation determination calculation means 30.
In FIG. 3, 31 is an autocorrelation calculating means for calculating the autocorrelation function of the output signal 111 taken by the switch 26, that is, the input signal IN1, and 32 is the fundamental frequency (pitch) f1 of the output signal from the autocorrelation calculating means 31. Similarly, the basic frequency calculation means 33 for calculating, the autocorrelation calculation means 33 for calculating the autocorrelation function of the output signal 112 captured by the switch 28, that is, the input signal IN2, and the basic 34 of the output signal from the autocorrelation calculation means 33. Fundamental frequency calculating means 35 for calculating the frequency (pitch) f2, and 35 is a pitch fluctuation determining means for judging the magnitude of the pitch fluctuation from the basic frequency f1 from the basic frequency calculating means 32 and the basic frequency f2 from the basic frequency calculating means 34. .
[0014]
Next, the operation will be described with reference to FIGS.
Now, when an acoustic input signal 100 is generated and input to the accident sound capturing means 20 when an accident occurs, an unnecessary signal component is removed by the waveform shaping circuit 21 and an output signal 101 is generated.
The output signal 101 is converted from an analog signal to a digital signal 102 by an A / D converter 22. The output digital signal 102 is input to the difference calculation means 23, and the difference signal 103 of the digital output signal 102 is output from the difference calculation means 23. The difference signal 103 generally represents a change in the signal level, and a larger signal level is generated as there is a sudden level change. Conversely, if the level change is small even if the signal level is large, the level is small. Therefore, for example, when a sudden phenomenon occurs such as when an accident occurs, the difference signal 103 shows a large level change. Therefore, a reference difference value as a reference is generated in advance by the reference difference value generation circuit 25, and the difference signal 103 and the reference difference value are compared using the comparison circuit 24. When the difference signal 103 is larger than the reference difference value, it is determined that a traffic accident sound whose signal level changes abruptly is generated, and a trigger signal Trg is generated.
[0015]
The switch 26 is turned on by the trigger signal Trg from the comparison circuit 24, the output signal 102 of the A / D converter 22 is taken in, and the output signal 111 is input to the autocorrelation calculation means 31 of the pitch fluctuation determination calculation means 30. Further, the switch 28 is turned on by the trigger signal Trg from the comparison circuit 24 delayed by the delay circuit 27 by the predetermined time Δt, the output signal 102 of the A / D converter 22 is taken in, and the pitch fluctuation determination calculating means 30 is used as the output signal 112. To the autocorrelation calculating means 33.
[0016]
The autocorrelation calculating means 31 and 33 calculate the autocorrelation function of the input output signals 111 and 112. The spectrumgram of each output signal input to the autocorrelation calculating means 31 and 33 is as shown in FIG. In addition, there are a case where the frequency, that is, the pitch varies with the passage of time, and a case where the frequency, that is, the pitch is constant regardless of the passage of time, as shown in FIG. 4 and 5, the characteristic indicated by the bold line represents the lowest frequency of each output signal, that is, the fundamental frequency f0 (pitch).
Therefore, the autocorrelation calculating means 31 and 33 calculate an autocorrelation function as shown in FIG. Here, the autocorrelation function is a function that is symmetrical with respect to time 0, and repeats peaks and valleys with time in the case of positive time. If the time given to the first peak position by this autocorrelation function is t0, its reciprocal 1 / t0 becomes the fundamental frequency (pitch) f0.
[0017]
The output signals of the autocorrelation calculating means 31 and 33 are supplied to the fundamental frequency calculating means 32 and 34, respectively, and the fundamental frequency (pitch) is obtained from the autocorrelation function as described above. Therefore, the fundamental frequency f1 with the acquisition time t1 is calculated for the output signal 111 acquired by turning on the switch 26 by the trigger signal Trg from the comparison circuit 24, and similarly to the output signal 111 by the delay circuit 27. On the other hand, a basic frequency f2 is calculated for a capture time t2 with respect to the output signal 112 captured by turning on the switch 28 by the trigger signal Trg from the comparison circuit 24 delayed by a predetermined time Δt.
[0018]
FIG. 7 shows the relationship between the fundamental frequencies f1 and f2 computed by the fundamental frequency computing means 32 and 34 at this time. The time t1 is substantially the time when the output signal 111 is captured with respect to the fundamental frequency f1. The time t2 substantially represents the time when the output signal 112 is acquired with respect to the fundamental frequency f2, and the difference between the times t1 and t2 is Δt.
[0019]
In this way, the fundamental frequencies f1 and f2 obtained by the fundamental frequency calculating means 32 and 34 are supplied to the pitch fluctuation determining means 35, where the pitch fluctuation rate rp is obtained. The pitch fluctuation rate rp is calculated from a value obtained by dividing the fundamental frequency f2 by f1, that is, rp = f2 / f1.
[0020]
Next, as shown in FIG. 8, the pitch fluctuation determining means 35 determines whether or not the calculated pitch fluctuation rate rp is larger than a predetermined pitch fluctuation rate Δr, and the pitch fluctuation rate rp is a predetermined pitch fluctuation rate. If it is larger than Δr, it is determined that the signal fetched from the accident sound fetching means 20 to the pitch fluctuation judgment calculating means 30 has pitch fluctuation, that is, a pitch fluctuation sound, and the pitch fluctuation rate rp is greater than the predetermined pitch fluctuation rate Δr. If it is smaller, it is determined that the signal taken from the accident sound capturing means 20 to the pitch fluctuation determination calculating means 30 has no pitch fluctuation, that is, an accident sound, and the determination result is output to the pitch fluctuation sound removing means 40 as an output signal 120. Supply as.
[0021]
In the pitch fluctuation sound removing means 40, when the input output signal 120 is a signal indicating that the pitch fluctuation is large, this is a pitch fluctuation sound, for example, a siren sound, and therefore, the output signal in which the signal component is excluded from the accident sound. 130 is output. Further, in the pitch fluctuation sound removing means 40, if the input output signal 120 is a signal indicating that the pitch fluctuation is small, it is an accident sound. Output as an output signal 130 for a trigger signal.
[0022]
As described above, in the present embodiment, in order to discriminate between a sudden braking sound and a siren sound in an input acoustic signal such as an accident sound, the fluctuation of the fundamental frequency (pitch) is calculated, and the pitch fluctuation is predetermined. If it is larger than the value, it is judged as a siren sound and excluded from the accident sound. If the pitch fluctuation is smaller than the predetermined value, a trigger signal for recording as an accident sound is output. Thus, it is possible to distinguish between the sudden braking sound and the siren sound, and it is possible to efficiently detect only the accident sound and improve the detection ability of the accident sound.
[0023]
【The invention's effect】
As described above, according to the invention of claim 1, there is an accident sound detection device for detecting an accident sound using an external acoustic signal, wherein the accident sound is converted into two signals at different times. Each of the fundamental frequencies is obtained from the accident sound capturing means to be captured and the signals captured at different times from the accident sound capturing means , the ratio of the two fundamental frequencies is determined as the pitch variation rate , and the pitch variation rate Pitch fluctuation determination calculating means for determining magnitude, and pitch fluctuation sound removing means for excluding output signals having a pitch fluctuation rate larger than a predetermined pitch fluctuation rate from the accident sound, the accident sound capturing means, A waveform shaping circuit for shaping the waveform of the external acoustic signal, an A / D converter for converting an analog signal of the waveform shaping circuit into a digital signal, and a differential signal from an output signal from the A / D converter A difference calculating means to be taken out, a comparison circuit for comparing a difference signal from the difference calculating means with a reference difference value set in advance, and generating a trigger signal according to the comparison result, and a trigger from the comparison circuit Switch means for taking the output signal from the A / D converter based on the signal into the pitch fluctuation determination calculation means as a plurality of output signals having a predetermined delay time from each other. Therefore, it is possible to distinguish between sudden braking sound and siren sound, and it is possible to efficiently detect only the accident sound and improve the detection ability of the accident sound.
[0024]
According to a second aspect of the present invention, the accident sound capturing means includes a waveform shaping circuit that shapes the waveform of the external acoustic signal, and an A / A that converts the analog signal of the waveform shaping circuit into a digital signal. The D converter, the difference calculation means for extracting the difference signal from the output signal from the A / D converter, the difference signal from the difference calculation means and the reference difference value set in advance are compared, and the comparison A comparison circuit that generates a trigger signal according to the result, and the pitch fluctuation as a plurality of output signals having a predetermined delay time with respect to the output signal from the A / D converter based on the trigger signal from the comparison circuit Since it has the switch means to be taken into the judgment calculation means, there is an effect that it can contribute to efficiently detecting only the accident sound.
[0025]
According to a third aspect of the present invention, the pitch fluctuation determination calculating means includes a plurality of autocorrelation calculating means for calculating autocorrelation functions from the plurality of output signals acquired from the accident sound capturing means, A plurality of fundamental frequency computing means for calculating a corresponding fundamental frequency based on each autocorrelation function from the plurality of autocorrelation computing means, and the A / D based on each fundamental frequency from the plurality of fundamental frequency computing means Since the pitch variation judging means for judging the pitch variation of the output signal from the converter is provided, it is possible to distinguish between the sudden braking sound and the siren sound and to contribute to the improvement of the detection capability of the accident sound.
[0026]
According to a fourth aspect of the present invention, when the pitch variation determination means obtains a pitch variation rate based on each fundamental frequency from the plurality of fundamental frequency calculation units, and the pitch variation rate is smaller than a predetermined value, If it is determined that the sound is an accident sound and is greater than a predetermined value, it is determined that the sound is a pitch fluctuation sound outside the accident sound, so that the pitch fluctuation of the accident sound can be determined efficiently and reliably.
[0027]
According to a fifth aspect of the invention, the switch means includes a first switch for taking in an output signal from the A / D converter based on a trigger signal from the comparison circuit, and a trigger from the comparison circuit. Since the delay circuit that delays the signal for a predetermined time and the second switch that takes in the output signal from the A / D converter based on the output signal delayed from the delay circuit for the predetermined time, only the accident sound is efficient. There is an effect that it can contribute to detection well.
[Brief description of the drawings]
FIG. 1 is a functional block diagram showing a first embodiment of the present invention.
FIG. 2 is a block configuration diagram illustrating an example of an accident sound capturing unit according to Embodiment 1 of the present invention.
FIG. 3 is a block diagram showing an example of pitch fluctuation determination calculation means in the first embodiment of the present invention.
FIG. 4 is a diagram for explaining an operation of an autocorrelation calculating unit according to the first embodiment of the present invention.
FIG. 5 is a diagram for explaining an operation of an autocorrelation calculating unit according to the first embodiment of the present invention.
FIG. 6 is a diagram for explaining an operation of an autocorrelation calculating unit according to the first embodiment of the present invention.
FIG. 7 is a diagram for explaining an operation of a fundamental frequency calculation unit in the first embodiment of the present invention.
FIG. 8 is a diagram for explaining an operation of a pitch variation determination unit according to the first embodiment of the present invention.
FIG. 9 is a block diagram showing a conventional traffic accident situation recording apparatus.
[Explanation of symbols]
20 accident sound capturing means, 21 waveform shaping circuit, 22 A / D converter, 23 difference calculating means, 24 comparing circuit, 25 reference difference value generating circuit, 26, 28 switch, 27 delay circuit, 30 pitch fluctuation determining calculating means 31, 32 Autocorrelation calculating means, 32, 34 Fundamental frequency calculating means, 35 Pitch fluctuation determining means, 40 Pitch fluctuation sound removing means.

Claims (4)

外部からの音響信号を用いて事故音を検出するための事故音検出装置であって、
上記事故音を異なる時間に2つの信号として取り込む事故音取込手段と、
該事故音取込手段からの異なる時間に取り込まれた信号からそれぞれの基本周波数を求め、上記2つの基本周波数の比率をピッチ変動率として求め、該ピッチ変動率の大小を判定するピッチ変動判定演算手段と、
上記事故音から該ピッチ変動率が所定のピッチ変動率よりも大きい出力信号を除外するピッチ変動音除去手段と
を備え
上記事故音取込手段は、上記外部からの音響信号の波形を整形する波形整形回路と、該波形整形回路のアナログ信号をディジタル信号に変換するA/D変換器と、該A/D変換器からの出力信号から差分信号を取り出す差分演算手段と、該差分演算手段からの差分信号とあらかじめ値が設定された基準差分値とを比較し、その比較結果に応じてトリガ信号を発生する比較回路と、該比較回路からのトリガ信号に基づいて上記A/D変換器からの出力信号を相互に所定の遅延時間を有する複数の出力信号として上記ピッチ変動判定演算手段に取り込むスイッチ手段とを有することを特徴とする事故音検出装置。
An accident sound detection device for detecting an accident sound using an external acoustic signal,
Accident sound capturing means for capturing the accident sound as two signals at different times ;
Pitch fluctuation determination calculation for obtaining each fundamental frequency from signals taken at different times from the accident sound capturing means, obtaining a ratio of the two fundamental frequencies as a pitch fluctuation rate , and determining the magnitude of the pitch fluctuation rate Means,
Pitch fluctuation sound removing means for excluding an output signal having a pitch fluctuation rate larger than a predetermined pitch fluctuation rate from the accident sound ;
Equipped with a,
The accident sound capturing means includes a waveform shaping circuit that shapes the waveform of the external acoustic signal, an A / D converter that converts an analog signal of the waveform shaping circuit into a digital signal, and the A / D converter. A difference calculating means for extracting a difference signal from an output signal from the comparator, a comparison circuit for comparing the difference signal from the difference calculating means with a reference difference value set in advance and generating a trigger signal according to the comparison result And switch means for taking the output signals from the A / D converter into the pitch fluctuation determination calculating means as a plurality of output signals having a predetermined delay time based on a trigger signal from the comparison circuit. Accident sound detection device characterized by.
上記ピッチ変動判定演算手段は、上記事故音取込手段から取り込まれた複数の出力信号からそれぞれその自己相関関数を算出する複数の自己相関演算手段と、該複数の自己相関演算手段からの各自己相関関数に基づいて対応する基本周波数を算出する複数の基本周波数演算手段と、該複数の基本周波数演算手段からの各基本周波数に基づいて上記A/D変換器からの出力信号のピッチ変動を判定するピッチ変動判定手段とを有することを特徴とする請求項記載の事故音検出装置。The pitch fluctuation determination calculating means includes a plurality of autocorrelation calculating means for calculating autocorrelation functions from a plurality of output signals received from the accident sound capturing means, and each self-correlation calculating means from each of the plurality of autocorrelation calculating means. A plurality of fundamental frequency calculating means for calculating a corresponding fundamental frequency based on the correlation function, and determining a pitch variation of the output signal from the A / D converter based on each fundamental frequency from the plurality of fundamental frequency calculating means accident sound detection device according to claim 1, characterized in that it comprises a pitch change determination means for. 上記ピッチ変動判定手段は、上記複数の基本周波数演算手段からの各基本周波数に基づいてピッチ変動率を求め、該ピッチ変動率が所定値より大きい場合は事故音外のピッチ変動音であると判定する請求項記載の事故音検出装置。The pitch variation determination means obtains a pitch variation rate based on each fundamental frequency from the plurality of fundamental frequency calculation units, and determines that the pitch variation sound is outside the accident sound when the pitch variation rate is greater than a predetermined value. The accident sound detection device according to claim 2 . 上記スイッチ手段は、上記比較回路からのトリガ信号に基づいて上記A/D変換器からの出力信号を取り込む第1のスイッチと、上記比較回路からのトリガ信号を所定時間遅延する遅延回路と、該遅延回路からの所定時間遅延された出力信号に基づいて上記A/D変換器からの出力信号を取り込む第2のスイッチとからなることを特徴とする請求項1〜3のいずれかに記載の事故音検出装置。The switch means includes a first switch that captures an output signal from the A / D converter based on a trigger signal from the comparison circuit, a delay circuit that delays the trigger signal from the comparison circuit, and a delay circuit; The accident according to any one of claims 1 to 3 , further comprising a second switch that takes in an output signal from the A / D converter based on an output signal delayed by a predetermined time from the delay circuit. Sound detection device.
JP2002079200A 2002-03-20 2002-03-20 Accident sound detection device Expired - Lifetime JP3895621B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2002079200A JP3895621B2 (en) 2002-03-20 2002-03-20 Accident sound detection device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2002079200A JP3895621B2 (en) 2002-03-20 2002-03-20 Accident sound detection device

Publications (2)

Publication Number Publication Date
JP2003281679A JP2003281679A (en) 2003-10-03
JP3895621B2 true JP3895621B2 (en) 2007-03-22

Family

ID=29228765

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2002079200A Expired - Lifetime JP3895621B2 (en) 2002-03-20 2002-03-20 Accident sound detection device

Country Status (1)

Country Link
JP (1) JP3895621B2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115223370B (en) * 2022-08-31 2023-01-17 四川九通智路科技有限公司 Traffic accident detection method and system

Also Published As

Publication number Publication date
JP2003281679A (en) 2003-10-03

Similar Documents

Publication Publication Date Title
JP3069529B2 (en) Accident sound detection circuit
JP6001248B2 (en) Sound source detection device
US6636791B2 (en) Collision record apparatus, collision state estimation method, and record medium
EP2759843B1 (en) Sound source detection device
JP4742750B2 (en) Outside car sound processor
US6087960A (en) Accident sound detection circuit
JP2978132B2 (en) Accident sound detector
JP6146470B2 (en) Object detection apparatus and object detection method
JP3895621B2 (en) Accident sound detection device
JP4886461B2 (en) Abnormality monitoring device
JP3845034B2 (en) Accident sound detection device
EP1496499A3 (en) Apparatus and method of voice recognition in an audio-video system
JP2003202260A (en) Sound source identifying device, sudden event detecting device, and device for automatically recording sudden event
JP3895657B2 (en) Accident sound detection circuit
JP2950771B2 (en) Accident sound detection circuit and accident sound detection device
JP3015298B2 (en) Accident sound detection circuit and accident sound detection device
JP3810332B2 (en) Accident sound detection device
JP2841515B2 (en) Sound recognition device
JP2010241371A (en) Driving state detection apparatus
JP3875111B2 (en) Accident sound detection device, method and program
Bonarini et al. A composite system for real-time robust whistle recognition
JP2007163336A (en) Vehicle noise sound detector and method for detecting vehicle noise sound
JP4629922B2 (en) Traffic accident sound detection device
JP2006027290A (en) Collision mode determination apparatus and occupant crash protector
JP2005164378A (en) Movable body data analyzer and movable body data analysis system

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20040401

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20060425

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20060601

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20060725

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20060907

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20061114

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20061214

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

Ref document number: 3895621

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20091222

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20101222

Year of fee payment: 4

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20101222

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20111222

Year of fee payment: 5

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20121222

Year of fee payment: 6

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20131222

Year of fee payment: 7

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

EXPY Cancellation because of completion of term