JP2786154B2 - Signal processing method - Google Patents

Signal processing method

Info

Publication number
JP2786154B2
JP2786154B2 JP8117409A JP11740996A JP2786154B2 JP 2786154 B2 JP2786154 B2 JP 2786154B2 JP 8117409 A JP8117409 A JP 8117409A JP 11740996 A JP11740996 A JP 11740996A JP 2786154 B2 JP2786154 B2 JP 2786154B2
Authority
JP
Japan
Prior art keywords
processing circuit
signal
frequency analysis
spectrum
phase
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
JP8117409A
Other languages
Japanese (ja)
Other versions
JPH09304514A (en
Inventor
正典 阿部
泰正 大谷
和典 江花
康 佐々木
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOEICHO GIJUTSU KENKYU HONBUCHO
NEC Corp
Original Assignee
BOEICHO GIJUTSU KENKYU HONBUCHO
Nippon Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOEICHO GIJUTSU KENKYU HONBUCHO, Nippon Electric Co Ltd filed Critical BOEICHO GIJUTSU KENKYU HONBUCHO
Priority to JP8117409A priority Critical patent/JP2786154B2/en
Publication of JPH09304514A publication Critical patent/JPH09304514A/en
Application granted granted Critical
Publication of JP2786154B2 publication Critical patent/JP2786154B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Landscapes

  • Radar Systems Or Details Thereof (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【0001】[0001]

【産業上の利用分野】本発明は、受波した音響信号から
帯域毎に特定の信号が存在するかどうかを検出する信号
処理方式に関し、特に水中音響信号の信号処理方式に関
する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a signal processing method for detecting whether or not a specific signal exists for each band from a received sound signal, and more particularly to a signal processing method for an underwater sound signal.

【0002】[0002]

【従来の技術】従来の信号処理方式の一例を示すブロッ
ク図を図7に示す。図で、周波数分析処理回路21は、
水中の受波器で受波した信号を入力し、狭帯域に周波数
分析する。その結果複数の周波数成分のパワーレベル、
いわゆるパワースペクトルを出力する。積分処理回路2
2は、周波数分析処理回路21の出力の複数の周波数成
分のパワーレベルを入力し、時間軸方向にあらかじめ設
定した一定時間区間の平均を計算して複数の周波数成分
の平均パワーレベルを出力する。閾値処理回路23は、
積分処理回路22の出力の複数の周波数成分の平均パワ
ーレベルから、あらかじめ設定された閾値レベルを越え
るレベルの周波数成分を目標信号の成分として検出出力
する。
2. Description of the Related Art FIG. 7 is a block diagram showing an example of a conventional signal processing system. In the figure, the frequency analysis processing circuit 21
A signal received by an underwater receiver is input and frequency analysis is performed in a narrow band. As a result, the power levels of multiple frequency components,
A so-called power spectrum is output. Integral processing circuit 2
2 inputs the power levels of a plurality of frequency components output from the frequency analysis processing circuit 21, calculates the average of a predetermined time section set in the time axis direction, and outputs the average power level of the plurality of frequency components. The threshold processing circuit 23
From the average power level of a plurality of frequency components output from the integration processing circuit 22, a frequency component having a level exceeding a preset threshold level is detected and output as a component of the target signal.

【0003】次に従来の信号処理方式の作用について説
明する。周波数分析処理回路21は、受波信号の持つ周
波数帯域を狭帯域に分析することにより、目標信号のレ
ベルを保持しつつ雑音のレベルを小さくすることがで
き、S/Nを改善している。これは、目標信号のエネル
ギーが狭帯域に集中しているのに対して雑音のエネルギ
ーが広帯域に分散していることに依存している。また、
積分処理回路22は、周波数分析処理回路21の出力を
周波数成分毎にあらかじめ設定した一定時間区間平均す
ることにより、目標信号のレベルを保持しつつ雑音のレ
ベルのバラツキを小さくすることができ、検出の際の誤
警報を減らし、検出性能を改善している。これは、目標
信号のレベルは各々の時間で安定して得られるのに対し
て、雑音のレベルは各々の時間で得られるレベルの大き
さにバラツキがあることに依存している。
Next, the operation of the conventional signal processing system will be described. The frequency analysis processing circuit 21 can reduce the noise level while maintaining the level of the target signal by analyzing the frequency band of the received signal into a narrow band, thereby improving the S / N. This depends on the fact that the energy of the target signal is concentrated in a narrow band while the energy of noise is dispersed in a wide band. Also,
The integration processing circuit 22 can reduce the variation in the noise level while maintaining the level of the target signal by averaging the output of the frequency analysis processing circuit 21 for a predetermined time section for each frequency component. In this case, false alarms are reduced and detection performance is improved. This depends on the fact that the level of the target signal can be obtained stably at each time, while the level of the noise varies at each time.

【0004】[0004]

【発明が解決しようとする課題】この従来の信号処理方
式は、狭帯域周波数分析及び時間積分によりS/Nの改
善をしているがおのずと限界があり、その限界S/Nよ
り低いレベルの目標信号の場合、従来の方式では検出で
きないという問題があり、よりS/Nを改善できる信号
処理方式が求められていた。
In this conventional signal processing system, the S / N is improved by narrowband frequency analysis and time integration, but there is naturally a limit, and a target of a level lower than the limit S / N is required. In the case of a signal, there is a problem that it cannot be detected by the conventional method, and a signal processing method capable of further improving the S / N has been demanded.

【0005】[0005]

【課題を解決するための手段】本発明の信号処理方式
は、よりS/Nを改善する手段としてレベル以外の信号
特性、すなわち位相に着目し、この位相情報を基にS/
Nの改善を図るものである。
The signal processing method of the present invention focuses on signal characteristics other than the level, that is, the phase, as means for further improving the S / N.
N is to be improved.

【0006】本発明によれば、水中の受波器で受波した
受波信号から狭帯域に周波数分析してパワースペクトル
の他に位相スペクトルを出力する第1の周波数分析処理
回路と、受波信号を所定の時間遅延させる遅延処理回路
と、所定の時間遅れた前記受波信号を入力し、狭帯域に
周波数分析して位相スペクトルを出力する第2の周波数
分析処理回路と、前記第1及び第2の周波数分析処理の
出力の各位相スペクトルから所定の時間離れた2つの前
記受波信号の位相差を計算し、その位相差の分散を計算
する位相差分散計算処理回路と、前記パワースペクトル
レベルの平均値を前記位相差の分散値で強調する強調処
理回路とを備えた信号処理方式が得られる。
According to the present invention, a first frequency analysis processing circuit for performing frequency analysis in a narrow band from a received signal received by an underwater receiver and outputting a phase spectrum in addition to a power spectrum, A delay processing circuit that delays a signal by a predetermined time, a second frequency analysis processing circuit that receives the received signal delayed by a predetermined time, performs frequency analysis in a narrow band, and outputs a phase spectrum; A phase difference variance calculation processing circuit that calculates a phase difference between two received signals separated by a predetermined time from each phase spectrum of an output of the second frequency analysis process, and calculates a variance of the phase difference; A signal processing method including an emphasis processing circuit for emphasizing the average value of the levels with the variance of the phase difference is obtained.

【0007】[0007]

【実施例】次に本発明について図面を参照して説明す
る。図1は本発明の一実施例を示すブロック図である。
DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing one embodiment of the present invention.

【0008】図1において、周波数分析処理回路11は
水中受波器で受波した信号χ(t)を入力し狭帯域に周
波数分析する。分析の結果として、複数の周波数成分の
パワーレベルXt (ωn )及び位相φt (ωn )(いわ
ゆるパワースペクトル及び位相スペクトル)を出力す
る。この周波数分析には例えばFFT処理を用いる。こ
こで、ωn はn番目の周波数成分の周波数を表し、nは
1〜Nの範囲の整数をとる。Nは観測時間長で決まり、
(1)式により求めることができる。ただし、観測時間
長はNが整数となるようにとることが必要である。
In FIG. 1, a frequency analysis processing circuit 11 receives a signal χ (t) received by an underwater receiver and performs frequency analysis in a narrow band. As a result of the analysis, the output power level of the plurality of frequency components X tn) and the phase phi t to (omega n) (so-called power spectrum and phase spectrum). For this frequency analysis, for example, FFT processing is used. Here, ω n represents the frequency of the n-th frequency component, and n is an integer in the range of 1 to N. N is determined by the observation time length,
It can be determined by equation (1). However, it is necessary to set the observation time length so that N is an integer.

【0009】[0009]

【数1】 (Equation 1)

【0010】積分処理回路12は、周波数分析処理回路
11の出力の複数の周波数成分のパワーレベルXt (ω
n )を入力し、時間軸方向にあらかじめ設定した一定時
間区間の平均を計算して(2)式で表わされる複数の周
波数成分の平均パワーレベル
The integration processing circuit 12 has a power level X t (ω) of a plurality of frequency components output from the frequency analysis processing circuit 11.
n ), calculate the average of a predetermined time section set in the time axis direction, and calculate the average power level of a plurality of frequency components represented by the equation (2).

【0011】[0011]

【数2】 (Equation 2)

【0012】を出力する。Is output.

【0013】[0013]

【数3】 B:平均を求めるための標本数(Equation 3) B: Number of samples for calculating average

【0014】遅延処理回路13は、周波数分析処理回路
11に入力される前記受波信号χ(t)を入力しあらか
じめ設定した時間τだけ遅延させた受波信号χ(t−
τ)を出力する。
The delay processing circuit 13 receives the received signal χ (t) input to the frequency analysis processing circuit 11 and delays the received signal χ (t−
τ) is output.

【0015】周波数分析処理回路14は、遅延処理回路
13でτ時間だけ遅れた前記受波信号χ(t−τ)を入
力し、周波数分析処理回路11と同じ狭帯域に周波数分
析する。分析の結果として、複数の周波数成分の位相
The frequency analysis processing circuit 14 receives the received signal χ (t−τ) delayed by τ time in the delay processing circuit 13 and performs frequency analysis in the same narrow band as the frequency analysis processing circuit 11. As a result of analysis, the phase of multiple frequency components

【0016】[0016]

【数4】 (Equation 4)

【0017】を出力する。Is output.

【0018】位相差分散計算処理回路15は、周波数分
析処理回路11の出力の複数の周波数成分の位相φ
t (ωn )と、周波数分析処理回路14の出力の複数の
周波数成分の位相
The phase difference variance calculation processing circuit 15 calculates the phase φ of a plurality of frequency components output from the frequency analysis processing circuit 11.
tn ) and the phase of a plurality of frequency components of the output of the frequency analysis processing circuit 14

【0019】[0019]

【数5】 (Equation 5)

【0020】とを入力し、τ時間離れた受波信号χ
(t)、χ(t−τ)の位相差εt (ωn)を計算する
((3)式参照)。また、この位相差εt (ωn )から
あらかじめ設定した一定時間区間の位相差の分散を計算
して複数の周波数成分の位相差分散σ2 t (ωt )を出
力する((4)(5)式参照)。
And the received signal χ separated by τ time χ
Calculate the phase difference ε tn ) between (t) and χ (t−τ) (see equation (3)). Further, the variance of the phase difference in a predetermined time section is calculated from the phase difference ε tn ), and the phase difference variance σ 2 tt ) of a plurality of frequency components is output ((4) ( 5) See formula).

【0021】[0021]

【数6】 B:平均及び分散を求めるための標本数(Equation 6) B: Number of samples for calculating mean and variance

【0022】強調処理回路16は、積分処理回路12の
出力の複数の周波数成分の平均パワーレベル
The emphasis processing circuit 16 calculates an average power level of a plurality of frequency components output from the integration processing circuit 12.

【0023】[0023]

【数7】 (Equation 7)

【0024】と、位相差分散処理回路15の出力の複数
の周波数成分の位相差分散σ2 t (ωn )とを入力し、
前記平均パワーレベル
And the phase difference variance σ 2 tn ) of a plurality of frequency components output from the phase difference variance processing circuit 15,
The average power level

【0025】[0025]

【数8】 (Equation 8)

【0026】を位相分散σ2 t (ωn )で強調した複数
の周波数成分の強調パワーレベルYt(ωn )を出力す
る((6)式参照)。
The emphasis power level Y tn ) of a plurality of frequency components is output by emphasizing the frequency component with the phase dispersion σ 2 tn ) (see equation (6)).

【0027】[0027]

【数9】 (Equation 9)

【0028】閾値処理回路17は、前記強調処理の出力
の複数の周波数成分の強調パワーレベルYt (ωn )を
入力し、あらかじめ設定した閾値レベルを越える周波数
成分を目標信号の成分として検出し、出力する。
The threshold processing circuit 17 receives the emphasis power levels Y tn ) of a plurality of frequency components output from the emphasis processing, and detects a frequency component exceeding a preset threshold level as a target signal component. ,Output.

【0029】本発明の動作を説明すると、雑音の位相差
は統計的にみると図2のような分布を示すのに対して、
目標信号の場合の位相差は統計的にみると図3のような
分布を示し、その分散値は雑音に比べ小さく、目標信号
のS/Nが大きくなればなるほど分散値は小さくなり、
図4のようになる。
The operation of the present invention will be described. The noise phase difference statistically shows a distribution as shown in FIG.
The phase difference in the case of the target signal shows a distribution as shown in FIG. 3 when viewed statistically, and its variance is smaller than the noise. As the S / N of the target signal increases, the variance decreases.
As shown in FIG.

【0030】従って、図5に示す従来の前記パワースペ
クトルレベルの平均値と入力信号S/Nの関係は図6の
ようになり、図5の縦軸において設定できる閾値レベル
がNL(NL:雑音のパワースペクトルレベルの平均
値)より上の範囲であったのが、図6の縦軸において
は、NZ(NZ:雑音の位相差分散値)>1によりNL
/NZより上の範囲で設定できるため、NL以下のレベ
ルの目標信号に対しても検出できる。
Therefore, the relationship between the average value of the power spectrum level and the input signal S / N shown in FIG. 5 is as shown in FIG. 6, and the threshold level that can be set on the vertical axis of FIG. 5 is NL (NL: noise). However, the vertical axis in FIG. 6 is higher than NL (NZ: noise phase difference variance)> 1 in the vertical range in FIG.
Since it can be set in a range above / NZ, it can be detected even for a target signal having a level of NL or less.

【0031】[0031]

【発明の効果】以上説明したように、本発明ではパワー
スペクトルレベルの平均値を位相差の分散値で強調する
ことにより、従来検出することができなかった低S/N
の受波信号においても、目的とする音響信号を検出する
ことができる。
As described above, according to the present invention, the average value of the power spectrum level is emphasized by the variance value of the phase difference, so that the low S / N which cannot be detected conventionally can be obtained.
, A target acoustic signal can be detected.

【図面の簡単な説明】[Brief description of the drawings]

【図1】本発明の一実施例を示すブロック図。FIG. 1 is a block diagram showing one embodiment of the present invention.

【図2】雑音入力時の位相差の統計的分布図。FIG. 2 is a statistical distribution diagram of a phase difference when noise is input.

【図3】目標信号入力時の位相差の統計的分布図。FIG. 3 is a statistical distribution diagram of a phase difference when a target signal is input.

【図4】位相差分散値と入力信号S/Nの関係図。FIG. 4 is a relationship diagram between a phase difference variance value and an input signal S / N.

【図5】パワースペクトルレベルの平均値と入力信号S
/Nの関係図。
FIG. 5 shows the average value of the power spectrum level and the input signal S;
FIG.

【図6】位相差分散値で強調したパワースペクトルレベ
ル平均値と入力信号S/Nの関係図。
FIG. 6 is a diagram illustrating a relationship between a power spectrum level average value and an input signal S / N emphasized by a phase difference variance value.

【図7】従来の信号処理方式ブロック図。FIG. 7 is a block diagram of a conventional signal processing method.

【符号の説明】[Explanation of symbols]

11 第1の周波数分析処理回路 12 積分処理回路 13 遅延処理回路 14 第2の周波数分析処理回路 15 位相差分散計算処理回路 16 強調処理回路 17 閾値処理回路 21 周波数分析処理回路 22 積分処理回路 23 閾値処理回路 Reference Signs List 11 first frequency analysis processing circuit 12 integration processing circuit 13 delay processing circuit 14 second frequency analysis processing circuit 15 phase difference variance calculation processing circuit 16 enhancement processing circuit 17 threshold processing circuit 21 frequency analysis processing circuit 22 integration processing circuit 23 threshold Processing circuit

───────────────────────────────────────────────────── フロントページの続き (72)発明者 佐々木 康 千葉県印旛郡白井町大山口2−4−16− 203 (56)参考文献 特開 平8−220209(JP,A) 特開 昭60−22680(JP,A) 特許2648110(JP,B2) (58)調査した分野(Int.Cl.6,DB名) G01S 3/80 - 3/86 G01S 7/00 - 7/64────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Yasushi Sasaki 2-3-16 Oyamaguchi, Shirai-machi, Inba-gun, Chiba 203 (56) References JP-A-8-220209 (JP, A) JP-A-60- 22680 (JP, A) Patent 2648110 (JP, B2) (58) Fields investigated (Int. Cl. 6 , DB name) G01S 3/80-3/86 G01S 7/00-7/64

Claims (3)

(57)【特許請求の範囲】(57) [Claims] 【請求項1】 入力された被検出信号を受け帯域毎にパ
ワースペクトルと位相スペクトルとを求める手段と、帯
域毎に前記位相スペクトルの分散を求める分散演算手段
と、帯域毎に前記分散で前記パワースペクトルを強調す
る強調手段とを具備し、前記強調手段の出力から帯域毎
の信号の有無を検出する信号処理方式。
1. A means for receiving a signal to be detected and calculating a power spectrum and a phase spectrum for each band, a dispersion calculating means for calculating a variance of the phase spectrum for each band, and the power A signal processing method comprising: an emphasis means for emphasizing a spectrum; and detecting presence or absence of a signal for each band from an output of the emphasis means.
【請求項2】 前記分散演算手段が所定時間差をもつ前
記被検出信号の位相スペクトルから前記分散を求める請
求項1の信号処理方式。
2. The signal processing method according to claim 1, wherein said dispersion calculating means obtains said dispersion from a phase spectrum of said detected signal having a predetermined time difference.
【請求項3】 水中の受波器で受波した受波信号を入力
し、狭帯域に周波数分析してパワースペクトルと位相ス
ペクトルとを出力する第1の周波数分析処理回路と、前
記受波信号を所定の時間遅延させる遅延処理回路と、所
定の時間遅れた前記受波信号を入力し、狭帯域に周波数
分析して位相スペクトルを出力する第2の周波数分析処
理回路と、前記第1及び第2の周波数分析処理回路の出
力の各位相スペクトルから所定の時間離れた2つの前記
受波信号の位相差を計算し、その位相差の分散を計算す
る位相差分散計算処理回路と、前記パワースペクトルレ
ベルの平均値を前記位相差の分散値で強調する強調処理
回路とを備えたことを特徴とする信号処理方式。
3. A first frequency analysis processing circuit for receiving a received signal received by an underwater receiver, performing frequency analysis in a narrow band, and outputting a power spectrum and a phase spectrum, and the received signal. A delay processing circuit that delays a predetermined time, a second frequency analysis processing circuit that receives the received signal delayed by a predetermined time, performs frequency analysis in a narrow band, and outputs a phase spectrum, A phase difference variance calculation processing circuit that calculates a phase difference between two received signals separated by a predetermined time from each phase spectrum of an output of the frequency analysis processing circuit, and calculates a variance of the phase difference; A signal processing method comprising: an emphasis processing circuit for emphasizing an average value of levels with a variance value of the phase difference.
JP8117409A 1996-05-13 1996-05-13 Signal processing method Expired - Lifetime JP2786154B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP8117409A JP2786154B2 (en) 1996-05-13 1996-05-13 Signal processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP8117409A JP2786154B2 (en) 1996-05-13 1996-05-13 Signal processing method

Publications (2)

Publication Number Publication Date
JPH09304514A JPH09304514A (en) 1997-11-28
JP2786154B2 true JP2786154B2 (en) 1998-08-13

Family

ID=14710941

Family Applications (1)

Application Number Title Priority Date Filing Date
JP8117409A Expired - Lifetime JP2786154B2 (en) 1996-05-13 1996-05-13 Signal processing method

Country Status (1)

Country Link
JP (1) JP2786154B2 (en)

Also Published As

Publication number Publication date
JPH09304514A (en) 1997-11-28

Similar Documents

Publication Publication Date Title
US8065115B2 (en) Method and system for identifying audible noise as wind noise in a hearing aid apparatus
US8120993B2 (en) Acoustic treatment apparatus and method thereof
US7515209B2 (en) Methods of noise reduction and edge enhancement in image processing
JP4670446B2 (en) Radar signal processing apparatus and CFAR processing method used therefor
JPH09181940A (en) Method and device for improving local contrast of video signal
CN112037816A (en) Voice signal frequency domain frequency correction, howling detection and suppression method and device
CN110503973B (en) Audio signal transient noise suppression method, system and storage medium
JP3283423B2 (en) Microphone device
EP1699260A2 (en) Microphone array signal processing apparatus, microphone array signal processing method, and microphone array system
JP2786154B2 (en) Signal processing method
CN113316075B (en) Howling detection method and device and electronic equipment
JP2648110B2 (en) Signal detection method and device
JP2830276B2 (en) Signal processing device
US20020136416A1 (en) DVE system with instability detection
JP2801904B2 (en) CA LOG / CFAR equipment
JP2008232936A (en) Target automatic detection processing method and device
JP3294257B2 (en) Active signal processing method
JP3394412B2 (en) Pulse sound detection method and apparatus
JP3142400B2 (en) Target detection device
JP3212785B2 (en) Signal detection device
JP2758871B2 (en) Frequency analysis method by maximum entropy method
CN112584298B (en) Correction system and correction method for signal measurement
JP3394465B2 (en) Signal processing method and device
JP3130369B2 (en) Helicopter sound extraction and identification device
JPH0593772A (en) Detecting device for underwater acoustic signal

Legal Events

Date Code Title Description
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 19980428

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090529

Year of fee payment: 11

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100529

Year of fee payment: 12

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110529

Year of fee payment: 13

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110529

Year of fee payment: 13

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120529

Year of fee payment: 14

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120529

Year of fee payment: 14

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130529

Year of fee payment: 15

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130529

Year of fee payment: 15

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

EXPY Cancellation because of completion of term