JP2001101571A - Method, system, and device for decoding traffic congestion and recording medium - Google Patents

Method, system, and device for decoding traffic congestion and recording medium

Info

Publication number
JP2001101571A
JP2001101571A JP28084999A JP28084999A JP2001101571A JP 2001101571 A JP2001101571 A JP 2001101571A JP 28084999 A JP28084999 A JP 28084999A JP 28084999 A JP28084999 A JP 28084999A JP 2001101571 A JP2001101571 A JP 2001101571A
Authority
JP
Japan
Prior art keywords
space
traffic
spatial
road
average speed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP28084999A
Other languages
Japanese (ja)
Other versions
JP3260344B2 (en
Inventor
Kazuto Nishiyama
和人 西山
Kuninori Nakatani
邦則 中谷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sumitomo Electric Industries Ltd
Hanshin Expressway Public Corp
Original Assignee
Sumitomo Electric Industries Ltd
Hanshin Expressway Public Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sumitomo Electric Industries Ltd, Hanshin Expressway Public Corp filed Critical Sumitomo Electric Industries Ltd
Priority to JP28084999A priority Critical patent/JP3260344B2/en
Publication of JP2001101571A publication Critical patent/JP2001101571A/en
Application granted granted Critical
Publication of JP3260344B2 publication Critical patent/JP3260344B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

PROBLEM TO BE SOLVED: To provide a method, system, and device for deciding traffic congestion by which an abrupt change of a traffic flow such as the occurrence of a traffic congestion, etc. in a wide detecting range can be recognized quickly and precisely and to provide a recording medium. SOLUTION: The processing section 12 of a space sensor 1 measures space parameters including the space occupying ratio and average spatial speed of vehicles running in a measuring range contained in the picture taken with a CCTV camera 11 overlooking a road and transmits the measured results to a central transportation controller 2 through a line and the congestion deciding means 22 of the controller 2 decides the state of the traffic flow on the road by deciding that the region in which the correlation between the measured space occupying ratio and average space speed exists out of a plurality of regions in accordance with a plurality of states of the traffic flow which are decided by dividing the correlation distributing region between the space occupying ratio and average space speed by the combinations of the threshold values of the space occupying ratio and average space speed by referring to a threshold combination table 21.

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【0001】[0001]

【発明の属する技術分野】本発明は、道路を俯瞰撮影し
た画像の中の計測範囲に存在する車両の空間占有率,空
間平均速度,交通密度などの空間パラメータを計測し、
空間パラメータに基づいて、道路の交通流の状態(通常
流,渋滞流,停滞流など)を判定する渋滞判定方法、渋
滞判定システム、渋滞判定装置、及びコンピュータに渋
滞判定を行わせるためのコンピュータプログラムが記録
されている記録媒体に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention measures spatial parameters such as a space occupancy, a spatial average speed, and a traffic density of a vehicle existing in a measurement range in an image obtained by overhead photographing a road,
A traffic congestion determination method, a traffic congestion determination system, a traffic congestion determination device, and a computer program for causing a computer to perform traffic congestion determination, based on spatial parameters, for determining the state of traffic flow on a road (normal flow, congestion flow, stagnant flow, etc.) Related to a recording medium on which is recorded.

【0002】[0002]

【従来の技術】現行の渋滞判定システムでは、道路の上
方に 500m間隔で配置されている超音波センサにより収
集された交通量,時間占有率などの時間パラメータを用
いて渋滞判定を行っている。超音波センサは、オンラン
プ,オフランプなどによる道路形状の変化がなくて占有
率データの安定性が優れている追越車線に設置され、デ
ータを収集している。
2. Description of the Related Art In a current traffic congestion determination system, traffic congestion is determined using time parameters such as traffic volume and time occupancy collected by ultrasonic sensors arranged at intervals of 500 m above a road. The ultrasonic sensor is installed in an overtaking lane where the stability of the occupancy data is excellent without any change in the road shape due to the on-ramp and the off-ramp, and data is collected.

【0003】現行の渋滞判定システムでは、収集したデ
ータから占有率−交通量特性(O-V特性)を作成し、占
有率35%付近を分岐点として非渋滞領域と渋滞領域とに
分けることにより渋滞判定を行うが、O-V 特性の作成に
5分間の収集データを用いている。その理由は、1分収
集データでは渋滞時の粗密波など、交通流の変化に過敏
に追従して激しい変動が起こり、また15分収集データで
は交通流の変化に対する応答が遅れるが、5分収集デー
タでは交通流の変化が巧みに捉えられ、安定した変化が
見られるからである。
In the current traffic congestion determination system, an occupancy-traffic characteristic (OV characteristic) is created from the collected data, and the congestion is determined by dividing the vicinity of 35% of the occupancy into a non-congestion area and a congestion area by using a branch point. However, collected data for 5 minutes is used to create OV characteristics. The reason is that 1-minute collected data causes a sharp change following the change in traffic flow, such as compression waves during congestion, and 15-minute collected data delays the response to changes in traffic flow, but 5-minute collection This is because changes in traffic flow are skillfully captured in the data, and stable changes are seen.

【0004】[0004]

【発明が解決しようとする課題】渋滞判定は、交通密
度,空間平均速度などの空間パラメータを用いて行う方
が現象をよく捉えるとされている。しかし超音波センサ
は点計測のセンサであるので、交通量,時間占有率など
の時間パラメータの計測しかできない。また時間パラメ
ータの計測に5分収集データなどを用いるので、データ
を蓄積する時間が渋滞判定までの時間遅れの原因とな
る。さらに5分間といった所定期間の蓄積データを平均
化しているので、渋滞発生などの急激な交通流の変化を
迅速または精細に捉えきれない。
It is said that the determination of traffic congestion can be better understood by using spatial parameters such as traffic density and spatial average speed. However, since the ultrasonic sensor is a point measurement sensor, it can only measure time parameters such as traffic volume and time occupancy. Further, since the 5-minute collected data is used for measuring the time parameter, the time for accumulating the data causes a time delay until the traffic jam determination. Furthermore, since the accumulated data for a predetermined period such as 5 minutes is averaged, rapid changes in traffic flow such as occurrence of traffic congestion cannot be quickly or precisely captured.

【0005】また超音波センサは検知範囲が車体よりも
狭いため、データの収集間隔が 500m間隔で離散的なデ
ータしか得られず、しかも、超音波センサを追越車線に
配置した場合は追越車線のデータしか収集しないので、
検知範囲外で発生した渋滞を捉えることができない。
[0005] Further, since the ultrasonic sensor has a narrower detection range than the vehicle body, only discrete data can be obtained at a data collection interval of 500 m. In addition, when the ultrasonic sensor is arranged in the passing lane, the vehicle passes. Since we only collect lane data,
The traffic jam outside the detection range cannot be captured.

【0006】本発明はこのような問題点を解決するため
になされたものであって、道路を俯瞰撮影した瞬間の画
像から車両の空間占有率,空間平均速度,交通密度など
の空間パラメータを計測し、空間占有率及び空間平均速
度、または交通密度及び空間平均速度の相関が、これら
のパラメータの相関分布領域を交通流の複数の状態それ
ぞれに応じて区分した複数の領域のいずれに含まれるか
に基づいて交通流の状態を判定することにより、広い検
知範囲における渋滞発生などの急激な交通流の変化を迅
速または精細に捉える渋滞判定方法、渋滞判定システ
ム、渋滞判定装置、及びコンピュータに渋滞判定を行わ
せるためのコンピュータプログラムが記録されている記
録媒体の提供を目的とする。
The present invention has been made in order to solve such a problem, and measures a space parameter such as a space occupancy, a space average speed, and a traffic density of a vehicle from an image at the moment when a road is overlooked. The correlation between the space occupancy rate and the spatial average speed, or the correlation between the traffic density and the spatial average speed, is included in any of a plurality of areas obtained by dividing the correlation distribution area of these parameters according to each of a plurality of states of the traffic flow. A traffic congestion determination method, a traffic congestion determination system, a traffic congestion determination device, and a computer for determining traffic congestion in a wide detection range by quickly or precisely determining a sudden change in traffic flow by determining a traffic flow state based on the traffic flow. The purpose of the present invention is to provide a recording medium on which a computer program for performing the above is recorded.

【0007】[0007]

【課題を解決するための手段】本発明の渋滞判定方法
は、道路を俯瞰撮影した画像を利用して道路の交通流の
状態を判定する渋滞判定方法において、前記画像の中の
計測範囲に存在する車両の空間占有率及び空間平均速度
を計測し、計測した空間占有率及び空間平均速度の相関
が、空間占有率及び空間平均速度の相関分布領域を、空
間占有率及び空間平均速度の閾値の組合せによって区分
した、交通流の複数の状態それぞれに応じた複数の領域
のいずれに含まれるかによって道路の交通流の状態を判
定することを特徴とする。
A traffic congestion determination method according to the present invention is a traffic congestion determination method for judging the state of traffic flow on a road using an image obtained by photographing the road from a bird's-eye view. The space occupancy and the space average speed of the vehicle are measured, and the correlation between the measured space occupancy and the space average speed is used to determine the correlation distribution area between the space occupancy and the space average speed. The method is characterized in that the state of the traffic flow on the road is determined based on which of the plurality of areas corresponding to the plurality of states of the traffic flow, which are classified according to the combination.

【0008】本発明の渋滞判定システムは、道路を俯瞰
撮影した画像を利用して道路の交通流の状態を判定する
渋滞判定システムにおいて、前記画像の中の計測範囲に
存在する車両の空間占有率及び空間平均速度を含む空間
パラメータを計測する手段、及び計測した空間パラメー
タを送信する手段を有する端末装置と、端末装置から送
信された空間パラメータを受信する手段、空間占有率及
び空間平均速度の相関分布領域を交通流の複数の状態そ
れぞれに応じた複数の領域に区分する、空間占有率及び
空間平均速度の閾値の組合せを記憶する手段、及び計測
した空間占有率及び空間平均速度の相関が、前記複数の
領域のいずれに含まれるかによって道路の交通流の状態
を判定する手段を有する中央装置とを備えたことを特徴
とする。
A traffic congestion determination system according to the present invention is a traffic congestion determination system for determining the state of traffic flow on a road using an image obtained by photographing a road from a bird's-eye view. And a terminal device having a unit for measuring a spatial parameter including the spatial average speed and a unit for transmitting the measured spatial parameter, a unit for receiving the spatial parameter transmitted from the terminal device, a correlation between the space occupancy and the spatial average speed. The distribution area is divided into a plurality of areas corresponding to a plurality of states of the traffic flow, a means for storing a combination of thresholds of the space occupancy and the space average speed, and the correlation between the measured space occupancy and the space average speed, A central device having means for determining the state of traffic flow on the road according to which of the plurality of areas is included.

【0009】本発明の渋滞判定装置は、道路を俯瞰撮影
した画像を利用して道路の交通流の状態を判定する渋滞
判定システムにおいて、前記画像の中の計測範囲に存在
する車両の空間占有率及び空間平均速度を計測する手段
と、空間占有率及び空間平均速度の相関分布領域を交通
流の複数の状態それぞれに応じた複数の領域に区分す
る、空間占有率及び空間平均速度の閾値の組合せを記憶
する手段と、計測した空間占有率及び空間平均速度の相
関が、前記複数の領域のいずれに含まれるかによって道
路の交通流の状態を判定する手段とを備えたことを特徴
とする。
A traffic congestion determining apparatus according to the present invention is a traffic congestion determining system for determining the state of traffic flow on a road by using an image obtained by photographing a road from a bird's-eye view. Means for measuring the spatial occupancy and the spatial average velocity, and a threshold for the spatial occupancy and the spatial average velocity, which divides the correlation distribution area of the spatial occupancy and the spatial average velocity into a plurality of areas corresponding to a plurality of states of the traffic flow, respectively. And means for determining the state of traffic flow on the road based on which of the plurality of areas contains the correlation between the measured space occupancy and the space average speed.

【0010】本発明の記録媒体は、道路を俯瞰撮影した
画像から計測された該画像の中の計測範囲に存在する車
両の空間占有率及び空間平均速度を含む空間パラメータ
を利用して道路の交通流の状態をコンピュータに判定さ
せるコンピュータプログラムが記録されており、コンピ
ュータでの読み取りが可能な記録媒体において、コンピ
ュータに、計測された空間パラメータを取得させるプロ
グラムコード手段と、コンピュータに、空間占有率及び
空間平均速度の相関分布領域を交通流の複数の状態それ
ぞれに応じた複数の領域に区分する、空間占有率及び空
間平均速度の閾値の組合せのデータを参照させるプログ
ラムコード手段と、コンピュータに、取得した空間占有
率及び空間平均速度の相関が、前記閾値の組合せにより
区分される複数の領域のいずれに含まれるかによって道
路の交通流の状態を判定させるプログラムコード手段と
を含むコンピュータプログラムが記録されていることを
特徴とする。
[0010] The recording medium of the present invention uses traffic parameters on a road by utilizing a space parameter including a space occupancy and a space average speed of a vehicle existing in a measurement range in the image which is measured from a bird's-eye image of the road. A computer program for causing the computer to determine the flow state is recorded, and on a computer-readable recording medium, program code means for causing the computer to acquire the measured space parameter; and Program code means for dividing the correlation distribution region of the spatial average speed into a plurality of regions corresponding to a plurality of states of the traffic flow, and referring to data of a combination of a threshold of the spatial occupancy and the spatial average speed; The correlation between the occupied space occupancy and the spatial average velocity is divided into a plurality Wherein the computer program comprising program code means for determining the state of the road traffic flow by either included in any of the range are recorded.

【0011】また本発明は、交通流の状態が渋滞の状態
へ切り替わる渋滞発生の場合と、渋滞の状態から通常の
状態へ切り替わる渋滞解消の場合とで、異なる閾値の組
合せにより、空間占有率及び空間平均速度の相関分布領
域が区分されていることを特徴とする。
Further, according to the present invention, the space occupancy and the space occupancy can be changed by combining different thresholds in a case where a traffic congestion occurs when the traffic flow is switched to a traffic congestion state and in a case where the traffic congestion is switched from a traffic congestion state to a normal state. It is characterized in that the correlation distribution region of the spatial average velocity is divided.

【0012】また本発明は、空間占有率に代えて交通密
度を用いることを特徴とする。
Further, the present invention is characterized in that traffic density is used instead of space occupancy.

【0013】本発明では、道路を俯瞰撮影した瞬間の画
像の中の計測範囲に存在する車両の空間占有率,空間平
均速度,交通密度などの空間パラメータを計測し、計測
した空間占有率及び空間平均速度の相関が、空間占有率
の閾値及び空間平均速度の閾値の組合せによって空間占
有率及び空間平均速度の相関分布領域を、交通流の複数
の状態(通常流,渋滞流,停滞流など)に応じて区分し
た複数の領域のいずれに含まれるかによって、道路の交
通流の状態を判定する。
In the present invention, the space parameters such as the space occupancy, the space average speed, and the traffic density of the vehicles existing in the measurement range in the image at the moment when the road is overlooked are measured, and the measured space occupancy and space are measured. The correlation of the average speed is calculated based on the combination of the threshold of the space occupancy and the threshold of the space average velocity. The state of the traffic flow on the road is determined based on which of the plurality of areas is classified according to.

【0014】これにより、多車線の比較的長距離の道路
延長の画像を俯瞰撮影することで車両検知範囲が広くな
り、道路上の連続的なデータを収集することが可能にな
る。また空間パラメータは、原理的に瞬間の映像から収
集することが可能であるため、超音波センサによる渋滞
判定に比べ、5分間などのデータ蓄積が不要であるとと
もに、時間的な平均化処理が不要である。従って、渋滞
などの交通流の状態を即時に捉えることができる。また
渋滞発生時の交通流の急激な変化も迅速かつ精細に捉え
ることが可能になる。
[0014] Thus, by taking a bird's-eye view of an image of a relatively long multi-lane road extension, the vehicle detection range is widened and continuous data on the road can be collected. In addition, since spatial parameters can be collected from instantaneous images in principle, data accumulation such as 5 minutes is not required, and temporal averaging is not required, as compared to congestion determination using ultrasonic sensors. It is. Therefore, the state of traffic flow such as traffic jam can be immediately grasped. Also, a rapid change in traffic flow at the time of congestion can be quickly and precisely captured.

【0015】また本発明では、交通流が通常流から渋滞
流へ変化する渋滞発生の場合と、渋滞流から通常流へ変
化する渋滞解消の場合とで、相関分布領域を区分する空
間占有率及び空間平均速度、又は交通密度及び空間平均
速度の閾値の組合せを異なる値の組合せにして渋滞流を
判定する。
Further, according to the present invention, the space occupancy rate and the space distribution for dividing the correlation distribution area are determined when the traffic flow changes from a normal flow to a congested flow and when the traffic flow changes from a congested flow to a normal flow. The congestion flow is determined by using different combinations of the spatial average speed or the threshold value of the traffic density and the threshold value of the spatial average speed.

【0016】従って、例えば通常流から渋滞流に切り替
わるときの閾値より、渋滞流から通常流に切り替わると
きの閾値を低い値に設定して閾値にヒステリシスを持た
せることで、空間占有率及び空間平均速度の相関、又は
交通密度及び空間平均速度の相関が交通流の状態変化点
近傍にある場合に、渋滞判定結果が短時間の間に反転を
繰り返すことを防止できる。
Therefore, for example, by setting the threshold value at the time of switching from the congested flow to the normal flow to a value lower than the threshold value at the time of switching from the normal flow to the congested flow and giving the threshold value hysteresis, the space occupancy and the spatial average When the correlation between the speeds or the correlation between the traffic density and the spatial average speed is near the change point of the traffic flow, it is possible to prevent the traffic jam determination result from being repeatedly inverted in a short time.

【0017】また本発明では、空間占有率に代えて交通
密度を用いる。交通密度は空間占有率と一次線形関係に
あって、空間平均速度との相関分布が類似しているの
で、どちらの空間パラメータを用いても渋滞判定が可能
である。
In the present invention, traffic density is used instead of space occupancy. Since the traffic density has a first-order linear relationship with the space occupancy, and the correlation distribution with the spatial average speed is similar, it is possible to determine the congestion using either of the spatial parameters.

【0018】[0018]

【発明の実施の形態】図1は本発明の渋滞判定システム
を適用した交通管制システムの構成を示すブロック図で
ある。CCTV(Closed-Circuit TV) カメラ11は、道路上に
存在する車両の空間占有率,空間平均速度, 交通密度な
どの空間パラメータを画像処理を用いて計測する装置
(以下、空間センサという)1の撮像部である。CCTVカ
メラ11は、例えば道路の中央分離帯に立設されたT型照
明灯のようなポールの上部に取り付けられている。この
とき、例えばCCTVカメラ11を120 m間隔で設置し、各CC
TVカメラ11の画角を、車線の進行方向に計測範囲120 m
を、また車線横断方向に全車線(上り/下り4車線)の
計測範囲を確保できるように設定することにより、道路
上の連続的なデータが収集できるようになり、また1台
のカメラで多車線のデータが収集できるようになる。
FIG. 1 is a block diagram showing the configuration of a traffic control system to which a traffic jam judging system according to the present invention is applied. A CCTV (Closed-Circuit TV) camera 11 is a device (hereinafter, referred to as a space sensor) 1 that measures spatial parameters of vehicles existing on a road, such as spatial occupancy, spatial average speed, and traffic density, using image processing. It is an imaging unit. The CCTV camera 11 is mounted on an upper portion of a pole such as a T-type illumination lamp erected on a median strip of a road. At this time, for example, CCTV cameras 11 are installed at 120 m intervals,
Measures the angle of view of the TV camera 11 in the traveling direction of the lane, 120 m
In addition, it is possible to collect continuous data on the road by setting the measurement range of all lanes (four lanes up / down) in the direction of lane crossing. Lane data can be collected.

【0019】空間センサ1の処理部12は、画像処理機能
を有するマイクロコンピュータにより実現される。処理
部12は、複数台のCCTVカメラ11がそれぞれ俯瞰撮影した
画像をケーブルなどを介して取り込んで画像処理し、各
CCTVカメラ11の計測範囲に存在する車両の空間占有率,
空間平均速度, 交通密度などの空間パラメータを算出す
る。
The processing section 12 of the space sensor 1 is realized by a microcomputer having an image processing function. The processing unit 12 captures images taken by the plurality of CCTV cameras 11 from the bird's-eye view via a cable or the like, and performs image processing.
The space occupancy of vehicles existing in the measurement range of the CCTV camera 11,
Calculate spatial parameters such as spatial average speed and traffic density.

【0020】図2は1台のCCTVカメラ11の計測範囲の一
例を示す図である。なお、計測境界上に存在する車両に
関しては、車尾部(後方計測の場合)、あるいは車頭部
(前方計測の場合)が計測範囲内に存在する場合を計測
の対象とする。
FIG. 2 is a diagram showing an example of the measurement range of one CCTV camera 11. In addition, as for the vehicle existing on the measurement boundary, the case where the rear part (in the case of rear measurement) or the vehicle head (in the case of front measurement) exists within the measurement range is set as the measurement target.

【0021】道路の交通状態を管理・制御する管制セン
タには、空間センサ1が計測した空間パラメータから道
路の交通流の状態(通常流,渋滞流,停滞流など)を判
定する交通管制中央装置2が設けられ、交通管制中央装
置2と空間センサ1の処理部12とは回線で接続されてい
る。
The traffic control center for managing and controlling the traffic condition of the road is provided with a traffic control central device for determining the condition of the traffic flow (normal flow, congested flow, stagnant flow, etc.) from the spatial parameters measured by the spatial sensor 1. The traffic control central device 2 and the processing unit 12 of the space sensor 1 are connected by a line.

【0022】交通管制中央装置2は、2つの空間パラメ
ータ、例えば空間平均速度と空間占有率との相関分布領
域を、交通流の複数の状態(通常流,渋滞流,停滞流な
ど)のそれぞれに応じた複数の領域に区分する2つの空
間パラメータの閾値の組合せ、例えば空間占有率及び空
間平均速度の閾値の組合せを記憶する閾値組合せテーブ
ル21を備えている。
The traffic control central unit 2 assigns two spatial parameters, for example, a correlation distribution area between the average spatial velocity and the spatial occupancy, to each of a plurality of states of the traffic flow (normal flow, congested flow, stagnant flow, etc.). A threshold combination table 21 is provided which stores a combination of threshold values of two spatial parameters that are divided into a plurality of corresponding areas, for example, a combination of threshold values of a space occupancy and a space average velocity.

【0023】これらの閾値は、日単位(または月単位、
年単位)で、2つの空間パラメータ、例えば空間平均速
度及び空間占有率の時系列グラフを作成し、この時系列
グラフから時間帯別に作成した2つのパラメータの相関
グラフから、渋滞が発生した時間帯の相関分布領域と通
常流の時間帯の相関分布領域とを区分する値を設定す
る。
These thresholds are set on a daily (or monthly) basis.
A time series graph of two spatial parameters, for example, a spatial average speed and a space occupancy rate, is created in units of years), and a time zone in which congestion occurs is obtained from a correlation graph of the two parameters created for each time zone from the time series graph. Is set to distinguish between the correlation distribution area of the normal flow and the correlation distribution area of the normal flow time zone.

【0024】図3は空間平均速度と空間占有率との相関
グラフの一例である。図4は閾値組合せテーブル21の概
念図、図5は空間占有率及び空間平均速度の相関分布領
域を、交通流の状態に応じて複数の領域に区分した概念
図である。図5は、閾値をa=35%、b=20%、α=20
km/h、β=30km/hに設定した場合の例を示している。
FIG. 3 is an example of a correlation graph between the spatial average speed and the space occupancy. FIG. 4 is a conceptual diagram of the threshold combination table 21, and FIG. 5 is a conceptual diagram in which a correlation distribution area of the space occupancy and the space average speed is divided into a plurality of areas according to the state of traffic flow. FIG. 5 shows that the thresholds are a = 35%, b = 20%, α = 20
An example in the case of setting km / h and β = 30 km / h is shown.

【0025】交通管制中央装置2の渋滞判定手段22は、
閾値組合せテーブル21を参照し、空間センサ1から回線
を介して伝送されてきた空間パラメータの中の2つのパ
ラメータの相関がいずれの分布領域に含まれるかによっ
て道路の交通流の状態を判定する。
The traffic congestion determining means 22 of the traffic control central device 2
With reference to the threshold value combination table 21, the state of the traffic flow on the road is determined based on which distribution area contains the correlation between the two spatial parameters transmitted from the spatial sensor 1 via the line.

【0026】次に、渋滞判定方法の原理について説明す
る。渋滞などの交通特性は下式で表すことができる。 交通流=交通密度×空間平均速度 即ち、渋滞などの交通状況は、「車両の混み具合(交通
密度)」と「車群の移動速度(空間平均速度)」との2
つの空間パラメータの相関を用いて判定すると、交通現
象を的確に捉えることができるとされている。
Next, the principle of the traffic congestion determination method will be described. Traffic characteristics such as traffic congestion can be expressed by the following equation. Traffic flow = traffic density × average spatial speed In other words, traffic conditions such as traffic congestion can be calculated by using two factors: “congestion degree of vehicles (traffic density)” and “movement speed of vehicle group (average spatial speed)”.
It is said that the traffic phenomena can be accurately grasped if the determination is made using the correlation between the two spatial parameters.

【0027】さらに、交通密度は下式のように空間占有
率と一次線形の関係にある。 交通密度=空間占有率/平均車長 従って、空間平均速度−空間占有率の相関と、空間平均
速度−交通密度の相関とは同様の分布を示す(図6(a)
(b) 参照)。即ち、空間占有率と空間平均速度との相
関、交通密度と空間平均速度との相関のいずれを用いて
も渋滞判定が可能であるといえる。
Further, the traffic density has a linear relationship with the space occupancy as shown in the following equation. Traffic density = space occupancy / average vehicle length Accordingly, the correlation of spatial average speed-space occupancy and the correlation of spatial average speed-traffic density show the same distribution (FIG. 6 (a)).
(b)). That is, it can be said that the congestion determination can be made using any of the correlation between the space occupancy and the spatial average speed and the correlation between the traffic density and the spatial average speed.

【0028】次に、空間センサ1の処理部12における空
間パラメータ計測手順の一例を図7のフローチャートに
基づいて説明する。CCTVカメラ11から取り込んだ画像か
ら検出対象物である車両を抽出する。このとき、背景差
分方式と空間微分方式とを組合せて車両の存在候補を抽
出する( ステップS7-1) 。個々の車両存在候補に対し
て、時間差分方式により移動量を求め、速度を算出する
(ステップS7-2) 。
Next, an example of a procedure for measuring the spatial parameters in the processing unit 12 of the spatial sensor 1 will be described with reference to the flowchart of FIG. A vehicle as a detection target is extracted from an image captured from the CCTV camera 11. At this time, the presence candidate of the vehicle is extracted by combining the background difference method and the spatial differentiation method (step S7-1). For each vehicle presence candidate, the amount of movement is calculated by the time difference method, and the speed is calculated.
(Step S7-2).

【0029】ステップS7-1及びS7-2により抽出した車
両、及びその速度から空間パラメータを算出する (ステ
ップS7-3) 。即ち、交通密度は計測範囲内の車両台数を
計測し、空間占有率は計測範囲内の車両について計測し
た車長の総和を計測範囲長(進行方向)で除して算出
し、空間平均速度は計測範囲内に存在する車両の速度の
平均値を計算する。
A space parameter is calculated from the vehicle extracted in steps S7-1 and S7-2 and its speed (step S7-3). That is, the traffic density is calculated by measuring the number of vehicles in the measurement range, the space occupancy is calculated by dividing the sum of the vehicle lengths measured for the vehicles in the measurement range by the measurement range length (direction of travel), and the spatial average speed is calculated as follows: Calculate the average value of the speed of the vehicle existing within the measurement range.

【0030】このとき、広い視野範囲で画像が撮像され
るのでCCTVカメラ11の俯角が浅くなるため、個々の車両
の挙動を把握するために、カメラ画角に対する座標変換
処理、隣接車両の分離処理、車長及び車両の移動量の補
正などの処理を行うことが望ましい。
At this time, since the image is picked up in a wide field of view, the depression angle of the CCTV camera 11 becomes shallow, so that the coordinate conversion process for the camera view angle and the separation process of the adjacent vehicle are performed in order to grasp the behavior of each vehicle. It is desirable to perform processing such as correction of the vehicle length and the vehicle movement amount.

【0031】次に、交通管制中央装置2の渋滞判定手段
22における渋滞判定手順の一例を図8のフローチャート
に基づいて説明する。上述のような手順で空間センサ1
の処理部12により計測された空間平均速度と空間占有率
との組合せを一定周期で取り込む (ステップS8-1) 。入
力された空間平均速度と空間占有率との組合せを閾値組
合せテーブル21に当てはめ、3レベルのいずれに含まれ
るかでそのときの交通流の状態を判定する (ステップS8
-2) 。
Next, the congestion determination means of the traffic control central unit 2
An example of the congestion determination procedure in 22 will be described with reference to the flowchart of FIG. The space sensor 1 is operated in the above-described manner.
The combination of the space average speed and the space occupancy measured by the processing unit 12 is taken in at regular intervals (step S8-1). The combination of the input space average speed and space occupancy is applied to the threshold combination table 21, and the state of the traffic flow at that time is determined depending on which of the three levels is included (step S8).
-2).

【0032】ところで、交通流の変化点では、渋滞判定
結果が短時間の間に反転を繰り返す場合があるので、こ
れを防ぐため、それぞれの閾値にはヒステリシスを持た
せる。例えば、レベル0(通常流)からレベル1(渋滞
流)に切り替わるときの閾値より、レベル1(渋滞流)
からレベル0(通常流)に切り替わるときの閾値を低い
値に設定する。
By the way, at the change point of the traffic flow, the result of the congestion determination may be repeatedly inverted in a short time. To prevent this, each threshold value is provided with hysteresis. For example, the threshold at the time of switching from level 0 (normal flow) to level 1 (congested flow) is set to level 1 (congested flow).
The threshold value at the time of switching from to the level 0 (normal flow) is set to a low value.

【0033】以上のように、空間パラメータは、原理的
に瞬間の映像から収集することが可能であるため、5分
間等のデータ蓄積が不要であるとともに、時間的な平均
化処理がなくなるため、交通流の状況を即時に捉えるこ
とができ、また渋滞発生時の交通流の急激な変化につい
ても、迅速かつ精細に捉えることが可能になる。
As described above, since the spatial parameters can be collected from an instantaneous image in principle, it is not necessary to accumulate data for 5 minutes or the like, and there is no time averaging process. The situation of the traffic flow can be immediately grasped, and rapid changes in the traffic flow at the time of occurrence of traffic congestion can be quickly and precisely grasped.

【0034】なお、以上の説明では、空間パラメータを
計測する空間センサ1の処理部12と、渋滞を判定する交
通管制中央装置2とが回線で接続されている構成につい
て説明したが、空間パラメータ計測と渋滞判定とを1台
のコンピュータで実行する構成も可能である。
In the above description, the configuration in which the processing unit 12 of the space sensor 1 for measuring the space parameter and the traffic control central device 2 for determining traffic congestion are connected by a line has been described. It is also possible to adopt a configuration in which the determination of the traffic jam is executed by one computer.

【0035】また、以上のような渋滞判定のコンピュー
タプログラムはコンピュータにプレインストールして提
供することも、またCD-ROM、MO等の可搬型記録媒体で提
供することも可能である。さらに回線経由で提供するこ
とも可能である。
The computer program for determining traffic congestion as described above can be provided by being preinstalled in a computer, or can be provided on a portable recording medium such as a CD-ROM or MO. Further, it can be provided via a line.

【0036】[0036]

【発明の効果】以上のように、本発明は、道路を俯瞰撮
影した瞬間の画像から車両の空間占有率,空間平均速
度,交通密度などの空間パラメータを計測し、空間占有
率及び空間平均速度、または交通密度及び空間平均速度
の相関が、これらのパラメータの相関分布領域を交通流
の複数の状態それぞれに応じて区分した複数の領域のい
ずれに含まれるかに基づいて交通流の状態を判定するの
で、広い検知範囲における渋滞発生などの急激な交通流
の変化を迅速または精細に捉えるという優れた効果を奏
する。
As described above, according to the present invention, the spatial occupancy, the spatial average speed, the traffic density, and other spatial parameters of a vehicle are measured from the image at the moment when the road is overlooked, and the spatial occupancy and the spatial average speed are measured. Or the state of the traffic flow is determined based on whether the correlation between the traffic density and the spatial average speed is included in any of a plurality of areas obtained by dividing the correlation distribution area of these parameters according to the plurality of states of the traffic flow. Therefore, an excellent effect of rapidly or precisely catching a rapid change in traffic flow such as occurrence of traffic congestion in a wide detection range is achieved.

【図面の簡単な説明】[Brief description of the drawings]

【図1】本発明の渋滞判定システムを適用した交通管制
システムの構成を示すブロック図である。
FIG. 1 is a block diagram showing a configuration of a traffic control system to which a traffic jam determination system according to the present invention is applied.

【図2】1台のCCTVカメラの計測範囲の一例を示す図で
ある。
FIG. 2 is a diagram illustrating an example of a measurement range of one CCTV camera.

【図3】空間平均速度と空間占有率との相関グラフの一
例である。
FIG. 3 is an example of a correlation graph between a spatial average speed and a space occupancy.

【図4】閾値組合せテーブルの概念図である。FIG. 4 is a conceptual diagram of a threshold value combination table.

【図5】空間占有率及び空間平均速度の相関分布領域
を、交通流の状態に応じて複数の領域に区分した概念図
である。
FIG. 5 is a conceptual diagram in which a correlation distribution area of a space occupancy and a space average speed is divided into a plurality of areas according to a traffic flow state.

【図6】空間平均速度−空間占有率、及び空間平均速度
−交通密度の相関グラフである。
FIG. 6 is a correlation graph of spatial average speed-space occupancy, and spatial average speed-traffic density.

【図7】空間パラメータ計測手順の一例のフローチャー
トである。
FIG. 7 is a flowchart of an example of a spatial parameter measurement procedure.

【図8】渋滞判定手順の一例のフローチャートである。FIG. 8 is a flowchart illustrating an example of a traffic jam determination procedure.

【符号の説明】[Explanation of symbols]

1 空間センサ 11 CCTVカメラ 12 処理部 2 交通管制中央装置 21 閾値組合せテーブル 22 渋滞判定手段 Reference Signs List 1 space sensor 11 CCTV camera 12 processing unit 2 traffic control central device 21 threshold combination table 22 traffic congestion judgment means

───────────────────────────────────────────────────── フロントページの続き (72)発明者 中谷 邦則 大阪府大阪市中央区久太郎町四丁目1番3 号 阪神高速道路公団内 Fターム(参考) 5B057 AA16 DA06 DA20 DC02 DC19 5H180 AA01 CC04 CC11 CC24 DD02 DD04 5L096 BA04 CA03 FA34 FA70 GA02 GA08 HA03 9A001 HH23 JJ77 KK37  ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Kuniyoshi Nakatani 4-3-1 Kutarocho, Chuo-ku, Osaka-shi, Osaka F-term in Hanshin Expressway Public Corporation 5B057 AA16 DA06 DA20 DC02 DC19 5H180 AA01 CC04 CC11 CC24 DD02 DD04 5L096 BA04 CA03 FA34 FA70 GA02 GA08 HA03 9A001 HH23 JJ77 KK37

Claims (8)

【特許請求の範囲】[Claims] 【請求項1】 道路を俯瞰撮影した画像を利用して道路
の交通流の状態を判定する渋滞判定方法において、 前記画像の中の計測範囲に存在する車両の空間占有率及
び空間平均速度を含む空間パラメータを計測し、 計測した空間占有率及び空間平均速度の相関が、空間占
有率及び空間平均速度の相関分布領域を、空間占有率及
び空間平均速度の閾値の組合せによって区分した、交通
流の複数の状態それぞれに応じた複数の領域のいずれに
含まれるかによって道路の交通流の状態を判定すること
を特徴とする渋滞判定方法。
1. A traffic congestion determination method for determining the state of traffic flow on a road by using an image obtained by photographing a road from a bird's-eye view, the method including a space occupancy and a space average speed of vehicles existing in a measurement range in the image. The spatial parameters are measured, and the correlation between the measured space occupancy and the spatial average speed is calculated by dividing the correlation distribution area between the spatial occupancy and the spatial average speed by the combination of the threshold for the spatial occupancy and the spatial average speed. A traffic congestion determination method characterized by determining a state of a traffic flow on a road according to which of a plurality of areas according to each of a plurality of states is included.
【請求項2】 交通流の状態が渋滞の状態へ切り替わる
渋滞発生の場合と、渋滞の状態から通常の状態へ切り替
わる渋滞解消の場合とで、異なる閾値の組合せにより、
空間占有率及び空間平均速度の相関分布領域が区分され
ていることを特徴とする請求項1記載の渋滞判定方法。
2. A combination of different thresholds for a case where a traffic congestion occurs when the traffic flow state is switched to a congestion state and a case where traffic congestion is resolved when the traffic flow state is switched to a normal state.
2. The traffic congestion determination method according to claim 1, wherein a correlation distribution region of the space occupancy and the space average speed is divided.
【請求項3】 空間占有率に代えて交通密度を判定に用
いることを特徴とする請求項1又は2記載の渋滞判定方
法。
3. The traffic congestion determination method according to claim 1, wherein the traffic density is used for the determination instead of the space occupancy.
【請求項4】 道路を俯瞰撮影した画像を利用して道路
の交通流の状態を判定する渋滞判定システムにおいて、 前記画像の中の計測範囲に存在する車両の空間占有率及
び空間平均速度を含む空間パラメータを計測する手段、
及び計測した空間パラメータを送信する手段を有する端
末装置と、 端末装置から送信された空間パラメータを受信する手
段、空間占有率及び空間平均速度の相関分布領域を交通
流の複数の状態それぞれに応じた複数の領域に区分す
る、空間占有率及び空間平均速度の閾値の組合せを記憶
する手段、及び計測した空間占有率及び空間平均速度の
相関が、前記複数の領域のいずれに含まれるかによって
道路の交通流の状態を判定する手段を有する中央装置と
を備えたことを特徴とする渋滞判定システム。
4. A traffic congestion determination system that determines a state of a traffic flow on a road by using an image obtained by overhead-viewing a road, including a space occupancy rate and a spatial average speed of a vehicle existing in a measurement range in the image. Means for measuring spatial parameters,
And a terminal device having means for transmitting the measured spatial parameters, and a means for receiving the spatial parameters transmitted from the terminal device, and a correlation distribution area of the space occupancy and the spatial average velocity corresponding to each of a plurality of states of the traffic flow. Means for storing a combination of the threshold values of the space occupancy rate and the space average speed, and a correlation between the measured space occupancy rate and the space average speed, which is divided into a plurality of areas, depending on which of the plurality of areas includes the road. A traffic congestion determination system, comprising: a central device having means for determining a traffic flow state.
【請求項5】 交通流の状態が渋滞の状態へ切り替わる
渋滞発生の場合と、渋滞の状態から通常の状態へ切り替
わる渋滞解消の場合とで、異なる閾値の組合せが記憶さ
れていることを特徴とする請求項4記載の渋滞判定シス
テム。
5. A combination of different thresholds is stored in a case where a traffic congestion occurs when a traffic flow state is switched to a traffic congestion state and in a case where traffic congestion is switched from a traffic congestion state to a normal traffic state. The traffic congestion determination system according to claim 4.
【請求項6】 空間占有率に代えて交通密度を判定に用
いることを特徴とする請求項4又は5記載の渋滞判定シ
ステム。
6. The congestion determination system according to claim 4, wherein the traffic density is used for the determination instead of the space occupancy.
【請求項7】 道路を俯瞰撮影した画像を利用して道路
の交通流の状態を判定する渋滞判定装置において、 前記画像の中の計測範囲に存在する車両の空間占有率及
び空間平均速度を計測する手段と、 空間占有率及び空間平均速度の相関分布領域を交通流の
複数の状態それぞれに応じた複数の領域に区分する、空
間占有率及び空間平均速度の閾値の組合せを記憶する手
段と、 計測した空間占有率及び空間平均速度の相関が、前記複
数の領域のいずれに含まれるかによって道路の交通流の
状態を判定する手段とを備えたことを特徴とする渋滞判
定装置。
7. A traffic congestion determination device that determines a state of a traffic flow on a road using an image obtained by photographing a road from an overhead view, wherein a space occupancy and a spatial average speed of a vehicle existing in a measurement range in the image are measured. Means for dividing the correlation distribution area of the space occupancy rate and the space average speed into a plurality of areas corresponding to a plurality of states of the traffic flow, and storing a combination of threshold values of the space occupancy rate and the space average speed, Means for judging the state of traffic flow on the road based on which of the plurality of areas the correlation between the measured space occupancy rate and the spatial average speed is included in.
【請求項8】 道路を俯瞰撮影した画像から計測された
該画像の中の計測範囲に存在する車両の空間占有率及び
空間平均速度を含む空間パラメータを利用して道路の交
通流の状態をコンピュータに判定させるコンピュータプ
ログラムが記録されており、コンピュータでの読み取り
が可能な記録媒体において、 コンピュータに、計測された空間パラメータを取得させ
るプログラムコード手段と、 コンピュータに、空間占有率及び空間平均速度の相関分
布領域を交通流の複数の状態それぞれに応じた複数の領
域に区分する、空間占有率及び空間平均速度の閾値の組
合せのデータを参照させるプログラムコード手段と、 コンピュータに、取得した空間占有率及び空間平均速度
の相関が、前記閾値の組合せにより区分される複数の領
域のいずれに含まれるかによって道路の交通流の状態を
判定させるプログラムコード手段とを含むコンピュータ
プログラムが記録されていることを特徴とする記録媒
体。
8. A method for calculating the state of traffic flow on a road using a space parameter including a space occupancy and a space average speed of a vehicle existing in a measurement range in the image measured from an image of a bird's-eye view of the road. A computer program which causes a computer to acquire a measured spatial parameter; and a computer which has a computer operable to determine a correlation between a space occupancy and a spatial average speed. Program code means for dividing the distribution area into a plurality of areas corresponding to a plurality of states of the traffic flow, referring to data of a combination of a threshold value of a space occupancy rate and a space average speed; and The correlation of the spatial average velocity is included in any of a plurality of areas divided by the combination of the thresholds. A computer program including program code means for judging a state of traffic flow on a road depending on whether or not the road is in a running state.
JP28084999A 1999-09-30 1999-09-30 Congestion determination method, congestion determination system, congestion determination device, and recording medium Expired - Fee Related JP3260344B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP28084999A JP3260344B2 (en) 1999-09-30 1999-09-30 Congestion determination method, congestion determination system, congestion determination device, and recording medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP28084999A JP3260344B2 (en) 1999-09-30 1999-09-30 Congestion determination method, congestion determination system, congestion determination device, and recording medium

Publications (2)

Publication Number Publication Date
JP2001101571A true JP2001101571A (en) 2001-04-13
JP3260344B2 JP3260344B2 (en) 2002-02-25

Family

ID=17630848

Family Applications (1)

Application Number Title Priority Date Filing Date
JP28084999A Expired - Fee Related JP3260344B2 (en) 1999-09-30 1999-09-30 Congestion determination method, congestion determination system, congestion determination device, and recording medium

Country Status (1)

Country Link
JP (1) JP3260344B2 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003044512A (en) * 2001-07-27 2003-02-14 Dainippon Printing Co Ltd Server for searching activity area and server for recomending information
CN101615343B (en) * 2008-06-26 2011-02-09 上海宝信软件股份有限公司 Road CCTV monitoring system and road CCTV monitoring method
CN105551246A (en) * 2015-12-08 2016-05-04 合肥寰景信息技术有限公司 Method of calculating vehicle flow threshold of traffic signal controller
CN108665701A (en) * 2018-03-28 2018-10-16 上海与德科技有限公司 A kind of traffic congestion recognition methods, device, terminal and storage medium
CN109087478A (en) * 2018-08-22 2018-12-25 徐自远 A kind of early warning of the anti-swarm and jostlement of intelligence and method of river diversion and system
CN112419712A (en) * 2020-11-04 2021-02-26 同盾控股有限公司 Road section vehicle speed detection method and system
JP7439581B2 (en) 2020-03-12 2024-02-28 株式会社豊田中央研究所 Obstacle control system

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003044512A (en) * 2001-07-27 2003-02-14 Dainippon Printing Co Ltd Server for searching activity area and server for recomending information
JP4694060B2 (en) * 2001-07-27 2011-06-01 大日本印刷株式会社 Action area search server, program, and recording medium
CN101615343B (en) * 2008-06-26 2011-02-09 上海宝信软件股份有限公司 Road CCTV monitoring system and road CCTV monitoring method
CN105551246A (en) * 2015-12-08 2016-05-04 合肥寰景信息技术有限公司 Method of calculating vehicle flow threshold of traffic signal controller
CN105551246B (en) * 2015-12-08 2017-11-17 合肥寰景信息技术有限公司 A kind of computational methods of the vehicle flowrate threshold value of control traffic signaling equipment
CN108665701A (en) * 2018-03-28 2018-10-16 上海与德科技有限公司 A kind of traffic congestion recognition methods, device, terminal and storage medium
CN109087478A (en) * 2018-08-22 2018-12-25 徐自远 A kind of early warning of the anti-swarm and jostlement of intelligence and method of river diversion and system
JP7439581B2 (en) 2020-03-12 2024-02-28 株式会社豊田中央研究所 Obstacle control system
CN112419712A (en) * 2020-11-04 2021-02-26 同盾控股有限公司 Road section vehicle speed detection method and system

Also Published As

Publication number Publication date
JP3260344B2 (en) 2002-02-25

Similar Documents

Publication Publication Date Title
JP3501773B2 (en) Traffic situation determination method based on reported vehicle data for a traffic network including traffic-controlled network nodes
CN111613070B (en) Traffic signal lamp control method, traffic signal lamp control device, electronic equipment and computer storage medium
JP7040605B2 (en) Traffic monitoring equipment, traffic monitoring systems, traffic monitoring methods and programs
JP7040606B2 (en) Traffic monitoring equipment, traffic monitoring systems, traffic monitoring methods and programs
JP7063379B2 (en) Traffic monitoring equipment, traffic monitoring systems, traffic monitoring methods and programs
CN106384517A (en) Traffic signal control method based on visual sensing, apparatus and system thereof
CN106327880B (en) A kind of speed recognition methods and its system based on monitor video
KR102307217B1 (en) Road traffic information analyzing method by using drone shooting video and device using thereof
CN112767681B (en) Traffic state detection method, device and related equipment
CN111028523A (en) Signal lamp control method, device and equipment
JP3260344B2 (en) Congestion determination method, congestion determination system, congestion determination device, and recording medium
CN114049760B (en) Traffic control method, device and system based on intersection
CN114613155B (en) Special vehicle priority post signal time compensation method
JP3272334B2 (en) Required time calculation method and required time calculation device
JP2002288786A (en) Wide area congestion determination method, wide area congestion determination system, and determining device
JP2002083394A (en) Device and method for detecting abnormality in traffic flow
CN105389982B (en) Urban intersection congestion event detection and method for dissipating based on FCD
CN107730890B (en) Intelligent transportation method based on traffic flow speed prediction in real-time scene
JP2004005726A (en) Traffic flow monitoring system for moving-body
JP7069944B2 (en) Environment detectors, environment detection systems, environment detection methods, and computer programs
JP2001167381A (en) Method, system and device for detecting congestion at exit, and recording medium
JPH0251800A (en) Traffic jam state detecting system
TWI761863B (en) Traffic condition detection method
JP2000149181A (en) Traffic stream measurement system
JP2541531B2 (en) Parking detection method

Legal Events

Date Code Title Description
FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20071214

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20081214

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20091214

Year of fee payment: 8

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20101214

Year of fee payment: 9

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20101214

Year of fee payment: 9

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20111214

Year of fee payment: 10

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20111214

Year of fee payment: 10

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20121214

Year of fee payment: 11

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20121214

Year of fee payment: 11

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20131214

Year of fee payment: 12

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees