JP3140954B2 - Linear component extraction method - Google Patents
Linear component extraction methodInfo
- Publication number
- JP3140954B2 JP3140954B2 JP07327711A JP32771195A JP3140954B2 JP 3140954 B2 JP3140954 B2 JP 3140954B2 JP 07327711 A JP07327711 A JP 07327711A JP 32771195 A JP32771195 A JP 32771195A JP 3140954 B2 JP3140954 B2 JP 3140954B2
- Authority
- JP
- Japan
- Prior art keywords
- straight line
- point
- extracted
- image information
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Landscapes
- Processing Or Creating Images (AREA)
- Image Analysis (AREA)
Description
【０００１】[0001]
【発明の属する技術分野】本発明は、テレビカメラ等の
画像入力手段を利用して画像化された対象中、特に直線
の抽出に用いる直線成分抽出方法に関する。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for extracting a straight line component used for extracting a straight line from an object imaged using an image input means such as a television camera.
【０００２】[0002]
【従来の技術】従来、直線成分の抽出方法としては、特
開昭６２−２０２２９０号に見られるように、直線上の
各点を抽出して最小２乗法により直線を近似し、直線を
求める方法があった。2. Description of the Related Art Conventionally, as a method of extracting a straight line component, a method of extracting each point on a straight line, approximating the straight line by a least square method, and obtaining a straight line as disclosed in Japanese Patent Application Laid-Open No. 62-202290. was there.
【０００３】[0003]
【発明が解決しようとする課題】上記の従来例の方法に
よって直線を求める場合、各特徴点の抽出精度が、抽出
対象である直線の抽出精度に大きく影響を及ぼし、局所
的な特徴点の抽出ミスなどにより正しく直線が抽出され
ない場合が発生するという問題があった。本発明は上述
の問題点に鑑みて為されたもので、その目的とするとこ
ろは第１及び第２の２本の直線上の２点を結ぶ直線上の
画素の濃度の平均値を求めるという処理だけで抽出対象
である直線を高速に且つ安定に検出できる直線成分抽出
方法を提供するにある。When a straight line is obtained by the above-mentioned conventional method, the extraction accuracy of each feature point greatly affects the extraction accuracy of a straight line to be extracted, and local feature points are extracted. There has been a problem that a straight line may not be correctly extracted due to a mistake or the like. SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problem, and a purpose thereof is to obtain an average value of the density of pixels on a straight line connecting two points on a first and a second straight line. It is an object of the present invention to provide a straight line component extraction method capable of quickly and stably detecting a straight line to be extracted only by processing.
【０００４】[0004]
【課題を解決するための手段】請求項１の発明は、上記
目的を達成するために、画像入力手段により撮り込まれ
た画像情報の抽出対象である直線を含む領域に当該直線
と交差する第１及び第２の２本の直線を設定する段階
と、前記第１の直線上の画素の画素濃度のピーク点を求
める段階と、ピーク点に対向する第２の直線上の点の想
定を行なうとともにピーク点と想定した点とを結ぶ直線
上の画素の画素濃度の平均により得られる直線の画像情
報値を、第２の直線上の所定範囲内でピーク点と対向す
る点を順次想定しながら、求める段階と、求められた各
直線の画像情報値から抽出対象である直線を選択・抽出
する段階とからなるので、コントラストが低い抽出対象
であっても、空間微分処理や他のフィルタリング手法を
用いずに、第１及び第２の２本の直線上の２点を結ぶ直
線上の画素の画素濃度の平均値を求めるという処理だけ
で抽出対象である直線を高速に且つ安定的に抽出でき
る。Means for Solving the Problems of claims 1 invention, in order to achieve the above object, the straight line in a region including the straight line is the extraction target image information incorporated taken by the image input means
Setting two first and second straight lines that intersect with each other, obtaining a peak point of the pixel density of a pixel on the first straight line, and setting a point on a second straight line opposite to the peak point The image information value of the straight line obtained by averaging the pixel densities of the pixels on the straight line connecting the peak point and the assumed point is calculated as the point facing the peak point within a predetermined range on the second straight line. While sequentially assuming, a step of obtaining and a step of selecting and extracting a straight line to be extracted from the obtained image information value of each straight line are performed. A straight line to be extracted can be quickly and stably obtained only by calculating an average value of pixel densities of pixels on a straight line connecting two points on the first and second two straight lines without using the filtering method of Can be extracted.
【０００５】請求項２の発明は、請求項１の発明におい
て、抽出対象である直線の存在範囲が所定の領域に限定
される場合に、上記第１及び第２の直線を、上記領域の
境界線上の任意の２点を結び且つ互いに異なる点で上記
直線と交差する線分に設定して抽出対象である直線を選
択・抽出するので、検出対象である直線の存在範囲が限
定できる場合には、必要最小限の範囲に第１及び第２の
直線を設定することにより処理時間の短縮が行なえる。According to a second aspect of the present invention, in the first aspect of the present invention, when the existing range of the straight line to be extracted is limited to a predetermined area, the first and second straight lines are divided into the area.
Connect any two points on the boundary line and above at different points
Since the straight line to be extracted is selected and extracted by setting the line segment to intersect with the straight line, if the existing range of the straight line to be detected can be limited, the first and second straight lines are set to the minimum necessary range. The processing time can be reduced by setting.
【０００６】請求項３の発明は、請求項１又は２の発明
において、画像情報値のピーク値を抽出して抽出対象の
直線を選択・抽出するので、抽出のための処理時間を早
くすることができる。請求項４の発明は、請求項１又は
２の発明において、画像情報値の分布の重心を求めて抽
出対象の直線を選択・抽出するので、略等しいピークが
二つ以上あるときに有効となる。According to a third aspect of the present invention, in the first or second aspect of the present invention, a peak value of the image information value is extracted to select and extract a straight line to be extracted, thereby shortening the processing time for the extraction. Can be. According to the invention of claim 4, in the invention of claim 1 or 2, since the center of gravity of the distribution of image information values is obtained and a straight line to be extracted is selected and extracted, it is effective when there are two or more substantially equal peaks. .
【０００７】請求項５の発明は、請求項１又は２の発明
において、或る値以上を持つ画像情報値の分布の存在領
域の中心を求めて抽出対象の直線を選択・抽出するの
で、分布の度数が低い情報をカットすることになり、直
線の抽出の精度を向上することができる。請求項６の発
明は、請求項１乃至５の何れかの発明において、上記第
２の直線上の所定の開始点から第１のピッチ画素ごとに
第１の直線上のピーク点と対向する点を想定し、この想
定した点とピーク点とを結ぶ直線の画像情報値に基づい
て上記対向する点の候補を選択するとともに、この候補
点の近傍にて第１のピッチ画素よりも狭い第２のピッチ
画素ごとに第２の直線に沿って順次上記対向する点を想
定しながら画像情報値を求めるので、比較的に粗い第１
のピッチ画素ごとの走査で抽出対象である直線の存在位
置をあらかじめ決定した後、比較的に細かい第２のピッ
チ画素ごとに決定した直線の周辺を走査するようにして
いるため、第２の直線上の全ての点について第１の直線
上のピーク点と結んだ直線の画像情報値を求めるよりも
処理時間の短縮が行なえる。According to a fifth aspect of the present invention, in the first or second aspect of the present invention, a straight line to be extracted is selected and extracted by finding a center of a region where an image information value distribution having a certain value or more exists. The information having a low frequency is cut off, and the accuracy of extracting a straight line can be improved. According to a sixth aspect of the present invention, in any one of the first to fifth aspects, a point opposed to a peak point on the first straight line for each first pitch pixel from a predetermined start point on the second straight line. And selecting the opposing point candidate based on the image information value of a straight line connecting the assumed point and the peak point, and a second point narrower than the first pitch pixel in the vicinity of the candidate point. The image information value is obtained while sequentially assuming the opposing points along the second straight line for each pitch pixel of
After the existence position of the straight line to be extracted is determined in advance by scanning for each pitch pixel, the periphery of the relatively fine straight line determined for each second pitch pixel is scanned. The processing time can be reduced as compared with the case where the image information values of the straight line connected to the peak point on the first straight line are obtained for all the points above.
【０００８】請求項７の発明は、請求項１乃至６の何れ
かの発明において、抽出対象の直線を選択・抽出した
後、この抽出対象の直線と第２の直線との交点を新たな
起点とし、この起点と対向する点を第１の直線上に順次
想定しながら想定した点と上記起点を結ぶ各直線の画像
情報値を求めて抽出対象である直線を選択・抽出するの
で、直線抽出の起点としたピーク点の近傍を再度走査す
るため起点の誤検出を補正できて抽出精度を向上させる
ことができる。According to a seventh aspect of the present invention, there is provided any one of the first to sixth aspects.
In this invention, after selecting and extracting a straight line to be extracted, an intersection between the straight line to be extracted and the second straight line is set as a new starting point, and points facing the starting point are sequentially assumed on the first straight line. Since the image information value of each straight line connecting the assumed point and the above-mentioned starting point is obtained and the straight line to be extracted is selected and extracted, the vicinity of the peak point used as the starting point of the straight line extraction is scanned again so that the starting point is erroneously detected. Can be corrected, and the extraction accuracy can be improved.
【０００９】請求項８の発明は、請求項７の発明におい
て、元の起点たるピーク点を含む第１の直線上の所定範
囲内にて、微小なピッチ画素ごとに第２の直線上の上記
新たな起点と対向する点を順次想定するので、元の起点
を微小なピッチ画素ごとに走査して決定することによ
り、直線の抽出の精度を向上することができる。請求項
９の発明は、請求項１乃至８の何れかの発明において、
抽出対象の直線の選択・抽出を繰り返して行なうので、
直線抽出の信頼性を高めることができる。The invention according to claim 8 is the invention according to claim 7, wherein, within a predetermined range on the first straight line including the peak point as the original starting point, the above-mentioned arrangement on the second straight line for each minute pitch pixel is performed. Since the points opposite to the new starting point are sequentially assumed, the accuracy of extracting a straight line can be improved by scanning and determining the original starting point for each minute pitch pixel. The invention according to claim 9 is the invention according to any one of claims 1 to 8,
Since the selection and extraction of the line to be extracted is performed repeatedly,
The reliability of straight line extraction can be improved.
【００１０】[0010]
【発明の実施の形態】以下、本発明の実施形態を図面を
参照して説明する。 （実施形態１）本実施形態は図２に示す画像処理システ
ムを利用して実現したもので、図１に示すフローチャー
トに沿って抽出対象の直線を抽出処理を行なうようにな
っている。Embodiments of the present invention will be described below with reference to the drawings. (Embodiment 1) This embodiment is realized by using the image processing system shown in FIG. 2, and extracts a straight line to be extracted according to a flowchart shown in FIG.
【００１１】画像処理システムは、抽出対象を撮像する
ＴＶカメラ１と、ＴＶカメラ１で撮像して得られた画像
信号をＡ／Ｄ変換するＡ／Ｄ変換器２と、Ａ／Ｄ変換さ
れた原画像、微分画像、微分方向画像、エッジ画像等の
画像データが格納される画像メモリ３と、後述する作業
を行うためのワークメモリ４と、画像データをＤ／Ａ変
換するＤ／Ａ変換器５と、Ｄ／Ａ変換された画像信号に
基づいてＴＶカメラ１で撮像した原画像等を表示するモ
ニタ装置６と、モニタ装置６に表示させる文字データ等
が格納されたオーバレイメモリ７と、後述する作業等に
必要となるパラメータが格納されているスタティックＲ
ＡＭ８と、外部とのシリアル通信用の通信インターフェ
ース９と、これらの制御を行うＣＰＵ１０と、ＣＰＵ１
０の実行プログラム等が格納されたフラッシュＲＯＭ１
１と、外部とのディジタル通信用のディジタル通信用イ
ンターフェース１２とを備えている。なお、上記各部は
データバス１３により接続されている。The image processing system includes a TV camera 1 for imaging an object to be extracted, an A / D converter 2 for A / D converting an image signal obtained by imaging with the TV camera 1, and an A / D converted image signal. An image memory 3 for storing image data such as an original image, a differential image, a differential direction image, and an edge image; a work memory 4 for performing operations to be described later; and a D / A converter for D / A converting the image data 5, a monitor device 6 for displaying an original image or the like taken by the TV camera 1 based on the D / A-converted image signal, an overlay memory 7 for storing character data and the like to be displayed on the monitor device 6, Static R in which parameters required for the work to be performed are stored
AM 8, a communication interface 9 for serial communication with the outside, a CPU 10 for controlling these, and a CPU 1
Flash ROM 1 storing an execution program 0
1 and a digital communication interface 12 for digital communication with the outside. The above components are connected by a data bus 13.
【００１２】まず画像入力、画像メモリへの格納の段階
ではＴＶカメラ１により抽出対象を撮像し、撮像して得
られた画像信号はＡ／Ｄ変換器２によりＡ／Ｄ変換され
た後、ＣＰＵ１０の制御の下で、画像メモリ３に原画
像、微分画像、微分方向画像、エッジ画像等として格納
される。この画像メモリ３に格納された画像データから
ＣＰＵ１０により、次の各処理段階を経て直線抽出を行
なうのである。First, at the stage of image input and storage in an image memory, an image of an object to be extracted is taken by the TV camera 1, and an image signal obtained by the image pickup is subjected to A / D conversion by the A / D converter 2. Is stored in the image memory 3 as an original image, a differential image, a differential direction image, an edge image, and the like. A straight line is extracted from the image data stored in the image memory 3 by the CPU 10 through the following processing steps.
【００１３】まず抽出対象である図３に示す直線Ｌ0 を
含む領域へ第１及び第２の２本の直線Ｌ1 ，Ｌ2 を互い
に略平行させて設定し、その後この第１の直線Ｌ1 上の
画素について画素濃度のピーク点Ｐを求める。そして第
１の直線Ｌ1 上のピーク点Ｐに対向する第２の直線Ｌ2
上の点Ａの走査範囲（点ａ−点ａ’）を決定する。さて
走査範囲（点ａ−点ａ’）が決定されると、対向点Ａを
点ａから点ａ’方向に１画素ずつシフトさせながらピー
ク点Ｐと各対向点Ａとを結ぶ直線上の画素の画素濃度の
平均値（Ａａｖｅ）を求める。この平均値（Ａａｖｅ）
が画像情報値となる。そして対向点Ａの走査範囲（点ａ
−点ａ’）が終了すると、各直線の画像情報値（Ａａｖ
ｅ）から求める直線Ｌ0 を抽出するのである。First, the first and second two straight lines L 1 and L 2 are set substantially parallel to each other in an area including the straight line L 0 shown in FIG. 3 to be extracted, and then the first straight line L 1 is set. The pixel density peak point P is obtained for the upper pixel. Then, a second straight line L 2 facing the peak point P on the first straight line L 1
The scanning range of the upper point A (point a-point a ') is determined. When the scanning range (point a-point a ') is determined, the pixel on the straight line connecting the peak point P and each of the opposing points A while shifting the opposing point A one pixel at a time from the point a to the point a'. The average value (Aave) of the pixel densities is calculated. This average value (Aave)
Is the image information value. Then, the scanning range of the opposing point A (point a
When the point a ′) ends, the image information value (Aav) of each straight line
than it extracts the straight line L 0 obtained from e).
【００１４】（実施形態２） 本実施形態は、抽出用の走査直線である第１及び第２の
直線Ｌ1 ，Ｌ2 の設定方法に関し、抽出対象である直線
Ｌ0 （ｙ＝αｘ＋β）の存在範囲がある領域（例えばｃ
＜α＜ｄ、ｅ＜β＜ｆ）に限定される場合に、上記領域
の境界線上の任意の２点を結び且つ互いに異なる点で直
線Ｌ 0 と交差する線分として第１及び第２の直線Ｌ1 ，
Ｌ2 を設定するようにしたものである。(Embodiment 2) This embodiment relates to a method for setting first and second straight lines L 1 and L 2 which are scanning straight lines for extraction, and relates to a method for setting a straight line L 0 (y = αx + β) to be extracted. A region with an existence range (for example, c
<Α <d, e <β <f), the above region
Connect any two points on the boundary of
Lines L 1 of the line L 0 and the first and second as a line segment that intersects,
It is obtained so as to set the L 2.
【００１５】つまり本実施形態では図４のフローチャー
トで示すように、予め明らかになっている抽出対象たる
直線Ｌ0 の存在する領域（例えばｃ＜α＜ｄ、ｅ＜β＜
ｆ）に基づいて、図５に示すように第１及び第２の直線
Ｌ1 ，Ｌ2 （線分）の端点Ｍ11（ｘ，ｄｘ＋ｆ）、Ｍ12
（ｘ，ｃｘ＋ｅ）、Ｍ21（ｘ＋Ｄ，ｄ（ｘ＋Ｄ）＋
ｆ）、Ｍ22（ｘ＋Ｄ，ｃ（ｘ＋Ｄ）＋ｅ）を求め、抽出
対象である直線Ｌ0 を含む領域の境界線上の２点を結ぶ
線分として各直線Ｌ1 ，Ｌ2 を設定する。尚第２の直線
Ｌ2 の両端点Ｍ21，Ｍ22はそれぞれ対向点Ａの走査範囲
を決める点ａ及び点ａ’に対応する。That is, in the present embodiment, as shown in the flowchart of FIG. 4, a region where a straight line L 0 to be extracted exists (for example, c <α <d, e <β <
f), the end points M 11 (x, dx + f), M 12 of the first and second straight lines L 1 , L 2 (line segments) as shown in FIG.
(X, cx + e), M 21 (x + D, d (x + D) +
f), M 22 (x + D, c (x + D) + e) are obtained, and two points on the boundary of the area including the straight line L 0 to be extracted are connected.
Lines L 1 and L 2 are set as line segments . Both end points M 21 and M 22 of the second straight line L 2 correspond to the points a and a ′ that determine the scanning range of the opposing point A, respectively.
【００１６】尚図４の走査終了までの処理は実施形態１
と同じであるためその処理についての説明は省略する。
而して本実施形態では抽出対象である直線Ｌ0 の存在範
囲が限定される場合に、必要最小限の範囲に第１及び第
２の直線Ｌ1 ，Ｌ2 を設定するため処理時間の短縮を図
ることができる。The processing up to the end of scanning in FIG.
Since the processing is the same as that described above, the description of the processing is omitted.
If the Thus to the present embodiment is not limited the existence range of the straight line L 0 is the extraction target, reducing the first and second straight lines L 1, L 2 processing time to set to a range of the minimum required Can be achieved.
【００１７】（実施形態３）本実施形態は、ピーク点Ｐ
と対向点Ａとを結ぶ直線上の画素の画素濃度を総和した
画像情報値から、画像情報値のピーク値を抽出して、直
線Ｌ0 を選択する方法を採用したものである。つまり本
実施形態では図６のフローチャートで示すように走査終
了後、走査範囲（点ａ−点ａ’）内での直線上の画像情
報値（Ａａｖｅ）の分布を図７の如く求め、更にこの分
布のピーク値（Ｐｍａｘ）を求める。そしてこのピーク
値（Ｐｍａｘ）をとる対向点ＡのアドレスＰａより求め
る直線Ｌ0 を選択するのである。(Embodiment 3) In this embodiment, the peak point P
And from the image information values sum pixel density of the pixels on the straight line connecting the opposite points A, extracts the peak value of the image information value, is obtained by employing the method of selecting a straight line L 0. That is, in the present embodiment, as shown in the flowchart of FIG. 6, after the scanning is completed, the distribution of image information values (Aave) on a straight line within the scanning range (point a-point a ') is obtained as shown in FIG. The peak value (Pmax) of the distribution is obtained. And it is to select a line L 0 to determine from the address Pa opposing point A to take the peak value (Pmax).
【００１８】尚図６の走査終了までの処理は実施形態１
（或いは実施形態２）と同じであるためその処理につい
ての説明は省略する。而して本実施形態ではピーク値を
抽出して直線Ｌ0 を選択する方法であるため処理時間が
短くて済む。 （実施形態４）本実施形態は、画像情報値（Ａａｖｅ）
の分布の重心を求めて直線を選択する方法を採用したも
のである。The processing up to the end of scanning in FIG.
Since this is the same as (or the second embodiment), a description of that processing will be omitted. Requires only a short processing time because of the method of selecting a straight line L 0 extracts the peak value is Thus by the present embodiment. (Embodiment 4) In the present embodiment, the image information value (Aave)
And a straight line is selected by obtaining the center of gravity of the distribution.
【００１９】つまり本実施形態では図８のフローチャー
トで示すように走査終了後、走査範囲（点ａ−点ａ’）
での直線上の画像情報値（Ａａｖｅ）の分布を図９の如
く求め、その重心のアドレスを次式により求める。 Gr＝(p1 ×Aave(p1)＋p2×Aave(p2)＋…＋pn×Aave(p
n)) ／ΣAave(p) この求めた重心Ｇｒとピーク点Ｐを、結ぶ直線が求める
直線Ｌ0 となる。That is, in this embodiment, as shown in the flowchart of FIG. 8, after the scanning is completed, the scanning range (point a-point a ')
The distribution of the image information value (Aave) on the straight line at is obtained as shown in FIG. 9, and the address of the center of gravity is obtained by the following equation. Gr = (p 1 × Aave (p 1 ) + p 2 × Aave (p 2 ) + ... + pn × Aave (p
n)) / ΣAave (p) A straight line connecting the obtained center of gravity Gr and the peak point P is a straight line L 0 to be obtained.
【００２０】尚図８の走査終了までの処理は実施形態１
（或いは実施形態２）と同じであるためその処理につい
ての説明は省略する。以上のような処理を行なう本実施
形態は略等しいピークが二つ以上あるときに有効な方法
と言える。 （実施形態５）本実施形態は、或る値以上を持つ画像情
報分布の存在領域の中心を求めて直線を選択する方法を
採用したものである。The processing up to the end of scanning in FIG.
Since this is the same as (or the second embodiment), a description of that processing will be omitted. This embodiment that performs the above-described processing can be said to be an effective method when there are two or more substantially equal peaks. (Embodiment 5) This embodiment adopts a method of obtaining a center of an existing area of an image information distribution having a certain value or more and selecting a straight line.
【００２１】つまり本実施形態では図１０のフローチャ
ートで示すように走査終了後、走査範囲（点ａ−点
ａ’）での直線上の画像情報値（Ａａｖｅ）の平均値
（Ａｍｅａｎ）を求め、しきい値とする。そして図１１
に示す画像情報値分布において、求めたしきい値以上の
値をとる画像情報値分布の存在領域ａ1 −ａ2 を求め、
この存在領域ａ1 −ａ2 の中心のアドレスより求める直
線Ｌ0 を選択する。That is, in the present embodiment, as shown in the flowchart of FIG. 10, after the scanning is completed, the average value (Amean) of the image information values (Aave) on the straight line in the scanning range (point a-point a ') is obtained. The threshold is used. And FIG.
In the image information value distribution shown in ( 1), the existence area a 1 -a 2 of the image information value distribution having a value equal to or more than the obtained threshold is obtained,
Selecting a straight line L 0 to determine from the address of the center of the existing area a 1 -a 2.
【００２２】尚図１０の走査終了までの処理は実施形態
１（或いは実施形態２）と同じであるためその処理につ
いての説明は省略する。而して本実施形態によれば、分
布の度数の低い情報をカットすることができるため、抽
出精度を向上させることができる。尚実施形態３乃至実
施形態５の直線Ｌ0 の抽出選択に画像情報値の分布を用
いる方法を実施形態１以外に実施形態２においても採用
しても勿論よい。The processing up to the end of scanning in FIG. 10 is the same as that in the first embodiment (or the second embodiment), so that the description of the processing will be omitted. Thus, according to the present embodiment, information with a low frequency of distribution can be cut, so that the extraction accuracy can be improved. Note that the method of using the distribution of image information values for extracting and selecting the straight line L 0 according to the third to fifth embodiments may be adopted in the second embodiment other than the first embodiment.
【００２３】（実施形態６）本実施形態は、第１の直線
Ｌ1 上に直線Ｌ0 の抽出を行うための起点であるピーク
点Ｐを求めた後ピーク点Ｐから第２の直線Ｌ2 上に対向
点Ａを想定する段階において、先に粗いピッチの粗走査
を行って対向点Ａの候補点Ａ’を決定し、この候補点
Ａ’を含む狭い領域で細かいピッチの微走査を行って対
向点Ａを決定する方法を採用している。[0023] (Embodiment 6) In this embodiment, the straight line L 2 from the peak point P After determining the peak point P is a starting point of a second for the extraction of the straight line L 0 to the first upper straight line L 1 At the stage where the opposing point A is assumed above, coarse scanning is first performed at a coarse pitch to determine a candidate point A ′ of the opposing point A, and fine scanning at a fine pitch is performed in a narrow area including the candidate point A ′. A method of determining the opposing point A by using the method described above.
【００２４】つまり本実施形態では図１２のフローチャ
ートで示すように第１の直線Ｌ1 上にピーク点Ｐを設定
した後、第２の直線Ｌ2 上の走査範囲（点ａ−点ａ’）
で比較的に粗いピッチｇ画素ごとにピーク点Ｐと結んだ
直線上の画像情報値（Ａａｖｅ）の平均値（Ａｍｅａ
ｎ）を求め、さらに、図１３に示すように実施形態１乃
至実施形態５の方法を用いて画像情報値分布の存在領域
を求め、この存在領域の中心のアドレス等より求める対
向点Ａの候補点Ａ’（図示せず）を決定する。[0024] That After setting the peak point P on the first straight line L 1 as shown in the flowchart of FIG. 12 in the present embodiment, the second straight line L 2 on the scanning range (the point a- point a ')
The average value (Amea) of the image information values (Aave) on a straight line connected to the peak point P for each relatively coarse pitch g pixel
n), and further, as shown in FIG. 13, the presence area of the image information value distribution is obtained by using the method of the first to fifth embodiments, and the candidate of the opposing point A to be obtained from the address of the center of this existence area, Determine the point A ′ (not shown).
【００２５】そして、候補点Ａ’の第２の直線Ｌ2 上の
近傍ｈ画素の範囲Ｓ（Ａ’±ｈ画素）で細かいピッチｊ
画素（図示せず）ごとにピーク点Ｐと直線を結ぶととも
に、結んだ直線上の画像情報値（Ａａｖｅ）の平均値
（Ａｍｅａｎ）を求めて対向点Ａの決定を行い、最終的
にピーク点Ｐと対向点Ａを結んだ直線を求める直線Ｌ0
として選択する。[0025] Then, fine pitch j in the candidate point A 'range in the vicinity h pixels in the second on the straight line L 2 of S (A' ± h pixels)
A straight line is connected to the peak point P for each pixel (not shown), an average value (A mean) of image information values (Aave) on the connected straight line is determined, and the opposing point A is determined. A straight line L 0 for finding a straight line connecting P and the opposing point A
Select as
【００２６】而して本実施形態によれば、比較的に粗い
第１のピッチｇ画素ごとの走査で直線Ｌ0 を抽出するた
めの対向点Ａの候補点Ａ’を決定した後、比較的に細か
い第２のピッチｊ画素ごとに候補点Ａの周辺を走査する
ようにしているため、第２の直線Ｌ2 上の全ての点につ
いて第１の直線Ｌ1 上のピーク点Ｐと結んだ直線の画像
情報値を求めるよりも処理時間の短縮が行なえる。According to the present embodiment, after the candidate point A ′ of the opposing point A for extracting the straight line L 0 by scanning the relatively coarse first pitch g pixels is determined, since it has to scan the periphery of the candidate point a every second pitch j pixel fine, the connecting the peak point P of the first on the straight line L 1 for all points on the second straight line L 2 Processing time can be reduced as compared with the case where a straight line image information value is obtained.
【００２７】（実施形態７）本実施形態は、上述の実施
形態１乃至実施形態６により選択された抽出対象である
直線Ｌ0 に対して、抽出の起点とした第１の直線Ｌ1 上
のピーク点Ｐを補正するようにしたものである。つまり
本実施形態では図１４のフローチャートに示すように抽
出対象である直線Ｌ0 を一旦選択した後、図１５に示す
ように第１の直線Ｌ1 上のピーク点Ｐから第１の直線Ｌ
1 上で両側にＢ画素だけ離れたアドレスを点ｂ，ｂ’と
し、第１の直線Ｌ1 上に走査範囲（点ｂ−点ｂ’）を決
定する。[0027] (Embodiment 7) This embodiment, with respect to the straight line L 0 is selected extraction target by Embodiments 1 to 6 described above, extracted starting point the first straight line L 1 on the The peak point P is corrected. That is once selects the straight line L 0 is the extraction target as shown in the flowchart of FIG. 14 in the present embodiment, the first straight line L from the peak point P on the first straight line L 1 as shown in FIG. 15
1 on the point addresses apart on both sides by B pixels b, 'and the scan range (the point b- point b to the first on the straight line L 1' b to determine).
【００２８】さて走査範囲（点ｂ−点ｂ’）が決定され
ると、ピーク点Ｐを点ｂから点ｂ’方向に１画素ずつシ
フトさせながら各ピーク点Ｐと新たな起点となる第２の
直線Ｌ2 上の対向点Ａとを結ぶ直線上の画素の画素濃度
の平均値（Ｂａｖｅ）を求める。この平均値（Ｂａｖ
ｅ）が画像情報値となる。そしてピーク点Ｐの走査範囲
（点ｂ−点ｂ’）が終了すると、各直線の画像情報値
（Ｂａｖｅ）から求める直線Ｌ0 を抽出するのである。When the scanning range (point b-point b ') is determined, the peak point P is shifted from the point b to the point b' by one pixel at a time, and each peak point P and a new starting point are obtained. obtaining the average value of the pixel density of the pixels on the straight line connecting the opposite point a on the straight line L 2 a (Bave). This average value (Bav
e) is the image information value. When the scanning range of the peak point P (point b- point b ') is completed, it is to extract a straight line L 0 to determine from the image information values of the straight lines (Bave).
【００２９】尚図１４の一旦直線Ｌ0 を選択するまでの
処理は実施形態１と同じであるためその処理についての
説明は省略する。而して本実施形態では直線抽出の起点
としたピーク点Ｐの近傍を再度走査するため、起点の誤
検出を補正できて抽出精度を向上させることができる。 （実施形態８）上記実施形態７では１回だけ起点（ピー
ク点Ｐ）と対向点Ａとを交換して走査を行ない各直線の
画像情報値（Ｂａｖｅ）から求める直線Ｌ0 を抽出する
と処理を終了しているが、本実施形態では実施形態７の
処理に加えて図１６のフローチャートに示すように規定
回数（複数回）だけ起点と対向点を交換する操作を繰り
返し行なって規定回数だけ直線抽出を繰り返して行なう
ようにしたものであり、この複数回の直線抽出を行なう
ことにより直線抽出の信頼性を高めることができる。[0029] Once the processing up to select a line L 0 of Naozu 14 is omitted a description of the process is the same as Embodiment 1. In this embodiment, since the vicinity of the peak point P, which is the starting point of the straight line extraction, is scanned again, erroneous detection of the starting point can be corrected, and the extraction accuracy can be improved. The processing for extracting a straight line L 0 to determine the (Embodiment 8) In the above embodiment only 7 once the origin (peak point P) and subjected to replacement by scanning the opposite point A image information values of the straight lines (Bave) Although the process has been completed, in the present embodiment, in addition to the processing of the seventh embodiment, the operation of exchanging the starting point and the opposing point is repeated a specified number of times (a plurality of times) as shown in the flowchart of FIG. Is performed repeatedly, and the reliability of the straight line extraction can be increased by performing the plurality of straight line extractions.
【００３０】尚上記直線抽出を繰り返す操作は、実施形
態１乃至６においても採用することができ、それぞれの
実施形態において直線抽出の信頼性を高めることができ
るのは勿論である。The operation of repeating the straight line extraction can be employed in the first to sixth embodiments, and it is needless to say that the reliability of the straight line extraction can be improved in each embodiment.
【００３１】[0031]
【発明の効果】請求項１の発明は、画像入力手段により
撮り込まれた画像情報の抽出対象である直線を含む領域
に当該直線と交差する第１及び第２の２本の直線を設定
する段階と、前記第１の直線上の画素の画素濃度のピー
ク点を求める段階と、ピーク点に対向する第２の直線上
の点の想定を行なうとともにピーク点と想定した点とを
結ぶ直線上の画素の画素濃度の平均により得られる直線
の画像情報値を、第２の直線上の所定範囲内でピーク点
と対向する点を順次想定しながら、求める段階と、求め
られた各直線の画像情報値から抽出対象である直線を選
択・抽出する段階とからなるので、コントラストが低い
抽出対象であっても、空間微分処理や他のフィルタリン
グ手法を用いずに、第１及び第２の２本の直線上の２点
を結ぶ直線上の画素の画素濃度の平均値を求めるという
処理だけで抽出対象である直線を高速に且つ安定的に抽
出できるという効果がある。According to the first aspect of the present invention, first and second two straight lines intersecting the straight line are set in an area including the straight line from which the image information captured by the image input means is extracted. Determining the peak point of the pixel density of the pixel on the first straight line, assuming a point on the second straight line opposite to the peak point, and defining a point connecting the peak point and the assumed point. Determining image information values of a straight line obtained by averaging the pixel densities of the pixels while sequentially assuming points facing the peak point within a predetermined range on the second straight line. Selecting and extracting a straight line to be extracted from the information value. Therefore, even if the extraction target has a low contrast, the first and second lines can be extracted without using a spatial differentiation process or another filtering method. Image on the line connecting two points on the line There is an effect that a is to be extracted by the process of obtaining the average value of the pixel density linear can and stably extracted at high speed.
【００３２】請求項２の発明は、抽出対象である直線の
存在範囲が所定の領域に限定される場合に、上記第１及
び第２の直線を、上記領域の境界線上の任意の２点を結
び且つ互いに異なる点で上記直線と交差する線分に設定
して抽出対象である直線を選択・抽出するので、検出対
象である直線の存在範囲が限定できる場合には、必要最
小限の範囲に第１及び第２の直線を設定することにより
処理時間の短縮が行なえるという効果がある。According to a second aspect of the present invention, when the range of existence of a straight line to be extracted is limited to a predetermined region, the first and second straight lines are defined as two arbitrary points on the boundary line of the region. Conclusion
And a line that intersects with the straight line at a different point and selects and extracts the straight line to be extracted. If the range of the straight line to be detected can be limited, the range is set to the minimum necessary range. By setting the first and second straight lines, there is an effect that the processing time can be reduced.
【００３３】請求項３の発明は、画像情報値のピーク値
を抽出して抽出対象の直線を選択・抽出するので、抽出
のための処理時間を早くすることができるという効果が
ある。請求項４の発明は、画像情報値の分布の重心を求
めて抽出対象の直線を選択・抽出するので、略等しいピ
ークが二つ以上あるときに有効となるという効果があ
る。According to the third aspect of the present invention, since the peak value of the image information value is extracted to select and extract a straight line to be extracted, the processing time for the extraction can be shortened. According to the fourth aspect of the present invention, since the straight line to be extracted is selected and extracted by obtaining the center of gravity of the distribution of the image information values, it is effective when there are two or more peaks that are substantially equal.
【００３４】請求項５の発明は、或る値以上を持つ画像
情報値の分布の存在領域の中心を求めて抽出対象の直線
を選択・抽出するので、分布の度数が低い情報をカット
することになり、直線の抽出の精度を向上することがで
きるという効果がある。請求項６の発明は、上記第２の
直線上の所定の開始点から第１のピッチ画素ごとに第１
の直線上のピーク点と対向する点を想定し、この想定し
た点とピーク点とを結ぶ直線の画像情報値に基づいて上
記対向する点の候補を選択するとともに、この候補点の
近傍にて第１のピッチ画素よりも狭い第２のピッチ画素
ごとに第２の直線に沿って順次上記対向する点を想定し
ながら画像情報値を求めるので、比較的に粗い第１のピ
ッチ画素ごとの走査で抽出対象である直線の存在位置を
あらかじめ決定した後、比較的に細かい第２のピッチ画
素ごとに決定した直線の周辺を走査するようにしている
ため、第２の直線上の全ての点について第１の直線上の
ピーク点と結んだ直線の画像情報値を求めるよりも処理
時間の短縮が行なえるという効果がある。According to a fifth aspect of the present invention, since the center of the existence area of the distribution of image information values having a certain value or more is obtained and a straight line to be extracted is selected and extracted, information having a low frequency of distribution is cut. The effect is that the accuracy of straight line extraction can be improved. According to a sixth aspect of the present invention, the first pitch pixel is provided for each first pitch pixel from a predetermined start point on the second straight line.
Assuming a point opposing the peak point on the straight line, and selecting the opposing point candidate based on the image information value of the straight line connecting the assumed point and the peak point, and in the vicinity of the candidate point Since the image information value is obtained while sequentially assuming the above-mentioned opposing points along the second straight line for each second pitch pixel narrower than the first pitch pixel, a relatively coarse scan for each first pitch pixel is performed. After the existence position of the straight line to be extracted is determined in advance, the periphery of the straight line determined for each relatively fine second pitch pixel is scanned, so that all points on the second straight line are scanned. There is an effect that the processing time can be reduced as compared with the case where the image information value of the straight line connected to the peak point on the first straight line is obtained.
【００３５】請求項７の発明は、抽出対象の直線を選択
・抽出した後、この抽出対象の直線と第２の直線との交
点を新たな起点とし、この起点と対向する点を第１の直
線上に順次想定しながら想定した点と上記起点を結ぶ各
直線の画像情報値を求めて抽出対象である直線を選択・
抽出するので、直線抽出の起点としたピーク点の近傍を
再度走査するため起点の誤検出を補正できて抽出精度を
向上させることができるという効果がある。According to a seventh aspect of the present invention, after a straight line to be extracted is selected and extracted, an intersection between the straight line to be extracted and the second straight line is set as a new starting point, and a point facing the starting point is set as a first point. While sequentially assuming on a straight line, determine the image information value of each straight line connecting the assumed point and the starting point, and select the straight line to be extracted
Since the extraction is performed, the vicinity of the peak point used as the starting point of the straight line extraction is re-scanned, so that an erroneous detection of the starting point can be corrected and the extraction accuracy can be improved.
【００３６】請求項８の発明は、元の起点たるピーク点
を含む第１の直線上の所定範囲内にて、微小なピッチ画
素ごとに第２の直線上の上記新たな起点と対向する点を
順次想定するので、元の起点を微小なピッチ画素ごとに
走査して決定することにより、直線の抽出の精度を向上
することができるという効果がある。請求項９の発明
は、抽出対象の直線の選択・抽出を繰り返して行なうの
で、直線抽出の信頼性を高めることができるという効果
がある。According to the present invention, a point on the second straight line opposed to the new starting point for each minute pitch pixel within a predetermined range on the first straight line including the original peak point. Are sequentially assumed, so that the original starting point is scanned and determined for each minute pitch pixel, thereby improving the accuracy of straight line extraction. According to the ninth aspect of the present invention, the selection and extraction of the straight line to be extracted are repeatedly performed, so that the reliability of the straight line extraction can be improved.
【図１】本発明方法の実施形態１のフローチャートであ
る。FIG. 1 is a flowchart of Embodiment 1 of the method of the present invention.
【図２】同上に用いる画像処理システムのブロック図で
ある。FIG. 2 is a block diagram of an image processing system used in the embodiment.
【図３】同上の抽出対象の直線と抽出するために設定す
る第１及び第２の直線との関係を示す説明図である。FIG. 3 is an explanatory diagram showing a relationship between the extraction target straight line and first and second straight lines set for extraction.
【図４】本発明方法の実施形態２のフローチャートであ
る。FIG. 4 is a flowchart of Embodiment 2 of the method of the present invention.
【図５】同上の直線抽出の説明図である。FIG. 5 is an explanatory diagram of straight line extraction according to the embodiment;
【図６】本発明方法の実施形態３のフローチャートであ
る。FIG. 6 is a flowchart of Embodiment 3 of the method of the present invention.
【図７】同上の直線抽出の説明図である。FIG. 7 is an explanatory diagram of straight line extraction according to the embodiment;
【図８】本発明方法の実施形態４のフローチャートであ
る。FIG. 8 is a flowchart of Embodiment 4 of the method of the present invention.
【図９】同上の直線抽出の説明図である。FIG. 9 is an explanatory diagram of straight line extraction according to the embodiment;
【図１０】本発明方法の実施形態５のフローチャートで
ある。FIG. 10 is a flowchart of Embodiment 5 of the method of the present invention.
【図１１】同上の直線抽出の説明図である。FIG. 11 is an explanatory diagram of straight line extraction according to the embodiment;
【図１２】本発明方法の実施形態６のフローチャートで
ある。FIG. 12 is a flowchart of Embodiment 6 of the method of the present invention.
【図１３】同上の直線抽出の説明図である。FIG. 13 is an explanatory diagram of straight line extraction according to the embodiment;
【図１４】本発明方法の実施形態７のフローチャートで
ある。FIG. 14 is a flowchart of Embodiment 7 of the method of the present invention.
【図１５】同上の直線抽出の説明図である。FIG. 15 is an explanatory diagram of straight line extraction according to the embodiment;
【図１６】本発明方法の実施形態８のフローチャートで
ある。FIG. 16 is a flowchart of Embodiment 8 of the method of the present invention.
Claims (9)
報の抽出対象である直線を含む領域に当該直線と交差す
る第１及び第２の２本の直線を設定する段階と、前記第
１の直線上の画素の画素濃度のピーク点を求める段階
と、ピーク点に対向する第２の直線上の点の想定を行な
うとともにピーク点と想定した点とを結ぶ直線上の画素
の画素濃度の平均により得られる直線の画像情報値を、
第２の直線上の所定範囲内でピーク点と対向する点を順
次想定しながら、求める段階と、求められた各直線の画
像情報値から抽出対象である直線を選択・抽出する段階
とからなることを特徴とする直線成分抽出方法。A step of setting first and second two straight lines that intersect with a straight line in a region including a straight line from which image information captured by an image input unit is to be extracted; Calculating a peak point of the pixel density of the pixel on the straight line, assuming a point on the second straight line opposite to the peak point, and averaging the pixel density of the pixel on a straight line connecting the peak point and the assumed point; The image information value of the straight line obtained by
A step of determining a point opposite to a peak point within a predetermined range on the second straight line while sequentially assuming the same, and a step of selecting and extracting a straight line to be extracted from the obtained image information value of each straight line. A straight-line component extraction method, characterized in that:
領域に限定される場合に、上記第１及び第２の直線を、
上記領域の境界線上の任意の２点を結び且つ互いに異な
る点で上記直線と交差する線分に設定して抽出対象であ
る直線を選択・抽出することを特徴とする請求項１記載
の直線成分抽出方法。2. When the existing range of a straight line to be extracted is limited to a predetermined area, the first and second straight lines are
Connect any two points on the boundary of the above area and
2. A straight line component extracting method according to claim 1, wherein a straight line to be extracted is selected and extracted by setting the line segment to intersect the straight line at a certain point .
象の直線を選択・抽出することを特徴とする請求項１又
は２記載の直線成分抽出方法。3. The straight line component extracting method according to claim 1, wherein a peak value of the image information value is extracted to select and extract a straight line to be extracted.
象の直線を選択・抽出することを特徴とする請求項１又
は２記載の直線成分抽出方法。4. The straight line component extracting method according to claim 1, wherein a straight line to be extracted is selected and extracted by obtaining a center of gravity of the distribution of the image information values.
在領域の中心を求めて抽出対象の直線を選択・抽出する
ことを特徴とする請求項１又は２記載の直線成分抽出方
法。5. The straight-line component extraction method according to claim 1, wherein a straight line to be extracted is selected and extracted by obtaining a center of an existing area of a distribution of image information values having a certain value or more.
１のピッチ画素ごとに第１の直線上のピーク点と対向す
る点を想定し、この想定した点とピーク点とを結ぶ直線
の画像情報値に基づいて上記対向する点の候補を選択す
るとともに、この候補点の近傍にて第１のピッチ画素よ
りも狭い第２のピッチ画素ごとに第２の直線に沿って順
次上記対向する点を想定しながら画像情報値を求めるこ
とを特徴とする請求項１乃至５の何れかに記載の直線成
分抽出方法。6. A point opposite to a peak point on the first straight line is assumed for each first pitch pixel from a predetermined start point on the second straight line, and the assumed point and the peak point are connected. The candidate of the opposing point is selected based on the image information value of the straight line, and the candidate is selected along the second straight line for each second pitch pixel smaller than the first pitch pixel in the vicinity of the candidate point. linear component extraction method according to any of claims 1 to 5, characterized in that obtaining the image information values while assuming a point opposite.
の抽出対象の直線と第２の直線との交点を新たな起点と
し、この起点と対向する点を第１の直線上に順次想定し
ながら想定した点と上記起点を結ぶ各直線の画像情報値
を求めて抽出対象である直線を選択・抽出することを特
徴とする請求項１乃至６の何れかに記載の直線成分抽出
方法。7. After selecting and extracting a straight line to be extracted, an intersection point between the straight line to be extracted and the second straight line is set as a new starting point, and points facing the starting point are sequentially assumed on the first straight line. linear component extraction method according to any of claims 1 to 6, wherein the selecting and extracting a line is extracted target seeking image information values of the straight line connecting the assumed point and the origin while.
上の所定範囲内にて、微小なピッチ画素ごとに第２の直
線上の上記新たな起点と対向する点を順次想定すること
を特徴とする請求項７記載の直線成分抽出方法。8. A method according to claim 1, further comprising: assuming, in a predetermined range on the first straight line including the peak point as the original starting point, points opposite to the new starting point on the second straight line for each minute pitch pixel. The method for extracting linear components according to claim 7, wherein:
て行なうことを特徴とする請求項１乃至８の何れかに記
載の直線成分抽出方法。9. linear component extraction method in any one of claims 1 to 8 serial <br/> mounting and carrying out repeated selective-extraction of the extraction target line.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP07327711A JP3140954B2 (en) | 1995-12-15 | 1995-12-15 | Linear component extraction method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP07327711A JP3140954B2 (en) | 1995-12-15 | 1995-12-15 | Linear component extraction method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPH09167236A JPH09167236A (en) | 1997-06-24 |
| JP3140954B2 true JP3140954B2 (en) | 2001-03-05 |
Family
ID=18202139
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP07327711A Expired - Lifetime JP3140954B2 (en) | 1995-12-15 | 1995-12-15 | Linear component extraction method |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP3140954B2 (en) |
-
1995
- 1995-12-15 JP JP07327711A patent/JP3140954B2/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| JPH09167236A (en) | 1997-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP0117559B1 (en) | Pattern checking apparatus | |
| US5272763A (en) | Apparatus for inspecting wiring pattern formed on a board | |
| JP5198654B2 (en) | Composite image creation method and apparatus | |
| JP4230880B2 (en) | Defect inspection method | |
| JP3193240B2 (en) | Image processing device | |
| CN111260675A (en) | High-precision extraction method and system for image real boundary | |
| JPH08292014A (en) | Measuring method of pattern position and device thereof | |
| JP3140954B2 (en) | Linear component extraction method | |
| JP3627249B2 (en) | Image processing device | |
| EP1384204A2 (en) | Apparatus and method for boundary detection in vector sequences and edge detection in color image signals | |
| JP2957897B2 (en) | Linear component extraction method | |
| JP3126462B2 (en) | Boundary extraction method and apparatus | |
| US20020159654A1 (en) | Method for processing an image of a concrete construction | |
| JP3182936B2 (en) | Lead end detection method | |
| KR100212844B1 (en) | Edge detection method using double window | |
| JP3753900B2 (en) | Image processing device | |
| JP2008258980A (en) | Image information processor, and image inclination angle calculation method | |
| JP3146882B2 (en) | Picture inspection method | |
| CN117093164A (en) | Screen acquisition method, screen acquisition device and computer readable storage medium | |
| JP2918985B2 (en) | Method of setting area segmentation threshold in image processing | |
| JPH11102442A (en) | Method and device for detecting edge | |
| JPH08274984A (en) | Image processing unit | |
| KR100258328B1 (en) | Method for selecting region of picture editing device | |
| JP2000259826A (en) | Method and device for extracting ruled line and recording medium | |
| JP2003338926A (en) | Image processing method and apparatus thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20001205 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20071215 Year of fee payment: 7 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20081215 Year of fee payment: 8 |
|
| S533 | Written request for registration of change of name |
Free format text: JAPANESE INTERMEDIATE CODE: R313533 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20081215 Year of fee payment: 8 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20091215 Year of fee payment: 9 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20091215 Year of fee payment: 9 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20101215 Year of fee payment: 10 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20111215 Year of fee payment: 11 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20121215 Year of fee payment: 12 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20121215 Year of fee payment: 12 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20131215 Year of fee payment: 13 |
|
| EXPY | Cancellation because of completion of term |