JP5204686B2 - Array direction detection apparatus, array direction detection method, and array direction detection program - Google Patents

Array direction detection apparatus, array direction detection method, and array direction detection program Download PDF

Info

Publication number
JP5204686B2
JP5204686B2 JP2009031395A JP2009031395A JP5204686B2 JP 5204686 B2 JP5204686 B2 JP 5204686B2 JP 2009031395 A JP2009031395 A JP 2009031395A JP 2009031395 A JP2009031395 A JP 2009031395A JP 5204686 B2 JP5204686 B2 JP 5204686B2
Authority
JP
Japan
Prior art keywords
arrangement direction
line segment
convex hull
provisional
arrangement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2009031395A
Other languages
Japanese (ja)
Other versions
JP2010186407A (en
Inventor
博己 藤本
章 小川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Screen Holdings Co Ltd
Dainippon Screen Manufacturing Co Ltd
Original Assignee
Screen Holdings Co Ltd
Dainippon Screen Manufacturing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Screen Holdings Co Ltd, Dainippon Screen Manufacturing Co Ltd filed Critical Screen Holdings Co Ltd
Priority to JP2009031395A priority Critical patent/JP5204686B2/en
Publication of JP2010186407A publication Critical patent/JP2010186407A/en
Application granted granted Critical
Publication of JP5204686B2 publication Critical patent/JP5204686B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Description

本発明は、平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、配列方向に垂直な方向において互いに重なる複数の点列からなる点群から配列方向を検出する技術に関する。   The present invention detects an arrangement direction from a point group that is a point sequence in which points are arranged in a predetermined arrangement direction on a plane and that overlaps each other in a direction perpendicular to the arrangement direction. Regarding technology.

従来より、対象物の画像の傾きを求める方法の1つとして、対象物上に目印(いわゆる、アライメントマーク)を設けておき、画像中のアライメントマークの配列の傾きから画像の傾きを求める方法が知られている。   Conventionally, as one method for obtaining the inclination of an image of an object, there is a method in which a mark (so-called alignment mark) is provided on the object, and the inclination of the image is obtained from the inclination of the alignment mark alignment in the image. Are known.

また、特許文献1では、走査方向に垂直な方向における位置を変更しつつ画像を走査方向に沿って複数回走査し、各走査において最初に出現する画素の集合である印刷開始点列(例えば、矩形の印刷領域の上辺の画素)を求め、印刷開始点列の傾きから画像の傾きを求める方法が開示されている。   Further, in Patent Document 1, the image is scanned a plurality of times along the scanning direction while changing the position in the direction perpendicular to the scanning direction, and a print start point sequence (for example, a set of pixels that first appear in each scanning) (for example, A method is disclosed in which a pixel on the upper side of a rectangular print area is obtained, and the inclination of the image is obtained from the inclination of the print start point sequence.

特許文献2では、画像上においてセルである単位要素が縦方向および横方向に配列されており、各単位要素の重心位置をパターンマッチング処理により求め、縦方向の位置が近い重心を有する単位要素の集合(すなわち、横方向に並ぶ単位要素の集合であり、以下、「単位要素列」という。)を抽出し、当該単位要素列に含まれる複数の単位要素の重心を通る直線の傾きから画像の傾きを求める方法が開示されている。なお、上記重心を点と捉えた場合、多数の点から一の直線上に配列される複数の点を抽出する方法の1つであるハフ(Hough)変換を用いて単位要素列の複数の重心を通る直線を求めることが考えられるが、ハフ変換ではあらゆる方向を向く直線に対して投票処理を行って適切な直線を求めることになるため、処理時間が多大なものとなってしまう。   In Patent Document 2, unit elements that are cells are arranged in a vertical direction and a horizontal direction on an image, and the center of gravity of each unit element is obtained by pattern matching processing. A set (that is, a set of unit elements arranged in the horizontal direction, hereinafter referred to as “unit element sequence”) is extracted, and an image of the image is obtained from the slope of a straight line passing through the centroids of a plurality of unit elements included in the unit element sequence. A method for determining the slope is disclosed. Note that when the centroid is regarded as a point, a plurality of centroids of a unit element string are generated using Hough transform, which is one of methods for extracting a plurality of points arranged on one straight line from a large number of points. However, in the Hough transform, a voting process is performed on a straight line that faces in any direction to obtain an appropriate straight line, so that the processing time becomes long.

特開平7−89063号公報JP 7-89063 A 特開2005−313215号公報JP-A-2005-313215

ところで、対象物にアライメントマークを設けて画像の傾きを求める方法では、対象物に対するアライメントマークの付加が必要となる上、画像中からアライメントマークを抽出する必要もあり、傾き検出に要する演算量が増大してしまう。   By the way, in the method of obtaining the inclination of the image by providing the alignment mark on the object, it is necessary to add the alignment mark to the object, and it is also necessary to extract the alignment mark from the image. It will increase.

特許文献1の方法では、上述のように、矩形の印刷領域が設定されている画像の傾きを求めることは可能であるが、印刷領域の輪郭が矩形でない場合(例えば、曲線を含んだり凹凸がある場合)には、画像の傾きを精度良く求めることは困難である。   In the method of Patent Document 1, as described above, it is possible to obtain the inclination of an image in which a rectangular print area is set. However, when the outline of the print area is not rectangular (for example, it includes a curve or unevenness). In some cases, it is difficult to accurately determine the inclination of the image.

特許文献2の方法では、画像の傾きが少し大きくなると、一の単位要素列に含まれる複数の単位要素の重心位置と、当該単位要素列に隣接する他の単位要素列に含まれる複数の単位要素の重心位置とが縦方向において近接してしまい、隣接する2つの単位要素列を区別することが困難になって画像の傾きを精度良く求めることができなくなってしまう。また、隣接する単位要素列の間の距離が小さい場合にも同様に、隣接する2つの単位要素列に含まれる単位要素が一緒に抽出されてしまい、画像の傾きを精度良く求めることができなくなってしまう。   In the method of Patent Literature 2, when the inclination of the image is slightly increased, the barycentric positions of a plurality of unit elements included in one unit element column and a plurality of units included in other unit element columns adjacent to the unit element column The barycentric position of the elements is close in the vertical direction, and it becomes difficult to distinguish between two adjacent unit element strings, and the inclination of the image cannot be obtained with high accuracy. Similarly, when the distance between adjacent unit element strings is small, the unit elements included in the two adjacent unit element strings are extracted together, and the inclination of the image cannot be obtained with high accuracy. End up.

本発明は、上記課題に鑑みなされたものであり、点群に含まれる点列における複数の点の配列方向を容易かつ高精度に検出することを目的としている。   The present invention has been made in view of the above problems, and an object of the present invention is to easily and highly accurately detect the arrangement direction of a plurality of points in a point sequence included in a point group.

請求項1に記載の発明は、平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出装置であって、前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含み、かつ、前記暫定配列方向に長く、その長さが前記複数の点列において前記配列方向に隣接する2つの点の間の距離の既知の最大値の3倍以上である領域内に存在する対象点群を撮像する撮像部と、前記撮像部からの出力に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する凸包生成部と、前記部分凸包に含まれる複数の線分のうち最長の線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する配列方向取得部とを備える。   The invention according to claim 1 is a point group that is a point sequence in which points are arranged in a predetermined arrangement direction on a plane, and a plurality of point sequences that overlap each other in a direction perpendicular to the arrangement direction. An arrangement direction detecting device for detecting the arrangement direction from one of the provisional width directions perpendicular to the provisional arrangement direction that is at least part of the point cloud and has been found to be approximately parallel to the arrangement direction A region that includes a portion on the side, is long in the provisional arrangement direction, and has a length that is three times or more the known maximum value of the distance between two points adjacent in the arrangement direction in the plurality of point sequences An provisional width direction of a convex hull formed by connecting an image pickup unit that picks up a target point group existing inside and a point located on the outermost side of the target point group by a straight line based on an output from the image pickup unit A partial convex hull that is the one side portion of An array direction in which a convex hull generating unit to be generated and a longest line segment among a plurality of line segments included in the partial convex hull are specified as a direction indicating line segment and a direction of the direction indicating line segment is acquired as the array direction An acquisition unit.

請求項2に記載の発明は、平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出装置であって、前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含む対象点群を撮像する撮像部と、前記撮像部からの出力に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する凸包生成部と、前記部分凸包に含まれる複数の線分のうち前記暫定配列方向と為す角度が最も小さい線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する配列方向取得部とを備える。   The invention according to claim 2 is a point group consisting of a plurality of point sequences each of which is a point sequence in which points are arranged in a predetermined arrangement direction on a plane and which overlaps each other in a direction perpendicular to the arrangement direction. An arrangement direction detecting device for detecting the arrangement direction from one of the provisional width directions perpendicular to the provisional arrangement direction that is at least part of the point cloud and has been found to be approximately parallel to the arrangement direction The provisional width of the convex hull formed by connecting an image capturing unit that captures a target point group including a site on the side and a point located on the outermost side of the target point group based on an output from the image capturing unit with a straight line A convex hull generating unit that generates a partial convex hull that is the one side portion of the direction, and a line segment that has the smallest angle with the provisional arrangement direction among a plurality of line segments included in the partial convex hull Specified as a minute and said direction indicating line segment And a arrangement direction acquisition unit that acquires, as the arrangement direction countercurrent.

請求項3に記載の発明は、請求項1または2に記載の配列方向検出装置であって、前記方向指示線分から取得された前記配列方向が仮に決定された配列方向であり、前記撮像部、前記凸包生成部および前記配列方向取得部により、前記点群の前記暫定幅方向の他方側においても前記方向指示線分と同様にもう1つの方向指示線分が特定され、前記配列方向取得部が、前記方向指示線分の方向と前記もう1つの方向指示線分の方向とを用いて最終的な前記配列方向を取得する。   Invention of Claim 3 is the arrangement | positioning direction detection apparatus of Claim 1 or 2, Comprising: The said arrangement | positioning direction acquired from the said direction instruction | indication line segment is the arrangement | positioning direction determined temporarily, The said imaging part, By the convex hull generation unit and the arrangement direction acquisition unit, another direction instruction line segment is specified on the other side of the provisional width direction of the point group similarly to the direction instruction line segment, and the arrangement direction acquisition unit However, the final arrangement direction is acquired using the direction of the direction indicating line segment and the direction of the other direction indicating line segment.

請求項4に記載の発明は、請求項1ないし3のいずれかに記載の配列方向検出装置であって、前記点群において、各点と少なくとも1つの他の点とが前記配列方向に垂直な幅方向に並ぶ。   A fourth aspect of the present invention is the arrangement direction detecting device according to any one of the first to third aspects, wherein in the point group, each point and at least one other point are perpendicular to the arrangement direction. Line up in the width direction.

請求項5に記載の発明は、平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出方法であって、a)前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含み、かつ、前記暫定配列方向に長く、その長さが前記複数の点列において前記配列方向に隣接する2つの点の間の距離の既知の最大値の3倍以上である領域内に存在する対象点群を撮像する工程と、b)前記a)工程における撮像結果に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する工程と、c)前記部分凸包に含まれる複数の線分のうち最長の線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する工程とを備える。   The invention according to claim 5 is a point group consisting of a plurality of point sequences each of which is a point sequence in which points are arranged in a predetermined arrangement direction on a plane and which overlaps each other in a direction perpendicular to the arrangement direction. The arrangement direction detection method for detecting the arrangement direction from: a) a provisional width direction perpendicular to the provisional arrangement direction that is at least part of the point cloud and has been found to be approximately parallel to the arrangement direction And is longer than the known maximum value of the distance between two points adjacent to each other in the arrangement direction in the plurality of point sequences. A step of imaging a target point group existing in a certain area; and b) a convex hull formed by connecting a point located on the outermost side of the target point group with a straight line based on an imaging result in the step a) The one side portion in the provisional width direction A step of generating a partial convex hull, and c) specifying a longest line segment as a direction indicating line segment among a plurality of line segments included in the partial convex hull, and setting a direction of the direction indicating line segment as the arrangement direction Acquiring.

請求項6に記載の発明は、平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出方法であって、a)前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含む対象点群を撮像する工程と、b)前記a)工程における撮像結果に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する工程と、c)前記部分凸包に含まれる複数の線分のうち前記暫定配列方向と為す角度が最も小さい線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する工程とを備える。   The invention according to claim 6 is a point group that is a point sequence in which points are arranged in a predetermined arrangement direction on a plane, and a plurality of point sequences that overlap each other in a direction perpendicular to the arrangement direction. The arrangement direction detection method for detecting the arrangement direction from: a) a provisional width direction perpendicular to the provisional arrangement direction that is at least part of the point cloud and has been found to be approximately parallel to the arrangement direction And b) a convex hull formed by connecting a point located on the outermost side of the target point group with a straight line based on an imaging result in the step a) Generating a partial convex hull that is the one side portion of the provisional width direction, and c) a line segment having a smallest angle with the provisional arrangement direction among a plurality of line segments included in the partial convex hull. Identified as direction indicator line segment The direction indication line and a step of acquiring, as the arrangement direction.

請求項7に記載の発明は、平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出プログラムであって、前記配列方向検出プログラムのコンピュータによる実行は、前記コンピュータに、a)前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含み、かつ、前記暫定配列方向に長く、その長さが前記複数の点列において前記配列方向に隣接する2つの点の間の距離の既知の最大値の3倍以上である領域内に存在する対象点群の撮像結果を受け付ける工程と、b)前記a)工程における撮像結果に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する工程と、c)前記部分凸包に含まれる複数の線分のうち最長の線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する工程とを実行させる。 The invention according to claim 7 is a point group that is a point sequence in which points are arranged in a predetermined arrangement direction on a plane, and a plurality of point sequences that overlap each other in a direction perpendicular to the arrangement direction. An arrangement direction detection program for detecting the arrangement direction from a computer, wherein the execution of the arrangement direction detection program by the computer is a) at least part of the point group and approximately parallel to the arrangement direction Two portions including one side in the provisional width direction perpendicular to the provisional arrangement direction that is known to be long in the provisional arrangement direction and having a length adjacent to the arrangement direction in the plurality of point sequences. a step of receiving an image result of the target point group present in more than three times that in the area of known maximum value of the distance between the points, b) said pair based on the imaging result in the a) step A step of generating a partial convex hull that is a portion on the one side in the provisional width direction of a convex hull formed by connecting a point located on the outermost side of the point group with a straight line; and c) included in the partial convex hull A longest line segment is specified as a direction indicating line segment, and the direction of the direction indicating line segment is acquired as the arrangement direction.

請求項8に記載の発明は、平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出プログラムであって、前記配列方向検出プログラムのコンピュータによる実行は、前記コンピュータに、a)前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含む対象点群の撮像結果を受け付ける工程と、b)前記a)工程における撮像結果に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する工程と、c)前記部分凸包に含まれる複数の線分のうち前記暫定配列方向と為す角度が最も小さい線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する工程とを実行させる。 The invention according to claim 8 is a point group consisting of a plurality of point sequences each of which is a point sequence in which points are arranged in a predetermined arrangement direction on a plane and which overlaps each other in a direction perpendicular to the arrangement direction. An arrangement direction detection program for detecting the arrangement direction from a computer, wherein the execution of the arrangement direction detection program by the computer is a) at least part of the point group and approximately parallel to the arrangement direction A step of receiving an imaging result of a target point group including a part on one side in the provisional width direction perpendicular to the provisional arrangement direction, and b) based on the imaging result in the step a) of the target point group A step of generating a partial convex hull that is a portion on the one side in the provisional width direction of a convex hull formed by connecting points located on the outermost side with straight lines; and c) included in the partial convex hull. Identify the smallest segment as the direction indication line segment angle formed between the provisional arrangement direction of the number of line segments, the direction of the direction indication line to execute a step of acquiring, as the arrangement direction.

本発明では、点群に含まれる点列における複数の点の配列方向を容易かつ高精度に検出することができる。   In the present invention, the arrangement direction of a plurality of points in a point sequence included in a point group can be detected easily and with high accuracy.

第1の実施の形態に係る配列方向検出装置を示す図である。It is a figure which shows the arrangement | sequence direction detection apparatus which concerns on 1st Embodiment. 点群の画像を示す図である。It is a figure which shows the image of a point cloud. 演算部の構成を示す図である。It is a figure which shows the structure of a calculating part. 演算部の機能を示すブロック図である。It is a block diagram which shows the function of a calculating part. 配列方向の検出の流れを示す図である。It is a figure which shows the flow of a detection of an array direction. 点群の画像を示す図である。It is a figure which shows the image of a point cloud. 点群の画像を示す図である。It is a figure which shows the image of a point cloud. 点群の画像を示す図である。It is a figure which shows the image of a point cloud. シリコン基板上の複数のチップの画像を示す図である。It is a figure which shows the image of the some chip | tip on a silicon substrate. 第2の実施の形態に係る配列方向検出装置による配列方向の検出の流れを示す図である。It is a figure which shows the flow of a detection of the arrangement direction by the arrangement direction detection apparatus which concerns on 2nd Embodiment.

図1は、本発明の第1の実施の形態に係る配列方向検出装置1の構成を示す図である。配列方向検出装置1は、図2にその一部を示す対象物9の画像80中の複数の点列81からなる点群8から、点列81における複数の点811の配列方向を検出する装置である。図2では、図の理解を容易にするために、各点列81を二点鎖線にて囲む。点群8では、複数の点列81のそれぞれは、図2中のxy平面上において所定の配列方向(図2中におけるy方向であり、x方向およびy方向は点群8に対して固定された座標軸である。)に複数の点811が直線状に配列された点列であり、複数の点列81は、当該配列方向に垂直な幅方向(すなわち、x方向)において互いに重なっている。換言すれば、点群8では、図2中のy方向に平行に伸びる互いに平行な複数の点列81がx方向に配列されている。   FIG. 1 is a diagram showing a configuration of an arrangement direction detection apparatus 1 according to the first embodiment of the present invention. The arrangement direction detection apparatus 1 detects an arrangement direction of a plurality of points 811 in the point sequence 81 from a point group 8 composed of a plurality of point sequences 81 in the image 80 of the object 9 whose part is shown in FIG. It is. In FIG. 2, each point sequence 81 is surrounded by a two-dot chain line for easy understanding of the drawing. In the point group 8, each of the plurality of point sequences 81 has a predetermined arrangement direction on the xy plane in FIG. 2 (the y direction in FIG. 2, and the x direction and the y direction are fixed with respect to the point group 8. A plurality of points 811 are arranged in a straight line, and the plurality of point sequences 81 overlap each other in the width direction (that is, the x direction) perpendicular to the arrangement direction. In other words, in the point group 8, a plurality of parallel point sequences 81 extending in parallel to the y direction in FIG. 2 are arranged in the x direction.

図1に示す配列方向検出装置1は、対象物9をガラス面上に保持する保持部13、対象物9を撮像する撮像部11、および、撮像部11により取得された画像を受け付けて所定の演算を行う演算部12を備える。撮像部11は、印刷された面を下側((−Z)側)に向けて保持部13に保持された対象物9の下方に配置され、対象物9の印刷された面の画像を取得する。   The arrangement direction detection apparatus 1 shown in FIG. 1 receives a predetermined part by receiving a holding unit 13 that holds an object 9 on a glass surface, an imaging unit 11 that images the object 9, and an image acquired by the imaging unit 11. A calculation unit 12 that performs calculation is provided. The imaging unit 11 is arranged below the object 9 held by the holding unit 13 with the printed surface facing downward ((−Z) side), and acquires an image of the printed surface of the object 9. To do.

撮像部11は、対象物9上において図1中のX方向に伸びる線状領域を撮像するラインセンサ111、対象物9上におけるラインセンサ111の撮像領域に光を照射する光照射部112、並びに、ラインセンサ111および光照射部112をX方向に垂直なY方向に移動するセンサ移動機構113を備える。本実施の形態では、ラインセンサ111は、線状に配列された複数のCCD(Charge Coupled Device)素子を備え、ラインセンサ111の線状の撮像領域は対象物9のX方向の全幅に亘る。   The imaging unit 11 includes a line sensor 111 that images a linear region extending in the X direction in FIG. 1 on the object 9, a light irradiation unit 112 that irradiates light to the imaging region of the line sensor 111 on the object 9, and And a sensor moving mechanism 113 for moving the line sensor 111 and the light irradiation unit 112 in the Y direction perpendicular to the X direction. In the present embodiment, the line sensor 111 includes a plurality of CCD (Charge Coupled Device) elements arranged linearly, and the linear imaging region of the line sensor 111 covers the entire width of the object 9 in the X direction.

ここで、図1中のX方向およびY方向は、配列方向検出装置1に対して固定された既知の座標軸であり、XY平面と図2中のxy平面とは平行である。図2中のx方向およびy方向はそれぞれ、X方向およびY方向におよそ平行であることは判明しているものの未知の座標軸であり、配列方向検出装置1では、既知のY方向に対するy方向の傾きが求められることにより、点列81における複数の点811の配列方向が検出される。以下の説明では、複数の点811の配列方向であるy方向(すなわち、配列方向検出装置1の検出対象)におよそ平行なY方向を「暫定配列方向」といい、Y方向に垂直なX方向を「暫定幅方向」という。   Here, the X direction and the Y direction in FIG. 1 are known coordinate axes fixed to the arrangement direction detecting device 1, and the XY plane and the xy plane in FIG. 2 are parallel. The x direction and the y direction in FIG. 2 are unknown coordinate axes that are known to be approximately parallel to the X direction and the Y direction, respectively. In the arrangement direction detection apparatus 1, the y direction with respect to the known Y direction is By obtaining the inclination, the arrangement direction of the plurality of points 811 in the point sequence 81 is detected. In the following description, the Y direction approximately parallel to the y direction (that is, the detection target of the arrangement direction detection device 1) that is the arrangement direction of the plurality of points 811 is referred to as “provisional arrangement direction”, and the X direction perpendicular to the Y direction. Is called “provisional width direction”.

図3は、演算部12の構成を示す図である。演算部12は、通常のコンピュータと同様に、CPU101、RAM102、ROM103、固定ディスク104、ディスプレイ105、および、入力部106等を接続した構成となっており、固定ディスク104内には、演算部12により実行される配列方向検出プログラム1041が記憶される。図4は、演算部12のCPU101等が配列方向検出プログラム1041に従って演算処理を実行することにより実現される機能を示すブロック図であり、図4中の凸包生成部121および配列方向取得部122が、CPU101等により実現される機能に相当する。これらの機能は複数台のコンピュータにより実現されてもよい。   FIG. 3 is a diagram illustrating a configuration of the calculation unit 12. The arithmetic unit 12 is configured by connecting a CPU 101, a RAM 102, a ROM 103, a fixed disk 104, a display 105, an input unit 106, and the like, as in a normal computer, and the arithmetic unit 12 is included in the fixed disk 104. The arrangement direction detection program 1041 executed by is stored. FIG. 4 is a block diagram illustrating functions realized when the CPU 101 of the calculation unit 12 executes calculation processing according to the arrangement direction detection program 1041. The convex hull generation unit 121 and the arrangement direction acquisition unit 122 in FIG. Corresponds to a function realized by the CPU 101 or the like. These functions may be realized by a plurality of computers.

図5は、配列方向検出装置1による複数の点811の配列方向検出の流れを示す図である。図1に示す配列方向検出装置1では、まず、撮像部11のラインセンサ111および光照射部112がY方向に走査されることにより、対象物9が撮像されて画像80(図2参照)が演算部12へと送られる(ステップS11)。   FIG. 5 is a diagram showing a flow of detecting the arrangement direction of the plurality of points 811 by the arrangement direction detection apparatus 1. In the arrangement direction detection apparatus 1 shown in FIG. 1, first, the line sensor 111 and the light irradiation unit 112 of the imaging unit 11 are scanned in the Y direction, whereby the object 9 is imaged and an image 80 (see FIG. 2) is obtained. It is sent to the calculation unit 12 (step S11).

本実施の形態では、図2に示す画像80中の点群8の全体が、配列方向の検出に利用される対象点群となっている。点群8の複数の点列81のそれぞれでは複数の点811が不等ピッチにて配列されており、複数の点列81において配列方向であるy方向に隣接する2つの点811の間の距離の最大値(以下、「点間最大距離」という。)は既知とされる。対象点群である点群8は、暫定配列方向であるY方向に長い矩形状の領域801(図2において二点鎖線にて示す。)内に存在する。領域801のY方向の長さは、点間最大距離の3倍以上となっている。なお、図2では、図示の都合上、複数の点列81のx方向におけるピッチを実際よりも大きく描いているが、実際には、隣接する点列81の間の距離は点間最大距離よりもかなり小さい。   In the present embodiment, the entire point group 8 in the image 80 shown in FIG. 2 is the target point group used for detecting the arrangement direction. In each of the plurality of point sequences 81 of the point group 8, a plurality of points 811 are arranged at an unequal pitch, and the distance between two points 811 adjacent to each other in the y direction that is the arrangement direction in the plurality of point sequences 81. The maximum value (hereinafter referred to as “maximum distance between points”) is known. The point group 8 that is the target point group exists in a rectangular region 801 (indicated by a two-dot chain line in FIG. 2) that is long in the Y direction that is the provisional arrangement direction. The length of the region 801 in the Y direction is at least three times the maximum distance between points. In FIG. 2, for convenience of illustration, the pitch in the x direction of the plurality of point sequences 81 is drawn larger than the actual pitch, but in reality, the distance between adjacent point sequences 81 is greater than the maximum point-to-point distance. Is also quite small.

続いて、演算部12の凸包生成部121(図4参照)により、撮像部11(図1参照)からの出力である画像80に基づいて、点群8の最も外側に位置する複数の点811を、図6に示すように直線にて結んで形成される凸包82が生成される(ステップS12)。具体的には、画像80が二値化されて複数の点811が抽出され(すなわち、各点811を周囲の部位から孤立させて切り出し)、各点811の重心の位置が求められ、さらに、複数の点811のそれぞれの重心からグラハム(Graham)の方法等の既知の手法により凸包82が求められる。なお、画像80からの複数の点811の抽出はパターンマッチング等により行われてもよい。   Subsequently, a plurality of points positioned on the outermost side of the point group 8 based on the image 80 that is an output from the imaging unit 11 (see FIG. 1) by the convex hull generating unit 121 (see FIG. 4) of the calculation unit 12. A convex hull 82 formed by connecting 811 with a straight line as shown in FIG. 6 is generated (step S12). Specifically, the image 80 is binarized and a plurality of points 811 are extracted (that is, each point 811 is isolated from the surrounding part and cut out), and the position of the center of gravity of each point 811 is obtained. The convex hull 82 is obtained from the center of gravity of each of the plurality of points 811 by a known method such as the Graham method. Note that the extraction of the plurality of points 811 from the image 80 may be performed by pattern matching or the like.

次に、配列方向取得部122(図4参照)により、凸包82の暫定幅方向の一方側(すなわち、(−X)側)の部分である部分凸包821aが凸包82から抽出される(ステップS13)。図6では、図の理解を容易にするために、部分凸包821aを二点鎖線にて囲む。そして、部分凸包821aに含まれる複数の線分825のうち最長の線分が方向指示線分825aとして特定され、暫定配列方向であるY方向を基準とする方向指示線分825aの方向(例えば、Y方向と方向指示線分825aとの為す角度)が、各点列81における複数の点811の仮に決定された配列方向(以下、「仮配列方向」という。)として取得される(ステップS14)。   Next, the arrangement direction acquisition unit 122 (see FIG. 4) extracts from the convex hull 82 a partial convex hull 821a that is a portion of the convex hull 82 in the provisional width direction (that is, the (−X) side). (Step S13). In FIG. 6, the partial convex hull 821a is surrounded by a two-dot chain line for easy understanding of the drawing. The longest line segment among the plurality of line segments 825 included in the partial convex hull 821a is specified as the direction indicating line segment 825a, and the direction of the direction indicating line segment 825a with respect to the Y direction which is the provisional arrangement direction (for example, , The angle formed by the Y direction and the direction indicating line segment 825a) is acquired as a provisionally determined arrangement direction of the plurality of points 811 in each point sequence 81 (hereinafter referred to as “temporary arrangement direction”) (step S14). ).

また、配列方向取得部122により、凸包82の暫定幅方向の他方側(すなわち、(+X)側)の部分であるもう1つの部分凸包821bが凸包82から抽出され(ステップS15)、上述の方向指示線分825aと同様に、部分凸包821bに含まれる複数の線分825のうち最長の線分が方向指示線分825bとして特定される。そして、Y方向を基準とする方向指示線分825bの方向(例えば、Y方向と方向指示線分825bとの為す角度)が、各点列81における複数の点811のもう1つの仮配列方向として取得される(ステップS16)。   Further, the arrangement direction acquisition unit 122 extracts another partial convex hull 821b that is the other side (that is, (+ X) side) portion of the convex hull 82 in the provisional width direction from the convex hull 82 (step S15). Similarly to the above-described direction indicating line segment 825a, the longest line segment among the plurality of line segments 825 included in the partial convex hull 821b is specified as the direction indicating line segment 825b. Then, the direction of the direction indicating line segment 825b with respect to the Y direction (for example, the angle formed between the Y direction and the direction indicating line segment 825b) is set as another temporary arrangement direction of the plurality of points 811 in each point sequence 81. Obtained (step S16).

その後、方向指示線分825aから取得された仮配列方向と方向指示線分825bから取得された仮配列方向との平均値が、最終的な配列方向として取得される(ステップS17)。これにより、画像80からの点群8の読み取り時に生じる可能性がある読取誤差等による影響を抑制して配列方向を精度良く取得することができる。   Thereafter, an average value of the temporary arrangement direction acquired from the direction indicating line segment 825a and the temporary arrangement direction acquired from the direction indicating line segment 825b is acquired as a final arrangement direction (step S17). Thereby, it is possible to obtain the arrangement direction with high accuracy while suppressing the influence of the reading error or the like that may occur when the point group 8 is read from the image 80.

配列方向取得部122では、必ずしも上記平均値が最終的な配列方向とされる必要はなく、方向指示線分825aの方向および方向指示線分825bの方向である2つの仮配列方向が用いられるのであれば、他の様々な方法により最終的な配列方向が取得されてよい。例えば、凸包82の生成時に対象物9上の汚れ等を誤って点811として認識することにより、一方の方向指示線分の方向と暫定配列方向(Y方向)との為す角度が、他方の方向指示線分の方向と暫定配列方向との為す角度に比べて明らかに大きくなってしまっている場合、Y方向と為す角度が小さい方の方向指示線分の方向が最終的な配列方向として取得されてよい。   In the arrangement direction acquisition unit 122, the average value does not necessarily have to be the final arrangement direction, and two temporary arrangement directions that are the direction of the direction indicating line segment 825a and the direction of the direction indicating line segment 825b are used. If so, the final array direction may be obtained by various other methods. For example, when the convex hull 82 is generated, dirt or the like on the object 9 is mistakenly recognized as the point 811, so that the angle formed by the direction of one direction indicating line segment and the provisional arrangement direction (Y direction) is If it is clearly larger than the angle formed by the direction of the direction indicating line segment and the provisional array direction, the direction of the direction indicating line segment having the smaller angle formed by the Y direction is acquired as the final array direction. May be.

配列方向検出装置1は、例えば、印刷媒体である対象物9に印刷された暗号情報を示す点群8から暗号情報を読み取る際に利用される。図2に示す点群8では、各点列81が「0」または「1」を示し、8つの点列81により8桁のビット列からなる暗号情報が示される。点群8は、対象物9上の余白領域(すなわち、通常の画像が印刷される領域の周囲の領域)等に印刷される。点群8では、一の点列81が示す値が「0」である場合には、当該点列81における配列方向であるy方向の単位距離中に含まれる点811の個数(以下、「単位ドット数」という。)が所定の個数(以下、「ドット閾値」という。)以下とされ、当該点列81が示す値が「1」である場合には、単位ドット数がドット閾値よりも大きくされる。   The arrangement direction detection device 1 is used, for example, when reading encryption information from a point group 8 indicating encryption information printed on an object 9 that is a print medium. In the point group 8 illustrated in FIG. 2, each point sequence 81 indicates “0” or “1”, and the eight point sequences 81 indicate encryption information including an 8-digit bit sequence. The point group 8 is printed on a blank area on the object 9 (that is, an area around an area where a normal image is printed) or the like. In the point group 8, when the value indicated by one point sequence 81 is “0”, the number of points 811 included in the unit distance in the y direction that is the arrangement direction in the point sequence 81 (hereinafter, “unit”). When the value indicated by the dot sequence 81 is “1”, the number of unit dots is larger than the dot threshold. Is done.

対象物9から暗号情報が読み取られる際には、既述のように、配列方向検出装置1により、対象物9の画像80の取得、対象点群である点群8の凸包82の生成、凸包82からの部分凸包821aの抽出(すなわち、部分凸包821aの生成)、部分凸包821aに基づく仮配列方向の取得、凸包82からの部分凸包821bの抽出(すなわち、部分凸包821bの生成)、部分凸包821bに基づく仮配列方向の取得、および、2つの仮配列方向に基づく最終的な配列方向の取得(ステップS11〜S17)が行われる。   When the cryptographic information is read from the object 9, as described above, the arrangement direction detection apparatus 1 acquires the image 80 of the object 9, and generates the convex hull 82 of the point cloud 8 that is the target point cloud. Extraction of the partial convex hull 821a from the convex hull 82 (that is, generation of the partial convex hull 821a), acquisition of the temporary array direction based on the partial convex hull 821a, extraction of the partial convex hull 821b from the convex hull 82 (that is, partial convex Generation of the hull 821b), acquisition of the temporary arrangement direction based on the partial convex hull 821b, and acquisition of the final arrangement direction based on the two temporary arrangement directions (steps S11 to S17).

続いて、点群8における配列方向であるy方向が、暫定配列方向であるY方向に一致するように、y方向とY方向との為す角度だけ点群8が回転される(具体的には、点群8の各点811のXY座標系における座標が変換される)。そして、複数の点列81のそれぞれの単位ドット数がY方向に沿って計数され、単位ドット数がドット閾値と比較されて各点列81が示す値(「0」または「1」)が取得されることにより、対象物9から暗号情報が読み取られる。上記点群8の回転、各点列81の単位ドット数の計数、および、各点列81が示す値の取得は、配列方向検出装置1により行われてもよく、他の装置により行われてもよい。また、点群8の回転が行われることなく、基準となるY方向(暫定配列方向)と為す角度が既知となった配列方向に沿って各点列81の単位ドット数の計数が行われてもよい。   Subsequently, the point group 8 is rotated by an angle formed by the y direction and the Y direction so that the y direction that is the arrangement direction in the point group 8 matches the Y direction that is the provisional arrangement direction (specifically, The coordinates in the XY coordinate system of each point 811 of the point group 8 are converted). Then, the number of unit dots of each of the plurality of point rows 81 is counted along the Y direction, and the value (“0” or “1”) indicated by each point row 81 is obtained by comparing the number of unit dots with the dot threshold value. As a result, the encryption information is read from the object 9. The rotation of the point group 8, the counting of the number of unit dots in each point sequence 81, and the acquisition of the value indicated by each point sequence 81 may be performed by the arrangement direction detection device 1 or performed by another device. Also good. Further, the number of unit dots of each point array 81 is counted along the arrangement direction in which the angle formed with the reference Y direction (provisional arrangement direction) is known without rotation of the point group 8. Also good.

以上に説明したように、配列方向検出装置1では、図2に示す領域801のように、暫定配列方向に長く、かつ、その長さが点間最大距離の3倍以上である略矩形状の領域内に存在する対象点群である点群8が撮像され、点群8の画像から凸包82が生成される。このように、点群8の輪郭が上記の領域801の輪郭におよそ沿ったものとされることにより、点群8の凸包82に含まれる複数の線分825のうち、一の点列81に含まれる点811と他の点列81に含まれる点811とを結ぶ線分よりも、一の点列81に含まれる複数の点811を通る線分(すなわち、配列方向を向く線分)の方が確実に長くなる。このため、凸包82の(−X)側の部分凸包821aおよび(+X)側の部分凸包821bにそれぞれ含まれる複数の線分のうち最長の線分を方向指示線分825a,825bとして特定し、方向指示線分825a,825bのそれぞれの方向を用いて最終的な配列方向を取得することにより、点群8に含まれる点列81における複数の点811の配列方向を高精度に検出することができる。また、点群8を囲む凸包82を利用することにより、ハフ変換のように非常に多数の方向について検討することなく、配列方向を容易に検出することができる。   As described above, the arrangement direction detecting device 1 has a substantially rectangular shape that is long in the provisional arrangement direction and has a length that is at least three times the maximum point-to-point distance, as in a region 801 shown in FIG. A point group 8 that is a target point group existing in the region is imaged, and a convex hull 82 is generated from the image of the point group 8. As described above, when the outline of the point group 8 is approximately along the outline of the region 801, one point sequence 81 among the plurality of line segments 825 included in the convex hull 82 of the point group 8. A line segment that passes through a plurality of points 811 included in one point sequence 81 (that is, a line segment that faces the arrangement direction) rather than a line segment that connects the point 811 included in the point sequence and the point 811 included in another point sequence 81 Will surely be longer. Therefore, the longest line segment among the plurality of line segments included in the (−X) side partial convex hull 821a and the (+ X) side partial convex hull 821b of the convex hull 82 is defined as the direction indicating line segments 825a and 825b. By identifying and obtaining the final arrangement direction using the directions of the direction indicating line segments 825a and 825b, the arrangement direction of the plurality of points 811 in the point sequence 81 included in the point group 8 can be detected with high accuracy. can do. In addition, by using the convex hull 82 surrounding the point group 8, the arrangement direction can be easily detected without considering a very large number of directions as in the Hough transform.

配列方向検出装置1では、必ずしも点群8全体が凸包82の形成に利用される対象点群とされる必要はなく、点群8の一部が対象点群とされてもよい。換言すれば、対象点群は、点群8の少なくとも一部であればよい。点群8の一部が対象点群とされる場合、点群8のうち、図7に示すように、暫定配列方向に長く、かつ、その長さが点間最大距離の3倍以上である略矩形状の領域801a内に存在する対象点群8aが撮像部11(図1参照)により撮像される。このように、対象点群8aの輪郭が上記領域の輪郭におよそ沿ったものとされた状態で、対象点群8aの凸包82a(すなわち、対象点群8aの最も外側に位置する点を直線にて結んで形成される凸包)の部分凸包821a,821bにて特定された方向指示線分825a,825bのそれぞれの方向を用いて配列方向を取得することにより、上記と同様に、点群8に含まれる点列81(図2参照)における複数の点811の配列方向を容易かつ高精度に検出することができる。   In the arrangement direction detection device 1, the entire point group 8 does not necessarily have to be the target point group used for forming the convex hull 82, and a part of the point group 8 may be the target point group. In other words, the target point group may be at least a part of the point group 8. When a part of the point group 8 is the target point group, as shown in FIG. 7, the point group 8 is long in the provisional arrangement direction, and its length is three times or more of the maximum point-to-point distance. The target point group 8a existing in the substantially rectangular area 801a is imaged by the imaging unit 11 (see FIG. 1). In this way, the convex hull 82a of the target point group 8a (that is, the point located on the outermost side of the target point group 8a is a straight line in a state where the contour of the target point group 8a is approximately along the contour of the region. By acquiring the arrangement direction using the directions of the direction indicating line segments 825a and 825b specified by the partial convex hulls 821a and 821b of the convex hull formed by The arrangement direction of the plurality of points 811 in the point sequence 81 (see FIG. 2) included in the group 8 can be detected easily and with high accuracy.

配列方向検出装置1では、また、必ずしも部分凸包821a,821bにて特定された方向指示線分825a,825bの双方の方向を用いて配列方向が取得される必要はなく、例えば、方向指示線分825bを特定することなく、方向指示線分825aの方向が最終的な配列方向として取得されてもよい。換言すれば、図5中のステップS15〜S17が省略され、ステップS14にて求められた仮配列方向が最終的な配列方向とされる。この場合、撮像部11(図1参照)では、図8に示すように、点群8の一部であって暫定幅方向の一方側である(−X)側の部位を含む対象点群8bが撮像される。そして、対象点群8bの凸包82bの(−X)側の部分である部分凸包821aが生成され、部分凸包821aにて特定された方向指示線分825aの方向が最終的な配列方向として取得される。これにより、点群8に含まれる点列81(図2参照)における複数の点811の配列方向を容易かつ高精度に検出することができる。なお、配列方向検出装置1は、図2中のx方向に配列された点列の配列方向の検出に用いられてもよい。   In the arrangement direction detecting device 1, it is not always necessary to obtain the arrangement direction using both directions of the direction indicating line segments 825a and 825b specified by the partial convex hulls 821a and 821b. The direction of the direction indicating line segment 825a may be acquired as the final arrangement direction without specifying the minute 825b. In other words, steps S15 to S17 in FIG. 5 are omitted, and the temporary arrangement direction obtained in step S14 is the final arrangement direction. In this case, in the imaging unit 11 (see FIG. 1), as shown in FIG. 8, a target point group 8b including a part on the (−X) side that is a part of the point group 8 and is one side in the provisional width direction. Is imaged. Then, a partial convex hull 821a that is a (−X) side portion of the convex hull 82b of the target point group 8b is generated, and the direction of the direction indicating line segment 825a specified by the partial convex hull 821a is the final arrangement direction. Get as. Thereby, the arrangement direction of the plurality of points 811 in the point sequence 81 (see FIG. 2) included in the point group 8 can be detected easily and with high accuracy. Note that the arrangement direction detection apparatus 1 may be used to detect the arrangement direction of the point sequence arranged in the x direction in FIG.

配列方向検出装置1は、また、図9に示すシリコン基板である対象物9a上の複数のチップ91の画像80aにおけるチップ91の配列方向の検出にも利用されてよい。対象物9a上では、複数のチップ91が対象物9aに固定されたxy座標系のx方向およびy方向に等ピッチにて配列されており、以下では、各チップ91の重心を点811、配列方向であるy方向に配列された複数の点811を点列81、配列方向に垂直な幅方向であるx方向に配列された複数の点列81を点群8と捉えて説明する。点群8では、各点811と少なくとも他の点811とが幅方向に並んでいる。また、画像80aに固定されたXY座標系のY方向を既知の暫定配列方向と呼び、Y方向に垂直なX方向を暫定幅方向と呼ぶ。   The arrangement direction detecting device 1 may also be used for detecting the arrangement direction of the chips 91 in the images 80a of the plurality of chips 91 on the object 9a that is the silicon substrate shown in FIG. On the object 9a, a plurality of chips 91 are arranged at equal pitches in the x and y directions of the xy coordinate system fixed to the object 9a. A plurality of points 811 arranged in the y direction, which is the direction, will be described as a point sequence 81, and a plurality of point sequences 81 arranged in the x direction, which is the width direction perpendicular to the arrangement direction, will be regarded as a point group 8. In the point group 8, each point 811 and at least another point 811 are arranged in the width direction. Further, the Y direction of the XY coordinate system fixed to the image 80a is referred to as a known provisional arrangement direction, and the X direction perpendicular to the Y direction is referred to as a provisional width direction.

配列方向検出装置1では、まず、上記と同様に、点群8の(少なくとも)一部であって暫定幅方向の一方側および他方側((−X)側および(+X)側)の部位を含み、かつ、暫定配列方向に長く、その長さが点間最大距離(この場合、y方向における点811のピッチに等しい。)の3倍以上である領域内に存在する対象点群8cが撮像部11(図1参照)により撮像される。図9では、図示の都合上、対象点群8cの一部のみを描いている。続いて、撮像部11からの出力に基づいて、対象点群8cの最も外側に位置する点を直線にて結んで形成される凸包82cの暫定幅方向の一方側の部分である部分凸包821a、および、他方側の部分であるもう1つの部分凸包(図示省略)が凸包生成部121(図4参照)により生成される。   In the arrangement direction detecting device 1, first, similarly to the above, a part of (at least) part of the point group 8 on one side and the other side ((−X) side and (+ X) side) in the provisional width direction is determined. A target point group 8c existing in a region that is long in the provisional arrangement direction and whose length is three times or more the maximum distance between points (in this case, equal to the pitch of the points 811 in the y direction) is imaged. The image is taken by the unit 11 (see FIG. 1). In FIG. 9, for the convenience of illustration, only a part of the target point group 8c is drawn. Subsequently, based on the output from the imaging unit 11, a partial convex hull that is a portion on one side in the provisional width direction of the convex hull 82c formed by connecting the points located on the outermost side of the target point group 8c with a straight line. 821a and another partial convex hull (not shown) which is the other side portion are generated by the convex hull generating unit 121 (see FIG. 4).

そして、配列方向取得部122(図4参照)により、2つの部分凸包にそれぞれ含まれる複数の線分825のうち最長の線分が、方向指示線分825aおよびもう1つの方向指示線分(図示省略)として特定され、方向指示線分825aの方向ともう1つの方向指示線分の方向とを用いて最終的な配列方向が取得される。この場合も、上記と同様に、点群8に含まれる点列81における複数の点811の配列方向を容易かつ高精度に検出することができる。   Then, by the arrangement direction acquisition unit 122 (see FIG. 4), the longest line segment among the plurality of line segments 825 included in each of the two partial convex hulls is converted into a direction indicating line segment 825a and another direction indicating line segment ( The final arrangement direction is obtained using the direction of the direction indicating line segment 825a and the direction of the other direction indicating line segment. Also in this case, similarly to the above, the arrangement direction of the plurality of points 811 in the point sequence 81 included in the point group 8 can be detected easily and with high accuracy.

次に、本発明の第2の実施の形態に係る配列方向検出装置について説明する。第2の実施の形態に係る配列方向検出装置は、図1に示す配列方向検出装置1と同様の構成を備えており、以下の説明では、第2の実施の形態に係る配列方向検出装置の各構成に、図1、図3および図4に示す配列方向検出装置1の対応する構成と同符号を付す。第2の実施の形態に係る配列方向検出装置では、演算部12の固定ディスク104に、図3に示す配列方向検出プログラム1041とは異なる配列方向検出プログラムが記憶されるが、以下の説明では、第1の実施の形態と同様に、符号1041を付す。   Next, an arrangement direction detection apparatus according to the second embodiment of the present invention will be described. The arrangement direction detection apparatus according to the second embodiment has the same configuration as the arrangement direction detection apparatus 1 shown in FIG. 1, and in the following description, the arrangement direction detection apparatus according to the second embodiment Each component is assigned the same reference numeral as the corresponding component of the arrangement direction detecting device 1 shown in FIGS. In the arrangement direction detection apparatus according to the second embodiment, an arrangement direction detection program different from the arrangement direction detection program 1041 shown in FIG. 3 is stored in the fixed disk 104 of the arithmetic unit 12, but in the following description, Similar to the first embodiment, reference numeral 1041 is attached.

図10は、第2の実施の形態に係る配列方向検出装置による配列方向検出の流れを示す図である。配列方向検出装置では、上述のステップS11(図5参照)と同様に、撮像部11(図1参照)により対象物9が撮像されて、図2に示す画像80が演算部12へと送られる(ステップS21)。対象物9は、撮像部11による撮像よりも前に予め粗い姿勢調整(いわゆる、プリアライメント)が行われており、点811の配列方向であるy方向は暫定配列方向であるY方向におよそ平行となっている。   FIG. 10 is a diagram illustrating a flow of arrangement direction detection by the arrangement direction detection apparatus according to the second embodiment. In the arrangement direction detecting device, the object 9 is imaged by the imaging unit 11 (see FIG. 1) and the image 80 shown in FIG. 2 is sent to the computing unit 12 as in step S11 (see FIG. 5) described above. (Step S21). The object 9 has been subjected to coarse posture adjustment (so-called pre-alignment) before imaging by the imaging unit 11, and the y direction that is the arrangement direction of the points 811 is approximately parallel to the Y direction that is the provisional arrangement direction. It has become.

続いて、演算部12が配列方向検出プログラム1041(図3参照)に従って演算処理を実行することにより、凸包生成部121(図4参照)により、対象点群である点群8から図6に示す凸包82が生成され、配列方向取得部122(図4参照)により、凸包82の(−X)側の部分である部分凸包821aが抽出される(ステップS22,S23)。   Subsequently, when the calculation unit 12 performs calculation processing according to the arrangement direction detection program 1041 (see FIG. 3), the convex hull generation unit 121 (see FIG. 4) changes the point group 8 that is the target point group from FIG. The convex hull 82 shown is generated, and the partial convex hull 821a, which is the (−X) side portion of the convex hull 82, is extracted by the arrangement direction acquisition unit 122 (see FIG. 4) (steps S22 and S23).

本実施の形態では、上述のように、対象物9に対するプリアライメントが行われているため、一の点列81上の複数の点811を結ぶ直線の方向は、一の点列81上の点811と他の点列81上の点811とを結ぶ直線の方向よりもY方向に近くなる。そこで、配列方向取得部122により、部分凸包821aに含まれる複数の線分825のうち暫定配列方向(すなわち、図6中のY方向)と為す角度が最も小さい線分が方向指示線分825aとして特定され、暫定配列方向であるY方向を基準とする方向指示線分825aの方向(例えば、Y方向と方向指示線分825aとの為す角度)が、各点列81における複数の点811の仮配列方向として取得される(ステップS24)。   In the present embodiment, as described above, since pre-alignment with respect to the object 9 is performed, the direction of a straight line connecting a plurality of points 811 on one point sequence 81 is a point on one point sequence 81. It is closer to the Y direction than the direction of the straight line connecting 811 and the point 811 on the other point sequence 81. Therefore, by the arrangement direction acquisition unit 122, the line segment having the smallest angle with the provisional arrangement direction (that is, the Y direction in FIG. 6) among the plurality of line segments 825 included in the partial convex hull 821a is the direction indication line segment 825a. The direction of the direction indicating line segment 825a with respect to the Y direction which is the provisional arrangement direction (for example, the angle formed between the Y direction and the direction indicating line segment 825a) is defined by a plurality of points 811 in each point sequence 81. Obtained as a temporary arrangement direction (step S24).

また、凸包82の(+X)側の部分である部分凸包821bが抽出され(ステップS25)、部分凸包821bに含まれる複数の線分825のうち暫定配列方向と為す角度が最も小さい線分が方向指示線分825bとして特定され、暫定配列方向を基準とする方向指示線分825bの方向が、各点列81における複数の点811のもう1つの仮配列方向として取得される(ステップS26)。その後、第1の実施の形態と同様に、方向指示線分825aから取得された仮配列方向と方向指示線分825bから取得された仮配列方向とを用いて、最終的な配列方向が取得される(ステップS27)。   Further, the partial convex hull 821b that is the (+ X) side portion of the convex hull 82 is extracted (step S25), and the line having the smallest angle with the provisional arrangement direction among the plurality of line segments 825 included in the partial convex hull 821b is extracted. The minute is specified as the direction indicating line segment 825b, and the direction of the direction indicating line segment 825b with respect to the temporary array direction is acquired as another temporary array direction of the plurality of points 811 in each point sequence 81 (step S26). ). Thereafter, as in the first embodiment, the final arrangement direction is acquired using the temporary arrangement direction acquired from the direction indicating line segment 825a and the temporary arrangement direction acquired from the direction indicating line segment 825b. (Step S27).

第2の実施の形態に係る配列方向検出装置では、第1の実施の形態と同様に、点群8に含まれる点列81における複数の点811の配列方向を容易かつ高精度に検出することができる。配列方向検出装置では、点群8の少なくとも一部が撮像部11に撮像される対象点群とされていればよく、また、部分凸包821a,821bのうちの一方のみが生成され、当該部分凸包にて特定された方向指示線分の方向が最終的な配列方向として取得されてもよい。さらに、第1の実施の形態と同様に、図9に示すように、x方向およびy方向に等ピッチにて配列された複数の点811を有する点群8の配列方向の検出に利用されてもよい。   In the arrangement direction detection apparatus according to the second embodiment, as in the first embodiment, the arrangement direction of the plurality of points 811 in the point sequence 81 included in the point group 8 can be detected easily and with high accuracy. Can do. In the arrangement direction detection device, it is only necessary that at least a part of the point group 8 is a target point group imaged by the imaging unit 11, and only one of the partial convex hulls 821a and 821b is generated, and the part The direction of the direction indicating line segment specified by the convex hull may be acquired as the final arrangement direction. Further, as in the first embodiment, as shown in FIG. 9, it is used for detecting the arrangement direction of a point group 8 having a plurality of points 811 arranged at equal pitches in the x and y directions. Also good.

また、第1の実施の形態に係る配列方向検出プログラム、および、第2の実施の形態に係る配列方向検出プログラムが一の配列方向検出装置の演算部12の固定ディスク104に記憶され、両配列方向検出プログラムのうちの一方が選択的に用いられて配列方向の検出が行われてもよい。   The arrangement direction detection program according to the first embodiment and the arrangement direction detection program according to the second embodiment are stored in the fixed disk 104 of the arithmetic unit 12 of one arrangement direction detection device, and both arrangements are performed. One of the direction detection programs may be selectively used to detect the arrangement direction.

以上、本発明の実施の形態について説明してきたが、本発明は上記実施の形態に限定されるものではなく、様々な変更が可能である。   As mentioned above, although embodiment of this invention has been described, this invention is not limited to the said embodiment, A various change is possible.

配列方向検出装置では、撮像部11により点群8のうちの対象点群の画像(点群8全体の画像であってもよい。)が取得されるのであれば、必ずしも対象物9の全体の画像が取得される必要はない。また、撮像部11では、ラインセンサ111に代えて、例えば、2次元CCDカメラが設けられてもよい。   In the arrangement direction detection device, if an image of the target point group in the point group 8 (may be an image of the entire point group 8) is acquired by the imaging unit 11, the entire target object 9 is not necessarily acquired. An image need not be acquired. Further, in the imaging unit 11, for example, a two-dimensional CCD camera may be provided instead of the line sensor 111.

また、配列方向検出装置では、配列方向の検出精度を向上するために、一の対象物に対して上述の配列方向の検出が繰り返し行われてもよい。配列方向検出装置は、上述のような暗号情報を示す点群やシリコン基板上の複数のチップの重心に対応する点群の配列方向を検出する以外にも、様々な点群の配列方向を求める際に利用されてよい。   Further, in the arrangement direction detection device, in order to improve the detection accuracy of the arrangement direction, the above-described detection of the arrangement direction may be repeatedly performed on one object. The arrangement direction detecting device obtains the arrangement directions of various point groups in addition to detecting the arrangement direction of the point group corresponding to the center of gravity of the plurality of chips on the silicon substrate or the point group indicating the encryption information as described above. May be used when.

1 配列方向検出装置
8 点群
8a〜8c 対象点群
11 撮像部
81 点列
82,82a〜82c 凸包
121 凸包生成部
122 配列方向取得部
801,801a 領域
811 点
821a,821b 部分凸包
825 線分
825a,825b 方向指示線分
1041 配列方向検出プログラム
S11〜S17,S21〜S27 ステップ
DESCRIPTION OF SYMBOLS 1 Array direction detection apparatus 8 Point group 8a-8c Target point group 11 Imaging part 81 Point sequence 82,82a-82c Convex hull 121 Convex hull generation part 122 Arrangement direction acquisition part 801, 801a Area 811 Point 821a, 821b Partial convex hull 825 Line segment 825a, 825b Direction indication line segment 1041 Array direction detection program S11-S17, S21-S27 Step

Claims (8)

平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出装置であって、
前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含み、かつ、前記暫定配列方向に長く、その長さが前記複数の点列において前記配列方向に隣接する2つの点の間の距離の既知の最大値の3倍以上である領域内に存在する対象点群を撮像する撮像部と、
前記撮像部からの出力に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する凸包生成部と、
前記部分凸包に含まれる複数の線分のうち最長の線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する配列方向取得部と、
を備えることを特徴とする配列方向検出装置。
An array direction for detecting the array direction from a group of points each consisting of a plurality of point arrays overlapping each other in a direction perpendicular to the array direction on the plane. A detection device,
Including at least a portion of the point cloud and a portion on one side of the provisional width direction perpendicular to the provisional arrangement direction that has been found to be approximately parallel to the arrangement direction, and long in the provisional arrangement direction, An imaging unit for imaging a target point group existing in a region whose length is three times or more of a known maximum value of a distance between two points adjacent in the arrangement direction in the plurality of point sequences;
Based on the output from the imaging unit, a partial convex hull that is a portion on the one side in the provisional width direction of a convex hull formed by connecting points located on the outermost side of the target point group with a straight line is generated. A convex hull generator,
An array direction acquisition unit that identifies the longest line segment among the plurality of line segments included in the partial convex hull as a direction indicating line segment, and acquires the direction of the direction indicating line segment as the array direction;
An arrangement direction detecting device comprising:
平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出装置であって、
前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含む対象点群を撮像する撮像部と、
前記撮像部からの出力に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する凸包生成部と、
前記部分凸包に含まれる複数の線分のうち前記暫定配列方向と為す角度が最も小さい線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する配列方向取得部と、
を備えることを特徴とする配列方向検出装置。
An array direction for detecting the array direction from a group of points each consisting of a plurality of point arrays overlapping each other in a direction perpendicular to the array direction on the plane. A detection device,
An imaging unit that images a target point group that includes at least a part of the point group and includes a portion on one side in the provisional width direction perpendicular to the provisional arrangement direction that has been found to be approximately parallel to the arrangement direction;
Based on the output from the imaging unit, a partial convex hull that is a portion on the one side in the provisional width direction of a convex hull formed by connecting points located on the outermost side of the target point group with a straight line is generated. A convex hull generator,
An array direction in which a line segment having the smallest angle with the provisional array direction is specified as a direction indicating line segment among a plurality of line segments included in the partial convex hull, and the direction indicating the direction indicating line segment is acquired as the array direction An acquisition unit;
An arrangement direction detecting device comprising:
請求項1または2に記載の配列方向検出装置であって、
前記方向指示線分から取得された前記配列方向が仮に決定された配列方向であり、
前記撮像部、前記凸包生成部および前記配列方向取得部により、前記点群の前記暫定幅方向の他方側においても前記方向指示線分と同様にもう1つの方向指示線分が特定され、
前記配列方向取得部が、前記方向指示線分の方向と前記もう1つの方向指示線分の方向とを用いて最終的な前記配列方向を取得することを特徴とする配列方向検出装置。
The arrangement direction detecting device according to claim 1 or 2,
The arrangement direction acquired from the direction indicating line segment is an arrangement direction temporarily determined;
By the imaging unit, the convex hull generating unit, and the arrangement direction acquiring unit, another direction indicating line segment is specified on the other side of the provisional width direction of the point group similarly to the direction indicating line segment,
The arrangement direction detection device, wherein the arrangement direction acquisition unit acquires the final arrangement direction using the direction of the direction indication line segment and the direction of the other direction indication line segment.
請求項1ないし3のいずれかに記載の配列方向検出装置であって、
前記点群において、各点と少なくとも1つの他の点とが前記配列方向に垂直な幅方向に並ぶことを特徴とする配列方向検出装置。
The arrangement direction detecting device according to any one of claims 1 to 3,
In the point group, each point and at least one other point are arranged in a width direction perpendicular to the arrangement direction.
平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出方法であって、
a)前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含み、かつ、前記暫定配列方向に長く、その長さが前記複数の点列において前記配列方向に隣接する2つの点の間の距離の既知の最大値の3倍以上である領域内に存在する対象点群を撮像する工程と、
b)前記a)工程における撮像結果に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する工程と、
c)前記部分凸包に含まれる複数の線分のうち最長の線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する工程と、
を備えることを特徴とする配列方向検出方法。
An array direction for detecting the array direction from a group of points each consisting of a plurality of point arrays overlapping each other in a direction perpendicular to the array direction on the plane. A detection method,
a) including at least a part of the point group and a portion on one side of the provisional width direction perpendicular to the provisional arrangement direction that has been found to be approximately parallel to the arrangement direction; and in the provisional arrangement direction Imaging a target point group that is long and has a length that is three times or more of a known maximum value of a distance between two adjacent points in the arrangement direction in the plurality of point sequences;
b) A partial convex hull that is a portion on the one side in the provisional width direction of a convex hull formed by connecting points located on the outermost side of the target point group with straight lines based on the imaging result in the step a) Generating
c) identifying the longest line segment among a plurality of line segments included in the partial convex hull as a direction indicating line segment, and obtaining the direction of the direction indicating line segment as the arrangement direction;
An array direction detection method comprising:
平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出方法であって、
a)前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含む対象点群を撮像する工程と、
b)前記a)工程における撮像結果に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する工程と、
c)前記部分凸包に含まれる複数の線分のうち前記暫定配列方向と為す角度が最も小さい線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する工程と、
を備えることを特徴とする配列方向検出方法。
An array direction for detecting the array direction from a group of points each consisting of a plurality of point arrays overlapping each other in a direction perpendicular to the array direction on the plane. A detection method,
a) imaging a target point group that includes at least a part of the point group and includes a portion on one side in the provisional width direction perpendicular to the provisional arrangement direction that has been found to be approximately parallel to the arrangement direction; ,
b) A partial convex hull that is a portion on the one side in the provisional width direction of a convex hull formed by connecting points located on the outermost side of the target point group with straight lines based on the imaging result in the step a) Generating
c) A line segment having the smallest angle with the provisional arrangement direction is specified as a direction indicating line segment among a plurality of line segments included in the partial convex hull, and the direction of the direction indicating line segment is acquired as the arrangement direction. Process,
An array direction detection method comprising:
平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出プログラムであって、前記配列方向検出プログラムのコンピュータによる実行は、前記コンピュータに、
a)前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含み、かつ、前記暫定配列方向に長く、その長さが前記複数の点列において前記配列方向に隣接する2つの点の間の距離の既知の最大値の3倍以上である領域内に存在する対象点群の撮像結果を受け付ける工程と、
b)前記a)工程における撮像結果に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する工程と、
c)前記部分凸包に含まれる複数の線分のうち最長の線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する工程と、
を実行させることを特徴とする配列方向検出プログラム。
An array direction for detecting the array direction from a group of points each consisting of a plurality of point arrays overlapping each other in a direction perpendicular to the array direction on the plane. A computer program for executing the arrangement direction detection program is a detection program,
a) including at least a part of the point group and a portion on one side of the provisional width direction perpendicular to the provisional arrangement direction that has been found to be approximately parallel to the arrangement direction; and in the provisional arrangement direction The step of receiving an imaging result of a target point group that is long and has a length that is not less than three times the known maximum value of the distance between two points adjacent in the arrangement direction in the plurality of point sequences. When,
b) A partial convex hull that is a portion on the one side in the provisional width direction of a convex hull formed by connecting points located on the outermost side of the target point group with straight lines based on the imaging result in the step a) Generating
c) identifying the longest line segment among a plurality of line segments included in the partial convex hull as a direction indicating line segment, and obtaining the direction of the direction indicating line segment as the arrangement direction;
An array direction detection program characterized in that
平面上において、それぞれが所定の配列方向に点が配列された点列であり、かつ、前記配列方向に垂直な方向において互いに重なる複数の点列からなる点群から前記配列方向を検出する配列方向検出プログラムであって、前記配列方向検出プログラムのコンピュータによる実行は、前記コンピュータに、
a)前記点群の少なくとも一部であって前記配列方向におよそ平行であることが判明している暫定配列方向に垂直な暫定幅方向の一方側の部位を含む対象点群の撮像結果を受け付ける工程と、
b)前記a)工程における撮像結果に基づいて前記対象点群の最も外側に位置する点を直線にて結んで形成される凸包の前記暫定幅方向の前記一方側の部分である部分凸包を生成する工程と、
c)前記部分凸包に含まれる複数の線分のうち前記暫定配列方向と為す角度が最も小さい線分を方向指示線分として特定し、前記方向指示線分の方向を前記配列方向として取得する工程と、
を実行させることを特徴とする配列方向検出プログラム。
An array direction for detecting the array direction from a group of points each consisting of a plurality of point arrays overlapping each other in a direction perpendicular to the array direction on the plane. A computer program for executing the arrangement direction detection program is a detection program,
a) Accepting an imaging result of a target point group that includes at least a part of the point group and includes a part on one side in the provisional width direction perpendicular to the provisional arrangement direction that has been found to be approximately parallel to the arrangement direction. Process,
b) A partial convex hull that is a portion on the one side in the provisional width direction of a convex hull formed by connecting points located on the outermost side of the target point group with straight lines based on the imaging result in the step a) Generating
c) A line segment having the smallest angle with the provisional arrangement direction is specified as a direction indicating line segment among a plurality of line segments included in the partial convex hull, and the direction of the direction indicating line segment is acquired as the arrangement direction. Process,
An array direction detection program characterized in that
JP2009031395A 2009-02-13 2009-02-13 Array direction detection apparatus, array direction detection method, and array direction detection program Expired - Fee Related JP5204686B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2009031395A JP5204686B2 (en) 2009-02-13 2009-02-13 Array direction detection apparatus, array direction detection method, and array direction detection program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2009031395A JP5204686B2 (en) 2009-02-13 2009-02-13 Array direction detection apparatus, array direction detection method, and array direction detection program

Publications (2)

Publication Number Publication Date
JP2010186407A JP2010186407A (en) 2010-08-26
JP5204686B2 true JP5204686B2 (en) 2013-06-05

Family

ID=42767012

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2009031395A Expired - Fee Related JP5204686B2 (en) 2009-02-13 2009-02-13 Array direction detection apparatus, array direction detection method, and array direction detection program

Country Status (1)

Country Link
JP (1) JP5204686B2 (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2644724B2 (en) * 1985-07-12 1997-08-25 株式会社日立製作所 Document image skew correction method
JP3338537B2 (en) * 1993-12-27 2002-10-28 株式会社リコー Image tilt detector
JPH07229726A (en) * 1994-02-16 1995-08-29 Kubota Corp Method for detecting angle of object
JP4577580B2 (en) * 2007-04-10 2010-11-10 ソニー株式会社 Alignment method, alignment apparatus, and program

Also Published As

Publication number Publication date
JP2010186407A (en) 2010-08-26

Similar Documents

Publication Publication Date Title
Atcheson et al. Caltag: High precision fiducial markers for camera calibration.
JP3793100B2 (en) Information processing method, apparatus, and recording medium
TWI413937B (en) Image recognition methods and devices
US20130156268A1 (en) Image information processing apparatus and method for controlling the same
JP5447235B2 (en) Marker processing method, marker processing apparatus, and marker processing program
WO2017041600A1 (en) Chinese-sensitive code feature pattern detection method and system
JP5530752B2 (en) Instrument reading device, method, program, and computer-readable medium storing the software
CN104103069B (en) Image processing apparatus, image processing method and recording medium
JP2011007728A (en) Method, apparatus and program for defect detection
JP6496159B2 (en) Pattern inspection apparatus and pattern inspection method
JP4865844B2 (en) Two-dimensional code reading method, two-dimensional code for reading by the two-dimensional code reading method, and recording medium on which the two-dimensional code reading method is recorded
JP5204686B2 (en) Array direction detection apparatus, array direction detection method, and array direction detection program
JP4670994B2 (en) Color image processing method and image processing apparatus
JP5160366B2 (en) Pattern matching method for electronic parts
JP5329510B2 (en) Reading device, voting ticket refund device, voting ticket issuing device, and reading method
WO2018135112A1 (en) Positional-deviation-amount acquisition device, inspection device, positional-deviation-amount acquisition method, and inspection method
JP2011243138A (en) Image processing apparatus, image processing method and computer program
WO2020217970A1 (en) Wire shape measurement device, wire three-dimensional image generation method, and wire shape measurement method
JP2006292453A (en) Image recognition method
JP6355487B2 (en) Edge position detection device and edge position detection method
WO2020031980A1 (en) Method for correcting lens marker image, correcting device, program, and recording medium
KR20120134962A (en) Method for recognizing coordinate from coordinate pattern on pattern sheet
JP4670995B2 (en) Color image processing method and image processing apparatus
JP2010243209A (en) Defect inspection method and defect detection device
JP4916229B2 (en) Program, information storage medium, two-dimensional code generation system, and method for manufacturing printed matter on which two-dimensional code is printed

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20111219

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20121016

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20121025

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20121029

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20121129

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20130131

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20130215

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20160222

Year of fee payment: 3

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

LAPS Cancellation because of no payment of annual fees