JP4358918B2 - Cavity fruit judging method and device by visual inspection of Saijo - Google Patents

Cavity fruit judging method and device by visual inspection of Saijo Download PDF

Info

Publication number
JP4358918B2
JP4358918B2 JP27923598A JP27923598A JP4358918B2 JP 4358918 B2 JP4358918 B2 JP 4358918B2 JP 27923598 A JP27923598 A JP 27923598A JP 27923598 A JP27923598 A JP 27923598A JP 4358918 B2 JP4358918 B2 JP 4358918B2
Authority
JP
Japan
Prior art keywords
image
ring
fruit
saijo
hollow
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP27923598A
Other languages
Japanese (ja)
Other versions
JP2000111486A (en
Inventor
勘次 佐藤
敏広 山下
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nireco Corp
Original Assignee
Nireco Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nireco Corp filed Critical Nireco Corp
Priority to JP27923598A priority Critical patent/JP4358918B2/en
Publication of JP2000111486A publication Critical patent/JP2000111486A/en
Application granted granted Critical
Publication of JP4358918B2 publication Critical patent/JP4358918B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Description

【0001】
【発明の属する技術分野】
本発明は、西瓜の外観検査から内部の鬆の存在の有無を検出する方法と装置に関する。
【0002】
【従来の技術】
全国の農協または生産者組合の西瓜集出荷施設などでは、西瓜の品質を専門の判定員によって、外形、きず、内部の空洞などを総合的に評価している。この評価によって、西瓜に等級付けされ出荷される。西瓜の等級評価は外観に問題がある場合、例えばきず、外形などはその程度によって、明らかに減点評価できるが、内部が空洞のある空洞果の場合、熟練者による打音検査などが行われるが、その判定は極めて困難である。
【0003】
【発明が解決しようとする課題】
X線検査装置を用いて西瓜内部の透過画像を撮影すればかなり正確に鬆を検出できるが、食品にX線を照射することは消費者に悪印象を与えるため採用できない。また超音波検査でもかなり正確に鬆を検出できるが、超音波の場合、西瓜の表面に粘度の高い検査液を塗布し、検査後拭い去る必要があり、このため検査時間が長くなることと、食品にこのような検査液を塗ることは好ましくない。
【0004】
本発明は、上述の問題点に鑑みてなされたもので、外観を撮像しそのデータを解析して空洞果を検出する西瓜の外観検査による空洞果判定装置を提供することを目的とする。
【0005】
【課題を解決するための手段】
上記目的を達成するため請求項1の発明では、西瓜のつる付け根部または花落ち部を上方から照明して正反射光を撮像し、ほぼ円形に光った画像が得られるときは内部は空洞果ではないと判定し、リング状に光った画像が得られるときは空洞果と判定する。
【0006】
西瓜の内部に鬆のある空洞果実の場合、つるの付け根部と花落ち部がへこむ場合が多いのでこれらの場所の形状を調べる。これらの場所に照明を当て撮像した画像は、へこみがなく球状の場合、ほぼ円形に光った画像が得られ、へこみがある場合リング状に光った画像が得られる。このリング状の画像のときに内部に空洞果実があると判定する。
【0007】
請求項2の発明では、西瓜のつる付け根部または花落ち部を上方から照明する照明装置と、この照明装置で照明された西瓜からの正反射光を撮像する撮像装置と、この撮像装置からの画像より2値画像を生成する画像処理装置と、この2値画像に円形が表れている場合には、内部は空洞果ではないと判定し、リング状の画像が表れている場合には、内部は空洞果と判定する判定装置とを備える。
【0008】
照明装置で西瓜のつるの付け根部または花落ち部を照明し、この場所を撮像装置で撮像する。画像処理装置は撮像された画像を2値画像とし、判定装置はこの2値画像に円形が表れている場合内部は空洞果ではないと判定し、リング状の画像が表れている場合内部は空洞果と判定する。
【0009】
請求項3の発明では、前記判定装置はリング状画像の最大内径を測定し、所定の基準以上のとき空洞果であると判定する。
【0010】
リングの最大内径と鬆の大きさには相関関係があるので、このリング最大内径が所定の基準値以上のとき空洞果と判定する。
【0011】
請求項4の発明では、前記画像処理装置は前記2値画像がリングの切れた画像となっていたときは、太らせ処理によりリングになったときの画像を作成し、前記判定装置は太らせ処理によるリング状画像の最大内径を測定し、所定の基準以上とき空洞果であると判定する。
【0012】
リングが西瓜表面の凹凸により切れた状態の場合がある。このときは太らせ処理をしてリングになったときのリング最大内径を求め、この値が太らせ量を考慮した所定の基準以上のとき空洞果であると判断する。
【0013】
【発明の実施の形態】
以下、本発明の実施形態を図面を参照して説明する。
図1は本実施形態の構成を示す。西瓜1のつるの付け根部または花落ち部が上方になるようにし、この上方にリング状の照明器2を設ける。本実施形態では蛍光灯の高周波点灯装置を用いたが、この照明は特別なものは必要なく、普通の照明でよい。この照明器2は、西瓜1で正反射した光がテレビカメラ3に入射するように配置される。テレビカメラ3は西瓜1からの正反射光を撮像する。ビデオキャプチャーカード4はテレビカメラ3の撮像した画像データをアナロクデータからデジタルデータに変換しメモリに格納するもので、これを用いることにより通常のパーソナルコンピュータで画像処理が可能になる。パーソナルコンピュータ5はビデオキャプチャーカード4から画像データを読み出し、2値画像として西瓜1のつるの付け根部または花落ち部のへこみを調べ、空洞果を検出する。
【0014】
図2は鬆のない正常な西瓜1の断面図である。西瓜1は頂部のつるの付け根部11から底部の花落ち部12に縞模様が続いている。内部は通常赤い果実13の中にたね14が分散している。中に鬆15のない正常な西瓜1はつるの付け根部11と底部の花落ち部12はへこんでいない。図3は鬆のある西瓜1の断面図である。中に鬆15のある西瓜1は、つるの付け根部11と花落ち部12がへこんでいる。
【0015】
図4はへこみのない正常な西瓜のつるの付け根部11の画像を示す。つるの付け根部11は光を反射してほぼ円く光った画像となって表れる。これは花落ち部12も同様である。
【0016】
図5はへこみのある西瓜のつるの付け根部11の画像を示す。つるの付け根部11はへこみの周囲が光を反射し、へこみの部分が暗くなってリング状画像17となって表れる。これは花落ち部12も同様である。
【0017】
図6は図4、図5の画像の2値画像を示す。(A)は図4の2値画像であり、2値化のしきい値として中央の円形を他と明確に区別する値を用いる。(B)は図5の2値画像であり、2値化のしきい値として中央のリングを他と明確に区別する値を用いる。
【0018】
西瓜1のつるの付け根部11または花落ち部12が図6(A)に示すように円形の場合は内部は鬆のない正常な西瓜と判断する。また、図6(B)のようにリングの場合はリングの最大内径が所定値以上のとき空洞果(鬆のある状態)であると判断する。
【0019】
図7はリングの内径と鬆の大きさの関係を示す図である。横軸はサンプル番号を示し、縦軸は鬆の最大長さを単位mmで示す。リング内径は最大内径を示す。リング最大内径が大きくなると、鬆の最大長さも大きくなる。鬆のないサンプル1と2でも小さな内径のリングが表れている。本実施形態では最大リング内径が20mm以上の場合空洞果と判断している。しかしこの値は適宜設定することができる。
【0020】
図8はリングに切れ目がある場合の処理を示す図である。へこみ部の局部的な形状変化により、(A)に示すようにリングとならず切れ目の入った場合が表れることがある。この場合、次のいずれかにより空洞果の判断をする。
▲1▼ 切れ目にかからない位置での最大リング内径に基づき判断する。
▲2▼ (B)に示すように切れ目がなくなるまで太らせ処理し、このときの最大リング内径より太らせたことによるリング内径の減少を修正した値に基づき判断する。
▲3▼ (B)に示すように太らせ処理をし、(C)に示すように太らせた分細らせ処理をし、この状態の最大リング内径に基づき判断する。
【0021】
【発明の効果】
以上の説明より明らかなように、本発明は、西瓜のつるの付け根または花落ち部に生じるへこみと内部の鬆との関係を調べ、このへこみはリング状の画像として表れることを見い出し、このリング内径から空洞果のある西瓜を精度よく判定することができる。また西瓜に対してなんの影響も与えず、かつ迅速に判断することができるので、西瓜の出荷検査のように大量の西瓜を短時間で鬆の有無を判定するような検査には適している。
【図面の簡単な説明】
【図1】本発明の実施形態の構成を示す図である。
【図2】正常な西瓜の内部を示す図である。
【図3】鬆のある西瓜の内部を示す図である。
【図4】正常な西瓜のつるの付け根部または花落ち部の画像である。
【図5】鬆のある西瓜のつるの付け根部または花落ち部の画像である。
【図6】図4及び図5の2値画像である。
【図7】つるの付け根部または花落ち部のリング内径と鬆の大きさの関係を示す図である。
【図8】リングに切れ目のある場合の判定処理を説明する図である。
【符号の説明】
1 西瓜
2 照明器
3 テレビカメラ
4 ビデオキャプチャーカード
5 パーソナルコンピータ
11 つるの付け根部
12 花落ち部
13 果実
14 たね
15 鬆(空洞部)
16 円形画像
17 リング状画像
[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a method and an apparatus for detecting the presence or absence of internal voids from the appearance inspection of Saijo.
[0002]
[Prior art]
Agricultural cooperatives or producer associations across the country, such as Saijo Shugo shipping facilities, comprehensively evaluate the quality of Saijo by the expert judge, such as the outer shape, scratches, and internal cavities. Based on this evaluation, they are graded and shipped to Saitama. If there is a problem with the appearance of Saijo's grade, for example, scratches and outlines can be clearly deducted depending on the degree, but in the case of a hollow fruit with a hollow inside, a sound test by a skilled worker is performed. The determination is extremely difficult.
[0003]
[Problems to be solved by the invention]
X-ray inspection equipment can be used to detect a void fairly accurately by taking a transmission image of the inside of Saijo. However, irradiating food with X-rays cannot be used because it gives consumers a bad impression. In addition, ultrasonic inspection can detect the void fairly accurately, but in the case of ultrasonic, it is necessary to apply a high-viscosity test solution to the surface of Saijo and wipe it off after the test, which increases the test time. It is not preferable to apply such a test solution to food.
[0004]
The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a hollow fruit determination device based on the appearance inspection of Saijo, which captures the appearance and analyzes the data to detect the hollow fruit.
[0005]
[Means for Solving the Problems]
To achieve the above object, in the invention of claim 1, the inside when the specular reflected light imaged by illuminating the vine root portion or the flower fall of watermelon from above, an image flashed substantially circular obtained cavity It is determined that it is not a fruit, and when an image shining in a ring shape is obtained, it is determined as a hollow fruit.
[0006]
In the case of hollow fruits with a void inside the watermelon, the root of the vine and the flower fallen part often dent, so the shape of these places is examined. When the images taken by applying illumination to these places have no dent and are spherical, an image shining in a substantially circular shape is obtained, and when there is a dent, an image shining in a ring shape is obtained. It is determined that there is a hollow fruit inside the ring-shaped image.
[0007]
In invention of Claim 2, the illuminating device which illuminates the vine root part or flower fall part of a western foot from above , the imaging device which images the regular reflection light from the western foot illuminated with this illuminating device, and from this imaging device An image processing device that generates a binary image from an image, and if the circular image appears in the binary image, it is determined that the interior is not a hollow fruit, and if a ring-shaped image appears , Comprises a determination device for determining a hollow fruit.
[0008]
The base of the vine or the flower fallen part of the vine is illuminated with the lighting device, and this place is imaged with the imaging device. The image processing device converts the captured image into a binary image, and the determination device determines that the inside is not a hollow fruit when a circle appears in the binary image, and the inside is a cavity when a ring-shaped image appears. Judge as fruit.
[0009]
According to a third aspect of the present invention, the determination device measures the maximum inner diameter of the ring-shaped image, and determines that it is a hollow fruit when it exceeds a predetermined reference.
[0010]
Since there is a correlation between the maximum inner diameter of the ring and the size of the void, when the maximum inner diameter of the ring is equal to or greater than a predetermined reference value, it is determined as a hollow fruit.
[0011]
According to a fourth aspect of the present invention, when the binary image is an image with a broken ring, the image processing device creates an image when the ring is formed by a fattening process, and the determination device is fattened. The maximum inner diameter of the ring-shaped image obtained by the processing is measured, and when it exceeds a predetermined reference , it is determined that it is a hollow fruit.
[0012]
The ring may be cut off due to unevenness on the surface of the west side. At this time, the maximum inner diameter of the ring when the ring is formed by thickening is obtained, and when this value is equal to or greater than a predetermined reference considering the amount of thickening, it is determined that the fruit is a hollow fruit.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 shows the configuration of this embodiment. The root part or flower drop part of the vine of the west side 1 is made upward, and a ring-shaped illuminator 2 is provided above this. In the present embodiment, a fluorescent lamp high-frequency lighting device is used, but this illumination is not required and may be ordinary illumination. The illuminator 2 is arranged so that the light regularly reflected by the western foot 1 enters the television camera 3. The television camera 3 captures the specularly reflected light from the western foot 1. The video capture card 4 converts image data captured by the television camera 3 from analog data to digital data and stores it in a memory. By using this, image processing can be performed by a normal personal computer. The personal computer 5 reads out the image data from the video capture card 4 and examines the dents at the base of the vine or the flower fallen portion of the ridge 1 as a binary image to detect the hollow fruit.
[0014]
FIG. 2 is a cross-sectional view of a normal western ridge 1 without voids. Saijo 1 has a striped pattern from the base 11 at the top of the vine to the flower drop 12 at the bottom. Inside, usually seeds 14 are dispersed in red fruits 13. In the normal Nishimuro 1 without the void 15 inside, the base part 11 of the vine and the flower drop part 12 at the bottom are not dented. FIG. 3 is a cross-sectional view of the western wall 1 having a void. Saijo 1 with a void 15 in it has a vine root 11 and a flower drop 12 recessed.
[0015]
FIG. 4 shows an image of the base 11 of the normal vine vine without dents. The base portion 11 of the vine appears as an image that reflects light and shines almost circularly. The same applies to the flower falling part 12.
[0016]
FIG. 5 shows an image of the base 11 of the ridge of the west side with a dent. The root portion 11 of the vine reflects light around the dent, and the dent portion becomes dark and appears as a ring-shaped image 17. The same applies to the flower falling part 12.
[0017]
FIG. 6 shows a binary image of the images of FIGS. (A) is the binary image of FIG. 4, and uses a value that clearly distinguishes the central circle from the other as the threshold for binarization. (B) is the binary image of FIG. 5, and a value that clearly distinguishes the central ring from the others is used as the threshold for binarization.
[0018]
When the root part 11 or the flower drop part 12 of the vine 1 is circular as shown in FIG. 6 (A), the inside is determined to be a normal west part without voids. In the case of a ring as shown in FIG. 6B, when the maximum inner diameter of the ring is equal to or greater than a predetermined value, it is determined that the fruit is a hollow fruit (a state having a void).
[0019]
FIG. 7 is a diagram showing the relationship between the inner diameter of the ring and the size of the void. The horizontal axis indicates the sample number, and the vertical axis indicates the maximum length of the void in the unit mm. The inner diameter of the ring indicates the maximum inner diameter. As the maximum ring inner diameter increases, the maximum length of the void increases. Even in the samples 1 and 2 having no voids, a ring with a small inner diameter appears. In this embodiment, when the maximum ring inner diameter is 20 mm or more, it is determined as a hollow fruit. However, this value can be set appropriately.
[0020]
FIG. 8 is a diagram showing a process when there is a break in the ring. Due to the local shape change of the dent portion, there may be a case where a cut is formed instead of a ring as shown in (A). In this case, the hollow fruit is judged by either of the following.
(1) Judgment is made on the basis of the maximum ring inner diameter at a position where no break is formed.
{Circle around (2)} As shown in (B), thickening processing is performed until there is no break, and determination is made based on the corrected value of the decrease in the ring inner diameter caused by making it thicker than the maximum ring inner diameter at this time.
(3) A thickening process is performed as shown in (B), and a thinning process is performed as shown in (C), and a determination is made based on the maximum ring inner diameter in this state.
[0021]
【The invention's effect】
As is clear from the above explanation, the present invention investigated the relationship between the dent generated at the root of the vine or the flower drop of the west and the internal void, and found that this dent appeared as a ring-shaped image. From the inner diameter, it is possible to accurately determine the samurai with hollow fruits. In addition, because it has no effect on Saijo and it can be judged quickly, it is suitable for tests that determine the presence or absence of pores in a short time, such as Saitama's shipping inspection. .
[Brief description of the drawings]
FIG. 1 is a diagram showing a configuration of an exemplary embodiment of the present invention.
FIG. 2 is a view showing the inside of a normal Saijo.
FIG. 3 is a view showing the inside of a western wall with a void.
FIG. 4 is an image of a normal vine root or flower drop.
FIG. 5 is an image of the root or flower drop part of a vine with a void.
6 is a binary image of FIGS. 4 and 5. FIG.
FIG. 7 is a diagram showing the relationship between the inner diameter of the ring at the base of the vine or the flower drop and the size of the void.
FIG. 8 is a diagram illustrating a determination process when a ring has a break.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Saijo 2 Illuminator 3 Television camera 4 Video capture card 5 Personal computer 11 The base part of a vine 12 Flower fall part 13 Fruit 14 Seed 15 Pot (cavity part)
16 Circular image 17 Ring-shaped image

Claims (4)

西瓜のつる付け根部または花落ち部を上方から照明して正反射光を撮像し、ほぼ円形に光った画像が得られるときは内部は空洞果ではないと判定し、リング状に光った画像が得られるときは空洞果と判定することを特徴とする西瓜の外観検査による空洞果判定方法。Illuminating the vine root or flower fall part of Saijo from above and capturing specularly reflected light, when an image that is lit in a circular shape is obtained, it is determined that the inside is not a hollow fruit, and the image that shines in a ring shape Cavity fruit judging method by appearance inspection of Saijo, characterized in that when obtained, it is judged as a hollow fruit fruit. 西瓜のつる付け根部または花落ち部を上方から照明する照明装置と、
この照明装置で照明された西瓜からの正反射光を撮像する撮像装置と、
この撮像装置からの画像より2値画像を生成する画像処理装置と、
この2値画像に円形が表れている場合には、内部は空洞果ではないと判定し、リング状の画像が表れている場合には、内部は空洞果と判定する判定装置とを備えたことを特徴とする西瓜の外観検査による空洞果判定装置。
An illuminating device that illuminates the vine root or flower fall part of Saijo from above ;
An imaging device for imaging specularly reflected light from the western foot illuminated by the lighting device;
An image processing device for generating a binary image from an image from the imaging device;
When the binary image shows a circle, it is determined that the inside is not a hollow fruit, and when a ring-shaped image appears, a determination device is provided that determines that the inside is a hollow fruit. Cavity fruit judging device by appearance inspection of Saijo characterized by.
前記判定装置はリング状画像の最大内径を測定し、所定の基準以上のとき空洞果であると判定することを特徴とする請求項2記載の西瓜の外観検査による空洞果判定装置。3. The apparatus according to claim 2 , wherein the determination device measures the maximum inner diameter of the ring-shaped image and determines that the image is a hollow fruit when a predetermined reference value is exceeded. 前記画像処理装置は前記2値画像がリングの切れた画像となっていたときは、太らせ処理によりリングになったときの画像を作成し、前記判定装置は太らせ処理によるリング状画像の最大内径を測定し、所定の基準以上とき空洞果であると判定することを特徴とする請求項2記載の西瓜の外観検査による空洞果判定装置。When the binary image is an image with a ring cut, the image processing device creates an image when the ring is formed by a fattening process, and the determination device determines the maximum of the ring-shaped image by the fattening process. the inner diameter is measured, when more than a predetermined reference, the cavity result determination device according to the visual inspection of the watermelon according to claim 2, wherein determining that a cavity results.
JP27923598A 1998-10-01 1998-10-01 Cavity fruit judging method and device by visual inspection of Saijo Expired - Fee Related JP4358918B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP27923598A JP4358918B2 (en) 1998-10-01 1998-10-01 Cavity fruit judging method and device by visual inspection of Saijo

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP27923598A JP4358918B2 (en) 1998-10-01 1998-10-01 Cavity fruit judging method and device by visual inspection of Saijo

Publications (2)

Publication Number Publication Date
JP2000111486A JP2000111486A (en) 2000-04-21
JP4358918B2 true JP4358918B2 (en) 2009-11-04

Family

ID=17608329

Family Applications (1)

Application Number Title Priority Date Filing Date
JP27923598A Expired - Fee Related JP4358918B2 (en) 1998-10-01 1998-10-01 Cavity fruit judging method and device by visual inspection of Saijo

Country Status (1)

Country Link
JP (1) JP4358918B2 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3673414B2 (en) * 1998-11-24 2005-07-20 株式会社ニレコ Saijo visual inspection equipment
WO2012098682A1 (en) * 2011-01-21 2012-07-26 株式会社ニレコ Illumination device and illumination method for external quality inspection apparatus for agricultural produce
CN108370716B (en) * 2018-03-21 2020-11-20 义乌市志群拉链有限公司 Automatic watermelon picking device
JP2020101408A (en) * 2018-12-20 2020-07-02 株式会社クボタ Analysis device and analysis system

Also Published As

Publication number Publication date
JP2000111486A (en) 2000-04-21

Similar Documents

Publication Publication Date Title
Sarkar et al. Computer vision based system for quality separation of fresh market tomatoes
US5777244A (en) Method for inspecting the outer appearance of a golf ball and illuminating means used therefor
JPH06138056A (en) Method for inspecting foreign matter on solid body
JPH10505680A (en) Container flange inspection system using an annular lens
JP2007078540A (en) Visual inspection method and visual inspection device
AU2006233232A1 (en) Diagnosing or determining parameters for an installation for detecting open defects in the surfaces of parts by sweating
JP2018169605A (en) Device and method for inspecting contact lenses in plastic shell
JP4358918B2 (en) Cavity fruit judging method and device by visual inspection of Saijo
JP2015094644A (en) Egg appearance inspection apparatus and method
JP2002536633A (en) Lens inspection device
JP3632449B2 (en) Cream solder application state inspection device and application state inspection method
JP6772071B2 (en) Inspection equipment
JP4321696B2 (en) Inspection area setting method for container inspection
JPH09311020A (en) Inspection apparatus for protruding part
JPH0634574A (en) Bottle inspector
JP2010204051A (en) Inspection apparatus and inspection method
JP4184511B2 (en) Method and apparatus for defect inspection of metal sample surface
JP2001021490A (en) Non-destructive inspection method and device for detecting embryo in egg in brown chicken egg
JPH09312317A (en) Flip chip junction inspection method and device
JPH0926311A (en) Visual inspection apparatus
JP3810599B2 (en) Defect detection device
JP3012602B2 (en) Surface defect inspection equipment
JPH0862155A (en) Object 0bserving apparatus
JP3047168B2 (en) Inspection method of chicken eggs
JP3461136B2 (en) Tablet visual inspection device and PTP packaging machine

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20050207

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20071022

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20080827

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20081017

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20090804

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20090807

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120814

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120814

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20150814

Year of fee payment: 6

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees