JP2947141B2 - Weed recognition device for weeding robot - Google Patents

Weed recognition device for weeding robot

Info

Publication number
JP2947141B2
JP2947141B2 JP26200395A JP26200395A JP2947141B2 JP 2947141 B2 JP2947141 B2 JP 2947141B2 JP 26200395 A JP26200395 A JP 26200395A JP 26200395 A JP26200395 A JP 26200395A JP 2947141 B2 JP2947141 B2 JP 2947141B2
Authority
JP
Japan
Prior art keywords
weed
distance
area
weeds
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP26200395A
Other languages
Japanese (ja)
Other versions
JPH0981750A (en
Inventor
誠一 有馬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Iseki and Co Ltd
Original Assignee
Iseki and Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Iseki and Co Ltd filed Critical Iseki and Co Ltd
Priority to JP26200395A priority Critical patent/JP2947141B2/en
Publication of JPH0981750A publication Critical patent/JPH0981750A/en
Application granted granted Critical
Publication of JP2947141B2 publication Critical patent/JP2947141B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Catching Or Destruction (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【0001】[0001]

【発明の属する技術分野】本発明は、個々の形態認識に
は着目せず、群全体の特徴をパターンとして認識するテ
クスチャ解析手法により、TVカメラで撮影した画像に
現れる規則的な模様パターンを解析して雑草の有無を認
識する除草ロボットの雑草認識装置に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention analyzes a regular pattern pattern appearing in an image photographed by a TV camera by a texture analysis method which recognizes the features of the entire group as a pattern without focusing on individual form recognition. The present invention relates to a weed recognition device for a weeding robot that recognizes the presence or absence of weeds.

【0002】図2はTVカメラで撮影した画像から、雑
草しか写っていない部分を抽出した画像例であり、図3
は図2中の観測線aにおける濃度値をプロットした図表
である。図4はTVカメラで撮影した画像から、芝しか
写っていない部分を抽出した画像例であり、図5は図4
中の観測線bにおける濃度値をプロットした図表であ
る。これらの画像には、それぞれ特有の模様パターンが
現れ、芝の場合は特に白黒の変化が激しい。また、観測
線aおよび観測線bにおける濃度値をプロットした図表
では、同じ濃度値に属する画素間の距離に差があり、雑
草の場合は特に画素間の距離のばらつきが大きい。本発
明の雑草認識装置は、雑草についてはこの同じ濃度値に
属する画素間の距離に差がでるという知見から、芝など
に混生する雑草の有無を認識するものである。
FIG. 2 shows an example of an image obtained by extracting a portion showing only weeds from an image taken by a TV camera.
3 is a chart in which the density values at the observation line a in FIG. 2 are plotted. FIG. 4 shows an example of an image obtained by extracting a portion showing only grass from an image taken by a TV camera, and FIG.
It is the chart which plotted the density value in observation line b inside. Each of these images has a unique pattern, and in the case of turf, black and white change is particularly severe. Further, in the chart in which the density values on the observation line a and the observation line b are plotted, there is a difference in the distance between pixels belonging to the same density value, and in the case of weeds, the variation in the distance between pixels is particularly large. The weed recognition device of the present invention recognizes the presence or absence of weeds mixed in grass or the like from the knowledge that the distance between pixels belonging to the same density value is different for weeds.

【0003】[0003]

【発明が解決しようとする課題】除草剤の使用に当って
は、芝などの主作物に害を与えてはならない。このた
め、除草剤を使用して雑草を除去する除草ロボットは、
除草剤を注入する範囲を最小限に抑制する都合上、雑草
の生えている場所を狭い範囲に特定する必要がある。
The use of herbicides must not harm main crops such as turf. For this reason, weeding robots that remove weeds using herbicides
In order to minimize the area where the herbicide is injected, it is necessary to specify the place where the weeds grow in a narrow area.

【0004】本発明は、除草ロボットが除草剤を注入す
る場所を特定するために必要な面積単位まで画像エリア
を細分化し、各細分エリアでの雑草の有無を判定して雑
草の有るエリアを特定することを目的とする。
According to the present invention, an image area is subdivided into area units necessary for specifying a place where a herbicide is to be injected by a herbicide, and the presence or absence of a weed in each subdivision area is determined to specify an area containing a weed. The purpose is to do.

【0005】[0005]

【課題を解決するための手段】かかる目的を達成するた
めに、本発明は以下のように構成した。
In order to achieve the above object, the present invention is configured as follows.

【0006】すなわち、TVカメラで撮影した画像に現
れる規則的な模様パターンを解析して雑草の有無を認識
するものにおいて、前記画像の全濃度値を複数段階の濃
度値レベルに区分する濃度値レベル区分手段と、前記画
像を複数領域の細分エリアに均等分割するエリア分割手
段と、前記細分エリア毎に同じ濃度値レベルに属する画
素群の基準点間距離を計算する画素間距離計算手段と、
前記画素間の距離のばらつきを計算する距離のばらつき
計算手段と、前記距離のばらつきの大小により各細分エ
リアについて雑草の有無を判定する雑草有無判定手段
と、を備え、前記雑草有無判定手段が雑草有りと判定し
た細分エリアをさらに分割し、分割後の細分エリアにつ
いて分割前の細分エリアと同様に雑草の有無を判定し、
雑草有りと判定した細分エリアをさらに分割するという
操作を任意の回数繰り返すことにより、前記TVカメラ
で撮影した画像を任意の回数分割した細分エリアについ
て雑草の有無を判定し、これにより雑草の有るエリアを
識別することを特徴とする除草ロボットの雑草認識装置
である。
That is, in a system in which a regular pattern pattern appearing in an image captured by a TV camera is analyzed to recognize the presence or absence of weeds, a density value level in which all density values of the image are divided into a plurality of density value levels Classifying means, area dividing means for equally dividing the image into a plurality of sub-areas, and inter-pixel distance calculating means for calculating a distance between reference points of a group of pixels belonging to the same density value level for each of the sub-areas;
A distance variation calculating unit that calculates a variation in the distance between the pixels; and a weed presence determining unit that determines the presence or absence of a weed in each subdivided area according to the magnitude of the variation in the distance. The subdivision area determined to be present is further divided, and the presence or absence of weeds is determined for the subdivision area after division in the same manner as the subdivision area before division.
By repeating the operation of further dividing the subdivided area determined to have weeds an arbitrary number of times, the presence or absence of weeds is determined for the subdivided areas obtained by dividing the image taken by the TV camera any number of times, and thereby the area containing the weeds is determined. And a weed recognition device for a weeding robot.

【0007】[0007]

【発明の実施の形態】以下に図面を参照して本発明の実
施の形態について説明する。
Embodiments of the present invention will be described below with reference to the drawings.

【0008】図1は本発明の雑草認識装置のブロック図
である。本発明の雑草認識装置は、TVカメラの画像を
入力して画像の全濃度値を複数段階の濃度値レベルに区
分する濃度値レベル区分手段1と、同じくTVカメラの
画像を入力して画像を複数領域の細分エリアに均等分割
するエリア分割手段2と、この細分エリア毎に同じ濃度
値レベルに属する画素群の基準点(中心点など)間距離
を計算する画素間距離計算手段3と、この画素間の距離
のばらつきを計算する距離のばらつき計算手段4と、こ
の距離のばらつきの大小により雑草の有無を判定する雑
草有無判定手段6とで構成される。
FIG. 1 is a block diagram of a weed recognition apparatus according to the present invention. The weed recognition device of the present invention includes a density value level classifying unit 1 for inputting an image of a TV camera and classifying all the density values of the image into a plurality of density value levels, and similarly inputting an image of the TV camera to convert the image. An area dividing means 2 for equally dividing into a plurality of subdivided areas; an inter-pixel distance calculating means 3 for calculating a distance between reference points (such as center points) of a group of pixels belonging to the same density value level for each subdivided area; It is composed of a distance variation calculating means 4 for calculating a variation in the distance between pixels, and a weed presence determining means 6 for determining the presence or absence of a weed based on the magnitude of the variation in the distance.

【0009】本発明の雑草認識装置は以上のような構成
で、TVカメラの画像を入力し、濃度値レベル区分手段
1において前記画像の全濃度値を数十段階の濃度値レベ
ルに区分する。次に、前記TVカメラの画像をエリア分
割手段2において数十領域の細分エリアに均等分割す
る。そして、以下の処理を前記の各細分エリアについて
行う。
The weed recognizing device of the present invention is configured as described above, receives an image from a TV camera, and classifies all the density values of the image into several tens of density value levels by the density value level dividing means 1. Next, the image of the TV camera is equally divided by the area dividing means 2 into several tens of subdivided areas. Then, the following processing is performed for each of the above-described subdivision areas.

【0010】まず、画素間距離計算手段3において前記
の各細分エリア毎に同じ濃度値レベルに属する画素群の
基準点間距離を計算する。そして、距離のばらつき計算
手段4において前記画素間の距離のばらつきを計算す
る。最後に、雑草有無判定手段6において前記距離のば
らつき計算手段5が計算した距離のばらつきと、あらか
じめ記憶した芝などの主作物しか写っていない画像の距
離のばらつきとを比較し、その大小により雑草の有無を
判定する。
First, the inter-pixel distance calculating means 3 calculates the distance between the reference points of the pixels belonging to the same density value level for each of the above-described subdivision areas. Then, the distance variation calculating means 4 calculates the variation in the distance between the pixels. Finally, the weed presence determining means 6 compares the distance variation calculated by the distance variation calculating means 5 with the distance variation of an image of only the main crop such as turf, which is stored in advance, and determines the size of the weed. Is determined.

【0011】ここで、図6に示すように、雑草有りと判
定した細分エリアについては、さらにその細分エリアを
数十領域に均等分割し、各細分エリアについて、以上説
明した同じ濃度値レベルに属する画素間の距離計算から
雑草の有無判定までの処理を繰返し行う。
Here, as shown in FIG. 6, for the subdivided area determined to have a weed, the subdivided area is further equally divided into several tens of areas, and each subdivided area belongs to the same density value level described above. The process from calculating the distance between pixels to determining the presence or absence of weeds is repeated.

【0012】以上の処理を行って、雑草有りと判定した
細分エリアを除草ロボットが除草剤を注入する場所を特
定するために必要な最小面積まで細分化し、画像エリア
における全ての雑草の有る細分エリアを特定した時点で
処理を終了する。
By performing the above processing, the subdivision area determined to have a weed is subdivided into a minimum area necessary for specifying the place where the herbicide injects the herbicide, and the subdivision area including all the weeds in the image area is obtained. The processing is terminated at the point in time when is specified.

【0013】TVカメラで撮影した画像の葉や土、陰な
どの部分の画素はほとんど同じ濃度値を示す。従って、
これらの部分で同じ濃度値レベルに属する画素間の距離
を計算すると大部分の場合その答えは「1」となり、画
素間の距離にばらつきがなく、模様パターンを認識する
ことができない。
[0013] Pixels in parts such as leaves, soil, and shades of an image captured by a TV camera have almost the same density value. Therefore,
When the distance between pixels belonging to the same density value level is calculated in these portions, the answer is "1" in most cases, and the distance between pixels does not vary, and the pattern pattern cannot be recognized.

【0014】このための対策として、同じ濃度値レベル
に属する近傍の画素群に同じ番号のラベルを付け、この
ラベルの番号が同じものどうしの基準点間の距離を計算
してそのばらつきを求めると、適切な模様パターンを認
識することができる。
As a countermeasure for this, a group of neighboring pixels belonging to the same density value level is labeled with the same number, and the distance between reference points having the same label number is calculated to obtain the variation. , An appropriate pattern pattern can be recognized.

【0015】このラベル処理について以下に説明する。
まず、図7に示すように、画像の全濃度値を数段階の濃
度値レベルに区分してそれぞれにA,B,C・・・のよ
うなラベル名を付ける。次に、この画像を数十領域の細
分エリアに均等分割し、以下の処理をこの各細分エリア
について行う。
The label processing will be described below.
First, as shown in FIG. 7, all density values of an image are divided into several density value levels, and label names such as A, B, C. Next, this image is equally divided into several tens of sub-areas, and the following processing is performed on each of the sub-areas.

【0016】まず、図8に示すように、細分エリアの各
画素に対して、8近傍に同じ濃度値レベルに属する画素
があれば、それらに同じラベル名を付ける。そして、図
9に示すように、ラベルによって色分けされた細分エリ
アに対し、同じラベル名どうしの基準点間の距離を計算
してそのばらつきを求める。以下、その大小により雑草
の有無を判定する。
First, as shown in FIG. 8, for each pixel in the subdivision area, if there is a pixel belonging to the same density value level in the vicinity of 8, the same label name is assigned to each pixel. Then, as shown in FIG. 9, the distance between the reference points having the same label name is calculated for the subdivision areas color-coded by the labels, and the variation is calculated. Hereinafter, the presence or absence of weeds is determined based on the size.

【0017】[0017]

【発明の効果】本発明の雑草認識装置は、画像の全濃度
値を複数段階の濃度値レベルに区分する濃度値レベル区
分手段と、前記画像を複数領域の細分エリアに均等分割
するエリア分割手段と、前記細分エリア毎に同じ濃度値
レベルに属する画素群の基準点間距離を計算する画素間
距離計算手段と、前記画素間の距離のばらつきを計算す
る距離のばらつき計算手段と、前記距離のばらつきの大
小により各細分エリアについて雑草の有無を判定する雑
草有無判定手段と、を備え、前記雑草有無判定手段が雑
草有りと判定した細分エリアをさらに分割し、分割後の
細分エリアについて分割前の細分エリアと同様に雑草の
有無を判定し、雑草有りと判定した細分エリアをさらに
分割するという操作を任意の回数繰り返すことにより、
前記TVカメラで撮影した画像を任意の回数分割した細
分エリアについて雑草の有無を判定し、これにより雑草
の有るエリアを識別する。従って、フィルタを要した
り、近赤外領域に感度を要するような特殊なカメラを必
要とせず、一般民生用のカメラを使用できるので、除草
ロボットのコストダウンが図れる。また、雑草の周辺が
土や芝のいずれの場合でも、同じ濃度値レベルに属する
画素間の距離に差がでるため、雑草を識別できるという
効果を奏する。
The weed recognition apparatus according to the present invention comprises a density value classifying means for classifying all density values of an image into a plurality of density value levels, and an area dividing means for equally dividing the image into a plurality of subdivided areas. An inter-pixel distance calculation unit that calculates a distance between reference points of a pixel group belonging to the same density value level for each of the subdivision areas; a distance variation calculation unit that calculates a variation in the distance between the pixels; Weed presence / absence determination means for determining the presence or absence of weeds for each subdivision area according to the magnitude of the variation, further dividing the subdivision area determined to have weeds by the weed presence / absence determination means, By repeating the operation of determining the presence or absence of weeds in the same manner as the subdivision area and further dividing the subdivision area determined to have the weed, an arbitrary number of times,
The presence / absence of weeds is determined for a subdivided area obtained by dividing the image captured by the TV camera an arbitrary number of times, thereby identifying an area having weeds. Therefore, a camera for general use can be used without requiring a filter or a special camera requiring sensitivity in the near infrared region, so that the cost of the weeding robot can be reduced. Also, regardless of whether the surroundings of the weed are soil or grass, there is a difference in the distance between the pixels belonging to the same density value level, so that there is an effect that the weed can be identified.

【図面の簡単な説明】[Brief description of the drawings]

【図1】本発明の実施の形態の雑草認識装置のブロック
図である。
FIG. 1 is a block diagram of a weed recognition device according to an embodiment of the present invention.

【図2】芝しか写っていない部分を抽出した画像例であ
る。
FIG. 2 is an example of an image in which a portion where only grass is photographed is extracted.

【図3】図2の線aの濃度値をプロットした図表であ
る。
FIG. 3 is a table in which density values of a line a in FIG. 2 are plotted.

【図4】雑草しか写っていない部分を抽出した画像例で
ある。
FIG. 4 is an example of an image in which a portion showing only weeds is extracted.

【図5】図4の線bの濃度値をプロットした図表であ
る。
FIG. 5 is a table in which density values of a line b in FIG. 4 are plotted.

【図6】細分エリアを均等分割して雑草の有無判定を行
う処理の説明図である。
FIG. 6 is an explanatory diagram of processing for equally dividing a subdivision area to determine the presence or absence of a weed;

【図7】画像の全濃度値を数段階の濃度値レベルに区分
した例である。
FIG. 7 is an example in which all density values of an image are divided into several levels of density values.

【図8】8近傍の同じ濃度値レベルに属する画素に同じ
ラベル名を付た例である。
FIG. 8 is an example in which pixels belonging to the same density value level near eight have the same label name.

【図9】ラベルによって色分けされた細分エリアの例で
ある。
FIG. 9 is an example of a subdivision area color-coded by a label.

【符号の説明】[Explanation of symbols]

1 濃度値レベル区分手段 2 エリア分割手段 3 画素間距離計算手段 4 距離のばらつき計算手段 5 雑草有無判定手段 DESCRIPTION OF REFERENCE NUMERALS 1 density value level dividing means 2 area dividing means 3 inter-pixel distance calculating means 4 distance variation calculating means 5 weed existence determining means

───────────────────────────────────────────────────── フロントページの続き (58)調査した分野(Int.Cl.6,DB名) G06T 7/00 A01M 7/00 G06T 1/00 ──────────────────────────────────────────────────続 き Continued on the front page (58) Fields surveyed (Int. Cl. 6 , DB name) G06T 7/00 A01M 7/00 G06T 1/00

Claims (1)

(57)【特許請求の範囲】(57) [Claims] 【請求項1】 TVカメラで撮影した画像に現れる規則
的な模様パターンを解析して雑草の有無を認識するもの
において、 前記画像の全濃度値を複数段階の濃度値レベルに区分す
る濃度値レベル区分手段と、 前記画像を複数領域の細分エリアに均等分割するエリア
分割手段と、 前記細分エリア毎に同じ濃度値レベルに属する画素群の
基準点間距離を計算する画素間距離計算手段と、 前記画素間の距離のばらつきを計算する距離のばらつき
計算手段と、 前記距離のばらつきの大小により各細分エリアについて
雑草の有無を判定する雑草有無判定手段と、 を備え、 前記雑草有無判定手段が雑草有りと判定した細分エリア
をさらに分割し、分割後の細分エリアについて分割前の
細分エリアと同様に雑草の有無を判定し、雑草有りと判
定した細分エリアをさらに分割するという操作を任意の
回数繰り返すことにより、前記TVカメラで撮影した画
像を任意の回数分割した細分エリアについて雑草の有無
を判定し、これにより雑草の有るエリアを識別すること
を特徴とする除草ロボットの雑草認識装置。
1. A method for recognizing the presence or absence of weeds by analyzing a regular pattern pattern appearing in an image photographed by a TV camera, wherein a density value level for dividing all density values of the image into a plurality of density value levels Classifying means; area dividing means for equally dividing the image into a plurality of sub-areas; inter-pixel distance calculating means for calculating a distance between reference points of a group of pixels belonging to the same density value level for each of the sub-areas; A distance variation calculating means for calculating a variation in the distance between pixels; and a weed presence determining means for determining the presence or absence of a weed in each of the subdivided areas based on the magnitude of the variation in the distance, wherein the weed presence determining means has a weed. The subdivision area determined as above is further divided, and the presence or absence of weeds is determined for the divided subdivision area in the same manner as the subdivision area before division, and By repeating the operation of further dividing the rear any number of times, it is possible to determine the presence or absence of weeds in the subdivided area obtained by dividing the image taken by the TV camera any number of times, thereby identifying an area having weeds. Weed recognition device of a weeding robot.
JP26200395A 1995-09-18 1995-09-18 Weed recognition device for weeding robot Expired - Fee Related JP2947141B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP26200395A JP2947141B2 (en) 1995-09-18 1995-09-18 Weed recognition device for weeding robot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP26200395A JP2947141B2 (en) 1995-09-18 1995-09-18 Weed recognition device for weeding robot

Publications (2)

Publication Number Publication Date
JPH0981750A JPH0981750A (en) 1997-03-28
JP2947141B2 true JP2947141B2 (en) 1999-09-13

Family

ID=17369668

Family Applications (1)

Application Number Title Priority Date Filing Date
JP26200395A Expired - Fee Related JP2947141B2 (en) 1995-09-18 1995-09-18 Weed recognition device for weeding robot

Country Status (1)

Country Link
JP (1) JP2947141B2 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2014045950A1 (en) * 2012-09-20 2016-08-18 日本電気株式会社 Image processing system, image processing method, and program
KR102191426B1 (en) * 2013-10-07 2020-12-15 한국전자통신연구원 Mowing Robot's Mowing Boundary Area and Weed Length Recognition Apparatus and the Method
US10681905B2 (en) * 2015-07-02 2020-06-16 Ecorobotix Sa Robot vehicle and method using a robot for an automatic treatment of vegetable organisms

Also Published As

Publication number Publication date
JPH0981750A (en) 1997-03-28

Similar Documents

Publication Publication Date Title
Sujaritha et al. Weed detecting robot in sugarcane fields using fuzzy real time classifier
US5425108A (en) Mobile type of automatic identification system for a car plate
Vaillant et al. Original approach for the localisation of objects in images
EP0555380B1 (en) A face recognition system
US5606821A (en) Smart weed recognition/classification system
KR100586277B1 (en) Non-literal pattern recognition method and system for hyperspectral imagery exploitation
EA039345B1 (en) Method for aerial imagery acquisition and analysis
ZA202300610B (en) System and method for crop monitoring
US20060095207A1 (en) Obstacle detection using stereo vision
US20100215214A1 (en) Image processing method
CN114818909B (en) Weed detection method and device based on crop growth characteristics
Gondal et al. Early pest detection from crop using image processing and computational intelligence
Chen et al. Machine vision for a micro weeding robot in a paddy field
de Silva et al. Towards agricultural autonomy: crop row detection under varying field conditions using deep learning
Steward et al. Machine-vision weed density estimation for real-time, outdoor lighting conditions
CN115171361B (en) Dangerous behavior intelligent detection and early warning method based on computer vision
CN113095441A (en) Pig herd bundling detection method, device, equipment and readable storage medium
JP2947141B2 (en) Weed recognition device for weeding robot
CN112541383B (en) Method and device for identifying weed area
JP2000057355A (en) Area extracting device and image processor
Habib et al. Wavelet frequency transformation for specific weeds recognition
CN114943720A (en) Electric power image processing method and device
Zeng et al. Categorical color projection for robot road following
CN115700805A (en) Plant height detection method, device, equipment and storage medium
JP3517518B2 (en) Object detection device

Legal Events

Date Code Title Description
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 19990601

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110702

Year of fee payment: 12

LAPS Cancellation because of no payment of annual fees