JPS6155787A - Fruits recognition device - Google Patents

Fruits recognition device

Info

Publication number
JPS6155787A
JPS6155787A JP59177888A JP17788884A JPS6155787A JP S6155787 A JPS6155787 A JP S6155787A JP 59177888 A JP59177888 A JP 59177888A JP 17788884 A JP17788884 A JP 17788884A JP S6155787 A JPS6155787 A JP S6155787A
Authority
JP
Japan
Prior art keywords
fruit
shutter
closing
opening
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP59177888A
Other languages
Japanese (ja)
Inventor
Masahiko Hayashi
正彦 林
Yasuo Fujii
保生 藤井
Shigeaki Okuyama
奥山 恵昭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kubota Corp
Original Assignee
Kubota Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kubota Corp filed Critical Kubota Corp
Priority to JP59177888A priority Critical patent/JPS6155787A/en
Publication of JPS6155787A publication Critical patent/JPS6155787A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147Details of sensors, e.g. sensor lenses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/68Food, e.g. fruit or vegetables

Abstract

PURPOSE:To decrease an influence of an outside light and reduce a quantity of irradiated light making a color temperature constant by providing a means for opening and closing light incident to a monitor camera and synchronizing an irradiation by an irradiating means with the opening and closing of light incident to the camera. CONSTITUTION:A monitor camera 1 using a color video camera incorporating a shutter 2 is provided with a stroboscope 3 as an irradiating means and a shutter controller 4 for controlling a shutter speed. By a trigger signal TG of the stroboscope 3, an opening and a closing of the shutter 2 by the shutter controller 4 are synchronized, and by opening and closing the shutter 2 simultaneously with the irradiation by the stroboscope 3, a fruit of an object to be taken a picture can be taken a picture with a constant brightness. A color image signal for one frame taken a picture by the monitor camera 1 is converted into a binary signal corresponding only to the fruit by a color identifying device 5 and stored in a frame memory 6. The result is displayed by a monitor television 7, and at the same time, a processing such as a fruit position detection is done to obtain a fruit recognition device capable of automatically separating and discriminating from other objects.

Description

【発明の詳細な説明】 〔産業上の利用分野〕 本発明は、果実認識装置、詳しくは、モニタカメラから
得られる画像信号よル果実にべ応する特定色の信号を分
離してコ値化すること忙よりて果実のみに対応した2m
化画像信号を得るぺ〈構成された果実認識装置に関する
[Detailed Description of the Invention] [Field of Industrial Application] The present invention relates to a fruit recognition device, more specifically, to a fruit recognition device, which separates a signal of a specific color corresponding to a fruit from an image signal obtained from a monitor camera and converts it into a co-value. 2m suitable for fruit only due to busy schedule
The present invention relates to a fruit recognition device configured to obtain a converted image signal.

〔従来の技術〕[Conventional technology]

従来より上記この種の果実認識装置においては、撮像さ
れた画像信号の色に基いて果実とその他の物体とを分S
識別するものであることから画像信号の色レベルが安定
していないと果実の認識が不正確になるという欠点があ
〕、太陽光等の外光の影響による色温度変化を除去しな
ければ、本出順人が既に提案しである果実収穫用コボッ
トハンドのセンサ等の屋外で使用される機器のセンサと
しては使用できないものであった。  ′ そこで、上記外光の影響を除去すべく、木出頭人は、ス
トロボ等の一定の光量の光を撮像対象に向けて照光する
手段を設けて、撮像時の明るさをある程度一定にする手
段を既に提案しである(特願昭59−1)5402号参
照)。
Conventionally, this type of fruit recognition device described above has been able to distinguish fruits from other objects based on the color of the captured image signal.
Since it is used for identification, there is a drawback that fruit recognition will be inaccurate if the color level of the image signal is not stable. It could not be used as a sensor for equipment used outdoors, such as the sensor for a cobot hand for fruit harvesting that Junto Motode had already proposed. ' Therefore, in order to eliminate the influence of the external light mentioned above, Mr. Kinide provided a means to illuminate the object with a constant amount of light, such as a strobe, to keep the brightness constant to a certain extent during imaging. has already been proposed (see Japanese Patent Application No. 5402).

〔発明が解決しようとする問題点〕[Problem that the invention seeks to solve]

しかしながら、上記照光手段を設ける場合であっでも、
十分ではなく、改善の余地があった。
However, even when the above-mentioned illumination means is provided,
It wasn't good enough and there was room for improvement.

即ち、モニタカメラによる撮像は連続的に村なう必要が
無いので、照光手段としては通常ストロボ等の短時間で
はあるが一定の光量の光を照光できるものでよいのであ
るが、モニタカメラは一画面分(/フイイードル)の画
像を出力するためにはその構成上//≦O秒程度全程度
る。
In other words, since there is no need to take images continuously with a monitor camera, the illumination means can normally be anything that can emit a constant amount of light for a short period of time, such as a strobe. Due to its configuration, it takes approximately 0 seconds to output an image for a screen (/feedle).

従って、上記照光手段はカメラが7フイ一ルド分の撮像
に要する1740秒間照光するか、あるいはそれよりも
短時間(例えば/ / 1000秒)ではあるが非常に
大きな光量で照光し、カメラの絞りを大きく絞夛込んで
使用する必要が生じる。
Therefore, the above-mentioned illumination means illuminates for the 1740 seconds required for the camera to take an image of 7 fields, or it illuminates for a shorter period of time (e.g. / / 1000 seconds) but with a very large amount of light, and the aperture of the camera is It becomes necessary to use it with a large concentration.

その結果、上記照光手段は必要以上の光量を発光しなけ
ればならないなめにその電源装置等が大型化し、ま次男
使用のための充電時間が長くなって、発光間隔が長くな
るという不都合が有った。
As a result, the above-mentioned illumination means has to emit a greater amount of light than is necessary, resulting in an increase in the size of its power supply device, etc., which results in the inconvenience that the charging time for the second son's use becomes longer and the interval between lights emitted becomes longer. Ta.

本発明は、上記実情に鑑みてなさ九九ものであって、そ
の目的は、撮像された画像の色に基いて果実を認識する
装置において、外光の影響を除去するに、不必要に大き
な光量の照光手段を用いなくても安定した色レベルの画
像信号が得られる手段を備えた果実認識装置を提供する
ことにちる。
The present invention has been made in view of the above-mentioned circumstances, and its purpose is to eliminate the influence of external light in a device that recognizes fruits based on the color of a captured image. It is an object of the present invention to provide a fruit recognition device equipped with a means for obtaining an image signal of a stable color level without using an illumination means with a large amount of light.

〔問題点を解決するための手段〕[Means for solving problems]

上記問題を解決すべく、本発明による果実認識装置は、
前記モニタカメラによる撮像方向を所定の光量で照光す
る手段、および、lI前記モニタカメラに入射される光
を開閉する手段を設け、[i1E照光手段による照光と
開閉手段によるカメラへの入射光開閉とを同期して行な
うべく制御する手段を設けである点に特徴を有し、その
作用並ひく効果は以下の通シである。
In order to solve the above problem, the fruit recognition device according to the present invention has the following features:
A means for illuminating the imaging direction by the monitor camera with a predetermined amount of light, and a means for opening and closing the light incident on the monitor camera are provided; The present invention is characterized in that it is provided with means for controlling so as to perform them synchronously, and its functions and effects are as follows.

〔作 用〕[For production]

即ち、撮像対象への照光とカメラへの入射光開閉すなわ
ち露光とを同期して行なうのである。
In other words, the illumination of the object to be imaged and the opening/closing of the light incident on the camera, that is, the exposure, are performed in synchronization.

〔発明の効果〕〔Effect of the invention〕

上記特徴故に、下記の如き優れた効果が発揮されるに至
った。
Because of the above characteristics, the following excellent effects have been achieved.

即ち゛、撮像対象への照光とカメラの露光とを同期して
行なうので、照光している時間の間のみ露光を行なうこ
とができる。 従って、外光の影響例えばブルーミング
等が非常に少ない状部でカメラの絞)を十分く開けるこ
とができることから、色温度を一定にするための照光光
量も小さくできる。
That is, since the illumination of the object to be imaged and the exposure of the camera are performed in synchronization, the exposure can be performed only during the time of illumination. Therefore, since the aperture of the camera can be opened sufficiently in a state where the influence of external light, such as blooming, etc. is very small, the amount of illumination light for keeping the color temperature constant can also be reduced.

照光光量が小さくなれば、照光手段による照光時間を短
かくできるので照光手段の大幅な小型化が可能になり九
のである。
If the amount of illumination light is reduced, the illumination time by the illumination means can be shortened, and the illumination means can be significantly downsized.

又、照光時間を短かくすると、カメラへの入射光開閉時
間も短かくすることができるので、上記照光手段の小型
化との相乗効果で撮像可能な間隔も大幅に短縮できると
いう効果もある。
Further, by shortening the illumination time, the time for opening and closing the incident light to the camera can also be shortened, so that, in combination with the miniaturization of the illumination means, the interval at which images can be taken can also be significantly shortened.

〔実施例〕〔Example〕

以下、本発明の実施例を図面に基いて説明する。 Embodiments of the present invention will be described below with reference to the drawings.

第1図に示すように、カメラへの入射光開閉手段として
のシャッタ(2)を内蔵したカラービデオカメラを用い
たモニタカメラ(1)に、照光手段としてのストロボ(
3)を設けるとともに、前記シャッタ(2)の開閉すな
わちシャッタ速度を制御するシャッタコントローフ(4
)を設け、前記ストロボ(3)のトリガ信号(TG)に
よってクヤツタ;ントローツ(4)によるシャッタ(2
)の開閉を同期させ、ストロボ(3)による照光と同時
にシャッタ(2)を開閉することによって撮像対象であ
る果実を一定の明るさで撮像すべく構成しである。
As shown in Fig. 1, a monitor camera (1) using a color video camera with a built-in shutter (2) as a means for opening and closing light incident on the camera is connected to a strobe light (as an illumination means).
3) and a shutter control (4) for controlling the opening and closing of the shutter (2), that is, the shutter speed.
), and the shutter (2) is activated by the shutter (4) by the trigger signal (TG) of the strobe (3).
), and by opening and closing the shutter (2) simultaneously with the illumination by the strobe (3), the fruit to be imaged can be imaged at a constant brightness.

そして、前記構成となるモニタカメラ(1)によって撮
像された/フレーム分のカフ−画像信号は後記構成にな
る色識別装置+51 Kよって果実のみに対応したa値
化信号に変換されフレームメモリ+61 K記憶される
とともにモニタテレビ(7)によってその結果を表示し
ながら、制御装置(8)によって果実位置検出等の処理
を行なうことによって、果実とその他の物体とを自動的
に分#識別可能な果実認識装置を構成しである。
Then, the cuff image signal for each frame captured by the monitor camera (1) having the above configuration is converted into an a value signal corresponding only to the fruit by the color identification device +51K having the configuration described later, and is stored in the frame memory +61K. Fruits that can be automatically distinguished from other objects by being memorized and displaying the results on a monitor television (7) while performing processes such as fruit position detection using a control device (8). This constitutes a recognition device.

前記色識別装置(5)を構成するに、第2図に示すよう
に、モニタカメラ(1)より出力される画像情報である
輝度信号fYI Fi、後記構成だなる直流再生回路(
8)を介して2つの乗算器19) 、 +91によつて
構成されな掛算回路0αに入力し、夫′々ポテンショメ
ータ(R>) −(Rt’) 、 (Rm) + (R
/)によって設定された乗算比(Kl) 、(Kt’)
 、(Km) 、 (Km’)で乗算されて比較U5J
路Qll 、αVに入力され、赤の色信号(R1および
青の色信号fBlの2M化のための比較率(KIY)、
(K1’Y)−(KmY)−(Ks′Y)とされる。
As shown in FIG. 2, the color identification device (5) includes a luminance signal fYI Fi, which is image information output from the monitor camera (1), and a DC regeneration circuit (to be described later).
8) to a multiplier circuit 0α constituted by two multipliers 19) and +91, respectively potentiometers (R>) - (Rt') and (Rm) + (R
/) set by the multiplication ratio (Kl), (Kt')
, (Km), (Km') and compare U5J
A comparison rate (KIY) for converting the red color signal (R1 and the blue color signal fBl to 2M) is input to the path Qll and αV,
(K1'Y)-(KmY)-(Ks'Y).

BP輝度信号(■とともにモニタカメラ(1)より出力
される赤および青の色信号fR1、TBIは、2つのコ
ンパレータ(Al) 1.(Am)および反転バッファ
(G、)によってウィンドコンパレータに構成された比
較回路a刀、αDに入力され、夫々前記比較基準の各上
限値(KIY) 、(KsY)  と下限値(Kl’ 
Y ) 。
The red and blue color signals fR1 and TBI output from the monitor camera (1) along with the BP luminance signal (■) are configured into a window comparator by two comparators (Al) 1. (Am) and an inversion buffer (G,). The upper limit values (KIY), (KsY) and lower limit value (Kl') of the comparison standards are input to the comparison circuits a and αD, respectively.
Y).

(K/Y)の間のレベルの信号を抽出して、2値化され
、このコ値化色信号(R’) 、 (B’)の論理積を
AND回U口によって演算して前記ポテンショメータ(
R1) 、 (Rs’) 、 (Rm) 、 (R8勺
によって設定された範囲にある果実に対応する特定色の
みを2値化し九特定色信号(Flをフレームメモリ(6
)に出力すべく構成しである。
A signal with a level between (K/Y) is extracted and binarized, and the logical product of the color signals (R') and (B') is calculated by the AND circuit and the potentiometer is output. (
R1), (Rs'), (Rm), (R8 Binarize only the specific color corresponding to the fruit within the range set by 9 and store the 9 specific color signal (Fl) in the frame memory (6
).

前記直流再生回B t8>・・は、モニタカメラ(1)
より出力される前記輝度信号(■、赤および青の色信号
(R1、TBIが交流結合で出力されているためニ、ソ
のGNDレベルが一定していないことから、そのGND
レベルすなわち黒レベルを一定にすべく制御する几めに
設けであるものでらって、第8図に示すように、水平増
幅器(Ao)を介して入力される水平同期信号(HD)
の立上シに同期して入力信号(vt)をサンプルホール
ドするサンプルホールド回路(AS )およびこのサン
プルホールド回路(As)の出力(Vrei)と入力信
号(Vi )との差分を差動増幅器(A、)によって演
算することによって入力信号(Vi)を絶対的なGND
レベルからの直流成分の信号(V、)に変換すべく構成
しである。
Said DC regeneration B t8>... is the monitor camera (1)
Since the luminance signal (■, red and blue color signals (R1, TBI) output from
As shown in Fig. 8, the horizontal synchronizing signal (HD) is inputted via a horizontal amplifier (Ao), which is designed to control the level, that is, the black level, to be constant.
A sample hold circuit (AS) samples and holds the input signal (vt) in synchronization with the rising edge of A,) to convert the input signal (Vi) to the absolute GND
It is configured to convert the level to a DC component signal (V,).

尚、本実施例において、緑の色信号(Glを用いないの
は果樹の葉に対応する緑色系の信号は不要であるためで
あ)、また、赤と青の色信号(3)、(B)の論理演算
を行なうのは画像tn報から背景となる空の色を除去す
るためである。
In this example, the green color signal (Gl is not used is because a green signal corresponding to the leaves of a fruit tree is unnecessary), the red and blue color signals (3), ( The reason for performing the logical operation B) is to remove the background sky color from the image tn information.

又、輝度信号(Ylを2gL化する色信号(R1、fB
lの比較基準として用いるのは周囲の明るさの影響を除
く次めであり、前記ストロボ(3)による照光効果との
相乗効果で抽出する色の特定精度を向上させるためであ
って、このように輝度信号(Ylを比較基準として用い
る場合は、通常の適正露出となる絞り値に対して±2絞
シ程度の明るさの変化に対していわゆる自動絞りを行な
った場合と同等の色検出精度が得られる。
In addition, the luminance signal (color signal (R1, fB
It is used as a comparison standard to remove the influence of the surrounding brightness, and to improve the accuracy of identifying colors to be extracted by the synergistic effect with the illumination effect of the strobe (3). When using the luminance signal (Yl) as a comparison standard, the color detection accuracy is equivalent to that of automatic aperture for changes in brightness of about ±2 stops from the aperture value that normally provides proper exposure. can get.

【図面の簡単な説明】[Brief explanation of the drawing]

図面は本発明に係る果実認識装着の実施例を示し、第1
図は全体?712成を示すブロック図、第2図は色識別
装置の構成を示すブロック図、そして、第8図は直流再
生回路の動作の説明図である。 (1)・・・・・・モニタカメラ、(2)・・・・・・
入射光開閉手段、(3)・・・・・・照光手段。 代理人  弁理士  北  村     修第1図 疼 3 ロ 手続補正書 1.事件の表示 昭和59年 待 酸第177888号 2、発明の名称 果実認識装置 3、補正をする者 事件との関係 特   許 出願人 住所  大處府大阪市知区政津束/丁目−薔V2号名称
(105)久尿田鉄工株式会社 北村?、?frビル 7、W正の内容 明RA蕾の第l負/ダ行〜/I行の 「向、・・・・・・・・・でろる。」を削除する。
The drawings show an embodiment of the fruit recognition installation according to the present invention, and the first
Is the diagram the whole? FIG. 2 is a block diagram showing the configuration of the color identification device, and FIG. 8 is an explanatory diagram of the operation of the DC regeneration circuit. (1)...Monitor camera, (2)...
Incident light opening/closing means, (3)... illumination means. Agent Patent Attorney Osamu Kitamura 1st Edition 3 B Procedure Amendment 1. Indication of case 1982 Matsui acid No. 177888 2, name of invention Fruit recognition device 3, person making amendment Relationship to case Patent Applicant address Masatsuzuka/Chome-Bara V2, Chi-ku, Osaka-shi, Ogo prefecture Name (105) Kuureta Iron Works Co., Ltd. Kitamura? ,? fr building 7, W positive content description RA bud's 1th negative /DA line ~ /I line, "Toward, ...... deroru." is deleted.

Claims (1)

【特許請求の範囲】[Claims] モニタカメラ(1)から得られる画像信号より果実に対
応する特定色の信号を分離して2値化することによつて
果実のみに対応した2値化画像信号を得るべく構成され
た果実認識装置であつて、前記モニタカメラ(1)によ
る撮像方向を所定の光量で照光する手段(3)、および
、前記モニタカメラ(1)に入射される光を開閉する手
段(2)を設け、前記照光手段(3)による照光と開閉
手段(2)によるカメラ(1)への入射光開閉とを同期
して行なうべく制御する手段を設けてあることを特徴と
する果実認識装置。
A fruit recognition device configured to obtain a binarized image signal corresponding only to fruit by separating and binarizing a signal of a specific color corresponding to fruit from an image signal obtained from a monitor camera (1). means (3) for illuminating the imaging direction by the monitor camera (1) with a predetermined amount of light; and means (2) for opening and closing the light incident on the monitor camera (1); A fruit recognition device characterized in that it is provided with means for controlling the illumination by the means (3) and the opening/closing of the incident light to the camera (1) by the opening/closing means (2) in synchronization.
JP59177888A 1984-08-27 1984-08-27 Fruits recognition device Pending JPS6155787A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP59177888A JPS6155787A (en) 1984-08-27 1984-08-27 Fruits recognition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP59177888A JPS6155787A (en) 1984-08-27 1984-08-27 Fruits recognition device

Publications (1)

Publication Number Publication Date
JPS6155787A true JPS6155787A (en) 1986-03-20

Family

ID=16038811

Family Applications (1)

Application Number Title Priority Date Filing Date
JP59177888A Pending JPS6155787A (en) 1984-08-27 1984-08-27 Fruits recognition device

Country Status (1)

Country Link
JP (1) JPS6155787A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0685814A2 (en) * 1994-04-29 1995-12-06 International Business Machines Corporation Produce recognition system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5294021A (en) * 1976-02-02 1977-08-08 Suntory Ltd Method of observing instantaneous picture and device therefor

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5294021A (en) * 1976-02-02 1977-08-08 Suntory Ltd Method of observing instantaneous picture and device therefor

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0685814A2 (en) * 1994-04-29 1995-12-06 International Business Machines Corporation Produce recognition system
EP0685814A3 (en) * 1994-04-29 1997-03-05 Ibm Produce recognition system.

Similar Documents

Publication Publication Date Title
US6985185B1 (en) Dynamic range video camera, recording system, and recording method
US9615031B2 (en) Imaging device and scene determination method
JPS6155787A (en) Fruits recognition device
GB2151353A (en) Colour signal separating apparatus
JP3554069B2 (en) Imaging device
JPS60128314A (en) Fruit discriminating device
JPS62189891A (en) Automatic white balance device
JPH09266545A (en) Image pickup recorder for object having large gradation difference
JP2696904B2 (en) Color television camera
JPS608769A (en) Object detector
JPS61267464A (en) Video camera
JP2000069490A (en) Image pickup device
JPS6038626A (en) Identification of fruit
JPS61198989A (en) Image pickup device
JPS58161064A (en) Picture processing and reproducing device
KR940002708B1 (en) Auto light control apparatus and method of video camera
JPH08294038A (en) Video camera with automatic tripod
JPH0983860A (en) Image pickup device
JPH02274181A (en) Image pickup sensitivity correction device
JPH02291516A (en) Automatic light quantity control circuit for electronic endoscope device
CN115753790A (en) Attachment method capable of meeting optical filter dust detection requirement
JPS62178091A (en) Image pickup device
JPH032846A (en) Auto iris device
JPH0819333A (en) Device for identifying picture image of cucumber
JPH03270489A (en) Backlight correcting circuit for color video camera