JPH09224414A - Direction detector, traveling state display device and traveling controller for work wagon - Google Patents

Direction detector, traveling state display device and traveling controller for work wagon

Info

Publication number
JPH09224414A
JPH09224414A JP8037857A JP3785796A JPH09224414A JP H09224414 A JPH09224414 A JP H09224414A JP 8037857 A JP8037857 A JP 8037857A JP 3785796 A JP3785796 A JP 3785796A JP H09224414 A JPH09224414 A JP H09224414A
Authority
JP
Japan
Prior art keywords
image
image pickup
moving
work vehicle
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP8037857A
Other languages
Japanese (ja)
Inventor
Muneyuki Kawase
宗之 河瀬
Yuichi Yamazaki
祐一 山崎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kubota Corp
Original Assignee
Kubota Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kubota Corp filed Critical Kubota Corp
Priority to JP8037857A priority Critical patent/JPH09224414A/en
Publication of JPH09224414A publication Critical patent/JPH09224414A/en
Pending legal-status Critical Current

Links

Abstract

PROBLEM TO BE SOLVED: To provide a direction detector for a work wagon improved in steerage and operability by improving detection accuracy by discriminating the position deviation direction of an image pickup object between images picked up at every set moving time or the like as a machine body moving direction by a moving direction detection means. SOLUTION: This detector is provided with an image pickup means S1 for picking up the image of the plural image pickup objects present with intervals with each other on a ground side, an area extraction means 9 for extracting an object area corresponding to the image area of the image pickup object based on the image pickup information of the image pickup means S1 and the moving direction detection means 101 for detecting the machine body moving direction based on the area information of the area extraction means 9. The image pickup operation of the image pickup means S1 is performed at every set moving time or moving distance and the moving direction detection means 101 discriminates the position deviation direction of the image pickup objects between both images continuously picked up at every set moving time or moving distance as the machine body moving direction. Also, it is preferable that the moving direction detection means 101 defines the direction of a straight line for connecting overlapped object areas between both images as the position deviation direction.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【発明の属する技術分野】本発明は、地上側に互いに間
隔を隔てて複数個存在する撮像対象物を撮像する撮像手
段と、その撮像手段の撮像情報に基づいて前記撮像対象
物の画像領域に対応する対象物領域を抽出する領域抽出
手段と、その領域抽出手段の領域情報に基づいて機体移
動方向を検出する移動方向検出手段とが設けられた作業
車の方向検出装置、並びに、この境界検出装置にて検出
された境界に対する走行状態を表示する走行状態表示装
置、及び、この検出境界に沿って自動走行させるための
走行制御装置に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup means for picking up a plurality of image pickup objects which are present on the ground side at a distance from each other, and an image pickup device for displaying an image area of the image pickup object based on image pickup information of the image pickup means. A direction detecting device for a work vehicle provided with a region extracting means for extracting a corresponding object region and a moving direction detecting means for detecting a machine body moving direction on the basis of the region information of the region extracting means, and this boundary detection. The present invention relates to a traveling state display device that displays a traveling state with respect to a boundary detected by the device, and a traveling control device for automatically traveling along the detected boundary.

【0002】[0002]

【従来の技術】上記作業車の方向検出装置では、例え
ば、撮像対象物としての作物の苗を既植作業地に隣接す
る未植作業地に列状に設定間隔毎に植え付ける植付け作
業車(田植え機等)を、複数個の既植苗の列方向に沿っ
て走行させる際に必要となる機体移動方向を検出するた
めに、テレビカメラ等の撮像手段の画面所定方向(例え
ば画面上下方向)を機体前後方向に一致する状態に調整
するとともに、撮像画面内で各苗に対応する苗領域(対
象物領域)の情報に基づいてハフ変換等の直線近似や曲
線近似処理にて苗列方向を求め、この苗列方向と機体前
後方向に対応する画面方向との変位によって、機体前後
方向の向きつまり機体移動方向を検出するようにしてい
た(例えば、特開平6‐149362号公報参照)。
2. Description of the Related Art In the above-mentioned work vehicle direction detecting apparatus, for example, planting work vehicles (rice planting) for planting seedlings of a crop as an imaging object in rows at set intervals in an unplanted work site adjacent to an already planted work site. Machine) to detect the moving direction of the machine, which is necessary when traveling along the row direction of a plurality of already planted seedlings, the predetermined direction of the screen of the image pickup means such as a TV camera (for example, the vertical direction of the screen) is detected. Adjust the state to match the front-back direction, and determine the seedling row direction by linear approximation or curve approximation processing such as Hough conversion based on the information of the seedling area (target area) corresponding to each seedling in the imaging screen, The direction in the machine front-rear direction, that is, the machine body movement direction is detected by the displacement between the seedling row direction and the screen direction corresponding to the machine body front-rear direction (see, for example, JP-A-6-149362).

【0003】[0003]

【発明が解決しようとする課題】しかしながら、上記従
来技術では、予め撮像画面の所定方向(例えば画面上下
方向)が機体前後方向に一致するように、撮像手段を機
体に取り付けた状態が保持されることを前提としている
が、例えば走行中の振動等によって撮像手段の機体への
取り付け機構が緩んで撮像手段の撮像方向が変動する
と、上記機体移動方向の検出が不正確になり、その結
果、機体を苗列方向に沿って適正な状態で走行させるの
に支障があった。
However, in the above-mentioned prior art, the state in which the image pickup means is attached to the machine body is held so that the predetermined direction of the image pickup screen (for example, the vertical direction of the screen) matches the front-back direction of the machine body in advance. However, if the image pickup direction of the image pickup unit changes due to a loose attachment mechanism of the image pickup unit to the airframe due to vibration during traveling, for example, the detection of the moving direction of the body becomes inaccurate, and as a result, There was a problem in running the seedlings along the seedlings in a proper condition.

【0004】本発明は、上記実情に鑑みてなされたもの
であって、その目的は、上記従来技術の不具合を解消す
べく、例えば撮像手段の機体への取り付け機構が緩んで
撮像手段の撮像方向が変動した場合であっても、機体移
動方向の検出を適正に行い、そして、その機体移動方向
の苗列方向に対する走行状態を手動操縦している作業者
が判断できるように画面表示したり、あるいは、その苗
列方向に沿って作業車を自動走行させるようにすること
である。
The present invention has been made in view of the above circumstances, and an object thereof is, for example, in order to solve the above-mentioned problems of the prior art, for example, the mechanism for attaching the image pickup means to the body is loose and the image pickup direction of the image pickup means. Even if the change occurs, properly detect the moving direction of the aircraft, and display on the screen so that the operator who is manually controlling the traveling state of the moving direction of the aircraft in the seedling row direction, Alternatively, the work vehicle is automatically driven along the seedling row direction.

【0005】[0005]

【課題を解決するための手段】請求項1の構成によれ
ば、地上側に互いに間隔を隔てて複数個存在する撮像対
象物を設定移動時間又は移動距離毎に撮像した各撮像画
像において、撮像対象物の画像領域に対応する対象物領
域を抽出し、上記設定移動時間又は移動距離毎に連続し
て撮像された両画像間における撮像対象物の位置ずれ方
向を判別して機体移動方向とする。
According to the structure of claim 1, a plurality of image pickup objects existing on the ground side at a distance from each other are picked up for each set moving time or moving distance. The target object area corresponding to the image area of the target object is extracted, and the displacement direction of the imaged target object between both images captured continuously for each of the set moving time or moving distance is determined as the machine body moving direction. .

【0006】従って、作業車の移動に伴ってその移動方
向に沿って画面内で位置がずれる撮像対象物の位置ずれ
方向によって機体移動方向を検出するので、従来のよう
に、例えば、撮像画面の所定方向を機体前後方向に一致
させて、その画面所定方向に対する画面内での撮像対象
物の位置関係(例えば撮像対象物の並び方向と上記画面
所定方向との角度)を判別して機体移動方向を検出する
ものでは、撮像手段の機体への取り付け機構が緩む等し
て撮像方向が変動した場合には、機体移動方向の検出を
適正に行うことができなくなるのに比べて、そのような
場合であっても機体移動方向の検出が適正にできる作業
車の方向検出装置が得られる。
Therefore, since the machine body moving direction is detected by the position shift direction of the image pickup object whose position shifts on the screen along the moving direction of the work vehicle, as in the conventional case, for example, in the image pickup screen. Matching the predetermined direction with the aircraft front-back direction, and determining the positional relationship of the imaged object in the screen with respect to the screen predetermined direction (for example, the angle between the arrangement direction of the imaged objects and the screen predetermined direction) In this case, it is not possible to properly detect the moving direction of the machine when the imaging direction changes due to loosening of the attachment mechanism of the imaging means to the machine Even if it is, the direction detection device of the work vehicle that can appropriately detect the moving direction of the machine body can be obtained.

【0007】請求項2の構成によれば、請求項1におい
て、連続して撮像された両画像間において重なる対象物
領域同士を結ぶ直線の方向を、撮像対象物の位置ずれ方
向として判別する。
According to the second aspect of the present invention, in the first aspect, the direction of the straight line connecting the object regions overlapping between the continuously captured images is determined as the position displacement direction of the imaged object.

【0008】従って、両画像間において位置ずれしなが
ら重なっている対象物領域の組合わせを判別すること
で、作業車の移動に伴って画面内で位置ずれする同一の
対象物領域を確実に捉え、その対象物領域の位置ずれ方
向によって機体移動方向を的確に検出することができ、
もって、請求項1の構成の好適な手段が得られる。
Therefore, by discriminating the combination of the object areas that are overlapped while being displaced between the two images, the same object area that is displaced on the screen as the work vehicle is moved can be reliably captured. , It is possible to accurately detect the moving direction of the airframe by the direction of displacement of the target area,
Therefore, the preferred means of the constitution of claim 1 can be obtained.

【0009】請求項3の構成によれば、請求項2におい
て、連続して撮像された両画像のいずれか一方において
求めた各対象物領域の代表点が、他方の画像における対
象物領域に含まれていれば、その両対象物領域が上記両
画像間において重なっていると判別し、上記一方の画像
における各対象物領域の代表点が、他方の画像における
対象物領域に含まれていないときは、その両対象物領域
は上記両画像間において重なっていないと判別する。
According to the third aspect of the present invention, in the second aspect, the representative point of each object region obtained in either one of the two images captured continuously is included in the object region in the other image. If so, it is determined that the two object areas overlap between the two images, and the representative point of each object area in the one image is not included in the object area in the other image. Determines that the two object areas do not overlap between the two images.

【0010】従って、例えば、各対象物領域の代表点を
求めずに、両画像間での対象物領域の重なり状態を判別
するものでは、一方の画像における対象物領域を構成す
る多数の点について、他方の画像における対象物領域に
含まれるか否かを判断する必要があって、その判別処理
が複雑化するのに比べて、処理内容を簡素化することが
でき、もって、請求項2の構成の好適な手段が得られ
る。
Therefore, for example, in determining the overlapping state of the object regions between the two images without obtaining the representative points of the respective object regions, a large number of points constituting the object region in one image are detected. , It is necessary to determine whether or not the image is included in the target area in the other image, and the determination process is complicated, but the processing content can be simplified, and thus the determination process according to claim 2 is performed. A suitable means of construction is obtained.

【0011】請求項4の構成によれば、請求項1、2又
は3において、作業地を斜め下向きに撮像した撮像手段
の撮像画像が鉛直下向きに撮像した状態の画像に変換さ
れ、その鉛直下向きの連続する両画像における撮像対象
物の位置ずれ方向が機体移動方向として判別される。
According to the structure of claim 4, in claim 1, 2 or 3, the image picked up by the image pickup means, which is obtained by picking up the work site in a diagonally downward direction, is converted into an image in a vertically downward direction, and the image is taken in the vertically downward direction. The displacement direction of the imaged object in both consecutive images is determined as the machine body movement direction.

【0012】従って、作業地を斜め下向きに撮像する場
合の画像歪みを補正しながら、作業地を鉛直下向きに撮
像する場合に比べて、より広い範囲に存在する多数の撮
像対象物を捉えて、その多数の撮像対象物の位置ずれ方
向に基づいて機体移動方向の検出確度を高めることがで
き、もって、請求項1、2又は3の構成の好適な手段が
得られる。
Therefore, while correcting the image distortion when the work site is imaged obliquely downward, a large number of image pickup objects existing in a wider range are captured compared with the case where the work site is imaged vertically downward. The detection accuracy of the machine body movement direction can be increased based on the positional displacement directions of the large number of image pickup objects, and thus the preferable means of the configuration of claim 1, 2 or 3 can be obtained.

【0013】請求項5の構成によれば、請求項1、2、
3又は4の作業車において、機体移動方向に沿って列状
に形成された撮像対象物の列方向が検出され、画像表示
手段の同一画面上に、上記撮像対象物の列方向に対する
前記求めた機体移動方向の変位を示す画像と、列状の撮
像対象物を撮像した撮像画像とが表示される。
According to the configuration of claim 5, claims 1, 2,
In the work vehicle 3 or 4, the column direction of the imaging target formed in a row along the machine body movement direction is detected, and the above-mentioned determination with respect to the column direction of the imaging target is obtained on the same screen of the image display means. An image showing the displacement in the moving direction of the machine body and a captured image obtained by capturing the image capturing object in a row are displayed.

【0014】従って、例えば、作業車を手動で操縦する
作業者が、地上側に列状に存在する撮像対象物を実際に
見てその列方向に対する機体移動方向の変位を判断する
のに比べて、同一画面上に表示される実際の撮像対象物
の画像と上記変位を示す画像とから、撮像対象物の列方
向に対する機体移動方向の変位を容易且つ的確に判断で
き、もって、機体を地上側の撮像対象物の列方向に沿っ
て適切な状態で移動させるように手動操向する際に好適
な作業車の走行状態表示装置が得られる。
Therefore, for example, as compared with a case where a worker who manually operates a work vehicle actually sees an image pickup object existing in a row on the ground side and judges the displacement in the machine movement direction with respect to the row direction. , It is possible to easily and accurately determine the displacement of the imaged object in the machine movement direction with respect to the column direction from the image of the actual imaged object displayed on the same screen and the image showing the above displacement, and thus the machine body is placed on the ground side. It is possible to obtain a traveling state display device for a work vehicle that is suitable when the vehicle is manually steered so as to move the imaging target in the column direction in an appropriate state.

【0015】請求項6の構成によれば、請求項1、2、
3又は4の作業車において、機体移動方向に沿って列状
に形成された撮像対象物の列方向が検出され、その撮像
対象物の列方向に対する前記求めた機体移動方向の変位
情報に基づいて、その変位を打ち消すように走行装置が
自動的に操向操作されて、作業車が上記撮像対象物の列
方向に沿って走行するように操向制御される。
According to the structure of claim 6, claims 1, 2,
In the work vehicle of 3 or 4, the row direction of the imaging object formed in a row along the machine movement direction is detected, and based on the displacement information of the obtained machine movement direction with respect to the row direction of the imaging object. The traveling device is automatically steered so as to cancel the displacement, and the work vehicle is steered so as to travel in the row direction of the imaging target.

【0016】従って、例えば、作業者が手動にて操向操
作して作業車(例えば植付け作業車)を撮像対象物(例
えば植付けた作物の苗)の列方向に沿って走行させてい
る場合に、他の作業(苗補給等)を行うために操縦用の
ハンドル等から一時的に手を放しても、機体を上記列方
向に沿って自動走行させることができ、もって、作業性
に優れた作業車の走行制御装置が得られる。
Therefore, for example, when the operator manually operates the work vehicle (for example, the planting work vehicle) along the row direction of the object to be imaged (for example, the seedling of the planted crop). Also, even if you temporarily release your hands from the steering wheel for other work (supplementing seedlings, etc.), the machine can automatically run along the above-mentioned row direction, which is excellent in workability. A travel control device for a work vehicle is obtained.

【0017】[0017]

【発明の実施の形態】以下、本発明を、作業車としての
田植え機(植付け作業車)が植付け作業しながら圃場内
を走行する場合について、図面に基づいて説明する。
BEST MODE FOR CARRYING OUT THE INVENTION The present invention will be described below with reference to the drawings in which a rice transplanter (planting work vehicle) as a work vehicle travels in a field while planting work.

【0018】図1及び図2に示すように、前輪1F及び
後輪1Rを備えた作業車Vの機体後部側に、作物の苗T
を圃場に植え付ける苗植え付け装置2が昇降自在に設け
られ、作業車Vは、未植作業地に対して、機体進行方向
に沿って設定植付け間隔を隔てる列状に、且つ、機体横
幅方向に設定植付け幅を隔てる状態で複数個の苗Tを植
え付けて、既植作業地を形成する。つまり、地上側に互
いに間隔を隔てて複数個存在する撮像対象物としての複
数個の苗Tが、機体移動方向に沿って列状に形成され
る。
As shown in FIGS. 1 and 2, on the rear side of the body of the work vehicle V having the front wheels 1F and the rear wheels 1R, the crop seedlings T are provided.
The seedling planting device 2 for planting the plant in the field is provided so as to be able to move up and down, and the work vehicles V are set in a row with respect to the unplanted work site in a row with a set planting interval along the machine traveling direction and in the machine lateral direction. A plurality of seedlings T are planted in a state where the planting widths are separated to form a planted work site. That is, a plurality of seedlings T, which are present on the ground side and are spaced apart from each other, as imaging targets are formed in rows along the machine body moving direction.

【0019】作業車Vの機体前部側に、機体横外側方に
隣接する既植作業地と未植作業地との境界箇所に位置す
る苗Tnを含む前記苗Tを撮像する撮像手段としてのテ
レビカメラS1が設けられ、このテレビカメラS1は、
作業地を斜め上方から撮像する状態で機体横外側方に向
かって突出された支持部材4の先端部に取り付けられて
いる。尚、作業車Vは、圃場の一端側から他端側に向か
って機体横幅方向に平行に並ぶ状態で設定された複数個
の作業行程の一行程を走行する毎に圃場に対する走行方
向が反転して、作業車Vに対する前記境界の位置が左右
反転することから、前記テレビカメラS1は、作業車V
の左右夫々に各一個が設けられ、使用する側のテレビカ
メラS1を後述のように切り換え制御する。図1では、
境界の位置が作業車Vの左側であり、左側のテレビカメ
ラS1の撮像情報が使われる。そして、各作業行程で
は、作業者が、苗列方向に対する機体移動方向の変位状
態を示す後述のテレビモニター13の表示画面を見なが
ら作業車Vを手動操向させたり、あるいは、後述のよう
に、上記変位情報に基づいて作業車Vが自動的に操向制
御される。
On the front side of the work vehicle V as an image pickup means for picking up the seedling T including the seedling Tn located at the boundary between the planted work site and the unplanted work site adjacent to the lateral side of the machine. A TV camera S1 is provided, and the TV camera S1 is
It is attached to the tip of a support member 4 that projects outward from the fuselage in a state in which the work area is imaged obliquely from above. The work vehicle V reverses its traveling direction with respect to the field every time it travels through one working stroke set in a state in which the working vehicles V are arranged in parallel in the machine lateral direction from one end side to the other end side of the field. Since the position of the boundary with respect to the work vehicle V is horizontally reversed, the television camera S1 is
One is provided on each of the left and right sides, and the television camera S1 on the side to be used is switched and controlled as described later. In FIG.
The position of the boundary is on the left side of the work vehicle V, and the image pickup information of the left TV camera S1 is used. Then, in each work step, the operator manually steers the work vehicle V while looking at the display screen of the TV monitor 13 described later showing the displacement state in the machine movement direction with respect to the seedling row direction, or as described below. The steering of the work vehicle V is automatically controlled based on the displacement information.

【0020】前記作業車Vの構成について説明すれば、
図3に示すように、エンジンEの出力が変速装置5を介
して前輪1F及び後輪1Rの夫々に伝達され、その変速
装置5の変速操作状態を検出する変速状態検出用ポテン
ショメータR3と、その変速装置5を変速操作するため
の変速用電動モータ6及び手動変速用のアクセルペダル
17とが設けられている。尚、図中、S2は前記変速装
置5の出力回転数に基づいて機体移動距離を検出するた
めの距離センサである。
Explaining the structure of the work vehicle V,
As shown in FIG. 3, the output of the engine E is transmitted to each of the front wheels 1F and the rear wheels 1R via the transmission device 5, and the transmission state detecting potentiometer R3 for detecting the transmission operation state of the transmission device 5 and the potentiometer R3 are provided. An electric motor 6 for shifting the transmission 5 for shifting the transmission 5 and an accelerator pedal 17 for manual shifting are provided. In the figure, S2 is a distance sensor for detecting the moving distance of the machine body based on the output speed of the transmission 5.

【0021】操向操作自在な走行装置としての前輪1F
及び後輪1Rが、夫々油圧シリンダ7F,7Rによって
各別にステアリング操作されるように構成され、前後輪
1F,1Rのステアリング角度を検出するステアリング
角検出用ポテンショメータR1,R2と、手動操縦用の
ハンドル16と、そのハンドル16の操作角を検出する
ハンドル操作角検出用ポテンショメータR0と、前記油
圧シリンダ7F,7Rを作動させる電磁操作式の制御弁
8F,8Rとが設けられている。尚、前後輪1F,1R
を同位相で且つ同角度に操向する平行ステアリング形
式、前後輪1F,1Rを逆位相で且つ同角度に操向する
4輪ステアリング形式、及び、前輪1Fのみを操向する
2輪ステアリング形式の三種類のステアリング形式を、
図示しない切換スイッチによって選択使用できるように
なっている。但し、各作業行程に沿って自動走行する時
は、2輪ステアリング形式が選択される。
Front wheel 1F as a traveling device which can be freely steered
Also, the rear wheels 1R are configured to be individually steered by hydraulic cylinders 7F and 7R, respectively, and steering angle detecting potentiometers R1 and R2 for detecting steering angles of the front and rear wheels 1F and 1R, and a steering wheel for manual operation. 16, a steering wheel operation angle detection potentiometer R0 for detecting the operation angle of the steering wheel 16, and electromagnetically operated control valves 8F, 8R for operating the hydraulic cylinders 7F, 7R are provided. In addition, front and rear wheels 1F, 1R
Of the same phase and at the same angle for the parallel steering type, the front and rear wheels 1F, 1R for the opposite phase and at the same angle for the four-wheel steering type, and the front wheel 1F for steering only the two-wheel steering type. Three types of steering,
It can be selectively used by a changeover switch (not shown). However, when the vehicle automatically travels along each work stroke, the two-wheel steering type is selected.

【0022】マイクロコンピュータ利用の制御装置12
が設けられ、この制御装置12に、前記ステアリング角
検出用ポテンショメータR1,R2、ハンドル操作角検
出用ポテンショメータR0、変速状態検出用ポテンショ
メータR3、距離センサS2、及び、自動走行モードを
起動する自動走行スイッチ15からの各信号が入力さ
れ、制御装置12からは、前記変速用電動モータ6、及
び制御弁8F,8Rに対する駆動信号が出力されてい
る。そして、制御装置12は、自動走行スイッチ15が
オンした自動走行モードでは、変速装置5が予め設定さ
れた設定走行速度に対応する操作状態となるように変速
用電動モータ6を駆動し、且つ、前後輪1F,1Rのス
テアリング角が設定操舵角になるように制御弁8F,8
Rを駆動し、また、自動走行スイッチ15がオフした手
動走行モードでは、前後輪1F,1Rがハンドル16に
て指示された操作角になるように制御弁8F,8Rを駆
動する。尚、手動走行モードでは、上記アクセルペダル
17を作業者が操作して変速させる。
Microcomputer-based control unit 12
The control device 12 is provided with the steering angle detecting potentiometers R1 and R2, the steering wheel operating angle detecting potentiometer R0, the shift state detecting potentiometer R3, the distance sensor S2, and the automatic traveling switch for starting the automatic traveling mode. Each signal from 15 is input, and the control device 12 outputs drive signals for the electric motor 6 for shifting and the control valves 8F and 8R. Then, in the automatic traveling mode in which the automatic traveling switch 15 is turned on, the control device 12 drives the electric motor 6 for shifting so that the transmission device 5 is in an operation state corresponding to a preset traveling speed, and The control valves 8F, 8 are adjusted so that the steering angles of the front and rear wheels 1F, 1R become the set steering angles.
In the manual traveling mode in which R is driven and the automatic traveling switch 15 is turned off, the control valves 8F and 8R are driven so that the front and rear wheels 1F and 1R have the operating angles designated by the steering wheel 16. In the manual traveling mode, the operator operates the accelerator pedal 17 to shift gears.

【0023】図4に示すように、圃場面における苗T等
から反射光は、水面等からの直接反射光が入射しないよ
うにするための偏光フィルタ及び可視光の入射を阻止す
るための可視光カットフィルタからなる光フィルタ14
を透過した後、前記テレビカメラS1に入射している。
つまり、テレビカメラS1からは、圃場面における苗T
等についての赤外光による赤外画像がアナログ画像情報
として得られる(図9(イ)参照)。尚、テレビカメラ
S1は、後述のように設定移動距離毎に撮像作動され、
又、その画像は、テレビカメラS1が圃場の前方側を斜
め下向きに撮像しているために、遠方側の画像ほど距離
が縮んで見えている。
As shown in FIG. 4, the reflected light from the seedling T or the like in the field scene is a polarizing filter for preventing the direct reflected light from the water surface or the like and the visible light for blocking the incident of the visible light. Optical filter 14 consisting of a cut filter
After being transmitted, it is incident on the television camera S1.
That is, from the TV camera S1, the seedling T in the field scene is displayed.
An infrared image of infrared light of the like is obtained as analog image information (see FIG. 9A). The television camera S1 is operated to pick up images for each set moving distance, as will be described later.
In addition, since the television camera S1 images the front side of the field in a diagonally downward direction, the image appears to have a shorter distance as the image on the far side.

【0024】次に、前記テレビカメラS1の撮像情報に
基づいて、未植作業地に隣接する苗Tnの列方向つまり
境界に対応する線分Lや機体移動方向を検出するための
画像処理装置G(図3及び図4)について説明すると、
上記テレビカメラS1からのアナログ画像信号を処理し
て苗領域Taの情報を2値化したデジタル画像信号(図
9(ロ)又はこの画像を遠近歪み補正した図9(ハ)参
照)を出力するビデオ信号処理部9と、そのデジタル画
像信号を予め設定された画素密度(32×32画素/1
画面)に対応した画像データとして記憶する画像メモリ
11と、画像メモリ11内の画像データを処理する画像
処理部10とが設けられている。
Next, based on the image pickup information of the television camera S1, the image processing device G for detecting the line direction L of the seedlings Tn adjacent to the unplanted work site, that is, the line segment L corresponding to the boundary and the machine body moving direction. Explaining (FIGS. 3 and 4),
The analog image signal from the television camera S1 is processed and a digital image signal obtained by binarizing the information of the seedling area Ta (see FIG. 9B or the perspective distortion correction of this image is shown in FIG. 9C) is output. The video signal processing unit 9 and the digital image signal thereof are provided with a preset pixel density (32 × 32 pixels / 1
An image memory 11 that stores image data corresponding to a screen) and an image processing unit 10 that processes the image data in the image memory 11 are provided.

【0025】上記画像処理部10は、遠方側の画像ほど
距離が縮んでいる画像を鉛直下向きの画像に変換処理
し、設定移動距離毎に連続撮像された画像データを処理
して機体移動方向を求め、且つ1つの画像データを処理
して前記線分Lを求める各処理を行うとともに、ビデオ
信号処理部9に対して左右のテレビカメラS1の切換信
号や画像取り込み信号等を出力する画像処理部10とが
設けられている。そして、画像処理部10は、苗Tの列
方向を示す前記線分Lに対する機体移動方向の変位状態
を判別して、その判別情報を制御装置12に出力すると
ともに、液晶パネル等にて構成されたテレビモニター1
3を作動させて、その画面上にテレビカメラS1の撮像
画像や上記変位状態を表示させる。
The image processing unit 10 converts an image having a smaller distance toward a farther side image into a vertically downward image, and processes image data continuously captured for each set moving distance to change the machine body moving direction. An image processing unit that performs each process of obtaining and processing one image data to obtain the line segment L, and outputs a switching signal of the left and right television cameras S1 and an image capturing signal to the video signal processing unit 9. And 10 are provided. Then, the image processing unit 10 determines the displacement state in the machine body movement direction with respect to the line segment L indicating the row direction of the seedlings T, outputs the determination information to the control device 12, and is configured by a liquid crystal panel or the like. TV monitor 1
3 is operated to display the captured image of the television camera S1 and the displacement state on the screen.

【0026】以上より、上記ビデオ信号処理部9を利用
して、テレビカメラS1の撮像情報に基づいて前記各苗
Tの画像領域に対応する苗領域Ta(対象物領域に相
当)を抽出する領域抽出手段が構成されるとともに、画
像メモリ11及び画像処理部10を利用して、テレビカ
メラS1の撮像画像(実際には、上記苗領域Taの情
報)を鉛直下向きに撮像した状態の画像に変換する画像
変換手段104と、上記領域抽出手段9にて領域された
苗領域Taの情報に基づいて、機体移動方向を検出する
移動方向検出手段101とが構成されている。
As described above, the video signal processing unit 9 is used to extract the seedling area Ta (corresponding to the target area) corresponding to the image area of each seedling T based on the image pickup information of the television camera S1. Using the image memory 11 and the image processing unit 10 together with the extraction means, the imaged image of the television camera S1 (actually, the information on the seedling area Ta) is converted into an image in a vertically downward imaged state. The image conversion means 104 and the moving direction detecting means 101 for detecting the moving direction of the machine body are configured based on the information of the seedling area Ta which is created by the area extracting means 9.

【0027】前記移動方向検出手段101は、設定移動
距離毎に連続して撮像されたテレビカメラS1の両画像
間における前記苗Tの位置ずれ方向を機体移動方向とし
て判別するように構成されている。具体的には、図9
(ニ)及び図10に示すように、上記両画像を同じ画面
位置で重ね合わせたときに、両画像間において重なる苗
領域Ta同士(苗領域Taにおいて、時間的に先の画像
の苗領域g1と、時間的に後の画像の苗領域g2)を結
ぶ直線の方向を前記位置ずれ方向とする。画面内に存在
する多数の苗領域Ta夫々における、上記重なりの判別
から多数の直線が得られるので、全体としての機体移動
方向はこれらの平均の方向として求める。そして、上記
領域が重なっているか否かは、前記両画像のいずれか一
方(図10ではg2)において求めた各苗領域Taの代
表点、例えば重心位置(x2,y2)が他方の画像(図
10ではg1)における前記苗領域Taに含まれるとき
に、その両苗領域Taが前記両画像間において重なって
いると判別する。尚、上記各苗領域Taの代表点を、時
間的に後の画像g2ではなく時間的に先の画像g1につ
いて求めてもよい。以上より、上記設定移動距離は、連
続する両画像間において苗領域Ta同士が重なる状態に
なるような距離に設定される。
The moving direction detecting means 101 is configured to determine the direction of the displacement of the seedling T between the two images of the television camera S1 taken continuously for each set moving distance as the machine moving direction. . Specifically, FIG.
As shown in (d) and FIG. 10, when the two images are overlapped at the same screen position, the seedling areas Ta that overlap each other (in the seedling area Ta, the seedling area g1 of the previous image in time) is overlapped. And the direction of the straight line connecting the seedling region g2) of the image that is later in time is the direction of the positional deviation. Since a large number of straight lines can be obtained from the determination of the overlap in each of a large number of seedling areas Ta existing in the screen, the overall machine body movement direction is obtained as the average direction of these. Then, it is determined whether or not the above areas are overlapped with each other by using a representative point of each seedling area Ta obtained in one of the two images (g2 in FIG. 10), for example, the center of gravity position (x2, y2) of the other image (FIG. In 10, when it is included in the seedling area Ta in g1), it is determined that both seedling areas Ta are overlapped between the both images. The representative point of each seedling area Ta may be obtained not for the image g2 that is later in time but for the image g1 that is earlier in time. From the above, the set moving distance is set to such a distance that the seedling areas Ta overlap each other between the continuous images.

【0028】又、画像メモリ11及び画像処理部10を
利用して、苗Tの列方向を検出する列方向検出手段10
3とが構成されている。この列方向検出手段103の具
体構成について説明すると、図9(ハ)に示すように、
テレビカメラS1の撮像画面を機体横幅方向に沿う画面
方向の両側に分割(図では、左右に2等分)して、各分
割画面GL,GRにおいて画面に対する苗領域Taの面
積比が大である側(図では、左側の分割画面GLでの面
積比の方が大であるから左側)を既植作業地側であると
判別し、その判別情報を使って、図9(ホ)に示すよう
に、テレビカメラS1の機体前後方向に沿う画面方向
(図では、上下方向)の各位置において、機体横幅方向
に沿う画面方向で最も未植作業地側に隣接する苗領域T
aを求め、その機体前後方向に沿って列状に並ぶ苗領域
Taを結ぶように直線近似して前記線分Lを求める。
A column direction detecting means 10 for detecting the column direction of the seedlings T using the image memory 11 and the image processing section 10.
And 3 are configured. Explaining the specific configuration of the column direction detecting means 103, as shown in FIG.
The image pickup screen of the TV camera S1 is divided into both sides in the screen direction along the lateral direction of the machine body (divided into left and right in the figure), and the area ratio of the seedling region Ta to the screen is large in each divided screen GL, GR. The side (in the figure, the left side because the area ratio in the left split screen GL is larger) is determined to be the planted work site side, and the determination information is used as shown in FIG. At each position in the screen direction (vertical direction in the figure) along the machine body front-rear direction of the TV camera S1, the seedling area T that is closest to the unplanted work site side in the screen direction along the machine body width direction.
a is obtained, and the line segment L is obtained by linear approximation so as to connect the seedling areas Ta arranged in a row along the longitudinal direction of the machine body.

【0029】又、テレビモニター13を利用して、上記
列方向検出手段103にて求めた苗Tの列方向に対す
る、前記移動方向検出手段101にて求めた機体移動方
向の変位を示す画像及び前記テレビカメラS1の撮像画
像を同一画面上に表示する画像表示手段が構成されると
ともに、画像処理部10を利用して、上記テレビモニタ
ー13を表示作動させる表示制御手段102が構成され
ている。つまり、図11に示すように、前記テレビモニ
ター13の画面に、前記テレビカメラS1の撮像画像
と、前記求めた線分Lと、その線分Lに対する機体移動
方向を示す直線Liの変位つまりその両直線L,Liが
なす角度ずれθsを示す画像とが表示される。従って、
作業者は、上記テレビモニター13の表示画面を見て作
業車Vを手動操向させることになる。
Further, using the television monitor 13, an image showing the displacement in the machine body moving direction obtained by the moving direction detecting means 101 with respect to the row direction of the seedlings T obtained by the row direction detecting means 103 and the above-mentioned image. The image display means for displaying the captured image of the television camera S1 on the same screen is configured, and the display control means 102 for operating the television monitor 13 to display is configured by using the image processing unit 10. That is, as shown in FIG. 11, on the screen of the television monitor 13, the captured image of the television camera S1, the obtained line segment L, and the displacement of the straight line Li indicating the machine body moving direction with respect to the line segment L, that is, its An image showing the angle deviation θs formed by the two straight lines L and Li is displayed. Therefore,
The operator looks at the display screen of the television monitor 13 and manually steers the work vehicle V.

【0030】又、前記制御装置12を利用して、前記列
方向検出手段103にて求めた苗Tの列方向に対する、
前記移動方向検出手段101にて求めた機体移動方向の
変位(上記角度ずれθs)情報に基づいて前記前後輪1
F,1Rを操向制御する制御手段100が構成されてい
る。つまり、前記角度ずれθsが零になるように自動的
に操向制御される。
Further, by using the control device 12, the row direction of the seedlings T obtained by the row direction detection means 103,
The front and rear wheels 1 based on the displacement information (angle deviation θs) in the machine body movement direction obtained by the movement direction detection means 101.
A control means 100 for steering and controlling the F and 1R is configured. That is, the steering control is automatically performed so that the angle deviation θs becomes zero.

【0031】次に、図5〜図8に示すフローチャートに
基づいて、前記制御装置12及び画像処理装置Gによる
制御作動について説明する。制御がスタートすると、メ
インフロー(図5)では、テレビカメラS1の情報に基
づく機体移動方向の検出処理及び苗列検出処理を行い、
次に、自動走行モードか手動走行モードかを判断して、
手動走行モードは走行状態表示処理を行い、自動走行モ
ードでは前記角度ずれθs情報に基づく方向制御処理を
行う。移動方向検出処理(図6)では、先ず、設定距離
を走行する毎に、テレビカメラS1からの撮像画像を取
り込み(図9(イ))、この画像に対して、ノイズ除去
のためのフィルタ処理と、設定閾値で2値化して苗Tに
対応する苗領域Taを抽出する処理と、図9(ロ)に示
すような微小な偽の苗領域Ta’を除去するための縮体
・膨張処理を行い、さらに、前記遠近補正処理を行っ
て、図9(ハ)に示す苗領域Ta画像を得る。尚、図で
は、3列状態で15個の苗領域Ta1〜Ta15が抽出
されている状態を示す。次に、各苗領域Taの重心位置
を求め、その各苗領域Taの重心が1つ前に取り込んだ
画像の各苗領域Taに含まれるか否かによって、連続す
る両画像間での対応する重心の判別処理(図7)を行
い、その両画像間で対応する重心を結ぶ直線の傾きを計
算してその方向を求める。
Next, the control operation by the control device 12 and the image processing device G will be described with reference to the flow charts shown in FIGS. When the control starts, in the main flow (FIG. 5), the detection processing of the machine body movement direction and the seedling row detection processing based on the information of the TV camera S1 are performed,
Next, determine whether it is an automatic driving mode or a manual driving mode,
In the manual traveling mode, traveling state display processing is performed, and in the automatic traveling mode, direction control processing based on the angle deviation θs information is performed. In the moving direction detection process (FIG. 6), first, every time the vehicle travels the set distance, a captured image from the television camera S1 is captured (FIG. 9A), and a filter process for noise removal is performed on this image. And a process of binarizing a seedling region Ta corresponding to the seedling T by binarization with a set threshold value, and a shrinking / expanding process for removing a minute false seedling region Ta ′ as shown in FIG. Then, the perspective correction process is performed to obtain the seedling area Ta image shown in FIG. The figure shows a state in which 15 seedling areas Ta1 to Ta15 are extracted in a three-row state. Next, the barycentric position of each seedling area Ta is obtained, and it is determined whether or not the center of gravity of each seedling area Ta is included in each seedling area Ta of the previously captured image. The center of gravity determination processing (FIG. 7) is performed, the inclination of the straight line connecting the corresponding centers of gravity between the two images is calculated, and the direction is obtained.

【0032】上記対応する重心の判別処理(図7)で
は、今回の画像(g2)での各苗領域Taの重心を前回
の画像(g1)上にプロットし(図10参照)、そのプ
ロットした今回の画像(g2)での各苗領域Taの重心
(x2,y2)を含む前回の画像(g1)での各苗領域
Taを検出して、その検出された前回の画像(g1)で
の各苗領域Taの重心(x1,y1)を対応する重心と
する。
In the corresponding center-of-gravity discrimination processing (FIG. 7), the center of gravity of each seedling area Ta in the current image (g2) is plotted on the previous image (g1) (see FIG. 10), and is plotted. Each seedling area Ta in the previous image (g1) including the center of gravity (x2, y2) of each seedling area Ta in this image (g2) is detected, and the detected previous image (g1) in The center of gravity (x1, y1) of each seedling area Ta is set as the corresponding center of gravity.

【0033】苗列検出処理(図8)では、先ず、前記移
動方向検出処理(図6)において記憶されている遠近補
正後の苗領域Ta情報を入力し、図9(ハ)に示すよう
に、画面を左右に2分割して左右の各画面GL,GRで
苗領域Taの面積比を求める。具体的には、各画面G
L,GRにおいて、縦32画素×横16画素(合計51
2画素)のうちで苗領域Taに対応する画素(画素値
が’1’)の数を計数すると、面積比は、(苗領域Ta
の画素数)/512になるが、ここでは、その苗領域T
aの画素数SL,SRそのものの大小を比較して、左側
の画面での画素数SLが右側の画面での画素数SRより
も大きければ、画面左側が既植作業地であり、逆に右側
の画面での画素数SRが左側の画面での画素数SLより
も大きければ、画面右側が既植作業地であると判断す
る。そして、画面左側が既植作業地であれば、画面横方
向で最も右寄りの苗領域Taつまり既植作業地の右端点
の画素を判別し、画面右側が既植作業地であれば、画面
横方向で最も左寄りの苗領域Taつまり既植作業地の左
端点の画素を判別する。そして、上記未植作業地に隣接
する既植作業地の端点の画素を結んだ線分Lを直線近似
して求める。
In the seedling row detecting process (FIG. 8), first, the perspective-corrected seedling area Ta information stored in the moving direction detecting process (FIG. 6) is input, and as shown in FIG. , The screen is divided into left and right, and the area ratio of the seedling region Ta is calculated on each of the left and right screens GL and GR. Specifically, each screen G
In L and GR, 32 vertical pixels x 16 horizontal pixels (51 in total)
When the number of pixels (pixel value is “1”) corresponding to the seedling area Ta out of 2 pixels is counted, the area ratio becomes (seedling area Ta
Number of pixels) / 512, but here the seedling area T
If the number SL of pixels on the left side screen is larger than the number SR of pixels on the right side screen, the left side of the screen is the planted work site, and conversely the right side. If the number of pixels SR on the screen is larger than the number of pixels SL on the left screen, it is determined that the right side of the screen is a planted work site. Then, if the left side of the screen is a planted work site, the rightmost seedling area Ta in the lateral direction of the screen, that is, the pixel at the right end point of the planted work site is determined. The leftmost seedling area Ta in the direction, that is, the pixel at the left end point of the planted work site is determined. Then, the line segment L connecting the pixels at the end points of the planted worksite adjacent to the unplanted worksite is obtained by linear approximation.

【0034】尚、テレビカメラS1の撮像情報に基づい
て、作業行程の終端部に達したか否かも判別する。具体
的には、図12に示すように、機体横幅方向に並ぶ複数
個の苗領域Taの夫々を機体横幅方向に結ぶ線分を直線
近似にて求め、その直線近似した直線の撮像画面の左右
両端部夫々での画面上端からの距離P1,P2の値を、
作業行程終端部までの距離に対応する位置情報として求
める。そして、その距離P1,P2の平均した値が、設
定値以上になると、作業行程終端部に走行したと判断
し、自動走行モードでは、設定距離走行後に自動停止す
る。
It should be noted that it is also determined based on the image pickup information of the television camera S1 whether or not the end of the work process has been reached. Specifically, as shown in FIG. 12, a line segment that connects each of the plurality of seedling regions Ta arranged in the machine lateral width direction in the machine lateral width direction is obtained by linear approximation, and the straight line approximated to the left and right of the imaging screen is obtained. The values of the distances P1 and P2 from the upper edge of the screen at both ends are
It is obtained as position information corresponding to the distance to the end of the work process. Then, when the average value of the distances P1 and P2 becomes equal to or greater than the set value, it is determined that the vehicle has traveled to the work stroke end portion, and in the automatic travel mode, the vehicle automatically stops after traveling the set distance.

【0035】〔別実施形態〕上記実施例では、撮像手段
としてテレビカメラS1を用いて可視光をカットした赤
外線による撮像画像を得て、その赤外線画像を2値化し
て撮像対象物(苗T)の画像領域に対応する対象物領域
(苗領域Ta)を抽出するようにしたが、例えば、三原
色情報R,G,Bによるカラー画像を撮像するカラー式
のテレビカメラを用い、そのカラー画像において撮像対
象物(苗T)と背景(泥田)との色の違いによって対象
物領域を抽出するようにしてもよい。
[Other Embodiments] In the above embodiment, a television camera S1 is used as an image pickup means to obtain a picked-up image by infrared rays in which visible light is cut, and the infrared image is binarized to obtain an image pickup object (seedling T). Although the target area (seedling area Ta) corresponding to the image area is extracted, for example, a color type television camera for capturing a color image based on the three primary color information R, G, B is used, and an image is captured in the color image. The target area may be extracted based on the color difference between the target (seedling T) and the background (mud).

【0036】上記実施例では、撮像手段(テレビカメラ
S1)を設定移動距離毎に撮像作動させたが、例えば変
速状態検出用ポテンショメータR3の検出情報から得ら
れる車速の情報を使って上記設定移動距離に相当する設
定移動時間を判別して、その設定移動時間毎に撮像作動
させてもよい。
In the above embodiment, the image pickup means (television camera S1) is operated for each set moving distance. However, the set moving distance is set using the vehicle speed information obtained from the detection information of the shift state detecting potentiometer R3, for example. It is also possible to discriminate the set movement time corresponding to, and perform the imaging operation for each of the set movement times.

【0037】上記実施例では、移動方向検出手段101
が、連続して撮像された両画像間における撮像対象物
(苗T)の位置ずれ方向として、その両画像間において
重なる対象物領域(苗領域Ta)同士を結ぶ直線の方向
を求めたが、位置ずれ方向を判別するのはこれに限るも
のではない。例えば、撮像対象物が比較的大きい間隔を
隔てて存在するような場合には、重ならない状態で最も
近接して位置する対象物領域同士を結ぶ直線の方向を求
めてもよい。
In the above embodiment, the moving direction detecting means 101
However, the direction of the straight line connecting the object regions (seedling regions Ta) that overlap each other between the two images is obtained as the position shift direction of the imaged target (seedling T) between the continuously captured images. It is not limited to this to determine the misalignment direction. For example, when the imaged objects are present at relatively large intervals, the direction of the straight line connecting the object areas closest to each other in the non-overlapping state may be obtained.

【0038】又、上記両画像間において、対象物領域
(苗領域Ta)の重なりを判別するのに、一方の画像に
おける対象物領域の代表点(重心)を求めて、その各重
心が他方の画像における対象物領域に含まれるときに重
なっていると判別したが、このような代表点を求めず
に、一方の対象物領域が一部分でも他方の対象物領域に
含まれるか否かによって重なりを判別するようにしても
よい。
Further, in order to determine the overlap of the object areas (seedling areas Ta) between the two images, a representative point (center of gravity) of the object areas in one image is obtained, and each of the centers of gravity represents the other. It was determined that they overlap when they are included in the object region in the image, but without obtaining such a representative point, the overlap is determined by whether or not one of the object regions is included in the other object region. You may make it discriminate.

【0039】上記実施例では、作業車が植付け作業車で
あって、未植作業地に対して撮像対象物としての複数個
の作物の苗Tを植え付ける場合を例示したが、これ以外
に、上記苗Tに対して肥料である薬剤を散布する薬剤散
布車等の農作業車、あるいは、その他の作業車であって
もよい。又、撮像対象物は、作物の苗Tに限るものでは
なく、地上側に互いに間隔を隔てて複数個存在するもの
であればよい。
In the above embodiment, the work vehicle is the planting work vehicle, and the seedlings T of a plurality of crops as the image pickup objects are planted in the unplanted work site. It may be an agricultural work vehicle such as a chemical spraying vehicle for spraying a chemical agent as fertilizer onto the seedling T, or another work vehicle. The object to be imaged is not limited to the seedling T of the crop, and may be a plurality of objects to be imaged on the ground side at intervals.

【0040】上記実施例では、手動操向用の情報として
画像表示手段13に表示したり、ありは、自動走行用の
操向制御情報として使う変位を、撮像対象物(苗T)の
列方向に対する機体移動方向の角度ずれθsとして求め
たが、この角度ずれθsに加えて、境界Lに対する機体
横幅方向での位置ずれを求めるようにしてもよい。
In the above-described embodiment, the displacement used as the steering control information for the automatic display is displayed on the image display means 13 as the information for the manual steering, or in the column direction of the object to be imaged (seedling T). Although the angle deviation θs in the machine body movement direction with respect to is calculated, the position deviation in the machine width direction with respect to the boundary L may be calculated in addition to the angle deviation θs.

【0041】走行装置は、上記実施例のような車輪式の
走行装置1F,1R以外に、例えばクローラ走行装置等
であってもよい。
The traveling device may be, for example, a crawler traveling device in addition to the wheel type traveling devices 1F and 1R as in the above embodiment.

【0042】尚、特許請求の範囲の項に図面との対照を
便利にするために符号を記すが、該記入により本発明は
添付図面の構成に限定されるものではない。
In the claims, reference numerals are provided for convenience of comparison with the drawings, but the present invention is not limited to the configuration of the attached drawings by the entry.

【図面の簡単な説明】[Brief description of drawings]

【図1】植付け作業車の概略平面図FIG. 1 is a schematic plan view of a planting work vehicle.

【図2】同概略側面図FIG. 2 is a schematic side view of the same.

【図3】制御構成のブロック図FIG. 3 is a block diagram of a control configuration.

【図4】制御構成のブロック図FIG. 4 is a block diagram of a control configuration.

【図5】制御作動のフローチャートFIG. 5 is a flowchart of a control operation.

【図6】機体移動方向検出処理のフローチャートFIG. 6 is a flowchart of a body movement direction detection process.

【図7】機体移動方向検出処理のフローチャートFIG. 7 is a flowchart of processing for detecting a machine body movement direction.

【図8】苗列検出処理のフローチャートFIG. 8: Flow chart of seedling detection processing

【図9】画像処理の説明図FIG. 9 is an explanatory diagram of image processing.

【図10】画像処理の説明図FIG. 10 is an explanatory diagram of image processing.

【図11】画像表示手段の表示画面FIG. 11: Display screen of image display means

【図12】作業行程終端部での終端検出の説明図FIG. 12 is an explanatory diagram of end detection at the end of the work process.

【符号の説明】[Explanation of symbols]

S1 撮像手段 9 領域抽出手段 101 移動方向検出手段 104 画像変換手段 103 列方向検出手段 13 画像表示手段 102 表示制御手段 1F,1R 走行装置 100 制御手段 S1 image pickup means 9 area extraction means 101 moving direction detection means 104 image conversion means 103 column direction detection means 13 image display means 102 display control means 1F, 1R traveling device 100 control means

Claims (6)

【特許請求の範囲】[Claims] 【請求項1】 地上側に互いに間隔を隔てて複数個存在
する撮像対象物を撮像する撮像手段(S1)と、その撮
像手段(S1)の撮像情報に基づいて前記撮像対象物の
画像領域に対応する対象物領域を抽出する領域抽出手段
(9)と、その領域抽出手段(9)の領域情報に基づい
て機体移動方向を検出する移動方向検出手段(101)
とが設けられた作業車の方向検出装置であって、 前記撮像手段(S1)が、設定移動時間又は移動距離毎
に撮像作動され、 前記移動方向検出手段(101)は、前記設定移動時間
又は移動距離毎に連続して撮像された両画像間における
前記撮像対象物の位置ずれ方向を機体移動方向として判
別するように構成されている作業車の方向検出装置。
1. An image pickup means (S1) for picking up a plurality of image pickup objects existing at intervals on the ground side, and an image area of the image pickup object based on image pickup information of the image pickup means (S1). Area extracting means (9) for extracting the corresponding object area, and moving direction detecting means (101) for detecting the moving direction of the body based on the area information of the area extracting means (9).
A direction detection device for a working vehicle, wherein the image pickup means (S1) performs image pickup operation for each set moving time or moving distance, and the moving direction detecting means (101) sets the set moving time or A direction detecting device for a work vehicle configured to determine a direction in which a position of the imaged object is displaced between two images continuously captured for each moving distance as a machine body moving direction.
【請求項2】 前記移動方向検出手段(101)は、前
記両画像間において重なる前記対象物領域同士を結ぶ直
線の方向を前記位置ずれ方向とするように構成されてい
る請求項1記載の作業車の方向検出装置。
2. The work according to claim 1, wherein the moving direction detecting means (101) is configured to set a direction of a straight line connecting the object regions overlapping each other between the images as the position shift direction. Vehicle direction detection device.
【請求項3】 前記移動方向検出手段(101)は、前
記両画像のいずれか一方において求めた前記各対象物領
域の代表点が他方の画像における前記対象物領域に含ま
れるときに、その両対象物領域が前記両画像間において
重なっていると判別するように構成されている請求項2
記載の作業車の方向検出装置。
3. The moving direction detecting means (101), when a representative point of each of the object areas obtained in one of the images is included in the object area in the other image, 3. The configuration according to claim 2, wherein it is configured to determine that the object regions overlap between the images.
A device for detecting the direction of the work vehicle described.
【請求項4】 前記撮像手段(S1)が、作業地を斜め
下向きに撮像するように構成され、 前記撮像手段(S1)の撮像画像を鉛直下向きに撮像し
た状態の画像に変換する画像変換手段(104)が設け
られている請求項1、2又は3記載の作業車の方向検出
装置。
4. The image conversion means (S1) is configured to image a work site in a diagonally downward direction, and converts an image captured by the imaging means (S1) into an image in a vertically downward imaged state. The work vehicle direction detection device according to claim 1, 2 or 3, further comprising (104).
【請求項5】 前記撮像対象物が機体移動方向に沿って
列状に形成され、 請求項1、2、3又は4記載の作業車の方向検出装置に
おける作業車に、前記撮像対象物の列方向を検出する列
方向検出手段(103)と、この列方向検出手段(10
3)にて求めた前記撮像対象物の列方向に対する、前記
移動方向検出手段(101)にて求めた機体移動方向の
変位を示す画像及び前記撮像手段(S1)の撮像画像を
同一画面上に表示する画像表示手段(13)と、その画
像表示手段(13)を表示作動させる表示制御手段(1
02)とが設けられている作業車の走行状態表示装置。
5. The row of the imaged objects is formed on the work vehicle in the direction detecting device for the work vehicle according to claim 1, 2, 3 or 4, wherein the imaged objects are formed in a row along a moving direction of the machine body. A column direction detecting means (103) for detecting the direction, and this column direction detecting means (10
The image showing the displacement in the machine body movement direction obtained by the movement direction detection means (101) with respect to the column direction of the image pickup target obtained in 3) and the image pickup image of the image pickup means (S1) are displayed on the same screen. Image display means (13) for displaying and display control means (1) for displaying and operating the image display means (13).
02) and a traveling state display device for a work vehicle.
【請求項6】 前記撮像対象物が機体移動方向に沿って
列状に形成され、 請求項1、2、3又は4記載の作業車の方向検出装置に
おける作業車に、操向操作自在な走行装置(1F,1
R)と、前記撮像対象物の列方向を検出する列方向検出
手段(103)と、この列方向検出手段(103)にて
求めた前記撮像対象物の列方向に対する、前記移動方向
検出手段(101)にて求めた機体移動方向の変位情報
に基づいて前記走行装置(1F,1R)を操向制御する
制御手段(100)とが設けられている作業車の走行制
御装置。
6. The traveling object is capable of being steered by a work vehicle in the direction detecting device for a work vehicle according to claim 1, wherein the imaged objects are formed in a row along a moving direction of the machine body. Equipment (1F, 1
R), a column direction detecting means (103) for detecting the column direction of the image capturing object, and the moving direction detecting means (with respect to the column direction of the image capturing object obtained by the column direction detecting means (103) ( 101) A traveling control device for a work vehicle, which is provided with a control means (100) for controlling the steering of the traveling devices (1F, 1R) based on the displacement information in the machine body movement direction.
JP8037857A 1996-02-26 1996-02-26 Direction detector, traveling state display device and traveling controller for work wagon Pending JPH09224414A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP8037857A JPH09224414A (en) 1996-02-26 1996-02-26 Direction detector, traveling state display device and traveling controller for work wagon

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP8037857A JPH09224414A (en) 1996-02-26 1996-02-26 Direction detector, traveling state display device and traveling controller for work wagon

Publications (1)

Publication Number Publication Date
JPH09224414A true JPH09224414A (en) 1997-09-02

Family

ID=12509222

Family Applications (1)

Application Number Title Priority Date Filing Date
JP8037857A Pending JPH09224414A (en) 1996-02-26 1996-02-26 Direction detector, traveling state display device and traveling controller for work wagon

Country Status (1)

Country Link
JP (1) JPH09224414A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112884850A (en) * 2021-03-22 2021-06-01 上海易教科技股份有限公司 Method and device for acquiring picture for track identification

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112884850A (en) * 2021-03-22 2021-06-01 上海易教科技股份有限公司 Method and device for acquiring picture for track identification
CN112884850B (en) * 2021-03-22 2024-02-13 上海易教科技股份有限公司 Method and device for acquiring pictures for track identification

Similar Documents

Publication Publication Date Title
JPH04313199A (en) Distance between cars detector
WO2017108764A1 (en) Guidance system and method for providing guidance
JPH09224415A (en) Direction detector, traveling state display device and traveling controller for work wagon
JPH09224417A (en) Auxiliary device for working vehicle
JPH09224414A (en) Direction detector, traveling state display device and traveling controller for work wagon
JP2815760B2 (en) Crop row detector
JPH0628032A (en) Traveling control device for automatic traveling working vehicle
JPH06149362A (en) Planting state detector for farm product planting machine
JPH09168315A (en) Boundary detector, display device for running stage and running control device in working vehicle
JPH09201110A (en) Direction detector, running state displaying device and running controller of working vehicle
JPH09201109A (en) Direction detector, running state displaying device and running controller of working vehicle
JP2907641B2 (en) Work area detection device
JPH0520042B2 (en)
JP2667462B2 (en) Automatic steering control device for agricultural work machine
JPH0746084Y2 (en) Automatic steering device for work vehicles
JP2684024B2 (en) Automatic steering system for work vehicles
JP2710644B2 (en) Automatic steering control device for agricultural work machine
JPH01211410A (en) Crop row detection apparatus of farm working machine
JP2583583B2 (en) Automatic rudder control device for agricultural work machine
JP2505403Y2 (en) Automatic steering device for transplanter
JP2593165B2 (en) Automatic steering detection device for agricultural work machine
JPH01262706A (en) Device for automatic steering of working car
JPH07184437A (en) Planting state detecting device for crop planting machine
JPH0729777Y2 (en) Automatic steering device for transplanter
JPH01269406A (en) Automatic steering device of vehicle for operation