JPS6388985A - Moving object recognizing circuit - Google Patents

Moving object recognizing circuit

Info

Publication number
JPS6388985A
JPS6388985A JP23482286A JP23482286A JPS6388985A JP S6388985 A JPS6388985 A JP S6388985A JP 23482286 A JP23482286 A JP 23482286A JP 23482286 A JP23482286 A JP 23482286A JP S6388985 A JPS6388985 A JP S6388985A
Authority
JP
Japan
Prior art keywords
signals
moving object
signal
circuit
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP23482286A
Other languages
Japanese (ja)
Inventor
Shigeru Nishimura
茂 西村
Toshihisa Kuroda
黒田 俊久
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Priority to JP23482286A priority Critical patent/JPS6388985A/en
Priority to US07/023,663 priority patent/US4805018A/en
Publication of JPS6388985A publication Critical patent/JPS6388985A/en
Pending legal-status Critical Current

Links

Landscapes

  • Closed-Circuit Television Systems (AREA)

Abstract

PURPOSE:To extract image of moving object above a specified value and recognize the position on the image correctly by removing signals caused by trembling objects such as tremor of tree leaves due to wind, etc., from an outdoor landscape image. CONSTITUTION:One picture signal is inputted to a memory 2 and a moving object extracting and operating circuit 4 to separate and extract contour signals of only moving objects from background image from image signals of a camera 1. On the other hand, image signals are outputted from the memory 2 conforming timing with output signals of a shift register 3, and inputted to the moving object extracting and operating circuit 4 through a shift register 7, and only signals for moving object is extracted to obtain output signals 10. Then, output signals of the memory 2 are inputted to pulse generating circuits 8, 9 for checking tremor signals. Then, output signals 10,11 are inputted to an AND circuit 12 and tremor signals are outputted. When signals 14 are within the pulse width of signals 15, output from an AND circuit 16 is checked by a shift register 13 and the AND circuit 16 as vertical tremor signals.

Description

【発明の詳細な説明】 産業上の利用分野 本発明は、テレビカメラなどの撮像装置により得られる
画像において、移動物体を複雑な静的背景画面と分離し
て抽出する移動物体認識回路に関するものである。
DETAILED DESCRIPTION OF THE INVENTION Field of Industrial Application The present invention relates to a moving object recognition circuit that separates and extracts moving objects from a complex static background screen in images obtained by an imaging device such as a television camera. be.

従来の技術 近年、テレビカメラの普及に伴いその利用分野は、例え
ば監視用途、産業用ロボットの視覚的用途、医学教育用
途などに拡大されつつある。これらの用途は、単に画像
を再生し、画面を用いて確認する程度のものが多かった
が、近年、FA (工場自動化)、ロボット、遠隔監視
などの用途では画像によってテレビカメラ自体の撮像角
度を制御させたり、特定の移動物体を監視したり、追尾
撮像させることなどが要求されている。而して従来にお
いては、画面上の移動物体を人間が指定することによっ
て、その物体を画面上で追跡する方法などがある。
BACKGROUND OF THE INVENTION In recent years, as television cameras have become more widespread, their fields of use are expanding to include, for example, surveillance applications, visual applications for industrial robots, and medical education applications. In most of these applications, images were simply played back and confirmed using the screen, but in recent years, in applications such as FA (factory automation), robots, and remote monitoring, images have been used to determine the imaging angle of the TV camera itself. There are demands for controlling, monitoring specific moving objects, tracking and imaging, etc. Conventionally, there is a method in which a person specifies a moving object on the screen and the object is tracked on the screen.

発明が解決しようとする問題点 しかし画面上の移動物体を認識し、常にカメラをパンテ
ィルトさせて移動物体を画面上に追尾していくシステム
では、外景などの撮像においては風などによる微動、カ
メラ取付は架台等の微動、撮像カメラの残像等特性上に
起因するものなど電気信号として発生する等測的微動信
号が原因で所望の移動物体の追尾が正確に出来ない場合
が発生する。
Problems to be Solved by the Invention However, with a system that recognizes moving objects on the screen and constantly pans and tilts the camera to track the moving objects on the screen, it is difficult to capture images of external scenes due to slight movements caused by wind, etc. During installation, there are cases where the desired moving object cannot be accurately tracked due to isometric micro-movement signals generated as electrical signals, such as micro-movement of the pedestal, etc., and characteristics such as afterimages of the imaging camera.

こうした微動信号と区別して、テレビ画面上で大きく移
動する物体の位置を認識したり、この位置データを用い
てテレビカメラで移動物体を自動的に連続追尾する方法
が必要である。
There is a need for a method to differentiate from such micro-motion signals and recognize the position of objects that move significantly on a television screen, and to automatically and continuously track moving objects with a television camera using this position data.

とりわけ、連続して発生するテレビ画面から、ある間隔
を保って発生した2画面信号間の演算で移動物体像信号
を抽出し、この抽出信号から移動物体の位置をテレビ画
面上で認識し、またこの認識によって移動物体像を画面
中央部に再生追尾できるようにした場合、テレビカメラ
の撮像するシーンが屋外風景などの際は、風等による木
の葉のゆれも移動物体として抽出認識してしまう。そし
て、この様な微動信号は必要としない場合が多い。
In particular, a moving object image signal is extracted from a continuously occurring television screen by calculation between two screen signals generated at a certain interval, and the position of the moving object is recognized on the television screen from this extracted signal. If this recognition allows the image of a moving object to be reproduced and tracked in the center of the screen, if the scene captured by the television camera is an outdoor landscape, the shaking of leaves caused by the wind or the like will also be extracted and recognized as a moving object. In many cases, such a fine movement signal is not necessary.

特に画面上の大きく移動する物体の追尾撮像において、
微動信号はテレビカメラの追尾制御信号に対してはノイ
ズ信号として作用する。
Especially when tracking and imaging large moving objects on the screen.
The slight movement signal acts as a noise signal on the tracking control signal of the television camera.

また2画面間の演算時、一方の信号に時間的に微小なジ
ッタを起すと静止部の信号でも完全に消えずノイズ的な
残留信号を抽出してしまう。
Furthermore, when performing calculations between two screens, if a minute jitter occurs in one signal in time, even the signal of a stationary portion will not disappear completely and a noise-like residual signal will be extracted.

本発明は上記従来技術に鑑み、風等による木の葉などの
微動物体を移動物体認識から除去する移動物体認識回路
を提供するものである。
In view of the above prior art, the present invention provides a moving object recognition circuit that removes microscopic objects such as leaves caused by the wind from moving object recognition.

問題点を解決するための手段 本発明は移動物体像信号抽出回路により、比較する基準
輪郭画像信号をカバーする微動阻止パルス信号を発生さ
せ、後続の輪郭画像信号と前記基準輪郭画像信号間の演
算による移動物体像抽出信号に作用させ、予め設定した
微動阻止パルス信号のパルス幅を越えた移動物体像信号
のみを真の移動物体信号として抽出して微動信号を除去
するようにしたものである。
Means for Solving the Problems The present invention uses a moving object image signal extraction circuit to generate a fine movement prevention pulse signal that covers a reference contour image signal to be compared, and performs an operation between a subsequent contour image signal and the reference contour image signal. The moving object image extraction signal is applied to the moving object image extraction signal, and only the moving object image signal that exceeds the pulse width of the preset fine movement prevention pulse signal is extracted as a true moving object signal, and the fine movement signal is removed.

作用 本発明は上記構成によシ、後続の輪郭信号であるパルス
位相が前記阻止パルス幅以内で変化した場合は移動物体
抽出信号として出力されないので、移動物体信号の画面
上での重心位置の算出がより正確に行える。
According to the above-described configuration, the present invention does not output a moving object extraction signal when the pulse phase of the subsequent contour signal changes within the blocking pulse width, so that the center of gravity position of the moving object signal on the screen cannot be calculated. can be done more accurately.

実施例 第1図は本発明に基づく一実施例を説明するための移動
物体認識回路の構成図である。同図において、1はテレ
ビカメラで撮像した画像の輪郭化信号、2は画像信号1
画面分を記憶させるメモ刃、3は位相補償用のシフトレ
ジスタ回路、4はメモリ2で読み出した一画面信号と後
続の画信号との演算による移動物体像信号抽出回路であ
る。5は微動信号を除去する回路で、とりわけ、この回
路5において、6.7は画像の水平方向の微動阻止範囲
設定用のシフトレジスタ8.9はそれぞれ水平方向と垂
直方向の微動阻止パルス発生回路、11.15は上記各
パルス発生回路の出力信号、10はシフトレジスタ6.
7の出力信号を移動物体抽出演算回路4に入力して移動
物体の輪郭成分を抽出した信号、12.16はAND回
路、13は垂直方向シフトレジスタである。
Embodiment FIG. 1 is a configuration diagram of a moving object recognition circuit for explaining an embodiment based on the present invention. In the figure, 1 is a contouring signal of an image captured by a television camera, and 2 is an image signal 1.
3 is a shift register circuit for phase compensation; and 4 is a moving object image signal extraction circuit that calculates the one-screen signal read out from the memory 2 and the subsequent image signal. Reference numeral 5 denotes a circuit for removing a fine movement signal. Particularly in this circuit 5, 6.7 is a shift register for setting a fine movement prevention range in the horizontal direction of the image. 9 is a circuit for generating fine movement prevention pulses in the horizontal and vertical directions, respectively. , 11.15 are output signals of each of the above-mentioned pulse generation circuits, and 10 is a shift register 6.
The output signal of 7 is input to the moving object extraction calculation circuit 4 to extract the contour component of the moving object, 12.16 is an AND circuit, and 13 is a vertical shift register.

次に第1図に基づいて上記構成の動作について説明する
Next, the operation of the above configuration will be explained based on FIG.

まず、テレビカメラlの画像信号から抽出した画像の輪
郭信号にはカメラレンズの視野範囲に含む移動物体と背
景像が含まれる。移動物体のみの輪郭信号を背景像と分
離して抽出するために先ず任意の時間t、に入力した一
画面信号をメモリ2に記憶させる。次に11秒後の後続
一画面を各レジスタ3と6を介し、移動物体抽出演算回
路4に入力する。
First, the contour signal of the image extracted from the image signal of the television camera l includes a moving object and a background image included in the field of view of the camera lens. In order to extract the contour signal of only the moving object separately from the background image, first, a one-screen signal inputted at an arbitrary time t is stored in the memory 2. Next, the subsequent screen after 11 seconds is input to the moving object extraction calculation circuit 4 via the registers 3 and 6.

一方シフトVジスタ3の出力信号とタイミングを合せて
メモリ2よりto時の画像信号を出力させ、シフトレジ
スタ7を介し移動物体抽出演算回路4に入力する。
On the other hand, the image signal at the time of "TO" is outputted from the memory 2 in synchronization with the output signal of the shift V register 3, and is inputted to the moving object extraction calculation circuit 4 via the shift register 7.

移動物体抽出演算回路4では10秒と1.秒時の一画面
について情報を比較し移動物体に対する信号のみを抽出
して出力信号10を得る。
The moving object extraction calculation circuit 4 takes 10 seconds and 1. The information for one screen per second is compared and only the signal for the moving object is extracted to obtain the output signal 10.

ここでシフトレジスタ6と7は微動信号除去節囲の百を
決めるために設けておく。
Here, the shift registers 6 and 7 are provided to determine the range of the minute signal removal section.

次にメモリ2の出力信号を微動信号阻止用パルス発生回
路8と9に入力する。このパルス発生回路8は画面の水
平方向に対する微動信号阻止用、パルス発生回路9は同
じく垂直方向に対する微動信号阻止用のものである。
Next, the output signal of the memory 2 is inputted to the pulse generation circuits 8 and 9 for blocking fine movement signals. The pulse generating circuit 8 is used to block fine movement signals in the horizontal direction of the screen, and the pulse generating circuit 9 is also used to block fine movement signals in the vertical direction.

本実施例では水平方向の一走査線に対し256画素を有
し、水平方向の上記パルス幅は4〜6画素分に設定して
いる。また垂直方向のパルス幅は4〜6走査線分に設定
し充分目的を達成できる。
In this embodiment, one horizontal scanning line has 256 pixels, and the horizontal pulse width is set to 4 to 6 pixels. Further, the vertical pulse width can be set to 4 to 6 scanning lines to sufficiently achieve the purpose.

なお、パルス発生回路8.9はメモリ2より出力された
2値化パルス状信号であるから、たとえばモノステープ
ルマルチパイプレータで構成できる。
It should be noted that since the pulse generating circuit 8.9 generates a binary pulsed signal outputted from the memory 2, it can be constituted by, for example, a monostaple multipipelator.

次に移動物体抽出演算回路4と微動信号阻止用パルス発
生回路との出力信号10と11をAND回路12に出力
する。例えば1画素幅のパルス出力信号10が4画素分
のパルス幅に設定した信号11の幅内にあれば、出力信
号10は水平方向の微動信号と着像しアンド回路12の
出力信号として阻止する機能をもたせることができる。
Next, output signals 10 and 11 from the moving object extraction calculation circuit 4 and the pulse generation circuit for blocking a fine movement signal are outputted to the AND circuit 12. For example, if the pulse output signal 10 of one pixel width is within the width of the signal 11 set to the pulse width of four pixels, the output signal 10 will be imaged as a horizontal micro-motion signal and will be blocked as an output signal of the AND circuit 12. It can have functions.

またパルス出力信号10がこの4画素分以上移動してい
わば移動信号としてAND回路12よシ出力信号を出力
させる。
Furthermore, the pulse output signal 10 moves by more than these four pixels, so that the AND circuit 12 outputs an output signal as a moving signal.

また全く静止した背景像部分は移動物体抽出回路4の演
算で出力信号10は信号として存在しない様になってい
る。しかし後続の信号にノイズが重畳していたり、カメ
ラの前画像に対する微動による画像のズレ、一方の信号
のジッタがあった場合微動信号として出力されていく。
Further, in the completely stationary background image portion, the moving object extraction circuit 4 calculates so that the output signal 10 does not exist as a signal. However, if noise is superimposed on the subsequent signal, there is a shift in the image due to slight movement with respect to the previous image of the camera, or there is jitter in one of the signals, it will be output as a slight movement signal.

さらに画像に含む移動物体を追尾制御する場合は機構的
に発生する2画面比較時の微動、カメラのパンティルト
後の撮像センサの残像等による2画面間の輪郭信号の立
上り差分等によっても微動信号がAND回路12より出
力されていく。
Furthermore, when tracking a moving object included in an image, micro-movement signals may be generated due to mechanically generated micro-movements when comparing two images, or differences in the rise of contour signals between two images due to afterimages on the image sensor after camera pan-tilt. is output from the AND circuit 12.

そこで、出力信号15によシ、垂直方向に対し同様の効
果をもたせる。すなわち、垂直方向の微動信号阻止パル
ス幅の7時間を設定しているシフトレジスタ13と、A
ND回路16で、信号14が信号15のパルス幅内にあ
れば垂直微動信号として、AND回路16よりの出力を
阻止するように機能をもたせである。また出力信号14
が前記パルス幅を越えた位相にあれば移動物体の信号と
着像してAND回路16より出力される。
Therefore, the output signal 15 is made to have a similar effect in the vertical direction. That is, the shift register 13 which sets the vertical direction fine movement signal blocking pulse width of 7 hours, and the A
If the signal 14 is within the pulse width of the signal 15, the ND circuit 16 treats it as a vertical fine movement signal and blocks the output from the AND circuit 16. Also, the output signal 14
If the phase exceeds the pulse width, the signal is imaged with the signal of the moving object and outputted from the AND circuit 16.

以上の構成により画面の移動物体の検知が不必要な微動
信号の発生とそれによる位置検知誤差を廃除して正確に
行なうことができる。
With the above configuration, it is possible to accurately detect a moving object on the screen by eliminating the generation of unnecessary micro-movement signals and position detection errors caused by them.

なお、移動物体抽出演算回路4については、たとえば特
願昭61−90434号に記載の如く、第2図K 示ス
A N D 回路21、EXCLUSIVEOR回路2
2の論理回路により構成できるので、詳細な説明は割愛
する。
Regarding the moving object extraction calculation circuit 4, as described in Japanese Patent Application No. 61-90434, for example, as shown in FIG.
2, the detailed explanation will be omitted.

発明の効果 以上のように本発明は屋外の風景画像中から風等による
木の葉など微動物体による信号を除去し、一定値以上の
移動物体像抽出とその画像上での位置を正しく認知でき
る。
Effects of the Invention As described above, the present invention removes signals caused by microscopic objects such as leaves caused by the wind, etc. from an outdoor landscape image, extracts images of moving objects exceeding a certain value, and correctly recognizes their positions on the image.

また2画面間の演算時、微小な時間的変化によって残留
する不必要なノイズを除去することができる。
Furthermore, unnecessary noise that remains due to minute temporal changes can be removed during calculations between two screens.

【図面の簡単な説明】[Brief explanation of the drawing]

第1図は本発明の一実施例における移動物体認識回路の
ブロック結線図、第2図は同要部回路図である。 2・・・メモリ、3・・・シフトレジスタ、4・・・移
動物体像信号演算回路、5・・・微動信号阻止回路部、
6.7.13・・・水平および垂直シフトレジスタ、8
.9・・・水平および垂直方向微動信号阻止パルス発生
回路、12.16・・・AND回路。
FIG. 1 is a block diagram of a moving object recognition circuit according to an embodiment of the present invention, and FIG. 2 is a circuit diagram of the main parts thereof. 2... Memory, 3... Shift register, 4... Moving object image signal calculation circuit, 5... Fine movement signal blocking circuit section,
6.7.13...Horizontal and vertical shift registers, 8
.. 9...Horizontal and vertical direction fine movement signal blocking pulse generation circuit, 12.16...AND circuit.

Claims (1)

【特許請求の範囲】[Claims] テレビ画像の第1画像情報と、その後続の第2画像情報
から、移動物体に対する画像情報のみを抽出する移動物
体抽出演算回路と、前記移動物体抽出演算回路の出力に
対し、予め設定した微動阻止パルス信号のパルス幅を越
えた移動物体像信号のみを真の移動物体信号として抽出
して微動信号を除去する移動物体像信号抽出回路とを具
備する移動物体認識回路。
a moving object extraction calculation circuit that extracts only image information regarding a moving object from the first image information of the television image and the subsequent second image information; and a preset micro-motion prevention circuit for the output of the moving object extraction calculation circuit. A moving object recognition circuit comprising a moving object image signal extraction circuit that extracts only a moving object image signal exceeding the pulse width of a pulse signal as a true moving object signal and removes a minute movement signal.
JP23482286A 1986-03-07 1986-10-02 Moving object recognizing circuit Pending JPS6388985A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP23482286A JPS6388985A (en) 1986-10-02 1986-10-02 Moving object recognizing circuit
US07/023,663 US4805018A (en) 1986-03-07 1987-03-09 Video signal processing apparatus for separating an image of a moving object from video signals

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP23482286A JPS6388985A (en) 1986-10-02 1986-10-02 Moving object recognizing circuit

Publications (1)

Publication Number Publication Date
JPS6388985A true JPS6388985A (en) 1988-04-20

Family

ID=16976926

Family Applications (1)

Application Number Title Priority Date Filing Date
JP23482286A Pending JPS6388985A (en) 1986-03-07 1986-10-02 Moving object recognizing circuit

Country Status (1)

Country Link
JP (1) JPS6388985A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008268860A (en) * 2007-04-17 2008-11-06 Beijing Boe Optoelectronics Technology Co Ltd Liquid crystal display, and manufacturing method and repairing method thereof
JP2008305169A (en) * 2007-06-07 2008-12-18 Denso Corp Motion determination device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008268860A (en) * 2007-04-17 2008-11-06 Beijing Boe Optoelectronics Technology Co Ltd Liquid crystal display, and manufacturing method and repairing method thereof
US8654053B2 (en) 2007-04-17 2014-02-18 Beijing Boe Optoelectronics Technology Co., Ltd. Liquid crystal display device, manufacturing method and repair method thereof
JP2008305169A (en) * 2007-06-07 2008-12-18 Denso Corp Motion determination device

Similar Documents

Publication Publication Date Title
US4805018A (en) Video signal processing apparatus for separating an image of a moving object from video signals
CN102611872B (en) Scene image conversion system and method based on area-of-interest dynamic detection
US20080211903A1 (en) Image processing of regions in a wide angle video camera
US20120038776A1 (en) Automatically Expanding the Zoom Capability of a Wide-Angle Video Camera
US20050185058A1 (en) Image stabilization system and method for a video camera
JPS63166370A (en) Picture movement correcting device
JP2010114752A (en) Device and method of imaging and program
JPH03138595A (en) Moving body detecting device
JP3227179B2 (en) Moving object detection and tracking processing method
JPH06268894A (en) Automatic image pickup device
JPS6388985A (en) Moving object recognizing circuit
JPH0962444A (en) Indication information input device
JPS6388986A (en) Moving object tracking device
JPS63261482A (en) Moving object recognizing circuit
JP2832960B2 (en) Distance measurement area setting device
JP2000175101A (en) Automatic tracking device
JPH0783474B2 (en) Automatic tracking imaging device
KR100278989B1 (en) Closed Circuit Monitoring Apparatus and Method
JP2832053B2 (en) Automatic focusing device
JPS62245891A (en) Picture separation and extraction device
JP3109812B2 (en) Imaging device
JP2804644B2 (en) Imaging device
JP2675807B2 (en) Imaging device
JP3126998B2 (en) Motion vector detection device
JPH05236321A (en) Image processor