JP2008199389A - Monitoring camera and monitoring camera control method - Google Patents

Monitoring camera and monitoring camera control method Download PDF

Info

Publication number
JP2008199389A
JP2008199389A JP2007033785A JP2007033785A JP2008199389A JP 2008199389 A JP2008199389 A JP 2008199389A JP 2007033785 A JP2007033785 A JP 2007033785A JP 2007033785 A JP2007033785 A JP 2007033785A JP 2008199389 A JP2008199389 A JP 2008199389A
Authority
JP
Japan
Prior art keywords
subject
tracking
camera
imaging
person
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2007033785A
Other languages
Japanese (ja)
Other versions
JP5108323B2 (en
Inventor
Satoru Oyabu
覚 大藪
Kazuki Higuchi
和貴 樋口
Yasuharu Nakamura
靖治 中村
Yasuyuki Domoto
泰之 道本
Yuichiro Mori
雄一郎 森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Priority to JP2007033785A priority Critical patent/JP5108323B2/en
Priority to PCT/JP2008/000205 priority patent/WO2008099598A1/en
Publication of JP2008199389A publication Critical patent/JP2008199389A/en
Application granted granted Critical
Publication of JP5108323B2 publication Critical patent/JP5108323B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S3/00Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
    • G01S3/78Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using electromagnetic waves other than radio waves
    • G01S3/782Systems for determining direction or deviation from predetermined direction
    • G01S3/785Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system
    • G01S3/786Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system the desired condition being maintained automatically
    • G01S3/7864T.V. type tracking systems
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19608Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19639Details of the system layout
    • G08B13/19652Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm

Abstract

<P>PROBLEM TO BE SOLVED: To provide a monitoring camera and monitoring camera control method capable of smoothly tracking a subject even when the subject passes through around just under an imaging means. <P>SOLUTION: A just under traverse line Lc is previously set in a camera 12 by noticing that an advancing direction of a person who passes through just under the camera 12 can be limited to a direction of striding over a certain line perpendicularly many times. When a person being currently tracked approaches the just under traverse line Lc, the direction of the camera is set to a position of a linear symmetry with respect to the just under traverse line Lc where the person may advance, and the person who passes through just under the camera is caught to start tracking. Consequently, it is possible to smoothly perform automatic tracking around just under the camera. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

本発明は、被写体を自動追尾する監視カメラ及び監視カメラ制御方法に関する。   The present invention relates to a surveillance camera that automatically tracks a subject and a surveillance camera control method.

従来、監視カメラには、カメラ本体の撮像方向をパン方向、チルト方向に変える回転台付きのカメラを有し、このカメラをパン、チルト方向に制御すると共にカメラのズーム機能を制御して被写体を自動追尾するものがある(例えば、特許文献1参照)。   Conventionally, surveillance cameras have a camera with a turntable that changes the imaging direction of the camera body to the pan and tilt directions, and controls the camera in the pan and tilt directions and controls the zoom function of the camera to control the subject. There is one that automatically tracks (see, for example, Patent Document 1).

特開2002−27442号公報JP 2002-27442 A

しかしながら、上述した従来の監視カメラにおいては、被写体がカメラの真下付近を通過する場合、被写体が人物であれば、頭や肩部分しか写らないうえに、パン制御を行うと画面が回転する方向に動くことから、パン制御が難しくスムーズに追尾することができないという問題がある。因みに、人物を縦長の物体と想定しているので、頭や肩部分しか写らなくなると、当然ながら人物の特定が困難になる。   However, in the conventional surveillance camera described above, when the subject passes under the camera, if the subject is a person, only the head and shoulders are captured, and the panning control causes the screen to rotate. Since it moves, there is a problem that pan control is difficult and tracking cannot be performed smoothly. Incidentally, since it is assumed that the person is a vertically long object, if only the head and shoulders are captured, it is naturally difficult to identify the person.

本発明は、係る事情に鑑みてなされたものであり、被写体が撮像手段の真下付近を通過する場合でもスムーズに追尾することができる監視カメラ及び監視カメラ制御方法を提供することを目的とする。   The present invention has been made in view of such circumstances, and an object of the present invention is to provide a surveillance camera and a surveillance camera control method capable of smoothly tracking even when a subject passes near the vicinity of an imaging unit.

本発明の監視カメラは、被写体を撮像する撮像手段と、前記撮像手段をパン、チルト方向に移動させる回転台と、前記撮像手段で撮像された映像に対して追尾対象の被写体を特定するための映像処理を行って前記被写体を追尾するためのパン及びチルト情報を生成する映像処理手段と、前記映像処理手段で生成されたパン及びチルト情報に従って前記回転台を制御して前記被写体を追尾すると共に、前記被写体が前記撮像手段の真下付近に接近した場合に前記被写体の追尾を一時的に停止してその後の前記被写体の移動方向を予測し、予測した移動方向に対して前記回転台を制御することにより前記撮像手段の向きを変更して前記被写体が前記撮像手段の真下付近を通過した後に追尾を再開する追尾手段と、を備える。   The surveillance camera according to the present invention includes an imaging unit that images a subject, a turntable that moves the imaging unit in the pan and tilt directions, and a tracking target subject for identifying an image captured by the imaging unit. Video processing means for generating pan and tilt information for tracking the subject by performing video processing, and tracking the subject by controlling the turntable according to the pan and tilt information generated by the video processing means When the subject approaches close to the vicinity of the imaging means, the tracking of the subject is temporarily stopped to predict the moving direction of the subject, and the turntable is controlled with respect to the predicted moving direction. Tracking means for changing the direction of the imaging means and resuming tracking after the subject has passed near the imaging means.

上記構成によれば、被写体が撮像手段の真下付近に接近した場合に、その後の被写体の移動方向を予測して、その方向に対して撮像手段の向きを変更するので、被写体が撮像手段の真下付近を通過した後にスムーズに追尾を再開することが可能となる。   According to the above configuration, when the subject approaches the vicinity immediately below the imaging unit, the subsequent movement direction of the subject is predicted, and the direction of the imaging unit is changed with respect to that direction. Tracking can be resumed smoothly after passing the vicinity.

また、本発明の監視カメラは、前記追尾手段は、前記被写体が前記撮像手段の真下付近に接近した場合、前記撮像手段の真下位置を示す指標に対して線対称の位置に前記回転台を制御することにより前記撮像手段の向きを変更する。これは、通常、撮像手段の真下を通過する人物の進行方向は、ある線を垂直に跨ぐ方向に限定できる場合が多いことに着目したものである。   In the surveillance camera of the present invention, the tracking unit controls the rotating base at a line-symmetrical position with respect to an index indicating a position directly below the imaging unit when the subject approaches the vicinity of the imaging unit. By doing so, the orientation of the imaging means is changed. This is because the traveling direction of a person who passes right under the imaging means can usually be limited to a direction that straddles a certain line in many cases.

上記構成によれば、撮像手段の真下を横切る線(後述する実施の形態では、「真下横切りライン」と呼んでいる)を事前に設定しておき、この真下横切りラインに追尾中の被写体が近づいた場合には、この先進むであろう真下横切りラインに対して線対称の位置に撮像手段を向け、被写体を待ち構えることで、撮像手段真下付近での自動追尾をスムーズに行うことができる。   According to the above-described configuration, a line that traverses directly below the imaging means (referred to as a “directly transverse line” in the embodiments described later) is set in advance, and the subject being tracked approaches the transverse line that is directly below. In this case, by directing the imaging means to a position that is line-symmetric with respect to the straight line that will go forward, and waiting for the subject, automatic tracking near the imaging means can be performed smoothly.

また、本発明の監視カメラは、前記追尾手段は、前記撮像手段のパン、チルトによる位置変化を解析して、前記被写体が前記撮像手段の真下付近を通過した場合にその後の前記被写体の移動方向を予測し、予測した移動方向に対して前記回転台を制御することにより前記撮像手段の向きを変更する。   In the surveillance camera of the present invention, the tracking unit analyzes a change in position due to panning and tilting of the imaging unit, and when the subject passes near the imaging unit, the subsequent moving direction of the subject And the orientation of the imaging means is changed by controlling the turntable with respect to the predicted moving direction.

上記構成によれば、撮像手段のパン、チルトによる位置変化を解析して、被写体が撮像手段の真下付近を通過した場合に、その後の移動方向を予測し、その方向に対して撮像手段の向きを変更するので、撮像手段真下付近での自動追尾をスムーズに行うことができる。   According to the above configuration, the position change due to panning and tilting of the imaging unit is analyzed, and when the subject passes near the imaging unit, the subsequent moving direction is predicted, and the direction of the imaging unit with respect to the direction is predicted. Therefore, automatic tracking near the imaging means can be performed smoothly.

また、本発明の監視カメラ制御方法は、被写体を撮像する撮像手段で撮像された映像に対して追尾対象の被写体を特定するための映像処理を行って前記被写体を追尾するためのパン及びチルト情報を生成する映像処理工程と、前記映像処理工程で生成されたパン及びチルト情報に従って前記回転台を制御して前記被写体を追尾する追尾工程と、前記被写体が前記撮像手段の真下付近に接近した場合に前記被写体の追尾を一時的に停止してその後の前記被写体の移動方向を予測し、予測した前記被写体の移動方向に対して前記撮像手段の向きを変更して前記被写体が前記撮像手段の真下付近を通過した後に追尾を再開する追尾再開工程と、を備える。   Also, the surveillance camera control method of the present invention performs panning and tilt information for tracking the subject by performing video processing for specifying the subject to be tracked on the video imaged by the imaging means for imaging the subject. A video processing step for generating the image, a tracking step for tracking the subject by controlling the turntable according to the pan and tilt information generated in the video processing step, and a case where the subject is close to the vicinity of the imaging unit. The tracking of the subject is temporarily stopped to predict the moving direction of the subject thereafter, and the direction of the imaging unit is changed with respect to the predicted moving direction of the subject, so that the subject is directly below the imaging unit. A tracking resumption process for resuming tracking after passing the vicinity.

上記方法によれば、被写体が撮像手段の真下付近に接近した場合に、その後の被写体の移動方向を予測して、その方向に対して撮像手段の向きを変更するので、被写体が撮像手段の真下付近を通過した後にスムーズに追尾を再開することが可能となる。   According to the above method, when the subject approaches close to the vicinity of the imaging unit, the subsequent movement direction of the subject is predicted, and the direction of the imaging unit is changed with respect to that direction. Tracking can be resumed smoothly after passing the vicinity.

本発明の監視カメラ及び監視カメラ制御方法によれば、被写体が撮像手段の真下付近を通過する場合でもスムーズに追尾することができる。   According to the surveillance camera and surveillance camera control method of the present invention, it is possible to track smoothly even when the subject passes near the vicinity of the imaging means.

以下、本発明を実施するための好適な実施の形態について、図面を参照して詳細に説明する。   DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments for carrying out the invention will be described in detail with reference to the drawings.

(実施の形態1)
図1は、本発明の実施の形態1に係る監視カメラの概略構成を示すブロック図である。同図において、本実施の形態に係る監視カメラ1は、本監視カメラ1の各部を制御するカメラマイコン10と、カメラマイコン10を制御するためのプログラムを格納したフラッシュROM(Read Only memory)などの不揮発性のメモリ11と、被写体を撮像する撮像手段であるカメラ12と、カメラ12をパン及びチルト方向に向けるための回転台13と、カメラ12のパン方向の原点を検出するためのパン原点センサ14と、カメラ12のチルト方向の原点を検出するためのチルト原点センサ15と、パン原点センサ14及びチルト原点センサ15それぞれの検出結果とカメラマイコン10からのPT(PAN, TILT)制御指示に従って回転台13を制御するサーボマイコン・モータドライバ16と、カメラ12からの映像信号を基に動き検出、フレーム間差分などの処理を行って被写体である人物を特定し、特定した人物とカメラマイコン10から与えられるPTZ(PAN, TILT, ZOOM)位置情報とを基に追尾用のPTZ制御指示を生成し、カメラマイコン10に与える映像処理・自動追尾処理DSP(Digital Signal Processor)17とを備える。
(Embodiment 1)
FIG. 1 is a block diagram showing a schematic configuration of a surveillance camera according to Embodiment 1 of the present invention. In the figure, a surveillance camera 1 according to the present embodiment includes a camera microcomputer 10 that controls each part of the surveillance camera 1 and a flash ROM (Read Only memory) that stores a program for controlling the camera microcomputer 10. Non-volatile memory 11, camera 12 that is an imaging means for imaging a subject, turntable 13 for directing camera 12 in the pan and tilt directions, and pan origin sensor for detecting the origin of camera 12 in the pan direction 14, a tilt origin sensor 15 for detecting the origin of the camera 12 in the tilt direction, rotation results according to the detection results of the pan origin sensor 14 and the tilt origin sensor 15, and a PT (PAN, TILT) control instruction from the camera microcomputer 10. Based on the video signal from the servo microcomputer / motor driver 16 that controls the table 13 and the camera 12, motion detection and frame A person who is the subject is identified by performing processing such as inter-frame difference, and a PTZ control instruction for tracking is generated based on the identified person and PTZ (PAN, TILT, ZOOM) position information given from the camera microcomputer 10 And an image processing / automatic tracking process DSP (Digital Signal Processor) 17 provided to the camera microcomputer 10.

カメラ12は、ズームレンズ部121と、このズームレンズ部121を介して得られた映像を電気信号に変換するCCD(Charge Coupled Device)やCMOS(Complementary Metal Oxide Semiconductor)等の撮像素子122と、映像信号のレベルを一定にする制御を行ってデジタル変換するAGC(Automatic Gain Control)・A/D部123とを備える。   The camera 12 includes a zoom lens unit 121, an image sensor 122 such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) that converts an image obtained via the zoom lens unit 121 into an electrical signal, An AGC (Automatic Gain Control) and A / D unit 123 that performs digital conversion by performing control to keep the signal level constant is provided.

カメラマイコン10は、映像処理・自動追尾処理DSP17から入力されるPTZ制御指示に従い、パンとチルトに関するPT制御指示をサーボマイコン・モータドライバ16に与えて回転台13のパンモータ131とチルトモータ132を制御し、ズームに関するZ制御指示をカメラ12に与えてズームレンズ部121を制御する。また、カメラマイコン10は、電源投入時にサーボマイコン・モータドライバ16を制御すると共にカメラ12のズームレンズ部121を制御して原点位置を検出する。カメラマイコン10は、常時、カメラ12の位置情報を把握する。   The camera microcomputer 10 controls the pan motor 131 and the tilt motor 132 of the turntable 13 by giving a PT control instruction regarding pan and tilt to the servo microcomputer / motor driver 16 in accordance with the PTZ control instruction input from the video processing / automatic tracking process DSP 17. Then, a Z control instruction regarding zoom is given to the camera 12 to control the zoom lens unit 121. The camera microcomputer 10 controls the servo microcomputer / motor driver 16 when the power is turned on and also controls the zoom lens unit 121 of the camera 12 to detect the origin position. The camera microcomputer 10 always grasps the position information of the camera 12.

また、カメラマイコン10は、動作中、常にサーボマイコン・モータドライバ16から入力されるカメラ12のパン、チルトの位置情報と、カメラ12のズームレンズ部121から入力されるズーム情報とからPTZ位置情報を生成してこれを映像処理・自動追尾処理DSP17に入力し、また映像処理・自動追尾処理DSP17から入力されるPTZ制御指示に従ってサーボマイコン・モータドライバ16及びカメラ12のズームレンズ部121を制御して人物を追尾する。   In addition, the camera microcomputer 10 always receives PTZ position information from the pan / tilt position information of the camera 12 input from the servo microcomputer / motor driver 16 and the zoom information input from the zoom lens unit 121 of the camera 12 during operation. And is input to the video processing / automatic tracking processing DSP 17, and the servo microcomputer / motor driver 16 and the zoom lens unit 121 of the camera 12 are controlled in accordance with the PTZ control instruction input from the video processing / automatic tracking processing DSP 17. To track a person.

そして、人物がカメラ真下付近に接近した場合は、カメラマイコン10は、人物の追尾を一時的に停止し、カメラ12を事前に設定された指標(本実施の形態では「真下横切りライン」と呼ぶ)と線対称の位置に向けて再度人物が登場するのを待ち構える。これは、通常、カメラ12の真下を通過する人物の進行方向はある線(真下横切りライン)を垂直に跨ぐ方向に限定できる場合が多いことに着目したものであり、事前に指標である真下横切りラインを設定しておき、この真下横切りラインに追尾中の人物が近づいた場合に、この先進むであろう真下横切りラインに対して線対称の位置にカメラ12を向ける。   When the person approaches near the camera, the camera microcomputer 10 temporarily stops tracking the person, and the camera 12 is referred to as a pre-set index (in this embodiment, a “directly crossing line”). ) And wait for the person to appear again in a line-symmetric position. This is because attention is usually paid to the fact that the direction of movement of a person passing directly below the camera 12 can often be limited to a direction that vertically crosses a certain line (a straight line below). A line is set, and when the person being tracked approaches this right-down crossing line, the camera 12 is pointed at a line-symmetrical position with respect to the right-down crossing line that will be advanced.

図2の(a)は被写体である人物20がカメラ真下付近に接近した場合の様子を斜め上から見た図であり、また(b)は同様子を真上から見た図である。また、図中A,Bは、カメラ12の真下に設定された真下横切りラインLcに対して線対称な画角である。なお、この場合、画角A,Bは例えば20度としている。画角Aで人物20を捉えると一時的に追尾を止めて、画角Aと線対称な画角Bになるようにパン角度を決定してカメラ12の位置を変える。そして、この予測位置から追尾を再開する。   FIG. 2A is a diagram in which the state when the person 20 as the subject approaches the vicinity just below the camera is viewed obliquely from above, and FIG. 2B is a diagram in which the same child is viewed from directly above. In addition, A and B in the figure are angle of view that is line-symmetric with respect to a transverse line Lc that is set directly below the camera 12. In this case, the angles of view A and B are, for example, 20 degrees. When the person 20 is captured at the angle of view A, tracking is temporarily stopped, and the pan angle is determined so that the angle of view B is symmetrical with the angle of view A, and the position of the camera 12 is changed. Then, tracking is resumed from this predicted position.

このように、本実施の形態に係る監視カメラ1によれば、カメラ12の真下を通過する人物の進行方向はある線を垂直に跨ぐ方向に限定できる場合が多いことに着目して真下横切りラインLcを事前にカメラ12に設定しておき、この真下横切りラインLcに追尾中の人物が近づいた場合に、この先進むであろう真下横切りラインLcに対して線対称の位置にカメラ12の向きを設定して、カメラ真下通過後の人物20を捉えて追尾を再開するので、カメラ真下付近での自動追尾をスムーズに行うことができる。   As described above, according to the surveillance camera 1 according to the present embodiment, it is noted that the traveling direction of the person passing directly below the camera 12 can often be limited to a direction straddling a certain line vertically. Lc is set in the camera 12 in advance, and when the person being tracked approaches the straight crossing line Lc, the direction of the camera 12 is set to a position symmetrical with respect to the straight crossing line Lc that will be followed. Since the tracking is resumed by setting and capturing the person 20 that has passed directly under the camera, automatic tracking near the camera can be performed smoothly.

(実施の形態2)
前述した実施の形態1では、真下横切りラインLcを事前にカメラ12に設定しておいて、この真下横切りラインLcに追尾中の人物が近づいた時に、人物がこの先進むであろう真下横切りラインLcに対して線対称の位置にカメラ12の向きを設定するようにしたが、本実施の形態の監視カメラ1Aでは、2点のパン情報(追尾開始位置とカメラ真下付近の追尾位置)より、追尾対象の被写体である人物のカメラ真下付近通過後の移動予測を行うものである。装置としての構成は図1と共通であるので、図1を援用することとする。但し、メモリ11に、カメラマイコン10が、人物のカメラ真下付近通過後の移動予測を行うための計算プログラムを格納している点に違いがある。以下に、カメラ真下付近通過後の移動予測方法について説明する。
(Embodiment 2)
In the above-described first embodiment, the right-down crossing line Lc is set in the camera 12 in advance, and when the person being tracked approaches the right-down crossing line Lc, the right-down crossing line Lc that the person will move forward is the next. The direction of the camera 12 is set at a line-symmetrical position with respect to the tracking camera 1A according to the present embodiment. The movement prediction is performed after the person who is the target subject passes near the camera. Since the configuration of the apparatus is the same as that of FIG. 1, FIG. 1 is used. However, there is a difference in that the memory 11 stores a calculation program for the camera microcomputer 10 to perform a movement prediction after the person passes near the camera. The movement prediction method after passing near the camera will be described below.

図3はカメラ12と被写体である人物20を横方向から見た図であり、また図4はカメラ12と被写体である人物20を真上から見た図である。図3及び図4において、30はカメラ真下と指定している範囲(円)、P0はカメラ真下位置、P1は人物の追尾開始位置、P2は人物がカメラ真下付近にさしかった位置、P3は人物移動後の予測位置を示している。また、hはカメラ12の地面からの設置高さを示しており、カメラ12を設置する際に予めカメラ12に設定されている。   FIG. 3 is a view of the camera 12 and the person 20 as the subject viewed from the lateral direction, and FIG. 4 is a view of the camera 12 and the subject 20 as viewed from directly above. 3 and 4, 30 is a range (circle) designated to be directly under the camera, P0 is a position directly below the camera, P1 is a tracking start position of the person, P2 is a position where the person is in the vicinity of the camera, and P3 is The predicted position after moving the person is shown. In addition, h indicates the installation height of the camera 12 from the ground, and is set in the camera 12 in advance when the camera 12 is installed.

(1)まず、追尾開始時の距離a即ちカメラ真下位置P0から人物の追尾開始位置P1までの距離を求める。図5に示すように、追尾開始時の距離aは、カメラ12の設置高さhをtanγで除算することで求めることができる。即ち、a=h/tanγの式で求めることができる。 (1) First, the distance a at the start of tracking, that is, the distance from the position P0 directly below the camera to the tracking start position P1 of the person is obtained. As shown in FIG. 5, the distance a at the start of tracking can be determined by dividing the installation height h of the camera 12 in tan 1. That can be determined by the formula a = h / tanγ 1.

(2)次に、カメラ真下と指定している円30の半径bを求める。図6に示すように、円30の半径bは、カメラ12の高さhをtanγで除算することで求めることができる。即ち、b=h/tanγの式で求めることができる。 (2) Next, the radius b of the circle 30 designated as just below the camera is obtained. As shown in FIG. 6, the radius b of the circle 30 can be determined by dividing the height h of the camera 12 at tan 2. That can be obtained by the formula b = h / tanγ 2.

(3)次に、人物の追尾開始位置P1と人物がカメラ真下付近にさしかかった位置P2との間を成す角度αを求める。この角度αは、追尾開始時のパン角度γから人物がカメラ真下付近にさしかかった時のパン角度γを減算することで求めることができる。即ち、α=パン角度γ−パン角度γの式で求めることができる。 (3) Next, an angle α formed between the person's tracking start position P1 and the position P2 at which the person approaches the vicinity of the camera is obtained. This angle α can be obtained by subtracting the pan angle γ 4 when the person is approaching just below the camera from the pan angle γ 3 at the start of tracking. That is, it can be obtained by the equation: α = pan angle γ 3 −pan angle γ 4 .

(4)次に、人物の追尾開始位置P1と人物がカメラ真下付近にさしかかった位置P2との間の距離cを求める。この距離cは余弦定理を用いることで求めることができる。即ち、c=a+b−2abcosαの式で求めることができる。 (4) Next, the distance c between the tracking start position P1 of the person and the position P2 at which the person is approaching just below the camera is obtained. This distance c can be obtained by using the cosine theorem. That can be obtained by the formula c 2 = a 2 + b 2 -2abcosα.

(5)次に、カメラ真下位置P0と人物がカメラ真下付近にさしかかった位置P2との間を成す角度βを求める。この角度βも余弦定理を用いることで求めることができる。即ち、cosβ=(a+c−b)/2acの式で求めることができる。 (5) Next, an angle β formed between the position P0 directly below the camera and the position P2 at which the person approaches the camera is determined. This angle β can also be obtained by using the cosine theorem. That is, it can be obtained by the equation of cos β = (a 2 + c 2 −b 2 ) / 2ac.

(6)次に、人物がカメラ真下付近にさしかかった位置P2と人物移動後の予測位置P3との間を成す角度の1/2の角度θを求める。この角度θは、先の工程で求めた角度αとβを用いることで求めることができる。即ち、θ=180°−90°−β−αの式で求めることができる。   (6) Next, an angle θ which is a half of an angle formed between the position P2 where the person approaches the vicinity of the camera and the predicted position P3 after moving the person is obtained. This angle θ can be obtained by using the angles α and β obtained in the previous step. That is, it can be obtained by the equation θ = 180 ° −90 ° −β−α.

したがって、人物移動後の予測位置P3は、パン角を、人物がカメラ真下付近にさしかかった位置P2より更に2θ回転させた位置となる。この場合、チルト角はγに定めたので、求めるのはパン角度のみで良い。このようにして人物移動後の予測位置P3のパン角度が求まる。そして、カメラ12のパンがγに対し2θ移動した角度、チルトがγになるようにカメラ12の向きを制御する。 Therefore, the predicted position P3 after the movement of the person is a position obtained by further rotating the pan angle by 2θ from the position P2 at which the person approaches the vicinity of the camera. In this case, since the tilt angle is defined gamma 2, may only pan angle seek. In this way, the pan angle of the predicted position P3 after the person is moved is obtained. The angle at which the camera pan 12 is 2θ moved relative gamma 4, tilt controlling the direction of the camera 12 so that the gamma 2.

被写体である人物20は、概ね直線的に移動してくるが、カメラ真下付近にさしかかる位置までに、その移動方向が少しずつでも変化することが往々にしてあるので、上記した処理(1)〜(6)を短時間毎に繰り返し行うと良い。このようにすると、カメラ真下付近にさしかかる位置の直前で正確な人物移動後の予測位置を得ることができる。   The person 20 as the subject moves substantially linearly, but the movement direction often changes little by little until reaching a position just below the camera. (6) may be repeated every short time. In this way, it is possible to obtain an accurate predicted position after moving the person immediately before the position approaching just below the camera.

このように、本実施の形態に係る監視カメラ1Aによれば、カメラ12の真下位置P0から追尾対象の被写体である人物20の追尾開始位置P1までの距離aと、カメラ12の真下と指定している円30の半径bと、カメラ12の真下位置P0を中心とした人物の追跡開始位置P1と人物がカメラ真下付近にさしかかった位置P2との間の角度α(即ち、追尾開始時のパン角度γと人物がカメラ真下付近にさしかかった時のパン角度γとの差)とを基に、人物20のカメラ真下付近通過後の移動予測を行い、予測した位置にカメラ位置を設定し直すので、カメラ真下付近での自動追尾をスムーズに行うことができる。 As described above, according to the monitoring camera 1A according to the present embodiment, the distance a from the position P0 directly below the camera 12 to the tracking start position P1 of the person 20 that is the subject to be tracked and the position directly below the camera 12 are designated. The angle b between the radius b of the circle 30 and the tracking start position P1 of the person centered on the position P0 directly below the camera 12 and the position P2 where the person approaches the camera directly below (that is, panning at the start of tracking) based difference) and the pan angle gamma 4 when the angle gamma 3 and human is approaching the vicinity of directly below the camera performs movement prediction after passing near the camera beneath the person 20, and set the camera position to the predicted position Since it is corrected, automatic tracking near the camera can be performed smoothly.

本発明は、被写体が撮像手段の真下付近を通過する場合でも、混乱することなくスムーズに追尾することができるといった効果を有し、被写体を自動追尾する監視カメラシステム等への適用が可能である。   INDUSTRIAL APPLICABILITY The present invention has an effect that, even when a subject passes near the imaging unit, it can be smoothly tracked without being confused, and can be applied to a surveillance camera system that automatically tracks a subject. .

本発明の実施の形態1に係る監視カメラの概略構成を示すブロック図1 is a block diagram showing a schematic configuration of a surveillance camera according to Embodiment 1 of the present invention. 本発明の実施の形態1に係る監視カメラにおける監視カメラ制御方法を説明するための図であり、(a)は被写体である人物がカメラ真下付近に接近した場合の様子を斜め上から見た図、(b)は同様子を真上から見た図BRIEF DESCRIPTION OF THE DRAWINGS It is a figure for demonstrating the surveillance camera control method in the surveillance camera which concerns on Embodiment 1 of this invention, (a) is the figure which looked at the mode when the person who is a subject approached the camera direct vicinity from diagonally upward. (B) is a view of the same child as seen from directly above. 本発明の実施の形態2に係る監視カメラにおける監視カメラ制御方法を説明するための図であり、カメラと被写体である人物を横方向から見た図It is a figure for demonstrating the surveillance camera control method in the surveillance camera which concerns on Embodiment 2 of this invention, and the figure which looked at the camera and the person who is a subject from the horizontal direction 本発明の実施の形態2に係る監視カメラにおける監視カメラ制御方法を説明するための図であり、カメラと被写体である人物を真上から見た図It is a figure for demonstrating the surveillance camera control method in the surveillance camera which concerns on Embodiment 2 of this invention, and the figure which looked at the camera and the person who is a subject from right above 図3又は図4における追尾開始時の距離aの求め方を説明するための図The figure for demonstrating how to obtain | require the distance a at the time of the tracking start in FIG. 3 or FIG. 図3又は図4におけるカメラ真下と指定している円の半径bの求め方を説明するための図The figure for demonstrating how to obtain | require the radius b of the circle | round | yen designated as right under the camera in FIG. 3 or FIG.

符号の説明Explanation of symbols

1、1A 監視カメラ
10 カメラマイコン
11 メモリ
12 カメラ
13 回転台
14 パン原点センサ
15 チルト原点センサ
16 サーボマイコン・モータドライバ
17 映像処理・自動追尾処理DSP
20 人物
30 カメラ真下と指定している範囲(円)
Lc 真下横切りライン
P0 カメラ真下位置
P1 人物の追尾開始位置
P2 人物がカメラ真下付近にさしかかった位置
P3 人物移動後の予測位置
DESCRIPTION OF SYMBOLS 1, 1A Surveillance camera 10 Camera microcomputer 11 Memory 12 Camera 13 Turntable 14 Pan origin sensor 15 Tilt origin sensor 16 Servo microcomputer / motor driver 17 Video processing / automatic tracking processing DSP
20 People 30 Range that is specified as just under the camera (circle)
Lc Crossing line just below P0 Position just below the camera P1 Tracking start position of the person P2 Position where the person is approaching directly below the camera P3 Predicted position after moving the person

Claims (4)

被写体を撮像する撮像手段と、
前記撮像手段をパン、チルト方向に移動させる回転台と、
前記撮像手段で撮像された映像に対して追尾対象の被写体を特定するための映像処理を行って前記被写体を追尾するためのパン及びチルト情報を生成する映像処理手段と、
前記映像処理手段で生成されたパン及びチルト情報に従って前記回転台を制御して前記被写体を追尾すると共に、前記被写体が前記撮像手段の真下付近に接近した場合に前記被写体の追尾を一時的に停止してその後の前記被写体の移動方向を予測し、予測した移動方向に対して前記回転台を制御することにより前記撮像手段の向きを変更して前記被写体が前記撮像手段の真下付近を通過した後に追尾を再開する追尾手段と、
を備える監視カメラ。
Imaging means for imaging a subject;
A turntable for moving the imaging means in the pan and tilt directions;
Video processing means for performing video processing for specifying a subject to be tracked on the video imaged by the imaging means to generate pan and tilt information for tracking the subject; and
The panorama is controlled according to the pan and tilt information generated by the video processing means to track the subject, and the subject tracking is temporarily stopped when the subject approaches the vicinity of the imaging means. Then, after the moving direction of the subject is predicted, the direction of the imaging unit is changed by controlling the turntable with respect to the predicted moving direction, and the subject passes near the vicinity of the imaging unit. Tracking means for resuming tracking;
Surveillance camera with.
前記追尾手段は、前記被写体が前記撮像手段の真下付近に接近した場合、前記撮像手段の真下位置を示す指標に対して線対称の位置に前記回転台を制御することにより前記撮像手段の向きを変更する請求項1に記載の監視カメラ。   The tracking means controls the orientation of the imaging means by controlling the rotating base at a line-symmetrical position with respect to an index indicating a position directly below the imaging means when the subject approaches near the vicinity of the imaging means. The surveillance camera according to claim 1 to be changed. 前記追尾手段は、前記撮像手段のパン、チルトによる位置変化を解析して、前記被写体が前記撮像手段の真下付近を通過した場合にその後の前記被写体の移動方向を予測し、予測した移動方向に対して前記回転台を制御することにより前記撮像手段の向きを変更する請求項1に記載の監視カメラ。   The tracking unit analyzes a change in position due to panning and tilting of the imaging unit, predicts a moving direction of the subject when the subject passes near the imaging unit, and sets the predicted moving direction to the predicted moving direction. The surveillance camera according to claim 1, wherein the orientation of the imaging unit is changed by controlling the turntable. 被写体を撮像する撮像手段で撮像された映像に対して追尾対象の被写体を特定するための映像処理を行って前記被写体を追尾するためのパン及びチルト情報を生成する映像処理工程と、
前記映像処理工程で生成されたパン及びチルト情報に従って前記回転台を制御して前記被写体を追尾する追尾工程と、
前記被写体が前記撮像手段の真下付近に接近した場合に前記被写体の追尾を一時的に停止してその後の前記被写体の移動方向を予測し、予測した前記被写体の移動方向に対して前記撮像手段の向きを変更して前記被写体が前記撮像手段の真下付近を通過した後に追尾を再開する追尾再開工程と、
を備える監視カメラ制御方法。
A video processing step for generating pan and tilt information for tracking the subject by performing video processing for specifying the subject to be tracked on the video imaged by the imaging means for imaging the subject;
A tracking step of tracking the subject by controlling the turntable according to the pan and tilt information generated in the video processing step;
When the subject approaches close to the vicinity of the imaging unit, the tracking of the subject is temporarily stopped to predict the subsequent movement direction of the subject, and the imaging unit's movement direction is predicted with respect to the predicted movement direction of the subject. A tracking resumption step of resuming tracking after changing the direction and the subject passes near the vicinity of the imaging means;
A surveillance camera control method comprising:
JP2007033785A 2007-02-14 2007-02-14 Surveillance camera and surveillance camera control method Expired - Fee Related JP5108323B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2007033785A JP5108323B2 (en) 2007-02-14 2007-02-14 Surveillance camera and surveillance camera control method
PCT/JP2008/000205 WO2008099598A1 (en) 2007-02-14 2008-02-12 Surveillance camera and surveillance camera control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2007033785A JP5108323B2 (en) 2007-02-14 2007-02-14 Surveillance camera and surveillance camera control method

Publications (2)

Publication Number Publication Date
JP2008199389A true JP2008199389A (en) 2008-08-28
JP5108323B2 JP5108323B2 (en) 2012-12-26

Family

ID=39689846

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2007033785A Expired - Fee Related JP5108323B2 (en) 2007-02-14 2007-02-14 Surveillance camera and surveillance camera control method

Country Status (2)

Country Link
JP (1) JP5108323B2 (en)
WO (1) WO2008099598A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011142419A (en) * 2010-01-06 2011-07-21 Canon Inc Camera universal head system
JP2018000959A (en) * 2016-06-29 2018-01-11 クリエイツ インコーポレイテッドCreatz Inc. Method and system for determining region of interest for taking image of ball, and computer-readable non-temporary recording medium
JP2020088610A (en) * 2018-11-26 2020-06-04 キヤノン株式会社 Image processing apparatus and control method thereof
WO2022209135A1 (en) * 2021-03-30 2022-10-06 富士フイルム株式会社 Control device, control method, and program

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11261868A (en) * 1998-03-13 1999-09-24 Fujitsu Ltd Fisheye lens camera device and image distortion correction method and image extraction method thereof
JP2000032435A (en) * 1998-07-10 2000-01-28 Mega Chips Corp Monitoring system
JP2000083188A (en) * 1998-09-03 2000-03-21 Matsushita Electric Ind Co Ltd Monitoring camera device
JP2001069494A (en) * 1999-08-31 2001-03-16 Matsushita Electric Ind Co Ltd Supervisory camera apparatus and display method for supervisory camera
JP2004056239A (en) * 2002-07-17 2004-02-19 Kowa Co Monitor camera system
JP2004304847A (en) * 2004-06-25 2004-10-28 Matsushita Electric Ind Co Ltd Supervisory camera apparatus and display method of supervisory camera
JP2006041919A (en) * 2004-07-27 2006-02-09 Matsushita Electric Ind Co Ltd Imaging device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11261868A (en) * 1998-03-13 1999-09-24 Fujitsu Ltd Fisheye lens camera device and image distortion correction method and image extraction method thereof
JP2000032435A (en) * 1998-07-10 2000-01-28 Mega Chips Corp Monitoring system
JP2000083188A (en) * 1998-09-03 2000-03-21 Matsushita Electric Ind Co Ltd Monitoring camera device
JP2001069494A (en) * 1999-08-31 2001-03-16 Matsushita Electric Ind Co Ltd Supervisory camera apparatus and display method for supervisory camera
JP2004056239A (en) * 2002-07-17 2004-02-19 Kowa Co Monitor camera system
JP2004304847A (en) * 2004-06-25 2004-10-28 Matsushita Electric Ind Co Ltd Supervisory camera apparatus and display method of supervisory camera
JP2006041919A (en) * 2004-07-27 2006-02-09 Matsushita Electric Ind Co Ltd Imaging device

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011142419A (en) * 2010-01-06 2011-07-21 Canon Inc Camera universal head system
JP2018000959A (en) * 2016-06-29 2018-01-11 クリエイツ インコーポレイテッドCreatz Inc. Method and system for determining region of interest for taking image of ball, and computer-readable non-temporary recording medium
JP2020088610A (en) * 2018-11-26 2020-06-04 キヤノン株式会社 Image processing apparatus and control method thereof
JP7336185B2 (en) 2018-11-26 2023-08-31 キヤノン株式会社 Image processing device and image processing method
WO2022209135A1 (en) * 2021-03-30 2022-10-06 富士フイルム株式会社 Control device, control method, and program

Also Published As

Publication number Publication date
WO2008099598A1 (en) 2008-08-21
JP5108323B2 (en) 2012-12-26

Similar Documents

Publication Publication Date Title
US10475312B2 (en) Monitoring camera and monitoring camera control method
KR102132248B1 (en) Control apparatus, method of controlling image sensing device, and computer-readable storage medium
US20210069813A1 (en) Systems and methods for seam tracking in pipe welding
US9091904B2 (en) Camera device with rotary base
JP4558696B2 (en) Automatic body tracking device
US20140267595A1 (en) Rotating surveillance camera
JP5108323B2 (en) Surveillance camera and surveillance camera control method
KR101275297B1 (en) Camera Apparatus of tracking moving object
US20160173765A1 (en) Image-capturing apparatus which controls image-capturing direction
TW201813369A (en) Improved monitoring camera direction control
JP4293236B2 (en) Imaging apparatus and imaging method
CN113744299B (en) Camera control method and device, electronic equipment and storage medium
JP2017050829A (en) Camera control system and camera control method
JP2021126950A5 (en)
JP2011124614A (en) Subject tracking device and subject tracking method
JP2009260564A (en) Mobile object image tracking apparatus
KR100871833B1 (en) Camera apparatus for auto tracking
JP2009055180A (en) Surveillance camera system
JP2007150496A (en) Imaging apparatus, data recording control method, and computer program
TW201215146A (en) Image capturing device and method for tracking a moving object using the image capturing device
JP2013106175A (en) Camera system
JP2000224457A (en) Monitoring system, control method therefor and storage medium storing program therefor
JP2011049967A (en) Imaging apparatus unit
JP2011155461A (en) Imaging device, and method and program for controlling the same
JP2008134278A (en) Electronic camera

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20100104

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120410

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120604

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20120911

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20121005

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20151012

Year of fee payment: 3

LAPS Cancellation because of no payment of annual fees