WO2012057389A1 - System for extracting a target area using a plurality of cameras, and method for same - Google Patents

System for extracting a target area using a plurality of cameras, and method for same Download PDF

Info

Publication number
WO2012057389A1
WO2012057389A1 PCT/KR2010/008003 KR2010008003W WO2012057389A1 WO 2012057389 A1 WO2012057389 A1 WO 2012057389A1 KR 2010008003 W KR2010008003 W KR 2010008003W WO 2012057389 A1 WO2012057389 A1 WO 2012057389A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
tracking
image
matching
interest
Prior art date
Application number
PCT/KR2010/008003
Other languages
French (fr)
Korean (ko)
Inventor
김두현
조기호
전동운
Original Assignee
건국대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 건국대학교 산학협력단 filed Critical 건국대학교 산학협력단
Publication of WO2012057389A1 publication Critical patent/WO2012057389A1/en

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19639Details of the system layout
    • G08B13/19641Multiple cameras having overlapping views on a single scene
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/292Multi-camera tracking
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19608Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30232Surveillance

Definitions

  • the present invention relates to a region of interest extraction system using a plurality of cameras and a method thereof, and more particularly, to a method of image acquisition and processing using a plurality of cameras.
  • the present invention has been made in view of the above problems, using a matched result image in one camera frame to match in real time to the image frame of another camera, that is to update the image detected by a plurality of cameras
  • an object thereof is to provide a system and a method in which image acquisition and matching update can be made in real time.
  • the present invention for achieving the above technical problem relates to a region of interest extraction system using a plurality of cameras, a plurality of camera apparatuses, each camera device for obtaining an image for a target; A tracking device for tracking a region of interest using an image input in real time from the camera device; And a monitoring device that controls the tracking device according to user control information and continuously outputs an image tracking the ROI. Characterized in that it comprises a.
  • the present invention relates to a method for extracting a region of interest using a plurality of cameras, wherein (a) a plurality of camera apparatuses installed on a specific object at a predetermined distance on the same horizontal line to acquire images of a target at the same angle of view, respectively.
  • the image acquisition and matching updates are made in real time, and at the same time there is an effect that can continuously track the region of interest by analyzing the matching information.
  • a simple observation camera for checking the presence and absence of a person but also a closed camera used in a bank, a large sales office, a prison, a company, a public period, etc., has an effect that can be applied.
  • FIG. 1 is an overall configuration diagram conceptually showing a region of interest tracking system using a plurality of cameras according to an embodiment of the present invention.
  • FIG. 2 is an exemplary view for extracting a region of interest in an image acquired through two camera apparatuses according to an embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating a method for tracking a region of interest using a plurality of cameras according to an embodiment of the present invention.
  • camera device 110 first camera
  • ROI setting unit 220 First matching unit
  • first buffer unit 240 second matching unit
  • a region of interest tracking system using a plurality of cameras according to an embodiment of the present invention will be described with reference to FIGS. 1 to 2.
  • FIG. 1 is an overall configuration diagram conceptually showing a region of interest tracking system S using a plurality of cameras according to an embodiment of the present invention
  • FIG. 2 is two camera apparatuses 100 according to an embodiment of the present invention. This is an example for extracting a region of interest in an image acquired through).
  • the camera device 100 includes a camera device 100, a tracking device 200, and a monitoring device 300.
  • the camera apparatus 100 is a plurality of camera apparatuses installed at a predetermined distance on a same horizontal line on a specific object, and acquires images of targets at the same angle of view, respectively.
  • the camera device 100 is set to two first cameras 110 and two second cameras 120, but the present invention is not limited thereto.
  • the present invention is not limited thereto.
  • not only the camera device 100 may be installed on the aircraft, but also may be installed and used on a specific object in the room.
  • the tracking device 200 performs a function of tracking a region of interest using an image input in real time from the camera apparatus 100, as shown in FIG. 1, the region of interest setting unit 210.
  • the first matching unit 220 includes a first matching unit 220, a first buffer unit 230, a second matching unit 240, and a second buffer unit 250.
  • the ROI setting unit 210 may be the first input from the first camera 110 of the camera apparatus 100 based on the user's control information regarding the ROI input through the monitoring apparatus 300. Sets a region of interest in the image or sets a pre-stored image as the region of interest.
  • the ROI setting unit 210 determines whether the control information of the user regarding the end of the ROI tracking is input through the monitoring apparatus 300, and terminates the tracking if it is input.
  • the first matching unit 220 matches the ROI set according to the control information of the user with the image frame of the first camera 110. Meanwhile, when a matched result image is transmitted from the second buffer unit 250, the matched result image is matched to a frame of the first camera 110.
  • the first buffer unit 230 temporarily stores the result image matched by the first matching unit 220.
  • the second matching unit 240 matches the result image stored in the first buffer unit 230 with the frame of the second camera 120.
  • the second buffer unit 250 temporarily stores the result image matched by the second matching unit 240.
  • the monitoring device 300 controls the tracking device 200 according to the user's control information, and continuously outputs an image tracking the ROI.
  • the image output through the monitoring device 300 includes an image input from the first camera 110 and the second camera 120 of the camera device 100 and an image tracking the ROI.
  • the present invention can be understood that the ROI tracking is repeated by matching the image frame of another camera in real time using the resultant image matched in the frame of one camera.
  • image acquisition and matching update are performed in real time, and at the same time, the ROI can be continuously tracked by analyzing the matching information.
  • FIG. 3 is a flowchart of a method for tracking a region of interest using a plurality of cameras using a plurality of cameras according to an embodiment of the present invention.
  • the first camera 110 and the second camera 120 of 100 obtain images of the target at the same angle of view, respectively (S10), and the monitoring device 300 receives the user's control information (S20).
  • the ROI setting unit 210 of the tracking device 200 based on the user's control information regarding the ROI setting input through the monitoring device 300, the first camera 110 of the camera apparatus 100.
  • a region of interest is set in the initial image inputted from), or a pre-stored image is set as the region of interest (S30).
  • the first matching unit 220 matches the ROI set according to the user's control information with the image frame of the first camera 110 (S40), and the first buffer unit 230 matches the first matching unit.
  • the matched result image is temporarily stored (S50).
  • the second matching unit 240 matches the result image stored in the first buffer unit 230 with the frame of the second camera 120 (S60), and the second buffer unit 250 matches the second matching unit.
  • the matched result image is temporarily stored (S70).
  • the first matching unit 220 matches the result image stored in the second buffer unit 250 with the frame of the first camera 110 (S80).
  • the ROI setting unit 210 determines whether the control information of the user regarding the end of the ROI tracking is input through the monitoring apparatus 300, and terminates the tracking if it is input. The procedure of step S80 is repeated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)

Abstract

The present invention relates to a system for extracting a target area using a plurality of cameras, and to a method for same. The aim of the present invention is to provide a system and method for performing real-time image acquisition and matching updates by employing a method that uses a resulting image matched in a frame of one camera, so as to perform real-time matching to an image frame of another camera, i.e. real-time tracing by updating images detected from a plurality of cameras and cross-matching. To achieve the above aim, the system of the present invention includes: a plurality of camera devices, each acquiring an image of a target; a tracing device for tracing a target area by using an image inputted in real time from the camera device; and a monitoring device for controlling the tracing device according to control information from the user and continuously outputting an image that traces the target area.

Description

복수개의 카메라를 이용한 관심영역 추출 시스템 및 그 방법Region of interest extraction system using multiple cameras and method
본 발명은 복수개의 카메라를 이용한 관심영역 추출 시스템 및 그 방법에 관한 것으로서, 더욱 상세하게는 복수개의 카메라를 이용한 이미지 취득 및 처리 방법에 관한 기술이다.The present invention relates to a region of interest extraction system using a plurality of cameras and a method thereof, and more particularly, to a method of image acquisition and processing using a plurality of cameras.
종래에 관심영역을 추적하는 방법에 있어, 다수개의 각 카메라가 관심영역의 추적을 독립적으로 수행하는 방식이었다. 그러나, 이러한 방식은 움직이는 물체에 대하여 동시에 추적이 힘들었으며, 동일한 영역을 추적의 결과인지 확인이 불가능한 문제점이 있었다.In the conventional method of tracking a region of interest, a plurality of cameras have been a method of independently tracking a region of interest. However, this method was difficult to track at the same time with respect to the moving object, there was a problem that it is impossible to check whether the same area is the result of tracking.
본 발명은 상기와 같은 문제점을 감안하여 안출된 것으로, 하나의 카메라의 프레임에서 매칭된 결과이미지를 사용하여 타 카메라의 이미지 프레임에 실시간으로 매칭하는 방식 즉, 다수의 카메라가 검출한 이미지를 업데이트하며 교차 매칭하는 실시간 추적하는 방식을 사용함으로써, 이미지 취득과 매칭 업데이트는 실시간으로 이루어질 수 있는 시스템 및 그 방법을 제공함에 그 목적이 있다. The present invention has been made in view of the above problems, using a matched result image in one camera frame to match in real time to the image frame of another camera, that is to update the image detected by a plurality of cameras By using a cross-matching real-time tracking scheme, an object thereof is to provide a system and a method in which image acquisition and matching update can be made in real time.
이러한 기술적 과제를 달성하기 위한 본 발명은 복수개의 카메라를 이용한 관심영역 추출 시스템에 관한 것으로서, 복수개의 카메라 장치로서, 목표물에 대한 이미지를 각각 취득하는 카메라 장치; 상기 카메라 장치로부터 실시간으로 입력되는 이미지를 이용하여 관심영역을 추적하는 추적 장치; 및 사용자의 제어정보에 따라 상기 추적 장치를 제어하며, 관심영역을 추적하는 영상을 지속적으로 출력하는 모니터링 장치; 를 포함하는 것을 특징으로 한다.The present invention for achieving the above technical problem relates to a region of interest extraction system using a plurality of cameras, a plurality of camera apparatuses, each camera device for obtaining an image for a target; A tracking device for tracking a region of interest using an image input in real time from the camera device; And a monitoring device that controls the tracking device according to user control information and continuously outputs an image tracking the ROI. Characterized in that it comprises a.
한편, 본 발명은 복수개의 카메라를 이용한 관심영역 추출 방법에 관한 것으로서, (a) 동일한 가로선상에 일정한 거리를 두고 특정 물체에 설치되는 복수개의 카메라 장치가 동일한 화각으로 목표물에 대한 이미지를 각각 취득하는 단계; (b) 상기 모니터링 장치가 사용자의 제어정보를 입력받는 단계; (c) 상기 추적 장치가 상기 모니터링 장치를 통해 입력되는 사용자의 제어정보를 바탕으로, 상기 카메라 장치의 제 1 카메라로부터 입력된 최초 이미지 내에서 관심영역을 설정하는 단계; (d) 상기 추적 장치가 상기 사용자의 제어정보에 따라 설정된 관심영역을, 상기 제 1 카메라의 이미지 프레임에 매칭시키는 단계; (e) 상기 추적 장치가 상기 제 1 카메라의 이미지 프레임에 매칭된 결과이미지를 일시 저장하는 단계; (f) 상기 추적 장치가 상기 (e) 단계를 통해 저장된 결과이미지를 제 2 카메라의 프레임에 매칭시키는 단계; (g) 상기 추적 장치가 상기 (f) 단계를 통해 매칭된 결과이미지를 일시 저장하는 단계; (h) 상기 추적 장치가 상기 (g) 단계를 통해 저장된 결과이미지를 제 1 카메라의 프레임에 매칭시키는 단계; 및 (i) 상기 추적 장치가 상기 모니터링 장치를 통해 관심영역 추적 종료에 관한 사용자의 제어정보가 입력되었는지 여부를 판단하여, 입력된 경우 추적을 종료하는 단계; 를 포함하는 것을 특징으로 한다. Meanwhile, the present invention relates to a method for extracting a region of interest using a plurality of cameras, wherein (a) a plurality of camera apparatuses installed on a specific object at a predetermined distance on the same horizontal line to acquire images of a target at the same angle of view, respectively. step; (b) receiving, by the monitoring device, control information of a user; (c) setting, by the tracking device, a region of interest in an initial image input from a first camera of the camera device based on control information of a user input through the monitoring device; (d) the tracking device matching the ROI set according to the control information of the user with an image frame of the first camera; (e) temporarily storing, by the tracking device, the resultant image matched with the image frame of the first camera; (f) the tracking device matching the resultant image stored in step (e) with a frame of a second camera; (g) temporarily storing, by the tracking device, the matched result image through step (f); (h) the tracking device matching the result image stored in step (g) with the frame of the first camera; And (i) determining, by the tracking device, whether the user's control information regarding the end of the ROI tracking is input through the monitoring device, and ending the tracking if the tracking device is input. Characterized in that it comprises a.
상기와 같은 본 발명에 따르면, 이미지 취득 및 매칭 업데이트가 실시간으로 이루어지며, 동시에 매칭 정보를 분석하여 관심영역을 지속적으로 추적할 수 있는 효과가 있다. According to the present invention as described above, the image acquisition and matching updates are made in real time, and at the same time there is an effect that can continuously track the region of interest by analyzing the matching information.
또한 본 발명에 따르면, 움직이거나 회전하는 관심영역, 다양한 지형조건에서의 관심영역 추적이 가능한 효과도 있다, In addition, according to the present invention, there is an effect capable of tracking a region of interest in a moving or rotating region of interest and various terrain conditions.
그리고 본 발명에 따르면, 출입자 유무 및 출입자의 신원을 확인하는 단순한 관측 카메라 뿐만 아니라, 은행, 대형 판매소, 교도소, 기업, 공공 기간 등에서 사용되는 폐쇄 카메라에 이르기까지 적용이 가능한 효과가 있다.In addition, according to the present invention, not only a simple observation camera for checking the presence and absence of a person, but also a closed camera used in a bank, a large sales office, a prison, a company, a public period, etc., has an effect that can be applied.
도 1 은 본 발명의 일실시예에 따른 복수개의 카메라를 이용한 관심영역 추적 시스템을 개념적으로 도시한 전체 구성도. 1 is an overall configuration diagram conceptually showing a region of interest tracking system using a plurality of cameras according to an embodiment of the present invention.
도 2 는 본 발명의 일실시예에 따른 두 개의 카메라 장치를 통해 취득한 이미지 내에서 관심영역을 추출하기 위한 일예시도이다.2 is an exemplary view for extracting a region of interest in an image acquired through two camera apparatuses according to an embodiment of the present invention.
도 3 은 본 발명의 일실시예에 따른 복수개의 카메라를 이용한 관심영역 추적 방법에 관한 전체 흐름도.3 is a flowchart illustrating a method for tracking a region of interest using a plurality of cameras according to an embodiment of the present invention.
[부호의 설명][Description of the code]
S: 복수개의 카메라를 이용한 관심영역 추적 시스템S: ROI tracking system using multiple cameras
100: 카메라 장치 110: 제 1 카메라 100: camera device 110: first camera
120: 제 2 카메라 200: 추적 장치120: second camera 200: tracking device
210: 관심영역 설정부 220: 제 1 매칭부210: ROI setting unit 220: First matching unit
230: 제 1 버퍼부 240: 제 2 매칭부230: first buffer unit 240: second matching unit
250: 제 2 버퍼부 300: 모니터링 장치250: second buffer unit 300: monitoring device
본 발명의 구체적 특징 및 이점들은 첨부도면에 의거한 다음의 상세한 설명으로 더욱 명백해질 것이다. 이에 앞서 본 발명에 관련된 공지 기능 및 그 구성에 대한 구체적인 설명이 본 발명의 요지를 불필요하게 흐릴 수 있다고 판단되는 경우에는, 그 구체적인 설명을 생략하였음에 유의해야 할 것이다.Specific features and advantages of the present invention will become more apparent from the following detailed description based on the accompanying drawings. In the meantime, when it is determined that the detailed description of the known functions and configurations related to the present invention may unnecessarily obscure the subject matter of the present invention, it should be noted that the detailed description is omitted.
이하, 첨부된 도면을 참조하여 본 발명을 상세하게 설명한다. Hereinafter, with reference to the accompanying drawings will be described in detail the present invention.
본 발명의 일실시예에 따른 복수개의 카메라를 이용한 관심영역 추적 시스템에 관하여 도 1 내지 도 2 를 참조하여 설명하면 다음과 같다. A region of interest tracking system using a plurality of cameras according to an embodiment of the present invention will be described with reference to FIGS. 1 to 2.
도 1 은 본 발명의 일실시예에 따른 복수개의 카메라를 이용한 관심영역 추적 시스템(S)을 개념적으로 도시한 전체 구성도이며, 도 2 는 본 발명의 일실시예에 따른 두 개의 카메라 장치(100)를 통해 취득한 이미지 내에서 관심영역을 추출하기 위한 일예시도이다. 1 is an overall configuration diagram conceptually showing a region of interest tracking system S using a plurality of cameras according to an embodiment of the present invention, and FIG. 2 is two camera apparatuses 100 according to an embodiment of the present invention. This is an example for extracting a region of interest in an image acquired through).
상기 도 1 에 도시된 바와 같이 카메라 장치(100), 추적 장치(200) 및 모니터링 장치(300)를 포함하여 이루어진다. As shown in FIG. 1, the camera device 100 includes a camera device 100, a tracking device 200, and a monitoring device 300.
카메라 장치(100)는 특정물체에 동일한 가로선상에 일정한 거리를 두고 설치되는 복수개의 카메라 장치로서, 동일한 화각으로 목표물에 대한 이미지를 각각 취득한다.The camera apparatus 100 is a plurality of camera apparatuses installed at a predetermined distance on a same horizontal line on a specific object, and acquires images of targets at the same angle of view, respectively.
본 실시예에서, 카메라 장치(100)를 제 1 카메라(110) 및 제 2 카메라(120) 두 개로 설정하였으나, 본 발명이 이에 한정되는 것은 아니다. 또한, 본 실시예에서는 이러한 카메라 장치(100)를 비행체에 설치할 수 있을 뿐만 아니라, 실내의 특정 물체에 설치하여 사용할 수 있다. In the present embodiment, the camera device 100 is set to two first cameras 110 and two second cameras 120, but the present invention is not limited thereto. In addition, in the present embodiment, not only the camera device 100 may be installed on the aircraft, but also may be installed and used on a specific object in the room.
또한, 추적 장치(200)는 상기 카메라 장치(100)로부터 실시간으로 입력되는 이미지를 이용하여 관심영역을 추적하는 기능을 수행하는 바, 상기 도 1 에 도시된 바와 같이, 관심영역 설정부(210), 제 1 매칭부(220), 제 1 버퍼부(230), 제 2 매칭부(240) 및 제 2 버퍼부(250)를 포함한다. In addition, the tracking device 200 performs a function of tracking a region of interest using an image input in real time from the camera apparatus 100, as shown in FIG. 1, the region of interest setting unit 210. The first matching unit 220 includes a first matching unit 220, a first buffer unit 230, a second matching unit 240, and a second buffer unit 250.
구체적으로, 관심영역 설정부(210)는 모니터링 장치(300)를 통해 입력되는 관심영역 설정에 관한 사용자의 제어정보를 바탕으로, 상기 카메라 장치(100)의 제 1 카메라(110)로부터 입력되는 최초 이미지 내에서 관심영역을 설정하거나, 기 저장된 이미지를 관심영역으로 설정한다. Specifically, the ROI setting unit 210 may be the first input from the first camera 110 of the camera apparatus 100 based on the user's control information regarding the ROI input through the monitoring apparatus 300. Sets a region of interest in the image or sets a pre-stored image as the region of interest.
한편, 관심영역 설정부(210)는 모니터링 장치(300)를 통해 관심영역 추적 종료에 관한 사용자의 제어정보가 입력되었는지 판단하여, 입력된 경우, 추적을 종료한다. Meanwhile, the ROI setting unit 210 determines whether the control information of the user regarding the end of the ROI tracking is input through the monitoring apparatus 300, and terminates the tracking if it is input.
제 1 매칭부(220)는 상기 사용자의 제어정보에 따라 설정된 관심영역을, 제 1 카메라(110)의 이미지 프레임에 매칭시킨다. 한편, 상기 제 2 버퍼부(250)로부터 매칭된 결과이미지가 전송될 경우, 상기 매칭된 결과이미지를 상기 제 1 카메라(110)의 프레임에 매칭시킨다.The first matching unit 220 matches the ROI set according to the control information of the user with the image frame of the first camera 110. Meanwhile, when a matched result image is transmitted from the second buffer unit 250, the matched result image is matched to a frame of the first camera 110.
제 1 버퍼부(230)는 상기 제 1 매칭부(220)에서 매칭된 결과이미지를 일시 저장한다. The first buffer unit 230 temporarily stores the result image matched by the first matching unit 220.
제 2 매칭부(240)는 상기 제 1 버퍼부(230)에 저장된 결과이미지를 제 2 카메라(120)의 프레임에 매칭시킨다. The second matching unit 240 matches the result image stored in the first buffer unit 230 with the frame of the second camera 120.
제 2 버퍼부(250)는 상기 제 2 매칭부(240)에서 매칭된 결과이미지를 일시 저장한다. The second buffer unit 250 temporarily stores the result image matched by the second matching unit 240.
그리고, 모니터링 장치(300)는 사용자의 제어정보에 따라 상기 추적 장치(200)를 제어하며, 관심영역을 추적하는 영상을 지속적으로 출력한다. In addition, the monitoring device 300 controls the tracking device 200 according to the user's control information, and continuously outputs an image tracking the ROI.
여기서, 모니터링 장치(300)를 통해 출력되는 영상은, 상기 카메라 장치(100)의 제 1 카메라(110) 및 제 2 카메라(120)로부터 입력되는 영상과, 관심영역을 추적하는 영상을 포함한다. Here, the image output through the monitoring device 300 includes an image input from the first camera 110 and the second camera 120 of the camera device 100 and an image tracking the ROI.
즉, 본 발명은 하나의 카메라의 프레임에서 매칭된 결과이미지를 사용하여 타 카메라의 이미지 프레임에 실시간으로 매칭하는 방식으로, 관심영역 추적이 반복되는 것으로 이해할 수 있다. That is, the present invention can be understood that the ROI tracking is repeated by matching the image frame of another camera in real time using the resultant image matched in the frame of one camera.
이에 따라, 이미지 취득 및 매칭 업데이트가 실시간으로 이루어지며, 동시에 매칭 정보를 분석하여 관심영역을 지속적으로 추적할 수 있다. Accordingly, image acquisition and matching update are performed in real time, and at the same time, the ROI can be continuously tracked by analyzing the matching information.
이하에서는, 상술한 시스템을 이용한 복수개의 카메라를 이용한 복수개의 카메라를 이용한 관심영역 추적 방법에 관하여 도 3 을 참조하여 설명하면 다음과 같다. Hereinafter, a method of tracking a region of interest using a plurality of cameras using a plurality of cameras using the system described above will be described with reference to FIG. 3.
도 3 은 본 발명의 일실시예에 따른 복수개의 카메라를 이용한 복수개의 카메라를 이용한 관심영역 추적 방법에 관한 전체 흐름도로서, 도시된 바와 같이 동일한 가로선상에 일정한 거리를 두고 특정 물체에 설치되는 카메라 장치(100)의 제 1 카메라(110) 및 제 2 카메라(120)가 동일한 화각으로 목표물에 대한 이미지를 각각 취득하며(S10), 모니터링 장치(300)가 사용자의 제어정보를 입력받는다(S20). 3 is a flowchart of a method for tracking a region of interest using a plurality of cameras using a plurality of cameras according to an embodiment of the present invention. As shown in FIG. The first camera 110 and the second camera 120 of 100 obtain images of the target at the same angle of view, respectively (S10), and the monitoring device 300 receives the user's control information (S20).
이후, 추적 장치(200)의 관심영역 설정부(210)는 모니터링 장치(300)를 통해 입력되는 관심영역 설정에 관한 사용자의 제어정보를 바탕으로, 상기 카메라 장치(100)의 제 1 카메라(110)로부터 입력된 최초 이미지 내에서 관심영역을 설정하거나, 기 저장된 이미지를 관심영역으로 설정한다(S30). Subsequently, the ROI setting unit 210 of the tracking device 200 based on the user's control information regarding the ROI setting input through the monitoring device 300, the first camera 110 of the camera apparatus 100. A region of interest is set in the initial image inputted from), or a pre-stored image is set as the region of interest (S30).
이후, 제 1 매칭부(220)는 상기 사용자의 제어정보에 따라 설정된 관심영역을, 제 1 카메라(110)의 이미지 프레임에 매칭시키며(S40), 제 1 버퍼부(230)는 상기 제 1 매칭부(220)에서 매칭된 결과이미지를 일시 저장한다(S50). Thereafter, the first matching unit 220 matches the ROI set according to the user's control information with the image frame of the first camera 110 (S40), and the first buffer unit 230 matches the first matching unit. In step S50, the matched result image is temporarily stored (S50).
뒤이어, 제 2 매칭부(240)는 상기 제 1 버퍼부(230)에 저장된 결과이미지를 제 2 카메라(120)의 프레임에 매칭시키며(S60), 제 2 버퍼부(250)는 상기 제 2 매칭부(240)에서 매칭된 결과이미지를 일시 저장한다(S70). Subsequently, the second matching unit 240 matches the result image stored in the first buffer unit 230 with the frame of the second camera 120 (S60), and the second buffer unit 250 matches the second matching unit. In step S70, the matched result image is temporarily stored (S70).
이후, 제 1 매칭부(220)는 제 2 버퍼부(250)에 저장된 결과이미지를 제 1 카메라(110)의 프레임에 매칭시킨다(S80). Thereafter, the first matching unit 220 matches the result image stored in the second buffer unit 250 with the frame of the first camera 110 (S80).
이후, 관심영역 설정부(210)는 모니터링 장치(300)를 통해 관심영역 추적 종료에 관한 사용자의 제어정보가 입력되었는지 여부를 판단하여, 입력된 경우 추적을 종료하며, 입력되지 않은 경우 상기 제S50 단계 내지 제S80 단계의 절차를 반복 수행한다.Thereafter, the ROI setting unit 210 determines whether the control information of the user regarding the end of the ROI tracking is input through the monitoring apparatus 300, and terminates the tracking if it is input. The procedure of step S80 is repeated.
이상으로 본 발명의 기술적 사상을 예시하기 위한 바람직한 실시예와 관련하여 설명하고 도시하였지만, 본 발명은 이와 같이 도시되고 설명된 그대로의 구성 및 작용에만 국한되는 것이 아니며, 기술적 사상의 범주를 일탈함이 없이 본 발명에 대해 다수의 변경 및 수정이 가능함을 당업자들은 잘 이해할 수 있을 것이다. 따라서, 그러한 모든 적절한 변경 및 수정과 균등물들도 본 발명의 범위에 속하는 것으로 간주되어야 할 것이다. As described above and described with reference to a preferred embodiment for illustrating the technical idea of the present invention, the present invention is not limited to the configuration and operation as shown and described as described above, it is a deviation from the scope of the technical idea It will be understood by those skilled in the art that many modifications and variations can be made to the invention without departing from the scope of the invention. Accordingly, all such suitable changes and modifications and equivalents should be considered to be within the scope of the present invention.

Claims (6)

  1. 복수개의 카메라를 이용한 관심영역 추적 시스템에 있어서, In the ROI tracking system using a plurality of cameras,
    복수개의 카메라 장치로서, 목표물에 대한 이미지를 각각 취득하는 카메라 장치(100); A plurality of camera apparatuses, each comprising: a camera apparatus (100) for acquiring an image for a target;
    상기 카메라 장치(100)로부터 실시간으로 입력되는 이미지를 이용하여 관심영역을 추적하는 추적 장치(200); 및 A tracking device (200) for tracking a region of interest using an image input in real time from the camera device (100); And
    사용자의 제어정보에 따라 상기 추적 장치(200)를 제어하며, 관심영역을 추적하는 영상을 지속적으로 출력하는 모니터링 장치(300); 를 포함하는 것을 특징으로 하는 복수개의 카메라를 이용한 관심영역 추적 시스템. A monitoring device 300 that controls the tracking device 200 according to control information of a user and continuously outputs an image of tracking an ROI; A region of interest tracking system using a plurality of cameras, comprising a.
  2. 제 1 항에 있어서, The method of claim 1,
    상기 카메라 장치(100)는, The camera device 100,
    상기 특정 물체의 동일한 가로선상에 일정한 거리를 두고 설치되는 적어도 2개 이상의 카메라 장치로서, 동일한 화각으로 취득하는 것을 특징으로 하는 복수개의 카메라를 이용한 관심영역 추적 시스템. At least two or more camera devices installed at a predetermined distance on the same horizontal line of the specific object, the area of interest tracking system using a plurality of cameras, characterized in that obtained at the same angle of view.
  3. 제 1 항에 있어서, The method of claim 1,
    상기 추적 장치(200)는, The tracking device 200,
    상기 모니터링 장치(300)를 통해 입력되는 사용자의 제어정보를 바탕으로, 상기 카메라 장치(100)의 제 1 카메라(110)로부터 입력된 최초 이미지 내에서 관심영역을 설정하는 관심영역 설정부(210); Based on the control information of the user input through the monitoring device 300, the ROI setting unit 210 for setting an ROI in the initial image input from the first camera 110 of the camera device 100. ;
    상기 사용자의 제어정보에 따라 설정된 관심영역을, 제 1 카메라(110)의 이미지 프레임에 매칭시키는 제 1 매칭부(220); A first matching unit 220 matching the ROI set according to the control information of the user with an image frame of the first camera 110;
    상기 제 1 매칭부(220)에서 매칭된 결과이미지를 일시 저장하는 제 1 버퍼부(230); A first buffer unit 230 for temporarily storing the result image matched by the first matching unit 220;
    상기 제 1 버퍼부(230)에 저장된 결과이미지를 제 2 카메라(120)의 프레임에 매칭시키는 제 2 매칭부(240); 및 A second matching unit 240 for matching a result image stored in the first buffer unit 230 to a frame of the second camera 120; And
    상기 제 2 매칭부(240)에서 매칭된 결과이미지를 일시 저장하는 제 2 버퍼부(250); 를 포함하되, A second buffer unit 250 for temporarily storing the result image matched by the second matching unit 240; Including,
    상기 제 1 매칭부(220)는, The first matching unit 220,
    상기 제 2 버퍼부(250)로부터 매칭된 결과이미지가 전송될 경우, 상기 매칭된 결과이미지를 상기 제 1 카메라(110)의 프레임에 매칭시키는 것을 특징으로 하는 복수개의 카메라를 이용한 관심영역 추적 시스템.When the matched result image is transmitted from the second buffer unit (250), the region of interest tracking system using a plurality of cameras, characterized in that matching the matched result image to the frame of the first camera (110).
  4. 제 3 항에 있어서, The method of claim 3, wherein
    상기 관심영역 설정부(210)는,The region of interest setting unit 210,
    상기 모니터링 장치(300)를 통해 관심영역 추적 종료에 관한 사용자의 제어정보가 입력되었는지 여부를 판단하여, 입력된 경우 추적을 종료하는 것을 특징으로 하는 복수개의 카메라를 이용한 관심영역 추적 시스템.And determining whether or not the control information of the user regarding the end of the ROI tracking is input through the monitoring apparatus 300, and ending the tracking if the user inputs the ROI.
  5. 카메라 장치(100), 추적 장치(200) 및 모니터링 장치(300)를 포함하는 시스템을 통한 복수개의 카메라를 이용한 관심영역 추적 방법에 있어서, In the method for tracking a region of interest using a plurality of cameras through a system including a camera device 100, a tracking device 200, and a monitoring device 300,
    (a) 상기 카메라 장치(100)가 동일한 화각으로 목표물에 대한 이미지를 각각 취득하는 단계;(a) acquiring an image of a target by the camera apparatus 100 at the same angle of view;
    (b) 상기 모니터링 장치(300)가 사용자의 제어정보를 입력받는 단계; (b) receiving the control information of the user by the monitoring device 300;
    (c) 상기 추적 장치(200)가 상기 모니터링 장치(300)를 통해 입력되는 사용자의 제어정보를 바탕으로, 상기 카메라 장치(100)의 제 1 카메라(110)로부터 입력된 최초 이미지 내에서 관심영역을 설정하는 단계;(c) The region of interest in the initial image input from the first camera 110 of the camera apparatus 100 based on the control information of the user inputted by the tracking apparatus 200 through the monitoring apparatus 300. Setting up;
    (d) 상기 추적 장치(200)가 상기 사용자의 제어정보에 따라 설정된 관심영역을, 상기 제 1 카메라(110)의 이미지 프레임에 매칭시키는 단계; (d) the tracking device 200 matching the ROI set according to the control information of the user with an image frame of the first camera 110;
    (e) 상기 추적 장치(200)가 상기 제 1 카메라(110)의 이미지 프레임에 매칭된 결과이미지를 일시 저장하는 단계; (e) temporarily storing the resultant image matched to the image frame of the first camera by the tracking device 200;
    (f) 상기 추적 장치(200)가 상기 (e) 단계를 통해 저장된 결과이미지를 제 2 카메라(120)의 프레임에 매칭시키는 단계; (f) the tracking device 200 matching the result image stored through the step (e) with the frame of the second camera 120;
    (g) 상기 추적 장치(200)가 상기 (f) 단계를 통해 매칭된 결과이미지를 일시 저장하는 단계; (g) temporarily storing, by the tracking device, the result image matched through step (f);
    (h) 상기 추적 장치(200)가 상기 (g) 단계를 통해 저장된 결과이미지를 제 1 카메라(110)의 프레임에 매칭시키는 단계; 및 (h) the tracking device 200 matching the result image stored through the step (g) with a frame of the first camera 110; And
    (i) 상기 추적 장치(200)가 상기 모니터링 장치(300)를 통해 관심영역 추적 종료에 관한 사용자의 제어정보가 입력되었는지 여부를 판단하여, 입력된 경우 추적을 종료하는 단계; 를 포함하는 것을 특징으로 하는 복수개의 카메라를 이용한 관심영역 추적 방법.(i) determining, by the tracking device 200, whether or not the user's control information regarding the end of the ROI tracking is input through the monitoring device 300, and terminating the tracking if the tracking device 200 is input; A region of interest tracking method using a plurality of cameras, comprising a.
  6. 제 5 항에 있어서, The method of claim 5,
    (j) 상기 (i) 단계의 판단결과, 입력되지 않은 경우, 상기 추적 장치(200)가 상기 (e) 단계 내지 (h) 단계의 절차를 반복 수행하는 것을 특징으로 하는 복수개의 카메라를 이용한 관심영역 추적 방법.(j) If it is not input as a result of the determination of step (i), the tracking device 200 repeats the steps of (e) to (h). Zone tracking method.
PCT/KR2010/008003 2010-10-27 2010-11-12 System for extracting a target area using a plurality of cameras, and method for same WO2012057389A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2010-0105329 2010-10-27
KR1020100105329A KR20120043995A (en) 2010-10-27 2010-10-27 System and method for extracting region of interest using plural cameras

Publications (1)

Publication Number Publication Date
WO2012057389A1 true WO2012057389A1 (en) 2012-05-03

Family

ID=45994083

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2010/008003 WO2012057389A1 (en) 2010-10-27 2010-11-12 System for extracting a target area using a plurality of cameras, and method for same

Country Status (2)

Country Link
KR (1) KR20120043995A (en)
WO (1) WO2012057389A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110321888A (en) * 2019-03-18 2019-10-11 华中科技大学 A kind of spaceborne infrared small target detection method based on FPGA

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102031142B1 (en) 2013-07-12 2019-10-11 삼성전자주식회사 Electronic device and method for controlling image display
KR102232798B1 (en) 2014-03-18 2021-03-26 에스케이플래닛 주식회사 Service apparatus, user apparatus estimating regions of interest and method therefor, computer readable medium having computer program recorded therefor
KR102336447B1 (en) 2015-07-07 2021-12-07 삼성전자주식회사 Image capturing apparatus and method for the same
KR102391490B1 (en) * 2017-03-27 2022-04-28 삼성전자주식회사 Method for tracking an object in an image and electronic device thereof
KR102092392B1 (en) * 2018-06-15 2020-03-23 네이버랩스 주식회사 Method and system for automatically collecting and updating information about point of interest in real space

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19980054703A (en) * 1996-12-27 1998-09-25 구자홍 How to control the focus area of the camera
KR20060051256A (en) * 2004-09-13 2006-05-19 소니 가부시끼 가이샤 Imaging system and imaging method
KR20100007535A (en) * 2008-07-14 2010-01-22 한국산업기술대학교산학협력단 Method for tracking moving objects using characteristics of moving objects in image camera system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19980054703A (en) * 1996-12-27 1998-09-25 구자홍 How to control the focus area of the camera
KR20060051256A (en) * 2004-09-13 2006-05-19 소니 가부시끼 가이샤 Imaging system and imaging method
KR20100007535A (en) * 2008-07-14 2010-01-22 한국산업기술대학교산학협력단 Method for tracking moving objects using characteristics of moving objects in image camera system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110321888A (en) * 2019-03-18 2019-10-11 华中科技大学 A kind of spaceborne infrared small target detection method based on FPGA
CN110321888B (en) * 2019-03-18 2021-11-19 华中科技大学 FPGA-based satellite-borne infrared small target detection method

Also Published As

Publication number Publication date
KR20120043995A (en) 2012-05-07

Similar Documents

Publication Publication Date Title
WO2012057389A1 (en) System for extracting a target area using a plurality of cameras, and method for same
WO2019132168A1 (en) System for learning surgical image data
WO2018124707A1 (en) Input processing method using neural network computation, and apparatus therefor
US9690998B2 (en) Facial spoofing detection in image based biometrics
CN104521223B (en) With the wear-type computer without manual alarm reaction
WO2015178540A1 (en) Apparatus and method for tracking target using handover between cameras
WO2021071288A1 (en) Fracture diagnosis model training method and device
WO2015115802A1 (en) Depth information extracting device and method
WO2017142311A1 (en) Multi-object tracking system and multi-object tracking method using same
WO2021020866A1 (en) Image analysis system and method for remote monitoring
CN103999020A (en) Method for gesture control, gesture server device and sensor input device
WO2017095120A1 (en) Behaviour pattern analysis system and method using depth image
WO2016060453A1 (en) License plate number input device, and method therefor
WO2016167504A1 (en) Smart mirror device and user-customized image providing method
WO2017115887A1 (en) Device for providing motion recognition-based game, method for same, and computer-readable recording medium on which said method is recorded
WO2018135906A1 (en) Camera and image processing method of camera
KR20120072009A (en) Interaction recognition apparatus for multiple user and method thereof
WO2019088335A1 (en) Intelligent collaboration server and system, and collaboration-based analysis method thereof
US20190272692A1 (en) Monitoring terminal device and display processing method
US11983959B2 (en) Securing data of objects in a laboratory environment
CN113221703B (en) Wearing mask monitoring method, device and equipment based on non-service edge calculation
KR20100007535A (en) Method for tracking moving objects using characteristics of moving objects in image camera system
WO2015108401A1 (en) Portable device and control method using plurality of cameras
WO2021167312A1 (en) Touch recognition method and device having lidar sensor
WO2012057392A1 (en) System for measuring distance using a plurality of cameras, and method for same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10859003

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10859003

Country of ref document: EP

Kind code of ref document: A1