TW201209761A - Method of monitoring images - Google Patents

Abstract

A method of monitoring images, which includes: choosing a fixed camera; choosing a PTZ camera; using the fixed camera and the PTZ camera to generate related camera data comprising at least two located points to define pan, tile, and zoom value of the PTZ camera; clicking an object on the frame of the fixed camera; controlling the PTZ camera moved to the clicked objected according to the related camera data.

Description

201209761 VI. Description of the Invention: [Technical Field of the Invention] The present invention relates to an image monitoring method, and more particularly to a zero-time difference image monitoring method. [Prior Art] With the development of technology, the traditional monitoring method of traditional security personnel with general fixed-view camera can not meet the needs of people for security monitoring. Due to the rapid development of image processing technology and the decline of hardware prices, Image surveillance devices that can be combined with image processing technology have been widely used, which has led to the trend of high-tech security in the field of closed security monitoring. In general, the camera can be divided into two types: a solid-type camera and a rotary zoom (pan/Tilt/z〇〇m, PTZ) camera. The rotary zoom camera has a rotating function and a zoom function, including a fast ball (speed). D_) Camera' and the fixed camera can only observe the fixed size of the fixed scene, unable to rotate and zoom. A fixed camera monitors all suspicious people and things in their location. However, since there is no rotation or zoom function, even if there is an intruder in the :::2 location, the fixed camera is still Η 2 = 2 The image of the invader is located in the corner that the camera cannot monitor or The vain MH invaders (4) present a small image in a fixed image, but cannot be effective information of the user.杈 疋 疋 摄 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋 疋After discovering that the 1u 疋 camera appeared in the place where it is being monitored - the intruder, the 201209761 rotating zoom camera can be used to smash the field >& ^ image of the intruder in the image === The generated rotating zoom image first moves to the center of the above-mentioned rotating zoom image, and then uses the zoom function to enlarge the image of the intruder, so that the user who rotates the zoom camera can clearly see the face of the invader孑L ^ (4) Rotating the zoom camera in the eye-If control market has reached the generalization of the の potential = camera movement and changing the focal length to achieve the monitoring of no dead angle on the best and fastest control rotary zoom camera Fang 2: The *private-type control platform 'can be controlled by hardware or software, but: good' event location is not set by the rotary zoom camera, because the location is not a rotating focus camera::,,, Immediately rotate and focus to the location of the incident, that is, the helmet = that is, by controlling the platform to turn the face to the place where the event occurred, the second invention is then oysters. The present invention provides a system for simultaneous positioning and tracking, and a system for establishing a synchronous positioning tracking and monitoring system for a solid-state camera and a rotating-focus camera. The camera-associated data 'in turn allows the user to select (or point to the specific person of the picture presented by the camera) that the point of the user is pointing to the phase position, thereby making the step of the material difference 201209761 : ί 发明 发明 - kind of image monitoring method, description equipment: two: with a device management module to establish - camera data; the above model I = group to establish a rotating zoom camera data; Actuating the association by the above-mentioned association module; the screen for selecting the camera data by the selected central management module is to move the rotation:: the association module performs the above-mentioned association control to describe the phase n, and the zoom camera is enabled Corresponding to the position of up to ==4 to the selected position. If not, it is determined by the above-mentioned central Luli: group whether to end the above image monitoring method. Step-by-step provides an image monitoring method, selects a fixed camera; selects-rotates the zoom camera and the above-mentioned fixed-type camera and the above-mentioned rotary zoom camera: the pain-integrating data contains at least two positioning points and a μ-type camera Selecting an object or a position in the picture; the camera related data is used to control the movement of the rotary zoom camera, and the zoom camera is aligned to the selected object or position, wherein 'the above positioning point data is established The step of: setting an anchor point by using the above fixed camera; controlling the above-mentioned rotary zoom camera to locate the positioning point; adjusting the writing of the rotary zoom camera to match the object size; moving the rotary zoom camera The distance and zoom size are defined as anchor point data. In addition, the step of controlling the rotating zoom camera to the selected object or position comprises: capturing the selected object or position by using the associated module; and calculating, by using the associated module, a rotating zoom camera to move to the selected object Or location 201209761 required distance; using the above associated module ▲ above selected object or location. 4 疋 zoom camera to another advantage of this month is the above technology ^ ^ fixed camera to achieve multiple field ^ / / text ~ ~ hard number function. #处,的同步同步(零时差)Monitoring The above description is for the purpose of explaining the purpose of the present invention, and the description of the technical embodiment for the purpose of the other is accompanied by _^β Λ understand clearly. The present invention will be explained in terms of preferred embodiments and viewpoints, and the structure and steps of the present invention will be explained in a preferred embodiment. Therefore, the present invention may be widely practiced in other embodiments in addition to the preferred embodiments described herein. The synchronous image monitoring system of the present invention is as shown in the fourth figure, and the image monitoring system includes: device communication interface 4 撷 image capturing device, fixed 'photo ～ 403, red to zoom camera 4 〇 4, net Road camera 4〇5,: Zhoulu rotary focus camera 4〇6, management system communication interface training, central s management group 502, equipment management module 5〇3, association module 5〇4, image office "module , 'and 505, alarm notification module 5〇6, system database 5〇7. In this embodiment, the 'fixed camera 4〇3 and the rotary zoom camera are connected to the image manipulation device 4〇2 to generate a video stream that can be transmitted through the network, and the image capturing device 4〇 2 can include image capture card (Capture Card), network video recorder (NVR) or digital video recorder (DVR) 201209761 and so on. The image capturing device 402, the network camera 405, and the network rotating zoom camera 406 are respectively coupled to the device communication interface 401, so as to transmit the obtained image or video to the central management module 502, wherein the central management module It is coupled to a management system communication interface 501 for wired or wireless transmission with the device communication interface 401. Specifically, it can be wirelessly connected using an ethernet, an internet, a WiFi wireless network, or other communication network. transmission. The device management module 503, the association module 504, the image processing module 505, the alarm notification module 506, and the system database 507 are all coupled to the central management module 502, and the central management module 502, device management The module 503, the association module 504, the image processing module 505, and the alarm notification module 506 are all programmable in a processing device of a computer, such as a processor, a digital signal processor (DSP), a microcontroller, Application-specific integrated circuits (ASICs), application-specific instruction set processors (ASIPs), chips, multi-chip or wafer sets, system-on-chip (SoC), multiprocessor system chips (MPSoC), programmable a logic controller (PLC), a graphics processing unit (GPU) or a field programmable gate array (FPGA), etc., and a system database 507 for storing camera data and camera related data. It can be a computer readable medium such as a hard disk, a compact disc, a flash memory, a random access memory (RAM), or a read only memory (ROM). The device management module 503 is configured to manage the fixed camera 403, the rotary zoom camera 404, the network camera 405, and the network rotary zoom camera 406, thereby establishing the data of the on-camera camera; and the association module 504 is Used to establish camera-related data, and can be used in the fixed camera 403. C 1 7 201209761 ^ When the fixed area is selected or clicked, the rotary zoom camera 404 is controlled to be transferred immediately to facilitate the shooting to be selected or Clicking on the geographical location of the screen; the image processing module converts the video stream obtained by the central management module 502 into a video format that can be played on the screen, such as swollen MJPEG, MPEG1, MPEG2, MPEG4, H.263 , H.264; 憨 report = modulo; 506 can be in the presence of suspicious people, or when an event occurs; an alarm to alert the user. x ® related to the method for performing the instant synchronous image monitoring system of the present invention, which is described as follows: first transaction, $ ^ ^ ^ ^ ^ first, select a fixed camera; then, select-rotate the zoom camera; then, The fixing material includes two positioning points to define the landline: the joint data, click on an object or == in the camera related information plane, and the mirror and control of the rotating zoom camera are arranged on the fixed camera to facilitate the use. In the picture =:=s select or click on the geographical position. The object of the invention is disclosed or clicked. The data is immediately transferred to the center of the screen ^ @ = The above camera is associated to achieve the effect of synchronous monitoring. The first _ solid skin = phase:: geographical location, into a dew, like the monitoring side contains less - fixed photography; and the above image monitoring system to (four) / Dingcai, PTZ), which rotates: camera ^ (speed D〇me)#f^ ; In the monitoring system, it is measured by a central management module (4) whether there is a photo = 201209761. In the system database, the above camera data refers to the image data generated by the solid, the specific 'photo Run the machine ^ . ·, eight δ, this camera data is a line of sight and a stream of streaming), what is it?

_G1, brain G2, MPEG4, H, 263, H 264 _= T 2 database does not exist any camera data, then enter the steps, use the - device management module to establish - camera data, that is, profit = The management team obtained the image data of the fixed camera and the poor library; then, if Li Tongzi Zizi; 糸, wash into (4) the existing camera data in the library, into the ^, by the central government module phase exists At least one rotation

= camera data in the system database, the above rotation type C :: (four): the image produced by the rotary zoom camera ~ · I' is - video stream; 'and then 1 system database does not exist any Rotating the zoom camera data, the management module is set up - the rotary zoom camera (4) is used; = using the equipment management module to obtain the rotation change, the machine shakes the ', that is, using the equipment to carefully image the machine image, and store it in the system If there is already a rotating zoom photography in the database of the yakuru system, then the step 1G6' is managed by the central management module _ whether there is a camera-related data in the system database. The data contains two positioning points, 1 The screen of the camera body is positioned to the fixed camera rotary zoom photography (, , the squeaking required for each position of the suffocating surface (two zooms (Z. - points or objects (for example, the photographic lens can be captured) The location of the above selected location: in people, vehicles, etc.), the detailed method will be described separately in this specification; if there is no camera related information f ς· 1 9 201209761 exists in the system In the library, proceed to step m: establish camera-related data, that is, use the associated module 2:: camera and rotary zoom camera to perform the position, which is described in detail in the detailed description; however, if the system data If there is already a joint venture in the library, then proceed to step (10), and use the associated module to activate the off: control. The above-mentioned associated control means that when the written medium-object of the fixed camera is selected, the rotary zoom camera can immediately react to the zoom. (4) lens, so that the image captured by the lens contains the above = = piece 'best is located in the ten central area of the captured image, that is, the face of the shadow, and focus on the above objects; in steps 1〇9 Using the Central Prime Minister module to detect whether the face of the camera data has been clicked, and the second invention includes a user interface that can display the surface of the fixed camera or the shirt image, and display the cursor on the display screen for The user selects or clicks on the object or position to be observed; if it is selected or clicked, proceeds to step 110, and the associated module performs the associated control to rotate the zoom camera. Move to the clicked position and focus on the clicked object ^ = If the screen is not selected, click to go to step 1U, and the user will decide whether to end the image monitoring system; finally, if you choose to end the monitoring program, Then, in step 112, the image monitoring system is ended. δ month is shown in the second figure, and the figure describes in detail the method for establishing camera related data in steps 1 and 7 of the first figure. The steps are as follows: In the second step, a fixed zoom camera is selected; then, in step 2〇2, a rotary zoom camera is selected, which is a rotary zoom camera associated with the above fixed camera, that is, the rotary zoom camera must be r. 201209761: Take a second view to the selected fixed camera; then, in step 203, the associated module detects the car 次 丨 丨 丨 俊 于 于 于 于 步骤 ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; If there is a name of the camera-related data of the two anchor points, the user enters the step of the step, and the input face enters the text or number to be used. The user can store the file through the user step 205. ^ The name of this association information purposes; and finally, into the back + Cong 9Π1 such as organ associated data in the system database; however,

(4) If there is no resource for the two anchor points in the database of the cattle system, go to step 2〇6; set-positioning point of the camera, and the body is suddenly, second: the number taken with the above fixed camera The user can select an object or a positioning point in the image of the fixed camera J. After the iron, the Xiefeng tender elbow/, 夂我马 ^ ^: In step 207, the above-mentioned rotary zoom camera is controlled. (4) The selected object or position is presented in the image or screen center of the purely zoomed operation, and the positioning procedure is completed. Specifically, the 0 user controls 'turns it left and right ((4)) and tilts up and down (1) (4) j to rotate the zoom camera so that the center of the screen is aligned and fixed at the above-mentioned 疋 position, and then ^丰^^ η ..^ In step 208, the rotating zoom type photographic Si surface is adjusted to adjust the size of the composite component. Specifically, the zoom function of the rotary zoom type is used to zoom the zoom camera and focus on the positioning. Point, so that the object or position as the anchor point is clearly visible, so as to achieve the positioning effect. Then, in step 209, the above-mentioned positioning point data is stored in the system of the billet library, and the left and right rotations of the rotating zoom camera are tilted up and down (small) and the zoom size &; (10) values are defined as (Xl, Yl, Zl) ' and stored as anchor point data. Then, and returning to step 203 [S1 201209761, steps 206-209 are repeated to establish another location (χ2, γ2, Ζ2). By using the above two positioning points, the other points (Χ, Υ, Ζ) in the face of the camera can be calculated. The detailed calculation method is as follows: define a plane coordinate (X, y) In the face of the fixed camera, it is assumed that the first positioning point is (Xi, yi) in the plane of the fixed camera, and the second positioning point is 〇2, y2), and the rotary zoom camera is rotated from the origin to The pan value of the first positioning point is X1, and the pan value of the second positioning point is X2, then an absolute rotation parameter can be defined, and thus the relative rotation parameter is defined by the absolute rotation parameter.

Com-P=(Xl_Base_P)/Xi, and the X value of other positions to be observed in the surface of the fixed camera is calculated from the absolute rotation parameter and the relative rotation parameter CGm_P, and the relationship is as follows:

X = Base_P + x * com_P where X is the ordinate value to be observed in the fixed camera screen, and the above relationship can be used to obtain the pani X of the rotary zoom camera to this position. Similarly, assuming that the rotary zoom photography origin is tilted to the value of the tile at the -m point from Υι' to the point where the mth point is Υ2, an absolute tilt parameter can be defined.

Base_T ((Yi (yvym-D/^/yi·1)' and thus the absolute tilt moxibus number definition - relative tilt parameter com_T = (Yi_Base_T) / y 丨, and the absolute tilt parameter Base - T and relative tilt parameter c 〇m_T can calculate the γ value of other positions to be observed in the screen of the fixed camera, and the relationship is as follows: 疋' Y=Base_T+y*c〇m_T . Where y is the position to be observed in the fixed camera In the vertical [S] 12 201209761 coordinate value, and using the above relationship, you can get the rotary zoom / tile value Y to this position. Finally, assume that the rotary zoom = the scaling value of the second positioning point of the second machine (2〇〇 111) is Ζι, to the second fixed X~ machine value, 'can define 'absolute shrinkage and thus absolute scaling parameter definition-relative scaling parameter c〇m-z=(Zl_Base_z)/yi, and The parameter BaSe_Z& relative scaling parameter Cc)mZ can be used to calculate the z value of other positions to be observed in the plane of the camera. The relationship is as follows: Z=Base_Z+y*Com_Z where 'y means the position to be observed is fixed. The camera is squatting, and the above relationship can be used to get the rotary zoom camera to rotate here. The zoom (2_) value of the position is z. According to this, as long as the two positioning points are defined by the fixed machine and the rotary zoom camera, the above: == parameter value can be obtained, and the through-plane of the above-mentioned _ (4) stereo camera can be transmitted. Each position (x, y) is converted to a value of (x, γ, ζ), that is, the rotation (four), tilt, and zoom required for the rotary-focus camera to be positioned from the origin to each position. The value, by which, when any point (X, y) in the fixed camera screen is clicked, the associated module can be immediately converted to a (χ, γ, ζ) value and controlled according to this (Χ, γ, ζ) value. Rotate the zoom camera to the position of the click to achieve zero time difference monitoring. W Please refer to the third figure. This figure is used to describe the method of moving the center of the screen of the rotary zoom camera to the clicked position. The steps are as follows: Said: first, in step 30, searching for the camera associated with the poor material in the system database; then, entering the step of moving, using the associated module to manipulate the clicked position in the screen of the 201209761 camera, specifically, Invention can make use of one The interface is not fixed to the user of the camera, when the user moves: the gold face, 'has a cursor to know that an object is on the face or pays the bill: the associated module can capture the click position; Then, in step 303, the associated module is used to calculate the required distance of the rotational zoom click position. Specifically, the second and second ================================================

1 ...... 3, Y3, Z3), that is, the rotation (pan), tilt (6) e) and zoom required by the rotary zoom camera from the origin = stand to (X3, y3)

,: The center of the face of the two-rotary zoom camera corresponds to B ^ pure (X4, y4)' _ module can be converted to (Χ4, Υ4, Ζ4) according to the above relationship, that is, rotary zoom The position of the camera from the origin to U4, y4), pan, tilt and zoom (after z is calculated using the associated module (Χ3, Υ3, Ζ3) and (Χ4, Υ4, Ζ4) △ Υ ' ΔΖ), which is the required distance to move the screen of the rotary zoom camera; then, in step 3〇4, according to the above distance (Δ X, Δ y, Δ z), Control the rotary zoom, the camera's written 'make it to the click position, and then achieve the monitoring effect. The camera-related data established by the two inventions can set the various positions in the fixed camera's picture (X, y) Converted to (χ, γ, ζ) value, that is, the rotation (pan), tilt (1) (4) and zoom values required for the rotary zoom camera to be positioned from the origin to each position, so when the user clicks on the fixed camera When you are kneading the face, you can rotate the zoom camera according to The camera-related data immediately shifts the center of the screen to the clicked position, thereby achieving the effect of synchronous monitoring: 201209761 The above description is a better description of the present invention. It is used to illustrate this example. The scope of the patent rights of Zhang is limited to the main scope of the invention and its equivalent fields: the application of the patents attached to the two patents is within the spirit or scope of the patent, and the skilled person in the field Revealing the spirit of the completion or retouching, are within the scope of the patent application of the equivalent change of the I Fan of the hair. The text η and leaves, and should be included

BRIEF DESCRIPTION OF THE DRAWINGS The first drawing shows a preferred embodiment of the present invention; the second drawing shows the method of the first step 107 of the first figure; establishing the camera associated information center shifting to the third drawing, the description will rotate The method of clicking the position of the gold of the zoom camera; the fourth picture shows the monitoring system. - Image for image monitoring method of the present invention [Key element symbol description] 101-112 Steps 201-209 Steps 301-304 Step 401 Device communication interface 402 Image manipulation setting 403 Fixed camera 404 Rotary zoom camera 405 Webcam

15 201209761 406 Network Rotary Zoom Camera 501 Management System Communication Interface 502 Central Management Module 503 Device Management Module 504 Association Module 505 Image Processing Module 506 Alarm Notification Module 507 System Library

16

Claims (1)

201209761 VII. Shenqing patent scope: 1. An image monitoring method, the steps comprising: selecting a fixed camera; selecting a rotary zoom camera; using the fixed camera and the rotary zoom camera to establish a camera related data' It includes at least two anchor point data to define the pan, tile, and zoom of the camera, and to select an object or position in the face of the fixed camera. Controlling the movement of the rotary zoom camera according to the camera associated data, and aligning the zoom camera with the selected object or position. 2. The image monitoring method according to claim 1, wherein the positioning material is established The steps include: t, the fixed camera, the mandating-positioning point; the scrambled nuclear rotating zoom camera is rotated and tilted, so that the image center of the rotating zoom camera is positioned to the positioning point; ', , the image of the child's red to zoom camera to match the size of the object or position; The rotation, tilting and zooming value of the camera is defined as the positioning point data. 2. The image monitoring method according to the item 1 of 5, wherein the step of controlling the rotating zoom 17 201209761 type camera to the clicked object comprises: utilizing The associated module retrieves the selected object or position; the associated module calculates - the rotational variable f, the required distance of the camera to the selected object or position; the late = ^ associated core group controls the rotary zoom camera transfer To the selected object or position. Heart: member/the image monitoring method described, wherein the rotary zoom camera is a fast-speed camera. 5. The image of claim 1 is ^ ^ ^ ^, like the dish control method, wherein the fixed camera (NVR) number::, the type of camera is connected to the network video recorder Card). A video recorder (DVR) or an image capture card (Cap_ 201209761), the camera associated data includes at least two positioning point data, thereby defining the rotation (pan), tilt (me) 9 zoom (zoom) of the rotary zoom camera The value of the method of establishing the camera association as described in claim 6 includes: selecting a fixed camera; selecting the rotary zoom camera; using the associated module to determine (4) the contact association (4) the location data; If the ls side is two, it is stored as an associated positioning data; if not, the associated positioning step is performed. The image monitoring according to claim 7 includes: a method, wherein the associated positioning step uses a fixed camera to set an positioning point; and controls the rotating zoom camera to locate the positioning point. Adjusting the rotation zoom camera Face to match the size of the object. The step of performing the association control by using the image monitoring method described in claim 6 includes: transferring the clicked location surface to the associated module to calculate the rotary zoom camera Book 201209761 The required distance of the selected position; the associated module is used to control the transfer of the face of the rotary zoom camera to the selected position. 10. The image monitoring method of claim 6, wherein the camera data comprises fixed camera data or webcam data. 20