KR20080055423A - Method and apparatus for controlling camera using general-purpose interface in real time ip-surveillance system - Google Patents

Abstract

A method and an apparatus for controlling a camera by using a universal interface in a real time Internet protocol-based monitoring system are provided to maintain the compatibility among a terminal and several application systems by adapting the SIP(Secession Initiation Protocol) defined by the IETF(Internet Engineering Task Force). When an external control signal is received, a system control unit(410) of a camera terminal controls the entire operation of the camera terminal. An IP(Internet Protocol) stack unit(420) performs the Internet protocol process. An SIP/SDP unit(430) performs an SIP/SDP protocol. An RTP(Real time Transfer Protocol) unit(440) performs an RTP protocol. A control unit(450) performs the PTZ control of a camera. An encoder unit(460) using MPEG4/H.264 encodes the audio and video signals. A streamer application block unit(470) performs the application program such as motion detection and the like. The system control unit is connected with a camera through RS232 or RS485 and the like and transmits a control signal received from a client to the camera.

Description

Method and apparatus for controlling camera using general-purpose interface in real time IP-Surveillance System}

1 is a configuration diagram of an embodiment of an internet protocol-based monitoring service system using real-time transmission according to the present invention;

2A to 2H are signal flow diagrams illustrating session connection, termination, and process between a client, a surveillance service system, and a camera terminal.

3 is a view showing a flow of a SIP signal according to the real-time video playback,

4 is a block diagram showing the configuration of a camera terminal according to an embodiment of the present invention.

The present invention relates to a method and apparatus for controlling a camera using a universal interface in an internet protocol based surveillance system using real-time transmission, and more particularly, to a PTZ (Pan / Pan / Pan / Tilt / Zoom) control method and apparatus.

Closed Circuit TV (CCTV) systems use a plurality of video cameras to capture a moving picture of a predetermined range and record the moving picture data on a video tape or a CD. By playing a videotape or CD, an administrator can see what happened at a particular time or location. However, since the conventional closed circuit TV stores the captured moving image data on the video tape in an analog manner, the recordable time is very limited according to the storage capacity of the video tape, and there are many restrictions in the processing of the analog moving image data.

In order to solve this problem, recently, the use of digital video recorders (DVRs) capable of digitally storing captured video data and managing and transmitting them as necessary is increasing.

Digital video recorder (DVR) is a form of recording media from tape to hard disk with the development of digital video processing technology and compression technology in closed circuit television (CCTV) surveillance system.

That is, since the digital video recorder (DVR) can record the moving picture photographed in the management area as digital data, the recorded moving picture data can be easily retrieved, and the still picture moving picture can be printed on the plain paper.

In addition, the digital video recorder converts moving image data captured by an analog method into a digital signal, and then compresses and restores the moving image data according to the MPEG (Moving Picture Experts Group) protocol, thereby recording / reproducing the moving image data. Also, by including a motion detection sensor or an alarm device in the digital video recorder, it is possible to automatically record and record a moving picture according to the motion of an object in the management area in an emergency situation. In particular, since the digital video recorder is smaller, cheaper and easier to operate than an analog CCTV, it can be used in a building equipped with a matrix switch equipped with a plurality of digital cameras and sensors.

Meanwhile, in order to use a digital video recorder (DVR), an expensive DVR main body and camera equipment have to be purchased, and a cable installation cost of a considerable cost has to be paid depending on the place. Even if a network camera using a network without a coaxial cable was used, a digital video recorder (DVR) had to be provided at a specific place in order to use video recording, storage, and monitoring functions.

In addition, due to the development of the Internet, it is possible for a user to search for a remote DVR through the Internet. However, the user also has to inconvenience to maintain and maintain a personal DVR.

The present invention has been proposed to solve the above problems, and to provide a method and apparatus for PTZ control of a terminal used in an IP-Surveillance system.

In another aspect, the present invention is to provide a SIP-based access method of the terminal and the terminal to maintain the compatibility with the terminal and the various application systems employing the SIP protocol adopted by the IETF.

The present invention for achieving the above object, the control signal determining means for receiving the PTZ control signal of the camera generated from the client and interpreting it to determine the type of the signal; Control signal acquiring means for acquiring a control code of the corresponding camera according to the control signal; And a PTZ control means for controlling the PTZ of the camera by transmitting the obtained control signal to the corresponding camera.

In addition, the present invention comprises the steps of receiving a PTZ control signal of the camera generated from the client and interpreting it to determine the type of signal;

Acquiring a control code of a corresponding camera according to the control signal; And

The method of controlling a camera using a universal interface in a real-time internet protocol based surveillance system includes transmitting the obtained control signal to a corresponding camera to control the PTZ of the camera.

In addition, the present invention comprises the steps of the client terminal is connected to the recording server through the SIP server; Transmitting, by the client terminal, a control signal in the form of an instant message to the camera terminal through a session connection established between the SIP server and the recording server when a user interface manipulation occurs; And a control method of a camera using a general-purpose interface in a real-time internet protocol based surveillance system comprising controlling a PTZ of a corresponding camera according to the control signal.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. First of all, in adding reference numerals to the components of each drawing, it should be noted that the same components have the same number as much as possible even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related known technology may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an embodiment of an internet protocol based surveillance service system using real time transmission according to the present invention.

Referring to FIG. 1, a surveillance service system includes a plurality of cameras 11 equipped with a PTZ module, a plurality of camera terminals 12 equipped with SIP UAC connected to each of the cameras to transmit a control signal, and a surveillance service system based on an Internet protocol. 13, and three tiers of various clients 14.

The camera 11 may be used in connection with the camera terminal 12 equipped with a SIP UAC camera for surveillance, but a PTZ module for performing a PTZ function should be mounted to enable PTZ control.

The camera terminal 12 receives an image signal input from the camera and compresses the image signal, and delivers the compressed image signal to the surveillance service system 13 using the RTP protocol. In addition, it performs a function of adjusting the PTZ of the camera according to the control signal received from the client 14.

The client 14 may generally use a personal computer (PC), but may use a mobile communication terminal, a personal mobile communication terminal (PCS), a personal digital terminal (PDA), a smartphone, a next generation mobile communication terminal (IMT-2000), and a wireless device. A wireless communication terminal such as a LAN terminal or a video terminal having an internet access function can be used. However, in the present invention, a universal interface for controlling the PTZ of the camera 11, for example, a joystick 15, should be connected to exchange a signal with a SIP-based camera terminal. Therefore, it is preferable to use a universal joystick as a general-purpose interface for controlling PTZ, and the user can control the PTZ of the camera by using the joystick.

The monitoring service system 13 based on the Internet protocol is delivered in real time using a real time transmission protocol (RTP) from a SIP server 131 that is responsible for user authentication (login, logout), connection establishment, and billing, and a camera terminal 12 connected through the Internet. The received video data is stored in a video data storage 137, and the connection between the camera and the client 14 is relayed according to a video relay request from a client 14 connected through the Internet, and the video is transmitted according to a video play request from the client 14. A media server 132 for retrieving and transmitting moving image data stored in the data storage 137 and a moving image data storage 137 for storing a moving image photographed by the camera 11 according to a control of the media server 132 according to a user. .

In this case, the SIP server 131 preferably includes a SIP location registration server, a SIP proxy server, and a SIP redirect server.

For reference, the Session Initiation Protocol (SIP) is an Internet standard protocol developed by referring to a large part of the HyperText Transfer Protocol (HTTP) and uses an Internet address (URL). The message structure is text-based, written in ASCII, and the message structure consists of a header and a body. The basic function of the connection establishment protocol is to set up a call between VoIP terminals. There is no difference in function from ITU-T H.323. However, the connection establishment protocol is a text-based protocol that is easy to implement and is an Internet standard. Easy to compatible with In addition, the connection establishment protocol is an application layer control protocol, and is a unicast and multicast session capable of transmitting and receiving both request / response messages. Support all.

Meanwhile, the SIP server 131 finds location information of a called user agent server (UAC) and notifies the calling user agent client (UAC: User Agent Client) of the redirect server and user to directly attempt to set up a call. Proxy that finds location information of agent server (UAC: User Agent Server) and enables call setup from the middle, and simultaneously performs functions of user agent server (UAC: User Agent Server) and user agent client (UAC: User Agent Client) Include a server.

First, the SIP location registration server tracks the location of the client 14 and registers / manages the status information and location information of the camera 11 in the location registration database. The IP addresses of the client 14 and the camera 11 may change depending on the situation (for example, when using the Dynamic Address Allocation Protocol (DHCP)) and the SIP for connecting the client 14 and the camera 11. The location registration server provides a function of mapping an IP address and a SIP address.

The SIP proxy server establishes a request and response path of a message, determines a server to be sent according to a call request from a user agent client (UAC), and modifies and forwards a header.

The redirect server does not forward the call request but forwards the response containing the address of the next server to the user agent client (UAC), which allows UAC to send it directly.

On the other hand, the media server 132 processes a SIP message, and accordingly a video recorder for transmitting the video data received from the camera terminal 12 using the real-time transmission protocol (RTP) to the recording server 135 ( 133), the recording server 135 for storing the video data received from the video recorder 133 in the video data storage 137 for each user, and the video data storage in response to a request from the video player 134. Streaming server 136 for reading from 137 and delivering to video player 134, processes SIP message from client 14, requests video data to streaming server 136 and receives it accordingly. And a video player 134 for transmission to the client 14.

On the other hand, the signal flow for the session connection and termination of the camera or camera terminal is as shown in Figures 2a to 2f. First, as shown in FIG. 2A, when the power of the camera terminal 12 is applied, a registration request (REGISTER (Fetch)) message is transmitted to the SIP server 131 (201), and the SIP server 131 responds to this. The message 200 OK is transmitted to the camera terminal 12 (202. Then, the camera terminal 12 transmits an address registration message (REGISTER (registration)) to the SIP server 131 (203) and the SIP server 131 ) Registers the camera 11 connected to the camera terminal 12 and transmits a response message 200 OK thereto (204). When the address of the camera is registered, the camera terminal 12 and the SIP server are registered. 131 periodically detects the registration expiration time (205 to 208.) FIG. 2B is a signal flow diagram illustrating a process of establishing a call between a camera terminal and a media server, and FIG. 2C illustrates a process of establishing a call between a camera terminal and a client. Signal flow diagrams, FIGS. 2D and 2E show a call number between a media server and a camera terminal. Process, Fig. 2f and 2g which is a signal flowchart illustrating a procedure where a call is completed between the client and the camera terminals. Figure 2h is a signal flow chart when the media server the media information change (Destination IP / Port).

For reference, in the surveillance service system illustrated in FIG. 1, a specific implementation of a video recording method, a real-time video method, and a two-way voice service providing method is disclosed in Korean Patent Laid-Open Publication No. 2006-119100.

3 is a diagram illustrating the flow of a SIP signal according to real-time video playback.

Referring to FIG. 3, the various types of clients 14 are connected to the recording server 135 via the SIP proxy server in steps 301 to 314, and the client 14 instant message according to the user's interface (general joystick) operation. A control signal of a type, that is, a signal for controlling the angle (Pan), tilt (Tilt), zoom, etc. of the camera 11 to the camera terminal 12 through a session connection established between the SIP proxy server and the recording server. Transmit (315-316). The camera terminal 12 controls the operation of the camera 11 according to the received control signal, and terminates the session when a disconnect signal is received from the client 14 (317 to 320).

4 is a block diagram showing the configuration of a camera terminal according to an embodiment of the present invention.

In the present invention, the PTZ control service is required for a terminal that can accommodate the data received from the camera as data suitable for transmission and reception on the network. Such a camera terminal can be a semi-computer type terminal based on Linux or Windows CE and add various application functions.

Referring to FIG. 4, the camera terminal receives an external control signal and performs a system controller 410 for controlling the overall operation of the terminal, an IP stack unit 420 in charge of Internet protocol processing, and a SIP / SDP protocol. SIP / SDP unit 430, RTP unit 440 for performing RTP protocol, camera control unit 450 for PTZ control of camera, encoder for encoding audio and video (Encoder, MPEG4 / H.264) 460, a streamer application block 470 for executing an application program (motion detection, etc.).

The system controller 410 is not limited thereto, but is connected to the camera through RS232 or RS485, and performs a function of transmitting a control signal transmitted from a client to the camera. That is, the signal generated by the client 14 is transmitted to the monitoring system 13 through the instant message of the SIP, and again through the interpretation of the IP stack unit 420 and the SIP / SDP unit 430 of the camera terminal. After the signal type is determined by the application program executed in the unit 470, the camera control unit 450 receives the control signal of the camera as described later, and receives the control signal from the system controller 410. To the camera. If a sensor or alarm device is installed, the signal generated from the sensor or alarm device is input to the system control unit 410, and the system control unit 410 transmits the input signal to the streamer application unit 470. The type of signal is analyzed. The interpreted signal is encoded according to the SIP protocol and then transmitted to the monitoring system 13 in the form of an instant message. The monitoring system 13 performs an appropriate operation according to the received signal. For example, when it is necessary to pop up a scene by receiving an alarm signal, the monitoring system 14 sends the information back to the client 14 to send the information to the client 14 and the operation is performed on the client.

The camera controller 450 performs a function of receiving a camera control signal different from each camera manufacturer and transmitting it to the camera 11. Each camera control code is managed by an arbitrary server of the surveillance system 13 and the camera control unit 450 merely performs a function of transferring the control code of the corresponding camera to the camera. That is, rather than storing all the PTZ control codes for each camera manufacturer in the camera terminal, the control codes are managed in a table by any server of the monitoring system 13, and the monitoring system 13 responds to signals received from the client. The control code is transmitted to the camera terminal 12, and the camera controller 450 of the camera terminal transmits the received control code to the camera 11 so that the camera 11 performs the corresponding operation.

An example of a method of setting a SIP instant message transmitted from the client 14 to the camera terminal is as follows.

-Move unit of PTZ

In the example of A-BNF based syntax described below, when the value of the 'Action' field is "PAN LEFT START", it moves by a preset PTZ movement unit.

-You can save and set more than 10 PTZ presets per camera.

-If the value of 'PRESET SAVE' field of SIP instant message is 03, save PTZ of current camera in preset 03.

-If the value of 'PRESET GOTO' field of SIP instant message is 03, it moves the PTZ of the current camera to the PTZ value stored in preset 03.

-If the value of 'PRESET DELETE' field of SIP instant message is 03, delete PTZ of current camera at preset 03.

-'PAN_OFFSET' and 'TILT_OFFSET' of SIP instant message have a value of -100 ~ 100. This value is a relative value, and the streamer application unit 470 and the camera 11 convert this value to the absolute value of the camera to move the camera. Here, the negative value means a left coordinate or a lower coordinate based on the PAN / TILT center coordinates (0,0).

An example of syntax based on A-BNF to control the PTZ of a camera is as follows.

Here, each line is divided into CR / LF and these messages are transmitted as the content of the SIP instant message. In addition, the content-type of the SIP header is defined as "Content-Type: text / ptz".

While the invention has been described above based on the preferred embodiments thereof, these embodiments are intended to illustrate rather than limit the invention. It will be apparent to those skilled in the art that various changes, modifications, or adjustments to the above embodiments can be made without departing from the spirit of the invention. Therefore, the protection scope of the present invention should be construed to include not only the appended claims but also all of the above changes, modifications or adjustments.

As described above, the present invention includes a digital video recorder (DVR) in a central server linked to the Internet network, and stores (records) video data received in real time from a surveillance camera of each user, and then requests a user's request. By providing video data shot from surveillance cameras, users can buy digital video recorders (DVR) to build video surveillance service systems in stores, homes, businesses, etc. without incurring initial installation costs such as cable construction costs. It is effective to build video surveillance system at cost.

Companies can also build a video surveillance system using an existing network without the need for a separate cable, or can build their own security surveillance system by placing a central server in the enterprise. In this case, the existing network environment can be used as it is, and a dedicated network is not needed. A server can be centrally managed or managed by a service provider. In addition, the use of SIP and RTP has the advantage of being able to integrate with existing IP application services (IP-PBX).

On the other hand, in the camera terminal, there is an advantage to improve the responsiveness and suitable for real-time applications by applying a packet using technique using RTP instead of TCP. In addition, the general purpose joystick can be used to perform a variety of PTZ functions and has the advantage of easy scalability.

Claims (10)

An apparatus for controlling a camera using a universal interface in a real-time internet protocol based surveillance system, Control signal determination means for receiving the PTZ control signal of the camera generated from the client and interpreting the same, to determine the type of the signal; Control signal acquiring means for acquiring a control code of the corresponding camera according to the control signal; And Apparatus for controlling a camera using a universal interface in a real-time Internet protocol-based monitoring system comprising a PTZ control means for controlling the PTZ of the camera by transmitting the obtained control signal to the camera. The method of claim 1, wherein the determining means, An IP stack unit for processing an Internet protocol, Device for controlling a camera using a universal interface in a real-time Internet protocol-based monitoring system comprising a SIP / SDP unit for processing the SIP / SDP protocol to interpret the received signal. The method of claim 1, wherein the control signal obtaining means Apparatus for controlling a camera using a universal interface in a real-time Internet protocol-based surveillance system, characterized in that to obtain a control code of the camera from any server in which each camera control code is different for each camera manufacturer. The apparatus of claim 1, wherein the control signal is received through a SIP-based instant message. The method according to any one of claims 1 to 4, wherein the control signal, A control device of a camera using a universal interface in a real-time Internet protocol based surveillance system, characterized in that the A-BNF-based syntax for PTZ control of the camera. A camera control method using a universal interface in a real-time internet protocol based surveillance system, Receiving the PTZ control signal of the camera generated from the client and analyzing the same to determine the type of the signal; Acquiring a control code of a corresponding camera according to the control signal; And And controlling the PTZ of the camera by transmitting the obtained control signal to a corresponding camera. The method of claim 1, wherein the acquiring the corresponding control code comprises: A method of controlling a camera using a universal interface in a real-time internet protocol based surveillance system, wherein the camera obtains a control code of a corresponding camera from an arbitrary server in which camera control codes are different for each camera manufacturer. A camera control method using a universal interface in a real-time internet protocol based surveillance system, Connecting the client terminal to the recording server through the SIP server; Transmitting, by the client terminal, a control signal in the form of an instant message to the camera terminal through a session connection established between the SIP server and the recording server when a user interface manipulation occurs; And Control method of a camera using a universal interface in the real-time Internet Protocol-based surveillance system comprising the step of controlling the PTZ of the camera according to the control signal. The method of claim 8, wherein the recording server, A method of controlling a camera using a universal interface in a real-time Internet protocol based surveillance system, wherein each camera manufacturer stores and manages different camera control codes. The method of claim 9, wherein the camera terminal, The method of controlling a camera using a universal interface in a real-time Internet protocol based surveillance system, characterized by acquiring each camera control code stored in the recording server to control the PTZ of the corresponding camera.

Images