KR20070037752A - Data communication protocol of multi-guardian service system - Google Patents

Abstract

The present invention relates to a video control service system. In particular, the transmission and reception data is divided into common headers and message data for each signal type, and each message data is managed in a sub-command system, thereby minimizing redundancy and maximizing flexibility. The present invention relates to a data communication protocol of a video control service system. The protocol includes a plurality of video combiners for generating control signals and video signals from outside, and a video control server for collecting and managing information from a plurality of video combiners and generating a remote control signal to control the video combiner. A data communication protocol of a service system, said control signal and remote control signal comprising: a common header portion; And a separate message unit for each instruction, wherein the common header unit includes at least a protocol type for distinguishing between the control signal and the remote control signal type; A device identifier for identifying the image combiner; And protocol length information including the length of the message unit, wherein the message unit includes message type information for determining a message structure.

MGS, Video Control Service, Control Sensor, Camera, Control Server

Description

Data communication protocol of video control service system

1A to 1B are network configuration diagrams of a video control service system developed by the present applicant.

2A to 2D are diagrams illustrating network configurations of service models of the video control service system.

3A to 3H are diagrams for describing an interworking process of an internal device of a video control service system.

4A to 4C are communication flowcharts of a video control service system.

5A to 5E are diagrams for explaining a protocol structure and an example of a control signal of a video control service system.

6A to 6E are diagrams for explaining a protocol structure and an example of a remote control signal of an image control system.

7 is a diagram for explaining a protocol structure of a video signal of a video control service system.

<Explanation of symbols for the main parts of the drawings>

10: subscriber equipment 20: user client group

30: control server group 40: administrator client group

STB: Video Combiner PCS: Mobile Client

BWR: Web Client SSVR: Control Server

VSVR: Video Control Server CPS / WEB: Connection Server

MON / MAN: Administrator Client

The present invention relates to a video control service system. In particular, the transmission and reception data is divided into common headers and message data for each signal type, and each message data is managed in a sub-command system, thereby minimizing redundancy and maximizing flexibility. The present invention relates to a data communication protocol of a video control service system.

Conventional remote unmanned security service monitors the boundary target area by using a control sensor, and transmits the event and evidence images of each sensor to the control server refers to the monitoring and monitoring system.

The conventional remote unmanned security service is a system that simply monitors and monitors information transmitted from each sensor and camera, and does not provide a function of extracting and analyzing image information.

Accordingly, the present applicant has developed a network-based video control service system that performs a function of extracting and analyzing information based on image information and recognizing and recognizing a service object.

In such a video control service system, there is a demand for a data communication protocol capable of satisfying the following requirements for efficient data communication between devices in a plurality of subscriber network environments.

First, in terms of structure, appropriate data is expressed differently according to signal types in order to minimize redundancy. For example, essential time information in a control signal is omitted since it is unnecessary in a remote control signal, and is divided into a common header for representing common information and a separate data structure for each signal type.

Second, in terms of the functional aspects, in order to maximize the flexibility (flexiblilty) to distinguish the type of signal and the control command, it is possible to manage by classifying the sub-command system according to the type of each control command.

Third, in terms of security, the encryption protocol is actively utilized to solve the security problem of remote access by considering the authentication procedure and encryption.

An object of the present invention for providing an efficient data protocol of the video control service system developed by the present applicant described above is to transmit and receive the data transmitted and received as a common header and message data for each signal type, each message data is divided into a sub-command system By managing, it is to provide a data communication protocol of a video control service system that can minimize redundancy and maximize flexibility.

The data communication protocol of the video control service system according to the present invention for achieving the above object of the present invention collects and manages information from a plurality of video combiners and fraudulent video combiners that generate control signals and video signals from the outside. And a control server for generating a remote control signal to control the video combiner, the data communication protocol comprising: a common header unit; And a separate message unit for each instruction, wherein the common header unit includes at least a protocol type for distinguishing between the control signal and the remote control signal type; A device identifier for identifying the image combiner; And protocol length information including the length of the message unit, wherein the message unit includes message type information for determining a message structure.

In this case, the message unit preferably further includes control command information for identifying a control command for determining the detailed type of the message structure.

The control command information of the control signal may be at least one of an initialization, a failure detection, an expense, and an authentication command, and the message unit of the control signal may further include permutation information for preventing a signal from being lost. It is preferable that it is an independent numbering system of only said control signal.

Further, when the control command information of the control signal is an initialization command, the message unit further includes time information for time synchronization of the control server and the image combiner, and when the control command information is a failure detection command, The message unit further includes network configuration information for managing the dynamic IP. When the control command information is an authentication command, the message unit preferably further includes user number and authentication key information.

The control command information of the remote control signal is at least one of a control authority, a control range, a network, a control sensor, an environment monitoring sensor, and a codec command, and the message unit further includes user ID information for user identification. In addition, each field is separated by using a field separator for further extension and variability, and it is preferable to further include a control authority level according to the user ID information, user access network information, and user authentication key information.

In addition, when the control command of the remote control signal is a control range command, the message portion further includes network configuration information, the network configuration information including at least a control signal, a video signal, and path information of the remote control signal; Preferably, each route information is IP address and port information for the primary and secondary servers.

The video signal may be divided into an automatic video signal automatically transmitted through a TCP communication path and a request video signal transmitted through a UDP communication path in response to a request from the control server, and at least according to the type of a client to be connected. It is preferable to selectively use a video compression scheme including MPEG4 and MJPEG.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1A and 1B illustrate a network configuration diagram of an MGS system developed by the present applicant for better understanding of the present invention, and includes a subscriber equipment group 10, a subscriber monitoring client group 20, and a control server group ( 30) and a monitoring client group 40 for the administrator.

First, the subscriber equipment group 10 is a group of subscriber devices including various sensors and cameras, and a video combiner (STB) for generating control signals and video signals received therefrom, and provides a remote control service through a control server. Incidentally, it manages subscriber network environment.

The control server group 20 is a server group that collects and manages information received from a plurality of subscriber equipments and performs various control services according to a client's request. The control server group (SSVR), access server (CPS / WEB), It consists of a video control server (VSVR), a charging server (BIL) and a failure detection server (BCHK).

At this time, the control server (SSVR) is a control server module (SSM) for managing the control / video signal transmitted from the subscriber equipment, a remote control module (RCM) for remote control of the subscriber equipment, the authentication processing module for subscriber authentication processing ( ASM), a failure detection module for detecting equipment and network failures, and a DB module for controlling and managing control / image / processing information in DB.

In addition, the access servers (CPS / WEB) retrieves information managed in the control server DB through the client, supports the remote control of the subscriber equipment, and provides a function for performing the authentication process of the subscriber, the access server WEB is associated with web client BWR and access server CPS is associated with mobile client PCS. In particular, the access server (CPS) is composed of an IP management module that supports connection management to enable networking from the mobile client (PCS) to the corresponding control server (SSVR) and video combiner (STB), and the charging module for managing the charging target. do.

In addition, the video control server (VSVR) provides a function to support the control and processing of the video signal in order to provide a video recognition service. The processed information is managed in the DB and can be searched through the client.

The client group 20, 40 retrieves the DB information managed by the control server (SSVR), performs a function of remotely controlling the image combiner (STB) as necessary, and for subscribers according to the type of manager, subscriber, and platform. It is divided into a client 20 and an administrator client 40.

First, the web client BWR is a client 20, which is a client that retrieves the state of the video combiner STB through the access server WEB and performs a remote control service.

In addition, the mobile client (PCS) is a subscriber client 20, which is a client for retrieving the status of the image combiner (STB) using a mobile terminal such as a mobile phone or a PDA and performing a remote control service.

In addition, the manager client (MON / MAN) is a client that operates and manages the service platform and performs the control service using the generated control signals and video signals.

In FIG. 1B, the MSG system performs pipeline processing based on a DB. Thus, by unifying the interface between the processes and modules constituting the service platform to the DB (Application Programming Interface) API, it is considered to be able to quickly cope with a variety of services that occur in the future.

The above-described MGS system can provide a control service, a video service, and a remote control service through the above configuration.

First, the control service is a service that transmits the event information detected through the control sensor connected to the equipment of the subscriber target area to the control server (SSVR) and manages and analyzes it with the DB.

In addition, the video service transmits the image information of the subscriber target area to the control server (SSVR) to make a DB and manages it, and provides the service by mounting the target video control server (VSVR) according to the service purpose. If necessary, sound information may be added.

In addition, the remote control service is a service supported for controlling the control device connected to the equipment in the subscriber area through the control server, and provides basic home automation services as well as crime prevention and disaster prevention.

The MGS system is classified into HMGS (Hosting MGS), IMGS (Internet MGS), VMGS (VPN MGS), and WMGS (Windows MGS) models according to the service targets. same.

First, as shown in FIG. 2A, the HMGS model is a service model for a large ASP / ISP service provider targeting a large number of customers. The HMGS model is a service platform in which an image information transmitted through equipment installed in a subscriber area is transmitted to a service provider area. Provides services to collect, analyze and notify information through At this time, the image combiner (STB) is separated into a VPN network and operates stably, and access and control services of all subscribers are controlled through a control server (SSVR).

In addition, the IMGS model is an Internet-based service model, as shown in FIG. 2B, which provides a service platform for a customer to manage remotely installed devices through the Internet and collect, analyze, and notify image and sensor information transmitted from them. Operating service model. At this time, the ISP operator manages their network information collectively and provides a service that supports interworking or connection management with other services as necessary. A plurality of video combiners (STBs) are managed through a control server (SSVR) operated at a subscriber side, and an ISP operator supports a connection between the control server (SSVR) and a client by operating an access server.

In addition, the VMGS model, as shown in Figure 2c, by managing the customer's equipment and service platform through a secure private network (VPN), thereby ensuring a stable service operation. In addition, it is a model that provides a more secure service by controlling any action to access through the Internet using an ISP provider's access server. A plurality of video combiners (STBs) are managed through a subscriber side control server (SSVR) operated as a virtual private network, and an ISP operator supports a connection between the control server (SSVR) and a client by operating an access server.

In addition, as shown in FIG. 2D, the WMGS model is a service model that minimizes and provides a service platform and a monitoring client when a subscriber wants to operate a service using only a small number of devices. Refers to the same stand-alone service.

Table 1 shows the differences between the size of the service target and the network configuration according to each service model.

Model HMGS IMGS VMGS WMGS Service scale Large Large ~ Middle Middle ~ Small Small Business model ISP / ASP Branch Office Education Standalone Video surveillance target / Remote control request Many / Many Some / Some Few / Some Few / Few Network configuration Internet & VPN Internet / VPN VPN Internet / VPN Server network 2 Static IP / L4 Switch Public / VPN , Static IP LAN Private , Static IP LAN Private , Static IP Subscriber network VPN Private , Static IP Dynamic IP / VPN IP VPN Private , Static IP Dynamic IP / VPN IP

In addition, the hierarchical classification of the system according to each service model is shown in Table 2 below.

Model HMGS IMGS VMGS WMGS System hierarchy 3 tiers 2 tiers 2 tiers 1 tier First tier Client (Win) Client (Win) Client (Win) Client App & DB Server (Win) Second tier App Servers App & DB Server CP / WEB Server (LINUX) App & DB Server (LINUX) Third tier DB (UNIX) Access layer CP / WEB Server CP / WEB Server (ISP) CP / WEB Server (ISP)

Hereinafter, the interworking process between the components of the MGS system described above will be described.

First, referring to FIGS. 3A to 3C, the interworking process between the image combiner STB and the control server SSVR will be described.

FIG. 3A is a diagram for describing a control signal interworking process between the image combiner STB and the control server module SSM in the control server SSVR.

In FIG. 3A, the image combiner STB controls and signals various events occurring in its installation environment and transmits the signals to the control server SSVR. These control signals are classified into BOOT signals for managing the equipment configuration information, SECU signals for sensor detection events, ALIVE signals for equipment failure detection and IP management, and GRANT signals for access authentication and time and attendance management. . With respect to the control signal transmitted from the image combiner (STB), the control server (SSVR) transmits a response signal to determine whether the normal reception. These response signals are divided into syntax error / ID error / type error / data error / rejection error / normal reception according to the nature of the error.

Subsequently, FIG. 3B is a view for explaining a process of linking video signals between the image combiner STB and the control server module SSM in the control server SSVR.

In FIG. 3B, the automatic image generated from the image combiner STB is transmitted to the control server SSVR and stored in a DB or an independent file format. At this time, unlike the request video, the automatic video is transmitted through TCP communication, not UDP communication, which is easy to modularize so that the control server (SSVR) can safely receive and manage the video of the plurality of video combiners (STBs). To give.

Subsequently, FIG. 3C is a diagram for describing a process of interlocking remote control signals between the image combiner STB and the remote control and authentication module RCM / ASM in the control server SSVR.

In FIG. 3C, the remote control signal transmitted from the control server (SSVR) to the image combiner (STB) is divided into a LOG signal indicating a remote control connection, a signal for setting various control devices and control, a signal for image control, and the like. The remote control signals generated at the video control server (VSVR) and subscriber-side clients are transmitted via the control server (SSVR). In this case, when a service is performed in the Internet environment, an encryption protocol (SSL, etc.) must be applied in consideration of security of remote control.

Subsequently, FIG. 3D is a diagram for explaining a process of interworking between internal modules of the control server (SSVR).

In FIG. 3D, the interworking between the internal modules ASM, SSM, and RCM of the control server SSVR is in principle to share information through a DB. However, the process of processing the ALARM signal, especially the ALARM signal after the video signal processing among the urgent control signals, communicates through an internal socket or IPC (Inter Process Communication).

Next, FIG. 3E is a diagram for describing an interworking process between the control server SSVR, the image control server VSVR, and the access server CPS and WEB.

In FIG. 3E, the linkage between the control server (SSVR), the video control server (VSVR), and the access server (CPS, WEB) is in principle to share information through a DB. Accordingly, the authentication module ASM of the control server SSVR should perform a function of restricting or prioritizing a plurality of access requests to the image combiner STB.

Next, FIG. 3F is a diagram for explaining an interlocking process between the control server group and the DB.

In FIG. 3F, the servers (SSVR, VSVR, CPS, WEB) in the control server group 30 shown in FIG. 1A share information through a DB. That is, multiple service units generate access to a DB for each purpose. The APIs of these DBs should be considered to be easy to migrate by keeping the structure independent of the DB as much as possible.

Next, FIG. 3G is a diagram for describing an interworking process between a mobile client PCS, an access server CPS, WEB, and an image combiner STB.

In FIG. 3G, mobile clients (PCSs) have many constraints compared to clients for PCs, such as constraints on network bandwidth and platforms. Therefore, a dedicated protocol and image compression method should be used.

In other words, the access and authentication process supports the charging information header applied in the wireless network, and in the case of the remote control signal, restricts the use of only the command limited to the video and the control device among the client's control commands, and minimizes the protocol length. shall. In addition, in the case of a video signal, a wavelet-type MJPEG video, not an MPEG-4 video, is applied, and the resolution and the video compression quality are defined to have a low bit rate.

Subsequently, FIG. 3H is a diagram for describing an interworking process between an image combiner (STB) and a control server (SSVR) / image control server (VSVR) / client.

In FIG. 3H, since the video combiner STB should be able to access not only the control server SSVR and the video control server VSVR, but also various clients, access control and management thereof are required.

First, various network environments and various connection protocols should be supported. In other words, the client's access should allow access through the Internet as well as the same LAN or virtual private network environment. In addition, both mobile remote control protocols as well as basic remote control protocols must be accommodated.

In addition, the remote control range limitation and priority for each access subject should be managed. That is, as multiple clients can control the image combiner (STB) at the same time, the management of simultaneous access as well as the access allowance for them should be considered.

In addition, support for various images should be possible. That is, since video MPEG4 and MJPEG, which are mobile video, must be supported, resource management for various codecs should be considered.

In particular, the linkage process between the image combiner (STB) and the mobile client (PCS) will be described below.

First, a function required for transmitting an image to a mobile terminal such as a mobile phone and controlling a camera and a remote is as follows.

First, a communication path with a mobile client (PCS) applies TCP communication for maintaining a connection and connection for transmission of a camera / remote control signal and UDP communication for transmitting an image. At this time, the structure and size of the packet transmitted to the mobile terminal is designed to reflect the characteristics of the wireless network as much as possible.

Second, the video related software module applies the software codec to be the most universally applicable mobile video, and adopts the MJPEG method that transmits 1-2 frames per second in consideration of platform performance limitation. In addition, the resolution and quality of the screen are applied in consideration of the mobile platform.

Third, the basic function of the mobile protocol is composed of an authentication procedure, a control procedure, and a termination procedure. The authentication procedure uses an authentication ID and a password to access the image combiner (STB) in the mobile terminal, and the authentication process is performed. The control server (SSVR) performs the relay on the authentication information so that the STB can perform. The control procedure also reflects the ability to control individual cameras and remote control devices using a later defined mobile protocol architecture. The termination procedure also applies to terminating normal communication by terminating the TCP session.

When explaining the preferred embodiment of the protocol structure of the MGS according to the present invention applied to the above-described MGS system as follows.

According to each communication path of the MGS system, it can be largely divided into protocols related to control signals, remote control signals, and video signals.

First, TCP communication is performed on the control signal communication path, the control server (SSVR) is operated in the connection standby mode, the image combiner (STB) establishes a connection, and is transmitted in a short message method. In addition, a response message may be transmitted to determine whether the received message is normally received.

Subsequently, TCP communication is performed on the remote control signal communication path, the image combiner (STB) is operated in the connection standby mode, the control server (SSVR) or the client establishes the connection, and is transmitted in a short message manner. In addition, a response message may be transmitted to determine whether the received message is normally received.

In addition, on the video signal communication path, each communication path is classified according to a video and a client type. First, the mobile client transmits the MJPEG method, and the MPEG-4 video is transmitted to other clients or servers. This multi-codec / multi-protocol structure is to minimize the load of the relay server due to image conversion by transmitting a video structure suitable for the performance of the receiving client. Alternatively, in the case of an automatic video, a TCP communication method is used, and in the case of a transmission video, a UDP communication method is applied to transmit an MPEG-4 video. In case of transmission to the mobile client, the MJPEG image is transmitted by UDP communication method.

The protocol of the MGS according to the present invention is composed of a common header for expressing essential common information and message data having individual data formats different for each signal type.

First, the common header, which is a common element of the protocol of MGS, is a protocol identifier as a protocol identifier, a field for preventing an error on a communication path, a device identifier as a field for identifying a video combiner (STB) as a device identifier, and a length of an entire message. It consists of the protocol length, which is an information field.

In addition, the structure of the message data includes a message type, a control command, a time information, a sequence number, a sub-data, and a padding field. It may include. In this case, the message type field may be operated by separately distinguishing an identifier for distinguishing a service target, a processing function for each type, and a DB table. The structure of subsequent message data is distinguished from each other according to the information of this field. In addition, the control command field is an identifier code for a detailed type or control command, the time information field is time information in 14-byte text format (YYYY / MM / DD / hh / mm / ss), and the permutation information field is A code for identifying whether a message is missing or not, and the sub data field is parameter information for each message detail type. In this case, the padding field is a field filled with '0' or '1' to fit the data size.

4A to 4C show communication flowcharts according to protocols of a control signal, a remote control signal, and an image signal, respectively.

As shown in Figs. 4A and 4B, the control and remote control signals are transmitted by the TCP communication method, and the video signal shown in Fig. 4C is transmitted by the TCP or UDP method depending on the client.

As described above, the MGS protocol is composed of a control signal, a remote control signal, and a video signal protocol. Hereinafter, a detailed structure of each protocol will be described below.

First, the summary of the important field names for the following description of the protocol of the MGS according to the present invention are summarized in Table 3 below.

 Field name  Explanation  PTL  Protocol type  LEN  Total length of data  DEV  Device identifier  TYP  Message type  CMD  Control instruction  DATE  Time information  SEQ  Permutation number  DATA  General data  reserved  Reserved field

FIG. 5A is a diagram for explaining the structure of a control signal protocol. Referring to FIG. 5A, the structure includes PTL, reserved, LEN, DEV, TYP, CMD, SEQ, and DATA. In this case, the control signal protocol separately manages a permutation number (SEQ) to prevent the omission of the control signal, the SEQ number is operated in an independent numbering system according to the control type can be managed separately for each service.

These control signaling protocols can be broadly classified into BOOT, ALIVE and SECU control signal groups according to their functions.

5B is a diagram for explaining a protocol structure and an example of an initialization control signal BOOT.

In FIG. 5B, the initialization control signal BOOT is an initialization signal that is transmitted for the first time when the image combiner STB is initially operated. The initialization control signal BOOT is used to determine whether the equipment is initially installed and whether abnormal operation is performed. In addition, the signal BOOT also performs a function of synchronizing the time of the image combiner STB with time information managed by the control server SSVR. In this case, the SEQ number has an independent numbering system for managing the initialization control signal (BOOT).

5C is a diagram for explaining a protocol structure of an error detection control signal ALIVE and an example thereof.

In FIG. 5C, the failure detection control signal ALIVE is a signal periodically transmitted from the image combiner STB, and additionally, network configuration information is additionally transmitted to manage the case when using the floating IP. In this case, the SEQ number has an independent numbering system for managing the fault detection control signal (ALIVE), the IPv4 information applies a 32-bit binary representation of IP address information, and other premises information network and wide area information network ( LAN / WAN) port information (LPT, WPT) is also expressed as 16-bit binary information.

Subsequently, the security control signal SECU is a signal for converting and transmitting event information detected by various control sensors installed in the image combiner STB into a control signal, and these control signals are divided into crime prevention, disaster prevention, and environmental monitoring related information, respectively. A separate message is sent for each event. However, when event transmission occurs due to a network failure or backup signal request, a plurality of events may be continuously described and transmitted. At this time, each message according to the event is shown in Table 4 below.

ALARM EMG, EEMG / REMG Emergency, emergency detection / calling BGL, EBGL / RBGL Burglary, Intrusion Detection SEN, ESEN Sensor Trouble, Failure Signal for contact sensor GAS, EGAS / RGAS Gas, gas leak FIR, EFIR / RFIR Fire, fire WAT, EWAT / RWAT Water Flow, Inundation SMK, ESMK / RSMK Smoke HTM & LTM, EHTM / ELTM / RTMP Temperature, Up and Down Threshold HHU & LHU, EHHU / ELHU / RHUM Humidity, upper and lower limits Signal for built-in controller, RS232 or RS485 sensor Trouble PWR, EPWR / RPWR Power, power outage BAT, EBAT Low battery, discharge RST, ERST System Reset RBT, ERBT Engineer Reset, User Reset BOT, EBOT System Boot, System Boot NET, ENET / RNET Network failure RDR, ERDR / RRDR Reader, authenticator (card reader) failure DEV, EDEV / RDEV Device, peripheral device (expander) communication failure DWN, EDWN / SDWN / FDWN Download, Download Start / Success / Failure CVR, OCVR / CCVR Cover, Combiner Locking Device Bypass PAS, EPAS Bypass, Visitor Detection Access ARM, OARM / CARM Demarcation PAR, OPAR / CPAR Partial (boundary) boundary setting RAR, ORAR / CRAR Remote boundary setting MIS, EMIS Miss, unregistered user or user error MAS, OMAS / CMAS Master Mode, Enter / Exit Master Mode REM, OREM / CREM Remote Access, Remote Control Start / Stop ACC, EACC Access, user entry EGR, EEGR Egress, user exit CNE, ECNE Change network settings CSE, ECSE Change control settings CVD, ECVD Change video settings CEV, ECEV Change other preferences KEY, EKET Change of encryption key for server communication

FIG. 5D is a diagram for explaining a protocol structure and an example of a security control signal (SECU). In addition to the common header described above, time information (DATE), control event code (QUAL), extended group number (GROUP), and user / region It is divided into information (USER / ZONE).

Subsequently, the authentication control signal GRANT is a control signal operated to manage authentication information using an RF card reader, which is an authentication device installed in the image combiner STB. An authentication procedure is performed using a control server (SSVR) that shares authentication information between a plurality of image combiners (STBs).

FIG. 5E is a diagram for describing a protocol structure of an authentication control signal GRANT and an example thereof, and expresses and transmits a user number (USER) and authentication key (KEY) information as sub data, and transmits an authentication control signal GRANT. Consists of orders for procedures for registration and deletion, entry and exit of certification.

The control signals described above may be classified as shown in Table 5 below according to their types.

TYPE CMD BOOT 0x01 First transmission signal after boot ALIV 0x02 Signal for Health Check SECU 0x03 A guard signal GRAN 0x04 REGI 0x01 Certification information registration RMOV 0x02 Remove authentication information REQI 0x03 ID verification request REQO 0x04 Request for Departure Certification

In addition, the control signal can be classified as shown in Table 6 according to the response code.

CMD EACK 0xF0 Normal reception EMAL 0xF1 Rejection, control problem, Error-Code defined in Data field ESYN 0xF2 Protocol syntax error, unable to parse ESYS 0xF3 Video combiner identifier error, ID mismatch ETYP 0xF4 Message type error, unrecognized message type ECMD 0xF5 Command error, unrecognized command

6A to 6B are diagrams for explaining a protocol structure and an example of a remote control signal, and FIG. 6B shows a configuration example for starting and ending remote control, respectively.

First, the structure of the remote control signal is composed of PTL, reserved, LEN, DEV, TYP, CMD, USER ID and DATA. In this case, since the remote control signal does not require management of the permutation number (SEQ), it is omitted, and instead, the user identification information (USER ID) is operated to manage the authority level. In this case, the expression of data is defined as applying a text expression that is easily deformable in consideration of variability. In addition, the delimiter of a parameter is represented by "}".

These remote control signals are largely controlled according to their functions (LOGG), control range (CLOG), network (CNET), control sensor (CSEC), environmental monitoring (CENV) and codec (CMED), camera (CCAM) and video. It can be divided into transmission (CRTP) remote control signal group.

First, the control authority remote control signal (LOGG) is a control signal for managing the remote control authority, the control authority level is shown in Table 7 below.

MAN  Access to Video Combiner (STB) via Manager Level, Control Server (SSVR) SVR Access Video Combiner (STB) via Video Control Server (VSVR) Class, Control Server (SSVR) MON  Control agent level, allowing direct / direct access via control server (SSVR) USR  User class, control server (SSVR) case / Direct access allowed

In addition, the information for managing the remote control authority is shown in Table 8.

USER ID  User Identification Information IP ADDR  Connection network information Authentication Key / Password  Authentication Key and Password Access level  Permission level Expire Time  Effective time

6C is a diagram showing an example of a protocol configuration of a control range remote control signal (CLOG). The control signal (CLOG) retrieves connection information for remote control of the image combiner (STB), and sets the control range for the authority level. As control signals for performing the setting function, Fig. 6C shows an example of the configuration of the connection information retrieval and detailed control range setting signal. At this time, the type of access information is divided into IP, USER ID, and ACCESS LEVEL, and the control range setting indicates whether permission level is allowed for message type classification, and is expressed as ACCESS LEVEL, MESSAGE TYPE, and whether there is permission.

6D is a diagram showing an example of the protocol configuration of the network remote control signal (CNET), (1) of FIG. 6D shows a network configuration information retrieval, and (2) of FIG. 6D shows a configuration example of a network configuration change. .

The network remote control signal CNET is a control signal for retrieving and updating network configuration information set in the image combiner STB. At this time, the network configuration information is managed by dividing the main and secondary server, and largely control signal path information (IP address and TCP port), video signal path information (IP address, TCP port, automatic transmission video signal), remote control path information (TCP port) and automatic transmission cycle time of ALIVE signal.

6E is a diagram showing an example of the protocol configuration of the control sensor remote control signal (CSEC), (1) is a PSTN relationship setting search, (2) a PSTN control setting change, (3) a peripheral device related control setting (4) change of control settings related to peripheral devices, (5) search of control settings related to sensor information, (6) change of control settings related to sensor information, and (7) configuration examples related to boundary mode search and setting, respectively. It is shown.

The control sensor remote control signal CSEC is a control signal for retrieving and changing configuration information of the control sensor installed in the image combiner STB.

The PSTNSTATUS field at the time of searching and changing the PSTN relationship setting shown in (1) and (2) of FIG. 6E is in the format of 'NUM1} TELNUM} NUM2} TELNUM} PTL} XXX} PERIOD} 000}', where NUM1 is the main server. NUM2 is the divisional server, PTL is the modem protocol such as PPP / FSK, and PERIOD is the PSTN Alive communication cycle.

In addition, the DEVSTATUS field at the time of searching and changing the control settings related to the peripheral devices shown in (3) and (4) of FIG. 6E is in the format of 'EXPM} 00} CRN} 00} AUTV} O} AUTC} 00XXX}'. EXPM is the number of zone expanders, CRN is the number of card readers, AUTV is the automatic video transmission, AUTC is the automatic remote control.

In addition, the summary of the ZONESTATUS, SENSTATUS, and REMSTATUS fields at the time of searching and changing the control setting related to sensor information shown in (5) and (6) of FIG. 6E are summarized in Table 9 below.

 ZONESTATUS Format: EXPM} 00} USEZ} OOOOOOOO} TYPZ} ########} EMGZ} OOOOOOOO} DRSZ} OOOOOOOO} PARZ} OOOOOOOO} VISZ} OOOOOOOOENTENT}} 1122334455667788} EXTZ} 1122334455667788} CAMZ} 11223344556677AA} RCTL } OOOOO}-EXPM: Zone expander number-USEZ: Sensor installation zone-EMGZ: Emergency zone-DRSZ: Subscriber zone-TYPZ: Sensor type, O / C / H-PARZ: Partial (zone) boundary zone- VISZ: Visit Zone-ENTZ: Entrance Delay Zone, Sensor Delay Time, 00 ~ FF (255) Seconds-EXTZ: Exit Delay Zone, Sensor Delay Time, 00 ~ FF (255) Seconds-CAMZ: Automatic Transmission Video Camera Zone A. 11 ~ 99 Camera AA ~ ZZ. Split mode when applying channel mux-RCTL: Remote controller installation information  SENSTATUS  "OCEXOCEX", individual sensor states O: Open, C: Close, E: error, X: Disable  REMSTATUS  "OCXOC", individual control unit status O: Open, C: Close, E: error, X: Disable

In addition, the MODESTATUS field value at the time of boundary mode search and installation shown in (7) of FIG. 6E means ARM, boundary, PAR, partial (revenue) boundary, DIS, release, and MAS, respectively, master mode.

Fig. 6F shows an example of the protocol configuration of the environmental monitoring remote control signal CENV. The environmental monitoring remote control signal CENV is a control signal for retrieving and changing information of an environmental monitoring sensor installed in the image combiner STB. In this case, the GTMP and STMP commands are the temperature sensor threshold setting search and change commands, and the GHUM and SHUM commands are the humidity sensor threshold setting search and change commands.

Table 10 below shows an example of a protocol configuration of a codec remote control signal (CMED). The codec remote control signal CMED is a control signal for controlling an image codec installed in the image combiner STB.

  GMED  Retrieve codec count information  VSVR-> STB: CMED.GMED} UID] STVR-> VSVR: CMED.EACK} UID} CODECN} NUM  GCDC  Retrieve individual codec setting information VSVR-> STB: CMED.GCDC} UID] STB-> VSVR: CMED.EACK} UID} CODEC} CDCNUM} TYP} MEDIATYPE} CODECNAME} VIDEO} 4} AUDIO} 1]-CDCNUM: Codec Index Number-MEDIATYPE: MPEG , AVI, ...-CODECNAME: Codec processor name, VW2005-VIDEO: Number of channels supported, Video MUX usage information-AUDIO: Supported  GVDO / SVDO  Individual codec image QOS information search / change VSVR-> STB: CMED.GVDO} UID} CDCNUM] VSVR-> STB: CMED.SVDO} UID} CDCNUM} VIDEOSTATUS] STB-> SSVR: CMED.EACK} UID} VIDEOSTATUS] VIDEOSTATUS: TYPE} VIDEOTYPE} RESOLUTION} FRAMES } QUAILTY} BRIGHT} BITRATE}-VIDEOTYPE: MPEG4TS, MPEG4PS, H.264, ...-RESOLUTION: Screen resolution-FRAME: FPS information-QUALITY: Brightness correction-BRIGHT: Brightness correction-BITRATE: Compressed image data size  GADO / SADO  Search / change codec acoustic QOS information VSVR-> STB: CMED.GVDO} UID} CDCNUM] VSVR-> STB: CMED.SVDO} UID} CDCNUM} VIDEOSTATUS] STB-> SVR: CMED.EACK} UID} VIDEOSTATUS] VIDEOSTATUS: TYPE} VIDEOTYPE} RESOLUTION} FRAMES } QUAILTY} BRIGHT} BITRATE}-VIDEOTYPE: MPEG4TS, MPEG4PS, H.264,-RESOLUTION: Screen Resolution-FRAMES: FPS Information-QUALITY: Video Quality Information-BRIGHT: Brightness Correction-BITRATE: Compressed Video Data Size

Table 11 below shows an example of the protocol configuration of the camera remote control signal (CCAM).

 GCAM / SCAM  Search / change installation camera information VSVR-> STB: CCAM.GCAM} UID] VSVR-> STB: CCAM.SCAM} UID} CAMSTATUS] STB-> VSVR: CCAM.EACK} UID} CAMSTATUS] CAMSTATUS: CAMN} NUM} USEC} OOOOOOOOOOOOOOOOOO PCTL} OOOOOOOOOOOOOOOO } TCTL} OOOOOOOOOOOOOOOOOO} ZCTL} OOOOOOOOOOOOOOOOOO-NUM: Number of supported cameras-USEC: Installed camera location-PCTL / TCTL / ZCTL: PTZ camera location GPTZ / SPTZ  PTZ Manual Control Search / Change VSVR-> STB: CCAM.GPTZ} UID} CAMNUM] VSVR-> STB: CCAM.SPTZ} UID} CAMNUM} PTZSTATUS] STB-> VSVR: CCAM.EACK} UID} CAMNUM} PTZSTATUS]-CAMNUM: Camera Index Number- PTZSTATUS: FOCUS} FVALUE} PAN} PVALUE} TILT} TVALUE} ZOOM} ZVALUE}-FVALUE: F (ar) / N (ear) / A (uto)} 000}-PVALUE: L (eft) / R (ight) } 000}-TVALUE: U (p) / D (own)} 000}-ZVALUE: I (n) / O (out)} 000} CPRE  Initialize PTZ auto control setting VSVR-> STB: CCAM.CPRE} UID} CAMNUM] STB-> VSVR: CCAM.EACK} UID} CAMNUM] GPRE / SPRE / RPRE  Search / change / execute PTZ auto control setting VSVR-> STB: CCAM.GPRE} UID} CAMNUM} PRENUM] VSVR-> STB: CCAM.SPRE} UID} CAMNUM} PRENUM] VSVR-> STB: CCAM.RPRE} UID} CAMNUM} PRENUM] STB-> VSVR: CCAM.EACK} UID} CAMNUM} PRENUM} PTZSTATUS]-PRENUM: Preset index number RPAN  PTZ Auto Pan Run VSVR-> STB: CCAM.RPAN} UID} CAMNUM} O / C] STB-> VSVR: CCAM.EACK} UID] RIRS  PTZ Auto Zoom / IRIS VSVR-> STB: CCAM.RIRS} UID} CAMNUM} O / C] STB-> VSVR: CCAM.EACK} UID]

The camera remote control signal CCAM described above is a control signal for retrieving and changing information of a camera installed in the image combiner STB.

Table 12 below shows an example of the protocol configuration of the image transmission remote control signal (CRTP).

SETP Video signal communication path setup (SETUP) VSVR-> STB: CRTP.SETP} UID} CAMNUM} DIP} DPORT] STB-> VSVR: CRTP.EACK} UID} SESSION} DIP} DPORT} SIP} SPORT]-CAMNUM: Resource Identifier (Like URI)-Destination IP / Port, Source IP / Port-Default if omitted-Session: Identifier for De-multiplexing Stream PLAY Video signal transmission (PLAY) VSVR-> STB: CRTP.PLAY} UID} SESSION] STB-> VSVR: CRTP.EACK} UID} SESSION] PAUS Video signal stop (PAUSE) VSVR-> STB: CRTP.PAUS} UID} SESSION] STB-> VSVR: CRTP.EACK} UID} SESSION] STOP Video signal end (STOP) VSVR-> STB: CRTP.STOP} UID} SESSION] STB-> VSVR: CRTP.EACK} UID} SESSION GSSR Get SSRC Request SSRC identifier information of stream transmitted to RTP VSVR-> STB: CRTP.GSSR} UID} SESSION] STB-> VSVR: CRTP.EACK} UID} SESSION} SSRC]-SSRC, Source ID. Camera FIFR  full INTRA-frame request Independent compressed video request (same as MJPEG method), transmission without INTER-frame VSVR-> STB: CRTP.FIFR} UID} SESSION] STB-> VSVR: CRTP.EACK} UID} SESSION] NACK Negative acknowledgment VSVR-> STB: CRTP.NACK} UID} SESSION} SSRC} FSN} LPN] STB-> VSVR: CRTP.EACK} UID} SESSION]-SSRC, Source ID. Camera-FSN, First Sequence Number-LPN, Lost Packets Number

Table 13 below is a code table of the above-described remote control signal.

TYPE CMD LOGG 0x08 IN 0x01 Remote control start signal OUT 0x02 Remote control end signal CLOG 0x09 ON 0x01 Authentication process setting signal OFF 0x02 Authentication process release signal ADD 0x03 Authentication information addition signal UPDT 0x04 Authentication information change signal GETS 0x05 Connection Information Search Signal SGRN 0x06 Detailed control range setting signal GGRN 0x07 Detailed control range search signal CNET 0x0A GETS 0x01 Network setting information search signal UPDT 0x02 Network setting information change signal GTEL 0x03 PSTN related control setting search signal STEL 0x04 PSTN related control setting change signal GDEV 0x05 Peripheral Device Control Search Signal TYPE CMD CNET 0x0A SDEV 0x06 Peripheral device related control setting change signal GSEN 0x07 Sensor (zone) setting search signal SSEN 0x08 Sensor (zone) setting change signal GZON 0x09 Sensor (Zone) Status Check Signal SREM 0x0A Remote control signal GMOD 0x0B Alert Mode Search Signal SMOD 0x0C Caution mode setting signal CENV 0x0B GTMP 0x01 Temperature sensor threshold setting search signal STMP 0x02 Temperature sensor threshold setting change signal GHUM 0x03 Humidity Sensor Threshold Setting Search Signal SHUM 0x04 Humidity sensor threshold setting change signal CMED 0x10 GMED 0x01 Installation codec count information retrieval signal GCDC 0x02 Individual codec setting information search signal GVDO 0x03 Individual Codec Video QOS Information Search Signal SVDO 0x04 Individual codec video QOS information change signal GADO 0x05 Individual Codec Acoustic QOS Information Search Signal SADO 0x06 Individual codec acoustic QOS information change signal CCAM 0x11 GCAM 0x01 Setup camera information search signal SCAM 0x02 Install camera information change signal GPTZ 0x03 PTZ manual control search signal SPTZ 0x04 PTZ manual control change signal CPRE 0x05 PTZ auto control setting initialization signal GPRE 0x06 PTZ auto control setting search signal SPRE 0x07 PTZ auto control setting change signal RPRE 0x08 PTZ auto control setting execution signal RPAN 0x09 PTZ Auto Pan execution signal RIRS 0x0A PTZ Auto Zoom / IRIS execution signal

7 is a view for explaining the structure of the video signal protocol, the structure of the V, P, X, CC, M, PT, SEQ, TIMESTAMP, SSRC ID, stream and the like. In this case, the meaning of each field is shown in Table 14 below.

V  Version P  For future reservations X  Header extension CC  CSRC count (= 0) M  Profile, frame boundary (= 0) PT  Payload type SEQ  Permutation number SSRC  Source ID, camera information, etc.

In this case, the video signal transmitted from the image combiner STB is divided into an automatic video signal and a request video signal as described above. The automatic video signal is video information transmitted along with a control event, which is an evidence video stored in a DB, and the requested video signal is used as a video for performing a real time video or a recognition service of a video control server (VSVR). In addition, a video compression scheme is transmitted according to the type of client. In the case of a mobile client (PCS), an MJPEG image is used, and other clients use an MPEG4 image. Therefore, the image combiner (STB) selectively uses a separate codec and TCP / UDP communication according to the image transmission format and the type of the receiving client, and the control server (SSVR) decides whether to directly transmit the image of the DB or convert the image. The service is performed by distinguishing whether to perform.

MGS system as described above should be encrypted for the transmitted data as well as the authentication management for the access / control authority as the main privacy information of the subscriber can be transmitted and received based on the network. Therefore, encryption technology such as SSL (Secure Socket Layer) or TLS (Transport Layer Security) applicable to various platforms is applied.

Although the technical spirit of the present invention has been described in detail according to the above-described preferred embodiment, it should be noted that the above-described embodiment is for the purpose of description and not of limitation. In addition, those skilled in the art will understand that various embodiments are possible within the scope of the technical idea of the present invention.

As described above, the data communication protocol of the video control service system according to the present invention divides the transmission / reception data into a common header and message data for each signal type, and manages each message data in a sub-command system.

Accordingly, the amount of data can be minimized by minimizing unnecessary redundancy, and the protocol structure can be maximized for flexibility, thereby facilitating the management of subsequent expansion or modification.

Claims (12)

A plurality of video combiners for generating control signals and video signals from the outside and fraudulent information control system comprising a control server for collecting and managing information from a plurality of video combiners and generating a remote control signal to control the video combiner In the data communication protocol, The control signal and the remote control signal includes a common header portion and a separate message portion for each instruction, The common header unit may include at least a protocol type for distinguishing between the control signal and the remote control signal type; A device identifier for identifying the image combiner; And protocol length information including a length of the message unit. The message unit includes a message type information for determining a message structure, the data communication protocol of the video control service system. The method of claim 1, And the message unit further includes control command information for identifying a control command for determining a detailed type of a message structure. The method of claim 2, And the control command information of the control signal is at least one of an initialization, a failure detection, an expense, and an authentication command. The method of claim 3, The message unit of the control signal further comprises permutation information for preventing the signal missing, the data communication protocol of the video control service system. The method of claim 4, wherein And said permutation information is an independent numbering system of said control signal only. The method of claim 3, If the control command information is an initialization command, the message unit further includes time information for time synchronization of the control server and the video combiner, If the control command information is a failure detection command, the message unit further includes network configuration information to manage the floating IP, And if the control command information is an authentication command, the message unit further comprises a user number and authentication key information. The method of claim 2, And the control command information of the remote control signal is at least one of a control authority, a control range, a network, a control sensor, an environment monitoring sensor, and a codec command. The method of claim 7, wherein The message unit of the remote control signal further comprises user ID information for user identification, data communication protocol of the video control service system. The method of claim 7, wherein And the message unit of the remote control signal divides each field using a field separator for further expansion and variability. The method of claim 8, The message unit of the remote control signal further comprises a control authority level according to the user ID information, the user's access network information and the user's authentication key information, the data communication protocol of the video control service system. The method of claim 7, wherein If the control command is a control range command, the message section further includes network configuration information, the network configuration information including at least control information, video signals, and path information of a remote control signal, each path information being a main and A data communication protocol of a video control service system, which is IP address and port information for a secondary server. The method of claim 1, The video signal is classified into an automatic video signal automatically transmitted through a TCP communication path and a request video signal transmitted through a UDP communication path in response to a request from the control server.

Images