KR100932157B1 - Large surveillance system based on IP monitoring - Google Patents

Abstract

A large control system based on IP (Internet Protocol) monitoring according to the present invention is disclosed. An IP surveillance-based large control system according to the present invention uses a network processing unit that receives different types of video stream sources using IO Completion Port (IOCP), and converts the received video stream sources into preset standard video stream sources. A streamHAL unit for transforming and mediating streaming, a storage unit for storing the modified video stream source using file bank technology, and a search unit for retrieving the stored video stream source according to at least one predetermined information. Include. Through this, the present invention is easy to integrate and expand the system, it is possible not only to manage the system stably, but also to make individual development.

Description

Central management system based on IP surveillance

The present invention relates to a large-scale control system, and in particular, by configuring an image processing unit capable of integrating various image stream sources, it is easy to integrate and expand the system, and various image providing methods and image compression techniques employed in the image processing unit. By modularizing the network management method and video storage technology, the system can not only stably manage the system but also apply the flash UI (User Interface) to the GUI to configure and operate independently of each module of the image processing unit. Therefore, the present invention relates to a large-scale control system based on IP monitoring that allows individual development to be performed.

Due to the development of the current network environment and the enlargement of the control or surveillance system, for example, existing analog video surveillance system has to use a large number of devices for a large number of image processing, and a video storage method for storing / retrieving images. Has developed into a digital video recorder (DVR) method that can store video data digitally in a VCR (Video Casette Recoder) method and manage and transmit it as needed.

This DVR system converts analog signals, which are image data input to the camera, into digital signals, and compresses and restores images using MPEG (Moving Picture Experts Group), the international compression standard. The system method. DVR uses hard disk (HDD) or digital video disk (DVD) instead of video tape, so it is not only easy to play or search the saved screen but also stored as digital signal. have.

However, in order to build an analog video surveillance system, there are many costs incurred due to expensive DVR and camera equipment, and it is difficult to provide remote surveillance and web services to a large number of users. In addition, there is a limit to the DVR's own storage capacity for large-capacity video storage.There is a separate search software for storing and searching hundreds of terabytes of video using large-capacity storage. It became necessary.

As a result, the control or surveillance system is being transformed into an IP (Internet Protocol) Surveillance-based control system that is easy to provide a large number of image processing / retrieval and services to an unspecified number of users at low cost.

An object of the present invention is to solve the above problems of the prior art, by configuring an image processing unit that can integrate various video stream sources, IP surveillance-based large control to facilitate the integration and expansion of the system To provide a system.

Another object of the present invention is to provide a large-scale IP surveillance-based large-capacity IP management to ensure stable management of the system by interlocking each of the various video providing method, image compression technology, network management method and video storage technology employed in the image processing unit To provide a control system.

It is still another object of the present invention to provide a large-scale monitoring system based on IP surveillance, which allows individual development to be performed since the flash UI (User Interface) is applied to the GUI and configured and operated independently of each module of the image processing unit. have.

In order to achieve the above object, an IP surveillance-based large control system according to an aspect of the present invention is a network processing unit for receiving different types of video stream sources using IOCP (IO Completion Port), the received video The StreamHAL unit transforms a stream source into a preset standard video stream source and performs a role for mediating streaming, a storage unit for storing the modified video stream source using a file bank technology, and the stored video stream source. And a search unit for searching according to at least one piece of information.

In addition, an IP surveillance-based large control system according to the present invention provides a user with information for controlling the video stream source and various functions, and uses a flash to implement image processing in a vector display manner. The apparatus may further include a graphical user interface (GUI) unit for applying a used user interface (UI).

When the UI message is generated by the user command, the GUI unit, a message distributer unit for checking the type of the UI message, intelligent queue unit for delivering the UI message, worker pool manager unit for receiving the UI message, the UI message It may be composed of a UI worker unit for processing and a message poster unit for sending a predetermined message required to reprocess the UI message.

The network processor is configured to interlock a handle of the video stream source received from the network with an IOCP port, an IOCP queue for storing the received video stream source, and an IOCP queue for detecting the IOCP queue and dedicated to processing the video stream source. It may include a calling thread for calling a working thread unit and a callback function associated with a handle for processing the video stream source.

The StreamHAL unit transfers the stream engine for transforming the received video stream source into the standard video stream source and information of the standard video stream source to the storage unit or at least one output unit, and a buffer for mediating streaming. It may include a HAL wrapper that serves as).

In this case, the standard video stream source is divided into a header part and a data part so that the header part is not used, a channel field indicating an ID for distinguishing a stream source, a format field indicating a stream structure, and a time at which the stream is received. A stream time field indicating a size, a header size field indicating a size of a header portion, a body size field indicating a size of a stream body, and a body pointer field indicating a storage location of a stream body may be included. The format field may include a source type field indicating a stream source type, a data type field indicating a data type, an unused field that is not used, and a data format field indicating a configuration of data.

In order to store the video stream source, the storage unit divides a pre-allocated space of the storage unit into at least one file bank and uses the file bank manager and information of the video stream source stored in the file bank. It may include a meta file unit for storing as.

In addition, the IP surveillance-based large control system according to the present invention may further include an E-map unit for the user to easily check the location image of the place where the user wants to monitor the IP (Internet Protocol). In addition, the apparatus may further include an output unit configured to output the stored or retrieved image stream source, and the output unit may output the image stream source using a memory inside the graphic card or the video card.

Other objects and features of the present invention in addition to the above object will be apparent from the description of the embodiments with reference to the accompanying drawings.

Through this, the present invention has an effect that the integration and expansion of the system can be easily by configuring an image processing unit that can integrate the various image stream sources.

The present invention has the effect of stably managing the system by modularizing the various image providing method, image compression technology, network management method, and image storage technology employed in the image processing unit, respectively.

In addition, since the present invention is configured and operated independently of each module of the image processing unit by applying a flash UI (User Interface) to the GUI, there is an effect that can be individually developed.

Hereinafter, a large control system based on Internet Protocol (IP) Surveillance according to an embodiment of the present invention will be described in detail with reference to FIGS. 1 to 10.

The present invention proposes an IP surveillance-based large control system capable of integrating various video stream sources. That is, the present invention is capable of special video compression technology, efficient network management method, flexible response to various video providing methods, storage / retrieval of mass storage using special video storage technology, and remote monitoring / control using network. Surveillance can be easily done. The present invention supports a professional security graphical user interface (GUI) function, and various image source processing devices such as PC-DVR, standalone DVR, video server, and IP camera can be integrated into one central control solution to display images. In addition, the integrated decoder can reliably decode the CPU (Central Processing Unit) load rate by connecting and interworking with various image source processing devices.

In addition, the present invention is easy to control by supporting the electronic map function, maximize the stability and efficiency of image storage / retrieval by efficient file and HDD (Hard Disk Drive) management, motion detection and sensor detection through the event alarm function It can support interworking with information, and support various PTZ control protocols, and can support multiple display or multiple monitor functions to smoothly configure the status panel and administrator terminal in one system.

1 is an exemplary view showing a large monitoring system based on IP monitoring according to an embodiment of the present invention.

As shown in FIG. 1, the IP surveillance-based large control system according to the present invention can be largely divided into an input unit, an image processing unit, an output unit, and the like. In particular, the image processing unit includes a local processing unit, a PTZ unit, an E-map unit, It may include a network processor, a streamHAL unit, a live play unit, a storage unit, a decoder unit, a search unit, a display processor, an audio processor, and the like.

First, the input unit refers to a camera for capturing a video within a predetermined management area. The input unit may be a concept encompassing not only a general camera but an IP-based IP camera.

The image processor is a device for integrating various image source processing apparatuses such as PC-DVR, standalone DVR, video server, and IP camera.

The network process unit may perform network reception processing of an image stream source from an input unit, and this network reception processing process may be efficiently improved by using an IO completion port (IOCP).

StreamHAL transforms various network streams input from PC-DVR, Standalone DVR, video server, and IP-camera into standardized video stream source and buffers to mediate streaming. Can serve as

E-map unit makes it easy to check the image of the location where you want to monitor, and when an event such as motion occurrence or sensor detection occurs, it is displayed on E-map or electronic map and any event occurs at any location. It is possible to inform the supervisor quickly by transmitting a notice.

The storage unit enables the use of an efficient hard disk (HDD), called a filebank, to stabilize and fragment the hard disk and improve its speed. The search unit may support an efficient search function based on information such as an event, a time, and a place of the recorded and stored file.

The display process unit may improve an image display function by using a main memory unit and a memory unit of a graphics card. A decoder unit optimized for such image processing may also be required.

In addition, the output unit may include a display unit for displaying an image and a GUI unit, wherein the GUI unit is a network or local based surveillance image portion and command control between a user and a central management system (CMS). You can configure a screen that delivers information such as (command control), event processing, recorded video playback, and storage device control. Hereinafter, a large monitoring system based on IP monitoring according to an embodiment of the present invention configured as described above will be described in detail.

The GUI part shows the information from the large control system to the user. It should be able to display very detailed screens, and the development time is also a lot of development time because the application developer and the UI developer have to collaborate. The GUI unit according to the present invention may be implemented as a vector display method instead of the existing bitmap display method, and for this purpose, a flash may be adopted.

The reason for this is as follows. A bitmap of a conventional bitmap display method is defined as a space and a color for displaying each pixel and represented as a small square of pixels. If you zoom in on it, each pixel will be larger and stand out in our eyes, making the image unnatural. As a result, when the bitmap expresses an image, a screen degradation phenomenon occurs in which the sharpness is changed according to the resolution of the monitor.

However, instead of bitmap RGB (Red, Green, Blue), vector display method uses the position, curve, Colors, thicknesses, proportions, etc. are made using mathematical expressions to make digital images. As a result, when the series of images according to the resolution of the monitor is scaled up and down, the overall proportion is re-adjusted, so there is no problem in the representation of the image, thereby greatly improving the screen degradation phenomenon.

In addition, by adopting a UI using a flash to separate the application unit and the UI, there is a great advantage in the development period and reuse of the UI. That is, in the conventional UI development, since the application unit and the UI unit are not completely developed, the UI should be newly configured even when developing programs of the same field. However, since the UI can be used for other programs due to the separation of development, modules necessary for program development in the same field can be reused. In addition, developers can focus on application development and designers can focus on UI development. As a result, by separating the UI unit from the application unit, the advantages of shortening the development period, ease of development, and increasing the reusability of the UI may appear.

2 is an exemplary view for explaining the operation principle of the flash UI according to the present invention.

As shown in FIG. 2, when a UI message is generated by a user's command, the UI Message Distributer unit asks the Message Maker unit for a UI message, and the Message Maker unit sends information about the message. In addition to the UI message, it is passed back to the Message Distributer.

When the UI message is delivered to the Intellegent Queue section according to this information, the UI message is delivered to the Worker Pool Manager section, which is delivered to the UI Worker section, which can be executed, so that the UI Worker section processes or reprocesses it using the UI Engine section. The message can be sent to the Message Poster section or communicated with the application.

If the UI itself needs to be changed, the UI can be changed using the App Notifier part, and the changed UI can be exchanged with the application through the Panel Updater part again.

3 is an exemplary diagram illustrating a network reception process using an IOCP technology according to an embodiment of the present invention.

As shown in FIG. 3, the present invention proposes an efficient improvement method of a network reception process using an IOCP technology. The IOCP technology can generate two threads to improve an existing excessive thread generation problem. have. Here, the IOCP technology may refer to a technology that processes a work using a handle in which an input / output operation frequently occurs and binds it to one port.

In this regard, the network reception process of the conventional IP monitoring-based large control system is a separate working thread for each network source inputted by the application always checking data coming from the network. Generated. As a result, an average of two threads are created per channel, and in the case of 128 Channel, 256 threads are created. Thus, the creation of such excessive threads can cause performance degradation of large control systems.

4 is an exemplary view for explaining the concept of the IOCP technology according to an embodiment of the present invention.

As shown in FIG. 4, a handle such as a file, a socket, and the like corresponding to a video stream source received from a network through an interlocking unit is interlocked with an IOCP port, and an IOCP dedicated working thread unit is always present. Detect IOCP queue and process network source by calling callback function associated with handle requesting this operation through caller when operation (Receive / Send, Read / Write) is completed. By using only two threads, assuming that the number of threads required is one CPU, the required threads can be greatly reduced.

IOCP's technology improves the use of threads, reduces CPU consumption, improves the reliability of large control systems, and improves the handling of network sources.

Various types of network streams coming from PC-DVR, Standalone DVR, video server, and IP-camera can only be added to the existing cameras according to the prior art. Since the camera transmits a different type of compressed video stream, applications that receive the network video stream have had to make internal modifications. Thus, an improved technique called StreamHAL can be applied.

5 is an exemplary view showing a basic structure of a StreamHAL unit according to an embodiment of the present invention.

As shown in FIG. 5, various types of video stream sources coming from the network are transformed into standardized video stream sources through respective stream engines, and standardized video streams through the HAL Wrapper of StreamHAL. The information may be transmitted to a storage unit or an output unit such as a display unit, and also serve as a buffer for mediating streaming.

As a result, StreamHAL can receive a stream standardized by the HAL wrapper at an end point that processes this video regardless of any stream source.

Even when a new kind of video stream source comes in, the developer does not only modify the entire application by modifying each stream engine and HAL wrapper but also partially corrects the application to reduce errors in system development, shorten the development time, and create new video. It can also be easily changed and added to the stream module.

The HAL wrapper abstracts the changed source by abstracting it into a standardized video stream. The standardized video stream source is divided into a header part and a data part.

The header part having the standardized video stream source information may be configured as shown in Table 1 below.

That is, the header part of the video stream is a reserved field that is not used, a channel field indicating an ID for distinguishing a stream source, a format field indicating a stream configuration, a stream time field indicating a time when the stream is received, and a header indicating a size of the header part. The size field, a body size field indicating the size of the stream body, and a body pointer indicating the storage location of the stream body may be included.

The format part of the header part of the standardized video stream source may be configured as shown in Table 2 below.

That is, the format unit or format field may include a source type field indicating a stream source type, a data type field indicating a data type, an unused unused field, a data format field indicating a configuration of data, and the like.

In this way, the StreamHAL unit may change the general stream source into the header unit and the data unit of the standard video stream source in each stream engine, thereby having a great advantage as an architecture for easily expanding the camera and the module. In addition, the StreamHAL unit may serve as a place for temporarily storing a standardized video stream source.

6 is an exemplary view showing an internal structure of a StreamHAL unit according to an embodiment of the present invention.

As shown in FIG. 6, the StreamHAL unit according to the present invention has a predetermined area of pre-allocated memory as a data unit, which will be referred to as a memory pool. In addition, to facilitate the management of the memory pool may have a control unit in a list structure.

The standardized video stream source may be temporarily stored in a memory poll under the list management of the controller, and serve as a temporary storage for storing data until output.

7 is an exemplary diagram illustrating a data flow of a StreamHAL unit according to an embodiment of the present invention.

As shown in FIG. 7, the video stream source standardized in the StreamHAL unit according to the present invention may be processed by being divided into a storage unit or a display unit.

8 is an exemplary view showing a detailed structure of a storage unit according to an embodiment of the present invention.

As illustrated in FIG. 8, when recording and storing an image, the storage unit may request a storage space from a unit called a filebank manager. Thus, the video can be recorded using the space provided by the file bank manager, that is, the file bank, and the information of the file can be stored by setting a meta file unit separately.

The file bank technology has an advantage of enabling efficient hard disk (HDD) use and improving stabilization, fragmentation and speed of the hard disk.

In addition, in order to enable efficient and fast retrieval, the storage unit separately stores a portion of the file information such as play time, event, etc. when storing the recorded video as a meta file unit. It is possible to search the meta file part only, instead of searching for, thereby enabling a quick data search.

9 is an exemplary view for explaining the operation principle of the file bank according to an embodiment of the present invention.

As shown in FIG. 9, a predetermined portion of the initialized hard disk may be generated as a file bank in advance. The application unit may request a storage from the filebank to receive a portion of the preallocated space in the filebank, and store the same using the space.

If the file bank has already provided the space of the file bank, the file bank may request the return of the storage from the application unit, and may provide only the space of the hard disk by providing the space to the application unit when the storage is requested.

As a result, since only a part of the hard disk is used regularly, the fragmentation phenomenon of the hard disk is eliminated, and the stability of the overall video control system is increased by the stability of the hard disk.

In addition, since only the contiguous space of the hard disk is used, improved performance of playback and searching can be enabled.

10 is an exemplary diagram illustrating memory usage of a video card according to an embodiment of the present invention.

As shown in FIG. 10, the display unit according to the present invention may display an image using a main memory unit and a memory of a video card or a graphics card.

For this reason, the main memory or surface for conventional image processing is a surface or a system surface that can be basically created using direct-draw, and all DC outputs to the screen by default. Share the area with, for example, Device Context: a structure that gathers all the options for graphics. As a result, collisions can occur because large control systems using system surfaces use a common space.

Therefore, by using the memory (memory) existing in the video card to create a overlay (surface) of the surface that can be output separately on the screen that is basically output on the screen and the image can be displayed on the flash using the overlay. That is, when using the overlay, since the default output space is different, it may not collide with each other.

In addition, since the image processing unit uses the system surface and the output unit uses the overlay, the image processing unit uses the main memory, thereby enabling fast information exchange with the CPU, thereby enabling fast image processing and improving performance of large control systems. In addition, since the output unit uses the memory inside the video card, it is possible to contribute to the stable performance of the display unit by enabling stable and fast output.

In addition, the existing display unit can process only the network stream transmitted from the IP-camera, but the improved display unit may consider the display of the network stream and the local raw stream transmitted from the PC-DVR or Standalone DVR. have.

This will be described in detail as follows. That is, since the local low stream transmitted from the PC-DVR or the standalone DVR is transmitted with the decoded video stream instead of the encoded video stream, the video stream can be immediately displayed on the screen and thus the standard video stream There is no need to standardize, so data can be sent directly to the display without the need to use StreamHAL.

In addition, since the display unit receives the decoded video stream, the display unit can directly output the screen without using the decoder unit. As a result, the IP surveillance-based large control system can easily expand the existing PC-DVR or Standalone DVR as well as the network stream and can build a large control system with improved performance when monitoring in real time.

The IP monitoring-based large control system according to the present invention can be modified and applied in various forms within the scope of the technical idea of the present invention and is not limited to the above embodiments. In addition, the embodiments and drawings are merely for the purpose of describing the contents of the invention in detail, not intended to limit the scope of the technical idea of the invention, the present invention described above is common knowledge in the technical field to which the present invention belongs As those skilled in the art can have various substitutions, modifications, and changes without departing from the technical spirit of the present invention, it is not limited to the above embodiments and the accompanying drawings, of course, and not only the claims to be described below but also claims Judgment should be made including scope and equivalence.

1 is an exemplary view showing a large monitoring system based on IP monitoring according to an embodiment of the present invention.

2 is an exemplary view for explaining the operation principle of the flash UI according to the present invention.

3 is an exemplary diagram illustrating a network reception process using an IOCP technology according to an embodiment of the present invention.

4 is an exemplary view for explaining the concept of the IOCP technology according to an embodiment of the present invention.

5 is an exemplary view showing a basic structure of a StreamHAL unit according to an embodiment of the present invention.

6 is an exemplary view showing an internal structure of a StreamHAL unit according to an embodiment of the present invention.

7 is an exemplary diagram illustrating a data flow of a StreamHAL unit according to an embodiment of the present invention.

8 is an exemplary view showing a detailed structure of a storage unit according to an embodiment of the present invention.

9 is an exemplary view for explaining the operation principle of the file bank according to an embodiment of the present invention.

10 is an exemplary diagram illustrating memory usage of a video card according to an embodiment of the present invention.

Claims (10)

A network processor configured to receive various types of video stream sources using different IO Completion Ports (IOCPs); A StreamHAL unit which transforms the received video stream source into a preset standard video stream source and mediates streaming; A storage unit for storing the modified image stream source using a file bank technology; And A search unit for searching the stored video stream source according to at least one preset information; Large monitoring system based on IP surveillance, comprising a. According to claim 1, Graphic User Interface (GUI) that provides a user with information for controlling the video stream source and various functions, and applies a user interface (UI) using flash to implement image processing in a vector display method. Large monitoring system based on IP surveillance, characterized in that it further comprises a). The method of claim 2, The GUI unit, A message distributer unit for checking a type of the UI message when a UI message is generated by a user command; An intelligent queue unit for delivering the UI message; A worker pool manager unit receiving the UI message; A UI worker unit for processing the UI message; And IP surveillance-based large control system comprising a message poster for sending a predetermined message required to reprocess the UI message. According to claim 1, The network processing unit, An interworking unit interlocking a handle of the video stream source received from a network with an IOCP port; An IOCP queue for storing the received video stream source; An IOCP dedicated working thread unit for detecting the IOCP queue and processing the video stream source; And And a caller for calling a callback function associated with a handle for processing the video stream source. According to claim 1, The StreamHAL unit, A stream engine transforming the received video stream source into the standard video stream source; And IP surveillance-based large control, characterized in that it comprises a HAL Wrapper to transfer the information of the standard video stream source to the storage unit or at least one output unit, and serves as a buffer for mediating streaming system. The method of claim 5, The standard video stream source is divided into a header part and a data part. Reserved field not used, channel field indicating ID for identifying stream source, format field indicating stream configuration, stream time field indicating time of stream received, header size field indicating header size, stream body size And a body pointer indicating a storage size of the stream body and a body size field. The method of claim 6, The format field is An IP surveillance-based large control system comprising a source type field indicating a stream source type, a data type field indicating a data type, an unused unused field, and a data format field indicating a configuration of data. According to claim 1, The storage unit, A file bank manager for dividing a pre-allocated space of a storage unit into at least one file bank to store the video stream source and using the same as a storage space; And IP surveillance-based large control system comprising a meta-file unit for storing the information of the video stream source stored in the file bank as search information. According to claim 1, Large-scale monitoring system based on IP surveillance, characterized in that it further comprises an E-map unit for the user to easily check the location image of the IP (Internet Protocol) monitoring. According to claim 1, And an output unit for outputting the stored or retrieved video stream source. And the output unit outputs the video stream source using a memory inside a graphics card or a video card.

Images