KR101040530B1 - System and method of processing images of a closed circuit television - Google Patents

Abstract

PURPOSE: An image processing system of a closed circuit television and method thereof are provided to conveniently grasp a defect factor of an image recovery function. CONSTITUTION: A plurality of internet protocol cameras(110,120,130) photographs of an image. A plurality of video processors(210,220,230) receives a compressed camera image from an IP camera. According to kinds of camera of the image processors, the compressed camera image is restored. A digital video recorder(300) extracts the image.

Description

Image processing system of closed circuit television and its method {SYSTEM AND METHOD OF PROCESSING IMAGES OF A CLOSED CIRCUIT TELEVISION}

The present invention relates to an image processing system and a method of a closed circuit television, and more particularly, to an image processing system and a method of a closed circuit television for removing a monitoring gap of a closed circuit television system when a defect in an image restoration function occurs. It is about.

In general, a closed circuit TV (CCTV) system uses a plurality of video cameras to capture a moving picture of a predetermined range and record the captured moving picture data on a video tape or a CD. By playing a videotape or CD, an administrator can see what happened at a particular time or location. However, since the conventional closed circuit TV stores the captured moving image data on the video tape in an analog manner, the available recording time is very limited according to the storage capacity of the video tape.

In order to solve this problem, recently, the use of digital video recorders (DVRs) capable of digitally storing photographed video data and managing and transmitting them as necessary is increasing. Digital Video Recorder (DVR) is a form of recording media from tape to hard disk with the development of digital video processing technology and compression technology in closed circuit TV system.

On the other hand, the digital video recorder (DVR) is a device that receives the image monitored through the camera from the input terminal and stores it as a disk, it can be divided into analog and digital methods. The analog method receives image data directly from a camera connected with a wired cable, while the digital method receives image data from an IP camera through the Internet or an internal network.

1 is a block diagram illustrating a general digital image data reception path.

Referring to FIG. 1, the image data photographed by the cameras 10 are focused on the hub 20, and the image data focused on the hub 20 is provided to the DVR 30 via the Internet. The external monitoring apparatus 40 inquires about what kind of action was performed in a specific time period through a method such as searching for image data stored in the DVR 30.

Image data received from the cameras 10 follow a basic Internet protocol. Internet protocols include TCP / IP, HTTP, and UDP. Image data is compressed in different cameras. JPEG, H264 and MPEG-4 are widely used as the current standard compression methods, and in some cases, manufacturers may adopt their own compression methods.

The key to image processing is that image restoration methods must be taken differently depending on the camera. In order to request an image storage system from the image processing system (DVR), it is necessary to convert the image data type into the type required by the image processing system. In this case, the image restoration routine must be newly implemented according to the supported camera.

However, as the camera is added, the image processing system has to be modified. In addition, there is a problem that the stability of the image processing system is deteriorated by the newly added image restoration function. In addition, there is a problem that the entire image processing system is stopped due to a defect of one image restoration function. In addition, when a defect occurs in the image processing system, a problem range includes a restorer as well as a storage device, which makes it difficult to determine the cause of the defect.

Therefore, the technical problem of the present invention is focused on this point, the object of the present invention is that even if a new camera is added, the image processing system does not need to be rebuilt, and when a defect occurs in the image restoration function, It is to provide an image processing system of a closed circuit television to remove the surveillance gap.

Another object of the present invention is to provide an image processing method of an image processing system of a closed circuit television.

In order to realize the above object of the present invention, an image processing system of a closed circuit television according to an embodiment is connected to each of a plurality of IP cameras for capturing an image, and receives a compressed camera image provided from the IP camera. And a plurality of image processors for restoring and temporarily storing the compressed camera image according to the type of camera, and a digital video recorder (DVR) for extracting and storing the images temporarily stored in each of the image processors.

In one embodiment of the present invention, each of the image processor, the image restoration module for restoring the compressed camera image provided from the IP camera, and the control so that the image restored by the image restoration module is temporarily stored in the temporary storage It may include a temporary storage control module.

In one embodiment of the present invention, each of the image processor broadcasts the presence or absence of a camera to each of the IP cameras, and as a confirmation signal is provided from the IP camera, and requests the camera information from the IP camera, the corresponding IP As the camera information is transmitted from the camera, the DVR may request the camera information to be added, and the camera information addition completion signal may be received from the DVR.

In one embodiment of the present invention, the DVR, a control module, an image extraction module for extracting the temporarily stored image under the control of the control module, and a storage for storing the image extracted by the image extraction module It may include.

In one embodiment of the present invention, the control module is connected to an external video surveillance apparatus, and as the image extraction is requested from the video surveillance apparatus, the control module may extract and transfer the corresponding image to the video surveillance apparatus.

In order to realize the above object of the present invention, an image processing method of a closed circuit television according to an embodiment includes: (a) a type of a camera by receiving a compressed camera image provided from each of a plurality of IP cameras for capturing an image; Restoring and temporarily storing an image according to the present invention; and (b) extracting and storing the temporarily stored image in a digital video recorder (DVR).

In an embodiment of the present invention, step (a) includes (a-1) checking the type of the IP camera, (a-2) receiving the compressed IP camera image, and (a-3) checking Restoring the received IP camera image based on the received IP camera type; and (a-4) temporarily storing the restored image.

In one embodiment of the present invention, step (a-1) is performed by (a-11) broadcasting whether a camera exists in each of the IP cameras, and (a-12) as a confirmation signal is provided from the IP camera. Requesting camera information from the IP camera; and (a-13) receiving camera information from the IP camera, requesting addition of the camera information to the DVR; and (a-14) from the DVR. And receiving a camera information addition completion signal.

In one embodiment of the present invention, step (a-4) is (a-41) as the image is received from the IP camera, the step of restoring the received image, and (a-42) the restored image to the temporary storage Copying; (a-43) transmitting a read signal to the DVR; and (a-44) restoring an image received from the IP camera as the read completion signal is received from the DVR. The method may include checking whether the operation of copying to the temporary storage is continuously performed, and feeding back to step (a-41) when checking to continue (a-45).

In an embodiment of the present invention, step (b) reads the temporarily stored image according to (b-1) receiving a read signal from an image processor for temporarily storing the restored image, and (b-2) Storing the read image in the storage of the DVR; (b-3) transmitting a read completion signal to the image processor; and (b-4) storing the temporary stored image in the storage of the DVR. The method may include checking whether the operation continues, and feeding back to step (b-1) when the operation is checked to be continued.

In one embodiment of the present invention, the image processing method of a closed-circuit television further includes (c) transmitting the stored image to the video surveillance apparatus as the transmission of the video signal from the external video surveillance apparatus is requested. can do.

According to the image processing system and the method of the closed-circuit television, the image restoration module and the image storage device prepared for each camera are separated from each other to separate the image restoration function and the image storage function, and to send and receive data only as processors in different areas. Even if a new video restoration module is added following the addition of a new camera, there is no need to rebuild the DVR, which is a video storage device. Accordingly, even if a defect occurs in the image restoration function, the cause of the defect can be easily identified, and the DVR can be maintained in a stable state.

1 is a block diagram illustrating a general digital image data reception path.
2 is a block diagram illustrating the function of an image processing system of a closed circuit television (CCTV) according to an embodiment of the present invention.
3 is a flowchart illustrating a video processing method of CCTV according to an embodiment of the present invention.
FIG. 4 is a signal flow chart for explaining model identification of an IP camera by checking the type of the IP camera shown in FIG. 3.
FIG. 5A is a flowchart for describing an image temporary storage step shown in FIG. 4, and FIG. 5B is a flowchart for explaining an image extraction step shown in FIG. 4.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will now be described in more detail with reference to the accompanying drawings. As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the text. However, this is not intended to limit the present invention to the specific disclosed form, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Like reference numerals are used for like elements in describing each drawing. In the accompanying drawings, the dimensions of the structures are shown in an enlarged scale than actual for clarity of the invention.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a part or a combination thereof is described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

Also, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

2 is a configuration diagram for explaining the function of the image processing system of CCTV according to an embodiment of the present invention.

Referring to FIG. 2, an image processing system of a CCTV according to an embodiment of the present invention includes a plurality of image processors 210, 220, and 230 and a digital video recorder (hereinafter, referred to as a DVR) 300. In the present embodiment, three IP cameras are arranged as an example, but the number of IP cameras may be variously changed.

Each of the image processors 210, 220, and 230 includes an image restoration module 212, a temporary storage control module 214, and a temporary storage area 216, and capture a plurality of IP cameras 110 and 120. And 130) connected to each other, and receives compressed camera images provided from the connected IP cameras and restores the images according to the types of cameras for temporary storage. That is, in the present embodiment, each of the image processors 210, 220, 230 is executed in one process according to the currently received camera, each of which performs an image restoration function. Each of the image processors 210, 220, and 230 may transmit the restored image to the DVR 300 to allow the DVR 300 to store the image and to transmit the image to the external video surveillance apparatus 300. Make sure In the present embodiment, the same reference numerals are assigned to the modules provided in each of the image processors 210, 220, and 230.

The image restoration module 212 restores the compressed camera image provided from the IP camera 110 and provides the restored camera image to the temporary storage control module 214.

The temporary storage control module 214 controls the image restored by the image restoration module 212 to be temporarily stored in the temporary storage 216.

The DVR 300 includes a control module 310, an image extraction module 320, and a storage 330, which are temporarily stored in the temporary storage 216 of each of the image processors 210, 220, and 230. Extract the image and save it.

The image extraction module 320 extracts the image temporarily stored in the temporary storage 216 under the control of the control module 310 and stores the extracted image in the storage 330.

The storage 330 stores the image extracted by the image extraction module 320.

In addition, the control module 310 is connected to an external video surveillance apparatus 400, and as the image extraction is requested from the video surveillance apparatus 400, extracts the corresponding image stored in the storage 330 Transfer to the video surveillance apparatus 400.

As described above, an image processor for performing a part of a function performed by the existing DVR is separately provided between the IP camera and the DVR. That is, the image processor is executed in one process according to the currently received camera, each of which performs an image restoration function. The reconstructed image is transmitted to the DVR to store the image and transmit it to an external video surveillance apparatus.

3 is a flowchart illustrating a video processing method of CCTV according to an embodiment of the present invention.

2 and 3, the type of the IP camera is checked (step S100). Checking the type of the IP camera may be made in the image restoration module 212, and further provided with a check module (not shown in Figure 2) to check the type of the IP camera separately from the image restoration module 212. It may be done. The checking of the type of the IP camera described above will be described in detail later with reference to FIG. 4.

Subsequently, the image restoration module 212 checks whether a compressed image is received from the IP camera 110 (step S200).

If it is checked in step S200 that the compressed image is received from the IP camera 110, the image restoration module 212 receives the image according to the type of the IP camera (step S300).

Then, the image restoration module 212 restores the received image (step S400).

Subsequently, the image restoration module 212 temporarily stores the restored image and transmits the stored image to the DVR 300 (step S500). Temporarily storing the restored image and transferring the stored image to the DVR 300 will be described in detail with reference to FIG. 5A.

Subsequently, the DVR 300 extracts the temporarily stored image (step S600). Extracting the temporary stored image will be described in detail later with reference to FIG. 5B.

Subsequently, the DVR 300 checks whether a video extraction request is received from an external video surveillance apparatus 400 (step S700).

If it is checked in step S700 that the video extraction request is received, the DVR 300 extracts the corresponding video and transmits the extracted video to the video surveillance apparatus 400 (step S800).

Step S100 of checking the type of camera in FIG. 3 is different for each camera manufacturer, but greatly follows the following procedure.

FIG. 4 is a signal flow chart for explaining model identification of an IP camera by checking the type of the IP camera shown in FIG. 3.

2 and 4, the image processor 200 transmits a response acknowledgment packet for all IPs that may be connected to receive initial IP camera information (step S110). As such, transmitting a response acknowledgment packet for all IPs is called broadcast in communication terms.

The IP camera 110 which has received the response acknowledgment packet from the image processor 200 transmits a reply packet to the image processor 200 to notify its presence (step S120).

When the reply packet is received from the IP camera 110, the image processor 200 may know the IP address of the IP camera 110 that has sent the reply packet and requests the camera information from the corresponding IP camera 110 (step). S130). The IP camera 110 transmits IP camera information including manufacturer information, model information, and the like to the image processor 200 (step S140).

The image processor 200 receiving the IP camera information from the IP camera 110 provides the IP camera information to the DVR 300 to request the addition of the IP camera information (step S 150), and the DVR 300 After adding the IP camera information, a signal indicating that the addition of the IP camera information is completed is provided to the image processor 200 (step S160).

FIG. 5A is a flowchart for describing an image temporary storage step shown in FIG. 4, and FIG. 5B is a flowchart for explaining an image extraction step shown in FIG. 4.

2 and 5A, for example, the image processor 210 waits for receiving an image from the IP camera 110 (step S510).

Subsequently, the image processor 210 checks whether the image is received (step S520), and if it is checked that the image is not received, the image processor 210 feeds back to step S510.

If it is checked in step S520 that the image is received, the image processor 210 restores the received image (step S530).

Subsequently, the image processor 210 copies the restored image to the temporary storage 216 which is a shared memory (step S540). Description of copying an image to the temporary storage 216, which is the shared memory, will be described in detail in the data exchange technique described below.

Subsequently, the image processor 210 transmits a read signal to the DVR 300 (step S550).

Subsequently, the image processor 210 waits for reception of a read complete signal from the DVR 300 (step S560).

Subsequently, the image processor 210 checks whether the read completion signal is received from the DVR 300 (step S560), and if it is checked that the read completion signal is not received, the image processor 210 feeds back to step S560.

If it is checked in step S560 that the read completion signal is received, it is checked whether to continue the operation of restoring the image received from the IP camera 110 and copying it to the temporary storage (step S580).

In step S580, if checked to continue, the feedback to step S600, and if checked to continue, the feedback to step S510 to wait for the image reception.

2 and 5B, the DVR 300 waits for reception of a read signal provided from the image processor 210 (step S610).

The DVR 300 checks whether the read signal is received (step S620), and feeds back to step S610 if the read signal is not checked.

If it is checked in step S620 that the read signal is received, the DVR 300 reads the images temporarily stored in the image processors 210 (step S630).

The DVR 300 stores the read image (step S640).

The DVR 300 transmits a read completion signal to the image processor 210 (step S650).

The DVR 300 checks whether the operation of storing the temporarily stored image in the storage of the DVR is continued (step S660), and feeds back to step S700 if it is not checked to continue.

If the process continues to check in step S660, the process returns to step S610 to wait for reception of the read signal.

In order to transmit and receive image data between different processes, Inter Process Communication (IPC) is required. In this case, since the overall performance may vary depending on how many times the image data is copied, the proposed method according to the present invention allows the number of copies to be reduced by one time through the temporary storage, which is shared memory.

In the above flowchart, the additional memory copy time is only required when the image is copied from the image temporary storage module to the temporary memory, which is shared memory. In case of extracting the temporarily stored image, the previously stored memory can be accessed and saved directly to the main storage without any restoration work.

This data exchange technique can be summarized as pseudo code as follows.

For example, the image transfer code of each of the image processors 210, 220, and 230 is as follows.

================================================== ====================

[#One. Image Processor]

    while bLoop = true

    begin

        if CameraFrameSended = false then

            continue;

        EncodedFrame: = RecvFrameFromCamera;

        DecodedFrame: = Decode (EncodedFrame);

        SharedMemory: = AllocSharedMemory from OS;

        TempStorage: = SharedMemory.Alloc (DecodedFrame.Size);

        CopyMem (TempStorage, DecodedFrame.Data, DecodedFrame.Size);

        SignalToDVR (READ_SHARED_MEM, TempStorage);

        WaitForDVRSignal (READ_COMPLETED);

        SharedMemory.Free (TempStorage);

    end

================================================== ====================

On the other hand, the image transmission code of the DVR 300 is as follows.

================================================== ====================

[#2. Digital Video Recorder (DVR)]

    while bLoop = true

    begin

         if WaitSignalFromDecoder (READ_SHARED_MEM) = false then

             continue;

         TempStorage: = RecvSignalData (READ_SHARED_MEM);

         DecodedFrame: = TempStorage;

         SaveFrameToMainStorage (DecodedFrame);

         SignalToDecoder (READ_COMPLETED);

    end

================================================== ====================

In the image transfer code, copying to the temporary storage, which is a shared memory, is performed only once when the image processor 210 calls <CopyMem>. The DVR 300 receives the signal that the memory is copied from the image processor 210 and reads the image data from the temporary storage 216, which is the corresponding shared memory, and transmits the image data to the external video surveillance apparatus 400 or stores it in the storage 330. Can be.

As described above, the present invention separates an image restoration function and an image storage function, which are functions of an image processing system. That is, by separating only the image restoration module prepared for each camera and the storage function of the image processing system, it becomes a form in which only data can be exchanged as processes in different areas.

By dividing the module into process units as described above, even if a new image restoration module is added, only the new image restoration module is implemented without changing the structured image storage module. Therefore, the image storage module can maintain a stable state.

In addition, even if a defect occurs in one image restoration function, only the image restoration module in which the defect is generated is stopped, and the other image restoration module is normally operated, so that the image processing system may continue to operate.

In addition, the defect generation range is limited when the image storage system defect occurs. That is, only the module in which the fault occurs is stopped, so that the module related and the module that is not are clearly separated.

Although described above with reference to the embodiments, those skilled in the art can be variously modified and changed within the scope of the invention without departing from the spirit and scope of the invention described in the claims below. I can understand.

As described above, according to the present invention, by separating the image restoration module and the image storage device prepared for each camera to separate the image restoration function and the image storage function to send and receive data only as processors in different areas, Even if a new video restoration module is added, there is no need to rebuild the DVR. Accordingly, the DVR can be maintained in a stable state.

In addition, even if a defect occurs in one image restoration function, only the corresponding image restoration module in which the defect is generated is stopped and the DVR continues to operate, thereby eliminating the monitoring gap of the CCTV system.

In addition, even if a program error occurs, the problem range according to the error can be reduced. Because the image processor and the DVR which restore the image received from the camera and temporarily store the image are separated from each other, it is possible to diagnose the error in which part more quickly and accurately.

In addition, since image processors and DVRs can be developed independently of each other, development time required for CCTV system construction can be shortened.

210, 220, 230: Image processor 212: Image restoration module
214: temporary storage control module 216: temporary storage
300: digital video recorder 310: control module
320: image extraction module 330: storage

Claims (11)

It is connected to each of a plurality of Internet Protocol (IP) cameras for capturing an image, receives a compressed camera image provided from a corresponding IP camera, and restores the compressed camera image according to the type of camera to temporarily A plurality of image processors for storing; And
And a digital video recorder (DVR) for extracting and storing an image temporarily stored in each of the image processors, wherein each of the image processors includes:
An image restoration module for restoring the compressed camera image provided from the IP camera; And
And a temporary storage control module for controlling the image restored by the image restoring module to be temporarily stored in a temporary storage. delete The image processing apparatus of claim 1, wherein each of the image processors
Broadcasting the presence or absence of a camera to each of the IP cameras, as a confirmation signal is provided from the IP camera, requests the camera information from the IP camera,
When the camera information is transmitted from the IP camera, requesting the DVR to add the camera information, and receiving the camera information addition completion signal from the DVR, the image processing system of a closed circuit television. The method of claim 1, wherein the DVR,
Control module;
An image extraction module for extracting the temporarily stored image under control of the control module; And
And a storage unit for storing the image extracted by the image extraction module. The closed-circuit television of claim 4, wherein the control module is connected to an external video surveillance apparatus and, when an image extraction is requested from the video surveillance apparatus, extracts the corresponding image and transfers the image to the video surveillance apparatus. Image processing system. (a) receiving a compressed camera image provided from each of a plurality of IP cameras for capturing the image, restoring the image according to the type of camera, and temporarily storing the compressed camera image; And
(b) extracting the temporarily stored image and storing the same in a digital video recorder (DVR), wherein step (a) includes:
(a-1) checking the type of the IP camera;
(a-2) receiving a compressed IP camera image;
(a-3) restoring the received IP camera image based on the checked IP camera type; And
(a-4) temporarily storing the reconstructed image. delete According to claim 6, Step (a-1) is,
(a-11) broadcasting the presence or absence of a camera in each of the IP cameras;
(a-12) requesting camera information from the IP camera as a confirmation signal is provided from the IP camera;
(a-13) receiving camera information from the IP camera, requesting the DVR to add camera information; And
(a-14) receiving a camera information addition completion signal from the DVR. The method of claim 6, wherein step (a-4)
(a-41) restoring the received image as the image is received from the IP camera;
(a-42) copying the reconstructed image to a temporary repository;
(a-43) transmitting a read signal to the DVR;
(a-44) checking whether to continue the operation of restoring an image received from the IP camera and copying the image received from the IP camera as the read completion signal is received from the DVR; And
(a-45) If checked to proceed, feedback to step (a-41) comprising the image processing method of a closed circuit television. The method of claim 6, wherein step (b)
(b-1) reading the temporary archived image in response to receiving a read signal from an image processor for temporarily storing the restored image;
(b-2) storing the read image in the storage of the DVR;
(b-3) transmitting a read completion signal to the image processor; And
(b-4) checking whether the operation of storing the temporarily stored image in the storage of the DVR is continued, and if it is checked as being continued, feeding back to step (b-1). Image processing method of circuit television. The method of claim 6,
and (c) transmitting the stored image to the video surveillance apparatus when the video signal is transmitted from the external video surveillance apparatus.

Images