KR20150011051A - Method and apparatus for dertermining monitoring channel in visual surveillance system - Google Patents

Abstract

Disclosed are a method and an apparatus for determining a monitoring channel in a video surveillance system. A video surveillance method includes the steps of: receiving a video stream from a camera; determining whether a frame contained in a video stream is a frame I or a frame P; determining whether an event occurs on the frame based on the encoding information of the same type of a frame, which is previously encoded, depending on whether the frame is the frame I or the frame P; determining the video stream contained in the frame as an output video stream if it is determined that the event occurs on the frame; and transmitting the video stream to the monitor if the video stream is determined as an output video stream to be output to the monitor.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and apparatus for determining a monitoring channel in a video surveillance system,

The present invention relates to an image processing method, and more particularly, to a video monitoring method and apparatus.

The importance of video surveillance systems is increasing to prevent further increases in international terrorism and violent crime and to collect evidence later on. CCTV (closed circuit television) can be used as one of the video surveillance systems. Existing video surveillance systems based on cameras such as CCTV monitor surveillance manpower through a monitor that outputs a screen shot from CCTV. In this case, the more monitoring CCTVs can not perform active monitoring, the lower the efficiency of surveillance. According to a recent study, when one person monitors two monitors, after 10 minutes, they do not recognize 45% of the events and do not recognize 95% after 22 minutes. Also, in most cases, after the occurrence of the event, methods using the images recorded by the video surveillance system are utilized. This type of surveillance system is a type of system structure in which damage to human life or property due to risk factors is inevitable. In recent years, there has been a demand for a preventive centered intelligent video surveillance system that automatically observes images, automatically detects threats that are likely to occur, and reports them to a person in charge.

Such a video surveillance system can be utilized in various fields. Specific areas of application are as follows. Automatic security surveillance for home security at apartments, office buildings, etc. Terrorism surveillance at a place where many people enter the subway, stadium, shopping center, etc. Automatic security monitoring of passengers and ATM users at financial institutions such as banks, government agencies, Automated security surveillance in buildings, automatic security surveillance of passengers in theft prevention and confidential leakage prevention research, traffic management (applied to technologies such as vehicle detection, vehicle tracking, traffic volume survey), facility management (object detection / Management of aging, breakage, outsider access, etc.), etc., can be used in various fields.

A first object of the present invention is to provide a method for determining a monitoring channel in a video surveillance system.

A second object of the present invention is to provide an apparatus for performing a method of determining a monitoring channel in a video surveillance system.

According to an aspect of the present invention, there is provided a video surveillance method including receiving a video stream from a camera, determining whether to output the video stream to a monitor, And transmitting the video stream to the monitor when the video stream is determined to be an output video stream output to the monitor, wherein the video stream includes a video stream including an I (intra coded) frame and a P (predictive coded) Wherein determining whether to output the video stream to the monitor comprises determining whether the frame contained in the video stream is the I frame or the P frame, determining whether the frame is the I frame or the P frame Based on the encoding information of the previously encoded same type of frame, Determining whether the event has occurred, and determining the video stream including the frame as the output video stream if it is determined that the event has occurred in the frame. Wherein the step of determining whether an event has occurred in the frame based on the encoding information of a previously encoded same kind of frame, depending on whether the frame is the I frame or the P frame, Performing a first determination condition for determining whether a difference between an encoded bit amount of an I frame and a difference between encoded bit amounts of other I frames received for a predetermined period of time is greater than a preset threshold value; Performing a second determination condition for determining whether a difference between an encoded bit amount of the I frame and an encoded bit amount of another I frame immediately before the I frame has occurred more than a preset number of times, And if the frame satisfies the first judgment condition and the second judgment condition , It may be determined that the event has occurred in the frame. Wherein the step of determining whether an event has occurred in the frame based on the encoding information of the previously encoded same kind of frame, depending on whether the frame is the I frame or the P frame, Performing a third determination condition that determines whether a difference between an encoded bit amount of a P frame and an average value of encoded bit amounts of other P frames received for a predetermined period of time is greater than a set threshold value; Frame, comparing the first MV information of the P frame with the second MV information of another P frame encoded immediately before the P frame for a predetermined period of time to determine whether the difference between the first MV information and the second MV information is equal to or greater than a preset threshold Performing a fourth determination condition for determining whether or not the frame is the first determination condition, 4 < / RTI > determination condition is satisfied, it may be determined that the event has occurred in the frame. Wherein the step of determining whether an event has occurred in the frame based on the encoding information of the previously encoded same frame according to whether the frame is the I frame or the P frame,

≪ Equation &

는 현재 P 프레임을 예측하는데 사용한 움직임 벡터의 인덱싱한 변수이고, 상기

는 이전 P 프레임을 예측하는데 사용한 움직임 벡터를 인덱싱한 변수이고, 상기 프레임이 P 프레임인 경우 상기 수학식에 기반하여 산출된 상기

와 상기

의 값을 기반으로 상기 프레임에 상기 이벤트가 발생하였는지 여부를 판단할 수 있다. 상기 영상 감시 방법은 상기 출력 영상 스트림에 포함된 프레임에서 상기 이벤트가 발생한 위치를 판단하는 단계와 상기 카메라가 상기 이벤트가 발생한 위치를 포커싱하여 촬상할 수 있도록 상기 카메라를 제어하는 단계를 더 포함할 수 있다. remind

Is an indexed variable of the motion vector used for predicting the current P frame,

Is a variable indexed by a motion vector used for predicting a previous P frame, and when the frame is a P frame,

And

It is possible to determine whether or not the event has occurred in the frame. The video surveillance method may further include determining a position where the event occurs in a frame included in the output video stream and controlling the camera to focus the position where the event occurs to capture have.

According to another aspect of the present invention, there is provided an image surveillance system including a processor for receiving a video stream from a camera, Determines whether the included frame is an I (intra coded) frame or a P (predictive coded) frame, and determines whether the frame is an I frame or a P frame based on coding information of a previously encoded same type frame Determining whether or not an event has occurred in the frame, and if it is determined that the event has occurred in the frame, determining the video stream including the frame as the output video stream and outputting the video stream as an output video stream , The video stream is transferred to the monitor To be implemented. The processor determines a first determination condition for determining whether the difference between the encoded bit amount of the I frame and the encoded bit amount of other I frames received for a predetermined time is greater than a preset threshold value when the frame is the I frame Frame and the encoded bit amount of the other I frame immediately before the I frame is greater than or equal to the threshold value for a certain period of time when the frame is the I frame , And to determine that the event has occurred in the frame when the frame satisfies the first determination condition and the second determination condition. The processor determines whether a difference between an encoded bit amount of the P frame and an average value of the encoded bit amounts of other P frames received for a predetermined time is greater than a set threshold value when the frame is the P frame And if the frame is the P frame, comparing the first MV information of the P frame with the second MV information of another P frame encoded immediately before the P frame for a predetermined time, Performing a fourth determination condition for determining whether a difference between the second MV information is equal to or greater than a preset threshold value and if the frame satisfies the third determination condition and the fourth determination condition, . ≪ / RTI > The processor comprising:

≪ Equation &

는 현재 P 프레임을 예측하는데 사용한 움직임 벡터의 인덱싱한 변수이고, 상기

는 이전 P 프레임을 예측하는데 사용한 움직임 벡터를 인덱싱한 변수이고, 상기 프레임이 P 프레임인 경우 상기 수학식에 기반하여 산출된 상기

와 상기

의 값을 기반으로 상기 프레임에 상기 이벤트가 발생하였는지 여부를 판단도록 구현될 수 있다. 상기 프로세서는 상기 출력 영상 스트림에 포함된 프레임에서 상기 이벤트가 발생한 위치를 판단하고 상기 카메라가 상기 이벤트가 발생한 위치를 포커싱하여 촬상할 수 있도록 상기 카메라를 제어하도록 구현될 수 있다. remind

Is an indexed variable of the motion vector used for predicting the current P frame,

Is a variable indexed by a motion vector used for predicting a previous P frame, and when the frame is a P frame,

And

To determine whether the event has occurred in the frame. The processor may be configured to determine the location of the event in a frame included in the output video stream, and to control the camera so that the camera can focus and image the location where the event occurred.

As described above, according to the method and apparatus for determining a monitoring channel in a video surveillance system according to an embodiment of the present invention, a screen in which a specific event occurs on a screen shot through an imaging camera of the video surveillance system is determined through image analysis, The system can perform effective monitoring.

1 shows a video surveillance system according to an embodiment of the present invention.
2 is a conceptual diagram illustrating a transport packet according to an embodiment of the present invention.
3 is a conceptual diagram illustrating an RTP header according to an embodiment of the present invention.
4 is a conceptual diagram illustrating a change in bit amount per frame according to an embodiment of the present invention.
5 is a flowchart illustrating a method for determining occurrence of an event in a video surveillance system server according to an exemplary embodiment of the present invention.
6 is a conceptual diagram illustrating a video surveillance system server according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, the same reference numerals will be used for the same constituent elements in the drawings, and redundant explanations for the same constituent elements will be omitted.

In the case of a small-scale video surveillance system having a small number of cameras for transmitting video streams, the number of images captured and displayed is small. Therefore, it is possible to monitor all channels in real time by displaying images of all channels on the monitor of the monitoring system. However, in the case of a large-scale video surveillance system having a large number of cameras for transmitting a video stream, a large amount of calculation may be required to decode a video stream transmitted from a plurality of channels. Therefore, in a large-scale video surveillance system having a large number of channels, it may not be effective to decode images of all channels in real time and display them on a monitor.

According to the embodiment of the present invention, it is possible to effectively perform monitoring by selecting only a part of the channels determined to have generated a specific event and real-time display. In order to determine a channel to be monitored in real time in a large-scale video surveillance system, it is possible to preferentially select and display a channel in which a specific event or event is determined to have occurred.

According to the embodiment of the present invention, the video stream transmitted from the camera of each channel to the video surveillance system server can be analyzed in real time, and the channel in which the change of the video is detected can be displayed preferentially.

1 shows a video surveillance system according to an embodiment of the present invention.

The video surveillance system according to the embodiment of the present invention may include a plurality of cameras 100, a video surveillance system server 120, a storage device 140, and a monitor 160. Each component of the video surveillance system can perform, for example, the following operations.

The plurality of cameras 100 may capture images from each camera, and may transmit the video streams generated by the cameras to the video surveillance system server 120. In addition, the setting of the individual camera may be changed based on the command transmitted from the video surveillance system server 120. The plurality of cameras 100 can transmit a video stream to the video surveillance system server 120 based on each camera channel. The images captured by each camera are compressed in the form of a compressed bitstream using a moving image compression codec such as H.264 or MPEG-4. The compressed bitstream is again packetized into transport packets according to a transport protocol such as a real-time transport protocol (RTP).

2 is a conceptual diagram illustrating a transport packet according to an embodiment of the present invention.

Referring to FIG. 2, a transport packet transmitted from a plurality of cameras to a video surveillance system server may include an RTP header 200 and a compressed bitstream 220. The RTP header 200 contains information such as the number of frames corresponding to the corresponding bit stream and a time stamp (Timestamp) for knowing when to display the bit stream.

3 is a conceptual diagram illustrating an RTP header according to an embodiment of the present invention.

Referring to FIG. 3, the RTP header may be composed of the following information.

V (version): Information about the version of RTP can be represented by 2-bit information.

P (padding): This information can indicate whether there is more than one padding bit at the end of the packet.

 X (Extension): It can mean that one extension header after the fixed header is additionally included in 1-bit information.

CC (CSRC Count): The number of CSRC identifiers displayed after the 12-byte fixed header with 4-bit information can be displayed.

M (Marker): used to indicate important events such as frame boundaries in the packet stream with 1 bit of information.

PT (Payload Type): It is possible to indicate the type of the RTP payload by 7 bits of information. For example, RTP indicates whether the content being transmitted is G.711 or H.264.

Sequence number: As 16 bits of information, the sequence number starts at a random number for security reasons but can be incremented by 1 each time the packet is incremented.

Timestamp: The 32-bit information indicates the sampling instant of the first byte of the RTP packet.

SSRC (Synchronization Source) Identifier: Represents a synchronization source with 32 bits of information, and can be determined at random. They must have different values in the same RTP session.

CSRC (Contributing Source) Identifiers: It is possible to indicate when a plurality of sound sources are integrated into one through an audio mixer with information of 32 bits.

FIG. 2 and FIG. 3 assume that a plurality of cameras transmit video streams generated based on RTP. A plurality of cameras may transmit image information sensed based on a protocol other than RTP to a video surveillance system, and such embodiments are also included in the scope of the present invention.

The video surveillance system server 120 may control a plurality of cameras 100 and may perform image processing on a video stream transmitted by a plurality of cameras 100. [ The video surveillance system server 120 may selectively transmit an image generated by a specific event among the images captured by the camera to the monitor 160. [ A method for selecting an image in which a specific event has occurred from images photographed by the camera 100 will be described in detail below. Also, the video surveillance server 120 can transmit the video streams transmitted from the plurality of cameras 100 to the storage device.

The storage device 140 may store a video stream transmitted from the video surveillance system server 120.

The monitor 160 may selectively display a video stream selected by the video surveillance system server 120.

The video streams generated by the plurality of cameras 100 are transmitted to the video surveillance system server 120. The video streams transmitted by the plurality of cameras 100 may be referred to as transmission packets. The video surveillance system server 120 may depacketize the transport packet transmitted from the camera 100 and store the compressed bit stream in the storage device 140. The video surveillance system server 120 may also compress It is possible to display the reconstructed image on the monitor 160 by decoding the bitstream. If a large number of transmission packets are transmitted from a plurality of cameras 100, since a large amount of computation is required in the decoding process in the image processing server 120, the large-sized video surveillance system server 120 decodes transmission packets of all cameras in real- There may be restrictions.

For example, when the performance of the video surveillance system server 120 is such that 10 channels of HD (high definition) video can be decoded in real time, whereas the number of channels transmitted to the video surveillance system server 120 is 32 All channels can not be decoded and displayed in real time. In such a case, it may be impossible to perform monitoring in real time. In such a large-scale video surveillance system, there is a method of setting a desired channel as a method of determining a real-time monitoring channel. It is possible to use a method of receiving transmission packets of all channels and storing them in a storage device, and decoding only a part of channels desired by the user in real time. If there is no user setting, the video surveillance system server 120 may determine that a channel in which a specific event or event occurs is preferentially displayed on the monitor 160.

In the present invention, a method of deciding a real-time monitoring channel by referring to the amount of compressed bitstream of each frame and the size information of a motion vector (MV) after depacketizing a transport packet in the video surveillance system server 120 .

The video surveillance system server 120 decapsulates the transport packet and can know the type of each frame and the encoded bit amount of each frame (I frame, P frame or B frame).

(1) An I frame (intra coded frame) is a frame in which encoding and decoding are independently performed through intra prediction without reference to another frame. The I frame may come in any position in the data stream. Since it is encoded without reference to other images, it can have the lowest compression ratio among I, B and P frames.

(2) P-frame (predictive coded frame) can perform encoding based on inter-picture prediction with reference to the previous frame (forward prediction). The encoding and decoding can be performed using the previous I frame information and the P frame information in encoding and decoding operations for the P frame. P frames can be encoded based on fewer bits in encoding than I frames.

(3) A B-frame (Bi predictive coded frame) is a frame predicted from a frame to be displayed later than the previous frame as well as the current frame. That is, bidirectional prediction can be performed when performing motion prediction in a B frame.

The coding rate may be changed depending on whether the frame is an I frame, a P frame, or a B frame, even if the same image frame is used. Therefore, in the embodiment of the present invention, it is possible to determine a change in the coding rate of a frame by dividing the frame into the types.

4 is a conceptual diagram illustrating a change in bit amount per frame according to an embodiment of the present invention.

Referring to FIG. 4, there is a conceptual diagram illustrating a bit amount changed between an I frame and a P frame.

Since the I frame performs intra prediction, the amount of bits to be encoded is relatively larger than that of the P frame.

It can be confirmed that a specific I frame of the I frames has a higher bit amount to be encoded than the previous I frame. In addition, it can be confirmed that a specific P frame of the P frames has a higher bit amount to be encoded than the previous P frame.

It can be predicted that a frame having a relatively large amount of change in the amount of bits based on the previously encoded frame is different from the previous frame in the image encoded in the corresponding frame. Therefore, according to the embodiment of the present invention, it is possible to determine whether an event has occurred in a specific channel by dividing the frame according to the type of the frame and the change in the coding rate of the frame. Hereinafter, a method for determining whether or not an event has occurred in a channel according to whether an encoded frame is an I frame or a P frame is explained in the following embodiments of the present invention. A method of determining whether or not an event has occurred in the channel may use another determination method as an example.

(1) A method for determining whether an event has occurred in a channel in an I frame.

A method of determining whether or not an event has occurred in a channel in an I frame is as follows. The following conditions are one example of how to determine the change on the screen based on the coding rate of the I frame. It is possible to determine whether or not an event has occurred in an image encoded in an I frame encoded through various criteria based on I frames as well as the following method. A condition for determining whether or not an event has occurred in an I frame received based on the previous I frame may be referred to as an I frame event occurrence condition determination condition.

1) If the encoded bit amount of the current I frame is greater than the average bit amount of the hatched bit stream for a predetermined time period (user definable, for example, one minute) For example, if I am over 30%).

2) The number of times (for example, 1 minute) the number of times that the difference between the I-frame of the current comparison target and the I-frame immediately before is larger than a threshold value (for example, 20% For example, more than 3 times).

If one of the above two conditions is satisfied, there is a high probability that a scene change occurs in an image encoded in an I frame, and it is judged that a probability that an event has occurred is high.

(2) A method for determining whether an event has occurred in a channel in a P frame.

A method of determining whether or not an event has occurred in a channel in a P frame is as follows. The following condition is an example of a method of determining a change of a picture based on a coding rate of a P frame. It is possible to determine whether or not the contents of the image of the P frame encoded through various judgment criteria based on the P frame as well as the following method have changed. A condition for determining whether or not an event has occurred in a received P frame based on the previous P frame may be referred to as a P frame event occurrence condition determination condition.

1) the bit amount is greater than the average bit amount of all P frames of the current P frame for a predetermined period of time (user-definable, for example, one minute) (for example, three times or more).

2) The MV information is extracted from the current P frame and the immediately preceding encoded P frame (the process of extracting only MV information from the bit stream instead of the complete decoding). As a result, the difference between the MVs of the two frames is smaller than the threshold , 30% or more).

When both of the above two conditions are satisfied, it can be determined that not only a luminance change but also a motion has occurred in the P frame. That is, it can be determined that the probability of occurrence of an event in the corresponding channel is high.

The following formula is a formula for calculating the difference of MV in P frame.

&Quot; (1) "

는 현재 P 프레임을 예측하는데 사용한 움직임 벡터를 인덱싱한 것이고,

는 이전 P 프레임을 예측하는데 사용한 움직임 벡터를 인덱싱한것이다.

는 인덱싱된 현재 P 프레임의 움직임 벡터와 이전 P 프레임의 움직임 벡터의 차이를 지시한다. 본 발명의 실시예에 따르면, 수학식 1에서 산출된

가 0.3 *

보다 큰 경우 두 개의 P 프레임의 MV의 차이가 30% 이상 난다고 판단할 수 있다.In Equation (1)

Is a motion vector index used for predicting the current P frame,

Is the index of the motion vector used to predict the previous P frame.

Indicates a difference between a motion vector of the indexed current P frame and a motion vector of the previous P frame. According to an embodiment of the present invention,

0.3 *

It is judged that the difference between the MVs of the two P frames is 30% or more.

The event generation information for all video streams of all channels can be counted by the above-described method, and a channel in which a lot of events are generated can be selected first and decoded and displayed, thereby realizing monitoring in real time.

In order to determine whether or not an event has occurred, it is determined whether or not an event has occurred in the I frame. It is determined whether or not an event has occurred in the P frame, and it is determined that an event has occurred in both the I frame and the P frame in the received video stream The corresponding video stream can be displayed on the monitor. Or if it is determined that an event has occurred in one of the I frame and the P frame in the received video stream, the corresponding video stream may be displayed on the monitor.

Also, the numerical values used as the comparison reference in the above I frame and P frame are exemplified in the present invention and can be adjusted according to the characteristics of the image in the real time video surveillance system. For example, if all channels have excessive events and meaning that event counts are not meaningful, you can adjust the comparison threshold to make the criteria you recognize as an event more rigorous. Conversely, if the occurrence of the event is too small, the comparison reference value can be adjusted to increase the frequency of the event.

By performing the above determination in the video surveillance system server, a large-scale video surveillance system having a large number of channels can perform a real-time display by selecting a channel having a high probability of occurrence in the video surveillance system server without user setting. The present invention can be efficiently used in a large-scale video surveillance system having a large number of channels, requiring only a bit amount and motion vector information of each frame without performing a decoding process requiring a large number of operations.

5 is a flowchart illustrating a method for determining occurrence of an event in a video surveillance system server according to an exemplary embodiment of the present invention.

Referring to FIG. 5, a video stream is received through a plurality of cameras (step S500).

The image processing server can receive a video stream transmitted from a plurality of cameras and determine a video stream to be displayed on the monitor among the received video streams.

The video surveillance system server determines whether an event has occurred in the frame received based on the previous frame (step S510).

The video surveillance system server may store information on bits encoded on a frame-by-frame basis to determine whether a specific event has occurred in an image captured by a plurality of cameras, and determine whether an event is generated in the received frame based on the information .

As described above, a frame may be divided into I, B, and P frames according to a coding method, and the amount of bits encoded may be different for each type of frame.

For example, when the received frame is an I frame, it is possible to determine whether an event has occurred in the received I frame by comparing it with the amount of encoding of the previously received I frame. For example, if the encoded bit amount of the current I frame is equal to or greater than the threshold value, which is compared with the average bit amount of the bitstream for which all I frames for a predetermined time have been hatched, If the number of bits of the I frame that is the target and the number of bits of the I frame that has been coded immediately before is greater than the threshold value, it is determined that an event has occurred in the received I frame, and the video stream is decoded and output to the monitor have.

And outputs a video stream determined as an event to the monitor (step S520).

It is possible to display only the video stream that is determined to have generated the event on the monitor. By using this method, the image can be monitored more intensively.

The image processing server may further analyze the video stream in which the event has occurred and control the camera so as to focus and focus the part where the event occurs.

If the image processing server determines that an event has occurred in a specific image stream, the image may be further analyzed to determine the occurrence part of the event. Various methods can be used as a method for determining and focusing the occurrence of an event in an image. For example, in the case of a video surveillance system used for tracking a person, it is possible to detect movement of a specific person based on characteristics of a person who is an object, and to control the camera to focus the image on a person based on the movement. Another way is to control the camera's focus on the image based on the specific behavior. In the case of criminal activity, there is a high possibility that sudden change in behavior occurs in the behavior of a person or object. That is, it can have an ideal behavioral characteristic rather than a general behavior. Accordingly, the server determines a specific behavior pattern as a default value, and when a behavior characteristic exceeding the default value is detected, the camera can be controlled to focus the image to the corresponding position.

6 is a conceptual diagram illustrating a video surveillance system server according to an embodiment of the present invention.

6, the video surveillance system server may include a video stream receiving unit 600, a video stream analyzing unit 610, a video stream transmitting unit 620, a camera controlling unit 630, and a processor 640. Each component of the image processing server can be implemented to perform the operation of the video surveillance system server described above in the embodiment of the present invention.

The video stream receiving unit 600 may be implemented to receive a video stream transmitted from a plurality of cameras.

The video stream analyzing unit 610 may be implemented for analyzing a plurality of video streams transmitted from the video stream receiving unit 600 to determine which video stream the event has occurred. As described above, the video stream analyzing unit 610 can distinguish frames according to a coding method of a frame such as an I frame and a P frame in the received video stream. In addition, the divided frame may be compared with the coded bits of another frame to determine whether the event has occurred or not. Various conditions may be used for determining whether or not an I frame event is a condition for determining whether or not an event has occurred in a video stream and a P frame event determination condition. The video stream analyzing unit 610 can determine that an event has occurred in the video stream if both the I frame event determination condition and the P frame event determination condition are satisfied. Alternatively, it is also possible to determine that an event has occurred in the video stream even when only one of the I frame event determination condition or the P frame event determination condition is satisfied.

The video stream transmission unit 620 may be implemented to transmit a video stream determined to have generated an event based on the result determined by the video stream analysis unit 610.

The camera controller 630 can analyze the image of the video stream determined to have generated the event and control the operation of the camera to focus more on the portion where the event occurs in the image. For example, the video stream analyzing unit 610 can analyze events generated in the video. In the camera control unit 630, a camera control signal may be generated and transmitted to the camera so that the camera can focus on a portion where an event occurs in the image.

The processor 640 may be implemented to control operations of the video stream receiving unit 600, the video stream analyzing unit 610, the video stream transmitting unit 620, and the camera controlling unit 630.

For the sake of convenience of description, the above-described structure is expressed by separating each constituent part from the function, and even when expressed by one constituent part, the constituent parts may be divided into plural constituent parts and a plurality of constituent parts may be combined into one constituent part.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

Claims (10)

A video surveillance method comprising:
Receiving a video stream from a camera;
Determining whether to output the video stream to a monitor; And
And transmitting the video stream to the monitor if the video stream is determined to be an output video stream output to the monitor,
The video stream is a video stream including I (intra coded) frames and P (predictive coded) frames,
Wherein the step of determining whether to output the video stream to a monitor comprises:
Determining whether a frame included in the video stream is the I frame or the P frame;
Determining whether an event has occurred in the frame based on encoding information of a previously encoded same frame according to whether the frame is the I frame or the P frame; And
And determining the video stream including the frame as the output video stream when it is determined that the event has occurred in the frame. The method as claimed in claim 1, wherein the step of determining whether an event has occurred in the frame based on the encoding information of a previously encoded same type frame, according to whether the frame is the I frame or the P frame,
If the frame is the I frame, performing a first determination condition for determining whether the difference between the encoded bit amount of the I frame and the encoded bit amount of other I frames received for a predetermined period of time is greater than a set threshold value ;
It is determined whether or not a difference between the encoded bit amount of the I frame and the encoded bit amount of another I frame immediately before the I frame has occurred more than the preset number of times or more for a predetermined time when the frame is the I frame Performing a second determination condition to determine a second determination condition; And
And determining that the event has occurred in the frame if the frame satisfies the first determination condition and the second determination condition. The method as claimed in claim 1, wherein the step of determining whether an event has occurred in the frame based on the encoding information of a previously encoded same type frame, according to whether the frame is the I frame or the P frame,
When the frame is the P frame, a third determination condition for determining whether the difference between the encoded bit amount of the P frame and the average value of the encoded bit amounts of other P frames received for a predetermined period of time is greater than a set threshold value ;
If the frame is the P frame, the first MV information of the P frame and the second MV information of another P frame encoded immediately before the P frame are compared for a predetermined time, and the first MV information and the second MV information Performing a fourth determination condition to determine whether a difference between the first threshold value and the second threshold value is equal to or greater than a set threshold value; And
And if the frame satisfies the third determination condition and the fourth determination condition, determining that the event has occurred in the frame. The method of claim 1, wherein the step of determining whether an event has occurred in the frame based on the encoding information of the previously encoded same frame, depending on whether the frame is the I frame or the P frame,
≪ Equation &

remind

Is an indexed variable of the motion vector used to predict the current P frame,
remind

Is a variable indexing a motion vector used for predicting a previous P frame,
And if the frame is a P frame,

And

And determining whether the event has occurred in the frame. 5. The method of claim 4,
Determining a location of the event in a frame included in the output video stream; And
And controlling the camera so that the camera can focus and image the location where the event occurred. A video surveillance apparatus, comprising: a processor;
The processor receives the video stream from the camera,
Determines whether a frame included in the video stream is an I (intra coded) frame or a P (predictive coded) frame,
It is determined whether or not an event has occurred in the frame based on the encoding information of the previously encoded same type frame according to whether the frame is the I frame or the P frame
If it is determined that the event has occurred in the frame, the video stream including the frame is determined as the output video stream
And to transmit the video stream to the monitor when the video stream is determined to be an output video stream output to the monitor. 7. The apparatus of claim 6,
A first determination condition for determining whether a difference between an encoded bit amount of the I frame and a different encoded bit amount of another I frames received for a predetermined time is greater than a preset threshold value when the frame is the I frame,
It is determined whether or not a difference between the encoded bit amount of the I frame and the encoded bit amount of another I frame immediately before the I frame has occurred more than the preset number of times or more for a predetermined time when the frame is the I frame The second judgment condition is satisfied,
And determines that the event has occurred in the frame when the frame satisfies the first determination condition and the second determination condition. 7. The apparatus of claim 6,
When the frame is the P frame, a third determination condition for determining whether the difference between the encoded bit amount of the P frame and the average value of the encoded bit amounts of other P frames received for a predetermined period of time is greater than a set threshold value and,
If the frame is the P frame, the first MV information of the P frame and the second MV information of another P frame encoded immediately before the P frame are compared for a predetermined time, and the first MV information and the second MV information And a fourth determination condition for determining whether or not the difference between the first threshold value and the second threshold value is equal to or greater than the set threshold,
And determines that the event has occurred in the frame when the frame satisfies the third determination condition and the fourth determination condition. 7. The apparatus of claim 6,
≪ Equation &

remind

Is an indexed variable of the motion vector used to predict the current P frame,
remind

Is a variable indexing a motion vector used for predicting a previous P frame,
And if the frame is a P frame,

And

Wherein the determination unit determines whether the event has occurred in the frame based on the value of the event. 10. The apparatus of claim 9,
Determining a location of the event in a frame included in the output video stream,
Wherein the camera is configured to control the camera so as to focus and photograph the position where the event occurs.

Images