KR102172943B1 - Method for managing image information, Apparatus for managing image information and Computer program for the same - Google Patents

Abstract

The present invention relates to a video information management method, a video information management apparatus, and a computer program.
According to an aspect of the present invention, there is provided a video information management method executed by a video information management apparatus, comprising: 1) receiving video information captured by a CCTV camera; 2) displaying the image information received from the CCTV camera through a display device; 3) when a memo request command is input during the display of the image information, providing a memo input window to a screen area of the display device-the memo input window is an input window for inputting memo information regarding the image information being displayed; And 4) when a memo completion command is input, generating and storing memo record information on the image information being displayed based on the input memo information-The memo record information includes information on a time when the memo request command is input and the A method for managing image information configured including: generating including memo information is disclosed.

Description

Image information management method, image information management device and computer program {Method for managing image information, Apparatus for managing image information and Computer program for the same}

The present invention relates to an image information management method, an image information management apparatus, and a computer program. Specifically, when a user finds an image that needs to be recorded separately in the process of monitoring an image captured by a CCTV camera, the user input The present invention relates to a video information management method, a video information management apparatus, and a computer program configured to record and manage a record of a corresponding video as information in the form of a memo.

Closed circuit television (CCTV) is installed to enable constant or temporary monitoring of a specific place. By displaying the image captured by the CCTV camera on the display device, the monitor checks the image in real time indoors and copes with it when a problem occurs. Or, it is used for confirmation purposes after an incident occurs.

A recent CCTV system, in a conventional method using a digital video recorder (DVR) that records and stores an image captured by a camera, is connected to an IP camera and uses a network video recorder (NVR) that compresses and stores the transmitted image. It is a trend that has changed in the way it is used. The DVR or NVR can monitor the video and efficiently transmit signals from multiple cameras to the surveillance system, and if necessary, the video can be checked later.

In the process of monitoring CCTV video, separate management of specific event or object information may be required.

As a related art, Korean Patent Laid-Open Publication No. 10-2012-0004037 (published on January 12, 2012) relates to a system and method for providing an image service using a security surveillance camera, which extracts objects excluding a background image from an image frame. After assigning an ID to each of the extracted entities, and listing entity information on the entity image, entity movement time, local terminal ID, and other entity properties such as the elderly, children, women, men, and heights to the IDed entity. A configuration was proposed to add a local image control unit with functions to the local security monitoring camera.

However, since the prior art is based on the image characteristics of the object included in the image, not from the viewpoint of considering the characteristics of the event that the monitor focuses on, there is a limitation in that it cannot provide a video recording function based on various events in real time.

As another prior art, Korean Patent Registration 10-0896949 (registered on May 1, 2009) relates to an image processing monitoring system and a monitoring method capable of object identification, from recorded image information to quickly analyze the cause of an accident. Provides an image processing monitoring system that enables object identification to quickly search for desired images, but in order to shorten the search time, features are extracted from the extracted human images, and still images recorded from multiple cameras are compared to have similar characteristics. A configuration to track a specific person's path by searching still images is proposed.

However, since the prior art is also based on image features extracted from human images, not from the viewpoint of considering the characteristics of events that the monitor focuses on, there is a limitation in that it cannot provide various event-based image recording functions in real time.

Republic of Korea Patent Publication 10-2012-0004037 (published on January 12, 2012) Korean Patent Registration 10-0896949 (registered on May 1, 2009)

The present invention was devised in consideration of the above problems, and when a user finds an image that requires separate recording in the process of monitoring an image captured by a CCTV camera, the record of the image is recorded in the form of a memo by the user's input. It is an object of the present invention to provide a video information management method, a video information management apparatus, and a computer program configured to be recorded and managed with information of

According to an aspect of the present invention in consideration of the above object, there is provided an image information management method executed by an image information management apparatus, comprising: 1) receiving image information captured by a CCTV camera; 2) displaying the image information received from the CCTV camera through a display device; 3) when a memo request command is input during the display of the image information, providing a memo input window to a screen area of the display device-the memo input window is an input window for inputting memo information regarding the image information being displayed; And 4) when a memo completion command is input, generating and storing memo record information on the image information being displayed based on the input memo information-The memo record information includes information on a time when the memo request command is input and the A method for managing video information configured including: generating including memo information is disclosed.

Preferably, the memo input window may include a selection menu for selecting and inputting an event type included in the image information as the memo information.

Preferably, the memo input window may include a selection menu for selecting and inputting a type of a place where an event included in the image information has occurred as the memo information.

Preferably, in the present invention, 5) providing a search condition input window for the memo record information on a screen area of the display device- The search condition is at least one of a time when the memo request command is input, the event type, and a place type. Any one -; And 6) when a search condition is input, displaying and providing memo record information matching the input search condition.

Preferably, if the input search condition is 2 or more, the step 6) includes one search condition as an upper search condition and another search condition as a lower search condition, and the searched memo record information is classified according to the upper search condition. And, within each group classified according to the upper search condition, memo record information included in the corresponding group may be classified and displayed in lower order according to the lower search condition.

Preferably, in the memo input window, an image frame displayed at a time when the memo request command is input may be displayed as a captured image, and the captured image may constitute memo information.

Preferably, the memo input window may provide a drawing function of inputting a line or figure at an arbitrary position in the captured image as the memo information.

Preferably, the screen area of the display device includes an input menu for inputting the memo request command, and the memo input window includes a time when the memo request command is input and a time when the memo request command is input. A selection menu for selecting and inputting the captured image of the video frame being displayed and the event type included in the captured image as the memo information, a text input window for inputting text information as the memo information, and a memo completion command A completion menu for may be included.

Preferably, the memo record information may be generated including image identification information on an image in which the memo record information is generated or frame identification information on an image frame.

According to another aspect of the invention, there is provided a memory for storing one or more instructions; And a processor that executes the one or more commands stored in the memory, wherein the processor receives image information photographed by a CCTV camera, displays the image information received from the CCTV camera through a display device, and the image When a memo request command is input during the display of information, a memo input window is provided to the screen area of the display device-The memo input window is an input window for inputting memo information about the image information being displayed -, a memo completion command is input Then, based on the input memo information, memo record information on the video information being displayed is generated and stored-The memo record information is generated including information about the time at which the memo request command was input and the memo information- Disclosed is an apparatus for managing video information, characterized in that.

According to another aspect of the present invention, there is provided a computer program combined with hardware and stored in a medium to execute an image information management method, the image information management method comprising: receiving image information photographed by a CCTV camera; Displaying image information received from the CCTV camera through a display device; Providing a memo input window to a screen area of the display device when a memo request command is input during the display of the image information-the memo input window is an input window for inputting memo information regarding the image information being displayed; And generating and storing memo record information regarding image information being displayed based on the input memo information when a memo completion command is input.- The memo record information includes information about a time when the memo request command is input and the memo information. Generated, including-A computer program comprising: is disclosed.

In the present invention, when a user finds an image that requires separate recording in the process of monitoring an image captured by a CCTV camera, the record of the image can be conveniently recorded and managed as information in the form of a memo by the user's input. It offers the advantage of being able to.

1 is an overall configuration diagram of an image information management apparatus according to an embodiment of the present invention;
2 is a configuration diagram of an image information management apparatus according to an embodiment of the present invention;
3 is a flowchart of an image information management method according to an embodiment of the present invention;
4 is an exemplary view of a screen area of a display device according to an embodiment of the present invention;
5 is an exemplary view of a memo input window according to an embodiment of the present invention;
6 is an exemplary diagram of a search condition input window according to an embodiment of the present invention;
7 is a schematic diagram of a hardware perspective of an image information management apparatus according to an embodiment of the present invention;
8 to 10 are exemplary diagrams of a memo record information display screen according to an embodiment of the present invention.

The present invention can be implemented in various other forms without departing from the technical spirit or main features thereof. Therefore, the embodiments of the present invention are merely illustrative in all respects and should not be interpreted as limiting.

Terms such as first and second are used only for the purpose of distinguishing one component from other components. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected or connected to the other component, but another component may exist in the middle.

The singular expression used in the present application includes a plural expression unless the context clearly indicates otherwise. In the present application, terms such as "include", "include", "have", and the like are intended to express the existence of elements or combinations thereof described in the specification, and the possibility that other elements or features may exist or be added. It is not excluded in advance.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is an overall configuration diagram of an image information management apparatus according to an embodiment of the present invention, FIG. 2 is a configuration diagram of an image information management apparatus according to an embodiment of the present invention, and FIG. It is a schematic diagram from a hardware viewpoint of the video information management apparatus.

An image information management system according to an embodiment of the present invention includes a CCTV camera 10, an image information management device 20, and a display device 30.

The CCTV camera 10 is installed in at least one surveillance target area and is configured to photograph each surveillance target area.

The image information management method of the present embodiment may be executed on one image information captured by one CCTV camera 10, and two or more image information captured by two or more CCTV cameras 10 are divided into one display device. It can also be executed while being displayed on the screen at the same time. In the following description, a case in which two or more image information captured by two or more CCTV cameras 10 is displayed will be described as an example.

The CCTV camera 10 may be configured as an IP camera, and may be configured in the form of a CCTV camera set including a network video recorder (NVR) that compresses and stores an image transmitted through a network connection thereto. It may be configured in the form of a CCTV camera set including a DVR capable of digital image processing.

The image information management device 20 functions as a server that receives image information photographed by the CCTV camera 10 and executes the image information management method according to the present embodiment.

The image information management apparatus 20 of the present embodiment receives image information from two or more CCTV cameras 10 and displays each image information on a screen area of the display device 30.

The reception of the image information is directly or indirectly received from the CCTV camera 10.

As an example, the CCTV camera 10 may be directly wired or wirelessly connected to the image information management device 20, and may be configured to transmit image information from the CCTV camera 10 to the image information management device 20.

In another example, two or more CCTV cameras 10 are connected to a network video recorder (NVR) and a LAN or WLAN to receive and store and manage images from each CCTV camera 10 in the NVR, and the image information management device 20 May be configured to receive image information from the NVR.

As another example, two or more CCTV cameras 10 are connected to a network with an image management solution (VMS) that comprehensively manages images, and the image information management device 20 transmits image information from the image management solution. It may be configured to receive.

From a functional point of view, the image information management device 20 according to the present embodiment, as shown in FIG. 2, is an operation module 25 that performs a normal server operation and management function, and the CCTV camera 10 An image information management module 26 that receives and manages the image information, and an image that analyzes the image from the received image information to determine and manage whether there is movement or an object in the area to be monitored. The analysis module 27 provides a memo input window when a memo request command is input while the image information is being displayed, generates memo record information about the image information being displayed based on the input memo information, and provides a search function for the memo record. And a memo record management module 28 to perform memo recording and a display control module 29 that provides a display control function for memo input and memo search.

The image information management device 20 includes an image information DB 21 that stores image information and/or identification information of the CCTV camera 10 that provided image information, and an image analysis that analyzes an image about a motion/object. An image analysis information DB 22 for storing information and a memo record information DB 23 for storing memo record related information may be provided.

Since the image analysis information for each of the images is stored in the image analysis information DB 22, it is possible to check the image information through the image analysis information DB 22 when the user misses monitoring or when checking after do.

Each information received or generated by the image information management apparatus 20 may be stored in a file form or may be temporarily stored in a random access memory (RAM).

As an example, the display device 30 may be a normal monitor (or TV), and may be divided and displayed on one monitor, or may be configured to display image information as a single screen by interlocking multiple monitors. have.

Referring to FIG. 7, from a hardware point of view, the image information management apparatus of this embodiment includes a memory 2 for storing one or more commands, and a processor 4 for executing the one or more commands stored in the memory 2, , A computer program stored in a medium to execute a method for managing image information. The image information management apparatus according to the present embodiment may include a data input/output interface 6 and a communication interface 8, a data display means 3, and a data storage means 5.

3 is a flowchart of a method for managing image information according to an embodiment of the present invention, FIG. 4 is an exemplary view of a screen area of a display device according to an embodiment of the present invention, and FIG. 5 is a memo according to an embodiment of the present invention. An exemplary diagram of an input window, FIG. 6 is an exemplary diagram of a search condition input window according to an embodiment of the present invention, and FIGS. 8 to 10 are exemplary diagrams of a memo record information display screen according to an embodiment of the present invention.

First, the process of generating memo record information will be described.

In step 1), the image information management apparatus 20 receives image information photographed by the CCTV camera 10. The image information may be received in the form of an image file including an image frame.

In step 2), the image information management device 20 displays the image information received from the CCTV camera 10 through the display device 30. Two or more image information screens M-1 to 4 may be simultaneously displayed on the screen area M of the display device. Each image information screen (M-1 to 4) represents a screen received from one CCTV camera 10, respectively. Depending on the screen control algorithm, each screen may be changed and displayed according to time or whether an event occurs.

An input menu 51 for inputting a memo request command is included in the screen area M of the display device. As an example, the input menu 51 may be displayed in the form of a click menu button in the screen of each image information.

In step 3), when a memo request command is input while the image information is being displayed, the image information management device 20 provides a memo input window 50 to the screen area M of the display device 30. As an example, the input of the memo request command may be performed in a manner that a CCTV monitor clicks a click menu button in a screen of specific image information to be recorded. As an example, the memo input window 50 may be displayed in the form of a pop-up window in the screen area M of the display device 30. The memo input window 50 may be stored in the form of a well-known XML file or HTLM file.

The memo input window 50 is an input window for inputting memo information regarding image information being displayed. The memo input window 50 displays the input time of the memo request command (reference numeral 53 in FIG. 5).

Preferably, in the memo input window 50, an image frame being displayed at the time the memo request command is input is displayed as a captured image 58, and the captured image 58 constitutes memo information. The captured image 58 may be generated in the form of a captured image file by capturing an image information frame displayed at a time when a memo recording command is input.

The memo input window 50 includes a selection menu 52 for selecting and inputting an event type included in image information as the memo information. The event of the image information may be an event included in the captured image 58. Examples of events can be divided into types such as events, accidents, and others.

In addition, the memo input window 50 includes a selection menu 54 for selecting and inputting a type of a place where an event included in the image information has occurred as the memo information. Examples of places may be driveways, sidewalks, and intersections.

In addition, the memo input window 50 may provide a drawing function 55 for inputting a line or figure 59 at an arbitrary position in the captured image 58 as the memo information. The drawing function may be configured by storing and storing various drawing objects such as straight lines, curves, circles, squares, triangles, arrows, etc. in the captured image 58 using a conventional drawing command input method. Drawing objects in and stored in the captured image 58 are stored together as part of the captured image 58 as they are drawn.

In addition, the memo input window 50 may include a text input window 56 for inputting text information as the memo information, and a completion menu 57 for inputting a memo completion command. The text information is information for directly inputting the recorded content that the CCTV monitor wants to record about the captured image or event situation.

In step 4), when a memo completion command is input, the image information management apparatus 20 generates and stores memo record information regarding the image information being displayed based on the input memo information. The memo record information is generated including information on a time when the memo request command is input and the memo information. The memo record information may be stored in a manner that a CCTV monitor clicks a button of the completion menu 57 in the screen of the memo input window 50. The memo record information may be stored in the form of a known XML file or HTLM file including the captured image file and text information generated or input as described above, but is not limited thereto.

Preferably, the memo record information is generated including image identification information on an image in which the memo record information is generated or frame identification information on an image frame. For example, the image identification information may be unique identification information of a CCTV image, and the frame identification information may be image frame identification information in which the captured image 58 is generated. Through this configuration, when a specific event is searched from the memo record as described later, a replay may be provided by connecting an image or image frame related to the event using the identification information.

Next, a search process for memo record information will be described. A CCTV monitor or a person in charge who wants to post-review a CCTV image may search for the memo record information generated as described above and view it again or check the statistically classified information.

In step 5), the video information management device 20 provides a search condition input window 60 for the memo record information on the screen area M of the display device 30 according to a command input by the CCTV monitor. The search condition may be at least one of a time when the memo request command is input, a type of the event, and a type of place.

In step 6), when a search condition is input, the image information management apparatus 20 displays and provides memo record information matching the input search condition. For example, when a CCTV monitor enters each search condition in the search condition input window 60 configured as shown in FIG. 6 and clicks the search button 5, the memo record information meeting the search condition is searched from the DB and the result Extract it and give it a mark. As an example, as illustrated in FIG. 8, the search result may display event occurrence locations and types in a list format in order of date and time, as illustrated in FIG. 8. As another example, as illustrated in FIG. 9, the search result may first classify events according to event types, and display locations of event occurrences in chronological order in the form of a list.

In step 6), when the input search condition is 2 or more, the image information management apparatus 20 may classify one search condition as an upper search condition and another search condition as a lower search condition.

In addition, the image information management apparatus 20 classifies the searched memo record information according to an upper search condition, and stores memo record information included in the corresponding group within each group classified according to an upper search condition as a lower search condition. According to the sub-classification can be provided. For example, as shown in FIG. 10, the upper group is classified with the event type (incident, accident) as the upper search condition, and the lower group is divided and displayed with the event occurrence place (intersection 1, intersection 2) as the lower search condition. May be.

For example, if you click any one of the memo record information for each event displayed in this way, the memo information (time, captured image, event type, place, text) input through the memo input window 50 for the memo record information , Drawing, etc.) may be provided to be displayed on the screen. As another example, if any one of the memo record information for each event is clicked, the memo record may be replayed according to a preset video play condition before and after a corresponding time zone.

Through such memo recording, CCTV monitors can conveniently search and reconfirm images that require detailed review or post-confirmation, or reconfirm image information while checking statistically classified information together.

The image information management method according to an embodiment of the present invention may be provided as a computer program stored in a medium to execute the image information management method in combination with hardware, and a computer program for executing the image information management method on a computer. It is also possible to be included in this recorded, computer-readable recording medium.

To this end, embodiments of the present invention include programs for performing operations implemented by various computers and a computer-readable recording medium recording the programs. The computer-readable recording medium may include program instructions, data files, data structures, and the like alone or in combination. The media may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs, DVDs, and USB drives, magnetic-optical media such as floppy disks, and ROM, RAM, Hardware devices specially configured to store and execute program instructions such as flash memory and the like are included. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

10: CCTV camera 20: video information management device
30: display device

Claims (11)

A video information management method executed by a video information management apparatus, comprising:
1) receiving image information captured by a CCTV camera;
2) displaying the image information received from the CCTV camera through a display device;
3) If a memo request command is input during the display of the image information, providing a memo input window to the screen area of the display device-The memo input window is an input window for inputting memo information about the image information being displayed, An input menu for inputting the memo request command is included in the screen area of the display device, and a time when the memo request command is input in the memo input window, and a time when the memo information is configured and the memo request command is input. A selection menu for selecting and inputting the captured image of the video frame being displayed in the image frame, the event type included in the captured image as the memo information, and selecting and inputting the type of the place where the event occurred included in the captured image as the memo information A selection menu for, a text input window for inputting text information as the memo information, a drawing function for inputting a line or figure at an arbitrary position in the captured image as the memo information, and a completion menu for inputting a memo completion command Contains -;
4) When a memo completion command is input, generating and storing memo record information about the video information being displayed based on the input memo information-The memo record information includes information about a time when the memo request command is input and the memo Information, and the memo record information is generated including image identification information on the generated image or frame identification information on an image frame, and the image identification information is unique identification information of the video information of CCTV and the frame identification information Is the image frame identification information in which the captured image is generated;
5) providing a search condition input window for the memo record information on a screen area of the display device-the search condition is at least one of a time when the memo request command is input, the event type, and a place type; And
6) When a search condition is input, the step of displaying and providing memo record information matching the input search condition.
delete delete delete The method of claim 1,
If the entered search condition is 2 or more,
Step 6),
By separating one search condition into the upper search condition and the other search condition into the lower search condition,
Classify the searched memo record information according to the upper search condition,
A method for managing video information, characterized in that, within each group classified according to an upper search condition, memo record information included in the corresponding group is subclassed and displayed according to a lower search condition.
delete delete delete delete A memory storing one or more instructions; And
And a processor that executes the one or more instructions stored in the memory,
The processor,
Receiving image information captured by a CCTV camera;
Displaying image information received from the CCTV camera through a display device;
When a memo request command is input during the display of the image information, a memo input window is provided to the screen area of the display device-the memo input window is an input window for inputting memo information regarding the image information being displayed, and the display device In the screen area of, an input menu for inputting the memo request command is included, and the memo input window comprises a time when the memo request command is input, and the memo information is being displayed at the time the memo request command is input. A selection menu for selecting and inputting a captured image of an image frame and an event type included in the captured image as the memo information, and a selection menu for selecting and inputting the type of a place where the event included in the captured image occurs as the memo information And, a text input window for inputting text information as the memo information, a drawing function for inputting a line or figure at an arbitrary position in the captured image as the memo information, and a completion menu for inputting a memo completion command- ;
When a memo completion command is input, memo record information about the video information being displayed is created and stored based on the input memo information-The memo record information includes information about the time when the memo request command was input and the memo information And, the memo record information is generated including image identification information on the generated image or frame identification information on the image frame, the image identification information is unique identification information of the video information of the CCTV, and the frame identification information is the capture It is the image frame identification information in which the image is generated
Providing a search condition input window for the memo record information on a screen area of the display device, wherein the search condition is at least one of a time when the memo request command is input, the event type, and a place type;
When a search condition is input, displaying and providing memo record information matching the input search condition.
A computer program stored in a computer-readable medium to be combined with hardware to execute an image information management method,
The video information management method,
1) receiving image information captured by a CCTV camera;
2) displaying the image information received from the CCTV camera through a display device;
3) If a memo request command is input during the display of the image information, providing a memo input window to the screen area of the display device-The memo input window is an input window for inputting memo information about the image information being displayed, An input menu for inputting the memo request command is included in the screen area of the display device, and a time when the memo request command is input in the memo input window, and a time when the memo information is configured and the memo request command is input. A selection menu for selecting and inputting the captured image of the video frame being displayed in the image frame, the event type included in the captured image as the memo information, and selecting and inputting the type of the place where the event occurred included in the captured image as the memo information A selection menu for, a text input window for inputting text information as the memo information, a drawing function for inputting a line or figure at an arbitrary position in the captured image as the memo information, and a completion menu for inputting a memo completion command Contains -;
4) When a memo completion command is input, generating and storing memo record information about the video information being displayed based on the input memo information-The memo record information includes information about a time when the memo request command is input and the memo Information, and the memo record information is generated including image identification information on the generated image or frame identification information on an image frame, and the image identification information is unique identification information of the video information of CCTV and the frame identification information Is the image frame identification information in which the captured image is generated;
5) providing a search condition input window for the memo record information on a screen area of the display device-the search condition is at least one of a time when the memo request command is input, the event type, and a location type; And
6) When a search condition is input, displaying and providing memo record information matching the input search condition; and a computer program comprising: a.

Images