KR20160026544A - System and method for video search - Google Patents

Abstract

An exemplary embodiment of the present invention provides a moving picture search system, to efficiently perform moving picture search using complex search rules set by a user, which comprises: a user client module receiving a user input for setting a plurality of search conditions for moving picture search and relations among the search conditions, and generating queries using the search conditions and the relations; and an analysis module acquiring moving picture related data using the queries, and analyzing the moving picture related data to provide information on moving pictures matched with the queries to the user client module.

Description

SYSTEM AND METHOD FOR VIDEO SEARCH

The disclosed embodiments relate to a moving image search technology, and more particularly to a moving image search system that can be placed in various operating environments and a moving image search method that can be performed in such a system.

There are various video analysis techniques for detecting an object or an event in a moving image captured by a photographing device or a moving image source such as a camera. These techniques make it possible to search for a moving picture in which a specific situation is photographed based on the detected object or event. For example, Closed-Circuit Television (CCTV) systems, widely used in many facilities such as roads, parking lots, schools, airports, and train stations, provide users with video search functions while maintaining vast amounts of video data. do.

However, existing video retrieval systems pre-set the types of search queries, and users can not use other types of queries. Also, in such systems, it is difficult to search based on the associations that may exist between moving images originating from multiple moving image sources. In the end, even if the video database is huge, its utilization rate is limited.

Accordingly, there is a need to overcome the limitations of the conventional moving image search system and to develop a more efficient moving image search function.

U.S. Patent No. 8315965

The disclosed embodiments provide a technique for efficiently performing video search using a complex search rule designated by a user.

According to an exemplary embodiment, there is provided an apparatus for receiving a user input that specifies a plurality of search conditions for a moving image search and a relationship between the plurality of search conditions, and generating a query using the plurality of search conditions and the relationship User client module; And an analysis module for acquiring moving picture related data using the query, analyzing the moving picture related data, and providing information about the moving picture matched with the query to the user client module.

The moving image related data may include metadata of a plurality of moving images.

The metadata may include at least one of an object and an event that can be extracted from the plurality of moving images.

The analysis module may also obtain the moving picture related data from the database management module using the query.

The analysis module may also convert the query into a format for querying the database management module.

The analysis module may further extract a specific search condition by parsing the query, and the moving image related data may satisfy the specific search condition.

The analysis module may also use a CEP (Complex Event Processing) engine to analyze the moving picture related data.

The user client module may also provide a user interface for receiving the user input.

The user client module may also express the plurality of search conditions and the relationship in the user interface.

The user client module may also obtain the matching moving image using the information.

According to another exemplary embodiment, there is provided a method comprising: receiving a user input specifying a plurality of search conditions for a moving image search and a relationship between the plurality of search conditions; Generating a query using the plurality of search conditions and the relationship; Acquiring moving picture related data using the query; And analyzing the moving picture related data and providing information on the moving picture matched with the query to the user client module.

The moving image related data may include metadata of a plurality of moving images.

The metadata may include at least one of an object and an event that can be extracted from the plurality of moving images.

The moving picture searching method may further include obtaining the moving picture related data from the database management module using the query.

The moving image search method may further include converting the query into a format for querying the database management module.

The moving image search method may further include extracting a specific search condition by parsing the query, and the moving image related data may satisfy the specific search condition.

The moving picture search method may further include using a complex event processing (CEP) engine to analyze the moving picture related data.

The moving picture search method may further include providing a user interface for receiving the user input.

The moving picture search method may further include displaying the plurality of search conditions and the relation in the user interface.

The moving image searching method may further include obtaining the matching moving image using the information.

According to yet another exemplary embodiment, there is provided a computer program stored on a medium for executing the motion picture retrieval method, in combination with hardware.

According to some embodiments, by specifying a plurality of search conditions and a relationship between the search conditions, the user can obtain a desired video.

According to some embodiments, a composite query can be generated according to a correlation between a plurality of moving images, and a user can conveniently define a query of a desired type.

1 illustrates a moving picture search system according to an exemplary embodiment;
2 is a diagram illustrating an operating environment to which a moving picture search system is applied according to an exemplary embodiment;
3 illustrates a graphical user interface in accordance with an exemplary embodiment;
4 is a diagrammatic representation of a search rule defined by a user according to an exemplary embodiment;
FIG. 5 illustrates a moving image search process according to an exemplary embodiment; FIG.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. The following detailed description is provided to provide a comprehensive understanding of the methods, apparatus, and / or systems described herein. However, this is merely an example and the present invention is not limited thereto.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. The following terms are defined in consideration of the functions of the present invention, and may be changed according to the intention or custom of the user, the operator, and the like. Therefore, the definition should be based on the contents throughout this specification. The terms used in the detailed description are intended only to describe embodiments of the invention and should in no way be limiting. Unless specifically stated otherwise, the singular forms of the expressions include plural forms of meanings. In this description, the expressions "comprising" or "comprising" are intended to indicate certain features, numbers, steps, operations, elements, parts or combinations thereof, Should not be construed to preclude the presence or possibility of other features, numbers, steps, operations, elements, portions or combinations thereof.

1 shows a moving picture search system according to an exemplary embodiment.

1, the exemplary video retrieval system 100 includes a user client module 110, an analysis module 120, a database management module 130, and a video storage management module 140. Each module of the video search system 100 may be implemented in hardware. For example, such hardware may include a processor, a computer readable storage medium (e.g., volatile memory, nonvolatile memory and / or storage device) accessible by the processor, an input device (e.g., a pointing device such as a mouse, And / or an external computing device for providing an interface for an output device (e.g., a display device, a speaker and / or a printer, such as a monitor), an input device and an output device, Network interface. According to some embodiments, at least some of the user client module 110, analysis module 120, database management module 130 and video storage management module 140 may be included or implemented in different computing devices. According to some other embodiments, the user client module 110, analysis module 120, database management module 130, and video storage management module 140 may be included or implemented within a single computing device.

The user client module 110 is configured to receive input made by a user of the motion picture retrieval system 100. In particular, when the user wishes to define a search rule for enhanced video search, the user inputs an input specifying the elements of the search rule (e.g., the search conditions and the relationship between the search conditions) ). To this end, a user may perform various types of operations using an input device (e.g., clicking, hovering, and drag and drop operations using a pointing device such as a mouse, Such as writing a text using a key or pressing a key or a combination of two or more keys).

For example, the above search rule may be useful when the user wants to define the situation to be tracked, and objects, events and their relationships appear in scenes shot by several videos. Therefore, as described below, the moving image retrieval system 100 can provide a method of conveniently retrieving a moving image of such a complicated situation.

In addition, the user client module 110 is configured to generate a video search query indicating the above-described user-defined search rule. For example, the user client module 110 may generate a query having a specific format such as XML (eXtended Markup Language) using the search conditions specified by the user and the relationship between the search conditions. Further, the user client module 110 may provide the generated query to the analysis module 120.

In some embodiments, the user client module 110 may be configured to provide a user interface suitable for receiving user input. This user interface can be used to specify the elements of the search rule. In addition, the user client module 110 may represent elements of the search rule in a user interface. As an example, the user client module 110 may provide the user interface 300 shown in FIG.

The analysis module 120 is configured to obtain video-related data using the query generated by the user client module 110. [ In addition, the analysis module 120 is configured to analyze the acquired video-related data to generate an analysis result including information on the video matched with the query. In this regard, the moving image related data acquired by the analysis module 120 for analysis may be referred to as "analysis target data" hereinafter.

The database management module 130 stores data related to a plurality of moving pictures. In addition, the database management module 130 is configured to perform the retrieval of the stored data. Accordingly, as a specific example, the analysis module 120 may collect the analysis target data from the database management module 130 as follows.

The analysis module 120 may request the database management module 130 to search for the analysis target data using the query received from the user client module 110. [ According to some embodiments, the analysis module 120 may extract a specific condition (e.g., a specific search condition of a search rule indicated by the query) from a query, and perform a search on the analysis target data that satisfies the condition, Module 130 as described above. To this end, the analysis module 120 parses the query to extract certain conditions for such retrieval, and provides a format (e.g., SQL (Structured Query Language) type suitable for querying the database management module 130 Similar types).

For the requested search, the database management module 130 may identify data relating to some moving pictures in the data stored in the database management module 130. This identification may be based on a particular condition extracted by the analysis module 120 (e.g., a particular time period during which moving images were taken). In addition, the database management module 130 may provide the identified data to the analysis module 120 as analysis target data.

In some embodiments, in order for the database management module 130 to efficiently manage a large number of moving-image-related data and to provide search results quickly, the database management module 130 is provided with metadata, Lt; / RTI > For example, the metadata of each video may include various types of items that provide information related to the video. Typical examples of metadata for a video include items representing certain feature parts (e.g., objects, events, etc.) extractable from the video and other various aspects of the video (e.g., means for generating the video, Creation time and date, and the like). When the analysis module 120 parses a query to extract a specific condition and requests the database management module 130 to analyze the data that satisfies the condition, the database management module 130 determines whether the condition (Hereinafter also referred to as "metadata clusters") of metadata to the analysis module 120. Accordingly, the database management module 130 can construct a database required for moving image search using a much smaller amount of moving image related data, and can provide analysis target data to the analysis module 120 more quickly.

As described above, when the analysis module 120 acquires analysis target data from the database management module 130, the analysis module 120 can analyze the analysis target data using a query. Through this analysis, the analysis module 120 can identify the video-related data satisfying the search rule indicated by the query from the analysis target data. The analysis module 120 may then generate analysis results using the identified video-related data. In this way, the analysis result generated by the analysis module 120 can be further refined than the search result from the database management module 130.

In some embodiments, the result of the analysis may include information about the video that matches the query (e.g., information about which video source (e.g., camera) the video was taken from, the situation depicted as a search rule in the video, (E.g., thumbnail still images and / or thumbnail videos) that can be extracted from the video and / or the video at a time and the situation where the situation disappeared. Thus, such information may be useful for the analysis module 120 to obtain a video (e.g., from the video storage management module 140) that matches the query. For example, when a metadata cluster is transmitted from the database management module 130 to the analysis module 120, the analysis module 120 can identify the metadata of the video matched to the query from the metadata cluster, The above information available for acquiring the moving picture can be derived based on the identified metadata.

According to some embodiments, analysis module 120 may analyze data to be analyzed utilizing a Complex Event Processing (CEP) engine, which is suitable for reasoning more complex situations by combining data that can be derived from multiple video sources.

Further, the analysis module 120 may provide the generated analysis result to the user client module 110. [ The user client module 110 may request the moving image storage management module 140 for a moving image matched with the query using the received analysis result. The moving picture storage management module 140 stores moving pictures captured by one or a plurality of moving picture sources (e.g., at least one camera used in a CCTV system). In response to a request from the user client module 110, the moving image storage management module 140 may search the stored moving images and transmit the requested moving image to the user client module 110.

The video search system 100 may be deployed in various operating environments. A typical technician can tailor the implementation of the moving picture search system in consideration of the actual environment in which the moving picture search system 100 is placed. 2 to 4, a more detailed example of how the moving picture retrieval system 100 operates in an exemplary operating environment will be described below.

2 is a diagram for explaining an operating environment in which a moving image search system is applied according to an exemplary embodiment.

2, the exemplary operating environment 200 includes two CCTV cameras 230 and 235 installed around the crosswalk 220 on the road 210. As shown in FIG. On the surface of the road 210 is marked a center line 215 that separates lanes for two-way driving on opposite roads 210. The signal lamp 255 installed near the camera 230 is a traffic signal (for example, a red signal, a yellow signal) that can be seen by a driver of a vehicle (e.g., a vehicle 260) traveling on a lane for driving in the left- Or a green signal). Likewise, a traffic light 250 installed near the camera 235 may transmit a traffic signal (e.g., a red signal, a traffic signal, etc.) that a driver of a vehicle (e.g., vehicle 265) traveling on a lane for driving in the right- A yellow signal or a green signal). For convenience of explanation, when the traffic lights 250 and 255 are operating normally, it is assumed that the traffic lights 250 and 255 simultaneously display the same traffic signal.

 Cameras 230 and 235 are configured to capture scene 240 and scene 250, respectively. Although not shown in FIG. 2, the cameras 230 and 235 are communicably coupled to the motion picture retrieval system 100 of FIG. Accordingly, the moving images captured by the cameras 230 and 235 can be stored in the moving image storage management module 140. [ In addition, various information related to the moving images can be stored in the database management module 130 as metadata.

The scene 240 captured by the camera 230 includes a traffic light 250. Likewise, the scene 245 captured by the camera 235 includes a traffic light 255. A vehicle 260 traveling to the left along road 210 in FIG. 2 may appear in scene 240. Likewise, a vehicle 265 traveling to the right along road 210 in FIG. 2 may appear in scene 245. Thus, an event may be detected in which the object (e.g., vehicle 260) entering the scene 240 from the moving image captured by the camera 230 or the traffic light 250 displaying the red signal. Likewise, an event may be detected in which the object (e.g., vehicle 265) entering the scene 240 from the moving image captured by the camera 235 or the traffic light 255 displaying a red signal. Further, an event through which an object (e.g., a vehicle) passes through the crosswalk 220 may be detected from at least one of the above moving images.

In this operating environment 200, the moving picture search system 100 may provide a user with a moving picture of a vehicle in violation of a traffic signal as follows.

For example, the user client module 110 of the video retrieval system 100 may visually expose the user interface 300 shown in FIG. The user interface 300 is a window type graphical user interface that supports a motion picture retrieval mechanism according to the exemplary embodiment. 3, the user interface 300 includes a palette area 310, a property area 330, and a drawing area 350. Palette area 310 may include interface elements 320-1 through 320-4. Attribute area 330 may include interface elements 340-1 through 340-n. The drawing area 350 may provide a visual representation of the search rule. Further, the user interface 300 may include one or more taps (e.g., taps 360 and 365). The search rule represented in the drawing region 350 when the user selects the tab 360 may be different from the search rule represented in the drawing region 350 when the user selects the tab 365. [

In order to define a search rule in the form of a workflow in accordance with the representation 400 shown in FIG. 4, the user may take the following actions using the user interface 300.

The user may click on the interface element 320-1 of the palette area 310 with a mouse. In response to this operation, the user client module 110 may display in the palette area 310 an interface element for selection of the camera 230 and an interface element for selection of the camera 235. [ When the user drags an interface element for selection of the camera 230 and drops it into the drawing area 350, the user client module 110 sends the graphic representation 410 of FIG. 4 to the drawing area 350). The user client module 110 may display the graphical representation 420 of Figure 4 in the drawing area 350 if the user drags an interface element for selection of the camera 235 and drops it in the drawing area 350 have.

The user may click on the interface element 320-2 of the palette area 310 with a mouse. In response to this operation, the user client module 110 may display an interface element for selection of an event filter and an interface element for selection of an object filter in the palette area 310. When the user performs an operation of dragging an interface element for selection of an event filter to the drawing area 350 twice, the user client module 110 sends the graphic representations 430 and 440 of FIG. 4 to the drawing area 350). When the user performs an operation of dragging an interface element for selection of an object filter to drop in the drawing area 350, the user client module 110 sends the graphic representation 450 of FIG. 4 to the drawing area 350. [ Lt; RTI ID = 0.0 > 350 < / RTI >

The user can click on the interface element 320-3 of the palette area 310 with a mouse. In response to this operation, the user client module 110 may display various interface elements in the palette area 310. [ Each interface element is an interface element for a different one of a variety of logical relationships (e.g., AND relationships, OR relationships, and other logical relationships). For example, if a user drags and drops an interface element for the selection of an AND relationship into the drawing area 350, the user client module 110 displays the graphical representation 460 of FIG. 4 in the drawing area 350 can do.

The user can click on the interface element 320-4 of the palette area 310 with a mouse. In response to this operation, the user client module 110 may display various interface elements in the palette area 310. [ Each interface element is an interface element for a different one of a variety of connection relationships (e.g., one-to-one connection relationships, one-to-many connection relationships, connection relationships that specify end points of a workflow representing search rules, etc.). For example, if the user repeats the operation of dragging an interface element for selection of a one-to-one relationship to an appropriate position in the drawing area 350 five times, the user client module 110 may display the graphical representations 470-1 470-5 may display graphical representations 470-1 through 470-5 in the drawing area 350 in the same manner as shown in FIG. Also, if a user drags an interface element for selection of a connection relationship that specifies an endpoint and places it at the location of the right edge of the graphical representation 460 displayed in the drawing area 350, 4 can be displayed in the drawing area 350 with the graphic representation 470-6 of FIG.

The user may click on each of the graphical representations 410, 420, 430, 440 and 450 displayed in the drawing area 350. [ In response to this operation, the user client module 110 may display one of the interface elements 340-1 through 340-n of the attribute area 330 as an interface element for setting an attribute of the element represented by the graphical representation Can be activated. For example, if a user wishes to specify a particular time period as a search condition for a moving image captured by each of cameras 230 and 235, the user clicks on graphic representations 410 and 420, respectively, Can be input. In addition, if the user wishes to specify that an object passes through the crosswalk 220 with respect to moving images captured by the camera 230 and that the object is a vehicle, the user may select a graphical representation 430 Click to enter the passage of the crosswalk 220 as a desired event, and click on the graphical representation 450 to enter the vehicle as the desired object. Further, when the user wishes to designate the red signal of the traffic light 255 as a search condition for the moving image captured by the camera 235, the user clicks on the graphical representation 440 and the traffic light 255 displays the red signal As an event desired to be performed. In response to these operations, the user client module 110 may display graphical representations 415, 425, 435, 445, and 455 in the drawing area 350.

- After the search rule is modeled in the form of a workflow, the drawing area 350 is finally displayed with the expression 400 of the search rule shown in FIG. The completed search rule may be stored in the user client module 110.

The user client module 110 may generate an XML type query by combining the search conditions indicated by the completed search rule according to the relationship between the search conditions. In this regard, as shown in FIG. 3, the user interface 300 may include taps 370 and 375. When the tab 370 is selected, the drawing area 350 displays the graphical representations shown in FIG. 4 as described above. If the tab 375 is selected, the XML type query can be displayed in the text format in the drawing area 350, and the user can directly edit the query.

The user client module 110 may provide the generated query to the analysis module 120. The analysis module 120 may parse the query to extract a specified time period for the videos captured by the cameras 230 and 235. [ The analysis module 120 may request the database management module 130 to search the metadata on condition of the time period. After performing such a search, the database management module 130 may provide the metadata cluster to the analysis module 120.

In some embodiments, analysis module 120 may analyze metadata in a received metadata cluster sequentially. For example, metadata corresponding to the same sub-section of the above time period may be sequentially provided to the analysis module 120. The analysis module 120 may then analyze the received metadata. The analysis module 120 may repeat these operations until all of the meta data within the time period has been analyzed. In some other embodiments, analysis module 120 may process the analysis of such metadata in parallel for sub-intervals.

When the analysis of the metadata is completed, the analysis module 120 can generate the analysis result and display the analysis result on the user interface 300. [ Such an analysis result may include information (e.g., a thumbnail image of the video) available to acquire at least one video that matches the query. Accordingly, when the user selects an item (for example, a thumbnail image) of the analysis result displayed in the user interface 300, the user client module 110 acquires the video represented by the item from the video storage management module 140 can do. The user client module 110 can display the moving picture in the user interface 300 and visually express the metadata of the moving picture in the user interface 300. [

According to some embodiments, the user client module 110 may display additional interface elements in the user interface 300 (e.g., as needed). This additional interface element is available for selecting a specific processing function (e.g., a function of recognizing a license plate of a vehicle detectable in a moving picture) for a moving picture matched to a query. The user client module 110 may display additional graphical representations between the graphical representation 460 and the graphical representation 470. For example, if a user drags the interface element and drops it into the drawing area 350, can do. The above functions may be provided by the analysis module 120. [ The analysis module 120 may perform such a function using a sub-module (e.g., to recognize a license plate of a vehicle) after identifying the metadata that satisfies the search rule represented by the query.

FIG. 5 shows a moving image search process according to an exemplary embodiment. Each of the operations included in the exemplary process 500 may be performed by the user client module 110, the analysis module 120, the database management module 130, or the moving image storage management module 140 of the moving image search system 100 .

After the start operation, the process 500 proceeds to operation S505. In operation S505, the user client module 110 receives a user input specifying a search rule including search conditions for a moving image search and a relationship between the search conditions. To this end, the user client module 110 may provide a user interface 300 available for specifying such a search rule.

In operation S510, the user client module 110 generates a query using a search rule. For example, the generated query can have an XML format. The user client module 110 may then be provided to the analysis module 120. In addition, the user client module 110 may express the generated query in the user interface 300. [

In operation S515, the analysis module 120 requests the database management module 130 to search for video-related data using the query. To this end, the analysis module 120 may convert the query into a format for querying (e.g., SQL format) to the database management module 130, and then extract a specific search condition from the query. Then, the analysis module 120 may request the database management module 130 to search for video-related data satisfying the extracted search condition. As will be discussed below, the extracted search conditions may be used by the database management module 130 to perform searches for video-related data.

In operation S520, the database management module 130 provides the analysis module 120 with video-related data that satisfies a specific search condition. Accordingly, the analysis module 120 can obtain the video-related data from the database management module 130 using the query. In some embodiments, the acquired motion picture related data may include metadata of at least one motion picture. In particular, such metadata may include metadata of at least one of an object and an event extractable from the video.

In operation S525, the analysis module 120 analyzes the obtained moving image related data to generate an analysis result including information on moving images matched with the query. For this analysis, analysis module 120 may use a CEP engine. Examples of information on the matched moving image include identification information of the moving image source in which the moving image is photographed, information on a specific time period in which the user wants the situation to be photographed, and / or a thumbnail image of the moving image).

In operation S530, the analysis module 120 provides the generated analysis result to the user client module 110. [ The user client module 110 may express the received analysis result in the user interface 300.

In operation S535, the user client module 110 requests the moving picture storage management module 140 for a moving picture matched with the query.

In operation S540, the moving image storage management module 140 searches for moving images stored in the moving image storage management module 140 and provides the requested moving image to the user client module 110. [

On the other hand, certain embodiments may include a computer-readable storage medium including a program for performing the procedures described herein on a computer. Such computer-readable storage media may include program instructions, local data files, local data structures, etc., alone or in combination. The computer-readable storage medium may be those specially designed and constructed for the present invention. Examples of computer-readable storage media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floppy disks, and ROMs, And hardware devices specifically configured to store and execute the same program instructions. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. According to another embodiment, a computer program for performing the processes described herein may be provided. Such a program may be stored on a medium such as a computer-readable storage medium in combination with hardware to perform the above process.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, . Therefore, the scope of the present invention should not be limited to the above-described embodiments, but should be determined by equivalents to the appended claims, as well as the appended claims.

100: Video search system
110: User Client Module
120: Analysis module
130: Database Management Module
140: Video Storage Management Module

Claims (21)

A user client module for receiving a user input designating a relationship between a plurality of search conditions and a plurality of search conditions for moving image search and generating a query using the plurality of search conditions and the relationship; And
And an analysis module for acquiring moving picture related data using the query and analyzing the moving picture related data to provide information on a moving picture matched with the query to the user client module
Video search system. The method according to claim 1,
Wherein the moving picture related data includes metadata of a plurality of moving pictures. The method of claim 2,
Wherein the metadata includes at least one of an object and an event extractable from the plurality of videos. The method according to claim 1,
Wherein the analysis module also obtains the moving picture related data from the database management module using the query. The method of claim 4,
Wherein the analysis module also transforms the query into a format for querying the database management module. The method according to claim 1,
Wherein the analysis module further parses the query to extract a specific search condition, the video related data satisfying the specific search condition. The method according to claim 1,
Wherein the analysis module also uses a CEP (Complex Event Processing) engine to analyze the moving picture related data. The method according to claim 1,
Wherein the user client module also provides a user interface for receiving the user input. The method of claim 8,
Wherein the user client module also represents the plurality of search conditions and the relationship in the user interface. The method according to claim 1,
Wherein the user client module also obtains the matching video using the information. The method comprising: receiving a user input specifying a plurality of search conditions for moving image search and a relationship between the plurality of search conditions;
Generating a query using the plurality of search conditions and the relationship;
Acquiring moving picture related data using the query; And
Analyzing the moving picture related data and providing information on the moving picture matched with the query to the user client module
How to search for videos. The method of claim 11,
Wherein the moving picture related data includes metadata of a plurality of moving pictures. The method of claim 12,
Wherein the metadata includes metadata of at least one of an object and an event extractable from the plurality of moving pictures. The method of claim 11,
Further comprising the step of acquiring the moving picture related data from the database management module using the query. 15. The method of claim 14,
Further comprising the step of converting the query into a format for querying the database management module. The method of claim 11,
Further comprising parsing the query to extract a specific search condition, wherein the video related data satisfies the specific search condition. The method of claim 11,
Further comprising using a Complex Event Processing (CEP) engine to analyze the moving picture related data. The method of claim 11,
Further comprising providing a user interface for receiving the user input. 19. The method of claim 18,
And presenting the plurality of search conditions and the relationship to the user interface. The method of claim 11,
Further comprising the step of acquiring the matching video using the information. A computer program stored on a medium for execution in accordance with any one of claims 11 to 20 in combination with hardware.

Images