KR101391370B1 - System for multi-transmitting images by using an image collection and distribution server and the method thereof - Google Patents

Abstract

The present invention relates to a system for multi-transmitting images by using an image collection and distribution server and a method thereof and, more specifically, to a system for multi-transmitting images by using an image collection and distribution server and a method thereof which: stores images and metadata of a recording site by recording and generating based on a standard (or base) reference model set in accordance with characteristics of each recording site; and transmits the image information and metadata to an image collection and distribution server by using transmission methods including a real-time transmission method, a non-real time transmission method, or a combination thereof, wherein the image collection and distribution server can group the image information received from at least one image recording device for each theme and provide the same to a user.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a system and an image multiplex transmission system using an image acquisition and distribution server,

The present invention relates to an image multiplexing transmission system and method using an image gathering and distribution server, and more particularly to a system and method for multiplexing image information by recording and collecting image information, And the collected metadata are provided to the user through the image distribution server, so that the user can grasp the situation on the corresponding recording site by using only the metadata, and in addition, The present invention relates to a system and method for efficiently searching for a desired image and receiving the desired image.

Conventionally, most of the techniques for storing image information are simply photographing the image information with a camera and storing the image information as it is. In addition, most of the cases of storing and retrieving image information are stored by indexing by time, place, and device, and referring to them. In order to store all of the images recorded on the camera at the recording site, a large-capacity storage medium (i.e., a database) is required. In order to process a large amount of image information, the size of the server must be increased (high speed and large capacity) There were disadvantages.

In addition, the conventional video information recording and retrieving method as described above requires a long time for the user to retrieve the desired video information, and there is no way for the user to search the theme or group the video according to the user's desire, The user had to manually search and edit the image information. Thus, the conventional image acquisition and transmission system is inconvenient for the user to utilize the image information effectively.

Conventionally, there is no reference model that serves as a reference for the recording site of the video information. Every time a person prepares a recording program suitable for the site to perform monitoring, searching, reproducing, or a combination thereof, The user has to observe the image directly and to perform monitoring, searching, reproducing, or a combination thereof depending on the user's feeling.

Accordingly, the metadata is generated according to a predetermined reference reference model, not the human senses, and is collected together with the image information, and the image information is classified and grouped based on the metadata. The user can monitor, A reproduction system, or a combination thereof. In this case, the generated metadata should include information such as time, place, subject, object, reason, means, etc. so that the user can know about what event occurred on the corresponding recording site without directly checking the image.

The following describes briefly the prior art which exists in the technical field of the present invention, and then describes a technical matter that the present invention intends to differentiate from the prior art.

Korean Patent Registration No. 0831531 (May 05, 2008) discloses a recording apparatus, a recording method, a recording medium, a summary playback apparatus, a summary playback method, a multimedia summary system, and a multimedia summary method. The present invention relates to a system and a method for summarizing multimedia including stored video, audio, and text, storing interval importance analysis information of multimedia as metadata, and reproducing multimedia according to importance levels.

Korean Patent Registration No. 1248305 (Mar. 23, 2013) is an information recording medium on which a title, which is an AV content composed of partial sections or partial sections of a digital stream, is recorded, A position of a partial section in a digital stream, a play list having information specifying a title by designating a reproduction order, a program for controlling reproduction of a title by calling a play list, an information recording medium in which TopMenu, Index and Extension are recorded .

Korean Unexamined Patent Application Publication No. 2012-0055439 (May 31, 2012) discloses a method and a system for providing and receiving a service provided from a plurality of content providers, and a system and an apparatus using the method. Receiving a metadata feed associated with at least one service, transforming the received metadata into metadata in an XML format, and providing the converted XML format metadata to the client, And a method thereof.

In the prior art documents, metadata is generated according to a specific content of image information in storing or providing image information, and a user can grasp a part of the content of the image information through the generated metadata. According to the present invention, meta data according to a specific situation is generated based on a reference model matching the characteristics of each video recording site and collected together with video information as in the present invention, and when the service is provided to a user, There is no description of a technology for enhancing the data transmission efficiency by providing data and coded data, and for receiving video information by specific categories by searching video information based on the metadata, And effectiveness.

According to the present invention, metadata of a corresponding image information is generated based on a reference reference model matching the characteristics of a video recording site and is stored together with image information, so that a plurality of users A new image acquisition and distribution system and a new image acquisition and distribution system capable of providing information services specialized for each image recording site by allowing image information to be retrieved and to grasp the contents of the image and transmitting image information to a large number of users through an image distribution server .

The present invention is created to solve the above-described problems. In recording and collecting image information through a camera at a specific site, metadata according to the image information is generated, together with image information, and provided to a user And an image multiplexing transmission system using the image collecting and distributing server that enables a user to monitor, search, reproduce, or a combination of image information more efficiently.

In the present invention, in generating the meta data, a standardized reference model corresponding to the characteristics of each recording site is generated and based on the reference model, a time, place, subject, object, reason And means for generating a metadata including the above information and providing the metadata to the user so that the user can grasp the situation occurring in the corresponding recording site even if the user does not directly play the video information. Transmission system and method therefor.

In addition, in collecting image information and meta data, the present invention can adjust the amount of image information to be collected according to a service level of a user, and supplementing the part of image information not collected with metadata, And an image multiplex transmission system using the image collection and distribution server that can prevent a traffic congestion due to collection and an overload of a server and can efficiently manage a database.

In order to increase the efficiency of the video multiplex transmission system of the present invention, the video information and the metadata are divided into essential information and background information, and essential information is treated as real time information and collected in real time. And an image multiplexing transmission system using the image gathering and distribution server capable of collecting the traffic after checking the traffic with a server in a short period of time or handling the traffic in real time.

In addition, the present invention can expand the imaging and storage structure by connecting the camera and image information recording device in a cascading structure based on the image distribution server in collecting and transmitting image information and metadata And an image multiplexing transmission system using the image gathering and distribution server capable of transmitting image information and metadata to a plurality of users at the same time, and a method thereof.

An image multiplexing transmission system according to an embodiment of the present invention includes at least one image recording apparatus for receiving image information from at least one camera and recording the image information; And a video collection and distribution server, wherein the video recording apparatus captures video information of a video recording site based on a reference model set according to characteristics of each video recording site, And transmitting the at least one of the image information, the metadata, or a combination thereof to the image collection and distribution server through a transmission method according to a user's setting including a real time transmission method, a non-real time transmission method, And the image collection and distribution server transmits the image information, the metadata, or a combination thereof received from at least one of the image recording apparatuses to a dynamic model according to a user's request, a reference model set according to the characteristics of the recording site, As shown in FIG.

The video recording apparatus may further include: a reference model and a region of interest setting unit; A metadata generating unit; Storage interface; Communication interface; User interface; Camera interface; And a control unit.

The image collection and distribution server may include an interface unit including a user interface, a communication interface, and a camera interface; A user authentication management unit for managing user private information and security information; An information collecting unit for collecting image information and meta data; And a service providing unit for providing image information and metadata to the user.

In addition, the camera interface supports a control interface such that the optical axis and the irradiation axis can be adjusted through pan, tilt, zoom, focus, rotation, or a combination thereof according to the structure of the recording site, the reference model, .

The reference model is characterized by being a data structure composed of information including a recording site name, a recording site location, a recording time, a main purpose of recording, a recording object, a recording method, an environment, a situation information or a combination thereof .

In addition, the metadata may be configured according to time, place, subject, object, reason, means, or a combination thereof so that the user can grasp the contents of the image information using only metadata.

In addition, the image recording apparatus may further include image information shot by a camera, background information; And essential information which is a region in which a motion is captured or a region of interest set manually or automatically. The background information is transmitted in non-real time and the essential information is transmitted in real time to a user or an image collection and distribution server.

The image collection and distribution server collects image information, metadata, or a combination thereof from at least one image recording apparatus of at least one recording site, and the image collection and distribution server collects image information, The connection structure is characterized by being a structure including a star-shaped structure, a cascading structure, or a combination thereof.

According to still another aspect of the present invention, there is provided a method for multiplexing video images, the method comprising: transmitting at least one video recording site to at least one video recording apparatus based on a reference model set according to characteristics of each video recording site, ; Generating and storing metadata from the image information together with the photographed image information; Transmitting at least one of the image information, metadata, or a combination thereof to the image collection and distribution server in a transmission format according to a user's setting including a real time transmission method, a non-real time transmission method, or a combination thereof; And dynamically arranging the image information, the metadata, or a combination thereof received from at least one image recording apparatus in the image collection and distribution server according to a user's request, a reference model set according to characteristics of a recording site, The method comprising the steps of:

The step of photographing the image information may further include setting a region of interest through at least one of motion capture, feature point extraction of image information, a preset region, or a combination thereof, And an image of a recording site is photographed and stored based on a combination of a region, a region, or a combination thereof. The photographing of the image information may be performed by a panning, tilting, zooming, focusing, Through the camera control interface so that the optical axis and the irradiation axis can be adjusted through a combination of the camera control interface and the camera control interface.

The generating and storing of the metadata may include generating metadata of the photographed image information based on the reference model, the region of interest, or a combination thereof, and dynamically providing the metadata to the user, Grouping, or a combination thereof to provide the image information to an individual user or a plurality of user groups based on a user, a model, metadata, or a combination thereof.

The reference model is characterized by being a data structure composed of information including a recording site name, a recording site location, a recording time, a main purpose of recording, a recording object, a recording method, an environment, a situation information or a combination thereof .

In addition, the metadata may be configured according to time, place, subject, object, reason, means, or a combination thereof so that the user can grasp the contents of the image information using only metadata.

In addition, the image recording apparatus may further include image information shot by a camera, background information; And essential information which is a region in which a motion is captured or a region of interest set manually or automatically. The background information is transmitted in non-real time and the essential information is transmitted in real time to a user or an image collection and distribution server.

The image collection and distribution server collects image information, metadata, or a combination thereof from at least one image recording apparatus of at least one recording site, and the image collection and distribution server collects image information, The connection structure is characterized by being a structure including a star-shaped structure, a cascading structure, or a combination thereof.

The present invention relates to an image multiplexing transmission system and method using an image collecting and distributing server, which records image information through a camera at a specific site, generates metadata according to the image information, collects the metadata together with image information, A standardized reference model corresponding to the characteristics of each recording site is generated and metadata is generated based on the reference model so that the user can grasp the situation occurring in the corresponding recording site even if the user does not directly play the video information , The video information and the metadata are divided into essential information and background information, the essential information is treated as real time information and collected in real time, the background information is treated as non-real time information, and the traffic with the server is checked After collection, excessive video It is possible to prevent traffic congestion and server overload due to beam collection, to efficiently manage the database, and to connect the configuration of the camera and image information recording device with the cascade based on the image distribution server, It is possible to extend the storage structure and transmit image information and metadata to a plurality of users at the same time.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram for explaining a structure of an image multiplexing transmission system using an image collecting and distributing server according to an embodiment of the present invention; FIG.
BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a video recording apparatus,
FIG. 3 is an exemplary view for explaining a structure of an image collection and distribution server according to an embodiment of the present invention; FIG.
FIG. 4 is an exemplary diagram for explaining metadata generated based on a reference model according to an embodiment of the present invention; FIG.
5 is a diagram illustrating an image capturing and transmission according to a region of interest of a recording site according to an embodiment of the present invention;
6 is an exemplary diagram for explaining an expandable structure of an image multiplex transmission system using an image acquisition and distribution server according to an embodiment of the present invention;
FIG. 7 is a flowchart illustrating an image multiplexing method using an image collecting and distributing server according to an embodiment of the present invention; FIG.

Hereinafter, an embodiment of an image multiplexing transmission system using an image collecting and distributing server according to the present invention will be described with reference to the accompanying drawings.

1 is a diagram for explaining a structure of a video multiplexing transmission system using an image collecting and distributing server according to an embodiment of the present invention.

1, the image multiplexing transmission system using the image gathering and distributing server 200 of the present invention may include image information collected from a plurality of recording sites through the image recording apparatus 100 or the camera 50, Unlike a conventional video transmission system, a reference model corresponding to the characteristics of each recording site is generated and a user searches for recorded video information based on the generated reference model, It is a system that generates metadata including information that can roughly grasp a situation occurring in the corresponding recording site and provides metadata to the users along with image information. In addition, the system of the present invention not only stores video information transmitted from a camera but also groups video information on the basis of generated metadata to record time, place, theme (weather, accident, place type, event information, etc.) And can dynamically transmit video information grouped by the theme (theme) to the user. The image information to be provided to the user is basically a photographed image, but when providing only the metadata to the user preferentially, it is possible to provide the image information generated based on the meta data instead of the actual image through the GUI (Graphic User Interface) have.

More specifically, the image multiplexing transmission system using the image collecting and distributing server 200 according to the present invention generates various reference models according to characteristics of a recording site, captures images in a form suitable for a reference model, can do. For example, focusing on the situation information of public goods such as a recording site, a terminal, an airport, a bus stop, etc., in which a recording site is photographed focusing on specific object information such as a classroom, a church, A video recording site, a video recording site, a recording site, a bank, a museum, or the like, and photographs the video in a form suitable for the classified video recording site and generates metadata .

In addition, the present invention divides the image information and meta data captured by the image recording apparatus 100 into real time information, which is essential information, and non-real time information, which is background information, and the essential information is transmitted to the image collection and distribution server 200 in real time The background information may be transmitted only when only a small amount of data is stored in the image recording apparatus 100, and the system is efficiently used when the traffic conditions are good or at a predetermined time. Can be operated.

In addition to collecting real-time information and non-real-time information as described above, the system of the present invention may increase the efficiency of system operation by using a method of adjusting the amount of image information to be collected according to the service utilization level of the user . In addition, besides transferring and storing in the server, the image information transmitted from the camera 50 may be bypassed from the server according to the setting of the server and transmitted to the user in real time. For example, if the video recording apparatus 100 installed at the recording site captures an image of 30 frames per second, if the service utilization level of the user is low, only the image of one frame per second or one minute per minute is transmitted to the image collection and distribution server 200 And transmits all the real-time images of 30 frames per second to the image collection and distribution server 200 or the user when the user's service utilization level is high. Meanwhile, according to the quality of the collected image information (for example, the number of images collected per hour, image resolution, etc.), the user may not be able to fully grasp the situation occurring at the corresponding recording site by only the image information. For this purpose, generates meta data according to image information photographed at the recording site and provides the meta data to the user so that the user can grasp the situation occurring at the recording site sufficiently even if the quality of the image information is low. That is, even if the video information is transmitted intermittently, if the metadata and the rule (rule) in which the metadata are generated are known, the video information and the metadata that are intermittently transmitted, (Through sacrifice of naturalness) than the image transmitted to the user terminal.

 As described above, since the amount of data to be collected varies according to the service utilization level of the user, the image collection and distribution server 200 of the present invention can increase the capacity of the database used in comparison with the conventional image information providing system, The traffic overload problem in the process of transmitting the image information can be solved, and the amount of data processed by the server can be reduced, so that the system can be efficiently operated.

2 is a diagram illustrating an example of a structure of a video recording apparatus according to an embodiment of the present invention.

2, the video recording apparatus 100 of the present invention includes a reference model and an ROI setting unit 110, a camera interface 120, a metadata generating unit 130, a storage interface 140, An interface 150, a user interface 160, and a controller 170.

The reference model and ROI setting unit 110 sets a reference model that matches the characteristics of the site in which the video recording apparatus 100 is installed and sets a ROI (Region Of Interest) Or may be set on the spot when the video recording apparatus 100 is installed in the corresponding recording site or may be set on the user interface 160 or the communication interface 150 through the server after the video recording apparatus 100 is installed. And may be connected to the image recording apparatus to be set and modified. Alternatively, the ROI is not determined by the user's setting, but an ROI that matches the characteristics of each recording site may be automatically set based on the set reference model. In addition, the ROI can automatically or manually set a plurality of ROIs according to the number of moving objects, and can also move according to the ROI set according to the movement of the object, so that the movement of the object can be detected based on the movement of the ROI. By detecting such an ROI, an object or ROI is generated on a recording screen, disappears after a certain time, and a new ROI is generated each time.

The camera interface 120 interfaces with a camera that captures an image of a recording site based on a reference model, and the camera includes an analog camera, a digital camera, or a combination thereof. The camera interface 120 will mainly be configured to interface with a digital camera, which converts an image into an electrical signal in a sensor using any charge coupled device (e.g., CCD or CMOS) Output in data format. In addition, the camera interface 120 may control zooming, focusing, pan / tilt, and other control functions so that the camera can be rotated or zoomed in accordance with the position and direction of an object recorded in the camera, Interface. That is, the camera interface 120 can control the optical axis and the irradiation axis through pan, tilt, zoom, focus, rotation, or a combination thereof according to the structure of the recording site, the reference model, Support. In addition, one video recording apparatus 100 may include a plurality of cameras, and each camera interface 120 may be connected to the video recording apparatus 100 via wired or wireless, at least one So that it can interface with the above cameras.

The metadata generation unit 130 generates metadata based on the reference model and the reference model set in the ROI setting unit 110. The metadata may be summary information about the image information to be recorded, and may include text information, encoded code information, image information, or a combination thereof. The description of the metadata will be described in more detail below.

The storage interface 140 interfaces with the storage unit, which is input through the camera interface 120 and stores the image information photographed by the camera and the metadata generated by the metadata generation unit 130, The storage unit is typically a built-in memory or an external memory as a local storage unit, but the present invention further includes a virtualized storage device (briefly referred to as a cloud storage device) of a cloud computing network in the network for backup of image data can do. In addition, mobile terminals (eg smart phones, smart pads, notebook computers), e-mails, and social networks (eg Facebook, KakaoTalk, mobile messenger) that can send and receive multimedia messages have. In case of the local memory, since the amount of image information to be stored is limited due to the characteristics of the image recording apparatus 100 that continuously records and stores images, the image information is stored only for a predetermined time like the memory of the black box, The information may be in the form of an endless recording in which the oldest image information is pushed out and stored.

The communication interface 150 provides an interface for bidirectional communication with the camera or the image collection and distribution server 200. The communication method uses wireless, wired, or a combination thereof. The wireless scheme includes a short-range wireless scheme, a long-distance wireless scheme, or a combination thereof. For example, the short-range wireless scheme includes at least a Bluetooth, NFC, or infrared communication scheme, and the long-distance wireless scheme includes a mobile communication scheme such as 3G, 4G, LTE, or WiBro or a wireless Internet communication scheme such as WiFi do. It is, of course, possible to further apply other wireless communication capable of transmitting big data. It should be understood that a clear distinction between distance and nearness is not significant and should not be affected by the scope of the claim claimed in the claims of the present invention due to its distinction.

The control unit 170 controls the operation of the video recording apparatus 100. Basically, the controller 170 stores the video information recorded in the camera and the metadata generated in the metadata generating unit 130 in a storage unit, To the collection and distribution server (200). The control unit 170 controls the operation function of the camera so that the image information can be recorded according to the reference model or the site of the video recording site and transmits the image information to the metadata generating unit 130, And stores and manages the photographed image information and meta data in a storage unit. In addition, the controller 170 controls transmission of image information and metadata stored in the storage unit to the image collection and distribution server 200. That is, if the user has a high level of service utilization, it transmits detailed image information and meta data, and if the service utilization level is low, transmits intermittent images and metadata. For reference, when the intermittent image and metadata are transmitted due to the low level of service utilization, the movement of the object in the image can be continued between the image and the image so that the image can be transmitted smoothly. In addition, the stored image information may be converted into a relatively small form such as an animation instead of a large image, and may be transmitted to the image collection and distribution server 200.

3 is an exemplary diagram illustrating a structure of an image collection and distribution server according to an embodiment of the present invention.

3, the image acquisition and distribution server 200 of the present invention includes an interface unit 210, a user authentication management unit 220, an information collection unit 230, a service provider 240, And a storage management unit 250, and is connected to the database 300. [

The interface unit 210 includes a user interface 211, a communication interface 212 and a camera interface 213. The user interface 211 allows a system administrator to perform settings and controls related to the system of the present invention Or provides the Internet homepage or related interface so that the user can utilize the service provided by the system of the present invention. The communication interface 212 may include communication interface means for collecting video information from a video recording apparatus installed at each recording site, communication interface means for collecting coded metadata according to the video information, And communication interface means for connecting to the video recording apparatus 100 and performing setting tasks including reference model setting and ROI setting. In addition, the user can install the app through the user interface 211 and receive the video service through the application. These apps are a more user-friendly means of getting images of a specific recording site to a specific user regardless of time or place. That is, the user can monitor or check the site of interest at a certain time or place. Thus, the user can receive video information for a specific site anytime anywhere in the world.

The user authentication management unit 220 includes user personal information and security related information among the image information and metadata providing services provided by the system of the present invention, so that strict user management is required for users to trust and use the system of the present invention. Bar, users are required to perform a user authentication procedure before subscribing to the system or using the service of the present invention, and managing the information and the list about the collected users through this procedure.

The information collecting unit 230 collects information including image information and metadata received from the image recording apparatus through the communication interface 212. The collected information is stored in the database 300. [ In this case, it is necessary to process the corresponding information before storing the information in the database in advance. Instead of simply storing the necessary information, this processing is performed by grouping the information according to time, place (site) The user can easily provide services according to the desired service time, place, and theme. The processing of information referred to herein refers to the finding of common information so that specific information can be interpreted and grouped and stored rather than generating new information from specific information. For example, when a user wants a comparative image for a specific subject (theme), he or she accesses all the image information having a keyword for the subject, matches the additional image information with additional search information, Through the service providing unit.

The service providing unit 240 includes an image information providing unit 241 and a metadata providing unit 242. The system of the present invention may provide the user with video information of a specific recording site through the video information providing unit 241 and separately provide the metadata from the metadata providing unit 242 separately. In this way, the user is provided with the metadata before receiving the image information, and if the user finds a specific situation on the metadata, the user can request the image information and confirm the image. This method is very efficient in server operation because it provides a large amount of image information continuously to a user and transmits image data of a small amount of data at a usual time, In the case of the user, since only the image information corresponding to the situation need to be checked after confirming only the situation requiring confirmation through the metadata, it is possible to save the time and manpower consumed by checking all the image information with the naked eye. That is, the service providing unit 240 dynamically provides information on the image information, metadata, or a combination thereof to the user according to the service or security level of the user.

The storage management unit 250 stores and manages information including video information, metadata, and user information provided from the communication interface 212 in the database 300.

In addition, the database 300 is a local storage unit for storing data related to the system operation of the present invention, and typically means an embedded memory or an external memory. However, in the present invention, And may further include a virtualized storage device of a cloud computing network. That is, the database 300 is a database connected to the image collection and distribution server 200 of the present invention through an electric or optical cable, a network including cloud computing, or a combination thereof.

In addition, the image collecting and distributing server 200 as well as the database 300 are implemented in a cloud computing server environment, so that there is no need for a service provider to construct a separate server by hardware, Can be provided as a kind of service type (e.g., software as a service (SaaS)) so that users can select and provide services required for their own needs.

2 and 3, the respective components constituting the image recording apparatus 100 and the image collecting and distributing server 200 according to the present invention are described only for convenience of explanation, May be configured to process all the operations in any one of the constituent means, and may be configured to be further subdivided into various constituent means or a combination of the constituent means. In addition, the configuration means generally used for providing a service to a user using a server are not necessarily necessary for explaining the present invention, and thus will be omitted.

4 is an exemplary diagram for explaining metadata generated based on a reference model according to an embodiment of the present invention.

As shown in FIG. 4, the metadata 500 of the present invention is generated based on a reference model 400 according to each recording site. The reference model 400 includes a recording site name, a recording site location, a recording time A data structure composed of information including at least one object image or a combination of them, a main purpose of recording, a recording object, a recording method, an ambient environment, situation information (environment (brightness, temperature, . According to such a configuration, the reference model 400 can be generated in the form of a data structure differentiated for each recording site. Therefore, the reference model is a data structure that can be commonly defined for the same or similar recording sites. When the image collection and distribution server stores the information by the reference model and serves it to a specific user, It is possible to display the monitoring screen of the corresponding recording site on the terminal. That is, the information transmitted to the user through the data structure of the reference model can be converted into a graphical output through an application of the user terminal, so that the user can receive a monitoring service for the desired site. Such a service can be dynamically transmitted to a plurality of users at the same time and dynamically according to security and service level for each specific user in the image collecting and distributing server and displayed on the user terminal. The user may experience different levels of information displayed on the graphic screen depending on the level of the service to which the user subscribes. Therefore, if the user tries to increase the service level, he or she has to subscribe to a higher level service, and the billing means can be configured in the image collecting and distribution server, or it can be charged in connection with a financial institution or a communication company.

The video recording apparatus 100 generates the metadata 500 based on the reference model 400 configured in the above-described manner. Basically, the user can grasp the situation of the video recording site with only the metadata without the video information . Therefore, it is preferable that the metadata 500 generated by the video recording apparatus 100 according to the present invention is configured according to the two-dimensional hierarchy of how, where, what, why, and how. In addition, the system collects additional information about the surrounding situation or characteristic, and allows the user to designate the desired information. When the information is sensed, it is recognized as particularly important information and the contents can be described.

As described above, the basic rules for generating the metadata 500 so that the metadata 500 may include the contents of the two-dimensional hierarchy include the time, place, subject, object, reason, and means. The method of encoding the metadata 500 uses a method of allocating 3 bits to the configuration of each metadata 500. For example, the time may be set to 000, the location to 001, the subject to 010, the object to 011, the reason to 100, the reason to 100, and the remaining 110 and 111 to be reserved for other purposes. Alternatively, it is also possible to allocate 4 bits to the configuration of each metadata 500 to prepare for scalability. The metadata is transferred to the user terminal in the form of a data structure, and the transferred data is displayed graphically by a specific user interface or application of the user terminal through lexical analysis.

As for the contents of each item of the metadata 500, the time is indicated by "date, hour, minute, and minute". The location can be divided by assigning the number of recording sites to ip-address. In this case, it has a mapping table for ip-address and location, and can be used whenever needed. The subject can specify 'person name or subject (institution name)'. The object can display the object to be monitored by the camera in advance. In addition, the region of interest or the object of interest can be displayed separately from other objects. The reason is to display information according to the monitoring purpose of the recording site, and the means indicate that the situation occurs in the corresponding recording site among various specific situations set in the reference model. In addition, the status information and the additional information can be displayed using a code reserved by the user.

The configuration of the reference model that can be set for each recording site is stored in the database through the metadata providing unit and the storage management unit of the service providing unit. Then, the configuration is converted from the user terminal to the user interface metadata via the user interface, And the source code of the converted user interface is output to the user terminal through the template engine as a user interface configuration for each recording site. The user requests the image distribution service to the image collecting and distributing server through the interface displayed on the user terminal, and the service logic for the service request is converted into source code that can be executed by using the metadata, And is executed in conjunction with the recording site-specific user interface of the generated source code of the converted user interface.

Since existing video distribution services store the source code in a fixed file format, in order to manage different guide services for each recording site, the developer has to maintain the file by opening the file and correcting the source code. This approach increases maintenance costs and requires skilled personnel. However, since the image distribution service proposed in the present invention converts the related source codes into the metadata format and converts the source codes to the recording site upon request to generate and manage the source code, the maintenance cost is relatively low compared to the existing method .

Each component of the user interface is converted into a tree with a parent and stored in the database. The attributes for each component are also stored in the database and used to configure the customized image distribution service user interface according to the request of the recording site in the future. For example, a user interface panel called "recording site" is defined, a panel called "detailed information" is defined as a parent thereof, and a plurality of components are defined as a child again. Each component again defines a metadata structure that puts property information as children. When this metadata is converted into a user interface, a "recording site" user interface appears at the top. When this is selected, a message of "detailed information" is displayed. When this is selected again, "recording time" A recording object, a recording object, a recording reason, a recording means, and a text field, which is an attribute of each component, appear in the user interface.

The process of executing the image distribution service logic for each recording site in the image collection and distribution service system is a process of dynamically compiling, loading and executing the image distribution service logic defined for each recording site in the image distribution service. When a user using the image distribution service makes a request related to the image distribution service processing through a browser, the request processing controller performs class objectization of the stored image distribution service logic, and based on the recording site information, Read the metadata by querying the logic (code). The metadata of the logic thus read is dynamically generated into source code that can be executed by the runtime engine. The generated source code is dynamically compiled, loaded by the container's class loader, and registered in the container. When the source code of the recoding site definition logic is compiled and registered in the container, the runtime engine executes the logic and combines the result with the user interface and returns it to the user of the image distribution service.

Through this process, it is possible to distribute the image information collected for each recording site to the user interface of the user terminal. The present invention is not limited to the above-described process flow. Instead, it is possible to provide the image distribution service through the dynamic configuration of the user interface using the metadata described in the embodiment of the present invention. It is obvious that it is a technical matter belonging to the scope of

FIG. 5 is a diagram for explaining image capturing and transmission according to a region of interest of a recording site according to an embodiment of the present invention. Referring to FIG.

As shown in FIG. 5, in the video multiplex transmission system of the present invention, when collecting image information, a ROI 600 is set in a specific region of the recording site, Recording and transmission can be performed.

More specifically, the video multiplex transmission system of the present invention can treat video and metadata as essential information and background information as described above. Essential information can be treated as real-time information that is captured and transmitted in real time, and background information can be treated as non-real-time information. The image multiplexing transmission system according to the present invention photographs and generates images and metadata in the image recording apparatus 100 according to a reference model. At this time, only a part of the images captured by the metadata generating unit 130 are captured The entire image is non-real time information, and the motion capture area or the interest area 600 can be captured and transmitted as real time information. In this case, the collection of the image information is performed such that the entire image, that is, the frame rate at which the background image is transmitted or transmitted in the non-real time is low, and the frame rate is high, To be transmitted. The area of interest 600 may be a fixed area or object, a moving object, or may be created in a different area for each situation. Therefore, the image recording apparatus 100 of the present invention installed on the recording site can effectively acquire image information on the region of interest 600 by using a camera control function such as zoom / focus / pan / tilt.

6 is an exemplary diagram for explaining an expandable structure of an image multiplexing transmission system using an image collecting and distributing server according to an embodiment of the present invention.

6, an image multiplexing transmission system using the image gathering and distribution server 200 of the present invention includes a plurality of image recording apparatuses 100 of a plurality of recording sites in an image collecting and distributing server 200, And the image information and meta data can be collected. The structure is a mixture of a star type structure and a cascading structure. In the case where the distance between the video recording apparatuses 100 is long or it is difficult for the apparatuses such as communication cables to be compatible with each other, each video recording apparatus 100 has a star-type structure for transmitting video information and metadata directly to the server, When the distance between the recording apparatuses 100 is short, or when it is easy to link apparatuses such as a communication cable, a cascading structure may be used in which the video image recording apparatuses 100 are linked and the image information and metadata are transmitted to the server . However, it is not necessarily constructed as described above, and it is possible to selectively apply a proper structure depending on the situation. In the cascading structure, each video recording apparatus 100 may be connected through a wired communication cable or may form an ad-hoc network through short-range communication to transmit and receive information, and a combination of wired and wireless communication systems To form a network through which information can be transmitted and received. The case-cording structure connected by the add-drop method is less costly than the star-type structure in which information is directly transmitted from each video recording apparatus 100 to the server, and the system structure is effectively expanded I can go out.

7 is a flowchart illustrating an image multiplexing method using an image collecting and distributing server according to an embodiment of the present invention.

7 is a flowchart illustrating a method of generating a reference model according to characteristics of each recording site and generating reference models generated by a video recording apparatus or an image collecting and distributing server according to an embodiment of the present invention. The model is input (S101). In addition, a region of interest according to the request of the service user or the characteristics of the recording site is set in the video of the recording site photographed by the video recording apparatus (S102). Thereafter, an image of each recording site is captured and stored based on the reference model and the region of interest set in the video recording apparatus (S103). The image recording apparatus generates metadata about the image information based on the reference model, the region of interest, or a combination thereof set at the same time as the image capturing (S104). The image information and meta data shot and generated by the image recording apparatus are transmitted to the image collection and distribution server (S105). The image collection and distribution server stores image information and meta data received from the image recording apparatus, and performs classification, grouping, or combination of image information based on the reference model or metadata of each recording site (S106). The image information, the metadata, or a combination thereof is dynamically provided to an individual user or a plurality of user groups according to a user's request, a reference model set according to characteristics of a recording site, or a combination thereof, as described above (S107 ).

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, I will understand that. Accordingly, the technical scope of the present invention should be defined by the following claims.

50: camera 100: video recording device
110: reference model and ROI setting unit 120: camera interface
130: Metadata generation unit 140: Storage interface
150: communication interface 160: user interface
170: control unit 200: image collection and distribution server
210: interface unit 211: user interface
212: communication interface 213: camera interface
220: user authentication management unit 230:
240: Service providing unit 241: Video information provider
242: Metadata provider 250:
300: Database 400: Reference Model
500: metadata 600: region of interest (ROI)

Claims (15)

At least one image recording apparatus for receiving and recording image information from at least one camera; And
An image collection and distribution server,
The video recording apparatus captures video information of a recording site based on a reference model set according to characteristics of each video recording site, generates and stores metadata of the video information together with the captured video information, Metadata, or a combination thereof, to the image collection and distribution server in a transmission mode according to a user's setting including a real time transmission method, a non-real time transmission method, or a combination thereof,
The image collection and distribution server may dynamically provide image information, metadata, or a combination thereof received from at least one image recording apparatus according to a user's request, a reference model set according to characteristics of a recording site, or a combination thereof Wherein the video multiplex transmission system comprises: The method according to claim 1,
The video recording apparatus includes:
A reference model and a region of interest setting section; A metadata generating unit; Storage interface; Communication interface; User interface; Camera interface; And a control unit for controlling the transmission of the video data. The method according to claim 1,
The image collection and distribution server comprises:
An interface unit including a user interface, a communication interface, and a camera interface;
A user authentication management unit for managing user private information and security information;
An information collecting unit for collecting image information and meta data; And
And a service providing unit for providing the user with image information and meta data. The method of claim 2,
Wherein the camera interface comprises:
A control interface is provided such that the optical axis and the irradiation axis can be adjusted through pan, tilt, zoom, focus, rotation, or a combination thereof according to the structure of the recording site, the reference model and the position and direction of the object. system. The method according to claim 1,
In the reference model,
Wherein the data structure is a data structure comprising information including a name of a site to be recorded, a location of a recording site, a recording time, a main purpose of recording, a recording object, a recording method, an environment, a situation information or a combination thereof. The method according to claim 1,
The metadata includes:
Time, place, subject, object, reason, means, or a combination thereof so that the user can grasp the contents of the image information by only metadata. The method according to claim 1,
The video recording apparatus records video information shot by a camera,
Background information; And
And the essential information which is a region of interest in which the motion is captured or manually or automatically set. The background information is transmitted in non-real time and the essential information is transmitted in real time to the user or the image collecting and distributing server. system. The method according to claim 1,
The image collection and distribution server collects image information, metadata, or a combination thereof from at least one image recording apparatus of at least one recording site,
Wherein the connection structure between the image collection and distribution server and the at least one image recording apparatus is a star structure, a cascading structure, or a combination thereof. At least one video recording device capturing video information of a video recording site based on a reference model set according to characteristics of each video recording site with respect to at least one video recording site;
Generating and storing metadata from the image information together with the photographed image information;
Transmitting at least one of the image information, metadata, or a combination thereof to an image collection and distribution server in a transmission format according to a user's setting including a real time transmission method, a non-real time transmission method, or a combination thereof; And
The image collection and distribution server dynamically provides the user with video information, metadata, or combination thereof received from at least one video recording apparatus according to a user's request, a reference model set according to characteristics of a recording site, or a combination thereof The method comprising the steps of: The method of claim 9,
Wherein the step of photographing the image information comprises:
Setting a region of interest through at least one of motion capture, feature point extraction of image information, preset region, or a combination thereof, based on the reference model, region of interest, The photographing of the image information can be adjusted by the pan, tilt, zoom, focus, rotation, or a combination thereof according to the structure of the recording site, the reference model, and the position and direction of the object. Wherein the image data is supported through a camera control interface. The method of claim 9,
The generating and storing of the metadata may include:
Generating metadata of the photographed image information based on the reference model, the region of interest, or a combination thereof,
Wherein the dynamically providing to the user comprises:
And providing the image information to an individual user or a plurality of user groups by performing classification, grouping, or a combination thereof on the basis of the reference model, the metadata, or a combination thereof. . The method of claim 9,
In the reference model,
Wherein the data structure is a data structure composed of information including a name of a recording site, a location of a recording site, a recording time, a main purpose of recording, a recording object, a recording method, a surrounding environment, situation information or a combination thereof. The method of claim 9,
The metadata includes:
Wherein the metadata is constructed according to time, place, subject, object, reason, means, or a combination thereof so that the user can grasp the contents of the image information by only metadata. The method of claim 9,
The video recording apparatus records video information shot by a camera,
Background information; And
And the essential information which is a region of interest in which the motion is captured or manually or automatically set. The background information is transmitted in non-real time and the essential information is transmitted in real time to the user or the image collecting and distributing server. Way. The method of claim 9,
The image collection and distribution server collects image information, metadata, or a combination thereof from at least one image recording apparatus of at least one recording site,
Wherein the connection structure between the image collection and distribution server and the at least one image recording apparatus is a structure including a star structure, a cascading structure, or a combination thereof.

Images