KR100868187B1 - Creating And Offering System Of Photo-Based Contents And Method Thereof - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to a system for generating and providing a photo-based integrated content and a method thereof, and more particularly, camera setting information and situation information when a picture is taken by using semantic web technology as a meta information directly on a picture. The present invention relates to a photo-based integrated content generation and providing system and method for inserting, generating integrated content based on the inserted meta information, and providing integrated content through user search.

2. Technical problem to be solved by the invention

According to the present invention, a semantic web robot is stored in a web space with setting information (time, position (GPS), user profile) and a picture inserted from a camera as a technology in which a picture is semantically related to surrounding information. Situation information (RSS, event, news, person information, etc. related to ontology-based information) collected and inserted from is integrated with the original photo to define the technology for classifying, summarizing, searching, distributing, and processing related contents. The purpose is to provide a photo-based integrated content providing service based on the above technology.

3. Summary of the Invention Solution

The present invention defines a technique for defining concepts and relationships on the basis of ontology-based setting information inserted from a camera at the moment of taking a picture and context information inserted from a semantic web robot when stored on the web as meta information. Photographs, setting information and status information added are organically related by the ontology. Photo and meta information generated by this technique is generated based on the ontology, so external contents related to the photo are suitable for post-processing methodology such as search and classification through inference engine.

4. Important uses of the invention

The present invention is used for a photo-based integrated content providing service, an ontology-based semantic search system, and the like.

Photo, Content, Search, Semantic Web, Ontology, Inference, Meta Information

Description

Photo-based integrated content generation and provision system and method thereof. {Creating And Offering System Of Photo-Based Contents And Method Thereof}

1 is a block diagram of an embodiment of an existing system for registering and searching a web by taking a conventional picture.

2 is a system configuration diagram schematically showing a system for providing integrated picture-based contents according to a preferred embodiment of the present invention.

3 is a system configuration diagram schematically showing a system for providing integrated contents according to a preferred embodiment of the present invention.

4 is a flowchart schematically illustrating a method for generating integrated photo-based content according to an exemplary embodiment of the present invention.

5 is a flowchart schematically illustrating a method for providing integrated content according to a preferred embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

10, 30, 50: search engine 110, 310, 510: web document crawler

120, 320, 520: indexer module 130, 330, 530: acquisition analysis module

140, 340, 540: Web Document Repository

20, 40: integrated content providing server 210: setting information tagging machine

220: situation information tagging machine 230, 430: semantic web robot

240: ontology storage 250, 450: inference engine

260, 460: rule DB 270, 470: user profile DB

410: query engine 490: interface module

The present invention relates to a system for generating and providing a photo-based integrated content and a method thereof, and more particularly, camera setting information and situation information when a picture is taken by using semantic web technology as a meta information on a picture. The present invention relates to a photo-based integrated content generation and providing system and method for inserting, generating integrated content based on the inserted meta information, and providing integrated content through user search.

Since the conventional web technology only allows access to information by keywords, it generates a flood of information by producing a myriad of unnecessary information for simple keyword search. In addition, the existing web is a human-oriented information processing technology that the computer does not provide enough functions to effectively extract, interpret, and process the necessary information on its own.

More specifically, FIG. 1 is a diagram illustrating an exemplary embodiment of an existing system that registers and searches a conventional dictionary on the web.

Referring to FIG. 1, in the conventional photo retrieval system, when a user takes a picture and registers a picture in which time, location (GPS) information, etc. are inserted by a setting information tagging unit 160 included in the camera, is inserted into a web page. The web document is stored in the web document storage 140 by the crawler 110. The picture stored as described above was able to check the search results of the query engine 150 through the user's search.

The web document crawler 110 is a module for collecting web documents, the web document storage 140 is a repository for storing collected web documents, and the indexer module 120 indexes the collected web documents. The collection analysis module 130 converts the collected web document and the index information into a form useful for information retrieval.

At this time, the query engine 150 processes a search for a web document or photo file name indexed by the web document crawler 110. More specifically, the web document crawler 110 for collecting web documents is used to collect pictures included in HTML and HTML of various sites, and the collected data is indexed by the module 120 and the collection analysis module 130. Indexing is done by the search.

In general, if there is no classification criteria such as category, the search is performed based on the search keywords, and the search results with higher satisfaction can be provided using the page ranking information as well as the search keywords.

However, the conventional photo retrieval system performs keyword-based search term processing, and search users perform a search by inputting only one or two words, so that a large amount of search results are provided so that search users can search for information that they want. In addition to being difficult to find, there was a problem that another method of searching or additional actions of the user was required to obtain semantically related documents or photos.

Therefore, by improving existing search service and search technology for web contents including photo contents that are produced variously, users can efficiently and conveniently search for information they want while minimizing cognitive load. We need a way to do it.

The present invention has been made to solve the above problems, an object of the present invention is to insert the camera setting information and the situation information when taking a picture by using the semantic web technology directly into the picture as meta information, The present invention provides a system and method for creating and providing integrated photo-based contents using photo information generated by technology.

More specifically, the present invention is a technology in which a picture is connected to surrounding information that is semantically related at the moment of taking a picture, and setting information (time, location (GPS), user profile) and a picture inserted from a camera are displayed in a web space. Context information (RS information, ontology-based related RSS information, events, news, person information, etc.) that are collected and inserted from semantic web robots is integrated with the original picture and classified, summarized, searched, distributed, and processed for related content. The purpose is to define a technology to provide and provide a photo-based integrated content providing service based on the technology.

In order to achieve the above object, the photo-based integrated content generation system according to the present invention receives the setting information from the camera to generate the setting information of the semantic integrated content, read the ontology, and infer based on the ontology by the semantic web robot, the situation information. And an integrated content providing server for generating semantic integrated content using the setting information and context information, and a search engine for collecting external content from the setting information and storing a web document.

In addition, the integrated content providing server receives the setting information from the camera to generate the setting information of the semantic integrated content and the ontology from the semantic web robot when the picture is stored on the web to infer the situation information of the semantic integrated content The setting information based on the ontology, rule and user profile storing the inference engine to infer on the basis of the ontology-based situation information tagging and the situation information generated from the situation information tagging machine and the inference engine to match the rule And a semantic web robot that integrates contextual information to generate semantic integrated content.

The semantic web robot is a semantic integrated content integrating setting information and contextual information by mapping the web document and the ontology-based related document to a web document collected and stored from setting information through a search engine based on an ontology. It characterized in that to generate.

On the other hand, the photo-based integrated content providing system according to a preferred embodiment of the present invention to analyze the query input from the user based on the ontology to extract a search word, generated by the content generation system based on the ontology from the extracted search word A content providing server that infers semantic integrated content based on the ontology by a semantic web robot and provides a search result generated by reconstructing the collected external content through the inference result and collects the inference result and the related external content based on the ontology Include a search engine that stores web documents.

Here, the content providing server extracts a search term based on the ontology from the query input from the user and selects and binds a rule that can be mapped to the inference rule from the extracted search term based on the ontology and ontology from the extracted search term. Provide a semantic web robot that infers the semantic integrated content based on the semantic integrated content, a semantic web robot that reconstructs the collected external content through the inference result, a repository that stores the rules and ontology, and a search result reconstructed by the semantic web robot. And an interface module for providing a search result and an original document of the ontology-based related content.

On the other hand, a photo-based integrated content generation method according to a preferred embodiment of the present invention comprises a setting information tagging step of inputting the setting information from the camera tag; A content collection step of collecting and storing external content based on the tagged setting information; A contextual information tagging step of inferring contextual information based on ontology by a semantic web robot; And a content generation step of generating the semantic integrated content by integrating the setting information and the situation information.

Here, the setting information tagging step may receive setting information of a photo including a time, a place (including GPS information), and a user profile from a camera, and tag the photographed picture with the setting information tagging machine.

The content collection step includes a web document collector collecting a web document from an external web page based on the setting information of the photo, indexing the collected web document by the index module, and displaying the indexed web document. Includes steps stored in the web document repository.

In the contextual information tagging step, the semantic web robot infers the contextual information based on the ontology using the inference engine from the configuration information.

The content generation step includes a step of mapping a document related to the ontology based on the ontology on the web document collected and stored from the content collection step, and generating semantic integrated content by integrating setting information and situation information. Include.

On the other hand, the photo-based integrated content providing method according to an embodiment of the present invention to infer the semantic integrated content generated on the basis of the ontology from the query analysis step of reconstructing the search term based on the ontology from the query input by the user And a content composition step of reconstructing the external content retrieved through the content inference step and the result inferred in the content inference step based on the ontology, and a search result providing step of providing the user with the result reconstructed in the content composition step.

The query analysis step includes a user accessing an integrated content providing server to input a query statement, a query engine reconstructing a search word based on the ontology from the query statement, and a query rule as an inference rule. Selecting and binding a rule that can be mapped.

In addition, the content inference step may include a step of analyzing, by a query engine, external data based on the ontology and the result reconstructed in the content construction step collected and stored in a web document repository of a search engine for the analysis result through the query analysis step; And a reasoning engine infers the semantic integrated content based on the ontology from the query result analysis.

The content constructing step includes the semantic web robot searching the related content stored in the web document repository through the inference result generated from the inference engine and reconstructing the ontology based on the ontology to provide the searched content to the user. .

The search result providing step may include providing the reconstructed search result to a user through an interface module and providing an original document of linked content when the user selects desired content from the search result.

Hereinafter, the specific configuration and operation of the present invention will be described in detail with reference to the drawings and the embodiments.

The Semantic Web is a semantic-based search that allows not only humans but also machines (computers) to understand the information that exists on the web and finds only the results that are appropriate for the user's needs. By doing this we mean a web that can be automatically serviced on behalf of people.

The Semantic Web is a next-generation web technology that enables computers to understand, automate, integrate, and reuse the meaning of information resources. It is composed of three main elements:

1) Ontology

Ontology is a formal specification system for shared conceptualization that provides semantic information of domain vocabulary. Ontology is a kind of knowledge expression. Computer can understand the concept expressed by ontology and process the knowledge, and the axiom and rule system of ontology is needed for the processing of inference.

2) senamtically annotated web

An ontology annotated web, a kind of knowledge base. The Semantic Web can build a huge knowledge base that semantically integrates the distributed information resources of the Internet. In a narrow sense, it can build a knowledge base on the information level of a company or institution.

3) agent

It is an intelligent agent that collects, retrieves and infers information resources on behalf of humans, exchanges information with other agents, and is the core of a semantic web-based application system.

The semantic web realizes semantic interoperability by utilizing ontology and agent technology, and thus can make the existing web based on information expression into a knowledge-based semantic web.

2 is a system configuration diagram schematically showing a system for providing integrated picture-based contents according to a preferred embodiment of the present invention.

Referring to FIG. 2, the system for generating a photo-based integrated content according to the present invention receives a setting information from a camera and collects an integrated content providing server 20 for automatically generating semantic integrated content and a photo-based external content to store a web document. The search engine 30 is configured to include.

More specifically, the integrated content providing server 20 receives the setting information from the camera and the setting information tagging machine 210 for generating the setting information of the semantic integrated content and the ontology from the semantic web robot when the picture is stored on the web. The inference engine 250 that infers the situation information tagging machine 220 that generates the context information of the semantic integrated content, and the inference engine 250 that infers the context information generated from the situation information tagging machine 220 on the basis of the ontology is based on the ontology. Semantic web robot to generate semantic integrated content by integrating the setting information and context information on the basis of the ontology storage 240 for storing the ontology for matching the rules with the storage (260, 270) and the ontology based on the ontology ( 230 and a semantic integrated content DB 280 for storing the generated semantic integrated content. The.

Here, the setting information is information input from the camera and includes a location profile of a place where a picture is taken, time information taken, and a user profile that specifies a user's name, e-mail address, and preference.

In addition, the context information includes RSS information, events, news, person information, content information, and various link information related to the ontology.

In addition, the rule is information provided by the inference engine to infer on the basis of an ontology, and predefines a system (eg, longitudinal and horizontal relations of specific information) that can be semantically associated with configuration information. Say the law.

As a result, the semantic integrated content may be expressed as metadata for retrieving information semantically related from the setting information of the picture.

3 is a system configuration diagram schematically showing a system for providing integrated contents according to a preferred embodiment of the present invention.

Referring to FIG. 3, the photo-based integrated content providing system of the present invention provides a content providing server 40 which provides a search result generated by inferring semantic integrated content and reconstructing external content through a query input from a user. The search engine 50 collects external content related to the query and stores the web document.

The content providing server 40 extracts a search term based on the ontology from a query input from a user, and selects and binds a rule that can be mapped to an inference rule from the extracted search term and from the extracted search term. An inference engine 450 that infers the semantic integrated content based on an ontology, a semantic web robot 430 that reconstructs external content collected through the inference result, and a repository for storing the rules, ontology, and user profile 440, 460, 470 and an interface module 490 that provides a search result generated from the query engine 410 and the inference engine 450 and provides an original document of related content.

The search engine (30, 50) is a web document crawler (Web Crawler) (310, 510) for collecting information from a plurality of web pages, the keyword extraction and link frequency calculation for the information collected from the web page An indexing module and a collection and analysis module, and web document storage (340, 540) for storing a list of keyword-specific web page indexed from the indexing module.

The present invention also provides a setting information tagging function that inserts setting information into photo content when a user takes a picture in camera hardware, and extracts related information from an ontology based on setting information of a photo content to infer association with an external web document. Function, internal axiom-based reasoning in inference, rule-based inference inference according to search service rules in inference, user profile application inference inferencing by applying user's preferences in inference, collection of external web documents, Indexing the collected web documents, storing the collected web documents, querying for the semantic integrated content, and querying the program to realize the function of providing the contents related to the search results. A recording medium can be provided.

4 is a flowchart schematically illustrating a method for generating integrated photo-based content according to an exemplary embodiment of the present invention.

Referring to FIG. 4, first, setting information is input from a camera and tagged. (S110)

More specifically, when the picture is registered, the setting information tagging machine 210 receives the setting information of the picture including the time, place (including GPS information) and the user profile from the camera and tags the picture content.

For example, if a user takes a picture while watching a seminar entitled "Intelligent Web" on September 28, 2006, at the COEX Atlantic Center in Samsung-dong, Seoul, the photo was taken on September 28, 2006, at 11 am , Location: GPS coordinates 55.5 66.6, User profile: Hong Gil-dong (hong@mail.com) The same setting information is created through the setting information tagging machine and automatically inserted into the picture.

When the setting information is tagged to the picture by the setting information tagging machine 210, the web document crawler 310 of the search engine collects external content information based on the setting information in units of time (S120).

For example, on September 28, 2006, Web documents (seminar information, presenter information, etc.) corresponding to the COEX "Intelligent Web" will be collected and indexed and stored as one of the collected documents. This corresponds to the same process as the conventional keyword-based search method.

In addition, when the user registers a photo in the web space, the inference engine 250 is inferred based on the ontology through the semantic web robot 230 and the situation information is tagged (S130).

For example, the semantic web robot 230 analyzes the GPS information of the picture to recognize that the place of the picture is the Coex Atlantic Hall, and analyzes the time information to recognize the seminar picture content related to the "intelligent web." This may be possible because the location and time information is inferred and analyzed through the ontology represented. In addition, the semantic web robot 230 analyzes the ontology and semantically connects the information of the other seminar related to the "intelligent web" and the related information such as the presenter's information, the presentation material, etc. with the photograph.

The information semantically linked by the ontology-based inference (RSS, event, news, person information, link information, etc. related to the ontology) is integrated with the original picture by the context information tagging machine 220.

When the setting information and the situation information are tagged, the semantic web robot 230 maps the related content to the external content collected and stored in step S120 based on the ontology based on the setting information and the situation information.

The semantic integrated content is generated by the semantic web robot by integrating relevant external information, setting information, and contextual information through the mapping process (S140). The generated semantic integrated content is stored in the semantic integrated content DB 280.

For example, for a photo taken on September 28, 2006, this is a photo of a seminar on "Intelligent Web" at the COEX Atlantic on September 28, 2006, the presenter is 000, and the presentation URL is http: // tp.co.kr/presentation.ppt, and related seminars are seminars on "Intelligent Web 2.0" held at Indian Ocean. Semantically integrated content is generated.

5 is a flowchart schematically illustrating a method for providing integrated content according to a preferred embodiment of the present invention.

Referring to FIG. 5, a search word is extracted based on the ontology from a query input by a user (S210).

More specifically, when the user accesses the integrated content providing server 40 and inputs a query, the query engine 410 reconstructs the search word based on the ontology from the query.

In a conventional search system, for example, if a user searches on the keyword "September 28, 2006," the user searches for a web document containing the keyword "September 28, 2006," or photographs. Search for whether there is a keyword included in the file name of the content and provide the result to the user, but the integrated content providing method according to the present invention analyzes a user query and selects a rule to be used in the inference engine 450 and considers a user profile. To create a search query.

Therefore, although the user inputs "September 28, 2006 seminar photo", the query engine 410 searches on the ontology-based search term such as "time: September 28, 2006, content type: photo, user: Hong Gil-dong". Reconstruct and select and bind inference rules that can be mapped from reconstructed search words, eg, "seminar picture-> seminar topic, seminar presenter, seminar presentation, related seminar".

Subsequently, the semantic integrated content generated by the integrated content generation method is inferred from the reconstructed search word based on the ontology (S220).

More specifically, the query engine 410 compares and analyzes the related external content collected and stored in the web document storage 540 with respect to the search word reconstructed through the step S210, and the inference engine 450 ontology from the reconstructed search word. Infer the semantic integrated content based on this.

For example, in response to the reconstructed search terms, the user Hong Gil-dong confirmed that the photo was taken on September 28, 2006 at COEX, and inferred based on the semantic integrated content, and the "Intelligent Web" at the COEX Atlantic on September 28, 2006. Photo seminar, the presenter is OOO, and the URL of the presentation is http://tp.co.kr/presentation.ppt The related seminar is a photo-based inference called "Web 2.0" at the Indian Ocean Hall. You get the result (metadata).

The information is searched through the inference result and the searched external content is reconstructed (S230).

More specifically, the semantic web robot 430 retrieves external content stored in the document repository through the metadata based on the inference result. The result is a generalization of services for application services. In other words, through integration of reconstructed external content and content that has completed the semantic integrated content inference step, it is necessary to normalize the service to provide search services, map-based recommendation, and blogs to be developed in the future.

Here, the search exposure ranking may be determined using the ranking algorithm of the searched external content.

The reconstructed search result is provided to the user through the interface module 490. (S240) Here, the information distributed in the web space may be provided to the user as actual information through the original data link.

As described above, the photo-based integrated content generation and provision system and method thereof according to the present invention corresponds to the cost of searching and managing the user for photo content generated in accordance with the increasing frequency of web usage and the spread of digital cameras. In addition to minimizing input time, cognitive burden, and psychological burden, and maximizing efficiency and convenience, which are the benefits of search, there is an excellent effect of easily acquiring semantically related contents additionally.

In addition, since semantic-related contents are automatically integrated with information to be recorded or inadvertently taken photo contents, it is possible to easily construct a beneficial business service that can be generated from such contents integration.

Although the detailed description of the present invention described above has been described with reference to the preferred embodiment of the present invention, the protection scope of the present invention is not limited to the above embodiment, and those skilled in the art will appreciate It will be understood that various modifications and changes can be made in the present invention without departing from the spirit and scope of the invention.

Claims (15)

Receive the setting information from the camera to generate the setting information of the semantic integrated content, read the ontology and infer the ontology based on the ontology by the semantic web robot to generate the situation information, and generate the semantic integrated content using the setting information and the situation information An integrated content providing server; Photo-based integrated content generation system including a search engine for collecting the external content from the setting information to store a web document. The method of claim 1, The integrated content providing server A setting information tagging device for receiving setting information from a camera and generating setting information of semantic integrated content; A situation information tagging device for generating context information of semantic integrated content by reading and inferring ontology from a semantic web robot when a picture is stored on the web; An inference engine that infers context information generated from the context information tagging machine on an ontology basis; A repository for storing the ontology, rule and user profile for the inference engine to match a rule; Photo-based integrated content generation system comprising a semantic web robot to generate the semantic integrated content by integrating the setting information and the contextual information on the ontology. The method of claim 2, The semantic web robot On the basis of ontology based on the web engine collected from the configuration information stored on the web document and the ontology-based related document by mapping, characterized in that to generate the semantic integrated content integrating the configuration information and the situation information Photo-based integrated content generation system. Analyze the query input from the user on the basis of the ontology to extract a search word, and the semantic integrated content generated by the content generating system of claim 1 or 2 based on the ontology from the extracted search word ontology by the semantic web robot A content providing server for inferring based on the content and providing search results generated by reconstructing the external content collected through the inference result; And a search engine for collecting the inference result and the related external content based on the ontology and storing a web document. The method of claim 4, wherein The content providing server A query engine that extracts a search term based on the ontology from a query input from a user and selects and binds a rule that can be mapped to an inference rule from the extracted search term based on the ontology; An inference engine that infers the semantic integrated content based on the ontology from the extracted search word; A semantic web robot for reconstructing external content collected through the inference result; A repository for storing the rules and ontology; And an interface module for providing a search result reconstructed by the semantic web robot and providing an original document of the search result and the ontology-based related content. Setting information tagging step of inputting and tagging setting information from a camera; A content collection step of collecting and storing external content based on the tagged setting information; A contextual information tagging step of inferring contextual information based on ontology by a semantic web robot; And a content generation step of generating semantic integrated content by integrating the setting information and the situation information. The method of claim 6, The setting information tagging step And receiving setting information of a photo including a time, a place (including GPS information), and a user profile from a camera, and setting the tag information on the captured photo. The method of claim 6, The content collection step Collecting a web document by a web document collector from an external web page based on setting information of the picture; Indexing the collected web document by an index module; And storing the indexed web document in a web document repository. The method of claim 6, The situation information tagging step The semantic web robot infers the contextual information based on the ontology using the inference engine from the setting information. The method of claim 6, The content generation step Mapping, by the semantic web robot, a related document based on the ontology to a web document collected and stored from the content collection step; A method of generating integrated picture-based content comprising the step of integrating setting information and contextual information to generate semantic integrated content. A query word analyzing step of reconstructing a search word based on the ontology from a query input by a user; A content inference step of inferring semantic integrated content generated by any one of claims 7 to 10 based on the ontology from the reconstructed search word; A content configuration step of reconstructing the external content retrieved through the result inferred in the content inference step based on the ontology; And a search result providing step of providing the user with the result reconstructed in the content composition step. The method of claim 11, The query analysis step Inputting a query by a user accessing the integrated content providing server; Reconstructing, by the query engine, a search term based on ontology from the query; And selecting and binding a rule that can be mapped to an inference rule from the reconstructed search term. The method of claim 11, The content inference step Analyzing, by the query engine, the external content based on the ontology and the result reconstructed in the content construction step collected and stored in the web document repository of the search engine for the analysis result through the query analysis step; And a reasoning engine infers the semantic integrated content based on the ontology from the query result analysis. The method of claim 11, The content composition step Retrieving the related content stored in the web document repository by the semantic web robot through the inference result generated from the inference engine; Reconstructing on the basis of the ontology to provide the retrieved content to the user Photo-based integrated content providing method. The method of claim 11, The search result providing step Providing the reconstructed search result to a user through an interface module; And providing the original document of the linked contents when the user selects the desired contents from the search results.

Images