KR20090093573A - Apparatus for searching the internet by using the information obtained from the image and method threrefor - Google Patents

Abstract

An apparatus for searching the internet by using the information obtained from an image and a method therefor are provided to supply information by searching the Internet through the information obtained from the image acquired by a camera or a video device. A recognition unit(200) recognizes an image inputted by an image input unit(100), and compares the recognized image with preset data. In addition, the recognition unit outputs the comparison results in the words of text form according to the recognition reliability. A keyword extractor(300) adds the outputted words and the similar words, and judges the conformity of the added words from a search portal history. The keyword extracts the result keywords according to the judgment, and an Internet search engine unit(400) performs the Internet search through the extracted search.

Description

Apparatus for searching the internet by using the information obtained from the image and method threrefor}

The present invention relates to an Internet search apparatus and a method thereof, and more particularly, to an apparatus and method for searching the Internet using information obtained from an image input through a camera or a video camera.

Conventionally, the technology related to the Internet search apparatus has been published and published in a large number in addition to the Republic of Korea Patent Publication No. 2000-0072482 'Internet search system to facilitate the user' search.

The prior art, as shown in Figure 1, is connected to the Internet communication network to search for a variety of websites (30) is provided with the necessary information, the information of the accessed website (30) is automatically stored cookies ( 11) or a user's Internet connection means 10 having a temporally Internet file 12; When a search engine is provided to the user's Internet connection means 10 connected to the Internet communication network, and a request for information search or a specific website 30 is requested through the search engine, the user's Internet connection means 10 Analyze the characteristics of cookies (11) or Temporary Internet file (12) that is automatically stored in the web site (12) and informs from the information or search results of the website (30) according to the characteristics of the analyzed website (30) The operator server 20 is characterized in that it is configured.

However, in the related art, when a search term is input by using a keyboard, a search engine searches and outputs a result, but there is a problem in that the information given as an image cannot be directly used as a search term. For example, if you got a picture of an actor, but you don't know the name of the actor, you can't get the personal information of the actor. In other words, there is an inconvenience that the user must directly enter the search word, there is a problem that missing important information if you do not know the search word.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above problems and to provide information by searching the Internet using information obtained from an image acquired through a camera or a video apparatus.

Another object of the present invention is to provide an apparatus and method for searching the Internet while watching TV for directly searching a word or logo in an image to obtain related information and searching the internet for foreign languages without a keyboard.

An apparatus for searching the Internet using information obtained from an image, the apparatus comprising: an image input unit configured to receive an image from an external image acquisition device; A recognition unit which recognizes an image input by the image input unit, compares the image with preset data, and outputs the result as words in text form according to recognition reliability; A search word extracting unit which stores a search portal history, adds words similar to words output from the recognition unit, determines a goodness of fit from the search portal history, and selects and extracts a search word as a result; An internet search engine that searches the Internet using the search word extracted by the search word extractor and extracts related information according to relevance; And a controller configured to control the image input unit, the recognizer, the search word extractor, and the internet search engine. It includes.

On the other hand, the present invention provides a search method using a device for searching the Internet using information obtained from the image, the method comprising the steps of: (a) the control unit receives the image through the image input unit; (b) setting, by the control unit, information about the input image and a text name for the image in advance to build a database in the recognition DB module; (c) the control unit recognizing the input image through the recognition unit, and comparing the input image with the data preset in the database to the recognition DB module and extracts a word of text form as candidates of the search word according to the recognition reliability ; (d) extracting, by the controller, candidate words that are the recognition results of the recognition unit according to the goodness of fit as the Internet search word through the search word extracting unit; And (e) searching the Internet through the internet search engine unit and extracting related information by using the search word extracted by the search term extracting unit by the controller; It includes.

As described above, the present invention has the effect of providing information by searching the Internet using information obtained from an image acquired through a camera or a video apparatus.

In addition, the present invention has an effect of directly searching for words or logos in an image to obtain related information, and searching the Internet while watching TV for internet search without a foreign language without a keyboard.

1 is a schematic block diagram according to the prior art;

2 is a schematic block diagram of an apparatus for searching the Internet using information obtained from an image according to an embodiment of the present invention.

3 is an overall flowchart of a search method according to an embodiment of the present invention;

4 is a detailed flowchart illustrating a search word extraction process according to an embodiment of the present invention.

<Description of Drawing>

100: image input unit 200: recognition unit

210: face recognition module 220: place recognition module

230: position recognition module 240: character recognition module

250: animal and animal recognition module 260: object recognition module

270: trademark recognition module 280: recognition DB module

300: search term extraction unit 310: search history storage module

320: Word DB module 330: Word addition module

340: suitability judgment module 400: Internet search engine

500: display unit 600: control unit

The features and advantages of the present invention will become more apparent from the following detailed description based on the accompanying drawings. Prior to this, the terms or words used in the present specification and claims are defined in the technical spirit of the present invention on the basis of the principle that the inventor can appropriately define the concept of the term in order to explain his invention in the best way. It should be interpreted to mean meanings and concepts. In addition, when it is determined that the detailed description of the known function and its configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, it should be noted that the detailed description is omitted.

Hereinafter, with reference to the accompanying drawings will be described in detail the present invention.

An apparatus for searching the Internet using information obtained from an image according to an embodiment of the present invention will be described with reference to FIG. 2 as follows.

2 is a schematic block diagram of an apparatus for searching the Internet using information obtained from an image according to an embodiment of the present invention.

As shown in FIG. 2, an apparatus for searching the Internet using information obtained from an image according to an embodiment of the present invention includes an image input unit 100, a recognition unit 200, a search term extractor 300, and an Internet search. The engine unit 400, the display unit 500, and the controller 600 are included.

First, the image input unit 100 performs a function of receiving an image from an external image acquisition device such as a camera or a video camera.

In addition, the recognition unit 200 recognizes a face region, a place, GPS information, an object, and a trademark among the images received by the image input unit 100, compares the preset data with the preset data, and compares the result to recognition confidence. This function outputs a word in text form.

Recognition unit 200 performing this function is a face recognition module 210, a place recognition module 220, a position recognition module 230, a character recognition module 240, a flora and fauna recognition module 250, an object recognition module ( 260, a trademark recognition module 270, and a recognition DB module 280. In this case, the preset data includes information about a face photograph, a background photograph, a place, GPS information, a text, a dictionary, a term list, an object, a trademark, and the like, and information on a text name for the information.

First, the recognition DB module 280 is a face recognition module 210, place recognition module 220, position recognition module 230, character recognition module 240, flora and fauna recognition module 250, object recognition module 260 In order to compare the data on each recognition result of the trademark recognition module 270, information on the face, background, place, GPS information, text, dictionary, glossary, object, trademark, etc. This function saves the text name of the information in the database and sets it in advance. Here, the recognition DB module makes a dictionary or a list of frequently appearing terms in order to increase the recognition result.

The face recognition module 210 recognizes a face region among the images received through the image input unit 100, compares the face region with data preset in the recognition DB module 280, and extracts the name of the person in a text form. .

The place recognition module 220 recognizes the background of the image from the received image, compares it with data preset in the recognition DB module 280, and extracts the place name into a text word.

When the location recognition module 230 is an image acquired by a camera equipped with a GPS, the GPS information is compared with data preset in the recognition DB module 280, and the corresponding location name is extracted as a text word.

The character recognition module 240 recognizes a character area among the received images, compares the character area with data preset in the recognition DB module 280, and extracts the corresponding character string into a text word.

The flora and fauna recognition module 250 recognizes the flora and fauna area of the received image and compares the flora and fauna area with the data set in the recognition DB module 280 to extract the name of the flora and fauna as a word in text form.

The object recognition module 260 recognizes an object from the received image, compares it with data preset in the recognition DB module 280, and extracts a general name of the corresponding object as a text word.

The trademark recognition module 270 recognizes a trademark among the received images, compares the trademark with data preset in the recognition DB module 280, and extracts the name of the corresponding company as a text word.

Since the recognition unit 200 according to the present embodiment has a plurality of faces, objects, and the like in the received image, and may describe the same image in another aspect, a plurality of recognitions having different confidence in one image may be described. The result is a candidate of the search term.

In addition, the search word extractor 300 selects and extracts candidate words output from the recognizer 200 as search terms according to a goodness of fit as an Internet search term. The search term extracting unit 300 performing such a function is a search history storage module 310 for storing a search portal history, a word DB module 320 for constructing a plurality of words into a database, and candidates from a database built in the word DB module. A word adding module 330 for adding words similar to words, and a fitness determining module 340 for determining a goodness of fit from the search history.

Here, the possibility as a search term of the Internet, that is, suitability is determined in consideration of the meaning of a word and the linguistic function of the word, and proper nouns have high suitability as search terms, while common nouns and functional words are less suitable as search terms. Is common. There are individual differences according to the user's age, education, occupation, hobbies, etc., and there are ups and downs according to the current class. Therefore, the goodness of fit as the search word is preferably extracted from the history of the search portal. In addition, since a search term is used in several meanings, an additional search term may be added to differentiate the meaning of the extracted search term. As an example, after recognizing a picture of a fruit and handing it to a search engine called 'Apple', the search results of a computer company can be avoided by adding the term 'fruit' to avoid most cases about computer companies. Since a number of candidate words are extracted with different reliability, they are combined to select the most probable, that is, the good fit, as an Internet search term.

In addition, the Internet search engine unit 400 performs a function of searching the Internet using the search word extracted by the search word extracting unit 300 and providing related information according to relevance. In this case, the relevance according to the present embodiment may be regarded as having a relatively high relevance among a plurality of related information searched using a search word, in which the search word frequency in the related information is relatively higher than other related information.

In addition, the display unit 500 displays the results searched by the Internet search engine 400 in order of recognition reliability of the recognition unit 200, suitability of the search word extractor 300, and relevance of the Internet search engine 400. Follow the function to output the list.

The controller 600 controls the image input unit 100, the recognition unit 200, the search word extracting unit 300, the internet search engine unit 400, and the display unit 500.

The present invention has the effect of providing information by searching the Internet using information obtained from an image acquired through a camera or a video device.

In addition, the present invention has the effect of obtaining the personal information of the actor from the photo or video of the actor, and the tourist information from the photo or video of the famous feature.

In addition, the present invention has the effect of receiving the information of the product or store using wireless communication when taking the image of the signboard on the street.

In addition, the present invention obtains the information searched by the camera when the word is recognized by the camera when the word comes out when you do not know the book, in this case it is possible to input the search word in various languages without using a multilingual keyboard, multilingual Internet using the same It is effective to search.

In addition, the present invention has an effect of directly searching for words or logos in an image to obtain related information and searching the Internet for a foreign language without a keyboard.

Meanwhile, a search method (hereinafter, referred to as a 'search method') using an apparatus for searching the Internet using information obtained from an image according to an embodiment of the present invention will be described with reference to FIG. 3.

3 is an overall flowchart of a search method according to an embodiment of the present invention.

As shown in FIG. 3, the controller 600 receives an image from the external image acquisition device through the image input unit 100 (S2).

Next, the control unit 600 includes a face recognition module 210, a place recognition module 220, a position recognition module 230, a character recognition module 240, a plant and animal recognition module 250, an object recognition module 260, and a trademark. In order to compare the data of each recognition result of the recognition module 270, among the received images, information on the face photograph, background photograph, place, GPS information, text, dictionary, term list, object, trademark, etc. Set the text name in advance to build a database (S4).

Next, the controller 600 recognizes a face photo, a background photo, a place, GPS information, a dictionary, a term list, an object, and a trademark among the received images, the face recognition module 210 and the place recognition module 220 of the recognition unit 200. The position recognition module 230, the character recognition module 240, the animal and animal recognition module 250, the object recognition module 260 and the trademark recognition module 270 are recognized through the operation (S6).

Next, the control unit 600 compares the results recognized by the recognition modules 210 to 270 with data previously set as a database in the recognition DB module 280 and compares the words in text form with candidates for the search words according to the recognition reliability. Extracted as (S8).

Next, the controller 600 extracts the candidate words, which are the recognition results of the recognition unit 200, according to the goodness of fit as the Internet search word through the search word extractor 300 (S10).

Next, the controller 600 searches the Internet through the internet search engine 400 using the search word extracted by the search word extractor 300, and extracts related information according to the relevance (S12).

The controller 600 outputs the related information extracted by the internet search engine 400 through the display 500 (S14). Here, referring to step S14 in detail, the control unit 600 displays the extracted related information through the display unit 500, the recognition reliability of the recognition unit 200, the suitability of the search word extractor 300, and the Internet search engine unit ( The list is printed in the order of relevance of 400).

And, the search word extraction process according to an embodiment of the present invention will be described in detail with reference to FIG.

4 is a detailed flowchart illustrating a search word extraction process according to an embodiment of the present invention.

As shown in FIG. 4, the controller 600 stores the search portal history through the search history storage module 310 of the search word extractor 300 (S22).

Next, the controller 600 adds words similar to the candidate words that are the results of the recognition unit 200 through the word adding module 330 of the search word extractor 300 from the word DB module 320 (S24).

The controller 600 determines whether the fitness is suitable as an internet search term from the search portal history stored in the search history storage module 310 through the fitness determination module 340 and extracts the search word according to the fitness (S26).

Claims (10)

In the device for searching the Internet using the information obtained from the image, An image input unit which receives an image from an external image acquisition device; A recognition unit which recognizes an image input by the image input unit, compares the image with preset data, and outputs the result as words in text form according to recognition reliability; A search word extracting unit which stores a search portal history, adds words similar to words output from the recognition unit, determines a goodness of fit from the search portal history, and selects and extracts a search word as a result; An internet search engine that searches the Internet using the search word extracted by the search word extractor and extracts related information according to relevance; And A control unit controlling the image input unit, the recognition unit, the search word extracting unit, and the Internet search engine unit; Apparatus for searching the Internet using information obtained from an image comprising a. The method of claim 1, A display unit for outputting a result searched by the Internet search engine unit according to the recognition reliability, goodness of fit, and relevance; Apparatus for searching the Internet using the information obtained from the image, characterized in that it further comprises. The method of claim 1, The recognition unit, A face recognition module for recognizing a face region among the images received through the image input unit and extracting a person's name as a word in a text form by comparing the data set in the recognition DB module; A place recognition module for recognizing a background of an image among the images input through the image input unit, and extracting a corresponding place name as a word in a text form by comparing with the data preset in the recognition DB module; A recognition DB module which presets and stores data including information on an input image and a text name for the information, in order to compare the recognition results of the face recognition module and the place recognition module; Apparatus for searching the Internet using information obtained from an image comprising a. The method of claim 3, wherein The recognition unit, When the image received through the image input unit is an image acquired by the GPS-equipped image acquisition device, the position to recognize the GPS information, and to extract the corresponding position name as a text-type word by comparing with the data preset in the recognition DB module Recognition module; And A character recognition module that recognizes a text area among the images input through the image input unit, compares the text area with data preset in the recognition DB module, and extracts a corresponding character string into a text word; Apparatus for searching the Internet using information obtained from the image, characterized in that it further comprises. The method of claim 3, wherein The recognition unit, A flora and fauna recognition module for recognizing a flora and fauna area of the image received through the image input unit, comparing the animal and animal area with data preset in a recognition DB module, and extracting a name of the flora and fauna as a textual word; An object recognition module for recognizing an object among the images received through the image input unit, comparing the data set in the recognition DB module, and extracting a general name of the corresponding object as a textual word; And A trademark recognition module that recognizes a trademark among images received through the image input unit, and compares the trademark with data preset in the recognition DB module, and extracts the name of the corresponding company as a text word; Apparatus for searching the Internet using information obtained from the image, characterized in that it further comprises. The method of claim 3, wherein The information about the video, Among the images input through the image input unit, the Internet is obtained using information obtained from an image, including information about a face photograph, a background photograph, a place, GPS information, a text, a dictionary, a term list, an object, and a trademark. Device to search. The method of claim 1, The search word extracting unit, A search history storage module for storing a search portal history; A word DB module for constructing a plurality of words into a database; A word adding module for adding words similar to words output from the recognition unit from a database built in the word DB module; And A suitability determination module for determining a suitability from the search history of the search history storage module; Apparatus for searching the Internet using information obtained from an image comprising a. In a search method using a device that searches the Internet using information obtained from an image, (a) the control unit receiving an image through the image input unit; (b) setting, by the control unit, information about the input image and a text name for the image in advance to build a database in the recognition DB module; (c) the control unit recognizing the input image through the recognition unit, and comparing the input image with the data preset in the database to the recognition DB module and extracts a word of text form as candidates of the search word according to the recognition reliability ; (d) extracting, by the controller, candidate words that are the recognition results of the recognition unit according to the goodness of fit as the Internet search word through the search word extracting unit; And (e) the control unit searching the Internet through an internet search engine unit and extracting related information using the search word extracted by the search term extracting unit; Search method comprising a. The method of claim 8, After step (e), (f) outputting, by the control unit, the related information extracted by the Internet search engine unit through a display unit; Search method characterized in that it further comprises. The method of claim 8, In step (d), (d-1) storing, by the controller, a search portal history through a search history storage module of the search word extractor; (d-2) the control unit adding words similar to candidate words that are a result of the recognition unit through the word adding module of the search word extracting unit; And (d-3) determining, by the control unit, a suitability through a suitability determination module, whether the Internet search term is suitable from the search portal history stored in the search history storage module, and extracting a search term according to the suitability; Search method comprising a.