KR101193485B1 - Method, system and computer readable recording medium for recognizing multiple information using mobile camera and searching using the same - Google Patents

Abstract

The present invention relates to multiple information recognition using a mobile camera, a search method, a system and a computer readable recording medium using the same. According to an aspect of the present invention, a multi-information recognition using a mobile camera and a search method using the same, the step of reading whether there is primary information based on the search information received from the mobile communication terminal, the read result primary information Is present, extracting the characters or symbols included in the search information and converting them into machine-readable characters or symbols, performing a search using the converted characters or symbols as secondary information, and performing the search. And transmitting the search result according to the mobile communication terminal.

Description

Recognition of multiple information using a mobile camera, search method using the same, system and computer readable recording medium {METHOD, SYSTEM AND COMPUTER READABLE RECORDING MEDIUM FOR RECOGNIZING MULTIPLE INFORMATION USING MOBILE CAMERA AND SEARCHING USING THE SAME}

The present invention relates to multiple information recognition using a mobile camera, a search method, a system, and a computer-readable recording medium using the same, and more particularly, to identify a search phrase, that is, a keyword, to be searched through additional information that can be easily recognized. And a method, system, and computer readable medium for facilitating, and providing a search result for the specified keyword to a user via a mobile communication terminal.

In recent years, as the use of the Internet has become more common, users can obtain various information through Internet searches. In other words, the user enters an identifier such as a URL (Uniform Resource Locator) into the address bar of a web browser through a terminal device such as a personal computer that can access the Internet, and then accesses an Internet search site and searches for a search phrase that he / she wants to check. By entering, you can see search results related to various fields such as news, knowledge, games, and community.

In addition, mobile communication terminals, which previously focused solely on the call function, have evolved, and many performance improvements have been made in hardware such as a small computer. It provides an external camera attached via wired or wireless connection. In addition, the App Store (Appstore) or Google's Android Market that works with Apple's iPhone has appeared to show a variety of applications that can be installed in the mobile communication terminal and work in conjunction with the internal / external camera.

However, in spite of the development of this technology, when a user wants to check a search result for a specific search phrase through a mobile communication terminal, the user directly accesses a search site through a web browser and inputs a search phrase or a search developed by the search site. There has been a problem in that a specific application program such as a bar is installed in a mobile communication terminal and a search phrase must be directly input.

Of course, OCR (Optical Character Reader) has appeared to perform character recognition on the image input through the camera installed in the mobile communication terminal, using this technology to recognize the characters in the business card without having to scan the card separately The application for storing the contact information inside the mobile communication terminal has already been developed, but the character recognition technology has not been developed until now, which shows search results through direct search phrases. It's a technology that converts to, stores, and indexes data.

In addition, if an advertiser wants to promote his website but only promotes a search phrase having his website address, the only way for the mobile terminal user to enter the phrase is because it is inconvenient. Due to this, there was a problem that the number of users who access directly was not large.

To solve this problem, a two-dimensional barcode called a one-dimensional barcode or QR (Quick Response) code containing specific information therein according to a barcode recognition technology is input and analyzed through a camera installed in a mobile communication terminal, and is present in the interior thereof. A technology for extracting specific information is developed so that a user who owns a mobile communication terminal can view information embedded in the information or navigate to a specific web page by illuminating or photographing a corresponding barcode through a camera. However, since the barcode itself is only a material that encodes specific information, it does not serve to convey advertising effect or interest to the user by itself. As a result, there is a disadvantage that the advertising effect is poor.

An object of the present invention is to solve the above-mentioned problems of the prior art.

One object of the present invention is to increase the recognition rate in image search using a mobile camera.

In addition, another object of the present invention is a familiar search box through a search using a conventional personal computer to search phrases promoting web pages to be advertised from the advertiser's point of view, which can be interesting to the user recognized By providing a form and / or a letter or a figure, the function of increasing the advertisement effect through an easy access of the user is provided.

Further, another object of the present invention is to provide a function of easily displaying a search result from a mobile camera of a mobile communication terminal without additional input from an advertisement or information that is of interest to the user.

In addition, another object of the present invention is to provide a web page advertising means and a billing service according to the advertiser so that the user can easily search and access through the mobile communication terminal from the point of view of the search service provider.

In order to achieve the above-described object of the present invention and to achieve the specific effects of the present invention described below, the characteristic structure of the present invention is as follows.

According to an aspect of the present invention, a multi-information recognition using a mobile camera and a search method using the same, the step of reading whether there is primary information based on the search information received from the mobile communication terminal, the read result primary information Is present, extracting the characters or symbols included in the search information and converting them into machine-readable characters or symbols, performing a search using the converted characters or symbols as secondary information, and performing the search. And transmitting the search result according to the mobile communication terminal.

According to another aspect of the present invention, a multi-information recognition using a mobile camera and a search method using the same, performing a search using the secondary information received from a mobile communication terminal and the search results according to the search to the mobile communication terminal Transmitting the received information or the photograph or image received or taken through the mobile camera as search information, and whether the primary information exists based on the input search information. Reading whether or not; And if the primary information is found as a result of the reading, extracting a character or symbol included in the search information and converting the character or symbol into secondary information which is a machine-readable character or symbol.

According to still another aspect of the present invention, a multi-information recognition using a mobile camera and a search system using the same include a search module for performing a search using secondary information received from a mobile communication terminal and a search result according to the search. And a transmission / reception module for transmitting to a communication terminal, wherein the secondary information is received as a search information from a picture or an image received or taken through the mobile camera connected to the mobile communication terminal, and if the primary information exists. And a machine readable character or symbol included in the search information.

As described above, according to the present invention, a search phrase that promotes a web page to be advertised from an advertiser's point of view in which a user can recognize and induce interest is searched through a conventional personal computer. By displaying and providing a window and / or a letter or a figure, a function of increasing an advertisement effect through an easy access of a user may be provided.

In addition, according to the present invention, it is possible to provide a function of easily displaying a search result from a mobile camera of a mobile communication terminal without additional input from an advertisement or information that is of interest to the user.

In addition, according to the present invention, a web page advertising means and a billing service according to the present invention can be provided to an advertiser so that a user can easily search and access through a mobile communication terminal from the standpoint of a search service provider.

1 is a diagram schematically illustrating the overall configuration of a system for providing multiple information recognition using a mobile camera and a search using the same according to an embodiment of the present invention.
2 is a detailed configuration diagram of a mobile search system 100 in which a part or the whole is installed in a user terminal device or a search system according to an embodiment of the present invention.
3 is an exemplary screen illustrating an algorithm for recognizing a search box which is one of forms of primary information according to an embodiment of the present invention.
4 is an exemplary screen illustrating a UI screen displayed when a specific program capable of capturing search information using a mobile camera is executed according to an embodiment of the present invention.
5 is a diagram illustrating various schemes of including tertiary information in search information according to an embodiment of the present invention.
6 is a diagram showing a practical use of the present invention, in accordance with an embodiment of the present invention.

DETAILED DESCRIPTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention.

[Preferred Embodiment of the Present Invention]

In the specification of the present invention, the term "connection" means a broad meaning including not only "directly connected" but also "electrically connected" with another element therebetween. Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

In addition, in the specification of the present invention, the term "mobile camera" includes a lens embedded in the user's mobile communication terminal and a power port, USB port of the user's mobile communication terminal, as well as a camera having a picture and / or video recording function. Or, it should be interpreted as a broad concept including an external camera connected through various wired / wireless means such as Bluetooth.

In addition, in the specification of the present invention, the term "search information" refers to a screen or an image shown through the lens of the mobile camera, or a specific command on the program according to the execution of a specific program that can be photographed using the mobile camera. Refers to information processed by the stored screen or image in a form that can be recognized by a specific program of the mobile communication terminal, and according to an embodiment of the present invention, primary information and secondary information, and, if necessary, tertiary information. Includes up to For example, a JPG file captured by a mobile camera and compressed by a JPEG compression method may be included as one of such search information.

Here, the primary information may be an image, a letter, or a number that is easily recognized by a camera, and the secondary information may be a keyword, that is, a search phrase, which is an actual search target. The tertiary information may be selectively provided and may be an indicator for limiting a search DB or limiting a category. That is, according to the present invention, identification of easy-to-recognition primary information also facilitates recognition of secondary information, that is, a keyword through a correlation algorithm between the primary information and a keyword to be actually searched.

In addition, the description of the preferred embodiment in the specification of the present invention will be described below assuming that the primary information as a search box image and the secondary information as a search phrase, which means that the primary information and the secondary information are respectively the search box and It is not meant to be limited to search phrases.

Complete system configuration

1 is a diagram schematically illustrating the overall configuration of a system for providing multiple information recognition using a mobile camera and a search using the same according to an embodiment of the present invention.

As shown in FIG. 1, the entire system according to an exemplary embodiment of the present invention includes a mobile communication terminal 300 of a plurality of users whose mobile search system 100 drives and executes a mobile camera through a communication network 200. Is connected to.

First, according to an embodiment of the present invention, the mobile search system 100 receives the search information from the mobile communication terminal 300 of the user to extract the search phrase, and then search based on the extracted search phrase It serves to transmit the search results derived as a result to the mobile communication terminal (300). In addition, the mobile search system 100 may additionally have a role of performing a charging according to a search result or a user selecting a specific web page according to the search result.

First, according to an embodiment of the present invention, the communication network 200 may be configured without regard to communication modes such as wired and wireless, and may include a personal area network (PAN) and a local area network (LAN). ), A metropolitan area network (MAN), a wide area network (WAN), and the like. Preferably, the network described in the present invention may be a well-known World Wide Web, or may use a wireless transmission technology used for short-range communication such as infrared data (IrDA) or Bluetooth. have.

In addition, according to an embodiment of the present invention, the user's mobile communication terminal 300 can execute a mobile camera operating program (not shown) connectable to the communication network 200, the search obtained by executing the mobile camera operating program Information may be transmitted to the mobile search system 100 through the communication network 200. According to another embodiment, the mobile camera operation program may process the obtained search information and transmit only the search phrase extracted as a result to the mobile search system 100 through the communication network 200. As a mobile terminal that guarantees portability and mobility, it is a personal communication system (PCS), a global system for mobile communications (GSM), a personal digital cellular (PDC), a personal handyphone system (PHS), a personal digital assistant (PDA), and an international IMT. All kinds of handheld based devices such as Mobile Telecommunication (2000), Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wireless Broadband Internet (Wibro), smartphone terminals, etc. It may include a mobile terminal. In addition, the mobile communication terminal 300 may include a general PC such as a laptop computer, but the present invention is particularly useful for a terminal that is easily portable and mobile.

Mobile search system

2 is a detailed configuration diagram of a mobile search system 100 according to an embodiment of the present invention.

2, the mobile search system 100 according to an embodiment of the present invention is a transmission and reception module 110, information extraction module 120, search module 130, billing module 140 and one or more databases ( 150).

The transmission / reception module 110 receives search information, or search information and tertiary information that is additional information from a specific program of the mobile communication terminal 300, and transmits the search result extracted from the search module 130 to the mobile communication terminal 300. To send.

The information extraction module 120 recognizes a search box that is primary information from the search information received from the transmission / reception module 110 to determine whether it is a suitable search query, and when the search box exists, search that is secondary information required for search from the search information. The phrase is extracted and the extracted search phrase is transmitted to the search module 130 for searching. Here, a plurality of search phrases may exist. In addition, in addition to the received search information, if the received separately tertiary information or tertiary information other than the search phrase is included in the search information, the tertiary information is also transmitted to the search module 130. If the search window is not recognized from the received search information, an error message is transmitted to the mobile communication terminal 300 through the transmission / reception module 110. Detailed functions of each component of the information extraction module 120 will be described later.

The search module 130 searches the database 140 for the search phrase received from the information extraction module 120 or information matching the search phrase and the tertiary information. The search result extracted through the search is transmitted to the transmission / reception module 110 to be sent to the mobile communication terminal 300.

The charging module 140 updates the charging information described in the database 140 when a specific condition occurs. For example, if an advertiser provides an advertisement based on Cost Per Mille (CPM), a search unit 130 based on the extracted search phrase as a keyword, the search module 130 according to the search phrase may be used. Advertisement may be included in the search result of), and the charging module 140 may check the exposure of the advertisement and update the charging information. In addition, it will be apparent to those skilled in the art that the charging module 140 may be used for an advertisement charging scheme based on various methods such as Cost Per Click (CPC) for calculating the advertisement cost per click.

The database 150 may include various types of information collected or stored to provide a search result corresponding to a search phrase. In addition, the database 150 may request information extraction module 120, search module 130, and billing module 140. As a result, the requested information can be provided. The requested information may include user related information, search condition information, and billing information.

Here, the user-related information includes the type of the mobile communication terminal 300, the type and version of a program installed in the mobile communication terminal 300 and transmitting the search information, the file format of the search information, and the IP address of the mobile communication terminal 300. Refers to various information related to the user, which can be used for future statistics or system update purposes, such as (internet protocol address). Search condition information is information that can be used as a search condition to search under a specific condition when searching through a search phrase, for example, a condition that allows a search phrase to be searched only in a community such as a cafe or a blog, or a search phrase in a map service. There may be a condition showing the corresponding location.

Although only one database 150 is shown in FIG. 2, a separate database may be constructed that is physically separated according to the type of information to be stored.

In addition, according to another embodiment of the present invention, in order to reduce the amount of data transmitted through the communication network 200 and the possibility of overloading the mobile search system 100, the information extraction module 120 in the mobile communication terminal 300 Can be located. In this case, the information extraction module 120 recognizes the search box from the search information received using the mobile camera application operating in the mobile communication terminal 300 to determine whether the search box exists, and the search required for the search from the search information. After extracting the phrase, it may perform a function of transmitting to the transmission and reception module 110 of the mobile search system 100 for the search. In addition, if the third information other than the search phrase is included in the separate third information or the search information in addition to the search information, the corresponding third information is also transmitted to the transmission / reception module 110. If the search window is not recognized from the search information, an error message may be displayed on the screen. In this case, it will be apparent to those skilled in the art that the transmission / reception module 110, the search module 130, the charging module 140, and the database 150 may be designed to be interoperable to perform equivalent functions.

Information extraction module

According to an embodiment of the present invention, installed in the mobile search system 100 or the mobile communication terminal 300, the information extraction module 120 for extracting the search phrase and the third information while operating in more detail, The information extraction module 120 may include a primary information recognizer 121, a secondary information converter 122, and a tertiary information extractor 123.

Here, the primary information recognizing unit 121 according to an embodiment of the present invention recognizes the received search information and reads whether a search window that is the primary information exists in the search information by a predetermined algorithm. According to an embodiment of the present invention, as shown in FIG. 3 (a), a search box having a green rectangular border may be used as primary information, and a black background on a white background may be used for searching therein. Secondary information may be used in which specific letter (s) or symbols are described. In the preferred embodiment of the present invention, the primary information is described in the form of a search box. However, in addition to the search box, in the case of easy image recognition and simple image information, all of the information may be applied as primary information. For convenience of recognition, the specific letter (s) of the secondary information may be described in a specific font, but is not necessarily limited thereto, and may be described as handwriting in a manner that is convenient for changing an advertisement. As one of algorithms for recognizing such a search box, as shown in FIGS. 3 (b) to 3 (c), after dividing search information into 12 screens, a color code having the same color code (for example, green) is displayed. When detected in at least eight screens among the divided screens, a method of determining that a search box exists in a received image or image is easy, even if a user does not accurately project a portion corresponding to the search box on the mobile camera. You can recognize the presence. As another search box recognition algorithm, as shown in FIG. 3 (d), a guideline may be provided to align the search box to a specific position of a screen illuminated by the mobile camera, and the guideline may be received when receiving search information. The presence of the search box may be recognized by checking whether the edge of the search box is located near the corresponding position.

In addition, various known image recognition algorithms may be used to recognize the primary information displayed in various ways, and the simplicity of the primary information such as a search box may greatly assist in image recognition.

Next, when the primary information recognizer 121 recognizes the primary information, the secondary information converter 122 may determine a character or symbol (eg, a white color inside the search box) that is determined to be included in the search information. Black letters on the background) are extracted and converted into machine-readable characters or symbols. For such character / symbol conversion, a well-known optical character recognition (OCR) technique may be used. Meanwhile, according to a preferred embodiment of the present invention, the secondary information converter 122 may convert the image into a character or symbol showing a maximum similarity by calculating a similarity between the analyzed feature image and the character or symbol.

In such character / symbol conversion, a character reading database (not shown) may be referenced. The character reading database may further store language, font information, and the like together with information on a commercial character or a commercial symbol corresponding to a character or a symbol of a search phrase that is secondary information represented by an image. The secondary information converter 122 may convert the text represented by the image into each language represented by various fonts by referring to the character reading database.

On the other hand, a number of nonsensical characters or symbols may be extracted during normal character reading. In the present invention, a filtering process for filtering out such nonsense characters or symbols may be additionally performed. That is, with reference to the character reading database in which information on commercial characters or commercial symbols is stored, characters or symbols that do not correspond to commercial characters or commercial symbols may be deleted during the character reading process. To this end, the search phrase filtering unit (not shown) may be additionally included in the secondary information converter 122. The resulting readable characters or symbols are collectively called secondary information and can be used as keywords required for searching. In the preferred embodiment of the present invention, the secondary information is described in the form of a search phrase. However, in addition to the search phrase, all information to be searched may be applied as secondary information.

In addition, among the search phrases resulting from the character read result, it is determined whether a predetermined symbol or character is inserted, and if present, the front and rear parts are divided based on the symbol or character, and some of the search phrases are modified. It can be converted to use the additional information as 3rd order information. For example, when the search phrase derived from the reading result is "Blog-fstory97" and a specific symbol "-" is inserted, the symbol is pre-determined to be used as tertiary information and the symbol as a search phrase. Here, the search phrase may be “fstory97” and the third information may be “blog”.

Lastly, the tertiary information extracting unit 123 according to an embodiment of the present invention includes the tertiary information other than the search phrase in the search information, and separate third order received in addition to the received search phrase. It is determined whether there is information, and if present, it is extracted. Here, the tertiary information may collectively refer to additional information input other than a search phrase that may be used as a keyword required for a search, and may indicate a range, condition, and the like of the search. An embodiment of a UI screen displayed when a specific program that can be photographed using a mobile camera is shown in FIG. 4. The upper part of the screen is shown in conjunction with the mobile camera, and the lower part can select a search condition that is an example of the tertiary information according to the user's selection, in the case of Figure 4 the user is not a search for the site and knowledgein only You can see that the search condition is set to search. According to another embodiment, the UI screen may be configured to select the third information after selecting the search information. However, it should be appreciated that FIG. 4 is merely an example and may be implemented to enable the user to input tertiary information in various ways by implementing various interfaces.

Extraction of Tertiary Information in Search Information

In addition, the tertiary information extracting unit 123 performs a function of determining whether or not tertiary information other than the search phrase is included in the search information. Specific embodiments will be described with reference to FIG. 5. .

5A illustrates an example in which the color code of the search box is set to another color (for example, blue) other than the default green color. The primary information recognizing unit 121 determines only whether a search box exists, but the tertiary information extracting unit 123 determines whether a color corresponding to a color code of the search box is different from a default color (for example, green). By judging, each color code may be recognized as tertiary information (for example, when it is blue, it is recognized as tertiary information to find and show a location of a search phrase on a map).

FIG. 5B shows an example in which a search box is displayed in double and up and down, and there are a plurality of search phrases. In this case, some of the plurality of search phrases may be used as tertiary information, and the rest may be used as search phrases to be searched.

FIG. 5 (c) shows an example in which a plurality of search phrases exist by displaying a search box in double left and right, and a part of the search phrase is used as a condition as tertiary information as in the example of FIG. 5 (b). Can be implemented.

5 (d) and 5 (e) may be implemented so that such an image means separate tertiary information by placing an image corresponding to a specific character on the left side or the left side of the search box.

FIG. 5 (f) shows an icon having a specific meaning inside the left side of the search box, and uses it as tertiary information (for example, when a book icon is recognized, the search phrase is limited to book information. Manner) to search for the search phrase.

The third information extracted through FIGS. 4 and 5 may be used as a search condition for selecting or defining a search range or a search condition.

Practical Use Example

According to the present invention described above, a search using multiple information recognition may be used in various ways, and specific usage examples thereof will be described with reference to FIG. 6.

As shown on the left side of FIG. 6 (a), a search phrase in which a corresponding bus stop number is secondary information includes a search phrase and tertiary information in which a bus icon, which may mean a bus route, is described as tertiary information. The search box, which is the primary information, may be displayed at the bus stop, and when the user illuminates or photographs the search box using a mobile camera, the content is inputted as the search information and is displayed on the right side of FIG. 6 (a). Likewise, the information may be used in a manner of informing about bus information approaching a corresponding bus stop.

Next, referring to the left side of FIG. 6 (b), when a search box including a search phrase "blog-fstory97" and tertiary information is described in a business card, the user illuminates the search box using a mobile camera. Or, when taking a picture, as shown in the right side of Figure 6 (b), it can be moved directly to the blog address having a blog ID fstory97.

As another example, a search box such as the left side of FIG. 6 (c) may be displayed on a signboard of a flower shop, and when the user illuminates or photographs the corresponding search box using a mobile camera, as shown in the right side of FIG. 6 (c). Search results using the search phrase "rose flower shop" can be displayed, and if the advertisement or the site is registered directly, the content can be shown to enhance the advertising effect.

As seen in the various use examples of FIG. 6, according to the present invention, unlike the QR code, which is encoded and cannot be understood by itself, the multiple information used for searching can be directly recognized and understood by the user. / Or symbols can stimulate the curiosity of the user can be improved accordingly. In addition, users do not have to enter a search phrase directly from a search site accessed through a web browser, launch a specific program, and simply search or capture the search information including the search phrase with a mobile camera to obtain a search result. Because of the convenience, the frequency of use may increase due to its convenience, and thus the advertisement effect may be improved.

5 and 6 are merely examples of a combination of primary information, secondary information and tertiary information in search information, and a practical method of using the same, and according to the technical level of the related art and technical common knowledge of those skilled in the art. It should be appreciated that various methods may be used in combination with one or more of the examples of FIGS. 5 and 6, or may be modified to express or use the same or similar functions.

Embodiments according to the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as a hard disk, a floppy disk, and a magnetic tape; optical media such as CD-ROM and DVD; magnetic recording media such as a floppy disk; Includes hardware devices specifically configured to store and perform program instructions such as megneto-optical media and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

In the present invention as described above has been described by the specific embodiments, such as specific components and limited embodiments and drawings, but this is provided to help a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations are possible from these descriptions.

Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

100: mobile search system
110: transceiver module
120: information extraction module
121: primary information recognizing unit
122: secondary information conversion unit
123: third information extraction unit
130: search module
140: charging module
150: DB
200: network
300: mobile communication terminal

Claims (17)

In the multiple information recognition using a mobile camera and a search method using the same,
Reading whether primary information exists based on search information received from a mobile communication terminal;
Extracting a character or symbol included in the search information and converting the character or symbol included in the search information into a machine-readable character or symbol when primary information exists as a result of the reading;
Performing a search using the converted characters or symbols as secondary information; And
And transmitting the search result according to the search to the mobile communication terminal.
The primary information is information for indicating that the search information is searchable information.
The method according to claim 1,
The searching method further comprises the step of updating the charging information in accordance with the transmission of the search results.
The method according to claim 1,
And if the primary information exists as a result of the reading, further extracting tertiary information included in the search information.
The method according to claim 3,
The tertiary information may include color information of the primary information, an image or icon added to the primary information, a part of the secondary information described in a plurality of search boxes of the primary information, and a specific symbol of the secondary information described in the primary information. Or extracted from at least one of a portion separated based on a character.
The method according to claim 3,
And wherein the performing of the search comprises performing at least one of the tertiary information or the tertiary information received in addition to the search information as search condition information.
The method according to claim 1,
The search information is a search method, characterized in that the picture or video received or taken through the mobile camera.
The method according to claim 1,
The primary information present reading step divides the received search information into n (n is an integer greater than or equal to 1) screens, and specifies k (k is an integer greater than or equal to 1 and n> k) screens among the divided n screens. If the color code is detected, it is determined that the primary information exists.
The method according to claim 1,
The primary information present reading step determines that the primary information exists when there is an edge of the primary information at a specific position of the received search information,
Wherein the specific location is a search method, characterized in that the vicinity of the position corresponding to the guidelines provided on the UI (User Interface) screen through the mobile camera.
The method according to claim 1,
The converting step uses an optical character recognition (OCR) technique.
In the multiple information recognition using a mobile camera and a search method using the same,
Performing a search using secondary information received from a mobile communication terminal; And
And transmitting a search result according to the search to the mobile communication terminal.
The secondary information may include receiving a picture or an image received or taken through the mobile camera as search information;
Reading whether or not primary information exists based on the input search information; And
If the primary information is found as a result of the reading, extracting a character or symbol included in the search information and converting the character or symbol into secondary information which is a machine-readable character or symbol;
The primary information is information for indicating that the search information is searchable information.
The method of claim 10,
The searching method further comprises the step of updating the charging information in accordance with the transmission of the search results.
The method of claim 10,
Performing the search by performing at least one of the received tertiary information as search condition information;
Wherein the tertiary information is additionally extracted from the search information or additional information by user selection.
The method of claim 12,
The tertiary information additionally extracted from the search information includes color information of the primary information, an image or icon added to the primary information, a part of the secondary information described in a plurality of search boxes that are primary information, and primary information. Search method, characterized in that extracted from at least one of a portion separated based on a specific symbol or character of the secondary information described.
The method of claim 10,
The primary information present reading step divides the received search information into n (n is an integer greater than or equal to 1) screens, and k (k is an integer greater than or equal to 1, n> k) or more of n divided screens. And determining that primary information exists when a specific color code is detected.
The method of claim 10,
The primary information present reading step determines that primary information exists when there is an edge of primary information at a specific position of the received search information.
Wherein the specific location is a search method, characterized in that the vicinity of the position corresponding to the guidelines provided on the UI (User Interface) screen through the mobile camera.
A computer-readable recording medium having recorded thereon a program for performing each step of the searching method according to any one of claims 1 to 15 on a computer.
In the multiple information recognition using a mobile camera and a search system using the same,
A search module for performing a search by using the secondary information received from the mobile communication terminal; And
And a transmission / reception module for transmitting a search result according to the search to the mobile communication terminal.
Here, the secondary information is input to the search information received from the mobile camera connected to the mobile communication terminal or taken by the search information is included in the search information, if the primary information is present, machine-readable Letter or symbol,
The primary information is information for indicating that the search information is searchable information.

Images