KR101920465B1 - System and method for object identification in outdoor environment - Google Patents

Abstract

The present invention discloses an associated information providing system. More particularly, the present invention relates to an associated information providing system and an information providing server including an information providing server that photographs a subject using a mobile terminal and provides an augmented reality (AR) service based on the identification result.
According to the embodiment of the present invention, by using a plurality of reference images obtained in consideration of various environments rather than one reference image per each recognition object, by performing the image recognition procedure based on the specific point information, It is possible to remarkably improve the accuracy of image recognition.

Description

BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to a system and method for identifying an object in an outdoor environment,

The present invention relates to an object identifying system, and more particularly, to an object identifying system in an outdoor environment including an information providing server that photographs a subject using a mobile terminal and provides an augmented reality (AR) ≪ / RTI >

In accordance with the development of electronic information technology, a variety of forms of AR application program and enhancement that provide realistic and informative information by reflecting the surrounding situation in real time by using a portable mobile terminal such as a smart phone Real service is being proposed.

1A and 1B, when a user takes a signboard 5 installed in a nearby store 4 or the like as a subject through a mobile terminal 1 owned by the user, (6) on the screen (2) to identify the shop (4) by means of an identification means based on the shop (2), to display the main merchandise, coupon, event and marketing of the store And provides various association information 8.

The core technology that determines the performance in such augmented reality application program is a technology that recognizes the signboard 5 accurately and quickly when a signboard is taken by a smartphone.

Particularly, in the prior art, in order to recognize the shops 4 in the vicinity, the signboards 5 of all the stores to be provided with information are stored in advance in the server, and a billboard image taken by the user is stored in the query image The query image is compared with a plurality of reference images stored in the server to find a reference image having the highest degree of similarity to recognize the corresponding signboard 5 and store 4, The association information 8 of the recognized store 4 is augmented on the screen 2 of the mobile terminal 1 and is provided to the user.

According to the above-described method, in order to recognize a signboard, one image for a signboard is used as a reference image for each store, or a reference image including signboards for a plurality of stores together in one image is used.

Accordingly, in the augmented reality service according to the prior art, when one image for a signboard is used as a reference image for each store, when the environment when the reference image is generated and the surrounding environment when the query image is generated, There is a problem that the accuracy of recognition becomes very low.

For example, if an image of a signboard taken in an environment of a sunny weather is registered as a reference image in a specific shop, the probability of failing is conspicuous when the user attempts to recognize the image as a query image through eyes, rain, .

As described above, in the augmented reality service according to the related art, since the signboard of each shop as a subject is registered as a single reference image, the accuracy of image recognition becomes different depending on the surrounding environment such as weather, illumination, and time, It has a negative impact on providing normal service.

Korean Registered Patent No. 10-1423196 (Registration date: July 18, 2014) Korean Patent Publication No. 10-2010-0083961 (published date: July 23, 2010)

SUMMARY OF THE INVENTION The present invention has been conceived to solve the above-described problems, and it is an object of the present invention to provide a search information database using a plurality of reference images in augmenting reality service by photographing a nearby object using a mobile terminal such as a smart phone, There is a problem in providing a stable augmented reality service by drastically improving the accuracy of image recognition of a subject by performing an image recognition procedure based on minutia information.

In addition, the present invention provides an object identification system and method in an outdoor environment capable of realizing a high-quality augmented reality service, in which the accuracy of image recognition is further improved by collecting additional images related to each object from a plurality of mobile terminals and updating the database There is a challenge.

In order to solve the above-described problems, an object identification system in an outdoor environment according to an embodiment of the present invention includes an application program for photographing a subject to generate an image, and requesting association information on the subject using the image One or more mobile terminals; And when the association information is requested from the mobile terminal through the information communication network, the feature point information about the image is calculated, and the feature point information and at least one feature point information about the photographed subject in different environments And an information providing server for extracting association information on the object by comparing the search information with the search information and providing the extracted information to the mobile terminal.

According to an embodiment of the present invention, there is provided a method of identifying an object in an outdoor environment, the method comprising: displaying an image generated by photographing a subject from the mobile terminal, Receiving a request for providing association information using the association information; Generating minutia information for the image; Extracting association information for the subject by comparing the minutia information with search information including at least one minutia information about the photographed subject in different environments; And providing the extracted association information to the mobile terminal.

According to the embodiment of the present invention, by using a plurality of reference images obtained in consideration of various environments rather than one reference image per each recognition object, by performing the image recognition procedure based on the specific point information, It is possible to remarkably improve the accuracy of image recognition.

According to the embodiment of the present invention, not only the system configurator but also additional images and data related to each subject by a plurality of registered users are collected and updated in the database, thereby improving the accuracy of image recognition in an outdoor environment There is an effect that a subject identification system and method of the present invention can be provided.

1A and 1B are views showing an example of augmented reality service of a conventional mobile terminal.
2 is a diagram schematically showing an overall structure of an object identifying system in an outdoor environment according to an embodiment of the present invention.
3 is a diagram illustrating a structure of a mobile device according to an embodiment of the present invention.
4 is a diagram illustrating a structure of an application program of a mobile terminal according to an embodiment of the present invention.
5 is a diagram illustrating a structure of an information providing server of a subject identifying system in an outdoor environment according to an embodiment of the present invention.
6 is a view illustrating a method of identifying an object in an outdoor environment using an information providing server according to an embodiment of the present invention.
7A to 7C are views for explaining an image recognition method of an image processing unit and a database according to an embodiment of the present invention.
8A and 8B are views showing an example of a screen provided by the application program of the mobile terminal according to the embodiment of the present invention.

Prior to the description, when an element is referred to as being "comprising" or "including" an element throughout the specification, it is to be understood that the element may be further comprised of other elements . Also, the terms " unit " and " module ", etc. in the specification mean units for processing at least one function or operation, Software. ≪ / RTI >

Furthermore, the term " embodiment " is used herein to mean serving as an example, instance, or illustration, but the subject matter of the invention is not limited by such example. It is also to be understood that the terms " including, " " having, " and other similar terms are used, but that they do not exclude any additional or different components when used in the claims, Quot; is < / RTI > used in a manner similar to the term " Comprising ".

The various techniques described herein may be implemented with hardware or software, or may be implemented with a combination of both, where appropriate. As used herein, terms such as " Unit " and " module " are likewise equally applicable to computer-related entities such as hardware, a combination of hardware and software, Can be treated as equivalents. Further, in the present invention, both programs and hardware executed in a system including a terminal can be configured in units of modules, and can be recorded in one physical memory, or distributed among two or more memories and recording media.

Hereinafter, a system and method for identifying an object in an outdoor environment according to a preferred embodiment of the present invention will be described with reference to the drawings.

2 is a diagram schematically showing an overall structure of an object identifying system in an outdoor environment according to an embodiment of the present invention.

Referring to FIG. 2, the object identifying system of the present invention includes at least one mobile terminal 100 installed with an application program for photographing a subject to generate an image, and requesting association information on the subject using the image, When the association information is requested from the mobile terminal 100, minutia information about the image is calculated, and minutia information about the image is compared with search information including minutia information about the object constructed in the database to identify the object And an information providing server 300 for extracting association information about the subject and providing the extracted information to the mobile terminal 100. [

The mobile terminal 100 is provided with an application program for providing an augmented reality service. The mobile terminal 100 includes a camera module that allows a user to photograph the surrounding situation in real time, a communication module that connects to the information communication network and communicates data with the information providing server 300 Module. In particular, the mobile terminal 100 provides the augmented reality service by uploading image and location information to the connected information providing server 300 in real time and receiving the associated information. In order to perform such a function, a portable device such as a portable terminal such as a smart phone, a tablet PC, or a notebook computer having the above-described modules mounted thereon may be used as the mobile terminal 100.

The information providing server 300 interlocks with the mobile terminal 100 to determine the position of the mobile terminal 100 using the location information and the image according to the request, analyzes the image through the image recognition technique, Extracts association information on the identified object, and provides the extracted information to the mobile terminal 100.

In order to smoothly perform such functions, the information providing server 300 has a high-level function such as member management for a large number of users, processing of extracting and providing related information through application of image recognition techniques to images, A microprocessor, and a computing device having a large amount of data storage space.

In particular, the information providing server 300 includes a database constructed by using a plurality of reference images related to one subject when extracting association information.

More specifically, the system operator prepares a plurality of reference images photographed with different shooting environments such as day, night, weather, lighting, and angle with respect to a signboard of a shop or the like as a subject, And stores the minutia information calculated based on the minutiae points commonly included in the reference images. Here, the minutiae correspond to shapes of edges and valleys appearing in each image.

Accordingly, the information providing server 300 calculates the minutia information of the query image received from the mobile terminal 100 when the service is provided, and extracts association information on the object by comparing the minutia information with the minutia information stored in the database of the reference image . Herein, the minutia information is obtained by calculating the color change around the minutiae point of the image as a vector value.

According to the above-described structure, the object identifying system in the outdoor environment according to the embodiment of the present invention provides augmented reality service to a plurality of mobile terminals provided with application programs, It is possible to provide a high-quality service.

Hereinafter, a structure of a mobile device included in an object identification system in an outdoor environment according to an embodiment of the present invention will be described with reference to the drawings.

3 is a diagram illustrating a structure of a mobile device according to an embodiment of the present invention.

3, the mobile terminal 100 of the present invention includes a camera module 110 for photographing a subject located in one direction to generate the image, a GPS module 120 for receiving GPS signals from an external GPS system, A communication module 130 for connecting to the information providing server 300 through the information communication network and transmitting image and position information and receiving the related information, an input module 130 for receiving operations by the user when executing the application program 200, An output module 150 for displaying an execution screen of the image and application program 200, a memory 160 for storing the application program 200, and an AP 170 for executing the application program. have.

The camera module 110 photographs a subject in real time according to a user's operation and generates an image to be recognized. The camera module 110 may include a lens, a light emitting device, and an image sensor.

The GPS module 120 receives a GPS signal from an external GPS satellite or the like so that the position of the mobile terminal 100 can be grasped. Particularly, the GPS signal received by the GPS module 120 is used to identify a nearby object according to the current position in the augmented reality service provided by the application program 200 of the present invention.

The communication module 130 is connected to an information providing server through an information communication network and performs data communication. In particular, the communication module 130 transmits a position signal corresponding to an image currently being photographed and a GPS signal at the request of an application program, receives association information according to image recognition using the position signal, and provides an augmented reality service .

The input module 140 plays a role of receiving a user's operation and reflecting it in the driving of the application program. The user can select one of the functions displayed on the screen of the output module 150 to receive the augmented reality service of the present invention and input additional information.

The input module 140 may be integrated with the output module 150 as well as a button mounted on the mobile terminal 100, and may be implemented as a touch panel that recognizes the user's touch.

The output module 150 outputs a screen and sound according to the driving of the mobile terminal 100, and may include a display device and a speaker. In particular, the output module 150 of the present invention displays a screen constituted by an application program including a graphical user interface (GUI), and provides a screen for enhanced peripheral and related information according to the photographing.

The output module 150 may be implemented as a small-sized liquid crystal display device (LCD), an electrophoretic device (EPD), and an organic electroluminescent device (OLED) suitable for small portable computing devices.

The memory 160 may store an operating system (OS) and other programs for driving the mobile terminal 100 and an application program 200 according to an embodiment of the present invention. Lt; / RTI >

Such a memory 160 corresponds to a memory provided in a conventional computing device, and may be constituted by a read only memory (ROM) and a random access memory (RAM) or the like.

In addition, the application program 200 may include a plurality of components for performing respective functions related thereto. The configuration of the application program 200 will be described later in detail.

AP 170 may be a system on chip (SOC) suitable for a portable terminal including a central processing unit (CPU) and a graphics processing unit (GPU) Other programs and the application program 200 of the present invention to provide the augmented reality service and to control each module mounted on the mobile terminal 100. [

According to the above-described structure, the mobile terminal of the related information providing system according to the embodiment of the present invention can photograph a subject such as a shop signboard around the user and display the related information with improved accuracy in real time.

Hereinafter, an application program installed in a mobile device of an object identification system in an outdoor environment according to an embodiment of the present invention will be described with reference to the drawings.

4 is a diagram illustrating a structure of an application program of a mobile terminal according to an embodiment of the present invention.

4, an application program 200 of the present invention acquires a GPS signal from an acquiring unit 210, a GPS module 120 that acquires an image from a camera module 110, A position determination unit 220 for generating the acquired position information, a terminal communication unit 230 for transmitting and receiving data to and from the information providing server through the communication module 130, an interface providing unit 230 for receiving the operation of the user, (240), and an association information providing unit (250) for adding the association information received from the terminal communication unit (230) to the in-progress augmented reality method.

In addition, the application program 200 according to the embodiment of the present invention may further include a user participation unit 270 for receiving the additional image and data related to the subject from the user, generating the participation information, and providing the participation information to the information providing server have.

The image acquisition unit 210 receives the image generated by the camera module 110 and the position determination unit 220 determines the position of the current mobile terminal in response to the GPS signal received by the GPS module 120. [ .

The terminal communication unit 230 is connected to the information communication network through the communication module 130 and performs data communication with the information providing server to transmit and receive various data for providing the augmented reality service.

The interface providing unit 240 receives the operation of the user input through the input module 140 and reflects the operation of the application program 200 in execution.

When the camera module 110 is activated and an image photographed therefrom is transmitted to the image acquisition unit 210, the association information providing unit 250 provides the association information to the image acquisition unit 210, When the coordinate information is transmitted to the information low-floor server through the terminal communication unit 230 and the related information is received, the image is output to the output module through the interface providing unit 240.

In addition, the application program 200 of the present invention may include a user participation unit 270 to induce active participation of users, and the user participation unit 270 may include additional images related to the subject input by the user and related And transmits the generated participation information to the information providing server through the terminal communication unit 230. [

According to the above-described structure, the application program of the present invention can request and request the respective modules provided in the mobile terminal to receive and provide association information through data communication with the information providing server.

Hereinafter, an information providing server included in a subject identification system in an outdoor environment according to an embodiment of the present invention will be described with reference to the drawings.

5 is a diagram illustrating a structure of an information providing server of a subject identifying system in an outdoor environment according to an embodiment of the present invention.

5, an information providing server 300 according to an exemplary embodiment of the present invention includes a server communication unit 310 for transmitting and receiving data to and from a mobile terminal 100, An associative information management unit 320 for generating and providing association information, an image processing unit 330 for generating minutia information in which a color change around the minutiae point of the image is calculated as a vector value, minutia information, and a plurality of reference images An image determination unit 340 for comparing the search information including the generated minutia information and extracting association information about the image, and a database 350 in which search information is stored.

In addition, the information providing server 300 according to the embodiment of the present invention includes a participation information collection unit 360 for collecting participation information for each user when the participation information is received from the mobile terminal 100, And a data updating unit 370 for updating association information in the database 350 using one or more additional images and data.

The server communication unit 310 is connected to the mobile terminal 100 through the information communication network and receives the image in response to the association information request and transmits the association information to the mobile terminal 100 as the response.

In addition, the server communication unit 310 can transmit and receive various data for providing the augmented reality service.

When the information providing server 300 is requested to provide association information from the mobile terminal 100, the association information management unit 320 generates minutia information about the image received through the image processing unit 330 and transmits the minutia information to the image determination unit 340 And receives the association information on the identified object based on the minutia information, and provides the association information through the server communication unit 310.

The image processing unit 330 generates minutia information about the received image. The feature point information is obtained by calculating a vector value between a plurality of pixels around a feature point of a target image. The feature point information can be used to determine characteristics of an image and is used as a comparison object with search information on various objects constructed in the database.

To this end, the image processing unit 330 includes a color value extractor 331 for digitizing the tone value of each pixel included in the image feature point, and a vector converter 332 for calculating a vector value corresponding to the relationship between the tone values can do.

The image determining unit 340 compares the feature point information of the image with the search information defining the feature points of the images of the plurality of subjects stored in the database 350 by the image processing unit 330, The related information is extracted. Here, the image determining unit 340 first specifies search information corresponding to the position information, and finally selects a matching subject among the specified search information.

The database 350 stores search information including minutia information calculated in advance for a plurality of subjects. In the table of the database 350, fields such as an identification code, minutia information, association information, and position data of each object are stored. When a subject is identified, association information belonging to the object is extracted.

That is, in the present invention, a query image and a reference image may exist for one subject, minutia information about a query image to be searched at present and minutia information about a reference image constructed in advance in the database 350 are compared with each other, Thereby identifying a subject.

Also, in the database 350, setting values and other data for driving the information providing server 300 may be stored.

Meanwhile, the information providing server 300 according to the embodiment of the present invention encourages the participation of the user. In this configuration, the participation information collection unit 360 collects participation information transmitted from a plurality of mobile terminals 100 It plays a role. Here, the participation information may include one or more additional images for a predetermined subject created by users and related data for the subject.

The data updating unit 370 updates the information in the database using the collected participation information.

Also, although not shown, the information providing server 300 may further include a member management unit that processes a membership registration, management, and authentication procedures for a plurality of users.

According to the above structure, when the information providing server according to the embodiment of the present invention is requested to provide association information from one or more mobile terminals, the information providing server calculates the minutia information of the image provided therefrom, It is possible to provide the mobile terminal with the association information corresponding to the image by performing more accurate image recognition as compared with the search information including the minutia information of the image.

Hereinafter, a method of identifying an object in an outdoor environment using an information providing server according to an embodiment of the present invention will be described with reference to the drawings.

6 is a view illustrating a method of identifying an object in an outdoor environment using an information providing server according to an embodiment of the present invention.

Referring to FIG. 6, a method for identifying a subject according to an exemplary embodiment of the present invention is a method for identifying a subject using an information providing server linked to a mobile terminal, the method comprising: receiving a request for providing association information using an image generated by capturing a subject from a mobile terminal (S110) generating minutia information about the image, extracting association information about the object constructed in the database using the minutia information (S120), and providing the extracted minutia information to the mobile terminal S130).

The step S100 of receiving the association information using the generated image by photographing the subject from the mobile terminal is a step in which the server communication unit of the information providing server receives a request for providing related information from the mobile terminal registered as a member through the information communication network , And receives the generated image by photographing the subject.

Next, the step of generating minutia information for the image (S110) is a step of generating minutia information through the image processing unit with respect to the image received by the related information management unit.

In particular, in the above-described step S110, the color value extractor may include a step of quantizing the tone value of each pixel included in the image feature point, and a step of calculating a vector value corresponding to the relationship between the tone values of the vector converter .

Subsequently, the step of extracting association information on the object constructed in the database using the minutia information is performed by referring to the database based on the minutia information generated by the image determination section of the information providing server, thereby identifying the corresponding object And extracting association information therefor.

In operation S130, the extracted association information is provided to the mobile terminal. In operation S130, the association information manager provides the association information extracted in operation S120 to the mobile terminal through the server communication unit.

Meanwhile, although not shown, in the method of identifying an object in an outdoor environment according to an exemplary embodiment of the present invention, a mobile terminal receives additional images and data related to a subject from a user in accordance with participation of a plurality of registered users, The method includes the steps of: generating association information from a mobile terminal; collecting participation information for each user when participation information is received; updating association information in the database using one or more additional images and data included in the participation information; .

In addition, the system configurator can actively encourage the participation of users and give virtual points according to the number of participation, etc. in order to benefit.

According to the above-described steps, the augmented reality service is provided to a plurality of mobile terminals, and the augmented reality service is provided to each mobile terminal by performing a procedure that is an image based on a plurality of reference images through the feature point information of an image photographed therefrom .

Hereinafter, an image recognition method using an image processing unit and a database according to an embodiment of the present invention will be described with reference to the drawings.

7A to 7C are views for explaining an image recognition method of an image processing unit and a database according to an embodiment of the present invention.

7A to 7C, according to an embodiment of the present invention, feature point information is calculated using a plurality of reference images (a, b, c) photographed in a plurality of directions with respect to one subject 5, You can build a database using this.

The query image received by the mobile terminal may be photographed not only in the front direction but also in the right and left directions, or may be distorted due to external light and occluded due to weather such as snow or rain depending on the surrounding situation. (A), (b), (c), and the like, and the image processing unit obtains a vector value corresponding to the color change of the pixels around the feature point included in each of the reference images And generates minutia information based on the generated minutia information.

In particular, the feature point information used in the embodiment of the present invention is made up of vector values for one or more feature points appearing in the reference image.

For example, when the minutia information of a signboard for each of a plurality of stores is registered in the database, it is preferable that N (N is a natural number of 2 or more) When the minutia information is registered, the size of the database is increased by N times. In view of the performance of the image recognition technology operating in the search mode, the search time is further delayed and the search accuracy is lowered .

In order to solve such a disadvantage, in the embodiment of the present invention, a feature point having a high repeatability and a feature point having a good distinctiveness are used as specific point information for a plurality of reference images.

The reproducibility described above is advantageous for the search as the probability that the specific feature points are detected at the same position even if they are different from each other, and the discrimination power indicates that the feature point having a large difference from the other feature points is advantageous for the search.

7A, feature point information of a reference image stored in a database uses feature points included in a plurality of reference images (a, b, c) photographed in various environments for the subject, There is a highly reproducible vector value F1 that is common to the reference images a, b, and c, even though the imaging environments are different from each other. The vector value F1 is used as the feature point information.

Assuming that a specific vector value F2 among the minutiae points of a plurality of reference images a, b, and c for one object does not appear in the reference images for other objects as well as the other reference images b and c Since these non-common vector values can be used to identify the subject as a unique value having a high discriminating power, in the embodiment of the present invention, such a vector value F2 having such good discriminating power is used as minutia information .

However, if the specific vector value F3 among the minutiae points of the plurality of reference images a, b and c does not appear in the other reference images a and c but appears in the reference image for the other object, (F3) has low reproducibility and low discrimination power, it is not used as minutia information and is not reflected in the database.

Therefore, an efficient database is constructed by using the minutiae point F1, which is the basic data required to identify the subject, and the minutiae F2 to improve the search performance, except for the unnecessary vector value F3.

Referring to FIG. 7B, as an example, the color value extractor of the image processing unit constructs a color matrix (MT) by digitizing the colors of the pixels around each reference image feature point into 256 tone values in the case of 8 bits according to the image expression power.

In this color matrix (MT), black can be displayed in O gradation and white can be displayed in 255 gradation, and color change can be confirmed.

Also, the vector converter calculates a vector value by using the amount of change of the tone value of the color matrix (MT). The vector value itself is the minutia information, and this information represents the minutia point pattern. a, b, c of the subject 5 to identify one subject 5.

7C illustrates a table (T) structure of search information of a database using the above-described minutia information. As a search information, a table T for one object includes an identification code (ID) of a subject, feature data ), Association data (Relation data), and location data (Location data), and the image determination unit specifies the identification code with reference to the coordinate value of the position data, The vector value is compared with the vector values (V1, V2, ...) of the specified minutia data to determine the final identification code, and the associated data is extracted.

Hereinafter, the technical idea of the present invention will be described with reference to an example of a screen displayed according to execution of an application program installed in a mobile terminal according to an embodiment of the present invention.

8A and 8B are views showing an example of a screen provided by the application program of the mobile terminal according to the embodiment of the present invention.

8A and 8B, when an application program is executed according to an operation of a user, the mobile terminal 100 according to an exemplary embodiment of the present invention transmits an application program to the mobile terminal 100 through a camera module (not shown) Direction and can generate an image, and the user can receive the augmented reality service by taking the signboard 5 installed in his / her desired shop or building 4 as a subject.

Here, the application program sends the location information that is currently being photographed and the image of the photographing to the information providing server to request the association information. The information providing server specifies the search target first according to the location information, To identify the signboard 5 and provide associated information. At this time, the association information received by the mobile terminal 100 may be displayed on the one side of the screen W100 in the form of a notification window W101 or the like.

Also, according to the embodiment of the present invention, the user can participate in the augmented reality service through selection of the user participation icon W102 displayed on one side of the screen W100. When the user participation icon W102 is selected, the user participation screen W110 may be displayed on the mobile terminal 100 as shown in FIG. 8B.

The user participation screen W110 includes an upload window W111 for adding one or more images of the shop through the mobile terminal 100 and an input window W111 for inputting information related to the business of the corresponding signboard 5 in a text form And a window W112.

The user can input personal opinions, reviews, and other information related to the company through the input window W112 using the mobile terminal 100 of the user.

The mobile terminal 100 generates participation information by reflecting contents uploaded or inputted through the user participation screen W110, and transmits the participation information to the information providing server.

While a great many are described in the foregoing description, it should be construed as an example of preferred embodiments rather than limiting the scope of the invention. Accordingly, the invention is not to be determined by the embodiments described, but should be determined by equivalents to the claims and the appended claims.

100: mobile terminal 110: camera module
120: GPS module 130: Communication module
140: input module 150: output module
160: memory 170: AP
200: Application program 210: Image acquisition unit
220: position determination unit 230: terminal communication unit
240: interface providing unit 250: related information providing service
270: user participation unit 300: information providing server
310: server communication unit 320: association information generation unit
330: Image processing unit 340:
350: Database 360: Participation information collecting section
370:

Claims (9)

At least one mobile terminal installed with an application program for photographing a subject to generate an image, and requesting association information on the subject using the image; And
The method includes the steps of: calculating minutia information of the image when receiving the association information from the mobile terminal through an information communication network; and storing the minutia information in an environment in which one of time, weather, Associating information on the subject is extracted by comparing search information that is commonly displayed among a plurality of feature points of a plurality of photographed subjects or that includes one or more minutiae information that is uniquely displayed among a plurality of feature points of a plurality of subjects And an information providing server provided to the mobile terminal,
The information providing server,
A server communication unit for transmitting and receiving data to and from the mobile terminal;
An association information management unit for generating and providing association information corresponding to image and position information received from the mobile terminal;
An image processing unit for converting the color change of the image into a vector value and generating the minutia information based on the vector value;
An image determining unit for comparing the minutiae information with search information generated using a plurality of reference images and extracting association information for the subject; And
And a database in which the retrieval information is stored,
Wherein the image processing unit comprises:
A color value extractor for forming a color matrix by digitizing the tone values of the pixels included in the image; And
And a vector converter for calculating the vector value using a change amount of the tone value of the color matrix,
Wherein the table of search information includes a field of an object identification code, minutia information, association data, and position data,
The image judging unit judges,
The identification code is identified by referring to the coordinate value of the position data, the vector value included in the minutia information of the query image is compared with the vector value of the specified minutia information, and the final identification code is determined to extract the association information. Object identification system. The method according to claim 1,
The mobile terminal comprises:
A camera module for photographing the subject located in one direction and generating the image;
A GPS module for receiving a GPS signal from an external GPS system;
A communication module for accessing the information providing server through an information communication network, transmitting the image and position information, and receiving the association information;
An input module that receives an operation by a user when the application program is executed;
An output module for displaying an execution screen of the image and the application program;
A memory in which the application program is recorded; And
The AP executing the application program
Wherein the object identification system comprises: 3. The method of claim 2,
The application program includes:
An acquiring unit acquiring an image from the camera module;
A position determination unit for obtaining the GPS signal from the GPS module and generating position information on which the image is acquired in correspondence with the GPS signal;
A terminal communication unit for transmitting and receiving data to and from the information providing server through the communication module;
An interface providing unit for receiving a user's operation and providing an execution screen; And
An associative information providing unit for associating the association information received from the terminal communication unit with the in-
Wherein the object identification system comprises: The method of claim 3,
The application program includes:
A user participation module for requesting the camera module to receive additional images and data related to the subject from a user to generate participation information,
Further comprising: an object recognition system for identifying an object in an outdoor environment. delete delete 5. The method of claim 4,
The information providing server,
A participation information collection unit for collecting the participation information for each user when the participation information is received from the mobile terminal; And
A data update unit for updating search information in the database using one or more additional images and data included in the participation information,
Further comprising: an object recognition system for identifying an object in an outdoor environment.
delete delete

Images