JP2014174159A - Image base database construction method, route search service providing method and device using image base database - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image base database construction method for efficiently performing database construction, and for shortening a route search time.SOLUTION: The image base database construction method includes steps of: acquiring the image of an intersection region; extracting feature information from the acquired image of the intersection region; and storing the extracted feature information in association with the information pertinent to the intersection region. Therefore, it is possible to reduce a resource and time required for database construction, and to provide a quick and convenient route search and route guide service to a user.

Description

  The present invention relates to route search technology, and more specifically, an image base database construction method capable of efficiently constructing a database and shortening route search time, and a route search service providing method and apparatus using an image base database About.

  With the development of location-based service provision technology and video processing technology, map search services such as Google's Street View are actively used.

  In particular, with the spread of smart phones, map search services are indispensable services that are used for route guidance and location search.

  Such a map search service provides an aerial view and a road view using aerial photographs and photographs taken on a road together with a map. Can be confirmed.

  However, current map search services have user convenience issues and user location information confirmation issues.

  First, in relation to the user convenience problem, as pointed out in a previous paper published by Microsoft, there is a problem that it is inconvenient for the user to respond to a change in viewpoint and to search for a position on the road.

  In connection with problems related to user location information confirmation, GPS (Global Positioning System) and wireless positioning technology using base station information, etc. are used for user location information confirmation. There are problems that are difficult to provide.

  As described above, in order to provide an accurate route search in an alley in a road, a method for constructing an image (for example, photo) database using position information is preferentially required.

  There have been many studies for efficient image database construction, but there are problems when there are various photographs at the same position, problems with using geometric correction, problems such as having to create a database for all regions, etc. Still exists.

  In order to solve the problems as described above, an object of the present invention is to provide an image-based database construction method capable of efficiently constructing a database and shortening route search time.

  Another object of the present invention is to provide a route search service providing method using a database constructed through the image-based database construction method.

  Another object of the present invention is to provide an apparatus for performing the route search service providing method.

  According to an image-based database construction method according to an embodiment of the present invention for achieving the above object, in the image-based database construction method performed in the database construction device, a step of obtaining an image of an intersection area, and the obtained intersection Extracting the feature information from the image of the region, and storing the extracted feature information in association with the map information corresponding to the intersection region.

  Here, the step of extracting feature information from the acquired image of the intersection area may extract a local descriptor from the acquired image of the intersection area.

  Here, the step of acquiring an image of the intersection area may be performed at a plurality of preset angles with respect to a structure located in the intersection area at a first time interval.

  The method may further include recognizing the intersection area using at least one sensing information before obtaining the image of the intersection area.

  In order to achieve another object of the present invention, according to a route search service providing method using an image-based database according to an embodiment of the present invention, an image of an intersection area in a route search method performed at a user terminal. Acquiring the feature information from the acquired image of the intersection area, transmitting the extracted feature information to the search management device, and the location of the user terminal received from the search management device Outputting the position information of the intersection including the image.

  Here, after the step of outputting the position information of the intersection including the position image of the user terminal received from the search management device, the straight region in the specific direction selected by the user from the output position information of the intersection The method may further include transmitting a message requesting the information to the search management apparatus, and outputting the information on the straight region in the specific direction received from the search management apparatus.

  Here, after the step of outputting the information on the straight area in the specific direction received from the search management device, additional information on the specific area selected by the user from the output information on the straight area in the specific direction is requested. Transmitting a message to the search management device and outputting additional information for the specific area received from the search management device.

  Here, the additional information for the specific area may include at least one of telephone number information, address information, coupon information, and event information.

  In order to achieve still another object of the present invention, according to a route search service providing method using an image-based database according to an embodiment of the present invention, in a route search service providing method performed by a search management device, Receiving intersection-related information from a user terminal; acquiring intersection position information corresponding to the received intersection-related information from the database; and transmitting the acquired intersection position information to the user terminal. Including.

  Here, in the step of transmitting the acquired intersection position to the user terminal, when there are two or more acquired intersection positions, the two or more intersection positions are configured in a list form and transmitted to the user terminal. be able to.

  Here, the intersection-related information may be an intersection image or feature information extracted from the intersection image.

  Here, obtaining the intersection position corresponding to the received intersection-related information from the database includes extracting a local descriptor from the intersection image when the intersection-related information is an intersection image. And obtaining an intersection position corresponding to the extracted feature information from the database.

  Here, if a non-intersection information request message is received from the user terminal after transmitting the acquired intersection position to the user terminal, the step of acquiring the non-intersection information and the acquired non-intersection information Transmitting to the user terminal.

  Here, after transmitting the acquired non-intersection information to the user terminal, acquiring the additional information of the specific part corresponding to the additional information request message of the specific part received from the user terminal; And transmitting the additional information of the specific part to the user terminal.

  Here, the additional information may include at least one of telephone number information, address information, coupon information, and event information.

  According to the image base database construction method and the route search service providing method using the image base database according to the embodiment of the present invention as described above, an image of a recognized intersection is acquired, and feature information is obtained from the acquired intersection image. After the extraction, a database is constructed by associating the extracted feature information with the map information corresponding to the intersection area.

  Therefore, resources and time required for database construction can be reduced, and a quick and convenient route search and route guidance service can be provided to the user.

FIG. 1 is a conceptual diagram showing a database area for image-based database construction. FIG. 2 is a conceptual diagram illustrating a database area for constructing an image-based database according to an embodiment of the present invention. FIG. 3 is a conceptual diagram for explaining an image base database construction for an intersection area and a database construction method for a non-intersection area according to an embodiment of the present invention. FIG. 4 is a conceptual diagram for explaining image acquisition of a building B according to an embodiment of the present invention. FIG. 5 is a conceptual diagram for explaining non-intersection image acquisition according to an embodiment of the present invention. FIG. 6 is a flowchart for explaining an image-based database construction method according to an embodiment of the present invention. FIG. 7 is a flowchart illustrating a process for providing a route search service using a database constructed according to an embodiment of the present invention. FIG. 8 is a flowchart for explaining a route search service providing method using a constructed database performed in a user terminal according to an embodiment of the present invention. FIG. 9 is a flowchart for explaining a route search service providing method using a constructed database performed by the search management apparatus according to an embodiment of the present invention. FIG. 10 is a block diagram illustrating a configuration of a user terminal that performs a route search service providing method using a database constructed according to an embodiment of the present invention. FIG. 11 is a block diagram illustrating a configuration of a search management apparatus that performs a route search service providing method using a database constructed according to an embodiment of the present invention. FIG. 12 shows a screen of a user terminal that has acquired an image of an intersection area according to an embodiment of the present invention. FIG. 13 shows a screen of a user terminal showing the location of an intersection received according to an embodiment of the present invention. FIG. 14 shows a screen of a user terminal showing the position of a non-intersection received according to an embodiment of the present invention. FIG. 15 shows a screen of a user terminal showing additional information received according to an embodiment of the present invention.

  While the invention is susceptible to various modifications, and various embodiments thereof, specific embodiments are shown by way of example in the drawings and are described in detail.

  However, this should not be construed as limiting the invention to any particular embodiment, but should be understood to include all modifications, equivalents or alternatives that fall within the spirit and scope of the invention.

  Terms such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, the first component can be named as the second component without departing from the scope of the present invention, and similarly, the second component can be named as the first component. The term “and / or” includes any item of a combination of a plurality of related listed items or a plurality of related listed items.

  When a component is referred to as being “coupled” or “connected” to another component, it may be directly coupled to or connected to another component. It should be understood that there may be other components in between. On the other hand, when a component is referred to as being “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

  The terminology used in the present application is merely used to describe particular embodiments, and is not intended to limit the present invention. An expression used in the singular encompasses the expression of the plural, unless it has a clearly different meaning in the context. In this application, terms such as “including” or “having” are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described in the specification. It should be understood that the existence or additional possibilities of one or more other features or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance.

  Unless defined differently, all terms used herein, including technical or scientific terms, are identical to those commonly understood by those having ordinary skill in the art to which this invention belongs. It has meaning. Terms such as those defined in commonly used dictionaries shall be construed as having a meaning consistent with the meaning possessed in the context of the related art, and unless otherwise explicitly defined in this application, Or overly formal meaning.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the present invention, in order to facilitate an overall understanding, the same constituent elements in the drawings are denoted by the same reference numerals, and redundant description of the same constituent elements is omitted.

  Throughout the specification, the database construction device, the user terminal, and the search management device are a desktop computer capable of communication, a laptop computer, a tablet personal computer, a wireless phone, a wireless phone, a mobile A mobile phone, a smart phone, an e-book reader, a PMP (Portable Multimedia Player), a portable game machine, a navigation device, a digital camera, and a DMB (Digital digital) Player, digital voice recorder (digital a audio recorder, digital audio player, digital picture recorder, digital picture player, digital video recorder, digital video recorder, digital video recorder, digital video recorder, digital video recorder, digital video recorder, digital video recorder, digital video recorder video player) and the like.

FIG. 1 is a conceptual diagram showing a database area for image-based database construction.
Referring to FIG. 1, generally, in order to construct a database for route search, all regions 101 in a road are made into a database to support various searches by users.

  As described above, when all the regions 101 in the road are made into a database, a lot of time and resources are required to construct the database, so the region in the road is photographed using a panoramic camera, A method for generating images for image retrieval using geometric correction was introduced.

  However, it is inefficient to use a panoramic camera to capture an area in a road and generate an image for image retrieval using a geometric correction. .

  Hereinafter, in the image-based database construction method according to an embodiment of the present invention, when an actual user searches for a route, necessary information is information such as which direction is the destination direction in the intersection region. An example of a method for taking an image of an intersection area for route search and constructing a database will be described.

  FIG. 2 is a conceptual diagram illustrating a database area for constructing an image-based database according to an embodiment of the present invention.

  Referring to FIG. 2, in the image-based database construction method according to an embodiment of the present invention, attention is paid to the fact that an important base point is an intersection area in route search. Build a database.

  Here, the intersection area 201 may mean an area having a distance (for example, 50 meters) set in advance in each direction from the intersection center.

  Therefore, it is possible to reduce waste of resources and time necessary for creating a database, compared to creating a database for all road areas. In addition, when the user performs a route search, the search time can be shortened.

  FIG. 3 is a conceptual diagram for explaining an image base database construction for an intersection area and a database construction method for a non-intersection area according to an embodiment of the present invention.

  When building a database for route search using the image of the intersection area, the amount of photos required can be reduced considerably, and the amount of database and route search time can be reduced when using the route search service. it can. However, when using only the image around the intersection, it is difficult to support the search of various areas that were possible with the existing route search service, so that the convenience and satisfaction of the user can be reduced. A method for supporting a search of various regions according to an embodiment will be described.

  Referring to FIG. 3, a database for route search is constructed by dividing the intersection areas A and B and the non-intersection area C in order to support the search of various areas that were possible with the existing route search service.

  Here, the database constructed using the intersection areas A and B can be used to confirm the current position of the user through the feature information search. The database constructed using the non-intersection area C can be used to provide information on non-intersection areas (for example, alleys) at the request of the user after confirming the current position.

Hereinafter, a method of constructing a database using the intersection area and the non-intersection area will be described.
FIG. 4 is a conceptual diagram for explaining image acquisition of a building B according to an embodiment of the present invention. FIG. 5 is a conceptual diagram for explaining image acquisition of a non-intersection area according to an embodiment of the present invention. It is.

  Referring to FIG. 4, an image-based database construction apparatus (hereinafter, database construction apparatus) according to an embodiment of the present invention draws circular arcs at positions such as red points with respect to a building located at each corner. Take a picture of Building B.

  Here, if the intersection area is recognized based on the angle sensor information, the steering direction movement sensor information, the user input information, etc., the database construction device may select a predetermined direction among the intersection areas recognized at a preset time interval. Images can be taken using two vertical angles with respect to the structure.

  In addition, the database construction device constructs a database using the captured image of the building B, and features information such as SIFT (Scale Invariant Feature Transform), SURF (Speeded Up Robust Features) ), Etc., to extract a local descriptor (local descriptor). The database construction device stores the extracted feature information in association with map information and position information (for example, store information).

  Referring to FIG. 5, the database construction device can construct a database by photographing non-intersection areas at regular intervals.

  Here, the database construction device can photograph the non-intersection area so that the overlap ratio is 50%.

  Alternatively, when the database construction apparatus constructs a database using a non-intersection area, an existing photograph database (for example, a panorama) can be used instead of photographing the non-intersection area at a constant distance.

  Further, the database construction device stores the photographed non-intersection area in association with the map information.

  FIG. 6 is a flowchart for explaining an image-based database construction method according to an embodiment of the present invention.

  Referring to FIG. 6, the database construction device determines whether an intersection area is recognized (S610).

  Here, the database construction device can determine whether or not the intersection area can be recognized based on the angle sensor installed in advance, the angle sensor information acquired through the handle direction movement sensor, and the handle direction movement sensor information. The database construction device can also recognize an intersection area when the rotation angle of the database construction device satisfies a preset criterion or based on a user input.

  If the intersection area is recognized through step 610, the database construction apparatus acquires an image of the recognized intersection area (S620).

  Here, the database construction device can photograph a building in a predetermined direction among intersection areas recognized at a preset time interval using at least two vertical angles.

  Thereafter, the database construction device extracts feature information from the image of the intersection area acquired through step 620 (S630).

  Here, the database construction device can extract feature information such as SIFT (Scale Invariant Feature Transform), SURF (Speeded Up Robust Features), etc. from the acquired image of the intersection area. it can.

  The database construction device can extract a local descriptor from the acquired image of the intersection area. The feature information may be a feature vector generated at a corner or vertex of a structure included in the image of the intersection area.

  The database construction device associates the extracted feature information with the position information on the map information, and stores the extracted feature information (S640).

  The database construction device determines whether or not a non-intersection area is recognized (S650). If the non-intersection area is recognized, the non-intersection area is photographed at a preset interval (S660).

  Here, the database construction device can photograph the recognized non-intersection area so that the overlap ratio is 50%. Further, the database construction device can capture the non-intersection area at a time interval longer than the time interval at which the intersection area is captured.

  Thereafter, the database construction device associates the non-intersection area photographed through step 660 with the map information and stores the photographed non-intersection area (S670).

  Therefore, according to the image-based database construction method according to an embodiment of the present invention, since a database that supports route search is constructed using only the image of the intersection area, the database construction can be efficiently performed, and the route Search time can be shortened.

  FIG. 7 is a flowchart illustrating a process for providing a route search service using a database constructed according to an embodiment of the present invention.

  Referring to FIG. 7, the user terminal 100 acquires an image of an intersection area based on a user input (S710).

  Thereafter, the user terminal 100 transmits the image of the intersection area acquired through the step 710 to the search management apparatus 200 (S720).

  The search management apparatus 200 extracts feature information from the image of the intersection area received through step 720, and searches for an intersection position corresponding to the extracted feature information (S730).

  Here, the intersection position may be map information and position information corresponding to the extracted feature information, and the search management apparatus 200 may extract feature information from the image of the intersection area, such as SIFT (Scale Invariant Feature Transform), SURF. Local descriptors such as (Speeded Up Robust Features) can be extracted.

  The search management apparatus 200 transmits the intersection position searched through step 730 to the user terminal 100 (740).

  The user terminal 100 outputs the searched intersection position received through step 740 and selects a specific direction from the intersection positions based on the user input (S750).

  Thereafter, the user terminal 100 transmits the selected non-intersection information request message in a specific direction to the search management apparatus 200 (S760).

  The search management apparatus 200 acquires non-intersection information corresponding to the non-intersection information request message in the specific direction received through step 760, and transmits the acquired non-intersection information to the user terminal 100 (S770).

  The user terminal 100 transmits an additional information request message for requesting additional information included in the non-intersection information received based on the user input to the search management apparatus 200 (S780).

  Here, the additional information may include detailed information related to surrounding buildings such as telephone number information, address information, coupon information, event information, and the like.

  The search management apparatus 200 acquires additional information corresponding to the additional information request message received through step 780, and transmits the acquired additional information to the user terminal 100 (S790).

  In the embodiment of the present invention, the image of the intersection area acquired by the user terminal 100 is transmitted to the search management apparatus 200 by way of example. However, in another embodiment of the present invention, the user terminal 100 acquires the intersection After extracting the feature information from the image of the area, the extracted feature information can be transmitted to the search management apparatus 200.

  FIG. 8 is a flowchart for explaining a route search service providing method using a constructed database performed in a user terminal according to an embodiment of the present invention.

  Referring to FIG. 8, the user terminal 100 according to an embodiment of the present invention acquires an image of an intersection area based on a user input (S801).

  The user terminal 100 transmits the image of the intersection area acquired through step 801 to the search management apparatus 200 (S803).

  Here, the user terminal 100 can also extract feature information from the acquired image of the intersection area, and transmit the extracted feature information to the search management apparatus 200.

  Thereafter, the user terminal 100 determines whether or not an intersection position corresponding to the transmitted image of the intersection area is received (S805).

  If it is determined that the intersection position is received through the step 805, the user terminal 100 outputs the received intersection position so that the user can confirm (S807).

  Here, the received intersection position can be mapped to a map so that the user can easily confirm the current position.

  The user terminal 100 transmits a non-intersection information request message in a specific direction to the search management apparatus 200 based on the user input for the output intersection position (S809).

  Here, the user terminal 100 can also receive a plurality of candidate intersection positions that can correspond to the intersection position from the search management device 200. At this time, the user terminal 100 selects a specific intersection position among a plurality of candidate intersection positions based on a user input, and transmits a non-intersection information request message in a specific direction with respect to the selected specific intersection position to the search management apparatus 200. You can also.

  Thereafter, the user terminal 100 determines whether non-intersection information corresponding to a non-intersection information request message in a specific direction is received (S811).

  If the non-intersection information is received, the user terminal 100 outputs the received non-intersection information so that the user can check (S813).

  Here, the non-intersection information may include map information and a non-intersection image for the selected intersection direction, and the user terminal 100 may output the map information and the non-intersection image simultaneously or selectively through the interface. .

  Thereafter, the user terminal 100 transmits an additional information request message to the search management apparatus 200 based on the user input for the output non-intersection information (S815).

  The user terminal 100 determines whether additional information corresponding to the additional information request message is received (S817). If the additional information is received, the user terminal 100 outputs so that the user can confirm the received additional information. (S819).

  Here, the additional information may include detailed information related to surrounding buildings such as telephone number information, address information, coupon information, event information, and the like.

  According to an embodiment of the present invention, a route search based on the image of the current intersection area is performed through the search management device that has constructed a database using the image of the intersection area, so that a quick route search result can be provided. .

  FIG. 9 is a flowchart for explaining a route search service providing method using a constructed database performed by the search management apparatus according to an embodiment of the present invention.

  Referring to FIG. 9, the search management apparatus 200 determines whether an image of an intersection area is received from the user terminal 100 (S910).

  If the image of the intersection area is received through step 910, the search management apparatus 200 extracts feature information from the received image of the intersection area (S920).

  Here, the search management apparatus 200 can extract feature information such as SIFT (Scale Invariant Feature Transform), SURF (Speeded Up Robust Features), and the like from the image of the intersection area. .

  Thereafter, the search management apparatus 200 acquires an intersection position corresponding to the extracted feature information from a database that has been constructed in advance (S930).

  Here, the database constructed in advance is constructed only by the intersection image, and unlike the database of all road images, it is possible to quickly search for the intersection position.

  The search management apparatus 200 transmits the intersection position acquired through the step 930 to the user terminal 100 (S940).

  Here, when a plurality of candidate intersection positions are acquired from a database constructed in advance, the search management apparatus 200 configures the plurality of candidate intersection positions in a list form and transmits the list to the user terminal 100.

  Thereafter, the search management apparatus 200 determines whether a non-intersection information request message is received from the user terminal 100 (S950).

  If the non-intersection information request is received through step 950, the search management apparatus 200 acquires non-intersection information corresponding to the non-intersection information request and transmits it to the user terminal 100 (S960).

  Here, the non-intersection information may include map information and non-intersection images with respect to the selected intersection direction.

  Thereafter, the search management apparatus 200 determines whether an additional information request message is received from the user terminal 100 (S970).

  If the additional information request message is received through step 970, the search management apparatus 200 acquires additional information corresponding to the received additional information request message and transmits the additional information to the user terminal 100 (S980).

  Here, the additional information may include detailed information related to surrounding buildings such as telephone number information, address information, coupon information, event information, and the like.

  According to an embodiment of the present invention, a route search based on the image of the current intersection area is performed using a database constructed using the image of the intersection area. Can be provided.

  Hereinafter, a user terminal 100 and a search management apparatus 200 that perform a route search service providing method using a database constructed according to an embodiment of the present invention will be described with reference to FIGS. 10 and 11.

  The constituent elements described later are constituent elements defined not by physical division but by functional division, and can be defined by functions performed by each. Each component can be implemented by hardware and / or a program code and a processing unit for performing each function, and functions of two or more components can be implemented by being included in one component. You can also.

  Therefore, the names given to the components in the following embodiments are not for physically separating the components, but are given to imply representative functions performed by the components. It should be noted that the technical idea of the present invention is not limited by the names of the constituent elements.

  FIG. 10 is a block diagram illustrating a configuration of a user terminal that performs a route search service providing method using a constructed database according to an embodiment of the present invention.

  Referring to FIG. 10, the user terminal 100 according to an embodiment of the present invention may include a photographing unit 110, a communication unit 120, a processing unit 130, a display unit 140, and a feature information extraction unit 150.

  First, the imaging unit 110 acquires an image of an intersection area based on a user input, and provides the acquired image of the intersection area to the processing unit 130.

  The communication unit 120 communicates with the search management device 200, provides information received from the search management device 200 to the processing unit 130, and transmits a request message or the like to the search management device 200 based on control of the processing unit 130. .

  Here, communication between the communication unit 120 and the search management apparatus 200 is performed using IEEE802.11x (for example, 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, etc.), Bluetooth, ZigBee ( Zigbee (registered trademark)), ultra-wide band communication (UWB), near field communication (NFC), binary division multiple access (B-CDMA), LTE (Long) , WiBro (Wireless Broadband) can be used to perform various wireless communication technologies.

  The processing unit 130 transmits the image of the intersection area provided from the imaging unit 110 to the search management apparatus 200 through the communication unit 120.

  Alternatively, the processing unit 130 provides an image of the intersection area provided from the imaging unit 110 to the feature information extraction unit 150, controls the feature information to be extracted from the image of the intersection area, and provides the image from the feature information extraction unit 150. The obtained feature information is transmitted to the search management apparatus 200.

  The processing unit 130 may control the display unit 140 to output the received intersection position when the intersection position corresponding to the image of the intersection area or the feature information is received through the communication unit 120.

  Here, the processing unit 130 may receive a plurality of candidate intersection positions that can correspond to the intersection position from the search management apparatus 200. At this time, the processing unit 130 selects a specific intersection position among a plurality of candidate intersection positions based on a user input, and transmits a non-intersection information request message in a specific direction with respect to the selected specific intersection position to the search management apparatus 200. You can also.

  Further, the processing unit 130 transmits a non-intersection information request message in a specific direction to the search management apparatus 200 through the communication unit 120 based on the user input for the output intersection position.

  When the non-intersection information is received through the communication unit 120, the processing unit 130 controls the display unit 140 to output the received non-intersection information.

  Here, the non-intersection information may include map information and a non-intersection image for the selected intersection direction.

  Further, the processing unit 130 transmits an additional information request message to the search management device 200 through the communication unit 120 based on the user input for the output non-intersection information.

  When the additional information corresponding to the additional information request message transmitted through the communication unit 120 is received, the processing unit 130 controls the display unit 140 to output the received additional information.

  Here, the additional information may include detailed information related to surrounding buildings such as telephone number information, address information, coupon information, event information, and the like.

  Based on the control of the processing unit 130, the display unit 140 outputs the intersection position, non-intersection information, additional information, and the like so that the user can confirm. The display unit 140 provides user input information to the processing unit 130.

  Here, the display unit 140 may include a liquid crystal display (LCD), a plasma display panel (PDP), an organic light emitting diode (OLED), and the like.

  The feature information extraction unit 150 extracts feature information from the image of the intersection area provided based on the control of the processing unit 130, and provides the extracted feature information to the processing unit 130.

  Here, the feature information extraction unit 150 may extract feature information such as SIFT (Scale Invariant Feature Transform), SURF (Speeded Up Robust Features) from the image of the intersection area. it can.

  According to an embodiment of the present invention, a current route search is performed through a search management device that uses a database constructed with an image of an intersection area, so that a quick route search result can be provided.

  FIG. 11 is a block diagram illustrating a configuration of a search management apparatus that performs a route search service providing method using a database constructed according to an embodiment of the present invention.

  Referring to FIG. 11, a search management apparatus 200 according to an embodiment of the present invention includes a communication unit 210, a processing unit 220, a feature information extraction unit 230, an intersection information storage unit 240, a non-intersection information storage unit 250, a map and a position. An information storage unit 260 may be included.

  First, the communication unit 210 communicates with the user terminal 100, provides information received from the user terminal 100 to the processing unit 220, and transmits specific information to the user terminal 100 based on control of the processing unit 220.

  Here, the communication between the communication unit 210 and the user terminal 100 is performed using IEEE 802.11x (for example, 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, etc.), Bluetooth, Zigbee, Ultra Optical Band Communication (UWB: Ultra Wide Band), Near Field Communication (NFC: Near Field Communication), Binary CDMA (B-CDMA: Binary Division Multiple Access), LTE (Long Term Evolution B), LTE (Long Term Evolution B) Various wireless communication technologies can be used.

  If the image of the intersection area is received from the user terminal 100 through the communication unit 210, the processing unit 220 provides the received intersection image to the feature information extraction unit 230.

  The processing unit 220 acquires an intersection position corresponding to the feature information provided from the feature information extraction unit 230 from the intersection information storage unit 240, and transmits the acquired intersection position to the user terminal 100 through the communication unit 210.

  Alternatively, when the feature information on the image of the intersection area is received from the user terminal 100 through the communication unit 210, the processing unit 220 obtains the intersection position corresponding to the received feature information from the intersection information storage unit 240, and obtains it. The intersection position is transmitted to the user terminal 100 through the communication unit 210.

  Here, when a plurality of candidate intersection positions are acquired from the intersection information storage unit 240, the processing unit 220 configures the plurality of candidate intersection positions in a list form and transmits the list to the user terminal 100.

  Further, when the non-intersection information request message is received from the user terminal 100, the processing unit 220 acquires non-intersection information corresponding to the non-intersection information request from the non-intersection information storage unit 250 and transmits the non-intersection information to the user terminal 100.

  Here, the non-intersection information may include map information and non-intersection images with respect to the selected intersection direction.

  If the additional information request message is received from the user terminal 100, the processing unit 220 acquires additional information corresponding to the received additional information request message from the map and location information storage unit 260 and transmits the additional information request message to the user terminal 100. To do.

  Here, the additional information may include detailed information related to surrounding buildings such as telephone number information, address information, coupon information, event information, and the like.

  The feature information extraction unit 230 extracts feature information from the intersection image provided based on the control of the processing unit 220, and provides the extracted feature information to the processing unit 220.

  Here, the feature information extraction unit 230 can extract feature information, for example, a local descriptor such as SIFT or SURF, from the image of the intersection area.

  The intersection information storage unit 240 stores captured image of the intersection area and feature information extracted based on the image.

  Here, the image of the intersection area can be taken by using at least two vertical angles of a building in a predetermined direction at a preset time interval.

  The non-intersection information storage unit 250 stores an image of an area between intersections, and manages information for interlocking with the map and position information storage unit 260.

  The map and location information storage unit 260 stores and manages information for linking the image of the intersection area and the non-intersection image, additional information such as location information and store information.

  Here, the intersection information storage unit 240, the non-intersection information storage unit 250, and the map and position information storage unit 260 may be configured by a large-capacity nonvolatile storage device (for example, a hard disk drive).

  According to an embodiment of the present invention, a route search based on the image of the current intersection area is performed using a database constructed using the image of the intersection area. Can be provided.

  FIG. 12 shows a screen of a user terminal that has obtained an image of an intersection area according to an embodiment of the present invention. FIGS. 13 to 15 illustrate the positions of intersections and non-intersections received according to an embodiment of the present invention. The screen of the user terminal which shows additional information is shown.

  Referring to FIG. 12, it is a screen of the user terminal 100 that captures an image of an intersection area in an intersection area based on a user input.

  If the user terminal 100 transmits the captured image of the intersection area to the search management apparatus 200, the intersection position is searched and managed so that the current position of the user terminal 100 can be displayed on the map as shown in FIG. Receive from device 200.

  If the user terminal 100 selects one direction based on the user input with respect to four directions among the received intersection positions, information such as a store that can provide information in advance for the selected one direction is shown in FIG. Can be highlighted.

  The user can perform route search based on the screen of the user terminal 100 displayed as shown in FIG.

  Here, a circle at the center of the intersection indicates the current position of the user terminal 100, and a circle displayed with diagonal lines in the building indicates a store that can provide information in advance.

  In addition, when the user terminal 100 is switched to a horizontal screen based on a user operation in the situation shown in FIG. 14, as shown in FIG. 15, store information that can provide information on the left and right sides of the road depending on the direction is displayed. It can also be provided.

  Alternatively, when the user terminal 100 selects the left or right alley based on the user operation in the situation as shown in FIG. 14, information can be provided on the left and right sides of the road depending on the direction as shown in FIG. You can also provide store information.

  Reference numeral 111 in FIG. 15 represents store information that can be provided in advance as a non-intersection image, which moves in conjunction with the mark 115 and can be moved left and right through touch.

  Here, the store information may include a store image, a telephone number, store evaluation information, and the like.

  Reference numeral 113 in FIG. 15 denotes a panoramic thumbnail on the road, and can provide the user with a panoramic thumbnail image synthesized through a non-intersection image.

  Also, reference numeral 115 in FIG. 15 can display stores that can provide map information and position information in a direction that matches the current rotation direction or selection direction as a map that can be provided.

  Although the present invention has been described with reference to the embodiments, those skilled in the art can variously modify the present invention without departing from the spirit and scope of the present invention described in the following claims. And understand that they can be changed.

DESCRIPTION OF SYMBOLS 100 User terminal 110 Image pick-up part 120,210 Communication part 130,220 Processing part 140 Display part 150,230 Feature information extraction part 200 Search management apparatus 240 Intersection information storage part 250 Non-intersection information storage part 260 Map and position information storage part

Claims (19)

In the image infrastructure database construction method performed by the database construction device,
Obtaining an image of the intersection area;
Extracting feature information from the acquired image of the intersection area;
And storing the extracted feature information in correspondence with map information corresponding to the intersection area. The step of extracting feature information from the acquired image of the intersection area includes:
2. The method according to claim 1, wherein a local descriptor is extracted from the acquired image of the intersection area. Obtaining an image of the intersection area;
2. The image-based database construction method according to claim 1, wherein the structure located in the intersection area is photographed at a plurality of preset angles at a first time interval or a first distance interval. The image base database construction method is:
Recognizing a non-intersection area that is an area other than the intersection area;
Capturing an image of the recognized non-intersection area by a preset method;
The method according to claim 3, further comprising: storing the photographed image of the non-intersection area in association with map information. The step of taking an image of the recognized non-intersection area by a preset method includes:
5. The image-based database construction method according to claim 4, wherein an image of the recognized non-intersection area is photographed at a second time interval longer than the first time interval. The step of taking an image of the recognized non-intersection area by a preset method includes:
5. The image-based database construction method according to claim 4, wherein the image of the recognized non-intersection area is photographed at a second distance interval wider than the first distance interval. Before acquiring an image of the intersection area,
The method according to claim 1, further comprising recognizing an intersection area using at least one sensing information. Recognizing an intersection area using the at least one sensing information comprises:
8. The image-based database construction method according to claim 7, wherein when the rotation angle of the database construction device satisfies a preset criterion, the database is recognized as an intersection area. In the route search method performed in the user terminal,
Obtaining an image of the intersection area;
Extracting feature information from the acquired image of the intersection area;
Transmitting the extracted feature information to the search management device;
Outputting a location information of an intersection including a location image of the user terminal received from the search management device. After outputting the location information of the intersection including the location image of the user terminal received from the search management device,
Transmitting a message requesting information on a straight area in a specific direction selected by the user from the output location information of the intersection to the search management device;
The method for providing a route search service using an image-based database according to claim 9, further comprising: outputting information on the straight region in the specific direction received from the search management device. After outputting the information of the linear region in the specific direction received from the search management device,
Transmitting a message requesting additional information for the specific area selected by the user from the output linear area information in the specific direction to the search management apparatus;
The method of claim 10, further comprising: outputting additional information for the specific area received from the search management device. Additional information for the specific area is:
The method for providing a route search service using an image-based database according to claim 11, comprising at least one of telephone number information, address information, coupon information, and event information. In the route search service providing method performed in the search management device,
Receiving intersection-related information from the user terminal;
Obtaining intersection location information corresponding to the received intersection-related information from the database;
Transmitting the acquired intersection location information to the user terminal; and providing a route search service using an image-based database. Transmitting the acquired intersection position to the user terminal;
14. The route using an image-based database according to claim 13, wherein when there are two or more acquired intersection positions, the two or more intersection positions are configured in a list form and transmitted to the user terminal. Search service provision method. The intersection related information is
14. The method for providing a route search service using an image-based database according to claim 13, wherein the information is an intersection image or feature information extracted from the intersection image. Obtaining an intersection location corresponding to the received intersection-related information from the database;
Extracting the local descriptor from the intersection image when the intersection related information is an intersection image;
16. The method for providing a route search service using an image-based database according to claim 15, further comprising: obtaining an intersection position corresponding to the extracted feature information from the database. After transmitting the acquired intersection position to the user terminal,
Obtaining a non-intersection information if a non-intersection information request message is received from the user terminal;
The method of claim 13, further comprising: transmitting the acquired non-intersection information to a user terminal. After transmitting the acquired non-intersection information to the user terminal,
Obtaining additional information of the specific part corresponding to the additional information request message of the specific part received from the user terminal;
The method of claim 17, further comprising: transmitting the acquired additional information of the specific part to the user terminal. The additional information is
The method for providing a route search service using the image-based database according to claim 18, comprising at least one of telephone number information, address information, coupon information, and event information.