KR20200108403A - Apparatus and method for automatically recognizing local information through focusing around a user - Google Patents

Abstract

The present invention relates to a method for automatically recognizing local information, which comprises: a step (a) of extracting candidate geographic feature objects corresponding to a search region set to be visually displayed on a user terminal among geographic feature objects stored in an object storage unit of an automatic local information recognizing apparatus, on the basis of position information and direction information obtained from the user terminal; a step (b) of selecting visible geographic feature objects which can be visually identified within the search region among the candidate geographic feature objects; and a step (c) of recognizing the visible geographic feature object positioned closest to the center of the search region among the visible geographic feature objects as a local information request object. According to the present invention, information desired by a user can be automatically recognized.

Description

A device and method for automatically recognizing regional information through focusing around the user {APPARATUS AND METHOD FOR AUTOMATICALLY RECOGNIZING LOCAL INFORMATION THROUGH FOCUSING AROUND A USER}

The present application relates to an apparatus and method for automatically recognizing local information through focusing around a user. That is, the present application relates to an apparatus and method for automatically recognizing region information for automatically recognizing region information on a focused object by focusing an object (terrain object) around a user using a region information automatic recognition apparatus.

As mobile devices become popular and communication technologies develop, there is an increasing demand for information retrieval/providing services that can provide convenience in life by utilizing them.

In general, as a method of searching for information, there is a method of searching by entering a keyword of the search target into a search engine such as Google or Naver. However, this method has a problem in that information cannot be searched if the keyword is not known.

In order to solve this problem, a service that searches and provides surrounding information based on the user's location is emerging.

1 is a diagram illustrating an example of providing an information retrieval service based on Augmented Reality (AR).

Referring to FIG. 1, the AR (Augmented Reality)-based information search service does not require a separate keyword, and a camera image by searching for information around the user (eg, POI information) using the user's location information. It can be provided by overlaying it on top.

However, conventionally known AR-based information retrieval services use only the user's location to display information. For this reason, AR-based information retrieval services not only display information in places where it is difficult for the user to move, but also display both nearby information and distant information superimposed on one screen. Information) is difficult to recognize easily.

For example, Pokemon GO, one of AR apps, uses the user's location to show the location of the virtual Pokemon on the map. And when you encounter the Pokemon, the Pokémon is displayed according to the user's viewing direction on the camera image. However, since Pokemon GO does not take into account the topographical features of real life space, it appears that Pokémon is floating in the air regardless of the objects in real life space.

In addition, Sekai Camera, one of AR apps, superimposes virtual memos left at a specific location on the camera screen. However, this is also obscured by buildings or obstacles in the real life space, so that the memo is visible in places that should not be seen.

As such, the conventional AR-based service overlays information on an image acquired through a camera using only the user's location information without considering the user's surrounding environment at all. In other words, the conventional AR-based service provides information in the air regardless of the location of an object, or provides information that should not be seen hidden by buildings or obstacles as well as information that is not covered by buildings or obstacles on one screen. Since all information is provided on one screen without distinction between information and distant information, there is a problem that it is difficult to easily recognize the information desired by the user.

On the other hand, further from AR service technology, research is being conducted on MR (Mixed Reality) service technology that displays information by using the positional relationship and shape of real-life space objects in the user's visible area.

MR service technology mainly uses depth sensor and image processing technology for object extraction, and provides information that is better matched to real life space than AR. However, these conventional MR service technologies show good results in indoor spaces such as rooms, offices, etc., in which the sensing range is limited, but are difficult to apply outdoors where environmental changes are large.

In addition, since the conventional MR service technology recognizes an object based on image processing, the recognition rate of the object decreases due to the influence of the surrounding environment such as light, and it is difficult to recognize the object that is partially covered by the building in front. have.

That is, in order to enable outdoor MR service, it can be said that accurate location information of outdoor entities is required. However, since the conventional MR service is mainly studied on the premise of indoor service, it is difficult to recognize outdoor objects with the conventional MR service technology that specifies indoor objects using a depth sensor or feature points of an image. There is this.

The technology behind the present application is disclosed in Korean Laid-Open Patent Publication No. 10-2012-0075609.

The present application is to solve the problems of the prior art described above, without the need for a keyword, by simply focusing the object around the user, the user can automatically recognize the desired information (that is, local information on the focused object) An object of the present invention is to provide an apparatus and method for automatically recognizing local information through focusing around a user.

However, the technical problem to be achieved by the embodiments of the present application is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, a method for automatically recognizing region information through focusing around a user using an apparatus for automatically recognizing region information according to an embodiment of the present application includes: (a) location information obtained from a user terminal and Extracting candidate feature objects corresponding to a search area set to be visually displayed on a user terminal from among feature objects stored in an object storage unit of the apparatus for automatically recognizing location information based on direction information; (b) selecting visible feature objects that can be visually identified in the search area among the candidate feature objects; And (c) recognizing a visible feature object located closest to the center of the search area among the visible feature objects as a region information request target.

In addition, in the step (b), the candidate feature objects are sequentially searched in an order close to the location corresponding to the location information in the search area to select a visible feature object, and the selected visible feature object is The width area occupied within the search area may be excluded from the search target range from the next search.

In addition, the object storage unit stores information on the location and shape of the feature objects as object information, and the width region corresponding to the selected visible feature object stores the selected visible feature object in consideration of the object information. It may be an area corresponding to the object width displayed in the state projected onto the search area.

In addition, information on the shape may be stored in the form of a minimum bounding rectangle (MBR).

In addition, information on the shape may be stored in a MAR (Minimum Area Rectangle) format.

In addition, the MAR shape is the minimum area among all cases in which the MBR shape is formed based on a local axis including a line connecting two neighboring vertices among vertices included in the contour of the feature object included in the digital map. It may be a form corresponding to the case of.

In addition, in the step (a), if it is determined that there are a plurality of feature objects whose entire width is exposed within the search area through image analysis of the search area, the plurality of feature locations are analyzed through the image analysis. Based on the image analysis-based width ratio set calculated for the water object and the feature objects stored in the object storage unit, a plurality of candidate feature objects corresponding to the positions and directions of the plurality of feature objects are stored in the search area. It is possible to determine whether or not there is a discrepancy between the object information-based width ratio sets calculated in correspondence to the object width appearing in the projected state.

In addition, in the step (a), when it is determined that there is a discrepancy, the position information is changed within the error range of the position sensor of the user terminal while the direction information is kept constant, while the image analysis-based width ratio set If it is determined that another object information-based width ratio set corresponding to and there is another object information-based width ratio set corresponding to the image analysis-based width ratio set, it is considered that there is an error in the location information and the location information Can be corrected.

In addition, a method for automatically recognizing region information through focusing around a user using an apparatus for automatically recognizing region information according to an embodiment of the present application includes: (d) a point of interest corresponding to the region information request object recognized in step (c) ( It may further include displaying by overlaying POI (Point of Interest) information on the area information request target.

On the other hand, the apparatus for automatically recognizing local information through focusing around a user according to an embodiment of the present application includes a feature object stored in the object storage unit of the apparatus for automatically recognizing location information based on location information and direction information acquired from a user terminal. An extraction unit for extracting candidate feature objects corresponding to the search area set to be visually displayed on the user terminal; A selection unit that selects visually identifiable visible feature objects from among the candidate feature objects; And a recognition unit for recognizing a visible feature object located closest to the center of the search area among the visible feature objects as a region information request target.

In addition, the selection unit selects a visible feature object by sequentially searching for candidate feature objects in an order close to a location corresponding to the location information in the search area, and the selected visible feature object is the search area The width area occupied within can be excluded from the search target range from the next search.

In addition, the object storage unit stores information on the location and shape of the feature objects as object information, and the width region corresponding to the selected visible feature object stores the selected visible feature object in consideration of the object information. It may be an area corresponding to the object width displayed in the state projected onto the search area.

In addition, information on the shape may be stored in the form of a minimum bounding rectangle (MBR).

In addition, information on the shape may be stored in a MAR (Minimum Area Rectangle) format.

In addition, the MAR shape is the minimum area among all cases in which the MBR shape is formed based on a local axis including a line connecting two neighboring vertices among vertices included in the contour of the feature object included in the digital map. It may be a form corresponding to the case of.

In addition, if it is determined through image analysis of the search area that there are a plurality of feature objects whose entire widths are exposed in the search area, the extracting unit may perform the image analysis on the plurality of feature objects. A state in which a plurality of candidate feature objects corresponding to the position and direction of each of the plurality of feature objects are projected onto the search area based on the calculated image analysis-based width ratio set and feature objects stored in the object storage unit It is possible to determine whether or not there is a discrepancy between the calculated object information-based width ratio sets corresponding to the object width shown in.

In addition, when it is determined that the extraction unit is inconsistent, the location information is changed within the error range of the location sensor of the user terminal while maintaining the direction information, and corresponding to the image analysis-based width ratio set. If another object information-based width ratio set is searched and it is determined that another object information-based width ratio set corresponding to the image analysis-based width ratio set exists, it is considered that there is an error in the location information and the location information is corrected. I can.

In addition, the apparatus for automatically recognizing region information through focusing around a user according to an embodiment of the present application provides point of interest (POI) information corresponding to the region information request target recognized by the recognition unit on the region information request target. It may further include a display control unit for displaying by overlaying on the.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present application. In addition to the above-described exemplary embodiments, additional embodiments may exist in the drawings and detailed description of the invention.

According to the above-described problem solving means of the present application, information desired by the user (i.e., local information on the focused feature object) by simply focusing the feature object around the user using an automatic local information recognition device without the need for a keyword. Can be recognized automatically.

According to the above-described problem solving means of the present application, based on the location information and direction information obtained from the user terminal, the user is to request local information to be searched by using the feature objects stored in the object storage unit (in other words, the search target object ) Can be effectively recognized (identified).

However, the effect obtainable in the present application is not limited to the effects as described above, and other effects may exist.

1 is a diagram illustrating an example of providing an information retrieval service based on Augmented Reality (AR).
2 is a diagram illustrating a schematic configuration of an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present disclosure.
3 is a diagram for describing a search area that can be set by an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present disclosure.
4 is a diagram illustrating an example of a search area visually displayed on a user terminal in an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present application.
FIG. 5 is a diagram for explaining an MBR type (a) and a MAR type (b) considered in an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present disclosure.
6 is a view for explaining a process of selecting a visible terrain object in an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present disclosure.
7 is a diagram schematically illustrating a configuration of a system for automatically recognizing region information including an apparatus for automatically recognizing region information according to an embodiment of the present application.
8 is a diagram schematically showing the structure of an outdoor MR model applied to the system for automatically recognizing area information according to an embodiment of the present application.
9 is a diagram for explaining an R-tree structure, which is a storage structure of object information, in an apparatus for automatically recognizing local information according to an embodiment of the present application.
FIG. 10 is a diagram illustrating an example of searching for POI information on a region information request target in an apparatus for automatically recognizing region information according to an embodiment of the present application.
11 is a diagram illustrating an example of search information provided by an apparatus for automatically recognizing area information according to an embodiment of the present application.
12 is a diagram illustrating another example of search information provided by an apparatus for automatically recognizing area information according to an embodiment of the present application.
13 is a diagram illustrating another example of search information provided by an apparatus for automatically recognizing area information according to an embodiment of the present application.
14 is a view for explaining an example in which the determination of whether an error exists in the location information of a user terminal acquired by the apparatus for automatically recognizing local information according to an embodiment of the present application is manually performed by the user's determination.
15 is a diagram illustrating an example in which the location information of a user terminal is manually changed by a user input in the apparatus for automatically recognizing area information according to an embodiment of the present application.
FIG. 16 is a view for explaining an example of a case in which the apparatus automatically determines whether there is an error in the location information of a user terminal acquired by the apparatus for automatically recognizing local information according to an embodiment of the present disclosure.
17 and 18 are diagrams for explaining correction of location information of a user terminal in an apparatus for automatically recognizing area information according to an embodiment of the present application.
19 is a flowchart illustrating a method of automatically recognizing local information through focusing around a user using an apparatus for automatically recognizing local information according to an embodiment of the present application.

Hereinafter, exemplary embodiments of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present application. However, the present application may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts not related to the description are omitted in order to clearly describe the present application, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the present specification, when a part is said to be "connected" with another part, it is not only "directly connected", but also "electrically connected" or "indirectly connected" with another element interposed therebetween. "Including the case.

Throughout this specification, when a member is positioned "on", "upper", "upper", "under", "lower", and "lower" of another member, this means that a member is located on another member. It includes not only the case where they are in contact but also the case where another member exists between the two members.

Throughout the specification of the present application, when a certain part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

2 is a diagram illustrating a schematic configuration of an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present disclosure. Hereinafter, the apparatus 10 for automatically recognizing local information through focusing around a user according to an embodiment of the present disclosure will be referred to as the apparatus 10 for convenience of description.

Referring to FIG. 2, the apparatus 10 may include an extraction unit 11, a selection unit 12, and a recognition unit 13. In addition, the device 10 may include a display control unit 14 and an object storage unit 15.

The device 10 may be a device included (or installed, built-in, or provided) in the user terminal 1.

Here, the user terminal 1 is a mobile communication device that guarantees portability and mobility, for example, PCS (Personal Communication System), GSM (Global System for Mobile Communication), PDC (Personal Digital Cellular), PHS (Personal Handyphone). System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (WCode Division Multiple Access), Wibro (Wireless Broadband Internet) terminal, smartphone ( Smartphone), smart pads, tablet PCs, notebooks, wearable devices, and the like.

Based on the location information and direction information obtained from the user terminal 1, the extraction unit 11 visually displays the feature objects stored in the object storage unit 15 of the device 10 in the user terminal 1 Candidate feature objects corresponding to the search area set to be displayed may be extracted.

The search area may be set based on information acquired using a plurality of sensors included in the user terminal 1. For example, the search area may be set to have a similar area to the user's field of view. This can be more easily understood with reference to FIG. 3.

3 is a diagram for describing a search area that can be set by an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present disclosure.

3, the search area (s) is the location information of the user terminal 1 obtained from the location sensor (position acquisition sensor) included in the user terminal 1, and the gyro sensor included in the user terminal 1 , Accelerometer, magnetometer, compass (electronic compass) may be set in consideration of the direction information the user terminal 1 is looking at. Here, the direction information may specifically mean information on the direction that the image sensor 1a included in the user terminal 1 is looking at, and may be expressed differently as azimuth information. In addition, the location sensor may mean a GPS sensor as an example, but is not limited thereto. Also, the image sensor 1a may be expressed differently as a camera, an image acquisition device, an image capture device, or the like.

)를 이용하여 획득 가능한 이미지센서(1a)의 시야각(α), 및 인식거리를 더 고려하여 설정될 수 있다. 여기서, 시야각 α는 2*atan(

/2d)의 조건을 만족할 수 있다. 여기서, 인식거리는 미리 설정된 거리로 설정될 수 있다. 예시적으로, 인식거리는 사용자의 시야를 고려하여 미리 설정된 거리로서 사용자 단말(1)의 위치로부터 일예로 200m 이내의 거리로 설정될 수 있으며, 이에 한정되는 것은 아니다.In addition, the search area s is the focal length d of the lens of the image sensor 1a included in the user terminal 1 and the horizontal length of the image sensor 1a.

) May be set in consideration of the viewing angle α and the recognition distance of the image sensor 1a that can be obtained using ). Here, the viewing angle α is 2*atan(

The condition of /2d) can be satisfied. Here, the recognition distance may be set to a preset distance. Exemplarily, the recognition distance is a distance set in advance in consideration of the user's field of view, and may be set to a distance within 200m from the location of the user terminal 1, for example, but is not limited thereto.

As such, the search area s may be set in consideration of location information, direction (azimuth angle) information, viewing angle, and recognition distance of the user terminal 1.

4 is a diagram illustrating an example of a search area s visually displayed on a user terminal 1 in an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present disclosure.

Referring to FIG. 4, the search area (s) may mean an area visually displayed on the screen of the user terminal 1, a photographing area, a recognition area that can be recognized through the image sensor of the user terminal 1, etc. It can be expressed differently as

As an example, when the user wants to know the information of a specific landmark object, the user terminal 1 displays the specific landmark object to be known within the search area set to be visually displayed on the user terminal 1. You can focus on a specific feature object you want to know.

In this case, the extraction unit 11 may extract candidate feature objects corresponding to the search area s set to be visually displayed on the user terminal 1 from among the feature objects stored in the object storage unit 15. In other words, the extraction unit 11 may extract, as candidate terrain objects, the topographic objects located in the search area s among the topographic objects stored in the object storage unit 15.

The object storage unit 15 may store information on the location and shape of the feature objects as object information. Here, the object information may include keyword and phase information of the feature object. In addition, the landmark object is a fixed object that does not move, and may, for example, mean a structure such as a building, a building, a bridge, an overpass, a bulletin board, a large sign, and a monument, but is not limited thereto. Hereinafter, for convenience of description, the feature object means a building.

As an example, the object storage unit 15 may store information on the shape of the feature objects in the form of a minimum bounding rectangle (MBR). As another example, the object storage unit 15 may store information on the shape of the feature objects in a MAR (Minimum Area Rectangle) format. Here, the MAR shape is the minimum area among all cases in which the MBR shape is formed based on a local axis including a line connecting two neighboring vertices among vertices included in the contour of the feature object included on the digital map. It may mean a form corresponding to a case. A more detailed description may be more easily understood with reference to FIG. 5.

FIG. 5 is a diagram for explaining an MBR type (a) and a MAR type (b) considered in an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present disclosure.

Referring to FIG. 5, since feature objects (for example, buildings) are composed of a plurality of vertices, the object storage unit 15 is used as an example to facilitate the use of object information on the feature object. Information about the shape of water objects can be stored in the form of Minimum Bounding Rectangle (MBR). Here, the MBR shape may mean a square (minimum bounding rectangle) shape having a minimum size capable of including all vertices of a feature object.

At this time, when information about the shape of the feature objects is stored in the MBR format, a lot of empty spaces are generated. Therefore, when the information of the feature objects stored in the MBR format is used when extracting candidate feature objects in the extraction unit 11, the MBR area does not overlap with the actual building area, so the accurate search for the feature object. This may not be possible. In other words, when information about the shape of the feature objects is stored in the form of MBR as shown in Fig. 5 (a), for example, when building B is searched, the building located in the search area is searched with the search accuracy for the building B. This can fall.

Accordingly, it may be desirable to store information on the shape of the feature objects in the object storage unit 15 in the form of MAR, which is a modified form of MBR. Among the MBR types, the MAR type may mean a rectangle (minimum area rectangle) having the smallest area that can include all vertices of a feature object.

MAR can be obtained through the following process. To obtain MAR, first, the angle between two adjacent vertices among the vertices included in the contour of the feature object is obtained, rotated to fit the x-axis or y-axis, and then the area (width) of the MBR can be obtained. Next, regardless of the order, the area of the MBR can be obtained for all cases of adjacent vertices among the vertices included in the contour of the feature object, and the MBR of the case with the minimum area can be obtained. Next, MAR can be obtained by rotating the MBR having the minimum area as much as it rotated again.

As such, when information on the shape of the feature objects is stored in the form of MAR as shown in (b) in FIG. 5, the empty space can be eliminated compared to the MBR, so that more accurate search for the feature object is made compared to the MBR. I can.

When the location information and direction information are obtained from the user terminal 1, the device 10 provides information on the location and shape of the feature objects located within a preset distance range from the location of the user terminal 1 to the server. Information on the shape of the terrain feature objects obtained from and obtained may be stored in the object storage unit 15 in the form of MAR as an example. Here, the preset distance range may mean a range within 500m from the location of the user terminal 1 as an example, and is not limited thereto, and may be variously set.

According to this, information on the location and shape of all terrain objects may be stored in the server as object information, and the object storage unit 15 of the device 10 includes some of the object information stored in the server ( For example, information on the location and shape of feature objects located within a preset distance range from the location of the user terminal) may be acquired from the server and stored.

When the object storage unit 15 stores information about the location and shape of the feature objects as object information, the object storage unit 15 may link and store information on a point of interest (POI) corresponding to the object information. Here, the point of interest information may be obtained from the server. Accordingly, in the database of the server, for example, object information (information on the location and shape of topographic objects) constructed in an R-tree structure and information on points of interest corresponding thereto may be linked (mapped) and stored together. A more detailed description of this will be described later.

The selection unit 12 may select visible topographic objects that can be visually identified within the search area s from among the candidate topographic objects extracted by the extraction unit 11. This can be more easily understood with reference to FIG. 6.

6 is a view for explaining a process of selecting a visible terrain object in an apparatus for automatically recognizing local information through focusing around a user according to an exemplary embodiment of the present disclosure. In other words, FIG. 6 is a diagram for explaining a process of resetting a search target range (that is, a search algorithm for a visible feature object) in order to select a visible feature object within the search area s.

Referring to (a) and (b) in FIG. 6, for example, the candidate feature object corresponding to the search area (s) extracted by the extraction unit 11 includes a first candidate feature object (O1, Object 1). ), a second candidate feature object (O2, Object 2), and a third candidate feature object (O3, Object 3) may be included.

The selection unit 12 may select visible feature objects O1 and O2 that can be visually identified within the search area s from among the candidate feature objects O1, O2, and O3.

At this time, the selection unit 12 sequentially searches for candidate feature objects in an order close to the location corresponding to the location information of the user terminal 1 (that is, the location of the user terminal, pos) within the search area (s). Thus, the visible feature object may be selected, but the width area occupied by the selected visible feature object within the search area s may be excluded from the search target range from the next search.

Here, the width area corresponding to the selected visible feature object is a projected view of the selected visible feature object to the search area in consideration of the object information stored in the object storage unit (i.e., information on the location and shape of the feature objects). It may mean an area corresponding to the width of the object appearing in the state.

In other words, the selection unit 12 may first perform a search for selecting a visible feature object by using the entire search area s as the first search target range s. At this time, the selection unit 12 is the candidate feature object O1 located closest to the position (pos) of the user terminal among the candidate feature objects O1, O2, and O3 located within the first search target range (s). As an example, it may be selected as the first visible feature object.

After selection of the first visible feature object O1 in the first search target range s, the selection unit 12 selects the selected first visible feature object O1 within the search area s. A search for selecting a visible feature object may be performed for a search target range to which the width region occupied by the first visible feature object O1 is excluded from the search target range. That is, the selection unit 12 may reset the search target range after the first visible feature object O1 is selected in the first search target range s. At this time, in the reset search target range (ie, the second search target range, s1), the first visible feature object O1 selected from the first search target range s corresponding to the entire search area s is searched. It may mean an area s1 in which the width area occupied within the area s is excluded.

Accordingly, after the first visible feature object O1 is selected, the selection unit 12 may perform a search for selecting the visible feature object in the second search target range s1. As a result of the search for the second search target range s1, the selection unit 12 is located closest to the position (pos) of the user terminal among the candidate feature objects O3 located within the second search target range s1. The candidate feature object O3 may be selected as a second visible feature object as an example.

Thereafter, the selection unit 12 excludes the width area occupied by the second visible feature object O3 selected among the second search target range s1 from the search target range from the search target range, A search for selecting a visible feature object may be performed for a search target range excluding a width region occupied by the water object O3. Accordingly, when the search area s is set as shown in FIG. 6A, for example, the selection unit 12 may perform a search for selecting a visible feature object three times.

In the case of the situation as shown in (a) of FIG. 6, the selection unit 12 searches for a first candidate feature object O1 and a third candidate feature object among the candidate feature objects O1, O2, and O3 through three searches. The water object O3 can be selected as a visible feature object that can be visually identified within the search area s. At this time, since the second candidate feature object O2 is an object that is hidden and invisible by the first candidate feature object O1 when viewed from the position (pos) of the user terminal, the selection unit 12 is used as the second candidate feature object. The object O2 is not selected as a visible feature object.

The process of selecting visible terrain objects by the selection unit 12 will be described again as follows. FIG. 6B shows an example in which a building is located as the first candidate feature object O1 in the search area s.

Referring to (c) in FIG. 6, after extraction of candidate feature objects is performed by the extraction unit 11, the selection unit 12 selects visible feature objects that can be visually identified among the extracted candidate feature objects. Can be selected. At this time, the selection unit 12 selects the visible feature objects using the following search algorithm in order not to recognize the invisible feature object covered by the feature object in front (for example, a building). I can.

First, the selection unit 12 may search for a visible feature object in the order of a candidate feature object close to the position (pos) of the user terminal among candidate feature objects located in the search area (s). When one visible feature object is selected by searching, the selection unit 12 then determines the portion occupied by the candidate feature object closest to the position (pos) of the user terminal (that is, the visible feature object is the search area). The process of resetting the rest of the area except the width area occupied within the area) to the search target area and the search process for the visible feature object in the reset search target area may be repeatedly performed.

The selection unit 12 performs the resetting process of the search target area and the search process for the reset search target area until all visible feature objects among the candidate feature objects included in the search area s are selected. Can be performed repeatedly.

, r)로 이루어져 있다고 하자. 산출부(12)는 검색 영역(s)을 탐색 대상 영역으로 하여 가시 지형지물 객체에 대한 1차 탐색을 수행함으로써, 탐색 대상 영역 내에 위치한 제1 후보 지형지물 객체(O1)를 가시 지형지물 객체로서 선별할 수 있다.As a specific example, the search area (s) is ( pos ,

and r ). The calculation unit 12 uses the search area s as a search target area and performs a primary search for a visible feature object, thereby using the first candidate feature object O1 located in the search target area as a visible feature object. Can be selected.

In this case, it can be seen that the portions (a, b) corresponding to the selected first candidate geologic feature object O1 occupy some of the visually identifiable areas in the search area s. In other words, it can be seen that the width regions pos , c , and d corresponding to the visual feature object O1 selected from the search area s occupy a part. Here, the width area corresponding to the selected visible feature object O1 is in a state in which the selected visible feature object O1 is projected onto the search area s in consideration of object information stored in the object storage unit 15 It may mean an area ( pos , c , d ) corresponding to the displayed object width ( a , b ).

, c) 영역과 (pos, d, r) 영역이 포함될 수 있다.When the selection unit 12 performs a primary search to select one visible feature object, the visible feature object selected from among the search target areas corresponding to the search area s in which the first search has been made ( The remaining areas except for the width areas ( pos , c , d ) corresponding to O1) are reset as the search target area for the secondary search, and the second search for visible feature objects is performed for the reset search target area. I can. Here, in the search target area that is the secondary search target, that is, the reset search target area ( pos ,

, c ) and ( pos , d , r ) areas may be included.

, r)이 재귀(Recursion) 인자로 설정되고, Recursion(

, r)에서 검색 영역(s)의 좌표를 인자로 제공할 수 있다. 이를 통해, 선별부(12)는 탐색 알고리즘을 통해 검색 영역(s)에 대하여 건물들의 포함 관계를 판단할 수 있다.The search algorithm will be described again as follows. The selection unit 12 may perform a search algorithm to select a visible terrain object. In the search algorithm, the line segment (

, r ) is set as a recursion factor, and Recursion(

In, r ), the coordinates of the search area (s) can be provided as a factor. Through this, the selection unit 12 may determine the inclusion relationship of buildings in the search area s through a search algorithm.

,c)과 Recursion(d,r)이 수행될 수 있다. 또한, 검색 영역(s)에 대하여 건물이 포함되지 않은 경우, 일예로 본 장치(10)의 디스플레이 제어부(14)는 건물이 포함된 영역에 대하여 재촬영(재인식)이 이루어지도록 하기 위한 알림을 사용자 단말(1)로 제공할 수 있다. 또한, 검색 영역(s)에 대하여 건물이 검색 영역(s)보다 큰 경우, 해당 건물이 가시 지형지물 객체로서 탐색된 이후 탐색 알고리즘이 종료될 수 있다.In this case, in the case of the search algorithm, when the building is completely included or the building is partially included in the search area (s), Recursion(

, c ) and Recursion ( d , r ) can be performed. In addition, when a building is not included in the search area (s), as an example, the display control unit 14 of the device 10 provides a notification for re-taking (re-recognition) of the area including the building. It can be provided to the terminal 1. In addition, when the building is larger than the search area s with respect to the search area s, the search algorithm may be terminated after the building is searched as a visible terrain object.

Using such a search algorithm, the selection unit 12 may select visible terrain objects that can be visually identifiable within the search area s among candidate terrain objects.

The recognition unit 13 determines the area information request target (in other words, the user wants to search for a visible feature object located closest to the center of the search area s) among the visible feature objects selected by the selection unit 12. It can be recognized as a search target object).

When a user wants to know information about an object of interest (for example, a specific feature object), it is common to focus the object of interest to be located in the center of the screen (the image display screen displayed on the user terminal). In consideration of the point, the recognition unit 13 may recognize a visible feature object located closest to the center of the search area among the visible feature objects as a region information request target. Accordingly, the present application can provide convenience in allowing a user to directly select a desired building (object to be searched) through focusing of a nearby building using the user terminal 1.

For example, in the case of (a) of FIG. 6, the recognition unit 13 is the closest to the center of the search area S among the visible feature objects O1 and O3 selected by the selection unit 12. The located visible feature object O3 can be recognized as a target for requesting local information.

In the description to be described later, a target for requesting local information recognized by the recognition unit 13 may be differently expressed as a search target object.

In an example of the present application, it is exemplified that the recognition unit 13 recognizes the visible feature object located closest to the center of the search area among the selected visible feature objects as a region information request target (search target object), but is limited to this. It does not become.

As another example, in the present application, the display control unit 14 may cause the center identification mark to be displayed at the center of the screen of the user terminal 1. Thereafter, the user so that the center identification mark displayed on the screen of the user terminal 1 is located and displayed on the geographical feature object to be searched for in a real life environment (that is, as a search target object, for example, meaning a building), The feature object to be searched for can be illuminated with the image sensor of the user terminal. In this case, the recognition unit 13 may recognize a feature object corresponding to the center identification mark among the feature objects displayed on the user terminal as a region information request target (search target object). According to another example of the present application, the object to be searched may be more easily recognized (identified) by using the central identification mark.

The display control unit 14 may overlay and display point of interest (POI) information corresponding to the region information request object recognized by the recognition unit 13 on the region information request object. The display control unit 14 may overlay and display point-of-interest information corresponding to the region information request object on the region information request object displayed on the screen of the user terminal 1. Here, the point of interest information may include at least one of a name (name) and an address of the point of interest, but is not limited thereto.

The object storage unit 15 may store information on the location and shape of the feature objects as object information. In addition, the object storage unit 15 may link and store Point of Interest (POI) information corresponding to the object information together. Here, the object information stored in the object storage unit 15 and POI information corresponding thereto are some of the object information stored in the database of the server and POI information corresponding thereto (for example, a preset distance from the location of the user terminal). It may be object information located within a range and POI information corresponding thereto). Description of this may be more easily understood through the description to be described later.

7 is a diagram schematically illustrating a configuration of a system 100 for automatically recognizing region information including the apparatus 10 for automatically recognizing region information according to an exemplary embodiment of the present disclosure.

Referring to FIG. 7, the system 100 for automatically recognizing region information according to an exemplary embodiment of the present disclosure may include an apparatus for automatically recognizing region information (the present apparatus 10) and a server 20.

Here, the apparatus 10 for automatically recognizing region information may refer to the apparatus 10 described above. Accordingly, even if omitted below, the description of the device 10 may be equally applied to the description of the device 10 (automatic region information recognition device) to be described later.

The device 10 may transmit location information and direction information obtained from the user terminal to the server 20. In the database of the server 20, information on the location and shape of all terrain objects may be stored as object information, and in addition, point of interest information corresponding to such object information may be linked (mapped) and stored.

Accordingly, when the server 20 obtains the location information and direction information of the user terminal from the device 10, the server 20 is preset from a location corresponding to the location information of the user terminal based on the obtained information (location information and direction information). Object information located within a distance range and POI information corresponding thereto can be searched in the database. Thereafter, the server 20 may transmit object information located within the searched preset distance range and POI information corresponding thereto to the device 10.

Thereafter, the device 10 may store object information located within a preset distance range received from the server 20 and POI information corresponding thereto in the object storage unit 15 in the device 10. Thereafter, the device 10 extracts a candidate terrain object through the extraction unit 11 based on the information stored in the object storage unit 15, and selects and recognizes a visible terrain object through the selection unit 12 ( 13), and a process of displaying the POI information through the display control unit 14 may be performed.

The device 10 and the server 20 may be connected through a network 30.

The network 30 is, for example, a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) network, a World Interoperability for Microwave Access (WIMAX) network, an Internet, a Local Area Network (LAN), a Wireless LAN (Wireless LAN). Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), Bluetooth (Bluetooth) network, NFC (Near Field Communication) network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, etc. It may be included, but is not limited thereto.

On the other hand, the Ambient Browser can be said to be an MR system in which information of the object can be obtained simply by projecting an object on a real life space desired to be searched with an image sensor of a user terminal. The core of this system can be said to specify an outdoor object to be searched without a keyword. In constructing such a system, it is difficult to utilize the conventionally known MR research based on sensor/image processing.

In other words, as described above, the conventional MR service is mainly based on the premise of providing a service in an indoor space, and thus there is a limitation in applying the conventional MR service in the outdoors where the surrounding environment changes greatly.

Therefore, in the present application, the object to be searched (that is, recognition) using the location information and direction information of the user terminal based on real-life spatial object information of a digital map, not based on sensor/image processing as in the prior art, through the present system 100. We propose a technique that specifies the target of requesting local information recognized by the Department. In addition, based on this, the present application proposes an outdoor MR model based on real life space location for effective construction of outdoor MR service. In the following description, an object for requesting local information recognized by the recognition unit 13 may be referred to as an object to be searched for by the user.

That is, in this application, without the need for keywords, the outdoor MR model proposed by the present application is used to provide information on the point of interest of the object to be searched (that is, the region information request target recognized by the recognition unit) based on the digital map and POI information. A technology for building Ambient Browser, which is a possible outdoor MR service, is proposed. In other words, the device 10 may be expressed differently as an ambient browser device for providing an outdoor MR service. Description of the outdoor MR model proposed in the present application may be more easily understood with reference to FIG. 8.

8 is a diagram schematically showing the structure of an outdoor MR model applied to the system 100 for automatically recognizing area information according to an embodiment of the present application. A description of the process of providing point of interest information based on the outdoor MR model is as follows.

Referring to FIG. 8, the outdoor MR model proposed in the present application may include a real life space layer, an object storage space layer, an information storage space layer, and an information display space layer.

The outdoor MR model stores object information extracted from a digital map in an object storage space layer and uses it to identify a search target object (an outdoor object to be searched for), and an information storage space layer based on the specified search target object. It is characterized in that it searches for information (ie, POI information) related to the search target object specified in. A more detailed description follows.

[Real life space layer]

The real life space corresponding to the real life space layer may mean a space in which a user lives. Users can receive information provision services in real life spaces through the information display space layer. Here, the information display space layer represents a display screen on the user terminal 1, and a more detailed description will be described later.

When a user with a user terminal 1 wants to know information about a building (a landmark object) while moving in a real life space, the user can illuminate the building using the image sensor of the user terminal 1 have. That is, the user may focus and illuminate the corresponding building (object to be searched) for which information is desired using the meaning sensor of the user terminal 1 so that the corresponding building (object to be searched) for which information is desired is visually displayed on the screen of the user terminal 1.

At this time, the device 10 is, for example, when the user terminal 1 focuses on the object of the landmark that the user wants to know for a preset time, the desired landmark displayed on the screen of the user terminal 1 An image including an object may be recognized as a search request for searching for a search target object (ie, for recognition of a local information request target).

That is, when it is determined that the user terminal 1 has focused the feature object for a preset time, the device 10 recognizes this as a search request and can obtain location information and direction information from the user terminal 1. have. To this end, the device 10 may include a location information and direction information acquisition unit (not shown).

Here, the preset time for determining whether to recognize the search request may be 3 seconds as an example, but is not limited thereto.

When the search request is recognized, the device 10 requests the location information (longitude and latitude coordinates) of the user terminal 1 and the user terminal 1 from a GPS sensor, an electronic compass, and a gyro sensor provided in the user terminal 1. Viewing direction information (azimuth angle information) can be obtained. The device 10 may transmit the acquired location information and direction information of the user terminal 1 to the server 20. In particular, the location information and direction information of the user terminal 1 transmitted from the device 10 may be transmitted to the object storage space unit corresponding to the object storage space layer in the server 20. In other words, in the real life space layer, location information and direction information (location + direction) of the user terminal 1 may be transferred to the object storage space layer.

Here, the server 20 includes a database, and the database may include an object storage space unit corresponding to the object storage space layer and an information storage space unit corresponding to the information storage space layer. The object storage space unit stores information on the location and shape of all feature objects as object information (such object information includes keyword and phase information of the feature object), and the information storage space unit stores information corresponding to object information. Point of interest (POI) information may be stored. Accordingly, object information and corresponding point of interest information may be linked (mapped) to each other and stored in the database of the server 20.

[Object storage layer]

The object storage space corresponding to the object storage space layer may mean a space for storing information of objects (terrain objects) in real life space based on digital map information (geographic information), not simply location information. The information on the objects (terrain objects) on the real life space may be stored in a database of the server 20, particularly in the object storage space. In other words, the object storage space unit may store object information extracted from a digital map in which location information of various terrain objects existing in a real life space is recorded. That is, the object storage space unit may be constructed using object information of a digital map.

In the object storage space unit, information on the location and shape of all terrain objects may be stored as object information. In this case, the object information is converted into an MBR in the object storage space and stored in an R-tree structure. However, the present invention is not limited thereto, and object information may be converted to MAR and stored in an R-tree structure in the object storage space. Since the description of MBR and MAR has been described in detail above, it will be omitted below.

9 is a diagram for explaining an R-tree structure, which is a storage structure of object information, in the apparatus 10 for automatically recognizing area information according to an embodiment of the present application.

Referring to FIG. 9, the R-tree structure may be regarded as a structure of tree data that stores spatial information on feature objects. Here, the spatial information may be expressed differently as object information. Therefore, the spatial information may mean object information including information on the location, shape, and phase of the feature objects.

In the object storage space, object information may be stored in an R-tree structure in the form of an MBR, for example. That is, in the server 20, all object information represented by MBR may be stored (built) in an R-tree structure. Accordingly, the present application can more quickly perform a search for what buildings exist around the user (ie, search for buildings existing around the user terminal from a location corresponding to the location information of the user terminal) based on this.

For example, an R-tree structure may be constructed such that 1,2,3 feature objects are included in the R1 area, and 4,5,6 feature objects are included in R2. In this case, when the search range is as shown in FIG. 9, the server 20 confirms (identifies) that 3, 4, and 6 feature objects exist within the search range through a search based on the R-tree structure. I can.

For example, object information may be stored in an MBR format in an object storage space of the server 20, and object information stored in the object storage 15 of the device 10 may be stored in a MAR format. However, the present invention is not limited thereto, and as another example, object information may be stored in a MAR format in the object storage space.

Using the location information and direction information of the user terminal 1 transmitted from the real-life space layer, based on the object information stored in the R-tree structure in the object storage space, what buildings (terrestrial objects) are located in the surrounding area where the user is located. S) can be detected (identified) more quickly. Object information stored in an R-tree structure and POI information corresponding thereto may be mapped and stored in the database of the server 20.

Accordingly, the server 20 uses the location information and the direction information of the user terminal 1 received from the device 10, among the object information stored in the object storage space, within a preset distance range from the location of the user terminal. Positioned object information (that is, information about the location and shape of the feature objects) can be identified more quickly using the R-tree. In other words, in the present application, an object storage unit may be provided as an object information DB (in other words, a building information DB) capable of responding more quickly to a query about a building search by using the inclusion relationship between the characteristics of the tree and the MBR.

Thereafter, the server 20 may provide the object information identified in the object storage space unit and point of interest information corresponding to the object information identified in the information storage space unit to be described later to the device 10 together.

In the object storage space layer, (location + direction) information transmitted from the real life space layer and the identified object information may be delivered to the information storage space layer. Here, the identified object information may include keyword and phase information (ie, building keyword + phase information) of terrain objects (eg, buildings). In addition, such object information may include information on the location and shape of the feature object.

[Information storage layer]

The information storage space corresponding to the information storage space layer may mean a space in which point of interest (POI) information corresponding to the object information existing in the object storage space is stored based on a location based on the balance map information. have. This point of interest information may be stored in a database of the server 20, in particular, in an information storage space.

In the present application, as an example, only POI information corresponding to the object information is stored in the information storage unit, but is not limited thereto. As another example, the information storage unit may store not only information having a public nature such as POI, but also information directly written by a user for object information.

Information (POI information) stored in the information storage space may be indexed with location information and keyword information of a feature object. In other words, POI information may be stored in the information storage space. In this case, the POI information may be indexed as a keyword of the feature object stored in the object storage space based on the location (longitude latitude coordinates) of the feature object and stored in the information storage space.

Accordingly, according to the information storage space unit, POI information of a feature object corresponding to the object information identified in the object storage space layer may be identified (searched). In other words, when object information is identified in the object storage space unit using (location + direction) information, the server 20 may identify (search) POI information corresponding to the object information identified in the storage space unit. That is, the server 20 identifies object information located within a preset distance range from the location of the user terminal using the object storage unit, and identifies (searches) POI information corresponding to the identified object information using the information storage unit. can do.

In the information storage layer, (location + direction) information received from the object storage layer, building keyword + phase information as the identified object information, and information corresponding to the identified object information (ie, POI information) are displayed as an information display space. You can pass it to the layer. In other words, when the server 20 acquires (receives) the location information and the direction information of the user terminal 1 from the device 10, based on the database including the object storage space unit and the information storage space unit, the user The device 10 identifies object information located within a preset distance range from a location corresponding to the location information of the terminal and POI information corresponding thereto, and identifies the identified information (object information and POI information corresponding thereto). Can be delivered to (transfer).

Here, the object storage space unit may be expressed differently as a building information DB, and the information storage space unit may be expressed differently as a POI DB. In addition, as an example, in the present application, the building center coordinates in the POI DB are queried from the building information constructed as an R-tree in the object storage space, and the building name (name) in the POI DB is mapped to the building information in response to the query. By doing so, the database of the server 20 can be built.

In other words, after the R-tree is constructed, the POI DB can be constructed by querying the R-tree for the coordinates of the building center of the POI DB, and mapping the building information (object information) and the POI as a result. Thereafter, when receiving the location information and direction information of the user terminal through communication with the device 10, the server 20 provides object information around the user and corresponding POI information to the user terminal using the R-tree. I can. The device 10 performs a search for a building desired by the user based on object information provided from the server 20 and POI information corresponding thereto, and transmits POI information for the searched building to the user terminal 1 Can be provided on the screen of.

The database of the server 20 will be described again as follows. Object information (building information) and POI information corresponding thereto may be stored in the database. Object information (building information) may be composed of coordinates of vertices of a building. As one object information, coordinates of all vertices of a building may be stored. The coordinates of the vertices of the building may be composed of the latitude/longitude information of the building. In addition, information on the shape of the object in relation to the object information may be made of a polygon (polygon) as the start and end of the coordinates of the vertices of the building are always the same.

In addition, with respect to POI information stored in the database, the POI information may be exemplarily configured in the form of NID, Ncode, name_full, Name_alias, Name_field, Xpos, Ypos, Admcode_A, Admname_A, Admcode_L, admname_L, LANDMARK, Codename, and TOP_POI. . In addition, as POI information, for example, a building name (name), a building center coordinate, and a building address may be used as main data.

According to this, object information (building information) built using R-tree and POI information corresponding thereto can be mapped and stored in the database, through which the building vertices and building names (names) are linked (connected) to each other and stored. Can be.

[Information space layer]

The information display space corresponding to the information display space layer may mean a space displayed on the screen of the user terminal 1. That is, the information display space layer is a layer that connects the information identified (searched) in the information storage space and the real life space, and may mean a screen of the user terminal 1. The user terminal 1 may include, for example, a portable terminal, a smart device, a head mounted display (HMD), and all types of devices capable of visually displaying information such as digital signage.

Specifically, the device 10 provides the location information and direction information of the user terminal to the server, and in response thereto, the object located within a preset distance range from the location corresponding to the location information of the user terminal identified by the server. Information and POI information corresponding thereto may be obtained. The device 10 may store information (object information and POI information corresponding thereto) obtained from the server 20 in the object storage unit 15 of the device 10. Thereafter, the apparatus 10 uses the extraction unit 11, the selection unit 12, and the recognition unit 13 to request local information from among the topographic objects included in the search area displayed on the user terminal ( Search target object) can be recognized (specified). At this time, the device 10 is based on the premise that the object to be searched for the search by the user is the building closest to the center of the screen of the user terminal 1, the feature objects included in the search area displayed on the user terminal Among them, it is possible to specify which object the user wants to search for the POI (ie, the object to be searched). Thereafter, the device 10 displays the information of the point of interest corresponding to the region information request object (search target object) recognized based on the information stored in the object storage unit 15 on the screen of the user terminal 1. It can be displayed by overlaying it on the information request target.

Accordingly, the device 10 to the system 100 may provide POI information identified based on location information and direction information of the user terminal 1. In particular, in the device 10 to the system 100, the user in the real life space can transmit POI information on the search target object that the user wants to recognize by simply illuminating the search target object to the user terminal 2. It can be provided so that it can be recognized through the screen of the user terminal 1.

The device 10 comprehensively considers the location information and direction information of the user terminal, and the phase information of the object, and overlays the POI information on the search target object that the user wants to search on on the search target object displayed on the screen. Can be displayed.

The present application can provide an outdoor MR-based service based on an outdoor MR model built based on the location of a real-life space that enables POI search of a search target object without a keyword.

FIG. 10 is a diagram illustrating an example in which the apparatus 10 for automatically recognizing area information according to an exemplary embodiment of the present disclosure searches for POI information for an area information request target (search target object). In particular, FIG. 10 is a diagram showing an example of a screen displayed on the screen of the user terminal 1 by the device 10.

Referring to FIG. 10, a screen corresponding to a search area s recognized (illuminated) through an image sensor may be displayed in the first area S1 of the user terminal 1.

In addition, in the second area S2 of the user terminal 1, a map indicating a location on the map corresponding to the search area s may be displayed.

Exemplarily, a rectangle L1 with a red border displayed on the map of the second area S2 represents the MAR of the POI that exists in reality. In addition, the red triangle L2 indicating various POIs displayed on the map of the second area S2 allows the selection of visually identifiable visual feature objects by the selection unit 12 within the search area to be intuitively confirmed. Is shown. In addition, among the POIs indicated by the red triangle L2, a blue square L3 represents a region information request target (ie, a search target object) recognized by the recognition unit 13.

A first UI (User Interface) icon may be displayed in the third area S3 of the user terminal 1 to allow the user to select (determine) whether or not to display the map on the screen of the user terminal 1. have. The screen size of the first area S1 may be set to be larger or smaller depending on whether the map is displayed by the first UI icon.

A second UI icon may be displayed in the fourth area S4 of the user terminal 1 to allow the user to select (determine) whether or not to start the POI search. For example, when a POI search is started by a user input to the second UI icon in the shape of a search start button, the fourth area S4 may be changed to an icon in the shape of a search stop button that enables the search for the POI to be stopped. . For example, after the search for the POI is completed, an icon in the shape of a search start button may appear to enable re-search, and when a user input for this is made, the POI re-search may be performed. The search target object (region information request target) that the user wants to search among the feature objects on the screen recognized through the image sensor through POI search may be recognized (identified).

After the POI search is completed, POI information corresponding to the search target object may be overlaid and displayed on the search target object recognized (identified) on the screen recognized through the image sensor. Here, the POI information may include at least one of a name (name) and an address.

As an example, when the user illuminates a specific feature object for a preset time (eg, 3 seconds) using the image sensor of the user terminal 1, the device 10 regards this as a search request, and the image The object to be searched may be recognized (identified) within the image recognized through the sensor, and POI information corresponding thereto may be provided.

In the exemplary embodiment of the present application, it is exemplified that the present apparatus 10 displays POI information only for one region information request object (search request object) recognized by the recognition unit 13, but is not limited thereto. As another example, the apparatus 10 may display POI information corresponding to each of the visible terrain objects selected by the selection unit 12 according to a user setting. As another example, the device 10 displays POI information corresponding to each of the object information stored in the object storage unit 15 (ie, terrain objects located within a preset distance range from the location of the user terminal). can do. Whether to display POI information on such visible terrain objects and whether to display POI information on object information stored in the object storage unit 15 may be selectively performed based on a user input.

In addition, the display control unit 14 of the device 10 displays the point-of-interest information corresponding to the object for requesting local information recognized by the recognition unit 13, and then a user input for the displayed point-of-interest information (for example, touch When it is determined that selection input using the like) has been made, search information searched based on the displayed point of interest information (eg, POI name, POI address, etc.) may be displayed on the screen of the user terminal 1. Here, the displayed search information is search information corresponding to information on a point of interest in which a user input has been made, and may be information searched through a search engine. For example, the search engine may mean a search engine such as Google, Naver, or Daum, but is not limited thereto. Through the provision of such search information, the device 10 may provide more detailed information on POI information identified and recognized through the device 10.

11 is a diagram illustrating an example of search information provided by the apparatus 10 for automatically recognizing area information according to an embodiment of the present application.

Referring to FIG. 11, a user may perform focusing on a building to be searched among buildings (terrain objects) existing in a real life environment through an image sensor of the user terminal 1 as shown in FIG. 11(a). I can. In this case, the device 10 recognizes (identifies) the focused building that the user wants to search among the image buildings recognized through the image sensor, and the recognized focused building (i.e., area information recognized by the recognition unit) POI information corresponding to the request target) may be displayed on the screen of the user terminal 1 as shown in (b) of FIG. 11. For example, when the focused building is the'Leaning Tower of Pisa', the display control unit 15 is the POI information of the building focused on the building displayed (displayed) on the screen of the user terminal 1, which is the name of the POI. The Leaning Tower of Pisa can be displayed overlaid.

In addition, when it is determined that a user input (for example, a selection input using touch, etc.) is made for the POI information displayed on the user terminal 1 as shown in FIG. 11B, the displayed Search information searched based on POI information may be displayed on the screen of the user terminal 1. For example, when a user input is made to the POI information displayed on the user terminal 1, the leaning tower of Pisa, the display control unit 15 retrieves information about the leaning tower of Pisa as shown in FIG. 11(c). Can be displayed on the screen.

12 is a diagram illustrating another example of search information provided by the apparatus 10 for automatically recognizing area information according to an embodiment of the present application.

Referring to FIG. 12, when the user focuses on the building to be searched using the user terminal 1 as shown in FIG. 12(a), the device 10 is the user terminal 1 as shown in FIG. 12(b). As POI information of the building focused on the screen of ), information such as'Aeronautical University Lecture Building' can be displayed. Thereafter, when a user input is made for the displayed POI information (for example, aeronautical university lecture building), the device 10 is searched based on the'Aerospace University lecture building' information as shown in Fig.12(c). Result information) can be displayed on the screen of the user terminal 1.

13 is a diagram illustrating another example of search information provided by the apparatus 10 for automatically recognizing area information according to an embodiment of the present application.

Referring to FIG. 13, when a user focuses on a building to be searched using a user terminal as shown in FIG. 13(a), the device 10 is a screen of the user terminal 1 as shown in FIG. 13(b). POI information of the building focused on the image may be provided in a pop-up window. For example, the display control unit 15 of the device 10 may provide POI information such as "The information of the searched building is Lotte Mart Hwajeong Branch (66 Hwajung-ro, Deogyang-gu, Goyang-si, Gyeonggi-do, Korea) in the form of a pop-up window.

Next, when it is determined that the user has confirmed the POI information by making a user input for checking the provided POI information, the display control unit 15 searches for detailed information on the POI information displayed as shown in FIG. 13C. It may provide a search engine selection menu for. For example, the search engine selection menu may include selection menus such as'Search with Naver','Search with Next', and'Search with Google'.

At this time, when a user input for'Search with Naver' is made, the display control unit 15 uses the Naver search result as a keyword using POI information displayed as shown in Fig. 13(d) as search information for the displayed POI information. (1) Can be displayed on the screen.

The device 10 to the present system 100 search for local information that allows the user to easily search for POIs around the user just by focusing the POIs around the user existing in the real life space with the image sensor of the user terminal. Technology can be provided.

In the present application, a new geographic information infrastructure can be constructed through the object storage space unit and the information storage space unit, so that information can be provided in consideration of the surrounding situation of the user. The present system 100 proposed in the present application has scalability that can be expanded if only object information (building information) and POI data exist, and thus the scale of the infrastructure can be increased. In addition, according to the present application, it is possible to utilize a system specialized for POI information by using the constructed geographic information infrastructure.

In addition, the present application proposes an outdoor MR model based on the actual location of the real-life space object, in which case the location of the real-life space object can be extracted using a digital map. In addition, as a service based on the outdoor MR model proposed in the present application, the present application can provide an Ambient Browser that can search POI information simply by illuminating a building in a real life space to a user terminal without a keyword.

According to the outdoor MR model proposed in the present application, it is possible to specify the location and range of a real-life space that the user wants to search by using the location and viewing direction information of the user terminal. Thereafter, based on the specified location and range information, a search for an object at a corresponding location in the object storage space layer may be performed. Thereafter, in the information storage layer, information (POI information) at a corresponding location, that is, POI information for objects retrieved from the object storage layer may be searched. Thereafter, the object information retrieved from the object storage layer and the information storage layer and the corresponding POI information are the positional relationship between the two pieces of information (object information and POI information) and the location information and direction information of the user terminal in the information display space. It can be displayed on the screen in consideration. The displayed information (for example, POI information) can be recognized by a user in a real life space through a user terminal.

This application can provide Ambient Browser, a digital map-based mobile MR system to which the concept of Ambient Intelligence is applied. The present application can enable the user to receive information about the building by simply illuminating the building in a real-life space for which information is desired with an image sensor of a user terminal without a keyword.

The present application proposes an outdoor MR model based on real life space location for outdoor MR-based services, taking into account that the conventional MR research considers indoor use. In this study, it was shown that the object storage space, which is the core of the outdoor MR model, was constructed using a digital map. In addition, the present application shows an actual application example of the Ambient Browser (see FIGS. 10 to 13 as an example) as an example of a service based on an outdoor MR model.

Meanwhile, in the apparatus 10, the extraction unit 11 may correct the location information obtained from the user terminal 1 before extracting the candidate terrain objects. A more detailed description of the correction of the location information is as follows.

When the location information obtained from the user terminal 1 is GPS information, the GPS has an error range of about 5 m, which may become larger or smaller depending on the surrounding environment. Such an error in the location information may cause an incorrect POI search to be performed with respect to the device 10 that performs a POI search based on the location information and direction information of the user terminal. Therefore, the device 10 corrects an error in the location information obtained from the user terminal 1 by using object information (building information) and image processing extracted from the digital map so that a more accurate POI search can be made. In addition, the POI search may be provided based on the corrected location information.

When it is determined that there are a plurality of feature objects whose entire width is exposed in the search area through image analysis of the search area, the extraction unit 11 calculates an image of the plurality of feature objects through image analysis. Based on the analysis-based width ratio set and the feature objects stored in the object storage unit, a plurality of candidate feature objects corresponding to the positions and directions of the plurality of feature objects are projected onto the search area to correspond to the object width. Thus, it is possible to determine whether there is a discrepancy between the calculated object information-based width ratio sets.

Here, the width ratio set may mean a ratio with respect to the width of each of the buildings, for example. As another example, the width ratio set may mean a ratio considering not only the width of each of the buildings but also the width of the space between the buildings. That is, as another example, the width ratio set may mean a ratio related to the width of each of the buildings and the width of the space between the buildings.

In addition, the image analysis-based width ratio set may mean a width ratio set calculated through image analysis for an image projected on the screen of the user terminal 1. Also, the object information-based width ratio set may mean a width ratio set calculated based on object information (building information) extracted from a digital map. The object information-based width ratio set may include a plurality of object information-based width ratio sets calculated according to a search position for a plurality of candidate feature objects.

When it is determined that the determination result is inconsistent, the extraction unit 11 changes (shifts) the location information within the error range of the location sensor of the user terminal while maintaining the direction information obtained from the user terminal constant, based on image analysis. The width ratio set based on the other object information corresponding to the width ratio set can be searched. That is, if it is determined that the determination result is inconsistent, the extraction unit 11 determines the other object information-based width corresponding to the image analysis-based width ratio set among the plurality of object information-based width ratio sets calculated for the plurality of candidate feature objects. You can browse through a set of ratios.

Here, the change of the location information may mean a change by shift movement that is moved without changing the orientation information. In addition, the change of the location information within the error range may be automatically performed by the device 10, but is not limited thereto, and may be performed manually by a user input. In addition, the determination of whether there is an error in the location information obtained from the user terminal may be automatically performed by the device 10 or may be performed manually by the user's determination. This can be more easily understood through the description to be described later.

If it is determined that there is an image analysis-based width ratio set and another object information-based width ratio set corresponding to the image analysis-based width ratio set, it is deemed that there is an error in the location information and may correct the location information obtained from the user terminal. That is, if the extraction unit 11 determines that there is an image analysis-based width ratio set and another object information-based width ratio set corresponding to the image analysis-based width ratio set, it is deemed that there is an error in the location information, so that the location information obtained from the user terminal is image analyzed. Another object information-based width ratio set corresponding to the base width ratio set may be corrected to the calculated search position.

A description of the position information correction may be more easily understood through description with reference to the following drawings.

FIG. 14 is a diagram for explaining an example in which the determination of whether an error exists in the location information of a user terminal acquired by the apparatus 10 for automatically recognizing local information according to an embodiment of the present application is manually performed by the user's determination . In other words, FIG. 14 shows a case where the building that the user actually wants to search for (for example, building A) and the building that the user wants to search for by the device 10 (eg, building B) do not match. Shows an example.

In FIG. 14, pos 1 in FIG. 14 represents a location corresponding to the location information of the user terminal 1 obtained by the device 10, that is, an example of the location coordinates of the user terminal 1 recognized by the device 10. Show. pos 2 represents an example of the location coordinates of the actual user terminal 1. In addition, pos 1-f (focus) represents the center line of sight recognized by pos 1 (ie, the line of sight corresponding to the center of the screen), and pos 2-f represents the center line of sight recognized by pos 2.

Referring to FIG. 14, as an example, when a user wants to perform a POI search (search) for building A, the user may select the user terminal 1 so that the building A is located at the center of the screen of the user terminal 1. The image sensor can be focused toward building A. Accordingly, in the entire screen area S1 of the user terminal 1, the building A may be visually displayed so that it is located at the center.

In this case, a map showing location information and direction information of the user terminal recognized by the device 10 may be provided in a region S2 of the screen of the user terminal 1.

In this case, when there is an error in the location information of the user terminal recognized by the device 10, the location of the user terminal displayed on the map may be displayed as a location with an error different from that of the actual user (pos 2). That is, in the location of the user with an error appearing on the map, it may be recognized that the building B is a building located in the center line of sight.

According to this, when an accurate search is made, the device 10 should display POI information of building A as POI information on the object to be searched on the screen of the user terminal 1. However, in the example illustrated in FIG. 14, since the object to be searched is incorrectly recognized due to the existence of an error in the acquired location information of the user terminal, the apparatus 10 may erroneously display POI information of building B.

As such, in the present application, the user can use the map provided on one area S2 of the user terminal 1 and the image recognized through the image sensor provided on the full screen area S1 of the user terminal 1 It is possible to manually detect (recognize) whether there is an error in the location information obtained from 1).

15 is a diagram illustrating an example of a case where the location information of a user terminal is manually changed by a user input in the region information automatic recognition apparatus 10 according to an exemplary embodiment of the present application.

Referring to FIG. 15, in FIG. 15, (a) shows that the location of the user terminal displayed on the map is recognized through the image sensor of the user terminal due to an error in the location information of the user terminal (that is, due to a GPS error). It represents a case different from the location of the actual user terminal corresponding to the image.

In this case, the user performs a user input such as dragging the location coordinate (pos 1) corresponding to the location information displayed on the map of the user terminal 1 through a screen touch, as an example, as shown in FIG. 15B. You can correct the location information together.

As another example, the user may correct the location information through a user input to the location information adjustment icon Q displayed on a portion of the screen of the user terminal 1. At this time, by a user input to the location information adjustment icon Q, location information displayed on the map may be changed and displayed in real time. The location information may be moved upward or downward based on the drawing, for example, by the location information adjustment icon Q. However, the present invention is not limited thereto, and the location information may be moved in any one of 360-degree directions by the location information adjustment icon Q.

According to a user input, a manually corrected corrected position coordinate (pos 1', that is, the position coordinate of an actual user terminal) may be displayed on the map as shown in FIG. 15B. In this case, the device 10 may perform POI search (search) based on the corrected location information as shown in FIG. 15B. That is, the location information of the user terminal 1 recognized by the device 10 herein may be corrected as it is manually fine-tuned by a user input, for example.

16 is for explaining an example in which the determination of whether an error exists in the location information of the user terminal acquired by the apparatus 10 for automatically recognizing local information according to an embodiment of the present application is automatically made by the apparatus 10 It is a drawing.

In FIG. 16, pos 1 represents a location corresponding to the location information of the user terminal 1 acquired by the device 10, that is, an example of the location coordinates of the user terminal 1 recognized by the device 10. pos 2 represents an example of the location coordinates of the actual user terminal 1.

Referring to FIG. 16, the extraction unit 11 performs an image analysis on an image corresponding to the search area s displayed on the user terminal 1 as shown in FIG. 16A, and thus the image analysis-based width ratio Set can be calculated. In this case, the image analysis-based width ratio set calculated from the image displayed on the user terminal 1 may mean a width ratio set calculated at the actual position pos 2. In other words, the image displayed on the user terminal 1 in FIG. 16A may represent an example of an image recognized at the position pos 2.

In addition, the extraction unit 11 may calculate an object information-based width ratio set for a plurality of candidate feature objects based on the feature objects stored in the object storage unit 15. In this case, the calculated object information-based width ratio set may mean, for example, a width ratio set calculated at a position pos 2 in FIG. 16B.

In this case, the extraction unit 11 may determine whether the image analysis-based width ratio set calculated from the image displayed on the user terminal 1 and the object information-based width ratio set calculated at the pos 2 position do not match.

As a result of the determination, since there is a discrepancy, the extraction unit 11 changes the position of pos 1 such as the first position (pos 1') and the second position (pos 1') with the direction information kept constant (shift ) While searching for another object information-based width ratio set corresponding to the image analysis-based width ratio set. In this case, the object information-based width ratio set calculated at the first position (pos 1 ′) may mean another object information-based width ratio set corresponding to the image analysis-based width ratio set searched by the extraction unit 11. . Therefore, as a result of the search, since the image analysis-based width ratio set and the other object information-based width ratio set corresponding to the first position (pos 1') exist for the first position (pos 1'), the extraction unit 11 Considering that there is an error in the location information, the location information (pos 1) of the user terminal 1 recognized by the device 10 may be corrected to the first location (pos 1 ′).

At this time, as an example, when the location of pos 1 is changed (shifted), the extraction unit 11 maintains constant direction information for the feature objects stored in the object storage unit based on the digital map. The window width of the image that can be recognized by the sensor can be changed (shifted) by a distance corresponding to the width of one building in the left and right directions.

As such, the device 10 is based on an image analysis-based width ratio set (in other words, a building size ratio pattern on the image) calculated through image analysis and object information on the location of the user terminal recognized by the device 10 Inconsistency can be determined by comparing a set of width ratios (in other words, the pattern of the ratio of the building size to the location of the user terminal recognized by the present apparatus 10 based on a digital map). If the determination result is inconsistent, the apparatus 10 searches for an object information-based width ratio set corresponding to the image analysis-based width ratio set by comparing the object information-based width ratio set to the shifted position while shifting the position of the user terminal. , It is possible to correct the location of the user terminal with the searched corresponding location.

The apparatus 10 may automatically determine whether an error exists in the location information of the user terminal through digital map and image analysis. In this case, in the present application, various image recognition (analysis) algorithms existing or developed in the future may be applied when analyzing an image.

17 and 18 are diagrams for explaining correction of location information of a user terminal in the apparatus 10 for automatically recognizing area information according to an embodiment of the present application.

17 and 18, as shown in (a) of 17, the location of the user terminal 1 recognized through the device 10 is equal to pos 1, and the actual location of the user terminal 1 Suppose the coordinates are equal to pos 2.

The extraction unit 11 may extract outlines of buildings displayed on the screen as shown in (b) of FIG. 17 by performing image analysis on the image displayed on the screen of the user terminal 1.

Next, as shown in (c) of FIG. 17, based on the outlines of buildings extracted through image analysis, the extraction unit 11 sets the width ratio based on image analysis (R1, otherwise expressed as a building size ratio pattern on the image). Can be calculated. In this case, as an example, the extraction unit 11 may calculate an image analysis-based width ratio set R1 based on a vertical line of an outline.

Next, the extraction unit 11 may specify a recognizable search effective area within the error range in consideration of the error range of the position sensor of the user terminal 1 as shown in FIG. 17D. Thereafter, the extraction unit 11 changes the position of pos 1 within the error range based on a plurality of candidate feature objects located in the search effective area, while another object corresponding to the image analysis-based width ratio set R1 It is possible to perform a search for an information-based width ratio set.

At this time, the extraction unit 11 maintains the direction information constant as shown in (a) of FIG. 18, and changes (shifts) the position of pos 1 in the left and right directions within the error range, while the image analysis-based width ratio set and A corresponding object information-based width ratio set R2 may be searched.

As a result of the search, if there is an image analysis-based width ratio set (R1) and another object information-based width ratio set (R2) corresponding to the image analysis-based width ratio set (R2), it is considered that there is an error in pos 1, which is the location information obtained from the user terminal (1). (11) corresponds to the location information pos 1 of the user terminal 1 recognized by the device 10 as shown in (b) of FIG. 18 and the width ratio set based on image analysis (R1) as shown in (c) of FIG. 18 Another object information-based width ratio set R2 may be corrected to a position pos 1'at which the acquisition is performed.

As such, the device 10 may provide more accurate POI information by performing POI search (search) based on the corrected location information of the user terminal.

Hereinafter, based on the details described above, the operation flow of the present application will be briefly described.

19 is a flowchart illustrating a method of automatically recognizing local information through focusing around a user using the apparatus 10 for automatically recognizing local information according to an exemplary embodiment of the present disclosure.

The method for automatically recognizing region information illustrated in FIG. 19 may be performed by the apparatus 10 for automatically recognizing region information described above. Therefore, even if omitted below, the description of the apparatus 10 for automatically recognizing region information may be equally applied to the description of the method for automatically recognizing region information.

Referring to FIG. 19, in step S11, based on the location information and direction information obtained from the user terminal, among the feature objects stored in the object storage unit of the automatic region information recognition device, a search area set to be visually displayed on the user terminal is selected. Corresponding candidate feature objects can be extracted.

At this time, in step S11, if it is determined that there are a plurality of feature objects whose entire width is exposed in the search area through image analysis of the search area, the image calculated for the plurality of feature objects through image analysis Based on the analysis-based width ratio set and the feature objects stored in the object storage unit, a plurality of candidate feature objects corresponding to the positions and directions of the plurality of feature objects are projected onto the search area to correspond to the object width. Thus, it is possible to determine whether there is a discrepancy between the calculated object information-based width ratio sets.

In step S11, when it is determined that the determination result is inconsistent, the position information is changed within the error range of the position sensor of the user terminal while maintaining the direction information while other object information corresponding to the image analysis-based width ratio set. You can explore a set of base width ratios. Thereafter, in step S11, if it is determined that there is another object information-based width ratio set corresponding to the image analysis-based width ratio set, it is considered that there is an error in the location information, and the location information may be corrected.

In step S11, candidate terrain objects may be extracted based on the corrected location information and direction information.

Next, in step S12, among the candidate feature objects extracted in step S11, visible feature objects that can be visually identified within the search area may be selected.

In addition, in step S12, a visible feature object is selected by sequentially searching for candidate feature objects in an order close to the location corresponding to the location information in the search area, but the width occupied by the selected visible feature object in the search area The area can be excluded from the search target range from the next search.

The object storage unit considered in step S11 may store information about the location and shape of the feature objects as object information. Accordingly, the width area corresponding to the selected visible feature object considered in step S12 may mean an area corresponding to the object width appearing in a state in which the selected visible feature object selected in consideration of object information is projected onto the search area. have.

Here, as an example, information about the shape in the object storage unit may be stored in the form of a minimum bounding rectangle (MBR). As another example, information about a shape in the object storage unit may be stored in a MAR (Minimum Area Rectangle) format.

The MAR shape is the smallest area among all cases in which the MBR shape is formed based on a local axis including a line connecting two neighboring vertices among the vertices included in the contour of the feature object included on the digital map. It can mean the corresponding form.

Next, in step S13, among the visible feature objects selected in step S12, the visible feature object located closest to the center of the search area may be recognized as a region information request object.

In addition, although not shown in the drawing, in the method for automatically recognizing local information according to an embodiment of the present application, point of interest (POI) information corresponding to the area information request object recognized in step S13 is transferred to the local information request object. It may include the step of overlaying and displaying.

In the above description, steps S11 to S13 may be further divided into additional steps or may be combined into fewer steps, depending on the embodiment of the present application. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

The method for automatically recognizing region information according to an exemplary embodiment of the present disclosure may be implemented in the form of program commands that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The above-described hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

In addition, the above-described method for automatically recognizing area information may also be implemented in the form of a computer program or application executed by a computer stored in a recording medium.

The foregoing description of the present application is for illustrative purposes only, and those of ordinary skill in the art to which the present application pertains will be able to understand that it is possible to easily transform it into other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present application is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present application.

1: user terminal
10: area information automatic recognition device
11: extraction section
12: sorting unit
13: recognition
14: display control unit
15: object storage

Claims (15)

As a method for automatically recognizing region information through focusing around a user using an automatic region information recognition device,
(a) Based on the location information and direction information obtained from the user terminal, among the feature objects stored in the object storage unit of the region information automatic recognition device, a candidate feature corresponding to a search area set to be visually displayed on the user terminal Extracting objects;
(b) selecting visible feature objects that can be visually identified in the search area among the candidate feature objects; And
(c) recognizing a visible feature object located closest to the center of the search area among the visible feature objects as a region information request object,
Local information automatic recognition method comprising a. The method of claim 1,
The step (b),
In the search area, a visible feature object is selected by sequentially searching for candidate feature objects in an order close to a location corresponding to the location information, and the width area occupied by the selected visible feature object in the search area A method for automatically recognizing local information from the next search to exclude it from the search target range. The method of claim 2,
The object storage unit stores information on the location and shape of the feature objects as object information,
The width area corresponding to the selected visible feature object is an area corresponding to the object width appearing when the selected visible feature object is projected onto the search area in consideration of the object information. Way. The method of claim 3,
The information on the shape is stored in the form of MBR (Minimum Bounding Rectangle). The method of claim 3,
The information on the shape is stored in a MAR (Minimum Area Rectangle) format. The method of claim 5,
The MAR shape is the minimum area among all the cases in which the MBR shape is formed based on a local axis including a line connecting two adjacent vertices among vertices included in the contour of the feature object included on the digital map. In a form corresponding to, the method for automatically recognizing local information. The method of claim 1,
(d) overlaying and displaying POI (Point of Interest) information corresponding to the region information request object recognized in step (c), on the region information request object,
Local information automatic recognition method further comprising a. As an automatic local information recognition device through focusing around the user,
Based on the location information and direction information obtained from the user terminal, among the feature objects stored in the object storage unit of the automatic region information recognition device, candidate feature objects corresponding to the search area set to be visually displayed on the user terminal are extracted. An extraction unit;
A selection unit that selects visually identifiable visible feature objects from among the candidate feature objects; And
A recognition unit for recognizing a visible feature object located closest to the center of the search area among the visible feature objects as a region information request object,
Region information automatic recognition device comprising a. The method of claim 8,
The selection unit,
In the search area, a visible feature object is selected by sequentially searching for candidate feature objects in an order close to a location corresponding to the location information, and the width area occupied by the selected visible feature object in the search area A device for automatically recognizing area information, which is to be excluded from the range to be searched from the next search. The method of claim 9,
The object storage unit stores information on the location and shape of the feature objects as object information,
The width area corresponding to the selected visible feature object is an area corresponding to the object width appearing when the selected visible feature object is projected onto the search area in consideration of the object information. Device. The method of claim 10,
The information on the shape is to be stored in the form of MBR (Minimum Bounding Rectangle), region information automatic recognition device. The method of claim 10,
The information on the shape is stored in a MAR (Minimum Area Rectangle) format. The method of claim 12,
The MAR shape is the minimum area among all the cases in which the MBR shape is formed based on a local axis including a line connecting two adjacent vertices among vertices included in the contour of the feature object included on the digital map. The apparatus for automatically recognizing local information in a form corresponding to. The method of claim 8,
A display control unit that overlays and displays point of interest (POI) information corresponding to the region information request object recognized by the recognition unit on the region information request object,
Region information automatic recognition device further comprising a. A computer-readable recording medium recording a program for executing the method of claim 1 on a computer.

Images