KR100685790B1 - System and Method for Real Image based Navigation - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to an image-based navigation system and a method thereof.

2. The technical problem to be solved by the invention

The present invention guides a route based on a geographic image that is actually photographed (for example, in the case of vehicle navigation, a live image taken on a real road, etc.), thereby providing a realistic, realistic and accurate route guidance. Its purpose is to provide a base navigation system and method thereof.

3. Summary of Solution to Invention

The present invention provides a navigation system mounted to a mobile terminal for guiding a movement route of the mobile terminal, comprising: terminal position obtaining means for obtaining position information of the mobile terminal; Map matching means for matching the position of the mobile terminal received from the terminal position obtaining means with the position on the numerical map; Controls a route searching means to receive a route to a user's destination, and uses the map-matched location information and 'mathematic map and image mapping information' in the map matching means as the mobile terminal moves to the received route. An image-based route guidance means for searching for a geographic image corresponding to a current position of the mobile terminal and combining and outputting corresponding route guidance information to the retrieved geographic image; The route retrieving means for retrieving a route to a destination using a digital map and POI information under the control of the image-based route guidance means; And storage means for storing digital maps, POI information, geographic images, and 'mapping map and image mapping information'.

4. Important uses of the invention

The invention is used in navigation systems and the like.

Navigation, Route Guide, Geographic Image, Mapping Information, Spatial Object, Attribute Information

Description

Image-based navigation system and its method {System and Method for Real Image based Navigation}             

1 is a configuration diagram of an embodiment of an image-based navigation system according to the present invention;

2 is a screen configuration diagram of an embodiment of an image-based navigation system according to the present invention;

3 is a diagram illustrating an embodiment of a method for acquiring an image used for image-based navigation according to the present invention;

4 is a flowchart illustrating a method of mapping an image and a digital map according to the present invention and extracting attribute information on a spatial object from the image;

5 is an explanatory diagram of an embodiment of attribute information of a spatial object extracted from an image according to the present invention;

6 is a flowchart illustrating an embodiment of an image-based navigation method according to the present invention.

* Explanation of symbols for the main parts of the drawings

100: image-based navigation system 110: terminal position acquisition unit

120: map matching unit 130: image-based route guidance unit

140: path search unit 150: memory data management unit

160: storage information access unit 170: storage unit

The present invention relates to an image-based navigation system and a method thereof, and more particularly, to provide a realistic, realistic and accurate route guidance by guiding a route based on a geographic image actually captured. And to a method thereof.

Conventional navigation systems provide a path guidance function based on two-dimensional (2D) or three-dimensional (3D) graphics, not actual photo-realistic images, and thus lack a sense of realism and realism, and thus allow a user to There is a problem that it is difficult to find a destination.

The present invention has been proposed to solve the above problems, by providing a route based on the actual geographic image (for example, a real image taken on a real road, etc.) to provide a realistic, realistic and accurate route guidance. It is an object of the present invention to provide a video based navigation system and a method thereof.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

According to an aspect of the present invention, there is provided a navigation system mounted on a mobile terminal to guide a movement route of the mobile terminal, comprising: terminal position obtaining means for obtaining position information of the mobile terminal; Map matching means for matching the position of the mobile terminal received from the terminal position obtaining means with the position on the numerical map; Controls a route searching means to receive a route to a user's destination, and uses the map-matched location information and 'mathematic map and image mapping information' in the map matching means as the mobile terminal moves to the received route. An image-based route guidance means for searching for a geographic image corresponding to a current position of the mobile terminal and combining and outputting corresponding route guidance information to the retrieved geographic image; The route retrieving means for retrieving a route to a destination using a digital map and POI information under the control of the image-based route guidance means; And storage means for storing the digital map, POI information, geographic images, and 'mapping map and image mapping information'.

The system of the present invention further comprises storage information access means for providing an interface for accessing the storage means in a unified manner; And memory data management means for loading the digital map and mapping information of the digital map and the image into the memory for path search and route guidance, and managing the information on the memory. The storage means in the system of the present invention further stores image attribute information or spatial object attribute information, and the image-based route guidance means, according to the user's request, image attribute information or spatial object attribute information. It is characterized in that to further perform the function to provide.
On the other hand, the present invention, a navigation method mounted on a mobile terminal applied to the navigation system for guiding the movement path of the mobile terminal, comprising: an input step of receiving route search information from a user; Acquiring the location information of the mobile terminal and acquiring the location of the terminal and matching the location information with the location on the numerical map; A route search step of searching for a route for the input route search information by referring to a digital map, a navigation map, and POI information; And searching for a geographic image corresponding to the current location of the mobile terminal by using the numerical map, image mapping information, and terminal location information when the mobile terminal moves along the searched route, and displays route guide information on the searched geographic image. And providing an image-based route guidance step.

delete

In addition, the method of the present invention, by checking whether the mobile terminal is moving along the searched path using the map matched location information in the terminal location acquisition and map matching step and the path searched in the path search step, A route rescanning step of searching for a new route based on the position of the current mobile terminal if there is a route deviation; And providing attribute information for providing image attribute information or spatial object attribute information according to the user's request.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of an image-based navigation system according to an embodiment of the present invention. As shown in the drawing, the image-based navigation system 100 includes a terminal position obtaining unit 110, a map matching unit 120, and an image. Based path guide unit 130, path search unit 140, memory data management unit 150, storage information access unit 160, and storage unit 170.

The image-based navigation system 100 of FIG. 1 is installed and used in a mobile terminal (mobile terminal) such as a PDA and an Auto PC mounted on a mobile body such as a car. Hereinafter, each component will be described.

The terminal location obtaining unit 110 obtains the location information of the mobile terminal on which the image-based navigation system 100 is mounted. The terminal location obtaining unit 110 receives a GPS signal and provides the current location of the user (more accurately, the current location of the user terminal). The position information of the mobile terminal is acquired from a GPS receiver, an odometer, and the like.

The map matching unit 120 performs a function of matching the position of the terminal received from the terminal position obtaining unit 110 with a position on the numerical map (for example, the position on the numerical map road in the case of vehicle navigation).

The image-based route guide unit 130 controls the route search unit 140 to receive a route to the user's destination, and as the mobile terminal moves to the received route, the map matching unit 120 maps the match. The geographic image corresponding to the current location of the mobile terminal is searched by using the location information and the 'mathematic map and image mapping information', and the route guide information is combined with the retrieved geographic image and output. At this time, the image-based route guide unit 130 receives route search information from the user, instructs the route search unit 140 to route search, receives the route searched from the route search unit 140, and receives the received route search information. It checks whether the mobile terminal deviates from the route by using the route and map-matched location information (processing result of the map matching unit), and if there is a route deviation, commands to search for a new route based on the current mobile terminal position. (See Figure 6).

Through the above process, the image-based route guide unit 130 provides the geographic image to the user, guides the route based on the same, and also adds the route guide information on the geographic image.

Here, the route guide information includes a destination name, information on surrounding facilities currently displayed in the image, a distance remaining to the destination, a current speed, an arrival time to the destination, and a future travel direction. ) Is retrieved through the storage information access unit 160 and combined with the geographic image, and if it is not stored in the storage unit 170, the image-based route guide unit 130 generates the self- Will be used.

In addition, the image-based route guide unit 130 searches for the image attribute information or the spatial object attribute information stored in the storage unit 170 and provides the user to the user through the storage information access unit 160 according to a user's request. do.

The path search unit 140 controls navigation maps and other information (POI information, etc.) like the navigation based on the 2D or 3D graphics based on the control of the image-based path guide 130. For reference, the route to the destination is searched by the memory data manager 150 (if the memory data manager is not found, the storage 170 accesses the storage information access unit 160). At this time, the path search unit 140 performs a path search through various path search algorithms.

The memory data management unit 150 includes a memory, and loads a numerical map (including a navigation map), mapping information of the numerical map and images into a memory and manages the memory in the memory for path search and route guidance. .

The storage unit 170 is a file system or a database, and includes a digital map (including a navigation map) and Point of Interest (POI) information 171 used in a navigation system, actual images acquired by a vehicle, and image attributes related thereto. Information (e.g., attribute information on the name of the road on which each image was taken, property information, etc.), spatial object attribute information 172, digital map and image mapping information 173, and route guidance information (not stored). May not be used). In addition, the storage unit 170 may be various storage media such as a CD-ROM.

Here, the mapping information is generated through mapping between the actually taken geographic image and the digital map. When the location information of the mobile terminal is obtained through the GPS receiver, the mapping information is generated based on the acquired position of the geographic image. When the location information is obtained through the odometer, the location information is generated based on the road name and the distance information.

The storage information access unit 160 provides an interface for accessing the storage unit 170 in a unified manner from the outside (for example, an image-based route guide unit and a memory data manager). That is, when there is a request for access to data stored in the storage unit 170 from the outside, the storage information access unit 160 searches for the storage unit according to the data storage method (that is, the stored data is transferred to the file system). Depending on whether it is stored or stored in a database, it retrieves the data using the appropriate interface method and delivers the result. In addition, the storage information access unit 160 has various interface functions for accessing data stored in the storage medium even when the storage unit 170 is various storage media such as a CD-ROM. As a result, the function module (for example, the image-based route guide unit) to search for data in the storage unit 170 may consider how the data is stored, what is the storage medium, and the interface method accordingly. There is no need.

2 is a screen configuration diagram of an embodiment of an image-based navigation system according to the present invention.

In the image-based navigation system 100 according to the present invention shows a geographic image taken on the actual road instead of the two-dimensional (2D) and three-dimensional (3D) graphics shown in the conventional navigation, as shown in the example screen The forward direction, destination name and remaining time will be shown.

3 is a diagram illustrating an embodiment of a method of acquiring an image used for image-based navigation according to the present invention.

The geographic image used for route guidance in the image-based navigation system 100 should be the same image as the user driving the vehicle through the windshield of the vehicle and similar images, which is more realistic and realistic in the system. To provide.

In addition, an image of the same angle as a bird view may also be provided, in order to secure a wider field of view to the user so that the direction of the future may be previewed.

To acquire such a geographic image, as shown in FIG. 3, a camera and other devices (eg, a GPS receiver and an odometer) are mounted on a vehicle, and the road is photographed while driving on a real road.

When using a high-definition video camera (such as a CCTV camera or a high-definition camera), the angle at which the image is captured and the lens constants for capturing the image can be known. This allows more various extraction of attribute information to be shown on the image. .

4 is a flowchart illustrating a method of mapping an image and a digital map according to the present invention and extracting attribute information on a spatial object from the image, and mapping the acquired image to the digital map for use in image-based navigation. A method of extracting attribute information of a spatial object from the image is shown.

First, obtain a geographic image and attribute information of the geographic image (vehicle name where each image was photographed, photographed facility, photographing time, photographing coordinates, image size, image color information, etc.) through the vehicle (400), The mapping information is generated by mapping the obtained geographic image with a digital map (including a navigation map) for path search (402), and then stored in the storage unit 170. Here, the mapping information may vary according to the geographic image, the acquired attribute information, the digital map (including the navigation map), and the image mapping method. For example, if the vehicle is equipped with a GPS receiver, the vehicle can be mapped based on the acquired position (x, y, z) of the image obtained from the GPS receiver. If an odometer is used, the road name and Mapping can be done using distance information.

Next, after extracting attribute information about various spatial objects (e.g., a specific building, a sign, a signal, etc.) shown in the geographic image (404), the image and image attribute information (see 400) obtained above and The attribute information of the extracted public security object is stored in the storage unit 170.

5 is a diagram illustrating an embodiment of attribute information of a spatial object extracted from an image according to the present invention.

As the attribute information of various spatial objects shown in the geographic image provided to the user, as shown in FIG. Guide the route so you can look more closely at the object of interest.

FIG. 6 is a flowchart illustrating a method of guiding a route through an image-based navigation system according to an embodiment of the present invention.

When the navigation function according to the present invention is started (600), and receives route search information such as a starting point and a destination from the user (602), the image-based navigation system based on the existing two-dimensional (2D) or three-dimensional (3D) Similar to the graphical navigation system, the route search is performed by referring to the numerical map, the navigation map, and the point of interest (POI) 171 (604).

After the route search is finished, when the route guidance starts, it is checked whether the position of the mobile terminal is changed (606), and if the position of the mobile terminal is changed, it is checked whether the mobile terminal has deviated from the searched route (608).

As a result of the path departure confirmation of "608", if the mobile terminal deviates from the searched route, a new route is searched based on the current position of the mobile terminal (604); When the mobile terminal moves along the searched route (that is, does not deviate from the route), the geographic image most suitable for the position of the terminal is obtained by using the map-matched terminal position information and 'mathematic map and image mapping information' (173). The image storage unit 172 retrieves / loads the image 610, and displays the image through the image-based route guide 130 (612). In this case, various route guide information may be displayed on a geographic image (612), and the route guide information may be retrieved from a storage unit or generated by itself (see FIG. 1). Here, the route guide information includes a destination name, information on surrounding facilities appearing in the image currently being output, the distance remaining to the destination, the current speed, the arrival time to the destination, and the future direction.

In addition, the image attribute information or the spatial object attribute information may be provided together with the user's request.

This process is repeatedly performed until the destination is reached, and when the destination is reached (614), the navigation function is terminated (616).

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

The present invention as described above, unlike the existing navigation system for guiding a route based on two-dimensional (2D) or three-dimensional (3D) graphics, because the route is guided based on the geographic image actually taken, the route guidance is a reality It can be executed realistically and realistically, and it also has the effect of providing the user with accurate information in destination or route guidance.

Claims (16)

In the navigation system mounted on the mobile terminal for guiding the movement path of the mobile terminal, Terminal position obtaining means for obtaining position information of the mobile terminal; Map matching means for matching the position of the mobile terminal received from the terminal position obtaining means with the position on the numerical map; Controls a route searching means to receive a route to a user's destination, and uses the map-matched location information and 'mathematic map and image mapping information' in the map matching means as the mobile terminal moves to the received route. An image-based route guidance means for searching for a geographic image corresponding to a current position of the mobile terminal and combining and outputting corresponding route guidance information to the retrieved geographic image; The route retrieving means for retrieving a route to a destination using a digital map and POI information under the control of the image-based route guidance means; And Storage means for storing numerical maps, POI information, geographic images, and 'mapping map and image mapping information' Image-based navigation system comprising a. The method of claim 1, Storage information access means for providing an interface for accessing said storage means in a unified manner Image-based navigation system further comprising. The method of claim 1, Memory data management means for loading the numerical map, mapping information of the numerical map and the image into the memory for path search and route guidance, and managing on the memory Image-based navigation system further comprising. The method of claim 1, The storage means, Further stores image attribute information or spatial object attribute information; The image-based route guidance means, According to the user's request, the image-based navigation system, characterized in that further performing the function of providing the image attribute information or spatial object attribute information. The method according to any one of claims 1 to 4, The path searching means control process of the image-based path guidance means, Receives the route search information from the user, instructs the route search means to search the route, receives the route searched from the route search means, and uses the received route and the map-matched location information to route the mobile terminal. Checking whether there is a deviation, if there is a deviation, the image-based navigation system characterized in that the command to search for a new route based on the location of the current mobile terminal. The method of claim 5, The image-based route guidance means, When the route guide information is stored in the storage means, the storage means is searched through the storage information access means. If the route guide information is not stored in the storage means, the path guide information is generated by itself and combined with the geographic image for output. Image-based navigation system, characterized in that. The method of claim 5, The route guide information, And a destination name, information on surrounding facilities appearing in the currently output image, a distance remaining to the destination, a current speed, a time of arrival to the destination, and a future direction. The method of claim 5, The mapping information of the storage means, An image-based navigation system, which is generated by mapping between a geographically captured geographic image and a digital map, and when the location information of the mobile terminal is acquired through a GPS receiver. The method of claim 5, The mapping information of the storage means, An image-based navigation system, which is generated by mapping geographic images and digital maps that are actually photographed, and is generated based on road names and distance information when the location information of the mobile terminal is acquired through an odometer. . In the navigation method is mounted to a mobile terminal applied to the navigation system for guiding the movement path of the mobile terminal, An input step of receiving route search information from a user; Acquiring the location information of the mobile terminal and acquiring the location of the terminal and matching the location information with the location on the numerical map; A route search step of searching for a route for the input route search information by referring to a digital map, a navigation map, and POI information; And When the mobile terminal moves along the searched route, the geographic image corresponding to the current position of the mobile terminal is searched by using the numerical map, the mapping information of the image, and the terminal location information, and the route guidance information is displayed on the searched geographic image. Image-based route guidance provided Image-based navigation method comprising a. The method of claim 10, Checking whether the mobile terminal is moving along the searched route using the map-matched location information in the terminal location acquiring and map matching step and the path searched in the path searching step, and if there is a deviation from the path of the current mobile terminal, Route rescan step to retrieve a new route based on location Image-based navigation method further comprising. The method of claim 10 or 11, Providing attribute information for providing image attribute information or spatial object attribute information according to the user's request Image-based navigation method further comprising. The method of claim 12, The route search information, Image-based navigation method comprising a starting point and a destination. The method of claim 12, The route guide information, And a destination name, information on surrounding facilities appearing in the currently output image, remaining distance to the destination, current speed, arrival time to the destination, and a future direction. The method of claim 12, The mapping information, An image-based navigation method, which is generated by mapping between a geographically captured geographic image and a digital map, and is generated based on an acquisition position of a geographic image when the location information of the mobile terminal is acquired through a GPS receiver. The method of claim 12, The mapping information, The image-based navigation method is generated based on mapping between the geographical image taken and the digital map, and the location information of the mobile terminal is generated based on the road name and distance information when the location information of the mobile terminal is obtained through an odometer. .

Images