KR20060134593A - Method for guiding road using camera image - Google Patents

Abstract

A method for guiding a road by using a camera image is provided to photograph the real image by using a camera and display a guidance object for the guidance of the road so that a user can know which object of real objects corresponds to the guidance object displayed on map data. A method for guiding a road by using a camera image comprises the following steps of: establishing an optimum travel route, from a current location to a destination which a user has inputted, by loading pre-stored map data(204); capturing an image photographed by a camera, and detecting a photographing location of the camera according to signals received by a GPS(Global Positioning System) receiver when capturing the image, and then matching objects within the captured image to objects existing on the map data on the basis of the detected photographing location(208,210); and displaying objects, matched to the destination of the user within the image, as guidance objects and guiding the road(216).

Description

Method for guiding road using camera image}

1 is a view showing the configuration of a navigation system to which the present invention is applicable;

2 is a flowchart showing a way guidance according to an embodiment of the present invention;

3 is a flowchart specifically illustrating an object matching step illustrated in FIG. 2;

4A to 4C are views illustrating a method of displaying a guide object on a camera image according to an exemplary embodiment of the present invention.

* Explanation of symbols for main parts of the drawings

100: GPS receiver 102: control unit

104: camera 106; Image processor

108: map data storage unit 110: sensor unit

The present invention relates to a method for guiding a road through a camera image that can provide a user with a road guide service through an image captured by a camera.

GPS (Global Positioning System) is a global positioning system developed by the US Department of Defense, and a plurality of GPS satellites are arranged on each of six circular orbits each having an inclination angle of 55 °. Each of them transmits its own location information signal with a period of about 12 hours, and the GPS receiver receives the location information signal from at least 4 GPS satellites among the plurality of GPS satellites, and the distance between the GPS satellites and itself. Detect the position vector of satellite and calculate its own position vector.

A navigation system having such a GPS receiver maps its location vector calculated from the GPS receiver onto map data and displays it, and provides an additional service as a supplementary service to provide the shortest route from the current location on the map to the user's destination. Providing. Thus, users can easily navigate to their destinations by carrying such a navigation system.

However, when the road guidance service is provided through the map data, the user may have to find a destination while checking whether the target road guide object corresponds to the actual visible object.

Therefore, an object of the present invention is to provide a method for guiding a road through a camera image that can provide a guiding service along with objects that are actually visible to a user.

In order to achieve the above object, the road guidance method according to the present invention comprises the steps of loading the pre-stored map data to set the optimum movement route from the current location to the destination input by the user; Capturing an image photographed by a camera, detecting a photographing position of the camera by a GPS reception signal when capturing the image, and matching objects in the captured image with objects existing on the map data; And displaying the object matching the destination of the user as a guide object in the image and guiding the road.

The capturing of the image may include capturing an image captured by the camera at predetermined time intervals.

The road guide may be configured to guide a moving path to the destination by a voice signal while displaying the input destination of the user in the image.

Matching the objects in the image and the objects on the map data in the present invention, calculating the position information for each of the objects present in the captured image; Calculating location information of objects present in the loaded map data; And comparing the location information of the respective objects in the calculated image with the location information of the objects in the map data and matching the objects with the same location information.

Preferably, the capturing position and azimuth of the camera are detected by the GPS signal and the detection signal of the geomagnetic sensor when capturing the camera image.

And calculating the position information of each object in the image, detecting the inclination angle of the camera by the detection signal of the inclinometer sensor; Separating each object in the image through image processing on the captured image; Setting a center point to each of the separated objects, and calculating position information of each of the objects based on the detected shooting position and azimuth; And correcting the calculated position information of each target object through the magnification information and the inclination angle of the camera. The center point setting of each of the target objects may include setting a center point at the bottom of each target object. It is done.

In addition, the calculation of the location information of the object in the map data is characterized in that the center point is set to each object located on the user's movement path, and the location information of the objects is calculated based on the detected shooting position and azimuth angle.

In the present invention, the position information of each object is characterized in that the direction angle and the distance value of each object based on the detected shooting position and azimuth.

On the other hand, if there is no object matching the user's destination in the image, a predetermined object located on the user's movement path among the objects existing in the image is determined as an intermediate guide object by referring to the map data. It is characterized in that the display as a guide object in the image to guide the way.

When the intermediate guide object is determined with reference to the map data, the intermediate object may be determined to be an object present at a position that rotates by a set angle or more on the movement path of the user among the objects existing in the image.

Preferably, in the present invention, when displaying a guide object in the image, text information of an object corresponding to the guide object is detected from the map data and mapped to the corresponding object in the image.

The displaying of the text information of the detected object may include setting a text point position of the corresponding object in the image; And mapping the text information of the detected object to a text point position of the object and displaying the mapped information.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing a configuration of a navigation system to which the present invention is applicable. As shown in FIG. 1, a navigation system according to the present invention is integrated with a camera 104, and provides an operation command and a destination according to a user's operation. Camera 104 through an input unit 116 for receiving input, a GPS receiver 100 for receiving a location information signal transmitted by a GPS satellite, a map data storage unit 108 for storing map data, and a gyroscope and an inclinometer. Sensor unit 110 for detecting azimuth and inclination angles), an image processor 106 for processing an image captured by the camera 104, and a user's current position from the user's current position to the user's destination input through the input unit 116 After setting the optimum movement route with reference to the map data, the display unit 102 controls the road guide operation by displaying the target object on the camera image and the display unit under the control of the control unit 102. A display driver 112 for displaying a guide object together with the image of the camera 104 on the 114, and a voice for guiding a moving path to a destination through the speaker 120 as a voice signal under the control of the controller 102. The driving unit 118 may be configured.

The navigation system having such a configuration receives a user's way guidance command through the input unit 116, turns on the reception function of the GPS receiver 100, receives position data from a plurality of GPS satellites located in the earth, and controls the control unit 102. To enter

When the user's destination is input through the input unit 116, the controller 102 loads the map data from the map data storage unit 108, and moves from the current position determined by the reception signal of the GPS receiver 100 to the input user destination. The optimal movement route is set with reference to the map data.

And while controlling the operation of the camera 104 in accordance with the user's command to capture the image taken by the camera 104 at a predetermined time interval, by matching each object present in the image with the objects present on the map data image The display driver 112 is controlled to display an object matching the user's destination within the display unit 114 as a guide object. In addition, the controller 102 controls the voice driver 118 to display the guide object in the image and guide the movement path to the destination through the speaker 120 as a voice signal.

On the other hand, if there is no object matching the user's destination in the captured camera image, the predetermined object located on the user's movement path among the objects existing in the captured image with reference to the map data is determined as the intermediate guide object. It is displayed as a guide object in the image and controls to perform a road guide operation.

In addition, in the present invention, when displaying the guide object in the image, the text information of the object corresponding to the guide object is detected from the map data and mapped to the corresponding object in the image to be displayed on the display unit 114.

2 is a flowchart illustrating a method for guiding a road according to an exemplary embodiment of the present invention. When a user's directions command is input (200), the user receives an input of a destination to which the user is guided (202). The map data stored in advance is loaded to search for and set an optimal movement route from the current position detected by the GPS reception signal to the user's destination with reference to the loaded map data (204).

When the movement path setting to the user's destination is completed, the operation of the camera 104 is turned on (206) so that the user can capture an image on the camera 104, and the captured camera image is captured at a predetermined time interval (208). ).

When capturing the image, each object existing in the captured image is matched with objects existing on the map data (210), and whether the object matching the destination of the user exists in the captured image is checked (212). As a result of the check, if the object exists, text information of the object is detected from the map data (214). Therefore, the detected text information is mapped to the object in the captured image and the object is displayed as the guide object along with the text information (216).

Here, in order to map and display the text information of the detected object to the object in the captured image, first, a text point position of the object is set in the captured image. The detected text information is mapped to the set text point position and displayed.

As described above, the present invention may be configured to display a guidance target in a camera image for guiding a user and guide a movement route to a destination through a speaker 120 as a voice signal.

In contrast, when an object matching the user's destination does not exist in the captured camera image, a predetermined object located on the moving path of the user among the objects existing in the image is determined as an intermediate guide object by referring to the map data (218). ). The text information of the intermediate guide object is detected from the map data (214), and is displayed by mapping the intermediate guide object in the image with each other (216).

In the present invention, when the intermediate guide object is determined with reference to the map data, an object existing at a position rotated by a set angle or more on a moving path of the user among objects existing in the image is characterized in that it is determined as the intermediate guide object. In other words, the building located near the intersection of the road is determined as the intermediate guide object, and is displayed as the guide object in the image and the road guide is made.

The present invention displays the intermediate guide object located on the user's destination or movement path as a guide object in the image as described above, and in order to distinguish whether the guide object displayed in the captured image is a destination or an intermediate guide object separately from each other. It is characterized by displaying a symbol (symbol) together.

As such, the process of displaying the guidance target on the camera image is continued until the user arrives at the destination (220).

3 is a flowchart specifically illustrating the object matching step 210 illustrated in FIG. 2, and an embodiment of matching objects between a camera image and map data according to the present invention will be described in detail with reference to FIG. 3.

First, when capturing a camera image, the camera detects a photographing position and azimuth angle of the camera 104 using a GPS signal and a geomagnetic sensor signal (300), and calculates position information on each object in the captured image based on this (302). .

Here, the position information calculation 302 for each object in the image detects the inclination angle of the camera 104 by the inclinometer sensor signal when capturing the image (302-2). Image processing is performed on the captured image to separate the objects in the image (302-4) and set the center point at the bottom of each of the separated objects (302-6), based on the shooting position and azimuth angle when capturing the image. The location information of each object is calculated (302-8). When the position information of each object is calculated, the actual position information of each object in the image is obtained by correcting the calculated position information of each object by using the tilt angle and magnification information of the camera 104 (302-10).

The position information of the objects calculated as described above is characterized in that the direction angle and the distance value of each object based on the photographing position and the azimuth angle of the camera 104.

Meanwhile, the location information of each object in the captured image is calculated 302, and the location information of each object located along the user's movement path is calculated in the map data (304). At this time, the location information of each object is also set to the center point point (304-2) in the object to calculate the position information based on the shooting position and azimuth angle of the camera 104 when capturing the image (304-4).

The location information of each object in the calculated image and the location information of the objects located along the user's movement path in the map data are compared with each other to match the objects having the same location information (306).

4A to 4C are diagrams showing a guide object displayed on a camera image according to a preferred embodiment of the present invention. FIG. 4A is a view showing loading map data in a terminal having a camera 104 and a navigation system integrated therein. The display panel is shown.

FIG. 4B is a destination corresponding to the user's destination in the camera image when the Simon building D shown in FIG. 4A is the destination to which the user is to be guided, and an object corresponding to the destination exists in the image captured by the camera 104. It shows how to display as a guide.

On the other hand, FIG. 4C shows a case where the intermediate guide object is displayed on the camera image when the Simon building D shown in FIG. 4A is determined as the intermediate guide object located on the movement path of the user.

As shown in FIGS. 4B and 4C, when the guidance target is displayed on a camera image, the present invention displays text information on the guidance target, and the 'D' symbol when the target corresponding to the user's destination is displayed as the guidance target. By indicating with the user to indicate that the destination, if the intermediate guide object located on the moving path is displayed as a guide object can be made to indicate that the intermediate guide object by displaying a flag symbol.

The present invention is not limited to the above-described embodiments and can be variously modified and implemented by those skilled in the art without departing from the technical spirit of the present invention.

According to the present invention, by providing a guide service to the user to take a real image with a camera and by displaying a guide object for the road guidance on the camera image, any of the objects that the guide object displayed on the map data actually visible Allows you to see at a glance if this applies to you.

In addition, when displaying a guide object for guiding a road on a camera image, text information of the guide object is displayed together. In particular, the currently guided object corresponds to a user's destination or an intermediate guide located on a route to the destination. By identifying whether an object is indicated by a symbol of a specific symbol, when a user receives a directions, the user can also view information about the object.

Accordingly, the present invention allows users to receive the guidance more conveniently.

Claims (13)

Loading the pre-stored map data and setting an optimum movement route from a current location to a destination input by the user; Capturing an image photographed by a camera, detecting a photographing position of the camera by a GPS reception signal when capturing the image, and matching objects in the captured image with objects existing on the map data; And And displaying the object matching the destination of the user as a guide object in the image to guide the way. The method of claim 1, wherein the capture of the image Method for guiding the camera image, characterized in that for capturing the image taken by the camera at a predetermined time interval. The method of claim 1, The way guidance is a road guidance method through a camera image, characterized in that to guide the moving path to the destination by the voice signal while displaying the input destination of the user in the image. The method of claim 1, wherein the matching of the objects in the image with the objects in the image comprises: Calculating location information of each object present in the captured image; Calculating location information of objects present in the loaded map data; And And comparing the location information of the respective objects in the calculated image with the location information of the objects in the map data, and matching the objects having the same location information with each other. 2. The method of claim 4, wherein The method for guiding the way through the camera image, characterized in that for detecting the camera position and the azimuth angle detected by the GPS signal and the detection signal of the geomagnetic sensor when capturing the camera image. The method of claim 5, wherein the location information of each object in the image is calculated. Detecting an inclination angle of the camera by a detection signal of an inclinometer sensor; Separating each object in the image through image processing on the captured image; Setting a center point to each of the separated objects, and calculating position information of each of the objects based on the detected shooting position and azimuth; And And correcting the calculated position information of the target objects through the magnification information and the inclination angle of the camera. The method of claim 6, wherein the center point setting for each of the objects is Method for guiding the way through the camera image, characterized in that for setting the center point at the bottom of each object. The method of claim 5, wherein the location information calculation for the object in the map data is performed. And a center point point is set for each object located on the user's movement path, and location information of the objects is calculated based on the detected shooting position and azimuth angle. The method of claim 4, wherein the location information of each object is And a direction angle and a distance value of each object based on the detected shooting position and azimuth. The method of claim 1, If there is no object matching the user's destination in the image, the target object located on the user's moving path among the objects existing in the image is determined as an intermediate guide object by referring to the map data. The method of guiding the way through a camera image, characterized in that the guiding and displaying the direction within the guide. The method of claim 10, When the intermediate guide object is determined with reference to the map data, an object existing at a position that rotates more than a set angle on the movement path of the user among objects existing in the image is determined as the intermediate guide object. How to get directions through camera video. The method according to claim 1 or 10, And displaying text information of an object corresponding to the guide object from the map data and mapping the same to the corresponding object in the image when displaying the guide object in the image. The method of claim 12, wherein the text information display of the detected object is Setting a text point position of a corresponding object in the image; And And detecting and displaying the text information of the object by mapping the text information to the location of the text point of the object.

Images