KR20160029911A - Apparatus and method for route guidance using additional information - Google Patents

Abstract

The present invention relates to a device and a method to guide a route using additional information. The present invention provides the device and the method to guide the route using additional information, capable of outputting route guidance information received from a user outside a vehicle. The device to guide the route using additional information comprises: a first communication unit receiving a front image and location information of a vehicle from an additional information guiding device performing route guidance for the vehicle by outputting the received additional information; a display unit displaying the received front image; an input unit receiving route guidance information from the user; and a first control unit generating the additional information based on the received location information and the inputted route guidance information. The first control unit transmits the generated additional information to the additional information guiding device through the first communication unit, and guides the route of the vehicle through the additional information guiding device.

Description

[0001] APPARATUS AND METHOD FOR ROUTE GUIDANCE USING ADDITIONAL INFORMATION [0002]

The present invention relates to a route guidance apparatus and method using additional information, and more particularly, to a route guidance apparatus and method using additional information generated by using forward image information of a vehicle.

Generally, route guidance of the vehicle is performed using a navigation device. That is, the navigation device of the vehicle notifies the accurate distance and the time required from the current position to the destination, and guides the route to the destination.

In order to perform the above-described functions, the navigation device is required to have a function of grasping the current position of the navigation device, which is accomplished by using a satellite navigation system such as GPS (Global Positioning System). The 24 GPS satellites equipped with a cesium atomic clock are emitting identification signals, time signals and position signals at the same time (50 times per second), and the navigation device transmits at least four signals (three for positioning, One for time error correction) and obtains its position on the two-dimensional plane.

On the other hand, Augmented Reality (AR) refers to a technique of superimposing a three-dimensional virtual image on a realistic image or background and displaying it as a single image. Although such augmented reality is implemented by applying various technologies in a complex manner, it is essential that a technique for estimating the position information of objects existing in a photographed image based on positional information of an image captured through a camera or the like is basically required Is required.

Meanwhile, the background art of the present invention is disclosed in Korean Patent Publication No. 10-2011-0038425 (April 14, 2011).

An object of the present invention is to provide a route guidance apparatus and method using additional information capable of outputting route guidance information received from a user outside the vehicle.

A route guidance apparatus using additional information according to the present invention includes a first communication unit for receiving a forward image and position information of a vehicle from an additional information guidance apparatus for outputting received supplementary information and performing route guidance of the vehicle; A display unit for displaying the received forward image; An input unit for receiving route guidance information from a user; And a first control unit for generating the additional information based on the forward image, the received position information, and the inputted route guidance information, wherein the first control unit transmits the generated additional information through the first communication unit To the additional information guide apparatus, and guides the vehicle through the additional information guide apparatus.

In the present invention, the first control unit generates a map screen on which the vehicle is located based on the forward image and the position information, and displays the generated map screen through the display unit.

In the present invention, at the time of generating the additional information, the first control unit calculates coordinates of the forward image of the route guidance information by matching the route guidance information with the forward image, and based on the forward image and the position information Estimates actual position information of the calculated coordinates, and generates the estimated actual position information and the route guidance information as the additional information.

In the present invention, when generating the additional information, the first control unit may calculate the coordinates of the route guidance information on the map screen by matching the route guidance information with the map screen, and based on the map screen and the location information Estimates actual position information of the calculated coordinates, and generates the estimated actual position information and the route guidance information as the additional information.

A route guidance apparatus using additional information according to the present invention includes: an image capturing unit for capturing a forward image of a vehicle; A position information receiving unit for receiving position information of the vehicle; A second communication unit for processing the forward image of the photographed vehicle and the position information of the received vehicle by processing route guidance information input from a user and generating additional information; A second control unit for receiving the additional information from the additional information generation apparatus through the second communication unit; And an additional information output unit for outputting the received additional information under the control of the second control unit, wherein the additional information includes route guidance information input from a user and actual position information to which the route guidance information is to be output .

In the present invention, the additional information output unit may include navigation, and the second control unit may output the route guidance information by matching the route guidance information with the map of the navigation according to the actual location information.

The additional information output unit may include a head-up display, and the second controller may output the route guidance information by matching the route guidance information to the screen of the head-up display according to the actual location information. do.

A route guidance method using additional information according to the present invention includes: a step in which a supplementary information guidance device captures a forward image of a vehicle; Receiving the location information of the vehicle; The additional information guide apparatus transmitting the front image of the taken vehicle and the position information of the received vehicle to the additional information generating apparatus; Displaying the transferred forward image by the additional information generating apparatus; Receiving the route guidance information from the user through the input unit; Generating the additional information based on the forward image, the transmitted position information, and the inputted route guidance information; The additional information generating apparatus transmitting the generated additional information to the additional information guide apparatus; And the additional information guide apparatus outputting the transmitted additional information through the additional information output unit.

In the present invention, the step of generating the additional information may include the step of the coordinates of the forward image of the route guidance information by matching the route guidance information with the forward image, Estimating actual position information of the calculated coordinates based on the forward image and the position information; And generating the additional information including the estimated actual position information and the route guidance information by the additional information generating apparatus.

In the present invention, the additional information output unit may include navigation, and in the step of outputting the additional information, the additional information guide device may map the route guidance information to the map of the navigation according to the actual position information, And outputs the output signal.

A route guidance apparatus and method using additional information according to the present invention is a route guidance apparatus and method using additional information, which receives route guidance information from a user outside the vehicle based on a forward image of the vehicle, generates it as additional information, The user can receive the route guidance and the surrounding information in real time from the user.

1 is a block diagram showing a configuration of a route guidance apparatus using additional information according to an embodiment of the present invention.
2 is a diagram for explaining a process of generating additional information in the route guidance apparatus using the additional information and outputting the generated additional information according to an embodiment of the present invention.
3 is a flowchart illustrating a route guidance method using additional information according to an embodiment of the present invention.
4 is a flowchart illustrating a process of generating additional information in a route guidance method using additional information according to an embodiment of the present invention.

Hereinafter, an embodiment of a route guidance apparatus and method using additional information according to the present invention will be described with reference to the accompanying drawings. In this process, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention or custom of the user, the operator. Therefore, definitions of these terms should be made based on the contents throughout this specification.

FIG. 1 is a block diagram illustrating a configuration of a route guidance apparatus using additional information according to an exemplary embodiment of the present invention. FIG. 2 is a block diagram of a route guidance apparatus using additional information according to an exemplary embodiment of the present invention. And outputting the generated additional information. Referring to FIG. 5, the route guidance apparatus using the additional information according to the present embodiment will be described as follows.

1, the route guidance apparatus using additional information according to an embodiment of the present invention includes an additional information guidance apparatus 100 for outputting received supplementary information to guide the route of the vehicle, Information generating apparatus 110 for processing the generated route guidance information and generating additional information. The additional information guide apparatus 100 may include a second control unit 101, a video photographing unit 102, a position information receiving unit 103, a second communication unit 104, and an additional information output unit 105, The additional information generation apparatus 110 may include a first control unit 111, a first communication unit 112, a display unit 113, and an input unit 114.

The image capturing unit 102 can capture a forward image of the vehicle. For example, the image capturing unit 102 may capture a forward image of the vehicle including a camera installed in the vehicle. Also, the image capturing unit 102 may capture a forward image of the vehicle through a smart phone, a tablet, and the like.

The position information receiving unit 103 receives information on the position of the vehicle. The position information receiving unit 103 can receive information on the position of the vehicle using a satellite navigation system such as GPS or Global Navigation Satellite System (GLONASS). Also, the position information receiving unit 103 may be configured to receive the position information of the vehicle from the navigation system of the vehicle.

The second communication unit 104 performs communication with the additional information generation apparatus 110. [ That is, the second communication unit 104 can exchange data with the first communication unit 112 of the additional information generation apparatus 110. The data communication between the second communication unit 104 and the first communication unit 112 includes a Code Division Multiple Access (CDMA), a Global System for Mobile Communications (GSM), a Wideband Code Division Multiple Access (WCDMA) Evolution), WiBro (Wireless Broadband), and the like. In addition, various communication methods can be applied.

The second control unit 101 transmits the forward image of the vehicle photographed through the image capturing unit 102 and the position information of the vehicle received through the position information receiving unit 103 to the additional information generating apparatus 110).

When the second control unit 101 transmits the forward image and the position information of the vehicle to the additional information generation apparatus 110, the first communication unit 112 of the additional information generation apparatus 110 generates a forward image and a forward image of the transmitted vehicle, Location information can be received.

The display unit 113 can display the forward image of the vehicle received through the first communication unit 112. [ The display unit 113 may also display a map screen on which the vehicle is located. That is, the first control unit 111 generates a map screen on which the vehicle is located based on the forward image and the position information of the vehicle received through the first communication unit 112, and displays the generated map screen through the display unit 113 can do. For example, the first controller 111 may map the location information of the vehicle to the map data, and determine the traveling direction of the vehicle based on the forward image of the vehicle to generate a map screen on which the vehicle is located. That is, the first control unit 111 displays a forward image of the vehicle or a map screen on which the vehicle is located through the display unit 113 so that the user can view and input route guidance information.

The input unit 114 can receive route guidance information from a user. Here, the route guidance information means a memo, a handwriting, a destination display, a voice, and the like input by the user to guide the route of the vehicle. For this, the input unit 114 may include devices capable of receiving route guidance information such as a touch sensor, a microphone, and the like. In the case where the input unit 114 is configured as a touch sensor, the touch sensor may have a mutual layer structure with the display unit 113. In this case, the display unit 113 and the input unit 114 may be integrated with each other, Lt; / RTI >

The additional information generation module 115 of the first control unit 111 can generate additional information based on the forward image of the vehicle, the location information of the vehicle, and the route guidance information input through the input unit 114. [ Here, the additional information means information including route guidance information input from a user and actual location information on which the route guidance information is to be located.

That is, the first control unit 111 calculates the coordinates (x-axis and y-axis pixel information) on the front image of the vehicle of the route guidance information by matching the route guidance information with the forward image of the vehicle, It is possible to estimate the actual position information of the coordinates calculated based on the positional information of the coordinates.

For example, when the display unit 113 and the input unit 114 are in the form of a touch screen and the user displays the destination using the route guidance information, the input unit 114 displays data corresponding to the input through the touch sensor The first control unit 111 analyzes the data to determine which area of the display unit 113 is touched. That is, in this way, the first controller 111 can calculate the coordinates of the route guidance information on the forward image of the vehicle or the coordinates on the map screen.

Also, the first controller 111 can convert the coordinates calculated using the augmented reality technology into actual position information. In other words, the first control unit 111 may perform the augmented reality analysis based on the forward image of the vehicle, the coordinates on the map screen, and the vehicle position information, or a structure such as a building, an intersection, Actual position information can be estimated. However, the method of estimating the actual position information of the coordinates calculated by the first controller 111 using the augmented reality technique is a known technique, and a detailed description thereof will be omitted in the present embodiment.

The first control unit 111 may generate the actual positional information and the route guidance information estimated by the above method as additional information and transmit the generated additional information to the additional information guide apparatus 100 through the first communication unit 112 have.

When the first control unit 111 transmits the additional information to the additional information guidance apparatus 100, the second control unit 101 of the additional information guidance apparatus 100 transmits the supplementary information through the second communication unit 104, Lt; / RTI >

The additional information output unit 105 can output the additional information received through the second communication unit 104 under the control of the second control unit 101. [ For example, the additional information output unit 105 may output a destination display inputted by the user including a navigation or a head up display (HUD), and may output a voice inputted by a user including a speaker It is possible.

The additional information output through navigation will be described in more detail with reference to FIG. When the user inputs an arrow and a circle as route guidance information through the input unit 114 of the touch screen type integrally formed with the display unit 113 displaying the forward image of the vehicle, Actual position information of the information is estimated, and the route guidance information may be matched to the map of the navigation according to the estimated actual position information and output. That is, the driver can receive route guidance through additional information from a user outside the vehicle through this process. On the other hand, the additional information output through the head-up display can be explained in the same manner as the additional information output through the navigation described above.

FIG. 3 is a flowchart illustrating a route guidance method using additional information according to an exemplary embodiment of the present invention. FIG. 4 is a flowchart illustrating a method of generating additional information in a route guidance method using additional information according to an exemplary embodiment of the present invention. A route guidance method using additional information according to the present embodiment will now be described with reference to the flowchart.

As shown in FIG. 3, the remote location information providing apparatus 100 photographs the forward image of the vehicle through the image photographing unit 102 (S200). For example, the image capturing unit 102 may photograph a forward image of the vehicle through a camera installed in the vehicle or a smartphone of the driver.

Then, the sub information providing apparatus 100 receives the location information of the vehicle through the location information receiving unit 103 (S210). For example, the position information receiving unit 103 may receive information on the position of the vehicle using a GPS navigation system such as GPS or Global Navigation Satellite System (GLONASS), or receive the position information of the vehicle from the navigation system of the vehicle ≪ / RTI >

After the step S210, the sub information providing apparatus 100 transmits the forward image of the vehicle photographed at the step S200 and the position information of the vehicle photographed at the step S210 through the second communication unit 104 To the information generating apparatus 110 (S220). The data transmission / reception method between the second communication unit 104 and the additional information generation apparatus 110 includes a Code Division Multiple Access (CDMA), a Global System for Mobile Communications (GSM), a Wideband Code Division Multiple Access (WCDMA) Long Term Evolution), WiBro (Wireless Broadband), and the like. In addition, various communication methods can be applied.

Subsequently, the additional information providing apparatus 100 receives the additional information generated by the additional information generating apparatus 110 from the additional information generating apparatus 110 through the second communication unit 104 (S230). 4, the process of generating additional information of the additional information generating apparatus 110 will be described in more detail.

4, first, the additional information generating apparatus 110 receives the forward image of the vehicle and the vehicle position information transmitted in the step S220 of FIG. 3 through the first communication unit 112 (S300 ).

Then, the additional information generating unit 110 generates the additional information on the basis of the forward image of the vehicle received in the step S300 or the forward image and the position information of the vehicle received in the step S300 through the display unit 113 (S310). That is, the sub information generating apparatus 110 displays a forward image of the vehicle or a map screen on which the vehicle is located through the display unit 113 so that the user can view and input the route guidance information.

After the step S310, the sub information generating apparatus 110 receives route guidance information from the user through the input unit 114 (S320). Here, the route guidance information means a memo, a handwriting, a destination display, a voice, etc. inputted by the user.

Subsequently, the additional information generation apparatus 110 generates additional information based on the forward image of the vehicle, the location information of the vehicle, and the route guidance information input in the step S320, which are received in the step S300. Here, the additional information means information including route guidance information input from a user and actual location information on which the route guidance information is to be located. Meanwhile, the method of generating the additional information by the additional information generation apparatus 110 may be explained in the same manner as the additional information generation process of the route guidance apparatus using the additional information according to the present embodiment described above.

After the step S330, the sub information generating apparatus 110 transmits the sub information generated in the step S330 to the sub information providing apparatus 100 through the first communication unit 112 at step S340. That is, in the step S230 of FIG. 3, the sub information providing apparatus 100 receives the sub information transmitted in the step S340 of FIG. 4 through the second communication unit 104. FIG.

3, the additional information providing apparatus 100 outputs the additional information received in the step S230 through the additional information output unit 105 (S240). For example, the additional information output unit 105 may output navigation information input by a user including navigation or a head up display (HUD).

As described above, the route guidance apparatus and method using the additional information according to the embodiment of the present invention receives route guidance information from a user outside the vehicle based on the forward image of the vehicle, generates additional information thereof, and outputs the generated additional information The driver can receive the route guidance and the surrounding information in real time from the user outside the vehicle so that the route and the complex destination can be easily navigated.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. I will understand. Accordingly, the technical scope of the present invention should be defined by the following claims.

100: additional information guide device
101:
102:
103: Position information receiver
104: second communication section
105: additional information output section
110: Additional information generating device
111:
112: first communication section
113:
114:
115: additional information generation module

Claims (10)

A first communication unit for receiving the forward image and the position information of the vehicle from the additional information guide apparatus for outputting the received additional information and performing route guidance of the vehicle;
A display unit for displaying the received forward image;
An input unit for receiving route guidance information from a user; And
And a first controller for generating the additional information based on the forward image, the received position information, and the inputted route guidance information,
Wherein the first control unit transmits the generated additional information to the additional information guide apparatus through the first communication unit to guide the vehicle through the additional information guide apparatus. .
The method according to claim 1,
Wherein the first control unit generates a map screen on which the vehicle is located based on the forward image and the position information, and displays the generated map screen through the display unit.
The method according to claim 1,
The first control unit may calculate the coordinates on the forward image of the route guidance information by matching the route guidance information with the forward image, and calculate the coordinates of the calculated forward image based on the forward image and the position information, Estimates the actual position information of the coordinates, and generates the estimated actual position information and the route guidance information as the additional information.
3. The method of claim 2,
The first control unit may calculate the coordinates of the route guidance information on the map screen by matching the route guidance information with the map screen and calculate the coordinates of the calculated route guidance information on the basis of the map screen and the position information, Estimates the actual position information of the coordinates, and generates the estimated actual position information and the route guidance information as the additional information.
An image capturing unit for capturing a forward image of the vehicle;
A position information receiving unit for receiving position information of the vehicle;
A second communication unit for processing the forward image of the photographed vehicle and the position information of the received vehicle by processing route guidance information input from a user and generating additional information;
A second control unit for receiving the additional information from the additional information generation apparatus through the second communication unit; And
And an additional information output unit for outputting the received additional information under the control of the second control unit,
Wherein the additional information includes route guidance information input from a user and actual position information to which the route guidance information is to be output.
6. The method of claim 5,
Wherein the additional information output unit includes navigation,
Wherein the second control unit outputs the route guidance information by matching the route guidance information to the map of the navigation according to the actual location information.
6. The method of claim 5,
Wherein the additional information output unit includes a head-up display,
Wherein the second controller outputs the route guidance information by matching the route guidance information to the screen of the head-up display according to the actual position information.
A step in which the additional information guide apparatus photographs a forward image of the vehicle;
Receiving the location information of the vehicle;
The additional information guide apparatus transmitting the front image of the taken vehicle and the position information of the received vehicle to the additional information generating apparatus;
Displaying the transferred forward image by the additional information generating apparatus;
Receiving the route guidance information from the user through the input unit;
Generating the additional information based on the forward image, the transmitted position information, and the inputted route guidance information;
The additional information generating apparatus transmitting the generated additional information to the additional information guide apparatus; And
And the additional information guide apparatus outputting the transmitted additional information through the additional information output unit.
9. The method of claim 8,
Wherein the generating the additional information comprises:
The additional information generation device calculating coordinates of the forward image of the route guidance information by matching the route guidance information with the forward image;
Estimating actual position information of the calculated coordinates based on the forward image and the position information; And
And the additional information generating apparatus generates the additional information including the estimated actual position information and the route guidance information.
10. The method of claim 9,
Wherein the additional information output unit includes navigation,
Wherein the additional information guide device outputs the route guidance information by matching the route guidance information to the map of the navigation according to the actual location information and outputting the route guidance information. Way.

Images