KR20160146384A - An augment reality navigation system and method of route guidance of an augment reality navigation system - Google Patents

Abstract

The present invention relates to an augment reality navigation system and a method of a route guidance of the augment reality navigation system. The method includes: photographing an image of the front of a vehicle through a camera; extracting a first coordinate which is a coordinate of the center of intersection after checking turn-by-turn (TBT) information for the intersection on a current driving path of the vehicle based on destination information set by a user; and extracting a second coordinate by selecting one selection structure of structures located near the intersection based on a direction of rotation of the intersection. The method displays a rotation indication image and an image after interrupting with each other after setting a location displayed on the image corresponding to the TBT information based on the first coordinate and the second coordinate.

Description

TECHNICAL FIELD [0001] The present invention relates to a navigation system for an augmented reality navigation system and an augmented reality navigation system, and more particularly to a navigation method for augmented reality navigation system and augmented reality navigation system.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a navigation system, and more particularly, to an augmented reality navigation system that displays turn-by-turn information by applying an augmented reality technique.

Generally, the navigation system map-maps its position measured by a global positioning system (hereinafter referred to as "GPS") to map data, inputs a stopover point and / or a destination from the user, Maps the route searched for in the map data, displays the route, and performs route guidance along the route.

In recent years, there has been proposed an augmented reality system which provides a current road image photographed by a camera on a screen and displays a route to a destination in a superimposed manner on the image, in addition to a general navigation system displaying an electronic map on a screen and providing a route through the electronic map Augmented Reality (AR) navigation systems have been actively researched and developed.

The augmented reality navigation system displays turn-by-turn (TBT) information in the form of an arrow to indicate the direction and distance of rotation of the user or the vehicle in an intersection, a rotation section, and the like. That is, the augmented reality navigation system displays the turn-by-turn information in order to clearly recognize the instantaneous change of direction without hindering the reality in the screen providing complex real road images.

In order to implement the method of displaying the turn-by-turn information of the conventional arrow shape, an image database of all the buildings located around the road should be constructed and implemented using the computer vision technology based on the database. For example, a database in which all building images viewed from the driving direction of the driver are database is basically required. In addition, the navigation system recognizes an image of the building from the information stored in the database using the computer vision technology for the forward image coming into the camera during the driving of the vehicle, and then displays an arrow-shaped arrow image corresponding to the turn- On the road displayed on the screen. However, the method of displaying the turn-by-turn information requires a large amount of money because the image of all the buildings in the area providing the navigation service must be converted into a database, and an arrow image corresponding to the turn- There is a problem that it is difficult for the driver to intuitively perceive the rotation or the traveling route.

It is an object of the present invention to provide a route guidance providing method of an augmented reality navigation system in which a driver can intuitively and clearly recognize turn-by-turn information.

Another object of the present invention is to provide an augmented reality navigation system in which a driver can clearly recognize turn-by-turn information intuitively.

It should be understood, however, that the present invention is not limited to the above-described embodiments, and various changes and modifications may be made without departing from the spirit and scope of the invention.

According to an aspect of the present invention, there is provided a route guidance method for an augmented reality navigation system, comprising: capturing an image of a vehicle ahead of a vehicle through a camera; After confirming the turn-by-turn (TBT) information for the intersection on the current driving route of the intersection, extracting the first coordinate, which is the coordinate of the center point of the intersection, The second coordinate can be extracted by selecting the selection structure which is one of the structures located in the periphery of the intersection based on the direction. Then, the route guidance method of the augmented reality navigation system sets a position at which a rotation instruction image corresponding to the turn-by-turn information is displayed on the image based on the first coordinate and the second coordinate, The instruction image and the image can be superimposed and displayed.

According to one embodiment, the base structures correspond to outermost buildings disposed adjacent to the intersection, and the selection structure is disposed at a position where the vehicle is to be rotated in the direction in which the vehicle must rotate in the intersection, Which is closest to the building.

According to an embodiment, the second coordinate may correspond to a coordinate of an edge of the selection structure closest to the first coordinate.

According to an embodiment, a method of setting a position at which the rotation instruction image is displayed on the image may include generating a virtual first extension line extending from the second coordinate in a direction parallel to a direction in which the vehicle is currently traveling, A second extension line extending in a direction parallel to a direction in which the vehicle travels after passing through the rotation section of the intersection from the first coordinate, and calculating an intersection point between the first extension line and the second extension line, Can be set as the end point of the rotation instruction image.

According to one embodiment, the rotation instruction image may be in the form of a curved arrow pointing in the direction in which the vehicle should rotate.

According to an embodiment of the present invention, a method of setting a position at which the rotation instruction image is displayed on the image may include generating a virtual first extension line extending a straight line connecting the third coordinate, which is the current position of the vehicle, From the first coordinate, a virtual second extension line extending in a direction parallel to a direction in which the vehicle will travel after passing through the rotation section of the intersection, and then calculating an intersection point between the first extension line and the second extension line, An intersection may be set as an end point of the rotation instruction image.

According to one embodiment, the third coordinate may correspond to the position of the driver's seat of the vehicle.

According to one embodiment, the rotation instruction image may be in the form of a curved arrow pointing in the direction in which the vehicle should rotate.

According to an embodiment, a method of setting a position at which a basic rotation instruction image is displayed on the image may include setting an end point of the rotation instruction image to the second coordinate.

According to one embodiment, the rotation instruction image may be in the form of a curved arrow pointing in the direction in which the vehicle should rotate.

In order to accomplish one object of the present invention, an augmented reality navigation system according to embodiments of the present invention includes a photographing unit for photographing a forward image of a vehicle through a camera in real time, A first coordinate which is a coordinate of an intersection center point on an optimal traveling path of the vehicle based on destination information set by the user and a first coordinate which is a turn-by-turn TBT ), And extracts a second coordinate, which is a coordinate of the selected building, which is one of the predetermined buildings from the database, based on the turn-by-turn information, a first coordinate and a second coordinate To-turn information corresponding to the turn-by-turn information is displayed on the image, And an augmented reality unit for superimposing an image on the image and displaying the image on an output unit.

According to one embodiment, the predetermined buildings correspond to the outermost buildings disposed adjacent to the intersection, and the selected building is arranged at a position where the vehicle is rotated in the direction in which the vehicle must rotate in the intersection, And the second coordinate may correspond to the corner coordinates of the selected building of the selected building.

According to an embodiment, the coordinate extracting unit may extract the corner coordinates of the selected building as the second coordinates based on the traveling direction of the vehicle and the direction to be rotated.

According to an embodiment, the setting unit may include a virtual first extension line extending from the second coordinate in a direction in which the vehicle is currently proceeding, and a second coordinate line extending from the first coordinate in a direction in which the vehicle will travel after passing through the rotation interval of the intersection The position of the end point of the rotation instruction image can be set at the intersection of the imaginary second extension line.

According to an embodiment, the setting unit may include a virtual first extension line extending a straight line connecting the third coordinate, which is the current position of the vehicle, with the second coordinate, and a virtual extension line extending from the first coordinate to pass the rotation interval of the intersection The position of the end point of the rotation instruction image can be set at the intersection of the imaginary second extension line extending in the direction in which the rotation instruction image is advanced.

According to one embodiment, the third coordinate may correspond to the position of the driver's seat of the vehicle.

According to an embodiment, the setting unit may set a position of an end point of the rotation instruction image to the second coordinate.

The method for navigating the augmented reality navigation system and the augmented reality navigation system according to the embodiments of the present invention includes the steps of setting the coordinates (i.e., the second coordinate) and the coordinates of the center point of the intersection (i.e., (I.e., the position of the end point) that expresses the TBT information based on the operation of the direction-indicating image. That is, in the rotation section or the intersection section that must be rotated with respect to a specific building, the end point of the direction designation image is located on the straight line extending from the corner coordinates of the selected building, so that the position, direction, . In addition, by displaying the TBT information using only the coordinate information of the corner of the predetermined building without using the existing whole building image database and computer vision technology, the cost for building the building image DB is reduced, and the calculation amount of the navigation is reduced .

However, the effects of the present invention are not limited to the effects described above, and may be variously extended without departing from the spirit and scope of the present invention.

1 is a flowchart illustrating a method of providing a route guidance of an augmented reality navigation system according to an embodiment of the present invention.
2A is a diagram showing an example of a screen displayed by the augmented reality navigation system by the route guidance providing method of FIG.
FIG. 2B is a view showing another example of a screen displayed by the augmented reality navigation system by the route guidance providing method of FIG.
FIG. 3 is a diagram illustrating an example of extracting a first coordinate and a second coordinate included in the route guidance providing method of the augmented reality navigation system of FIG. 1;
FIGS. 4A and 4B are views showing an example of a method of outputting a rotation direction image included in the route guidance providing method of the augmented reality navigation system of FIG.
5A and 5B are views showing another example of a method of outputting a rotation direction image included in the route guidance providing method of the augmented reality navigation system of FIG.
6A and 6B are diagrams illustrating another example of a method of outputting a rotation direction image included in the route guidance providing method of the augmented reality navigation system of FIG.
7 is a block diagram illustrating an augmented reality navigation system according to embodiments of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same reference numerals are used for the same constituent elements in the drawings and redundant explanations for the same constituent elements are omitted.

FIG. 1 is a flowchart illustrating a method of providing a route guidance of an augmented reality navigation system according to an embodiment of the present invention. FIG. 2a illustrates an example of a screen displayed by the augmented reality navigation system by the route guidance providing method of FIG. And FIG. 2B is a diagram illustrating another example of a screen displayed by the augmented reality navigation system according to the route guidance providing method of FIG. 1. Referring to FIGS. 1 and 2B, an augmented reality (AR) The route guidance method of the navigation system captures an image of the front of the vehicle (S100), and performs a turn-by-turn (TBT) operation on the intersection on the traveling path of the vehicle (S200), extracting a first coordinate as a center point coordinate of the intersection (S300), selecting one of the structures located around the intersection to extract a second coordinate (S400). Wherein the path guidance providing method sets a position at which the rotation direction image corresponding to the TBT information is displayed on the image based on the first coordinate and the second coordinate (S500) And displayed on the screen (S600).

The image of the front of the vehicle can be taken (S100) through the camera provided in the AR navigation system. The AR navigation system can photograph an image in front of the vehicle in real time. The image may be output in real time through an output unit provided in the AR navigation system and outputting an image. For example, as shown in Figs. 2A and 2B, a front image currently being photographed is displayed in one area or all (here, the left area) of the output screen. That is, in FIGs. 2A and 2B, the left area of the screen is the AR screen.

The AR navigation system can confirm (S200) the TBT information about the intersection or the rotation section on the current traveling route of the vehicle based on the destination information set by the user (or the driver). That is, the AR navigation system checks information on whether the vehicle should make a left turn, a right turn, or a straight turn at an approaching intersection. For example, the traveling route set based on the destination information may be compared with the route on which the vehicle is traveling, and the turn-by-turn information in the intersection may be checked based on the comparison. When the vehicle has to turn (e.g., turn left or right) at the intersection, the AR navigation system can output the TBT information. Hereinafter, a method of setting and outputting the rotation direction image to display the TBT information on the screen using the rotation direction image will be described.

FIG. 2A shows TBT information appearing on the AR screen in the case where there is no building at a position in or around the direction in which the vehicle should travel in the intersection or the rotation section (direction in which the vehicle turns right in FIG. 2A). That is, the direction indication image DI1 indicating the TBT information about the route on which the vehicle should enter is proceeded to the right end of the AR screen. At this time, since there is no obstacle such as a building on the route that the vehicle must rotate on the AR screen, the direction indication image DI1 can be displayed by the existing TBT information providing method as shown in FIG.

However, if there is a large structure such as a building at the position where the vehicle is placed, the direction indication image DI1 as shown in FIG. 2A can not intuitively show the driver the route information to be rotated. Therefore, when a building or the like is located in the rotation section, as shown in FIG. 2B, a direction indication image including TBT information may be displayed on the AR screen according to the embodiments of the present invention.

The route guidance method of the AR navigation system may extract a first coordinate which is a coordinate of a center point of the intersection or the rotation section (S300). In one embodiment, the first coordinate may be a predetermined coordinate for the intersection. For example, in the AR navigation system, coordinates corresponding to the intersections in the predetermined area may be stored, respectively. The coordinates at the intersection can be extracted based on the measured position or the photographed image from the GPS unit provided in the AR navigation system. In another embodiment, coordinates of the intersection can be extracted in real time by operation of the GPS unit. However, the first coordinate is limited to the center point of the intersection, and the meaning of the center point of the intersection is not limited to the center of the intersection. For example, the first coordinate may correspond to a two-dimensional image coordinate of a traffic facility arranged in the traveling direction of the vehicle, for example, a traffic light, a sign, and the like.

The route guidance method of the AR navigation system selects a selection structure (or a selection building) which is one of predetermined structures located around the intersection based on a direction in which the vehicle must rotate in the intersection, (S400). In one embodiment, the predetermined structures may correspond to outermost buildings disposed around the intersection. That is, the structures may be arranged around the intersection and correspond to the buildings disposed closest to the intersection (and road). However, the structures are not limited to buildings. The selection structure may correspond to one of the buildings disposed at a position in the direction in which the vehicle must rotate in the intersection, the closest to the first coordinate. For example, as shown in FIG. 2B, a building 10 disposed in a section where a vehicle must turn right may be selected as the selection structure. This will be described in detail with reference to FIG. 3 and subsequent drawings.

In one embodiment, the route guidance method of the AR navigation system can select the selection structure based on the running direction of the vehicle and the direction in which the vehicle should rotate. Here, the second coordinate may correspond to a coordinate of an edge of the selection structure closest to the first coordinate. The coordinates of the corner at the corresponding intersection are database. For example, in the case of an intersection intersection, four buildings arranged at respective corners are stored as candidates of the selection structure, and corner coordinates of each of the buildings may be stored in a database. The AR navigation system selects, as the selection structure, a building disposed at a position where the vehicle is to be rotated in the intersection based on the position of the vehicle currently in progress and the direction in which the vehicle should rotate, Can be extracted from the database as the second coordinate. That is, the existing building image database is not required, and the process of displaying the TBT information using the building image data and the computer vision technology is omitted. Thus, complex algorithms and hardware for implementing computer vision techniques can be omitted or simplified.

Thereafter, the route guidance method of the AR navigation system includes a step of, based on the first coordinate and the second coordinate, generating a rotation direction image (for example, DI2 in FIG. 2B) corresponding to the TBT information, (S500). The rotation instruction image 120 may have an arrow shape bent in the rotation direction to express the TBT information. The route guidance method of the AR navigation system can set the position of the end point of the rotation instruction image 120 based on a simple operation.

In one embodiment, the position of the end point of the rotation instruction image 120 having the arrow shape is substantially the same as the imaginary first extension line 120 extending in the direction parallel to the direction D1 in which the vehicle is currently proceeding from the second coordinate. And an intersection of a virtual second extension line extending in a direction parallel to a direction (D2) in which the vehicle travels after passing through the rotation section of the intersection from the first coordinate. In another embodiment, the position of the end point may be set as an intersection of the imaginary extension line extending the straight line connecting the third coordinate, which is the current position of the vehicle, and the second coordinate, and the second extension line. In another embodiment, the position of the endpoint may be set to the second coordinate. That is, the endpoint may be computed through a simple algorithm based on the coordinates. The position of the end point can be calculated and changed in real time by the movement of the vehicle.

Thereafter, the route guidance method of the AR navigation system may display the rotation direction image and the image superimposed on the screen (S600). As shown in FIG. 2B, the AR screen of the output unit included in the AR navigation system may output a screen in which a direction indication image DI2 indicating TBT information is superimposed on an image captured in real time. The direction indication image DI2 can be superimposed on the image by the above-described methods and output. FIG. 2B shows an AR screen and a direction indication image DI2 in the case where the buildings 10 are located at positions where the vehicle is placed in a rotation section of the vehicle. That is, the end point of the direction indication image DI2 may be located at the edge of the building 10 (i.e., the selection structure 10), unlike FIG. 2A. Accordingly, the driver who views the AR screen intuitively recognizes that the user must rotate the selected building 10.

As described above, the route guidance method of the AR navigation system according to the embodiments of the present invention includes the corner coordinates (i.e., the second coordinates) of the buildings disposed around the intersection and the coordinates (i.e., the first coordinates) The position of the direction indication image (i.e., the position of the end point) expressing the TBT information can be adjusted in real time on the basis of the operation with respect to the TBT information. That is, in the rotation section or the intersection section that must be rotated along the specific building 10, the end point of the direction designation image is located on a straight line extending from the corner coordinates of the selected building, Can be intuitively recognized. Further, by displaying the TBT information using only the coordinate information of the corner of the predetermined building without using the existing whole building image database and complicated computer vision technology, the cost for building the building image DB is reduced, and the calculation amount of the navigation Can be reduced.

FIG. 3 is a diagram illustrating an example of extracting a first coordinate and a second coordinate included in the route guidance providing method of the augmented reality navigation system of FIG. 1;

Referring to FIG. 3, the route guidance providing method of the AR navigation system may extract coordinates of an intersection in front of a vehicle and corner coordinates of a selected structure among the intersections, from a storage unit or a database.

In one embodiment, the first coordinate P1 may correspond to the coordinates of the center point of the intersection. The coordinates at the intersection can be extracted based on the measured position or the photographed image from the GPS unit provided in the navigation system. In another embodiment, coordinates of the intersection can be extracted in real time by operation of the GPS unit. However, the first coordinate is limited to the center point of the intersection, and the meaning of the center point of the intersection is not limited to the center of the intersection. The AR navigation system can extract the coordinate information (i.e., the first coordinate P1) for the intersection located in front of the vehicle. The coordinate information may correspond to two-dimensional coordinates excluding height information.

Further, in one embodiment, the corner coordinates (AE, BE, CE, DE) of each of the buildings (A, B, C, D) disposed around the intersection in the database or the storage unit of the AR navigation system are stored Can be. That is, the AR navigation system does not need to have a database for all the buildings around an intersection or a road for displaying the TBT information, and does not apply the computer vision technology using the database, and the corner coordinates (AE, BE , CE, and DE), it is possible to provide intuitive TBT information to the driver. For example, the AR navigation system may have coordinate information for only the outermost buildings A, B, C, and D disposed adjacent to the intersection among the structures disposed around the intersection. 3, each of the corner coordinates AE, BE, CE, DE can be set to correspond to the coordinates of the corner closest to the first coordinate P1 of the corner coordinates in the buildings .

In one embodiment, the route guidance method of the AR navigation system may select corner structures of the selection structure and the selection structure based on the direction in which an ongoing vehicle must turn at the intersection. The selection structure may correspond to a building located closest to the first coordinate, while the selection structure is disposed at a position in which the vehicle must rotate in the intersection. For example, when the AR navigation system displays TBT information that causes the vehicle 100 traveling in the first direction D1 to turn right at the intersection, the selection structure corresponds to the building A, May be determined as the corner coordinates (AE) of the building A. Alternatively, when the AR navigation system displays TBT information that causes the vehicle 100 traveling in the first direction D1 to turn left at the intersection, the selection structure corresponds to the building D, Can be determined as the corner coordinates (DE) of the building D.

FIGS. 4A and 4B are views showing an example of a method of outputting a rotation direction image included in the route guidance providing method of the augmented reality navigation system of FIG.

4A and 4B, a method of setting the position at which the rotation instruction image 120 is displayed on the image is a method in which the vehicle 100 is extended from the second coordinate P2 in a direction parallel to the direction D1 in which the vehicle 100 is currently in progress The virtual second extension line L1 extending from the first coordinate P1 in the direction parallel to the direction D2 in which the vehicle 100 travels after passing through the rotation section of the intersection, The intersection CP between the first extension line L1 and the second extension line L2 is calculated and the position of the end point of the rotation direction image 120 is calculated as the intersection CP (S530).

When the first coordinate P1 and the second coordinate P2 are set, an operation for setting the position of the end point of the rotation instruction image 120 may be performed. The second coordinate P2 may correspond to the corner coordinate AE closest to the first coordinate P1 of the corners of the selected building (i.e., the building A).

First, a virtual first extension line L1 extending from the second coordinate P2 in a direction parallel to the first direction D1 in which the vehicle 100 is currently traveling can be generated (S510). For example, a first calculation formula for the first extension line L1 may be established based on the two-dimensional coordinates for the intersections and buildings A, B, C, and D and the first direction D1. An imaginary second extension line L2 extending from the first coordinate P1 in a direction parallel to the second direction D2 in which the vehicle 100 will travel after passing through the rotation section of the intersection may be generated S520 . For example, a second equation for the second extension line L2 may be set based on the two-dimensional coordinate and the second direction D1.

Thereafter, the intersection CP of the first extension line L1 and the second extension line L2 may be set as the end point of the rotation instruction image 120 (S530). For example, the coordinates of the intersection point CP can be calculated through the first equation and the second equation. The coordinates of the end point of the rotation direction image 120 indicating the TBT information may correspond to the coordinates of the intersection point CP. Therefore, the TBT information can be displayed to the driver based on the corner position of the selected building (i.e., building A). In one embodiment, the rotation instruction image 120 may correspond to a curved arrow shape directed in the direction in which the vehicle 100 should rotate.

5A and 5B are views showing another example of a method of outputting a rotation direction image included in the route guidance providing method of the augmented reality navigation system of FIG.

5A and 5B, a method of setting the position at which the rotation instruction image 120 is displayed on the image is performed by connecting the third coordinate P3, which is the current position of the vehicle 100, A virtual second extension line L1 'extending in a direction parallel to the direction D2 in which the vehicle travels after passing through the rotation section of the intersection from the first coordinate (S540) The intersection CP between the first extension line L1 'and the second extension line L2 may be set as the end point of the rotation instruction image 120 in operation S560.

When the second coordinate P2 and the third coordinate P3 are set, an operation for setting the position of the end point of the rotation instruction image 120 may be performed. The second coordinate P2 may correspond to the corner coordinate AE closest to the first coordinate P1 of the corners of the selected building (i.e., the building A).

A virtual first extension line L1 'extending a straight line connecting the third coordinate P3 and the second coordinate P2 that is the current position of the vehicle 100 may be generated S540. The third coordinate P3 can be extracted so as to correspond to the position of the driver's seat of the vehicle 100. [ For example, the coordinates of the driver's seat of the vehicle 100 currently in progress through the GPS can be calculated. A first calculation expression representing the first extension line L1 'may be set based on the second coordinate P2 and the third coordinate P3. An imaginary second extension line L2 extending from the first coordinate P1 in a direction parallel to the second direction D2 in which the vehicle 100 will travel after passing through the rotation section of the intersection may be generated S520 . For example, a second equation for the second extension line L2 may be set based on the two-dimensional coordinate and the second direction D2.

Thereafter, the intersection CP of the first extension line L1 'and the second extension line L2 may be set to the end point of the rotation instruction image 120 (S560). For example, the coordinates of the intersection point CP can be calculated through the first equation and the second equation. The coordinates of the end point of the rotation direction image 120 indicating the TBT information may correspond to the coordinates of the intersection point CP. Therefore, the TBT information can be displayed to the driver based on the corner position of the selected building (i.e., building A) and the current position of the vehicle 100. [ 4A and 4B, the present embodiment can provide more accurate TBT information to the driver than the embodiment that displays the TBT information.

6A and 6B are diagrams illustrating another example of a method of outputting a rotation direction image included in the route guidance providing method of the augmented reality navigation system of FIG.

6A and 6B, the method of setting the position where the rotation instruction image 120 is displayed on the image can set the end point of the rotation instruction image 120 to the second coordinate P2 (S570) .

In one embodiment, when the first coordinate P1 and the second coordinate P2 are calculated, the AR navigation system sets the second coordinate P2 as the end point of the rotation instruction image 120, A rotation instruction image 120 of the type shown in FIG. The second coordinate P2 may correspond to the corner coordinate AE closest to the first one of the edges of the selected building (i.e., the building A). Therefore, in the present embodiment, the TBT information can be intuitively grasped at the first person's point of view of the driver, and the TBT information can be displayed by a simpler calculation and algorithm than the route guidance method of FIGS. 4A to 5B.

As described above, the route guidance method of the AR navigation system according to the embodiments of the present invention includes the corner coordinates (i.e., the second coordinate P2) of the buildings disposed around the intersection and the coordinates of the center point of the intersection 1 coordinate (P1)), the position of the direction indication image (i.e., the position of the end point) expressing the TBT information can be adjusted in real time. Therefore, by displaying the TBT information using only the coordinate information of the corner of the predetermined building without using the existing whole building image database and the computer vision technology, the cost for building the building image DB is reduced and the calculation amount of the navigation is reduced .

7 is a block diagram illustrating an augmented reality navigation system according to embodiments of the present invention.

7, the AR navigation system 200 includes a GPS unit 210, an input unit 220, a photographing unit 230, a control unit 240, a database 250, an output unit 260, a communication unit 270 And an augmented reality unit 270. [0034] In one embodiment, the control unit 240 may include a coordinate extraction unit 244 for extracting the first coordinate and the second coordinate, and a setting unit 244 for setting the position of the rotation instruction image for displaying the TBT information .

The GPS unit 210 can acquire position data on the current position of the AR navigation system 200 using the radio waves received from the plurality of satellites. The AR navigation system 200 can provide a route guidance service based on the current location based on the location data obtained by the GPS unit 210. [

The input unit 220 may receive an input from a user and convert the input signal into an electric signal. For example, the input unit 220 may include an operation button or an operation key (i.e., a physical button or the like) provided outside the AR navigation system 200, a user's voice, a microphone for receiving sound generated from the inside or the outside of the vehicle, And a touch screen in which a touch panel is integrally formed as a display panel and an input device.

The photographing unit 230 can photograph a forward image of the vehicle through the camera in real time. The photographing unit 230 is provided to realize the augmented reality of the navigation system. However, the present invention is not limited to the case where the photographing unit 230 photographs only the front of the vehicle, and it is also possible to photograph images of at least one of both sides and rear of the vehicle in real time.

The control unit 240 can control various operations of the AR navigation system 200. [ For example, the control unit 240 may include a GPS unit 210 of the navigation system 200, an input unit 230, and a display unit 240 of the navigation system 200 to provide a route guidance service, a real time traffic information service, a DMB service, The control unit 220, the output unit 260, the database 230, and the communication unit 270. The control unit 240 may include a coordinate extraction unit 242 for extracting the first coordinate and the second coordinate and a setting unit 244 for setting the position of the rotation instruction image for displaying the TBT information.

The coordinate extraction unit 242 extracts a first coordinate, which is a coordinate of an intersection center point on the optimal traveling path of the vehicle, and a turn-by-turn (TBT) information for the intersection based on the destination information set by the user And extract a second coordinate, which is a coordinate of the selected building, which is one of the predetermined buildings from the database, based on the turn-by-turn information. In one embodiment, the selected building may correspond to a building located closest to the first coordinate, while the vehicle is disposed at a position in a direction that the vehicle must rotate in the intersection. The second coordinate may correspond to the corner coordinates of the selected building of the selected building. In one embodiment, the coordinate extraction section 242 may extract the corner coordinates of the selected building as the second coordinates based on the traveling direction of the vehicle and the direction to be rotated. A method and an operation of extracting the first coordinate and the second coordinate have been described in detail with reference to FIG. 1 to FIG. 6B, and therefore the overlapping description will be omitted.

The setting unit 244 can set a position at which the rotation instruction image corresponding to the turn-by-turn information is displayed on the image, based on the first coordinate and the second coordinate. In one embodiment, as shown in FIG. 4B, the setting unit 244 includes a virtual first extension line extending from the second coordinate in a direction in which the vehicle is currently proceeding, and a virtual extension line extending from the first coordinate, The position of the end point of the rotation instruction image can be set at the intersection of the imaginary second extension line extending in the direction to proceed after passing through the rotation section of the intersection. For example, the setting unit 244 may calculate the intersection points based on the equations for the first and second extension lines. 5B, the setting unit 244 may include a virtual first extension line extending a straight line connecting the third coordinate, which is the current position of the vehicle, and the second coordinate, The position of the end point of the rotation instruction image can be set at the intersection of the imaginary second extension line extending from the coordinates in the direction in which the vehicle travels after passing through the rotation section of the intersection. At this time, the third coordinate may correspond to the position of the driver's seat of the vehicle. In another embodiment, the setting unit 244 may set the position of the end point of the rotation instruction image to the second coordinate, as shown in FIG. 6B. However, the method of setting the direction indication image indicating the TBT information has been described in detail with reference to FIG. 2 to FIG. 6B, so that the overlapping description will be omitted.

The database 250 (or storage unit) may store data necessary for operation of the AR navigation system 200 and data generated by the operation. In one embodiment, the database 230 may include the coordinates of the corners of each of the predetermined buildings located around the intersection. Wherein the predetermined buildings correspond to the outermost buildings disposed adjacent to the intersection and the coordinates of the corner correspond to the coordinates of the corner closest to the coordinates of the center point of the intersection of the respective buildings, can do. For example, the data necessary for the operation of the AR navigation system 200 may include an OS, a route search application, a map, and the like. Data generated by the operation of the navigation system 200 may include route data, Travel route data, travel pattern data, received images, and the like.

The output unit 260 may provide the user with information generated in the AR navigation system 200 in the form of video, audio, or the like. For example, the output unit 260 may include the display panel for visually displaying various information, and a speaker for audibly displaying various information. Also, as described above, the display panel and the touch panel may be integrally formed as the touch screen.

The communication unit 270 can perform predetermined wired / wireless communication with another external device.

The augmenting reality unit 280 may superimpose the rotation instruction image on the image and display it on the output unit. The augmented reality part matches the image inputted by the photographing part 230 with the rotation direction image, and the rotation direction image can be superimposed on the image and displayed as a screen of Fig.

As described above, the AR navigation system 200 according to the embodiments of the present invention includes a coordinate extraction unit 242 for extracting the first and second coordinates based on generation of the direction-indicating image, And a setting unit 242 for setting the position of the end point of the direction indicating image through an operation based on the second coordinates. Thus, the driver can intuitively recognize the turning or traveling path. In addition, by displaying the TBT information using only the coordinate information of the corner of the predetermined building without using the existing whole building image database and computer vision technology, the cost for building the building image DB is reduced, and the calculation amount of the navigation is reduced .

The present invention can be applied to a navigation system that displays TBT information in order to reflect an augmented reality. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the following claims. It can be understood that it is possible.

100: vehicle 120: direction indication image
200: AR navigation system 210: GPS unit
220: input unit 230: database
240: Control section 242: Coordinate extraction section
244: setting unit 260: output unit
270:

Claims (17)

Capturing an image in front of the vehicle in real time through a camera;
Confirming turn-by-turn (TBT) information for the intersection on the current traveling route of the vehicle based on the destination information set by the user;
Extracting a first coordinate which is a coordinate of a center point of the intersection;
Selecting a selection structure that is one of structures located at the periphery of the intersection based on a direction in which the vehicle should rotate in the intersection and extracting a second coordinate;
Setting a position at which a rotation instruction image corresponding to the turn-by-turn information is displayed on the image based on the first coordinate and the second coordinate; And
And displaying the rotation instruction image and the image in a superimposed manner. 2. The system of claim 1, wherein the substructures correspond to outermost buildings adjacent to the intersection,
Wherein the selection structure corresponds to a building located closest to the first coordinate while being disposed at a position where the vehicle is rotated in the direction in which the vehicle must rotate in the intersection. 3. The method according to claim 2, wherein the second coordinate corresponds to a coordinate of an edge closest to the first coordinate among the corners of the selection structure. The method as claimed in claim 1, wherein the step of setting a position at which the rotation instruction image is displayed on the image
Generating an imaginary first extension line extending from the second coordinate in a direction parallel to a direction in which the vehicle is currently traveling;
Generating an imaginary second extension line extending from the first coordinate in a direction parallel to a direction in which the vehicle will travel after passing through the rotation section of the intersection; And
Calculating an intersection point between the first extension line and the second extension line and setting the intersection point as an end point of the rotation instruction image. 5. The method of claim 4, wherein the rotation instruction image is in the form of a bent arrow pointing in a direction in which the vehicle should rotate. The method as claimed in claim 1, wherein the step of setting a position at which the rotation instruction image is displayed on the image
Generating a virtual first extension line extending a straight line connecting the third coordinate, which is the current position of the vehicle, with the second coordinate;
Generating an imaginary second extension line extending from the first coordinate in a direction parallel to a direction in which the vehicle will travel after passing through the rotation section of the intersection; And
Calculating an intersection point between the first extension line and the second extension line and setting the intersection point as an end point of the rotation instruction image. 7. The method according to claim 6, wherein the third coordinate corresponds to a position of a driver's seat of the vehicle. 7. The method of claim 6, wherein the rotation instruction image is in the form of a bent arrow pointing in a direction in which the vehicle should rotate. The method as claimed in claim 1, wherein the step of setting a position at which the rotation instruction image is displayed on the image
And setting an end point of the rotation instruction image to the second coordinate. 10. The method of claim 9, wherein the rotation instruction image is in the form of a bent arrow pointing in a direction in which the vehicle should rotate. A photographing unit for photographing a forward image of the vehicle through a camera in real time;
A database containing coordinates of edges of each of the predetermined buildings located at the periphery of the intersection;
On-turn (TBT) information for the intersection and a first coordinate, which is a coordinate of an intersection center point on the optimal traveling path of the vehicle, based on the destination information set by the user, A coordinate extraction unit for extracting a second coordinate, which is a coordinate of a selected building which is one of the predetermined buildings, from the database based on the turn information;
A setting unit for setting a position at which a rotation instruction image corresponding to the turn-by-turn information is displayed on the image based on the first coordinate and the second coordinate; And
And an augmenting reality unit for superimposing the rotation instruction image on the image and displaying the rotation direction image on an output unit. 12. The method of claim 11, wherein the predetermined buildings correspond to outermost buildings adjacent to the intersection,
Wherein the selected building corresponds to a building located closest to the first coordinate, the first building being located at a position in the direction in which the vehicle must rotate in the intersection,
And the second coordinate corresponds to the corner coordinates of the selected building of the selected building. 13. The augmented reality navigation system according to claim 12, wherein the coordinate extraction unit extracts the corner coordinates of the selected building as the second coordinate based on the traveling direction of the vehicle and the direction to be rotated. 13. The vehicle driving force control apparatus according to claim 12, wherein the setting unit comprises: a virtual first extension line extending from the second coordinate in a direction in which the vehicle is currently proceeding; and a second extending line extending from the first coordinate in a direction in which the vehicle is advanced after passing through the rotation interval of the intersection Wherein the position of the end point of the rotation instruction image is set at an intersection of a virtual second extension line. 13. The vehicle of claim 12, wherein the setting unit comprises: a virtual first extension line extending a straight line connecting the third coordinate, which is a current position of the vehicle, with the second coordinate; and a virtual extension line extending from the first coordinate, And a position of an end point of the rotation instruction image is set at an intersection of a virtual second extension line extending in a direction in which the rotation instruction image is advanced. 16. The augmented reality navigation system according to claim 15, wherein the third coordinate corresponds to a position of a driver's seat of the vehicle. 13. The augmented reality navigation system according to claim 12, wherein the setting unit sets a position of an end point of the rotation instruction image to the second coordinate.

Images