KR20190068006A - Method for providing route through marker recognition and server using the same - Google Patents

Abstract

According to the present invention, a method for providing a route by marker recognition comprises: (a) a step where a route providing device transmits current location information of a user which is information for a current location of the user and destination information which is information for a destination of the user to a server when the destination information is acquired to acquire route information which is information for a route from the current location of the user to the destination from the server; (b) a step where the route providing device refers to the current location information of the user to display route guide information corresponding to the route information on a video image acquired in response to a surrounding environment on a moving route of the user to output the route guide information to allow the user to know the route guide information; and (c) a step where the route providing device refers to the route information to track a marker located on the route, and refers to information of the tracked marker to correct the current location information of the user. Accurate location information can be provided without being affected by a surrounding environment in accordance with a moving route of a user.

Description

[0001] METHOD FOR PROVIDING ROUTE THROUGH MARKER RECOGNITION AND SERVER USING THE SAME [0002]

The present invention relates to a method and apparatus for providing a path through marker recognition, and more particularly, to a method and apparatus for providing a path through marker recognition, And a method and an apparatus for providing a path through recognition of a marker that corrects the current position information of the user by referring to the information of the marker located on the path, will be.

Augmented Reality (AR) is a technology that combines a virtual object or information into a real environment to make it look like an object in the original environment, that is, a 3D virtual object superimposed on the real world .

And, unlike the existing virtual reality (VR), which only targets virtual space and virtual objects, the augmented reality synthesizes virtual objects on the basis of real world, and reinforces additional information that is difficult to obtain only in the real world .

Because of this feature, augmented reality can be applied to various real environments, unlike existing virtual reality, which can be applied only to fields such as games, and is particularly attracting attention as a next generation display technology suitable for a ubiquitous environment.

Especially, there is a technology to guide route by combining location - based service and augmented reality.

In general, a conventional terminal device capable of guiding a route guides a route to a destination on the basis of a terrain or object modeled based on stored geographical information. On the other hand, if the terminal device provides the GPS information and / or the geomagnetism information to the server, the augmented reality technology determines the position and / or direction of the mobile terminal based on the information provided by the server, Guide information (AR information) is provided.

However, the conventional route guiding method is affected by the surrounding environment of the moving route, for example, the outdoor environment such as the outdoor or indoor environment, the urban area, etc., and the positioning error is generated. There is a problem that an error occurs in guiding the route.

SUMMARY OF THE INVENTION The present invention has been made to solve all the problems described above.

It is another object of the present invention to provide a route guidance method using an augmented reality, which can guide an accurate route without being affected by the surrounding environment.

It is another object of the present invention to accurately measure the current position of a user in route guidance using an augmented reality.

It is another object of the present invention to correct a positioning error caused by a surrounding environment in route guidance using an augmented reality.

It is another object of the present invention to enable a specific event to be performed at a transit point by using route guidance using an augmented reality.

According to another aspect of the present invention, there is provided a method of providing a path through marker recognition, the method comprising: (a) when destination information, which is information on a destination of the user, is obtained, Obtaining path information, which is information on a route from the current location of the user to the destination, from the server by transmitting the current location information of the user and the destination information to the server; (b) the route providing apparatus displays route guidance information corresponding to the route information on the image image obtained corresponding to the surrounding environment on the user's moving route with reference to the current location information of the user, A step of outputting information so as to be known; And (c) tracking the marker positioned on the path by referring to the path information, and correcting the current position information of the user with reference to the tracked marker information. A method for providing a path through marker recognition is provided.

In addition, the present invention provides an apparatus for providing a path through marker recognition, wherein when destination information, which is information on a destination of a user, is obtained, the current location information of the user, To the server so as to obtain path information, which is information on a path from the current location of the user to the destination, from the server; And a display unit for displaying route guidance information corresponding to the route information on the video image obtained corresponding to the surrounding environment on the moving route of the user with reference to the current location information of the user, And a second process of tracking a marker located on the path by referring to the path information and correcting the current position information of the user by referring to the information of the tracked marker. A marker providing unit for acquiring a marker;

In addition, a computer readable recording medium for recording a computer program for executing the method of the present invention is further provided.

The present invention has the following effects.

The present invention can correct the positioning error caused by the surrounding environment on the user movement path through the marker.

In addition, since the present invention can prevent a positioning error due to the surrounding environment on the user movement path, the present position of the user can be accurately positioned.

Further, the present invention can accurately position the current position of the user without being affected by the surrounding environment on the user movement route, thereby improving the reliability of the route guidance.

In addition, since the present invention allows a user to perform an event operation at a way point via a marker, the use range can be extended to a field such as facility inspection in addition to route guidance using an augmented reality.

FIG. 1 schematically shows a path providing apparatus for recognizing a marker according to an embodiment of the present invention,
2 schematically shows a state in which a path from a current location to a destination of a user is set according to an embodiment of the present invention,
3 schematically shows a state in which route guidance information is displayed to a user according to an embodiment of the present invention,
FIG. 4 schematically shows a state in which a user arrives at a waypoint according to an embodiment of the present invention,
FIGS. 5 to 8 illustrate examples of tracking a marker positioned on a movement path according to an embodiment of the present invention,
FIG. 9 and FIG. 10 schematically show a state in which a user performs an event to be displayed in response to marker information according to an embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention.

Referring to FIG. 1, a path providing apparatus 100 includes an input unit 110, a communication unit 120, a processor (not shown) 130, a position sensor 140, a camera 150, and an output unit 160.

The input unit 110 generates an input signal for controlling the operation of the user and may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, However, the present invention is not limited thereto, and may include any device capable of generating an input signal according to a user's intention, such as a microphone.

The communication unit 120 communicates with an external device such as a server. When the destination information that is the destination information of the user is acquired, the communication unit 120 transmits the current location information and the destination information of the user, Thereby obtaining route information that is information on the route from the current position of the user to the destination from the server.

The processor 130 controls the overall operation of the path providing apparatus 100. The processor 130 refers to the current location information of the user and displays a path corresponding to the path information on the image obtained in correspondence with the surrounding environment on the user's moving path, A first process of displaying guidance information and outputting the guide information so that the user can know the guidance information; a step of tracking the marker located on the route with reference to the route information and correcting the user's current position information by referring to the information of the tracked marker; 2 process can be performed.

In addition, the processor 130 acquires event information corresponding to the tracked marker information from the server, and transmits event result information corresponding to the event information to the server. When event completion information is obtained from the server, A third process of performing the second process may be further performed.

The position sensor 140 is for detecting the position of the path providing apparatus 100 and may include, but is not limited to, an accelerometer, a gyroscope, a geomagnetic machine, a barometer, etc., .

The camera 150 may capture a video image of the user's environment.

The output unit 160 may include a display unit, an audio output module, an alarm unit, a haptic module 154, and the like, but is not limited thereto. And the like.

In particular, the display unit of the output unit 160 may output a video image of the acquired environment.

In addition, when the display unit and the sensor for sensing the touch operation form a mutual layer structure, the display unit may be used as an input device in addition to the output device.

A method of providing a path through marker recognition according to an embodiment of the present invention will be described with reference to the path providing apparatus 100 constructed as above.

First, when the user inputs a destination to be moved through the input unit 110 of the route providing apparatus 100, the processor 130 of the route providing apparatus 100 transmits the current position information of the user, That is, the current position information of the path providing apparatus 100.

For example, the processor 130 may determine the current position of the user using positioning technology using GPS, wireless communication network, WLAN, UWB, infrared, ultrasound, RF, RFID, Bluetooth, Wi-Fi, beacon, The sensing signal of the user 140 is analyzed and the current position of the user is confirmed using a sensor-based positioning technique represented by Pedestrian Dead Reckoning (PDR). In addition, the processor 130 does not use only a specific positioning technique, but allows a more accurate position to be confirmed by confirming the current position of the user by using at least two positioning techniques.

The communication unit 120 of the path providing apparatus 100 transmits the current location information and the destination information of the user to the server.

Then, the server refers to the current location information and the destination information of the user, determines the route information, which is information on the route from the user's current location to the destination, according to a predetermined method, and transmits the determined route information to the route providing apparatus 100 ). At this time, the path information is set to a path corresponding to a specific condition or a combined condition such as a path corresponding to the shortest time from the current position of the user to the destination or a path corresponding to the minimum distance by a predetermined method Lt; / RTI >

For example, as shown in FIG. 2, when a destination (site C) is input by a user, the server can determine a movement path from a starting point to a destination, which is the current position. In addition, if the user selects an operation to perform a specific operation, the server can determine the starting point -> site A -> site B -> site C, which is the set route corresponding to the selected operation, as the route information.

Next, the communication unit 120 of the path providing apparatus 100 acquires path information, which is information on a path from the current position of the user to the destination, from the server, and the processor 130 of the path providing apparatus 100 The route guidance information corresponding to the route information is displayed on the video image corresponding to the surrounding environment on the user's moving route by referring to the current location information and is displayed on the video image through the output unit 160 Can be output.

3, the path guide information includes first path guide information 210 indicating path information in the geographical information including the current location of the user, And second route guidance information 220 indicating information on the position and direction in which the route to be changed should be changed.

In addition, the route guidance information may be displayed on the display unit of the output unit 160 so that the user can recognize the route guidance information, and the user can recognize the route guidance information by using the voice output through the speaker or the like.

In the state in which the path providing apparatus 100 provides the path information for the user to move to the destination by the above operation and the user moves to the destination according to the path guide information provided by the user, To track the marker located on the path, and correct the current position information of the user by referring to the information of the tracked marker.

The path providing apparatus 100 tracks the marker only when the current position of the user is located within the set distance from the position of the marker by referring to the position information of the marker located on the path, The current position information can be corrected.

4, when the user is located within a set distance from a specific marker (character T1-30), the route providing apparatus 100 notifies the user that the user has arrived at a specific waypoint via the route guidance information 220 Let the user know.

As shown in FIG. 5, event guide information for performing an operation for tracking a specific marker (character T1-30) 231 is output by the user.

At this time, the marker may be located in the path from the current position of the user to the destination, and the path information may be information on the path from the current position of the user via the at least one marker to the destination.

That is, referring to FIG. 2, the markers may be installed or formed at the start point, the site A, the site B, and the site C, respectively.

Further, the marker may include at least one of characters formed in the surrounding environment, an identification code formed in the surrounding environment, and a shape for a specific facility in the surrounding environment.

For example, as shown in FIG. 5, a specific character (T1-30) 231 may be formed by a marker, an identification code 232 including a QR code may be formed by a marker as in FIG. 6, 8, the shape of the specific facility 233, the facility or facility 234, 235, 236, 237 may be formed by a marker.

When the marker located on the movement path is tracked, the path providing apparatus 100 analyzes the relative position of the tracked marker corresponding to the current position of the user, and refers to the set reference marker position information of the marker to correspond to the relative position And obtains the current position information of the user using the acquired reference position information, and corrects the current position information of the user.

In other words, an error may occur in the user's current position information due to a positioning error caused by the surrounding environment during the movement of the user due to various positioning techniques. However, when the user uses the marker in the surrounding environment image acquired during the movement of the user, Accordingly, by correcting the current position information of the user having the error, it is possible to provide the route to the user by using accurate positioning information without being affected by the surrounding environment.

At this time, the path providing apparatus 100 analyzes the distance between the marker and the user's current position using the size information of the marker detected in the image, and uses the shape information of the marker detected in the image, The relative position of the marker can be analyzed by analyzing the direction information of the marker with reference to the movement information.

In addition to correcting the user's current position information using the marker, the path providing apparatus 100 acquires event information corresponding to the tracked marker information from the server, and transmits event result information corresponding to the event information to the server Thus, when event completion information is obtained from the server, the path information may be provided again, that is, path information provision and position correction may be provided.

For example, as shown in FIG. 9, when event information for performing a specific operation is obtained from the server in response to tracked marker information, the path providing apparatus 100 displays event information 301 ( 302) so that the user can know.

As shown in FIG. 10, in response to the event information 301 of FIG. 9, the user displays status information 303 about the status of the event, and the result information 304 about the event advanced by the user, The path providing apparatus 100 transmits the confirmed event result information to the server. When the event completion information is obtained from the server, it is determined that the event at the stopover point corresponding to the tracked or recognized marker is completed, and the route guidance information for moving to the next destination or stopover destination And displays it on a video image so that the user can know it.

In addition, the embodiments of the present invention described above can be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable recording medium may be those specially designed and constructed for the present invention or may be those known and used by those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for performing the processing according to the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, Those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.

Therefore, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the following claims, I will say.

100: path providing device, 110: input part,
120: communication unit, 130: processor,
140: position sensor, 150: camera,
160: Output section

Claims (20)

A method for providing a path through marker recognition,
(a) when the destination information, which is information on the destination of the user, is obtained, the route providing apparatus transmits the current location information of the user and the destination information to the server, Acquiring path information, which is information on a path from a current position of the mobile terminal to the destination;
(b) the route providing apparatus displays route guidance information corresponding to the route information on the image image obtained corresponding to the surrounding environment on the user's moving route with reference to the current location information of the user, A step of outputting information so as to be known; And
(c) tracking the marker located on the path with reference to the path information, and correcting the current position information of the user with reference to the tracked marker information;
The method of claim 1, The method according to claim 1,
(d) The route providing apparatus acquires event information corresponding to the tracked marker information from the server, and transmits event result information corresponding to the event information to the server, Performing the steps (b) and (c) again if it is obtained;
The method of claim 1, further comprising: The method according to claim 1,
In the step (c)
The path providing apparatus analyzes the relative position of the tracked marker corresponding to the current position of the user and refers to the reference marker position information of the marker to determine a reference to the current position of the user corresponding to the relative position Acquiring position information of the user and correcting the current position information of the user using the obtained reference position information. The method of claim 3,
In the step (c)
Wherein the path providing device analyzes the distance between the marker and the current position of the user using the size information of the marker detected in the image and uses the shape information of the marker detected in the image Or analyzing the direction information of the marker with reference to the movement information of the user, thereby analyzing the relative position of the marker. The method according to claim 1,
In the step (a)
The path providing apparatus may use positioning technology based on any one of GPS, wireless communication network, WLAN, UWB, infrared, ultrasound, RF, RFID, Bluetooth, Wi-Fi, beacon, And acquiring the current location information of the user by using the technology. The method according to claim 1,
Wherein the marker includes at least one of a character formed in the surrounding environment, an identification code formed in the surrounding environment, and a shape for a specific facility in the surrounding environment. The method according to claim 1,
Wherein the marker is located in a path from the current location of the user to the destination. 8. The method of claim 7,
Wherein the path information is information on a path from the current location of the user to the destination via at least one or more of the markers. The method according to claim 1,
In the step (c)
Wherein the path providing device tracks the marker only when the current position of the user is located within a set distance from the position of the marker by referring to the position information of the marker located on the path. How to provide a route. The method according to claim 1,
The route guidance information may include first route guidance information in which the route information is displayed in the geographical information including the current location of the user, and first route guidance information in which the user is moving in response to the route information at the current location of the user And second route guidance information indicating information on a location and a direction to be displayed. An apparatus for providing a path through marker recognition,
When the destination information which is the information on the destination of the user is obtained, the current position information of the user and the destination information, which is information on the current position of the user, are transmitted from the server to the server, A communication unit for acquiring path information that is information on a path; And
A first process of displaying route guidance information corresponding to the route information on an image obtained in correspondence with a surrounding environment on the movement path of the user with reference to the current location information of the user so that the user can know the route guidance information; And a second process of tracking a marker located on the path by referring to the path information and correcting the current position information of the user by referring to the information of the tracked marker.
And a marker recognition unit for recognizing the marker. 12. The method of claim 11,
Wherein the processor acquires event information corresponding to the tracked marker information from the server and transmits event result information corresponding to the event information to the server, 1 process, and a third process of performing the second process. 12. The method of claim 11,
The processor comprising:
Analyzing a relative position of the tracked marker corresponding to the current position of the user and obtaining reference position information on the current position of the user corresponding to the relative position with reference to the set reference marker position information of the marker, And the current position information of the user is corrected using the obtained reference position information. 14. The method of claim 13,
The processor comprising:
A distance between the marker and the current position of the user is analyzed using the size information of the marker detected in the image, and the shape information of the marker detected in the image is used, And analyzing the direction information of the marker to analyze the relative position of the marker. 12. The method of claim 11,
The processor may use positioning techniques based on GPS, wireless communication network, WLAN, UWB, infrared, ultrasound, RF, RFID, Bluetooth, Wi-Fi, beacons, and sensors, And acquires the current location information of the user by using the marker. 12. The method of claim 11,
Wherein the marker comprises at least one of a character formed in the surrounding environment, an identification code formed in the surrounding environment, and a shape for a specific facility in the surrounding environment. 12. The method of claim 11,
Wherein the marker is located in a path from the current location of the user to the destination. 18. The method of claim 17,
Wherein the path information is information on a path from the current position of the user to the destination via at least one or more of the markers. 12. The method of claim 11,
Wherein the processor tracks the marker only when the current position of the user is located within a set distance from the position of the marker by referring to the position information of the marker located on the path. Device. 12. The method of claim 11,
The route guidance information may include first route guidance information in which the route information is displayed in the geographical information including the current location of the user, and first route guidance information in which the user is moving in response to the route information at the current location of the user And second route guidance information indicating information on a position and a direction to be displayed on the display unit.

Images