KR20190114696A - An augmented reality representation method for managing underground pipeline data with vertical drop and the recording medium thereof - Google Patents

Abstract

The present invention relates to a method of expressing an augmented reality to manage an underground pipeline in consideration of an orthometric height, configured to express an underground pipeline having an orthometric height into an augmented reality using established two-dimensional underground pipeline geographic information system (GIS) database (DB) and geographic information, and to a recording medium recording the same. The method comprises the steps of: (a) measuring a position (hereafter, referred to a current position) and a posture of a smart terminal; (b) extracting three-dimensional geographic information about a topography within a predetermined range of the current position and two-dimensional pipeline information including a location and a depth of a pipeline; (c) generating a three-dimensional pipeline object by applying the three-dimensional geographic information to the two-dimensional pipeline information; (d) extracting a location and direction of a viewpoint of a camera of the smart terminal; (e) generating a two-dimensional projection image by projecting the three-dimensional pipeline object with respect to the viewpoint of a camera using the extracted location and direction of a viewpoint of a camera; and (f) synthesizing the projection image with a front image captured by the camera of the smart terminal and displaying the synthesized image. According to the method and the recording medium, it is possible to be simultaneously connected in at least one field, identify space information, and allow for organic data sharing between a manager of the space information and a worker working in the field by building a service which stores space information and provides a related service.

Description

An augmented reality representation method for managing underground pipeline data with vertical drop and the recording medium according to elevation differences

The present invention is a two-dimensional underground pipe that has an existing elevation difference, which is represented by augmented reality using a geographic information system (GIS) database (DB) and terrain information. It relates to an augmented reality representation method for management and a recording medium recording the same.

In general, Augmented Reality (AR) technology is a technology that combines a virtual world having additional information in real time into the real world that the user sees as a single image. For example, the portable terminal determines the approximate location using location and direction information, and identifies a service desired by the user by comparing object information such as surrounding building information with live image information input according to the movement of the camera. A technology that provides relevant information.

This augmented reality technology is a field of virtual reality (VR) technology, and uses a computer graphics technique that synthesizes virtual objects (objects) in a real environment and looks like objects existing in the original environment. In addition, unlike conventional virtual reality technology that targets only virtual spaces and objects, augmented reality technology has an advantage of reinforcing and providing additional information that is difficult to obtain only in the real world by synthesizing virtual objects on the basis of the real world. . In addition, such augmented reality technology is currently being used in a variety of fields due to the spread of smart phones, such as a portable terminal.

On the other hand, since facilities in underground pipelines such as water and sewage pipes and electric power facilities are buried underground, the location thereof cannot be grasped by the naked eye. To rely on drawings and surveying equipment to locate underground pipelines, the method is not intuitive and the procedures for locating location are complex.

In order to solve the above problems, a method of introducing augmented reality to underground facilities has been developed. For example, a technique for introducing cloud computing as a method for providing information on underground facilities has been proposed [Patent Document 1]. In addition, a method of modeling a three-dimensional object in order to express a two-dimensional object by using a virtual reference station (VRS) to increase the position accuracy of the smart device when using augmented reality has been proposed [Patent Document 2]. However, the prior arts are inconvenient to additionally perform a three-dimensional object modeling work in order to represent the two-dimensional object built in augmented reality.

In order to solve this inconvenience, a method of converting two-dimensional linear data into three-dimensional in real time has been proposed [Patent Document 3], but cannot be applied to augmented reality.

In addition, a method of converting two-dimensional data into three-dimensional for the purpose of managing power equipment has been proposed [Patent Document 4]. However, the prior art expresses the height of the underground facility only by the depth without considering the influence of the feature, there is a problem that the location accuracy is lowered in the case of the facility embedded in the feature of the height difference.

In addition, augmented reality technology based on image recognition has been proposed in accordance with recent development of artificial intelligence and image recognition accuracy improvement [Patent Document 5]. Image recognition-based augmented reality technology recognizes and displays the location of the feature points such as markers or targets. However, the image recognition-based augmented reality technology has a difference in accuracy depending on the image quality and contrast of the image. In particular, it cannot reflect the effect of shadows on the altitude of the sun. The system for managing underground pipelines is affected by the weather due to the nature of the outdoor site. Depending on the weather, there is a difference in the accuracy of the location of the underground pipeline. Therefore, AR system based on image recognition is not suitable for managing underground pipelines.

Korean Patent Publication No. 10-0992619 (announced on November 5, 2010) Korean Patent Publication No. 10-0997084 (announced 29 November 2010) Korean Patent Publication No. 10-2006-0066976 (June 19, 2006) Korea Patent Publication No. 10-1774877 (2017.09.05.Notification) Korean Patent Publication No. 10-2010-0006736 (published Jan. 21, 2010)

An object of the present invention is to solve the problems as described above, using a two-dimensional GIS DB of the existing underground pipeline to automatically generate and display a three-dimensional object, buried underground in the terrain with high differences The present invention provides an augmented reality representation method and a recording medium for the management of underground pipelines considering the elevation difference using spatial information including the elevation of the terrain to accurately represent the location of the pipeline.

In order to achieve the above object, the present invention relates to an augmented reality representation method for the management of underground pipes considering the elevation difference, which is performed by a system comprising a client installed in a smart terminal and a server connected to the smart terminal and a network. (a) measuring the position (hereinafter, present position) and posture of the smart terminal; (b) extracting three-dimensional topographic information within a predetermined range from the current location and two-dimensional pipeline information including the location and depth of the pipeline; (c) generating three-dimensional pipeline objects by applying three-dimensional terrain information to the two-dimensional pipeline information; calculating a position and a direction of a camera viewpoint of the smart terminal; (e) generating a two-dimensional projection image projecting the three-dimensional duct object based on the camera viewpoint using the calculated position and direction of the camera viewpoint; And (f) synthesizing and displaying the projection image on the front image photographed by the camera of the smart terminal.

In addition, the present invention provides a method for augmented reality representation for the management of underground pipelines considering the elevation difference, in step (c), the position of the node N _i of the underground pipeline from the pipeline information is (x _i , y _i ) and the depth It is characterized in that the extraction in that the d _i, and extracts the height h _i of the node N _i from the terrain information, calculates the three-dimensional position of the node N _i a (x _i, y _i, h _i -d _i) do.

In addition, the present invention in the augmented reality representation method for the management of underground pipelines considering the difference in elevation, the pipeline information is composed of a plurality of nodes, each node has a position spaced apart from each other at a predetermined interval, In the step (c), by using the interpolation method to obtain a continuous pipeline coordinates from a plurality of nodes, by obtaining a three-dimensional pipeline object from the obtained coordinates, it characterized in that the continuous three-dimensional pipeline object to generate.

In addition, the present invention, in the augmented reality representation method for the management of the underground pipeline considering the elevation difference, in the step (d), the normal direction perpendicular to the plane of the smart terminal from the pose of the smart terminal to obtain the direction of the camera view The altitude of the smart terminal is obtained by adding the machine height input from the user and the altitude of the current location extracted from the 3D topographical information, and the location of the camera viewpoint is obtained by the current position and the altitude of the smart terminal.

In addition, the present invention provides a method for augmented reality representation for the management of underground pipelines considering the difference in elevation, in the step (e), projecting a plane spaced apart by the focal length from the camera perspective to the opposite side to the three-dimensional pipeline object It is set to a plane, it characterized in that the projected point-symmetrical projection of the three-dimensional pipeline object on the projection plane around the camera viewpoint.

The present invention also relates to a computer-readable recording medium having recorded thereon a program for performing an augmented reality representation method for management of an underground pipeline considering an elevation difference.

As described above, according to the augmented reality representation method for the management of the underground pipeline considering the difference in elevation according to the present invention and the recording medium recording the same, by establishing a server for storing and servicing the spatial information at the same time at one or more sites to access the spatial information The effect of enabling organic data sharing between the manager of the spatial information and the workers in the field is obtained.

In addition, according to the augmented reality representation method for the management of the underground pipeline considering the elevation difference according to the present invention and the recording medium recording the same, separate three-dimensional modeling by using a two-dimensional spatial information DB mechanically organized by the underground pipeline management institution Since it is not necessary, the effect of saving time and cost for 3D modeling is obtained.

In addition, according to the augmented reality representation method for the management of the underground pipeline considering the elevation difference according to the present invention and the recording medium recording the same, to express the spatial information of the underground pipeline constructed in two dimensions as a three-dimensional spatial object on the augmented reality system In order to use the 3D topographic information and calculate the relative position with the smart device, the effect of calculating and locating the pipeline information more accurately can be obtained.

1 is a block diagram of an overall system for practicing the present invention.
2 is a block diagram of the configuration of a smart terminal according to an embodiment of the present invention.
3 is a flowchart illustrating an augmented reality representation method for management of an underground pipeline considering elevation differences according to an embodiment of the present invention.
4 is an exemplary view showing pipeline information according to an embodiment of the present invention.
5 is an exemplary view showing terrain information according to an embodiment of the present invention.
Figure 6 is an exemplary view showing the position of the underground pipe in accordance with an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, specific contents for carrying out the present invention will be described with reference to the drawings.

In addition, in describing this invention, the same code | symbol is attached | subjected and the repeated description is abbreviate | omitted.

First, the structure of the whole system for implementing this invention is demonstrated with reference to FIG.

As shown in Figure 1, the entire system for implementing the present invention is installed in the smart mobile terminal 10, the smart mobile terminal 10, such as a user's smart phone client 20 for displaying the pipeline as augmented reality, It is composed of augmented reality server 30 to bring the information and topographic information into the underground pipe to create augmented reality. The smart mobile terminal 10 and the augmented reality server 30 is connected to each other via a network 80, such as the Internet. In addition, the database 40 for storing underground pipe information and topographic information may be further configured.

First, the smart mobile terminal 10 is a mobile terminal used by a user, and is a smart terminal having normal computing functions such as a smartphone, a tablet, a tablet PC, and the like. In particular, the smart terminal 10 is a terminal on which an application or a mobile application (or an app or an app) may be installed and executed.

In particular, as shown in FIG. 2, the smart terminal 10 may include a camera 11 capable of capturing the front, a display 12 displaying a captured image or a generated image on a screen, and an input such as a touch screen or a button. Device 13, GNSS sensor, magnetic field, inertial system, gyro sensor, acceleration sensor such as acceleration sensor 14, communication unit 15 for performing data communication with mobile or local area network, GNSS (Global Navigation Satellite System) sensor Or a position detecting sensor 16 such as a GPS (Global Positioning System) sensor, and a central processing unit 18 such as a mobile CPU. It further comprises a memory (not shown) for storing data.

Next, the client 20 is a mobile application (or app, app) installed and executed in the smart terminal 10, a program that works with the augmented reality server 30 or independently provides augmented reality service to the underground pipe. System.

That is, the client 20 acquires an image (hereinafter, a front image) photographing the front through the camera 11 of the smart terminal 10, and a virtual image (or a three-dimensional spatial object) of the underground pipe to the obtained front image. Are synthesized to express the synthesized image on the display 12.

At this time, the client 20 detects the current position or direction (or the direction of the camera) through the position sensor 16 or the motion sensor 14, and augments the reality server 30 to detect the detected current position or direction. To transmit. Since the direction of the camera 11 is toward the front of the smart terminal 10, the direction of the camera is calculated by detecting the direction of the smart terminal 10 using the motion sensor 14 of the smart terminal 10.

Three-dimensional topographic information and underground pipeline information corresponding to the current location or direction are imported by the augmented reality server 30, and the location of the underground pipeline is calculated using this, and the three-dimensional spatial object is constructed.

In addition, the client 20 receives the 3D spatial object of the underground pipe, synthesizes a virtual image of the underground pipe to the front image, and displays the synthesized image.

Hereinafter, since the work performed by the client 20 or the work performed by the user is performed by the smart mobile terminal 10, the client 20 or the smart mobile terminal 10 will be described for convenience of description. That is, the client 20 or the smart mobile terminal 10 is mixed. In addition, the input data for the user to process the work associated with the augmented reality in the underground pipe is input through the input device 13 of the smart mobile terminal 10, the processing result is displayed on the display 12 of the smart mobile terminal 10 It is output through the output device. In the following description, a user performing a task means a task performed by the smart mobile terminal 10.

In addition, the client 20 may receive an input value from the user through the input device 13 such as a touch screen in order to perform a management function such as object property inquiry.

Next, the augmented reality server 30 is a conventional application server, a server for generating the three-dimensional space object of the underground pipeline by taking the information of the underground pipe route and the three-dimensional terrain information corresponding to the current position, performing the spatial operation to be.

That is, the augmented reality server 30 requests the database 40 for information on the underground pipe line and three-dimensional topographical information within a specific radius based on the location of the smart terminal 10. The augmented reality server 30 obtains the two-dimensional spatial information DB 41 and the three-dimensional topographic information DB 42 of the conduit from the database 40, generates three-dimensional information of the conduit, and sends the information to the client 20. To pass).

On the other hand, the client 20 and the augmented reality server 30 may be implemented according to the configuration method of a conventional client and server. That is, the functions of the entire system can be shared depending on the performance of the client, the server and the traffic. As an example, the client 20 simply acquires the captured front image or the current position or direction, and outputs the image obtained by synthesizing the image into the basement pipe to the front image, and the augmented reality server 30 performs the current position and direction. Most of computational operations can be performed by importing the topographic information or pipeline information corresponding to the 3D spatial object of the underground pipeline and synthesizing the image of the underground pipeline and the forward image. As another example, the augmented reality server 30 performs only a role of storing or importing only terrain information or pipeline information corresponding to a specific location, and the client 20 photographs the front image, measures the current location, and generates a 3D spatial object. You can also perform most operations such as creating composite images. Hereinafter, the augmented reality system of the pipeline, but may be implemented in a variety of shared forms according to the configuration method of the server-client.

Hereinafter, a server-client system composed of the client 20 and the augmented reality server 30 will be referred to as an augmented reality system 300.

Next, the database 40 includes a pipeline information DB 41 representing the underground pipeline as two-dimensional spatial information and a terrain information DB 42 representing the terrain information in three dimensions. However, the configuration of the database 40 is only a preferred embodiment, and in the development of a specific device, it may be configured in a different structure by a database construction theory in view of the ease and efficiency of access and search.

In addition, the database 40 may be embedded in or directly connected to the AR server 30, and may transmit necessary data according to a request of the AR server 30. Alternatively, the database 40 may be implemented as a server that is separated from the augmented reality server 30 and operated in a separate DB management system (DBMS). In this case, the AR server 30 requests and receives data from the database 40 through the connection of the network 80.

Next, the pipeline information DB 41 is geographic information representing the underground pipeline as two-dimensional spatial information. Preferably, it may be a two-dimensional GIS DB created by the organization managing the underground pipeline, or may be a two-dimensional GIS DB created by the National Geographic Information Institute or another organization in addition to the management organization. The pipeline information DB 41 may be constructed in various forms. It may be a CAD file, a shape file (eg, Esri Shape, etc.), or may be constructed in other unspecified form.

Next, the terrain information DB 42 is geographic information representing the terrain information in three dimensions.

The terrain information DB 42 includes contours, digital elevation models (DEM), digital terrain models (DTM), digital elevation models (DSM), and irregular triangular networks (TIN, Triangular). It can be constructed in various forms such as Irrgular Network).

Next, the augmented reality representation method for the management of the underground pipeline considering the elevation difference according to an embodiment of the present invention will be described in more detail with reference to FIGS. 3 and 4. The augmented reality representation method of the underground pipeline according to the present invention is a method performed by a server-client system consisting of the client 20 and the augmented reality server 30.

As shown in Figure 3, first, the current position is measured to calculate the current position coordinates and attitude (S10).

That is, the current position is measured by the position sensor 16 of the smart terminal 10 to calculate the current position coordinates. At this time, the current position is regarded as the position of the smart terminal 10. As described above, the smart terminal 10 includes a position detecting sensor 16 that detects a position such as a GNSS sensor or a GPS sensor. The position measured by the position sensor 16 is regarded as the current position and the current position coordinate is calculated. The position coordinate at this time is a two-dimensional coordinate.

In addition, the current posture (or posture of the smart terminal) is calculated using the motion sensor 14 of the smart terminal 10. The motion sensor 14 is composed of a GNSS sensor, a compass, a magnetic field, an inertial system, a gyro sensor, an acceleration sensor, and the like. From these sensors, the attitude | position, such as which direction the smart terminal 10 is facing, is grasped | ascertained. When the posture of the smart terminal 10 is measured, a direction (or a viewpoint) viewed by the camera 11 of the smart terminal 10 may be known.

For example, a gyro sensor can be used to obtain rotation values about three axes. In addition, an accelerometer can be used to obtain acceleration values for three axis directions. Roll φ for the x-axis direction, pitch θ for the y-axis rotation, and yaw ψ for the z-axis rotation. Compass, gyro sensor and accelerometer can be used to calculate the camera's posture roll, y-axis pitch, and z-axis yaw.

Next, the terrain information and pipeline information within a predetermined range from the current location is extracted (S20).

That is, the terrain information and the pipeline information within a predetermined range in the current position coordinates calculated above are taken from the database 40. Preferably the range is set to a radius. An area within a predetermined radius of the current position coordinate is set as the range.

Preferably, in consideration of the direction of the camera 11 of the smart terminal 10, the topographic information and the conduit information in the range of the direction in which the camera 11 is directed are extracted. That is, the information of the range which the camera 11 does not face may not be brought beforehand.

In this case, the range may be set by a user input.

In addition, the pipeline information is geographic information in which the object space information of the underground pipeline is displayed in two dimensions. Preferably, the pipeline information is a collection of two-dimensional linear objects. The linear object stores two-dimensional spatial information and attribute information of each node. Two-dimensional spatial information of nodes consists of longitude and latitude, or x and y coordinates on a map, and attribute information stores depth of each node.

4 shows pipeline information consisting of four linear objects.

The pipeline information consists of a number of nodes composed of location coordinates and depth. That is, the pipeline information does not represent each position of the continuous pipeline. Each node represents a spaced space from each other.

In the example of FIG. 4, each node of the underground passage is N ₁ , N ₂ , N ₃ , N ₄ . Through the pipeline information, the x-coordinate, y-coordinate, and depth of each node can be extracted. The x coordinate of the i th node is expressed by x _i , the y coordinate is represented by y _i , and the depth is represented by d _i . At this time, the depth d _i represents the distance from the ground surface.

Therefore, each node of the underground pipeline can be expressed as follows.

[Equation 1]

N _i (x _i , y _i , d _i )

Here, (x _i , y _i ) is the position coordinate of the node N _i , and d _i represents the depth.

Next, the terrain information is geographic information that displays the terrain in three dimensions. As described above, the terrain information may be constructed in various forms such as contour, DEM, DTM, DSM, and TIN.

5 shows three-dimensional terrain information represented by the contour line C. FIG. Fig. 5A is a contour line and Fig. 5B shows a terrain that can be calculated from the contour line. That is, when the interpolation method is applied to the contour line, three-dimensional topographic information at all positions can be calculated from the three-dimensional topographic information of FIG. 5 (a) as shown in FIG. 5 (b).

Therefore, the 3D terrain information can extract the location and altitude as follows.

[Equation 2]

P _i (x _i , y _i , h _i )

Here, (x _i , y _i ) is the position coordinate of the specific position P _i , and h _i represents the altitude or surface elevation of the position.

Next, the terrain information is applied to the pipeline information to generate a three-dimensional pipeline object (S30).

Using topographic information and pipeline information, three-dimensional position of underground pipeline is calculated and three-dimensional spatial object is constructed.

At this time, first, the three-dimensional position at each node of the pipeline information is obtained.

As in the above example, the case in which the pipeline information is composed of four nodes will be described.

The depth of the underground passage at the i-th node N _i and the elevation in the corresponding terrain information are as follows.

N _i (x _i , y _i , d _i ), P _i (x _i , y _i , h _i )

From this, the three-dimensional position Q (x, y, z) at the i th node (x _i , y _i ) is calculated as in the following equation.

[Equation 3]

Q (x, y, z) = (x _i , y _i , h _i -d _i )

Here, (x _i , y _i ) represents the position of the node, d _i represents the depth of the node N _i , h _i represents the altitude at the position (x _i , y _i ) in the terrain information.

Then, the three-dimensional position Q (x, y, z) of each node is interpolated to generate a three-dimensional object representing all (or continuous) pipelines. Preferably, interpolation or the like is used to create a continuous three-dimensional duct object from multiple nodes. In particular, a continuous three-dimensional pipeline object is generated by obtaining continuous pipeline coordinates from a plurality of nodes using interpolation and obtaining a three-dimensional pipeline object from the obtained coordinates.

Next, the camera viewpoint of the smart terminal 10 is calculated (S40).

The absolute view of the camera 11 of the smart terminal 10, that is, the direction and position of the camera view, is calculated.

First, when the attitude of the smart terminal 10 is obtained in advance, the attitude of the camera 11 installed in the terminal can also be obtained. In addition, the plane equation and the plane normal vector of the CCD (Charge-Coupled Device) device in which the image of the camera 11 is formed by using a roll, pitch, and yaw to determine the posture of the camera 11. Can be obtained.

If p is a plane formed by the smart terminal 10 (a plane of the front or rear of the terminal), p, a, b, and c are obtained as a normal vector of the plane in the plane equation ax + by + cz + d = 0. Line l passing through the camera 11 perpendicular to the smart terminal 10 because the a, b, c unknown in the plane equation and the three-dimensional coordinates (xs, ys, zs) of the smart terminal 10 are known. The equation for the straight line can be found as

[Equation 4]

Such a normal vector will be referred to as a direction vector (or direction) of a camera viewpoint.

In addition, the altitude of the smart terminal 10 can be calculated using the value of the machine height (machine height) input by the user and the three-dimensional terrain information. That is, the height on the ground is input and the altitude value corresponding to the current position is extracted from the 3D terrain information. The sum of these calculates the altitude of the smart terminal 10. This is called the altitude of the camera point of view.

In addition, the two-dimensional position of the camera viewpoint is the same as the two-dimensional position coordinates of the smart terminal 10 obtained above. Hereinafter, the position of the camera viewpoint is a three-dimensional position, and will be described as including a two-dimensional position and an altitude.

Meanwhile, when the surface elevation of the smart terminal 10 is h _o and the machine height is a, the relative altitude Δh from the smart terminal 10 to the i th node can be obtained by the following equation.

[Equation 5]

Next, a two-dimensional projection image according to the viewpoint of the smart terminal 10 to generate a three-dimensional pipeline object (S50).

As shown in FIG. 7, a 2D projection image is obtained by projecting a 3D duct object onto a 2D plane (CCD plane) around a camera viewpoint.

In this case, a two-dimensional plane (CCD plane) on which the pipeline object is projected will be referred to as a projection plane or a two-dimensional projection plane.

7 illustrates a process of projecting a projection plane about a camera viewpoint with respect to an arbitrary three-dimensional node Q _i (x _i , y _i , d _i ).

From the camera's viewpoint coordinates (xs, ys, zs) to the direction vectors (a, b, c) of the camera's viewpoint, the principal coordinates and plane equations of the CCD film spaced by the focal length f can be obtained, as shown in FIG. . The projection plane is obtained by the above plane equation. The principal point coordinate is called the center of the projection plane.

That is, the plane of the CCD film spaced apart by the focal length f on the opposite side to the three-dimensional pipeline object around the camera's viewpoint coordinates (xs, ys, zs) is set as the projection plane. The 3D duct object is projected on the projection plane in point symmetry around the camera viewpoint.

Equation li of a straight line connecting the three-dimensional node Q _i (x _i , y _i , d _i ) of the duct object with the camera viewpoint can be calculated by the equation shown in FIG. Using the plane equation of the projection plane and the equation li of the straight line, the parameter equation can be used to determine where the three-dimensional nodes Q _i (x _i , y _i , d _i ) are projected onto the projection plane. Since the parametric equation solving is a well-known technique, a detailed description thereof will be omitted.

Next, the image projected on the projection plane is augmented and displayed on the front image (S60).

That is, the projection plane obtained in the previous step and the front image photographed through the camera 11 are synthesized and displayed on the display 12 of the smart terminal 10.

An example implemented by the present invention will be described with reference to FIG.

The present invention accurately represents the underground pipeline at its three-dimensional location. That is, when the ground surface and the actual pipeline are the same as those of FIG. 8, the underground pipeline represented only by the depth of the starting point and the end point is expressed differently from the actual pipeline. When the smart terminal looks at the worker, the worker and P1 appear in the same position on the screen of the smart device under the same conditions. However, in the case of the prior art [Patent Document 4], it is understood that the operator and p3 appear in the same position on the smart terminal screen under the same conditions. However, since p3 is an underground pipeline expressed only in depth, the expression of p3 point on the screen should be expressed as p3 'on the screen.

Therefore, the present invention requires the absolute height of the pipeline in order to represent the augmented reality in accordance with the height of the underground pipeline. In particular, since the present invention expresses a pipeline object of an absolute three-dimensional position, it is expressed at a position buried underground, not at the surface. On the other hand, even when the surface is expressed as in the prior art, even the depth information is not necessary. That is, it can be expressed with only x and y coordinates. In the case of expressing on the ground surface, both p1 and p2 will be represented at the position of the operator on the screen of the smart terminal under the conditions as shown in FIG. 8.

That is, in the present invention, because it is expressed in the position buried underground, rather accurate position is required. If only the depth information is used, the height difference of the ground surface cannot be reflected, and p3 is expressed at the position of the worker on the screen of the smart device under the conditions as shown in FIG. 8. In practice, however, p3 'must be expressed in the worker's position, so the altitude of the underground pipe must be found.

On the other hand, the three-dimensional spatial object of the underground pipeline is created using the existing two-dimensional spatial information. The two-dimensional spatial information includes the x- and y-coordinates of the pipeline and can be regarded as a two-dimensional spatial object by itself. The depth is included in the attribute information of the spatial object. The three-dimensional topographic information can be used to obtain the elevation of the ground surface on which the pipeline is located. By subtracting the depth from the altitude of the surface, we can get the altitude of the pipeline. That is, the x- and y-coordinates of the pipeline can be obtained through the previously constructed two-dimensional spatial information, and the z-coordinate of the pipeline can be obtained using the attribute information of the pipeline and the three-dimensional topographic information.

As mentioned above, although the invention made by this inventor was demonstrated concretely according to the said Example, this invention is not limited to the said Example and can be variously changed in the range which does not deviate from the summary.

10: smart terminal 11: the camera
12 display 13 input device
14: motion sensor 15: communication unit
16: position sensor 18: central processing unit
20: Client 30: Augmented Reality Server
40: database 41: pipeline information DB
42: terrain information DB 80: network

Claims (6)

In the augmented reality representation method for management of the underground pipe channel considering the elevation difference, which is performed by a system comprising a client installed in the smart terminal and the server connected to the smart terminal network,
(a) measuring the position (hereinafter, present position) and posture of the smart terminal;
(b) extracting three-dimensional topographic information within a predetermined range from the current location and two-dimensional pipeline information including the location and depth of the pipeline;
(c) generating three-dimensional pipeline objects by applying three-dimensional terrain information to the two-dimensional pipeline information;
calculating a position and a direction of a camera viewpoint of the smart terminal;
(e) generating a two-dimensional projection image projecting the three-dimensional duct object based on the camera viewpoint using the calculated position and direction of the camera viewpoint; And,
and (f) synthesizing and displaying the projection image on the front image photographed by the camera of the smart terminal.
The method of claim 1,
In the step (c), extracting the position of the node N _i of the underground pipeline (x _i , y _i ) and the depth of the d _i from the pipeline information, and extract the altitude h _i of the node N _i from the terrain information And calculating the three-dimensional position of the node N _i as (x _i , y _i , h _i -d _i ).
The method of claim 1,
The pipeline information is composed of a plurality of nodes, each node has a position spaced apart from each other with a predetermined interval,
In the step (c), by using the interpolation method to obtain a continuous pipe coordinates from a plurality of nodes, by obtaining a three-dimensional pipe object from the obtained coordinates, taking into account the elevation difference, characterized in that to create a continuous three-dimensional pipe object Augmented Reality Representation Method for Management of Underground Pipeline.
The method of claim 1,
In step (d), a normal line perpendicular to the plane of the smart terminal is obtained from the posture of the smart terminal to obtain a direction of the camera viewpoint, and the sum of the altitude of the machine height received from the user and the current position extracted from the 3D terrain information Obtaining the altitude of the smart terminal, and the current position and the position of the camera viewpoint with the altitude of the smart terminal, the augmented reality representation method for the management of the underground pipeline considering the elevation difference.
The method of claim 1,
In the step (e), the plane spaced apart by the focal length on the opposite side of the three-dimensional pipeline object with respect to the camera viewpoint as the projection plane, and the three-dimensional pipeline object on the projection plane around the camera viewpoint An augmented reality representation method for the management of underground pipelines considering elevation difference.
A computer-readable recording medium having recorded thereon a program for performing the method of any one of claims 1 to 5.

Images