KR102276659B1 - Method for displaying facility through augmented reality using geospatial information - Google Patents

Abstract

According to an embodiment of the present invention, an apparatus for providing augmented reality for a river facility includes: an information collection unit for collecting location information and direction information of the user terminal from the user terminal, and image information about the river facility; Access the river facility information storage medium, search for and identify the river facility based on the location information, the orientation information, and the image information received from the information collection unit, and 3D model information and attributes for the river facility an information retrieval unit for retrieving information; an information matching unit that matches the 3D model information and the attribute information received from the information search unit with the image information; an augmented reality providing unit for synthesizing the image information, the 3D model information, and the attribute information and providing the image information in the form of augmented reality; And a display device for displaying information in the form of augmented reality provided through the augmented reality providing unit, and the viewpoint of displaying the 3D model information is changed according to a signal input through the display device.

Description

Augmented reality expression method of hydrophilicity and flood control facilities using river spatial information {METHOD FOR DISPLAYING FACILITY THROUGH AUGMENTED REALITY USING GEOSPATIAL INFORMATION}

The present invention relates to a method of displaying hydrophilic and water-reducing facilities, and more particularly, to an augmented reality expression method of water-repellent and water-reducing facilities using river spatial information.

Recently, as various river projects such as the national river project, river environment project, and expansion of riverside waterfront space and the utilization of river spatial information are increasing, it is necessary to develop a new paradigm of river information provision technology suitable for the information age.

In particular, it is necessary to break away from the supplier-centered, simple information provision method based on the existing 2D map, and to develop service technology to increase the popularity and utility of river information and experience/promotion.

However, existing river-related systems such as RIMGIS simply provide information such as the basic plan report, so there is a limit for general consumers to use, and most DB systems are configured to be used only by relevant departments and local governments.

In addition, as it is built around administrative work, practical use is limited (spatial/attribute information linkage is insufficient, and GIS spatial data is provided based on images, so it is insufficient in terms of utilization), and in the case of WAMIS data, missing parts and different locations are found. Also, there is a limit to showing the latest status in the update part.

Korean Patent Publication No. 2006-0006467 (Jan. 19, 2006)

It is an object of the present invention to provide a method for expressing water-friendly and water-retention facilities in augmented reality by using existing river spatial information without building a separate database.

Another object of the present invention is to provide an augmented reality expression method for hydrophilic and dimensional facilities that can be easily used through mobile devices such as smartphones or tablets.

Further objects of the present invention will become more apparent from the following detailed description and drawings.

According to an embodiment of the present invention, an apparatus for providing augmented reality for a river facility includes: an information collection unit for collecting location information and direction information of the user terminal from the user terminal, and image information about the river facility; Access the river facility information storage medium, search for and identify the river facility based on the location information, the orientation information, and the image information received from the information collection unit, and 3D model information and attributes for the river facility an information retrieval unit for retrieving information; an information matching unit that matches the 3D model information and the attribute information received from the information search unit with the image information; an augmented reality providing unit for synthesizing the image information, the 3D model information, and the attribute information and providing the image information in the form of augmented reality; And a display device for displaying information in the form of augmented reality provided through the augmented reality providing unit, and the viewpoint of displaying the 3D model information is changed according to a signal input through the display device.

According to an embodiment of the present invention, there is provided a method for providing augmented reality for a river facility, the method comprising: collecting location information and direction information of a user terminal, and image information about the river facility; accessing a river facility information storage medium, searching for and identifying the river facility based on the location information, the orientation information, and the image information, and searching 3D model information and attribute information for the river facility; matching the 3D model information and the attribute information with the image information; synthesizing the image information, the 3D model information, and the attribute information and providing the image information in the form of augmented reality; And including the step of displaying the augmented reality information provided through the augmented reality providing unit, according to the signal input through the user terminal, the perspective of the display of the three-dimensional model information changes.

According to an embodiment of the present invention, it is possible to express the hydrophilic and water-retention facilities in augmented reality by using the public river spatial information. In addition, augmented reality of hydrophilic and dimensional facilities can be easily used through mobile devices such as smartphones or tablets.

1 is a diagram schematically showing an apparatus for providing augmented reality for a river facility according to an embodiment of the present invention.
FIG. 2 is a diagram schematically illustrating the information providing apparatus shown in FIG. 1 .
3 is a flowchart schematically illustrating a method for providing augmented reality for a river facility according to an embodiment of the present invention.
4 and 5 are diagrams showing a result of providing augmented reality for a river dimension facility.
6 and 7 are diagrams showing the augmented reality provision result for the river friendly facility.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying FIGS. 1 to 7 . Embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be construed as being limited to the embodiments described below. These examples are provided to explain the present invention in more detail to those of ordinary skill in the art to which the present invention pertains. Accordingly, the shape of each element shown in the drawings may be exaggerated to emphasize a clearer description.

1 is a diagram schematically illustrating an apparatus for providing augmented reality for a river facility according to an embodiment of the present invention. As shown in FIG. 1 , the augmented reality providing apparatus includes a user terminal 100 , a river facility information storage medium 200 , a river facility information providing apparatus 300 , and a display device 400 .

The user terminal 100 collects information on river facilities and provides the information to the river facility information providing device 300 . The information on the river facility includes an image or location of the river facility, and the location of the river facility may mean location information and azimuth information of the user terminal 100 . A river facility may be a flood control facility such as an embankment or a shoreline, or it may be a water-friendly facility such as a park, swimming pool, or bicycle path.

Specifically, the user terminal 100 is a location information acquisition means such as GPS that can determine the current location, image information acquisition means such as a stereo camera capable of acquiring an image of a river facility, and from the location of the user terminal 100 . A direction information obtaining means capable of obtaining the direction of the river facility may be provided.

The river facility information storage medium 200 stores information collected in advance in relation to the river facility. Information on river facilities may include history, use, function, shape, attribute, scale, local government, and the like.

Specifically, various ministries such as the Ministry of Land, Infrastructure and Transport and the Ministry of Environment provide river spatial information as follows, and the river facility information storage medium 200 may be one or more of the following databases or a database for storing information retrieved from the following databases.

① WINS (Water Management Information Distribution System)

A system established to jointly utilize water resource information of 5 ministries and 12 water-related organizations on-line

- WAMIS (National Water Resources Management Comprehensive Information System), RIMGIS (Stream Management Geographic Information System), GIMS (National Water Resources Information Center), National Waterworks Information System, RAWRIS (Rural Water Resources Comprehensive Information System), Water Environment Information System, Korea Water Resources Association , Rural Development Administration, CCTV system, etc. water information related sites are linked with a link

② WAMIS (National Water Resources Management Comprehensive Information System)

Geospatial information serviced by WAMIS is divided into water resource unit map, water resource subject system, watershed subject system and analysis subject system, providing 72 geospatial information services in 19 items.

- The main users are policy makers, policy makers, water resources related workers, and general citizens.

- Internet-based portal system, service with shape file and raster file

③ RIMGIS (River Management Geographic Information System)

- A system developed by the Ministry of Land, Infrastructure and Transport to support efficient and systematic river management by establishing spatial information and related information on national rivers across the country.

- Provide spatial information for 23 points, 22 lines, and 53 polygons

- Provide information through standardization and computerization of river information and support various tasks related to rivers

④ KORIMIS (National River Maintenance System)

- 3D image GIS-based river management system built for systematic management and maintenance of continuously changing data for national rivers nationwide

- It is operated in conjunction with the RIMGIS website and is operated for the purpose of establishing an efficient river business support system, scientific site access and publicity effect, and monitoring before and after the four major rivers project

The river facility information providing apparatus 300 may identify the river facility based on the information provided from the user terminal 100 . Specifically, the information providing apparatus 300 may identify the river facility based on the location information, the orientation information, and the image information of the user terminal 100 .

In addition, the information providing device 300 may generate an icon according to the identified properties of the river facility, and synthesize the icon with the image information of the corresponding river facility through the display device 400 to provide it in the form of augmented reality. Alternatively, an icon according to the properties of the river facility may be generated in advance and stored in the river facility information storage medium 200 .

In addition, when the user selects the corresponding icon, for example, when the user touches the corresponding icon through the touch screen display device 400 , the information providing device 300 is the display device Through 400 , the 3D model information and attribute information for the corresponding icon can be synthesized with the image information of the corresponding river facility and provided in the form of augmented reality, and the user manipulates the 3D model through the display device 400 to It is possible to check the shape of river facilities from various angles (the viewpoint from which the three-dimensional model is displayed is different). The 3D model information or attribute information may be stored in the river facility information storage medium 200 .

In this way, the information providing device 300 provides the river facility information in the form of augmented reality, thereby effectively recognizing the information on the river facility.

The display device 400 may display river facility information in the form of augmented reality provided by the information providing device 300 , specifically, image information of a river facility, an icon, 3D model information, and attribute information, and the like. 400 may be provided through the user terminal 100 or may be provided separately from the user terminal 100 .

FIG. 2 is a diagram schematically illustrating the information providing apparatus shown in FIG. 1 . As shown in FIG. 2 , the information providing apparatus 300 includes an information collection unit 310 , an information search unit 320 , an information matching unit 330 , and an augmented reality providing unit 340 .

The information collection unit 310 combines information provided from the user terminal 100 , and specifically, the information collection unit 310 combines the location information, orientation information, and image information of the user terminal 100 to obtain an information search unit. forward to (320). The information search unit 320 searches for river facilities in the river facility information storage medium 200 based on the corresponding information, and can identify the river facilities through this process.

In addition, the information search unit 320 searches the river facility information storage medium 200 for icons or 3D model information/attribute information for the identified river facilities, and the information matching unit 330 searches for the identified river facilities. Matches image information, etc. with searched icons, 3D model information/attribute information, etc.

The augmented reality providing unit 340 may provide the corresponding icon in the form of augmented reality by synthesizing the corresponding icon with the image information of the corresponding river facility through the display device 400, and when the user selects the corresponding icon, the display device 400 is displayed. Through this, 3D model information and attribute information of the corresponding icon can be synthesized with image information of the corresponding river facility and provided in the form of augmented reality.

3 is a flowchart schematically illustrating a method for providing augmented reality for a river facility according to an embodiment of the present invention.

First, the information providing device 300 collects information on the river facilities from the user terminal 100 (S100), and the information on the river facilities includes images or locations of the river facilities, and the location of the river facilities is determined by the user. It may mean location information and orientation information of the terminal 100 .

The information providing apparatus 300 identifies the river facility based on the information provided from the user terminal 100 (S110). Specifically, the information collection unit 310 combines the location information, orientation information, and image information of the user terminal 100 and transmits the combination to the information search unit 320 . The information search unit 320 searches for river facilities in the river facility information storage medium 200 based on the corresponding information, and can identify the river facilities through this process.

In addition, the information search unit 320 searches the river facility information storage medium 200 for an icon or three-dimensional model information/attribute information for the identified river facility (S120), and the information matching unit 330 is the identified The image information of the river facility is matched with the searched icon, 3D model information/attribute information, etc. (S130).

The augmented reality providing unit 340 may provide the corresponding icon in the form of augmented reality by synthesizing the corresponding icon with the image information of the corresponding river facility through the display device 400, and when the user selects the corresponding icon, the display device 400 is displayed. Through this, 3D model information and attribute information of the corresponding icon can be synthesized with image information of the corresponding river facility and provided in the form of augmented reality (S140).

In addition, the information providing device 300 calculates the distance from the user terminal 100 to the corresponding river facility by using the location information among the location information of the user terminal 100 and the attribute information of the river facility, and displays it It can be provided through (400).

4 and 5 are diagrams showing a result of providing augmented reality for a river dimension facility. As shown in FIG. 4 , icons for a plurality of river irrigation facilities may be displayed, and when one icon is selected, shape information and attribute information for the corresponding irrigation facilities may be displayed together. Specifically, as shown in FIG. 5 , the shape information for the corresponding dimensioning facility is displayed as a three-dimensional model, and the user can check the shape from various angles by manipulating the three-dimensional model. In addition, image information of the corresponding water-measuring facility may be displayed together with the shape information.

6 and 7 are diagrams showing the augmented reality provision result for the river friendly facility. As shown in FIG. 6 , icons for several water-friendly facilities may be displayed, and when one icon is selected, the location of the user (or user terminal) is displayed on a mini-map along with attribute information on the corresponding water-friendly facility. can indicate Specifically, as shown in FIG. 7 , an icon may be displayed in augmented reality form along with image information about the corresponding hydrophilic facility, a mini map of the user's location is displayed at the upper right corner, and the corresponding hydrophilic facility is displayed at the lower right corner. Property information about the facility is displayed.

Although the present invention has been described in detail through preferred embodiments, other types of embodiments are also possible. Therefore, the spirit and scope of the claims set forth below are not limited to the preferred embodiments.

Claims (2)

an information collection unit that collects location information and orientation information of the user terminal from the user terminal, and image information on river facilities;
Access to a plurality of river facility information storage media, search for and identify the river facility based on the location information, the orientation information, and the image information received from the information collection unit, and 3D model information for the river facility and an information retrieval unit for retrieving attribute information.
an information matching unit that matches the 3D model information and the attribute information received from the information search unit with the image information;
an augmented reality providing unit for generating an icon according to the attribute information of the river facility, synthesizing the image information of the river facility, and synthesizing the image information, the three-dimensional model information, and the attribute information in an augmented reality form; and
and a display device for displaying the icon provided through the augmented reality providing unit and information in the form of augmented reality,
The augmented reality providing unit changes an angle for displaying the 3D model information according to a signal input through the display device,
The augmented reality providing unit for calculating the distance from the user terminal to the river facility based on the location information included in the location information of the user terminal and the attribute information of the river facility, the augmented reality providing apparatus of the river facility. collecting image information on the location information and orientation information of the user terminal and river facilities through the information collection unit;
Access the river facility information storage medium through the information retrieval unit, search and identify the river facility based on the location information, the orientation information, and the image information, and search 3D model information and attribute information for the river facility to do;
matching the 3D model information and the attribute information with the image information through an information matching unit;
Through the augmented reality providing unit, an icon is created according to the attribute information of the river facility and synthesized with the image information of the river facility, and the image information, the 3D model information, and the attribute information are synthesized and provided in the form of augmented reality to do; and
Comprising the step of displaying the information in the form of the icon and augmented reality provided through the augmented reality providing unit,
The augmented reality providing unit changes the angle for displaying the 3D model information according to the signal input through the display device,
The augmented reality providing unit for calculating the distance from the user terminal to the river facility based on the location information included in the location information of the user terminal and the attribute information of the river facility, the augmented reality providing method of the river facility.

Images