KR102387090B1 - Rivers information providing system using 3d virtual space - Google Patents

Abstract

The present invention relates to a river information providing system utilizing a three-dimensional virtual space, and more particularly, including an image of a river including an embankment to be measured (especially an area where flood damage continuously occurs), water level, temperature, and humidity. It collects environmental information and hyperspectral image from the sky and combines 3D virtual reality to analyze information about the river condition and predict the possibility of flooding, and provide intuitive information and risk situation to the river management subject And it relates to a river information providing system using a three-dimensional virtual space to provide information to the local residents.

Description

River information providing system using 3D virtual space {RIVERS INFORMATION PROVIDING SYSTEM USING 3D VIRTUAL SPACE}

The present invention relates to a river information providing system utilizing a three-dimensional virtual space, and more particularly, including an image of a river including an embankment to be measured (especially an area where flood damage continuously occurs), water level, temperature, and humidity. It collects environmental information and hyperspectral image from the sky and combines 3D virtual reality to analyze information about the river condition and predict the possibility of flooding, and provide intuitive information and risk situation to the river management subject And it relates to a river information providing system using a three-dimensional virtual space to provide information to the local residents.

In general, a river (河川, stream, river) means that water supplied to the surface through precipitation forms a constant waterway and flows down the inclined surface, and a certain waterway constituting a river is a channel A low valley formed by or flowing by a river is called a river valley, and the bottom part of a river made of rocks or soil is called a riverbed.

The resistance to flow in natural rivers where the material of the river bed or embankment is mainly composed of sand and gravel, or in vegetative rivers where vegetation such as grass, shrubs and trees is scattered on the floodplain and embankment. It causes a change in flow rate according to vegetation and river bed data on embankments and webbeds.

On the other hand, the dyke (堤防) means an artificial facility to prevent the natural (property) distribution of water, and the contents are the meaning of the system for storing water and the meaning of the system for waterproofing (防水). It has two meanings and functions.

Embankment refers to a general river embankment according to the River Management Act among the above two meanings and functions. It refers to a facility built to prevent floods from being lost or buried, and it is a generic term for reservoirs, seawalls, and large and small rivers.

Such embankments are usually piled wide enough so that flowing rivers do not permeate or erode them at a high water level, and as shown in the accompanying drawings FIG. protect against erosion by

It is essential to secure the stability of the reservoir embankment against the occurrence of unpredictable natural disasters such as earthquakes. In particular, the occurrence of cracks due to earthquakes can cause secondary damage such as bank collapse. In Korea, as strong earthquakes occurred in Gyeongju in September 2016 and Pohang in November 2017, smart ground and structure management is required. In particular, investigation and monitoring using cutting-edge equipment and new ICT convergence technology are required for the advancement of structure management. It has been more than 30 years since 16,700 reservoirs, 95% of which are currently located in the country, were built, and among them, reservoirs that are more than 50 years old are at increased risk of leakage. However, it was found that there are limits to practical safety management such as maintenance, repair, reinforcement, and precise safety diagnosis of disaster-risk reservoirs due to lack of budget.

In particular, in the Gyeongbuk region, there are 479 old reservoirs that are more than 50 years old in the province, so the possibility of secondary damage after an earthquake is very high. In addition, after the Pohang earthquake, shear cracks in embankments, drainage facilities, and waterproofing channels, leaks, and operation status of water intake facilities were intensively analyzed, targeting 126 disaster-prone reservoirs within a 50km radius of the epicenter and reservoirs of 100,000 tons or more. is difficult to accurately analyze.

In the river including the embankment as described above, after a disaster event, such as an earthquake or flood, the manager periodically visits the embankment and visually checks whether damage has occurred to the construction structure. Since there are limitations, recently, the current ecology is analyzed by remotely monitoring the embankment through sensors and/or aerial photos.

As a prior art related to the monitoring of rivers including such embankments, Korean Patent No. 10-1204426 (hereinafter referred to as Document 1) and Korean Patent Publication No. 10-1881822 (hereinafter referred to as Document 2) are examples. can

At this time, in Document 1, since the measuring means (measurement sensor) is buried in the flood control facility to measure the change in the slope of the flood control facility when the flood control facility begins to collapse, it is inevitable to recognize the risk at the time of collapse or immediately before the collapse occurs. There is this.

In addition, since the measuring means is buried in the irrigation facility, the measuring means is lost or damaged when it collapses, so there is a problem in that it is impossible to repeatedly use the measuring means, and thus there is a problem in that the maintenance cost is high.

On the other hand, the document 2 is a method of collecting and analyzing information on the surface material (low water level) of the reservoir including the embankment through aerial photography. There is a problem of low precision or accuracy as well as limitations of information analysis on the reservoir including.

Examples of documents in the prior art related to the information monitoring system for rivers including embankments as described above are as follows.

Document 1: Republic of Korea Patent Publication No. 10-1204426 (Title: Planar change analysis system and method of river using aerial photography and GIS; filing date: July 20, 2012)

Document 2: Republic of Korea Patent Publication No. 10-1881822 (Title: A method of measuring the freshwater capacity of a reservoir using an aerial photograph; filing date: September 12, 2017)

The present invention was created to solve the problems of the prior art as described above, and the image of a river (especially an area where flood damage continuously occurs) including an embankment to be measured, and environmental information including water level, temperature and humidity, and the sky By collecting hyperspectral image information and combining 3D virtual reality, it analyzes information about the river condition and predicts the possibility of flooding, and provides intuitive information and risk situations to the river management entity and surrounding residents. It aims to provide a river information provision system using a three-dimensional virtual space designed to provide information.

The present invention for achieving the above object collects topographic information including spectral image information and RGB image information in the air above the river including the embankment to be measured, while the actual image, water level, and temperature on the ground or water of the relevant embankment and river And after collecting environmental information including humidity, and analyzing the presence or absence of abnormalities or abnormal changes in the shooting area through an information analysis algorithm and program, the topographic information and environment information are used to implement a 3D virtual space through a 3D virtual space algorithm or program However, the presence or absence or abnormality of the analyzed shooting area is matched with the 3D virtual space to be informatized into a 3D processing space, and the management computer system 200 of the river management subject including the embankment through the communication network and the individual of each local residents It is characterized in that the river information providing system 100 for transmitting to the communication terminal (300).

In the present invention, the river information providing system 100 collects spectral image information and RGB image information while navigating a river including an embankment to be measured by an automatic navigation device, and whether there is an abnormality or abnormal change through a spectral image analysis algorithm and program a topographic information collecting device 110 that analyzes and converts the data into information, and collects RGB image information in proximity to an area with an abnormality or change as a result of the analysis; an environmental information collecting device 120 installed along a river including a levee to be measured and configured to collect an actual image and environmental information including water level, temperature and humidity; Spectral or RGB image information and analysis information transmitted while setting or remote control of the navigation route of the geographical information collecting device 110 and the environmental information collected by the environmental information collecting device 120 are analyzed using an information analysis algorithm and program. an operation analysis device 130 for storing and outputting after a final analysis of the presence or absence of abnormalities or abnormal changes in the photographing area; A 3D virtual space is implemented through a 3D virtual space algorithm or program using the topographic information of the topographic information collection device 110 and the environment information of the environment information collection device 120, but the shooting area analyzed by the operation analysis device 130 a 3D virtual space realizing device 140 that matches and outputs the presence or absence of abnormality or abnormal changes in the 3D virtual space; The information data analyzed by the operation analysis device 130 and the 3D virtual space image implemented in the 3D virtual space realization device 140 are transferred to the management computer system 200 of the central management control center of the river management body including the embankment through the communication network and The display device 210 distributed in the embankment or river area and the communication device 150 for transmitting to the personal communication terminal 300 of each of the local residents; It is characterized in that it includes.

The terrain information collection device 110 of the present invention is an airship or a drone, comprising: a battery for power supply; flight driving unit; GPS unit providing current location information; a photographing unit for photographing spectral and RGB image information; a storage unit for storing the photographed image information; Communication unit for communication connection with the operation analysis device (130); Controls the operation of the flight driving unit to move according to the coordinates transmitted from the operation analysis device 130 or the satellite through the automatic navigation program, controls the operation of the photographing unit that collects the spectral or RGB image information, a spectral image analysis algorithm and Analyze the presence or absence of abnormality or abnormal change for the spectral image information collected by the photographing unit through the program, and control the flight driving unit and the photographing unit to collect RGB image information by moving close to the corresponding coordinates if there is abnormality or change occurrence information and a control unit for controlling the operation of the communication unit to store the spectral or RGB image information and analysis information in the storage unit, while transmitting the spectral or RGB image information and analysis information to the operation and analysis device 130 .

The spectral image analysis algorithm and program of the topographic information collecting device 110 of the present invention includes: a ground reference point surveying part for surveying a ground reference point set for measuring coordinate accuracy of a photographing area; a data processing part for performing image registration processing on the captured spectral image or RGB image according to the ground reference point for coordinate accuracy of the photographing area; a data analysis and mapping part that analyzes the data processed in the data processing part and maps it to a map; and a crack mapping part for mapping the degree of cracking (length/width/depth, etc.) of the imaging area so that state profiling of the photographing area is possible not only in the longitudinal and lateral directions but also by depth. and an event output part for outputting an event generation signal according to the occurrence of abnormality or change in the photographing area mapped in the data analysis and mapping part, so that the photographing unit captures the RGB image.

The photographing unit of the topographic information collecting device 110 of the present invention includes: a hyperspectral sensor (hyperspectral camera) having spectral information characteristics in the ultraviolet and infrared regions for subdividing the visible and near-infrared wavelength bands into hundreds; and a digital camera including a DSLR for photographing the RGB image.

The environmental information collecting device 120 of the present invention is installed on the ground along the river including the embankment and includes a plurality of CCTV modules for shooting moving images and still images, a water level sensor installed on the water surface of the river to measure the water level, and the embankment. A temperature sensor installed on the ground and water along a river including the river to measure land and water temperature, a humidity sensor installed on the ground along a river including an embankment to measure the humidity around the river, and the measured or measured information for each time zone. It is characterized in that it includes a data logger that stores and manages and a network sensor that provides a communication path for wirelessly collecting and transmitting the measured or measured information.

The operation analysis device 130 of the present invention is a remote management device of the field, the operation communication unit for communication connection with the topographic information collection device 110 and the environment information collection device 120; a monitor unit for outputting information transmitted from the topographic information collection device 110 and the environment information collection device 120 and finally analyzed information; an operation storage unit for storing information transmitted from the topographic information collection device 110 and the environment information collection device 120 and finally analyzed information; Calculating and storing a coordinate value for a photographing area based on GPS information, while transmitting it to the topographic information collecting device 110, or remotely controlling the movement and operation of the topographic information collecting device 110, an information analysis algorithm and program The presence or absence or abnormal change is finally analyzed for the spectral or RGB image information and analysis information transmitted from the topographic information collection device 110 through the output device, and the spectral or RGB image information, analysis information, and final analysis information are output to the device. and an operation control unit for controlling the operation of the operation communication unit for communication connection with the topographic information collection device 110 and the environment information collection device 120 while outputting it through the operation storage unit and storing it in the operation storage unit.

The information analysis algorithm and program of the operation analysis device 130 of the present invention collects the spectral or RGB image information and analysis information transmitted from the topographic information collection device 110, converts it into an image and text, and outputs it to the monitor and stores the operation. data integration part to save as a copy; a change occurrence analysis part that determines whether abnormalities and changes occur in the photographing area from the integrated analysis data, and finally analyzes the cracks (length/width/depth, etc.) It is characterized in that it includes; an environmental evaluation part that inputs the final analysis information according to a preset table, processes it into environmental evaluation data for the shooting area, and provides it.

In the present invention, the 3D virtual space realization apparatus 140 includes a collection information DB for storing reference images and image images and SIFT descriptor data of the topographic information collection apparatus 110 and the environment information collection apparatus 120, and the The reference image of the space according to the shooting angle for each camera position of the geographical information collecting device 110 and the environmental information collecting device 120 is collected, and the shooting point of the video image collected by re-photographing of the indoor space is set according to the reference image Thus, an image collection module for storing in the collection information DB, analyzes the image image, sets SIFT descriptor data for each section in the image image according to the SIFT algorithm, and stores it in the collection information DB, and the intersection of neighboring image images Virtual spatial information including an image matching processing module that generates a virtual space image by matching a section based on the SIFT descriptor data, and stores it in the collection information DB, and a monitoring module that monitors the processing status of the image matching processing module management means; A search module for searching the collection information DB to retrieve necessary information, a data processing module for controlling execution of the image collection module, image matching processing module, and monitoring module, and outputting control status and inputting control information of the data processing module Image control means including a spatial image editing module for executing a dashboard for; It is characterized in that it includes.

The present invention by means of the above-mentioned problem solving means analyzes the spectral image taken by the hyperspectral sensor of the photographing unit provided in the topographic information collecting device 110 that flies along the movement path of the river including the embankment, the spectral image analysis algorithm and the program analyze Thus, when cracks or collapses are suspected in the embankment, when the RGB image is taken close-up by moving to the crack coordinates, and transmitted to the operation analysis apparatus 130 together with the spectral image and analysis information, the operation analysis apparatus 130 determines the terrain The information transmitted from the information collection device 110 is collected, and the spatial distribution of cracks or collapses generated in the embankment, which is a photographing area, is analyzed through the self-mounted information analysis algorithm and program, while the cross section of the embankment including the depth of the crack. By analyzing and converting into data, it is effective to improve the precision or accuracy of information analysis on levees. .

In addition, the present invention utilizes the ultraviolet and infrared characteristics, which are characteristics that cannot be confirmed with general RGB images, that is, characteristics that cannot be seen with the human eye, and multi-layered information collection and analysis is performed based on hyperspectral image information. This has the effect of enabling multi-dimensional, three-dimensional information collection and analysis of the state of the river including the levee through this, and through this, a wide range of information analysis on the river including the levee is possible.

In addition, the present invention utilizes the ultraviolet and infrared characteristics, which are characteristics that cannot be confirmed with general RGB images, that is, characteristics that cannot be seen with the human eye, and multi-layered information collection and analysis is performed based on hyperspectral image information. It has the effect of making it possible for the manager to analyze the distribution of cracks, depth, flood, drought, etc. without visually checking the river including the embankment.

In addition, the present invention enables quantitative investigation of the environment of rivers including embankments through improvement of precision and accuracy of analysis of river state information including embankments, which is a photographing area, and additional analysis scalability, as described above. It has the effect of allowing additional evaluation of the river environment including river environment evaluation and the possibility of disasters such as earthquakes and floods.

In particular, in the process of realizing the 3D virtual space in the 3D virtual space realization device 140, the present invention provides topographic information collected in real time or periodically by the topographic information collection device 110 and the environment information collection device 120, and By substituting and implementing changes in environmental information, change information on river conditions including embankments, such as bank subsidence or collapse, and the possibility of floods or droughts, is predicted, and information and risk situations are provided to the river management entity and surrounding residents. It has the effect of providing information quickly and intuitively through 3D virtual space images.

In addition, the present invention provides information on the river state including the embankment quickly and intuitively through a 3D virtual space image, so that the possibility of embankment subsidence or collapse and flood occurrence and the identification of the corresponding location is easily made, so that the initial response is made has the effect that it is done quickly and accurately.

1 is a photograph showing an example of an embankment.
Figure 2 is a system configuration diagram briefly showing the configuration of the present invention.
3 is a system block diagram showing the configuration of the present invention in more detail.
4 is a block diagram illustrating an example in which the topographic information collecting device of the present invention collects topographic information around a river, a spectral image, and an RGB image.
5 is a configuration diagram illustrating an example in which the environmental information collecting device of the present invention collects environmental information around a river.
6 is an exemplary diagram illustrating an example of setting a region to implement a 3D virtual space.
7 and 8 are virtual views showing an example of implementing a 3D virtual space.

Hereinafter, the present invention will be described with reference to the accompanying drawings presented as described above.

As shown in the accompanying drawings, the river information providing system utilizing the three-dimensional virtual space of the present invention collects topographic information including spectral image information and RGB image information in the sky including the embankment to be measured. On the other hand, after collecting actual images and environmental information including water level, temperature and humidity from the ground or water of the embankment and river, and analyzing the presence or absence of abnormalities or abnormal changes in the photographing area through an information analysis algorithm and program, the topographic information Realize 3D virtual space through 3D virtual space algorithm or program with environment information and 3D virtual space, but match the analyzed area of abnormality or abnormal change to the 3D virtual space to convert it into 3D processing space It includes a management computer system 200 of the river management subject, including a river information providing system 100 that transmits to the personal communication terminal 300 of each local resident.

Here, in the present invention, the river information providing system 100 collects spectral image information and RGB image information while navigating a river including an embankment to be measured by an automatic navigation device, and determines whether there is an abnormality or not through a spectral image analysis algorithm and program. a topographic information collecting device 110 that analyzes and converts abnormal changes into information, and collects RGB image information in proximity to an area with an abnormality or change as a result of the analysis; an environmental information collecting device 120 installed along a river including a levee to be measured and configured to collect an actual image and environmental information including water level, temperature and humidity; Spectral or RGB image information and analysis information transmitted while setting or remote control of the navigation route of the geographical information collecting device 110 and the environmental information collected by the environmental information collecting device 120 are analyzed using an information analysis algorithm and program. an operation analysis device 130 for storing and outputting after a final analysis of the presence or absence of abnormalities or abnormal changes in the photographing area; A 3D virtual space is implemented through a 3D virtual space algorithm or program using the topographic information of the topographic information collection device 110 and the environment information of the environment information collection device 120, but the shooting area analyzed by the operation analysis device 130 a 3D virtual space realizing device 140 that matches and outputs the presence or absence of abnormality or abnormal changes in the 3D virtual space; The information data analyzed by the operation analysis device 130 and the 3D virtual space image implemented in the 3D virtual space realization device 140 are transferred to the management computer system 200 of the central management control center of the river management entity including the embankment through the communication network and a communication unit 150 for transmitting the display device 210 and the personal communication terminal 300 of each local resident distributed in the embankment or river area; It is an embodiment to include.

At this time, the terrain information collecting device 110 of the present invention is an airship or a drone, comprising: a battery for power supply; flight driving unit; GPS unit providing current location information; a photographing unit for photographing spectral and RGB image information; a storage unit for storing the photographed image information; Communication unit for communication connection with the operation analysis device (130); Controls the operation of the flight driving unit to move according to the coordinates transmitted from the operation analysis device 130 or the satellite through the automatic navigation program, controls the operation of the photographing unit that collects the spectral or RGB image information, a spectral image analysis algorithm and Analyze the presence or absence of abnormality or abnormal change for the spectral image information collected by the photographing unit through the program, and control the flight driving unit and the photographing unit to collect RGB image information by moving close to the corresponding coordinates if there is abnormality or change occurrence information and a control unit for controlling the operation of the communication unit to store the spectral or RGB image information and analysis information in a storage unit and transmit the spectral or RGB image information and analysis information to the operation and analysis device 130; What has been done including

In addition, the spectroscopic image analysis algorithm and program of the topographic information collecting device 110 of the present invention includes: a ground reference point surveying part for surveying a ground reference point set for measurement coordinate accuracy of a photographing area; a data processing part for performing image registration processing on the captured spectral image or RGB image according to the ground reference point for coordinate accuracy of the photographing area; a data analysis and mapping part that analyzes the data processed in the data processing part and maps it to a map; and a crack mapping part for mapping the degree of cracking (length/width/depth, etc.) of the imaging area so that state profiling of the photographing area is possible not only in the longitudinal and lateral directions but also by depth. an event output part for outputting an event generation signal according to occurrence of abnormality or change in a photographing area mapped in the data analysis and mapping part, so that the photographing unit captures an RGB image; It is an embodiment to include.

In addition, the photographing unit of the topographic information collecting device 110 of the present invention is a hyperspectral sensor (hyperspectral camera) having spectral information characteristics in the ultraviolet and infrared regions for subdividing the visible and near-infrared wavelength bands into hundreds; a digital camera including a DSLR for photographing the RGB image; It is an embodiment to include.

In this case, the hyperspectral sensor is a near-infrared (NIR) image sensor, an optical multispectral sensor, or a hyperspectral sensor, and the near-infrared (NIR) image sensor is 600 nm above the photographing area. Spectral reflectivity of ~900nm wavelength band or Red wavelength band and NIR wavelength band, the multispectral image sensor is 400nm ~ 500nm wavelength band and 600nm ~ 700nm wavelength band or Blue and Red wavelength band, the hyperspectral image sensor is 400nm ~ 600nm and taking a spectral image to measure spectral reflectivity in a wavelength band of 650 nm to 750 nm.

On the other hand, the environmental information collecting device 120 of the present invention is installed on the ground along the river including the embankment and a plurality of CCTV modules for shooting moving images and still images, a water level sensor installed on the water surface of the river to measure the water level, A temperature sensor installed on the ground and water along a river including an embankment to measure land and water temperature, a humidity sensor installed on the ground along a river including a river to measure the humidity around a river, and the measured or measured information An embodiment includes a data logger that stores and manages for each time period and a network sensor that provides a communication path for wirelessly collecting and transmitting the measured or measured information.

On the other hand, the operation analysis device 130 of the present invention as a remote management device of the field, the operation communication unit for communication connection with the topographic information collection device 110 and the environment information collection device 120; a monitor unit for outputting information transmitted from the topographic information collection device 110 and the environment information collection device 120 and finally analyzed information; an operation storage unit for storing information transmitted from the topographic information collection device 110 and the environment information collection device 120 and finally analyzed information; Calculating and storing a coordinate value for a photographing area based on GPS information, while transmitting it to the topographic information collecting device 110, or remotely controlling the movement and operation of the topographic information collecting device 110, an information analysis algorithm and program The presence or absence or abnormal change is finally analyzed for the spectral or RGB image information and analysis information transmitted from the topographic information collection device 110 through the output device, and the spectral or RGB image information, analysis information, and final analysis information are output to the device. an operation control unit for controlling the operation of the operation communication unit to output the output through the operation storage unit and store it in the operation storage unit, and to communicate with the terrain information collection device 110 and the environment information collection device 120; What has been done including

At this time, the information analysis algorithm and program of the operation and analysis device 130 of the present invention collects the spectral or RGB image information and analysis information transmitted from the topographic information collection device 110, converts it into an image and text, and outputs it to the monitor and data integration part to be stored in the operation storage unit; a change occurrence analysis part that determines whether abnormalities and changes occur in the photographing area from the integrated analysis data, and finally analyzes the cracks (length/width/depth, etc.) an environmental evaluation part that inputs final analysis information according to a table set in advance and processes it into environmental evaluation data for the shooting area; It is an embodiment to include.

On the other hand, in the present invention, the 3D virtual space realization device 140 is a collection information DB that stores the reference image and image image of the topographic information separation device 110 and the environment information collection device 120 and SIFT descriptor data. And, a reference image of the space according to the shooting angle for each camera position of the topographic information collecting device 110 and the environmental information collecting device 120 is collected, and the shooting point of the video image collected by re-photographing of the indoor space is the reference image An image collection module that sets according to and stores in the collection information DB, analyzes the image image, sets SIFT descriptor data for each section in the image image according to the SIFT algorithm, and stores it in the collection information DB, and images adjacent to each other An image matching processing module for generating a virtual space image by matching an intersection section of an image based on the SIFT descriptor data, and storing it in the collection information DB, and a monitoring module for monitoring the processing status of the image matching processing module virtual spatial information management means; A search module for searching the collection information DB to retrieve necessary information, a data processing module for controlling execution of the image collection module, image matching processing module, and monitoring module, and outputting control status and inputting control information of the data processing module Image control means including a spatial image editing module for executing a dashboard for; It is an embodiment to include.

On the other hand, in the present invention, the communication device 150 includes a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), an Internet communication network, and a wireless fidelityv (WiFi) network. : It may be a communication module that connects to various online data networks including Wi-Fi and GPS (Global Positioning System) to enable two-way communication between the geographic information collection device 110 and the operation analysis device 130 for collection information and control signals. .

And, in the present invention, the management computer system 200 of the river management subject is installed in the government or local government or environment-related management organizations and research institutes, while setting or remotely controlling the operation route of the topographic information collection device 110, After analyzing the transmitted spectral or RGB image information and analysis information, and the environmental information collected by the environmental information collecting device 120 through an information analysis algorithm and program, the presence or absence of abnormality or abnormal change in the photographing area is finally analyzed, and then stored and output On the other hand, it is assumed that the management computer system for transmitting to the personal communication terminal 300 is an embodiment.

At this time, the management computer system 200 outputs the embankment and river related information and 3D virtual space image to the output device 210 including a monitor installed in government offices and public facilities in the area where the river including the embankment is located. In an embodiment, including a function of outputting immediate emergency guidance information when an abnormality including a flood occurs.

And, in the present invention, the personal communication terminal 300 is a smart loaded with a program including an application for activating the embankment and river information including the 3D virtual space transmitted from the river information providing system 100 or the management computer system 200 . Let it be a phone or a PC as an embodiment.

The operation of the present invention will be described as follows.

In the present invention, the operation analysis device 130 or the management computer system 200 sets the operation route of the topographic information collection device 110 or remotely controls it in real time so that movement is made.

At this time, the terrain information collecting device 110 is equipped with an automatic navigation device to enable autonomous driving, so if a GPS coordinate point for a photographing area is input in advance, it follows a preset navigation route as shown in FIG. Similarly, a spectral image is taken while moving according to the set coordinates of the embankment.

At this time, the topographic information collecting device 110 moves along a previously set navigation route, but determines the location through a GPS signal, and automatically navigates to correct data for rolling and pitching of the topographic information collecting device 110 . The devices simultaneously record the attitude values and store their route.

In this state, the topographic information collecting device 110 takes a spectral image with a hyperspectral sensor such as a near-infrared image sensor, a multispectral image sensor, or a hyperspectral image sensor, and a preset image (color) of the spectral or RGB image information. According to the gradient, an event occurs, that is, a crack is generated or a crack is suspected, and RGB image information is additionally captured and analyzed.

As such, in the present invention, when a crack has occurred or is suspected as a result of analysis of the spectral image taken by the hyperspectral sensor of the topographic information collecting device 110, it temporarily deviates from the set navigation route and moves to the coordinates where the crack occurred. By capturing an RGB image and transmitting it to the operational analysis device 130 or the management computer system 200, the administrator does not depend only on the analysis algorithm or program, but adds intuitive evaluation analysis through photo confirmation, further improving the accuracy of analysis can do it

For reference, in the hyperspectral sensor, the digital camera captures the RGB image in the topographic information collecting device 110 that flies at an altitude of 200 m above the imaging area, for example, and the near-infrared (NIR) image sensor is 600 nm~ Spectral reflectivity of 900 nm wavelength band or Red wavelength band and NIR wavelength band, the multi-spectral image sensor is 400 nm to 500 nm wavelength band and 600 nm to 700 nm wavelength band or Blue and Red wavelength band, the hyperspectral image sensor is 400 nm to 600 nm and While taking a spectral image to measure the spectral reflectivity in the wavelength band of 650 nm to 750 nm, general RGB images are taken and 3D virtual space information is collected through topographical surveying, as shown in the accompanying drawing 4 .

The spectral image can be taken in a narrow spectral band of up to about 1,000, so that the reflective characteristics of the object can be recorded as it is, so that the topography and features can be distinguished. Detects radiant energy.

All imaging systems have wavelength bands that are measured depending on the filter and sensor configuration. When only one wavelength band is used, it is called panchromatic, and in the case of RGB images that are commonly used, it can be called a kind of multispectral imaging in which the sensor responds to three wavelength bands R, G, and B. Since RGB is perceived by the human eye, RGB images are used a lot, and in reality, various configurations are possible.

In this case, the hyperspectral imaging is spatial imaging added to the number of wavelengths of many degrees used in a general spectrometer. Each pixel has a spectrum as if it was photographed with a spectrometer. When the number of wavelengths to be photographed is tens to hundreds and the relative spectral resolution is about 0.01, it is called hyperspectral, and this relative spectral resolution is called absolute spectral resolution/length of the spectrum. It refers to the value obtained by dividing the spectral resolution by the entire wavelength range being photographed.

Just as a general RGB image is in the form of a cube in which three images of Red, Blue, and Green are stacked, in the case of a hyperspectral image, a data cube is formed in which images of each wavelength captured are stacked.

There are several methods for capturing a spectral image, and accordingly, measurement devices are classified. In the case of multi-spectral devices that take photos by attaching filters according to wavelengths to the sensor like general RGB images, images are taken as snapshots at once, and the data obtained varies depending on the filter configuration of the sensor. Compared to the pushbroom, which is a line scan, or the whisk-broom, which is a point scan, the snapshot method is much simpler and has the advantage that all data is captured at the same time. less than the method.

On the other hand, in the case of the scanning method, simultaneous shooting is not possible because scanning is performed as the name suggests. Therefore, the device must not be shaken or the subject must not move. Pushbroom is the most commonly used hyperspectral imaging method as a line scanning method. At the time of shooting, the light in the linear direction enters the slit, and the light goes through a spectrometer, spreads for each wavelength band, and becomes a surface, which is detected by the 2D detector. 2d images in the spatial and spectral directions are taken. Then, while the camera or object moves in the y direction, line scanning is performed to compose the entire 3D cube.

As described above, the spectral image analysis algorithm and program analyze the spectral image taken by the hyperspectral sensor of the photographing unit provided in the topographic information collecting device 110 that flies along the set operation route of the embankment. When the RGB image is taken close-up by moving to the crack coordinates and transmitted to the operation analysis device 130 together with the spectral image and analysis information, the operation analysis device 130 collects the information transmitted from the topographic information collection device 110 . Therefore, if a crack has occurred in the embankment, which is the shooting area, through the self-installed information analysis algorithm and program, the spatial distribution map of the crack is analyzed, while the cross section of the embankment including the depth of the crack is analyzed and dataized.

As described above, the present invention makes it possible to improve the precision and accuracy of information analysis on the embankment, which is a photographing area, and to provide the analyzed data as evaluation data for the environmental evaluation of rivers and the possibility of disasters such as floods. It is possible.

In addition, the present invention utilizes the ultraviolet and infrared characteristics, which are characteristics that cannot be confirmed with general RGB images, that is, characteristics that cannot be seen with the human eye, and multi-layered information collection and analysis is performed based on hyperspectral image information. In this case, it is possible to collect multi-dimensional, three-dimensional information and analyze the condition of the embankment through it, and through this, it is possible to analyze a wide range of information about the embankment.

In addition, the present invention utilizes the ultraviolet and infrared characteristics, which are characteristics that cannot be confirmed with general RGB images, that is, characteristics that cannot be seen with the human eye, and multi-layered information collection and analysis is performed based on hyperspectral image information. It is possible to analyze the distribution and depth of cracks in the embankment without the manager directly checking the embankment with the naked eye.

In addition, as described above, the present invention enables quantitative environmental investigation of the embankment through improvement of precision and accuracy of analysis of river state information including the embankment, which is the photographing area, and additional analysis scalability, so that future embankment environment evaluation and It is possible to additionally evaluate the possibility of disasters such as earthquakes and floods.

5, the present invention shoots moving images and still images of the river including the embankment through the CCTV module constituting the environmental information collecting device 120, and measures the water level of the river through the water level sensor Measures the land and water temperature of the river including the embankment through the temperature sensor, measures the humidity around the river including the embankment through the humidity sensor, and stores and manages the measured or measured information by time period through the data logger while transmitting to the operation analysis device (130).

In the present invention as described above, the operation analysis device 130 collects the data photographed or measured by the topographic information collection device 110 and the environment information collection device 120, corrects the deviation, and outputs it as integrated analysis data, or It includes a control function that manages to re-shoot and measure the location when it exceeds the set range.

In this way, the operation and analysis device 130 collects the data photographed or measured by the topographic information collection device 110 and the environment information collection device 120 and corrects the deviation, various analysis values from the collected photographed or measured data It is desirable to calibrate the sum of the total by the number of measurements, and if it exceeds the set deviation range, a change occurs in the corresponding position of the river including at least the embankment. For example, it means that a dike crack or flood (drought) has occurred. Therefore, the state of the embankment can be more accurately analyzed by re-photographing and measuring the entire terrain information collection device 110 for the embankment, or moving to the corresponding coordinates of the embankment and re-photographing and measuring the embankment to perform re-analysis. let it be

The present invention as described above is illustratively, the control unit of the topographic information collection device 110 or the operation control unit of the operation analysis device 130, the earthquake level detected by the earthquake detection device is greater than or equal to a preset level, or precipitation measurement When the amount of precipitation measured by the device is greater than or equal to a preset amount, it is also preferable to move the topographic information collection device 110 to a river including an embankment to collect a spectral image or RGB image for analysis.

In this way, it is possible to immediately check whether the embankment is damaged by a natural disaster, such as an earthquake, heavy rain, or flood, and to respond to the disaster.

The present invention implements the topographic image, change image, and environmental change information of the river including the embankment collected and analyzed as described above as a 3D virtual space image. At this time, the operation control unit sets the 3D virtual space realization area. For reference, this is to select the EDC virtual space range based on the EDC (Eco Delta City) basic information obtained through collecting and dataizing in advance to review the possibility of the virtual space scope (refer to the attached drawing Fig. 6).

As described above, in the present invention, the 3D virtual space realization device 140 obtains the reference image and image image of the topographic information of the topographic information analysis device 110 and the environment information of the environment information collection device 120, and the SIFT descriptor data. storage, and collect a reference image of the space according to the shooting angle for each camera position of the topographical information analyzing device 110 and the environmental information collecting device 120, and based on the shooting point of the video image collected by re-photographing of the indoor space It sets according to the image and stores it in the collection information DB, analyzes the video image, sets SIFT descriptor data for each section in the video image according to the SIFT algorithm, and stores it in the collection information DB. Intersections of neighboring video images Creates a virtual space image by matching based on the SIFT descriptor data, stores it in the collection information DB, monitors the processing status of the image matching processing module, searches the collection information DB to retrieve necessary information, and data Executes the dashboard for outputting the control status of the processing module and inputting control information.

To explain this in detail, when the topographic information collecting device 110 and the environmental information collecting device 120 capture the image according to the corresponding shooting angle and collect and transmit the image image, the image collecting module collects the transmitted image image. It is stored in the information DB.

Next, by comparing the image image collected by the image registration processing module with a reference image, if the image image is found to be inconsistent with the reference image, the image registration processing module determines the shooting angle information of the inconsistent image image of the reference image. Adjust according to the shooting angle.

To explain this further, since the collected image and the video image are captured by shooting at the same shooting angle, and the collected image and the video image must be taken in the same section, an error may occur. The collected image and the video image are compared with each other to determine whether there is an error, and when the error is confirmed, the shooting angle information of the corresponding video image is adjusted to the shooting angle information of the collected image, and the corrected video image is stored in the collection information DB.

At this time, the image registration processing module analyzes the image image, sets the SIFT descriptor data for each section in the image image according to the SIFT algorithm, stores it in the collection information DB, and the image registration processing module calculates the intersection section of the neighboring image images. A spatial image is created by matching based on the SIFT descriptor data.

To elaborate on this, since the cameras of the topographic information collection device 110 and the environment information collection device 120 take pictures of rivers including embankments at various angles, the image registration processing module has numerous It is necessary to select only a specific section from the video image and proceed with processing to connect the neighboring video images. To this end, the image matching processing module is required to analyze the video image to which the corresponding shooting angle is linked, find a reference section from the neighboring shooting angles, connect them, and match. For such registration, a specific target that can be a matching criterion for the video image is required, and the video matching processing module checks the image of the specific target to match and edit the video images with each other.

In the present invention, the image registration processing module analyzes an image image based on the SIFT algorithm to classify and set a specific target. SIFT of the SIFT algorithm is an abbreviation of Scale-Invariant Feature Transform, and is a basic solution for matching a plurality of video images with each other. The image matching processing module determines the position of the feature point based on pixel values and distance measurement information through 3D interpolation, which is an extrema localization process, in a section that can be a target according to the SIFT algorithm.

The image registration processing module finds a locally bounced part in the image of the object (scale-space extreme detection). That is, to find a characteristic part (a part that appears prominently) in the video image, the part is classified as a characteristic point of an object.

In addition, the image matching processing module selects a key point, which is a reliable final feature point, from among the previously identified feature points. To this end, the image matching processing module first selects the final feature point based on the pixel value (intensity) of the feature points and the position or size corresponding to the corner of the object among the feature points, and sets it as a key point of the corresponding image image.

In addition, the image registration processing module obtains the inclination of the surrounding area of the key point, and obtains the direction indicated by the pixel values of the surrounding area when viewed as a whole. That is, since the key point set as the key point corresponds to a corner of the object image, one or more side images are included around the key point, and pixel values of the side image are formed toward the pixel of the corresponding key point.

Thereafter, the image matching processing module rotates so that the pixel direction of the peripheral region becomes 0 degrees, sets the part corresponding to the peripheral region as SIFT descriptor data, and stores it in the collection information DB. Through this, one or more SIFT descriptor data is configured in the video image. Therefore, even if there is a change in the image image according to the shooting angle, the image matching processing module recognizes the peripheral area set as the SIFT descriptor data as the same section.

For reference, the SIFT descriptor data includes pixel values of a region surrounding a key point, and histogram information based on direction information of pixel values of a peripheral region with respect to the key point. Therefore, the SIFT descriptor data enables the image matching processing module to identify a target representing the same section in a video image changed according to a shooting angle, and accurately match adjacent video images.

In general, since the Histogram Dimension recommended in the SIFT algorithm is 128-dimension, the video image including the same section regardless of the camera's shooting angle is precisely extracted from the same section by the image matching processing module, and each other from the neighboring video images. Image images are matched based on the shared SIFT descriptor data, and other necessary sections are combined to create a river image including an embankment.

7 and 8 are three-dimensional virtual space images completed according to the present invention.

As described above, in the present invention, the image registration processing module may utilize the existing template data of the 3D virtual space image to be completed in the image image registration process. To this end, the virtual spatial information management means further includes an existing information DB for storing existing image images and template data for the same indoor space, and the image matching processing module determines whether an existing image image for a river including the corresponding embankment. It searches the existing information DB under the control of the search module and executes matching processing of the new video image according to the SIFT algorithm based on the template data.

That is, if an image of a river including the same embankment exists in the past, the image matching processing module searches the existing template data of the spatial image in the existing information DB, and based on the template data, finds a combination for the image image. You can do it easily.

The image registration processing module as described above formats the spatial image generated according to the above-described process and stores it in the collection information DB. Through this, the operator can search for the output spatial image with the image control device and output it.

As described above, in the process of implementing the 3D virtual space in the 3D virtual space realization device 140, the present invention provides topographic information collected in real time or periodically by the topographic information collection device 110 and the environment information collection device 120, and By allowing changes in environmental information to be substituted and implemented, change information on river conditions including embankments, such as subsidence or collapse of dikes and the possibility of floods or droughts, is predicted, and information and risk situations are provided to the relevant river management entity and residents of the surrounding area. It is possible to provide information to users intuitively through 3D virtual space images.

In addition, the present invention provides information on the state of the river including the embankment through 3D virtual space images quickly and intuitively, so that the possibility of embankment subsidence or collapse and flood occurrence and the identification of the corresponding location can be easily made, so that the initial response is It is possible to make it happen quickly and accurately.

While the present invention has been described and illustrated in connection with preferred embodiments for illustrating the principles of the present invention, the present invention is not limited to the construction and operation as so shown and described.

In addition, it will be apparent to those skilled in the art that many changes and modifications can be made to the present invention without departing from the spirit and scope of the appended claims.

Accordingly, all such suitable alterations and modifications and equivalents are to be considered as falling within the scope of the present invention.

100: river information providing system 110: topographic information collecting device
120: environmental information collection device 130: operation analysis device
140: 3D virtual space realization device 150: communication device
200: management computer system 300: personal communication terminal

Claims (10)

Spectral image information and RGB image information are collected while operating the river including the embankment to be measured by the automatic navigation system, and the presence or absence of abnormalities or abnormal changes are analyzed and informationalized through the spectral image analysis algorithm and program, and abnormalities or changes are detected as a result of the analysis. a geographical information collecting device 110 for collecting RGB image information in proximity to an area in which there is;
an environmental information collecting device 120 installed along a river including a levee to be measured and configured to collect an actual image and environmental information including water level, temperature and humidity;
Spectral or RGB image information and analysis information transmitted while setting or remote control of the navigation route of the geographical information collecting device 110 and the environmental information collected by the environmental information collecting device 120 are analyzed using an information analysis algorithm and program. an operation analysis device 130 for storing and outputting after a final analysis of the presence or absence of abnormality or abnormal change in the photographing area;
When it is confirmed that the image image captured and transmitted by the topographic information collection device 110 and the environment information collection device 120 according to the shooting angle is compared with a reference image, and it is confirmed that the image image does not match the reference image, image matching processing The module corrects the shooting angle information of the inconsistent video image according to the shooting angle of the reference image, sets the SIFT descriptor data for each section in the video image according to the SIFT algorithm, and sets the SIFT descriptor data for the intersection section of the neighboring video images. A 3D virtual space realization device 140 that implements a 3D virtual space by matching based on the operation analysis device 130, and outputs the abnormality or abnormality of the photographing area analyzed by the operation analysis device 130 by matching it with the 3D virtual space;
The information data analyzed by the operation analysis device 130 and the 3D virtual space image implemented in the 3D virtual space realization device 140 are transferred to the management computer system 200 of the central management control center of the river management body including the embankment through the communication network and The display device 210 distributed in the embankment or river area and the communication device 150 for transmitting to the personal communication terminal 300 of each of the local residents; comprising;
A river information provision system using a three-dimensional virtual space characterized by
delete The method according to claim 1,
The terrain information collection device 110,
An airship or drone comprising: a battery for power supply; flight driving unit; GPS unit providing current location information; a photographing unit for photographing spectral and RGB image information; a storage unit for storing the photographed image information; a communication unit for communication connection with the operation analysis device 130; Controls the operation of the flight driving unit to move according to the coordinates transmitted from the operation analysis device 130 or the satellite through the automatic navigation program, controls the operation of the photographing unit that collects the spectral or RGB image information, a spectral image analysis algorithm and Analyze the presence or absence of abnormality or abnormal change for the spectral image information collected by the photographing unit through a program, and control the flight driving unit and the photographing unit to collect RGB image information by moving close to the corresponding coordinates if there is abnormality or change occurrence information and, while storing the spectral or RGB image information and analysis information in the storage unit, a control unit controlling the operation of the communication unit to transmit it to the operation and analysis device 130;
A river information provision system using a three-dimensional virtual space characterized by
The method according to claim 3,
The spectral image analysis algorithm and program of the topographic information collection device 110,
a ground reference point surveying part for surveying the ground reference point set for the accuracy of the measurement coordinates of the shooting area; a data processing part for performing image registration processing on the captured spectral image or RGB image according to a ground reference point for coordinate accuracy of a photographing area; a data analysis and mapping part that analyzes the data processed in the data processing part and maps it to a map; and a crack mapping part for mapping the degree of cracking (length/width/depth, etc.) of the imaging area so that state profiling of the photographing area is possible not only in the longitudinal and lateral directions but also by depth. In the data analysis and mapping part, an event output part for outputting an event generation signal according to the occurrence of abnormality or change in the photographing area mapped in the data analysis and mapping part, so that the photographing unit captures the RGB image;
A river information provision system using a three-dimensional virtual space characterized by
The method according to claim 3,
The photographing unit of the geographical information collecting device 110,
a hyperspectral sensor having spectral information characteristics in the ultraviolet and infrared regions for photographing by subdividing the visible and near-infrared region wavelength bands into hundreds; a digital camera including a DSLR for photographing the RGB image; comprising;
A river information provision system using a three-dimensional virtual space characterized by
The method according to claim 1,
The environment information collection device 120,
A number of CCTV modules installed on the ground along the river including the embankment to record video and still images, a water level sensor installed on the water surface of the river to measure the water level, and the ground and water along the river including the embankment installed on land and water A temperature sensor that measures underwater temperature, a humidity sensor that is installed on the ground along a river including an embankment to measure the humidity around the river, a data logger that stores and manages the measured or measured information for each time period, and the measured or measured information Including a network sensor that provides a communication path for wirelessly collecting and transmitting them;
A river information provision system using a three-dimensional virtual space characterized by
The method according to claim 1,
The operation analysis device 130,
An on-site remote management device, comprising: an operation communication unit for communication connection with the terrain information collection device 110 and the environment information collection device 120 ; a monitor unit for outputting information transmitted from the topographic information collection device 110 and the environment information collection device 120 and finally analyzed information; an operation storage unit for storing information transmitted from the topographic information collection device 110 and the environment information collection device 120 and finally analyzed information; Calculating and storing coordinate values for a photographing area based on GPS information and transmitting to the topographic information collecting device 110, or remotely controlling the movement and operation of the topographic information collecting device 110 The presence or absence or abnormal change is finally analyzed for the spectral or RGB image information and analysis information transmitted from the topographic information collecting device 110 through the output device, and the spectral or RGB image information and analysis information and final analysis information are output to the device. an operation control unit for controlling the operation of the operation communication unit to output the output through the operation storage unit and store it in the operation storage unit, and to communicate with the terrain information collection device 110 and the environment information collection device 120; made by including
A river information provision system using a three-dimensional virtual space characterized by
The method according to claim 7,
The information analysis algorithm and program of the operation analysis device 130,
a data integration part that collects the spectral or RGB image information and analysis information transmitted from the geographical information collecting device 110, converts them into images and texts, outputs them to a monitor, and stores them in an operation storage unit; a change occurrence analysis part that determines whether abnormalities and changes occur in the photographing area from the integrated analysis data, and finally analyzes the cracks (length/width/depth, etc.) Including; an environmental evaluation part that inputs the final analysis information according to a table set in advance and processes it into environmental evaluation data for the shooting area;
A river information provision system using a three-dimensional virtual space characterized by
The method according to claim 1,
The 3D virtual space realization device 140,
A collection information DB for storing reference images, image images, and SIFT descriptor data of the topographic information collection device 110 and the environment information collection device 120, and the topographic information collection device 110 and the environment information collection device 120 An image collection module that collects a reference image of a space according to a shooting angle for each camera location, sets a shooting point of a video image collected by re-photographing of an indoor space according to the reference image, and stores the image in the collection information DB; Analyze the image, set SIFT descriptor data for each section in the video image according to the SIFT algorithm, store it in the collection information DB, and create a virtual space image by matching the intersection sections of neighboring video images based on the SIFT descriptor data and virtual spatial information management means including an image matching processing module for storing in the collection information DB, and a monitoring module for monitoring the processing status of the image matching processing module; A search module for searching the collection information DB to retrieve necessary information, a data processing module for controlling execution of the image collection module, image matching processing module, and monitoring module, and outputting control status and inputting control information of the data processing module Image control means including a spatial image editing module for executing a dashboard for; comprising;
A river information provision system using a three-dimensional virtual space characterized by
The method according to claim 1,
The management computer system 200,
Embankment and river-related information and 3D virtual space images are output to the output device 210 including a monitor installed in government offices and public facilities in the area where rivers, including embankments, are located, while immediate emergency guidance information is provided in case of abnormalities including floods. that includes a function to output
A river information provision system using a three-dimensional virtual space characterized by

Images