KR20230059188A - River condition information provision system and method through image information and environmental information collection and analysis - Google Patents

Abstract

The present invention relates to a system and method for collecting and analyzing river condition information through image information and physical sensing, and more particularly, to a river including an embankment to be measured (particularly, an area where flood damage continues to occur) Image information is collected using a camera, and environmental information including water level, flow rate, temperature, and humidity is collected through physical sensing, while hyperspectral image information is collected from the sky and the information is analyzed while applying 3D virtual reality. Image information that analyzes information on river conditions and monitors and predicts real-time occurrences of disasters, including bank collapse or floods, and provides intuitive information and risk situations to relevant river management entities and the public using the river. and a system and method for providing river condition information through collection and analysis of environmental information.

Description

River condition information provision system and method through image information and environmental information collection and analysis}

The present invention relates to a river state information providing system and a river state information providing method through collection and analysis of image information and environmental information, and more particularly, to a river including an embankment in an area subject to information provision (especially flood damage continuously occurs). area), collects image information using various types of cameras, collects environmental information including water level, flow rate, temperature and humidity through physical sensing, collects hyperspectral image information from the sky, analyzes it, Incorporating 3D virtual reality, information on river conditions is analyzed to determine and predict the occurrence of disasters (abnormal occurrences) such as levee collapse and flooding, and intuitive detailed information and risk situations are provided to the corresponding river management It is about the "system and method of providing river condition information through collection and analysis of image information and environmental information" to be provided to the subject and local residents around the river.

In general, river (river, stram, river) refers to water supplied to the surface through precipitation forming a certain waterway and flowing down the inclined surface, and the constant waterway constituting the river is called a channel. A low valley formed by or flowing through a river is called a river valley, and the bottom part of a river made of rocks or soil is called a riverbed. In natural rivers where the river bed or embankment materials are mainly composed of sand and gravel, or in vegetative rivers in which vegetation such as grass, shrubs, and trees are scattered in floodplains and embankments, resistance to flow is It causes changes in flow velocity according to the vegetation and riverbed data in the riverbank.

On the other hand, embankment means an artificial facility to block the natural (natural) flow of water, and its contents mean the meaning of a dam for storage and a dam for waterproofing. It has two meanings and functions. Among the above two meanings and functions, the embankment refers to the embankment of a general river according to the River Management Act. It refers to a facility built to prevent floodwaters from being lost or buried, and is a general term for reservoir embankment, embankment embankment, large and small river embankment, etc. Such an embankment is usually built wide enough so that the river flowing at a high water level does not permeate and collapse or be eroded, and as shown in FIG. defend

It is absolutely necessary to secure the stability of reservoir embankments against unpredictable natural disasters such as earthquakes. In particular, cracks caused by earthquakes can cause secondary damage such as embankment collapse. In Korea, smart ground and structure management is required as strong earthquakes occurred in Gyeongju in September 2016 and Pohang in November 2017. In particular, investigation and monitoring using cutting-edge equipment and new ICT convergence technologies are required for the advancement of structure management. Currently, 16,700 reservoirs, 95% of all reservoirs in the country, have been created for more than 30 years, and among them, reservoirs older than 50 years are at increased risk of leakage. However, due to lack of budget, it was found that there are limitations in practical safety management such as maintenance, repair, reinforcement, and precise safety diagnosis of disaster risk reservoirs. In particular, in the case of Gyeongbuk, there are 479 reservoirs older than 50 years in the province, so the possibility of secondary damage after an earthquake is very high. In addition, after the Pohang earthquake, intensive analysis was conducted on 126 disaster-vulnerable reservoirs and reservoirs with a capacity of 100,000 tons or more within a radius of 50 km from the epicenter, shear cracks in embankments, drainage facilities, spillways, leaks, and operation of water intake facilities. It is a reality that accurate analysis is difficult because it is carried out.

Rivers including embankments are managed in such a way that after a disaster event, such as an earthquake or flood, occurs, a manager periodically visits the corresponding embankment to visually check whether or not damage has occurred to the building structure. However, there is a limit to such a visual inspection by the manager, and recently, attempts have been made to analyze the current state by remotely monitoring the embankment through sensors or/and aerial photographs. Prior art related to monitoring of rivers including embankments includes Korean Patent Registration No. 10-1204426 and Korean Patent Registration No. 10-1881822.

However, in the case of this prior art, since a measuring means (measurement sensor) is buried in the flood control facility and the method of measuring the change in the slope of the flood control facility when the collapse of the flood control facility starts, the danger is recognized at the time of collapse or just before the collapse occurs. There is a problem that it is difficult to secure sufficient time to cope with it because there is no choice but to do it. In addition, since the measuring means is buried in the flood control facility, there is a problem in that the measuring means is lost or damaged when it collapses, and maintenance costs are high due to the impossibility of repeatedly using the measuring means.

On the other hand, in the case of the prior art of collecting and analyzing information on the surface material (low water level) of a reservoir including an embankment through aerial photographs, multi-dimensional and three-dimensional information collection and analysis through this are not performed, and accordingly, the embankment There is a problem of low precision or accuracy as well as limitations of information analysis on the reservoir including the reservoir.

Republic of Korea Patent Registration No. 10-1204426 (Announced on November 26, 2012) Republic of Korea Patent Registration No. 10-1881822 (published on August 24, 2018)

The present invention was developed to solve the problems of the prior art as described above, and collects image information using various types of cameras for rivers including embankments in the information provision target area, and through physical sensing, water level, flow rate, temperature and In addition to collecting environmental information including humidity, hyperspectral image information is collected from the sky, the collected information is analyzed and 3D virtual reality is applied to analyze information on river conditions and predict the possibility of flooding, and intuitively Its purpose is to provide a "river condition information provision system through collection and analysis of image information and environmental information of the river" that can provide information on personal information and risk situations to the relevant river management entity and neighboring residents.

In order to achieve the above object, the present invention provides a system and method for providing river condition information through collection and analysis of image information and environmental information. A river information collection device that collects terrain information including data and RGB image information, and collects actual image information and environmental information including water level, flow rate, temperature, and humidity in real time from multiple points on the ground or above water in the river, including the embankment. (100); And based on the information data collected and transmitted by the river information collection device 100, whether there is anomaly or anomaly change in the river including the embankment is analyzed, and image information and environment information including topography are combined with the analyzed information to create a 3D virtual space It is implemented as a video, saved and printed. According to the analysis results, if there is an anomaly in the river and an abnormal change is predicted, a 3D virtual space image and anomaly change are obtained by using the local residents' personal communication terminal (300) and the other person's personal communication terminal (400) subscribed to the forecast service in advance It is characterized by having a configuration including a remote control device 200 for transmitting and guiding an alert.

In the present invention, the river information collection device 100 includes a topographic information and image information collection unit 110 that collects hyperspectral image information and RGB image information for a river including an embankment in a measurement target area; And collecting actual image information using various types of cameras at multiple points along the river, including the embankment of the measurement target area, and collecting environmental information including the water level and flow rate of the river, and the temperature and humidity of the river and its surroundings. It may be configured to include an environmental information collection unit 120. In particular, the geographic information and image information collection unit 110 subdivides the visible ray region and the near-infrared region wavelength range to capture the spectral information characteristics of the ultraviolet and infrared regions. a hyperspectral sensor having; and a camera for capturing RGB images.

In addition, in the present invention, a plurality of CCTV modules installed on the ground along the river, including the embankment, to acquire actual images by capturing moving images and still images; A water level sensor installed on the water surface of the river to measure the water level; Temperature sensors installed on land and water along rivers including embankments to measure land and water temperatures; A humidity sensor installed on the ground along the river including the embankment to measure the humidity around the river; a data logger that stores and manages the measured or measured information by time period; and a network sensor providing a communication path for collecting and transmitting the measured or measured information wired or wirelessly.

Furthermore, in the present invention, the remote control device 200 includes an analysis and 3D imaging unit 210 and an information processing and forecast management unit 220; The analysis and 3D imaging unit 210, when the information data collected by the river information collection device 100 is transmitted, an information analysis program for predicting and informatizing the presence or absence of abnormalities in the shooting area or changes in abnormalities, and predicting and informing information It includes a 3D virtual space program that implements the result, image information including topography, and environment information as a 3D virtual space image; The information processing and forecasting management unit 220 stores the data predicted and generated by the information analysis program and the 3D virtual space program and outputs them to the control monitor. It may have a feature of transmitting and guiding the change alert to the personal communication terminal 300 of the local resident and the personal communication terminal 400 of another person through the communication network, and the remote control device 200, the river information collection device 100 an operating communication unit 230 for communicating with the topographic information and image information collection unit 110 and the environment information collection unit 120; a monitoring unit 240 outputting information transmitted from the topographic information and image information collection unit 110 and environment information collection unit 120 and finally analyzed information; an operation storage unit 250 that stores information transmitted from the topographic information and image information collection unit 110 and environment information collection unit 120 and finally analyzed information; and calculating and storing coordinate values for the shooting area based on the GPS information and transmitting them to the topographic information and image information collecting unit 110, or remotely controlling the movement and operation of the topographic information and image information collecting unit 110, Based on the hyperspectral image information or RGB image information transmitted from the topographic information and image information collection unit 110 through the information analysis program, and the analysis information, the presence or absence of anomalies or changes in the region to be measured is finally analyzed, and the 3D virtual space Through the program, image information including topography, environment information, and analyzed prediction information are implemented as 3D virtual space images, output to the monitoring unit 240, and stored in the operation storage unit 250, while controlling the operation of the operation communication unit 230. It may have a configuration including an operation control unit 260 for controlling.

In particular, the information analysis program of the analysis and 3D imaging unit 210 in the present invention includes hyperspectral image information and RGB image information transmitted from the topographic information and image information collection unit 110 and the environment information collection unit 120 topographical-image information. A data integration module that collects actual image information, environment information, and analysis information, converts them into images and text, outputs them to the monitor unit, and stores them in the operating storage unit; Based on topography-image information, actual image information and environmental information, and analysis information, the topography, water level, flow velocity, temperature, and humidity of the river area subject to information provision are analyzed to determine whether there is an anomaly or an abnormal change in the river area subject to information provision. A change generation analysis module that determines and analyzes and generates prediction information, outputs it to the monitor unit, and stores it in the operation storage unit; And it may be configured to include an environmental evaluation module that inputs prediction information according to a table set in advance, processes it into environmental evaluation data for the shooting area of the river area to be provided information, and provides it, and analyzes and 3D imaging unit 210 The 3D virtual space program is composed of a virtual space information management part and an image control part; The virtual spatial information management part is the collection information in which the topography-image information of the topographic information and image information collection unit 110, the reference image and video image of the environment information collection unit 120, and SIFT descriptor data are stored DB module; The reference image of the space according to the shooting angle for each camera position of the topographic information and image information collection unit 110 and the environment information collection unit 120 is collected, and the shooting point of the video image collected by re-shooting the indoor space is the reference image. An image collection module for setting according to and storing in the collection information DB module; The video image is analyzed, SIFT descriptor data is set for each section in the video image according to the SIFT algorithm, stored in the collection information DB module, and the intersection section of neighboring video images is matched based on the SIFT descriptor data to create a virtual space image Image matching processing module for generating and storing in the collection information DB module; and a monitoring module for monitoring the processing status of the image matching processing module; The image control part includes a search module for searching the collection information DB module to retrieve necessary information; a data processing module controlling execution of the image collection module, image matching processing module, and monitoring module; and a spatial image editing module that executes a dashboard for outputting the control status of the data processing module and inputting control information.

Furthermore, in the present invention, the information processing and forecast management unit 220 stores the predicted and generated data from the information analysis program and 3D virtual space program of the analysis and 3D imaging unit 210 and outputs it to the control monitor at the same time, while analyzing the results Information processing program for transmitting and guiding 3D virtual space images and abnormal change alerts to local residents' personal communication terminals 300 and other people's personal communication terminals 400 through a communication network when it is determined that an abnormal change has occurred in the measurement target area according to ; A local forecast service program that collects, confirms, and approves personal information in advance with local residents' personal communication terminals 300 to use the forecast service to make a forecast; And when the personal communication terminal 400 of another person is captured in the region through the communication network, if the forecast service is used after checking whether or not to use it, the person who collects personal information, checks, and approves the operation to make the forecast. A forecast service program may be installed.

According to the present invention by means of the above problem-solving means, a topographic information and image information collection unit for collecting hyperspectral image information and RGB image information at specific points at intervals along the river of the river area to be provided information, and the water level and By installing an environmental information collection unit that collects environmental information including flow rate, temperature and humidity, image information is collected using various types of cameras for the river area to be provided information, and water level, flow rate, temperature and humidity are collected through physical sensing. While environmental information is collected, hyperspectral image information is collected and analyzed from the sky, and 3D virtual reality is applied to analyze information on river conditions and disasters such as collapse of embankments, floods, or other abnormal situations, i.e. abnormal occurrences. is determined and predicted, and intuitive information and emergency or dangerous situations are provided to the remote control device of the relevant river management entity for monitoring and analysis, and local residents' personal communication terminals or / and temporary transit or stay in the area By providing information to a personal communication terminal of another person, the effect of enabling nearby civilians to quickly respond to environmental changes of rivers including embankments, such as floods including collapse of embankments or other abnormal situations is exerted.

In particular, according to the present invention, when a stranger temporarily stays in a river area to be provided information, for example, to engage in activities such as camping, lodging by car, and camping, remote control of the subject managing the river including the river area to be provided information After accessing the device, agreeing to the use of advance forecast service and the use of personal information, and signing up for the service after identity verification, real-time environmental information about the area is provided, so that the occurrence of disasters including levee collapse or floods It also has the effect of ensuring the safety of others, which enables them to respond quickly.

In particular, in the present invention, as a result of analyzing the spectroscopic image taken by the hyperspectral sensor of the geographic information and image information collection unit, when the water level or flow speed increases rapidly or flooding is suspected in the river including the embankment, temporarily deviate from the set navigation route to the corresponding coordinates By moving to the RGB image and sending it to the remote control device, the manager adds intuitive evaluation analysis through photo confirmation without relying only on the analysis algorithm or program, and the effect of further improving the accuracy of the analysis is exerted.

Furthermore, in the present invention, the spectroscopy image analysis algorithm and program analyze the hyperspectral image taken for the river area to be provided information, and when cracks, collapses, or floods are suspected in the river including the embankment, move to the corresponding coordinates to obtain an RGB image is taken close-up and transmitted to the remote control device along with the spectroscopic image and analysis information, the remote control device 200 collects the transmitted information and uses the self-loaded information analysis algorithm and program to include the embankment, which is the shooting area. While analyzing cracks, collapses, or floods occurring in the river, it is effective to improve the precision or accuracy of information analysis on the levee by analyzing and converting the cross section including the depth of the river including the embankment into data. The advantage of being able to provide data as evaluation data for environmental assessment of rivers and the possibility of disasters such as flooding is demonstrated.

In addition, in the present invention, multi-layered information collection and analysis are made based on hyperspectral image information by utilizing ultraviolet and infrared characteristics, which cannot be confirmed by general RGB images, that is, characteristics that cannot be seen by the human eye. Therefore, if it is multifaceted, it is possible to collect three-dimensional information and analyze the state of the river including the embankment through it, and through this, the advantage of being able to analyze a wide range of information on the river including the embankment is also exhibited.

According to the present invention, the environment of the river including the embankment can be quantitatively investigated through the improvement of the precision or accuracy of the analysis of the state information of the river including the embankment, which is the shooting area, and the additional analysis scalability. It has the effect of allowing additional evaluations on the possibility of disasters such as earthquakes and floods to be carried out.

In particular, in the present invention, in the process of implementing the 3D virtual space algorithm or program of the remote control device, the terrain information and environment information collected in real time or periodically through the terrain information and image information collection unit and the environment information collection unit Since it is implemented by substituting changes, change information on river conditions including levees, such as bank subsidence or collapse, and the possibility of flood or drought are predicted, and information and risk situations are provided to the relevant river management body and residents in the surrounding area. The effect of being able to quickly and intuitively provide 3D virtual space images is demonstrated.

In addition, in the present invention, information on river conditions including embankments is quickly and intuitively provided through 3D virtual space images, so that the possibility of embankment subsidence or collapse and flood occurrence and identification of the corresponding location are easily made, so that the initial response The effect of making it happen quickly and accurately is exerted.

1 is a photograph in place of a drawing showing an example of an embankment.
2 is a schematic system configuration diagram briefly showing the configuration of the present invention.
3 is a system block diagram showing the configuration of the present invention in detail.
4 is a schematic configuration diagram showing an example in which the topographic information and image information collection unit and the environment information collection unit collect image information, hyperspectral image and RGB image information, and environment information of a river area to be provided information in the present invention. .
5 is a schematic block diagram showing the configuration of a hyperspectral image analysis program of a geographic information and image information collection unit.
6 is a schematic configuration diagram showing an example of capturing an actual image and extracting the image and terrain data in the present invention.
7 is a schematic block diagram of the configuration of a remote control device.
Figure 8 is a schematic block diagram showing the configuration of the information analysis program provided in the analysis and 3D imaging unit of the remote control device.
9 is a schematic block diagram showing the configuration of a 3D virtual space program provided in the analysis and 3D imaging unit of the remote control device.
10 is a schematic illustration showing an example of setting an area to implement a 3D virtual space.
11 is a virtual view showing an example of an image implementing a 3D virtual space.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. The present invention has been described with reference to the embodiments shown in the drawings, but this is described as one embodiment, and thereby the technical idea of the present invention and its core configuration and operation are not limited. For reference, in the disclosure of this specification, including the claims, like reference numerals designate like elements. In describing the embodiments of the present invention, detailed descriptions of well-known functions or configurations may be omitted. Combinations of each block of the accompanying block diagram and each step of the flowchart may be performed by computer program instructions (execution engine), and these computer program instructions are executed by a processor of a general-purpose computer, special-purpose computer, or other programmable data processing equipment. Since it can be mounted, the instructions executed through the processor of a computer or other programmable data processing equipment create means for performing the functions described in each block of the block diagram or each step of the flowchart. These computer program instructions may also be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement functionality in a particular way, such that the computer usable or computer readable memory The instructions stored in are also capable of producing an article of manufacture containing instruction means for performing the functions described in each block of the block diagram or each step of the flow chart. And since the computer program instructions can also be loaded on a computer or other programmable data processing equipment, a series of operating steps are performed on the computer or other programmable data processing equipment to create a computer-executed process to create a computer or other programmable data processing equipment. It is also possible that the instructions performing the data processing equipment provide steps for executing the functions described in each block of the block diagram and each step of the flow chart. Furthermore, each block or each step may represent a module, segment or portion of code that contains one or more executable instructions for executing specified logical functions, and in some alternative embodiments referred to in blocks or steps. It is also possible that the functions described may occur out of sequence. For example, two blocks or steps shown in succession may in fact be performed substantially concurrently, or the blocks or steps may be performed in the reverse order of their corresponding functions, if necessary. In particular, as used herein, '... module', '… unit', '… wealth', '… energy', '… A term such as 'part' refers to a unit that processes at least one function or operation, and may be implemented as hardware, software, or a combination of hardware and software.

In addition, the river state information providing system and method through the collection and analysis of image information and environmental information according to the present invention are abbreviated as "river state information providing system" and "river state information providing method", respectively. And throughout this specification, including the claims, rivers and river basins including embankments included in the area for which state information is to be provided are abbreviated as “river areas subject to information provision”. In actually applying the present invention, an area where flood damage continuously occurs may be set as a "river area subject to information provision".

2 is a schematic system configuration diagram briefly showing the configuration of the present invention, and FIG. 3 is a system block diagram showing the configuration of the present invention in detail. As shown in FIGS. 2 and 3 , the river state information providing system according to the present invention has a configuration including a river information collection device 100 and a remote control device 200 .

The river information collection device 100 collects "topographic-image information" including hyperspectral image information and RGB image information from the sky above the river area to be provided information, and for a plurality of ground or water points in the river area to be provided information It collects "actual image information" and "environmental information" including water level, flow rate, temperature and humidity of the river in real time.

The remote control device 200 collects from the river information collection device 100 and analyzes the information and data transmitted in real time through the communication network, so that disasters such as collapse of embankments or floods or other abnormal situations occur in the river area subject to information provision. whether or not an anomaly occurs, that is, whether or not an anomaly has occurred, and the contents of such anomaly, and furthermore, the possibility of anomaly occurrence is evaluated to predict the occurrence of an anomaly, and the analyzed result, that is, the prediction information is divided into terrain-image information, actual image information and Integrating with environmental information, it is realized and stored as a 3D virtual space image, and at the same time, it is output so that the manager can monitor the condition of the river area subject to information provision. According to the analysis result, abnormal occurrence or If it is judged to be an abnormal occurrence prediction, the personal communication terminal (local resident personal communication terminal) 300 of a local resident who has subscribed to the forecast service in advance and the personal communication terminal of another person temporarily staying or passing through the area (personal communication terminal of another person) A 3D virtual space image and an abnormal change alert are transmitted and guided to the terminal) (400). At this time, the transmission of the 3D virtual space image and the abnormal change alert to the personal communication terminal 400 of another person proceeds after prior consent to the forecast service.

In the river state information providing method according to the present invention, topographic-image information including hyperspectral image information and RGB image information is collected for the river area to be provided through the river information collection device 100, and the river including the embankment Actual image information and environmental information including water level, flow rate, temperature and humidity are collected in real time at multiple points on the ground or on the water, and are collected and transmitted by the river information collection device 100 through the remote control device 200. Based on the information and data to be provided, analyze the abnormality or abnormal change of the river area subject to information provision, and implement, save, and output as a 3D virtual space image by combining the analyzed forecast information with terrain-image information, actual image information, and environmental information And, according to the analysis result, if there is an abnormality in the river and an abnormal change is predicted, a 3D virtual space image and An abnormal change alert is transmitted and guided.

Specifically, in the river state information providing system and method according to the present invention, the river information collection device 100 acquires hyperspectral image information and RGB image information while fixing or moving at a certain height above the river zone to be provided information. A topographic information and image information collection unit 110 that collects "topographic-image information" and a "actual image information" for the information provision subject river area installed at multiple points along the river in the information provision subject river area It has a configuration including an environmental information collection unit 120 that collects and collects "environmental information" including water level, flow rate, temperature and humidity through physical sensing.

4, in the present invention, the topographic information and image information collection unit 110 and the environment information collection unit 120 provide topographic-image information including hyperspectral image information and RGB image information of the river area to be provided information, and actual image A schematic configuration diagram showing an example of collecting information and environment information is shown.

Specifically, the topographic information and image information collection unit 110 collects hyperspectral image information and RGB image information for the river area to be provided information. These hyperspectral image information and RGB image information correspond to "topography-image information". In addition, the environmental information collection unit 120 collects "actual image information" for the river area to be provided information using various types of cameras. In addition, the environment collection unit 120 collects "environmental information" including the water level and flow rate of the river in the river area to be provided information, and the temperature and humidity of the river and its surroundings through physical sensing using various sensors.

In the present invention, the remote control device 200 of the corresponding river management entity analyzes the collected information (terrain-image information, actual image information, and environmental information) and incorporates 3D virtual reality. In particular, in the remote control device 200, based on the analysis of the collected information and data, it is determined whether a disaster such as a collapse of an embankment or a flood or other abnormal situations occur (abnormal occurrence) in the river area subject to information provision. Further, by identifying the contents of such abnormality, evaluating the possibility of abnormality, predicting the occurrence of abnormality, and providing intuitive information and emergency or dangerous situation information about this to the local residents' personal communication terminal 300 or / and It is provided to the personal communication terminal 400, which is a temporary transit or stay in the area. Through this, it becomes possible for the surrounding civilians to quickly respond to environmental changes in the river area subject to information provision, for example, disasters such as embankment collapse, flooding, or other dangerous abnormal situations.

In particular, according to the present invention, when a stranger temporarily stays in a river area subject to information provision, for example, camping, accommodation using a car, or leisure activities such as camping, the subject's remote control device that manages the corresponding river area in advance (200) and sign up for the advance forecast service through the use application procedure, personal information use consent procedure, identity verification procedure, etc., and then receive detailed status information on the river area subject to provision of information in real time, It becomes possible to respond quickly to the occurrence of dyke collapse, flooding, and many other disasters.

According to an embodiment of the present invention, as described above, the river information collection device 100 collects hyperspectral image information and RGB image information, that is, "topography-image information" while being fixed or moving in the air at a certain height of the river area to be provided. It is provided with a collection unit 110 for collecting topographical information and image information.

The topographic information and image information collection unit 110 may include a photographing means for photographing hyperspectral image information and RGB image information, and such photographing means may be mounted on an unmanned aerial vehicle that autonomously travels within a set area. In this case, the unmanned air vehicle includes a battery for power supply, a flight drive unit, a GPS unit that provides current location information, a storage means for storing captured image information, a communication means for communicating with the remote control device 200, and an automatic navigation program. Controls the driving of the flight drive unit to move according to the coordinates transmitted from the remote control device 200 or the satellite through and controls the operation of the photographing means, and the acquired hyperspectral image information and RGB image information and analysis information obtained by analyzing them It may have a configuration including a control means for controlling the operation of the communication unit to be stored in the storage unit and transmitted to the remote control device 200.

In the present invention, a unique <hyperspectral image analysis program (algorithm)> is installed in the topographic information and image information collection unit 110 and can be operated by it. 5 shows a schematic block diagram of the configuration of <hyperspectral image analysis program> provided in the topographical information and image information collecting unit 110. As illustrated in FIG. 5, the <hyperspectral image analysis program> of the topographic information and image information collection unit 110 includes a ground control point measurement module for measuring ground control points set for measurement coordinate accuracy of the shooting area, and a captured second. A data processing module that performs image matching processing on a spectral image or RGB image according to a ground control point for coordinate accuracy of the shooting area, a data analysis and mapping module that analyzes the data processed by the data processing module and maps it to a map, and the photographing A mapping module that maps the topography, water level, flow rate, temperature and humidity of the shooting area so that condition profiling by depth as well as longitudinal and lateral directions of the area is possible, and the data analysis and mapping of the area mapped by the mapping module It may have a configuration including an event output module that outputs an event generation signal according to the occurrence of an abnormality or change so that an RGB image is captured.

As described above, the photographing means provided in the topographic information and image information collection unit 110 of the present invention is to photograph and obtain hyperspectral image information and RGB image information, specifically, in the visible ray region and near-infrared region wavelength bands in hundreds. It may be configured to include a hyperspectral sensor (hyperspectral camera) having spectral information characteristics in the ultraviolet and infrared regions by subdividing and photographing, and a digital camera capable of capturing RGB images such as a DSLR.

The hyperspectral sensor used as the topographic information and image information collection unit 110 is preferably a near-infrared (NIR) image sensor, an optical multispectral sensor, or a hyperspectral image sensor. In the sky, near-infrared (NIR) image sensors have spectral reflectivity in the 600nm-900nm wavelength range or red wavelength range and NIR wavelength range, multispectral image sensors in the 400nm-500nm wavelength range and 600nm-700nm wavelength range or blue and red wavelength ranges, and The hyperspectral image sensor preferably takes a spectroscopic image to measure spectral reflectance in a wavelength range of 400 nm to 600 nm and 650 nm to 750 nm. For reference, for example, a digital camera installed on an unmanned aerial vehicle flying at an altitude of 200 m captures an RGB image, and a near-infrared (NIR) image sensor captures the spectral reflectance of the 600 nm to 900 nm wavelength band or the red and NIR wavelength bands, the multiple The spectroscopy image sensor is a 400nm to 500nm wavelength band, a 600nm to 700nm wavelength band, or a blue and red wavelength band, and the hyperspectral image sensor is a spectroscopic image to measure the spectral reflectance in the 400nm to 600nm and 650nm to 750nm wavelength bands. Shoots a normal RGB video while shooting. Topographical survey is performed through the captured image, and 3D virtual space information is collected thereby. In hyperspectral imaging, up to 1,000 narrow spectral bands can be captured, so the reflection characteristics of an object can be recorded as it is to distinguish topography and features. Detect radiant energy.

Every imaging system has a measured wavelength range depending on the filter and sensor configuration. When only one type of wavelength band is used, it is called panchromatic, and in the case of a commonly used RGB image, it can be said to be a kind of multispectral imaging in which the sensor responds to three wavelength bands, R, G, and B. Since RGB is recognized by the human eye, RGB images are used a lot, but in reality, various types of configurations are possible. Here, hyperspectral imaging is spatial imaging added to a number of wavelengths as high as those used in general spectrometers. Each pixel has a spectrum as if taken with a spectrometer. When the wavelengths to be photographed are tens to hundreds and the relative spectral resolution is about 0.01, it is called hyperspectral, and the relative spectral resolution is called absolute spectral resolution/length of the spectrum. It is the value obtained by dividing the spectral resolution by the total wavelength range being photographed. Just as a general RGB image is in the form of a cube in which three images of red, blue, and green are stacked, in the case of hyperspectral image, a data cube in the form of stacking images of each wavelength to be captured is formed. There are several methods for capturing spectroscopic images, and measurement devices are classified accordingly. In the case of multi-spectral devices that take pictures by attaching filters according to wavelengths to the sensor like a general RGB image, the image is taken at once as a snapshot, and the data obtained varies depending on how the filter of the sensor is configured. Compared to the Pushbroom method that performs line scan or the Whisk-broom method that is point scan, it is much simpler as it is a snapshot method and has the advantage that all data are captured at the same time. less than the method.

On the other hand, in the case of the scanning method, as the name suggests, scanning is performed, so simultaneous shooting is not possible. Therefore, the device should not shake or the subject should not move. Pushbroom is the so-called line scanning method and is the most commonly used hyperspectral imaging method. At the time of one shot, light in a linear direction enters through the slit, and the light passes through a spectrometer and spreads for each wavelength band, becoming a plane and detected by a 2D detector. 2d images in the spatial and spectral directions are taken. Then, while the camera or object moves in the y direction, line scanning is performed to construct the entire 3D cube.

In the present invention, the river information collection device 100 is installed at multiple points along the river in the river area subject to information provision to acquire and collect "actual image information", the water level and velocity of the river, and the temperature of the river and river basin. and an environmental information collection unit 120 that collects "environmental information" including humidity. 6 is a schematic configuration diagram showing an example of capturing an actual image and extracting an image and terrain data from it in the present invention.

The environmental information collection unit 120 includes a plurality of CCTV modules installed on the ground along the river in the river area to be provided information to acquire actual images by taking video and still images, and a water level sensor installed on the water surface of the river to measure the water level. , a temperature sensor installed on the ground and on the water along the river including the embankment to measure land and water temperature, a humidity sensor installed on the ground along the river including the embankment to measure the humidity around the river, and the measured or measured information It may have a configuration including a data logger that stores and manages data for each time period, and a network sensor that provides a communication path for collecting and transmitting the measured or measured information by wire or wirelessly.

7 is a schematic block diagram of the configuration of the remote control device 200 is shown. As illustrated in FIG. 7 , in the present invention, the remote control device 200 includes an analysis and 3D imaging unit 210 and an information processing and forecast management unit 220 . In addition, since the remote control device 200 functions as a remote device that remotely manages related devices, it further includes an operation communication unit 230, a monitoring unit 240, an operation storage unit 250, and an operation control unit 260 have a configuration

In the remote control device 200, the analysis and 3D imaging unit 210 analyzes the information and data collected by the river information collection device 100 and transmitted through the communication network in real time to provide information within the shooting area of the river area to be provided. Determining whether there is an anomaly (whether a disaster such as a break in an embankment or a flood or other abnormal situations occur in the river area subject to information provision), identifying the contents of such anomaly, and predicting the possibility of anomaly < It is equipped with an information analysis program (algorithm). In addition, the analysis and 3D imaging unit 210 implements information generated by predicting and informationizing in the <information analysis program>, that is, terrain-image information, actual image information, environment information, and analyzed prediction information into 3D virtual space images. <3D virtual space program (algorithm)> is provided.

In the remote control device 200, the information processing and forecast management unit 220 stores data predicted and generated by <information analysis program> and <3D virtual space program> and outputs them to the control monitor at the same time, while outputting them to the control monitor according to the analysis results. If it is determined that there is an abnormal change in the river area subject to information provision, the 3D virtual space image and abnormal change alarm are transmitted to the personal communication terminal 300 of local residents and the personal communication terminal 400 of other people through the communication network. do. Here, the local residents' personal communication terminal 300 may be a smartphone or PC with a program including an application for activating forecast information transmitted from the remote control device 200 and embankment and river information including 3D virtual space. The stranger's personal communication terminal 400 may be a smartphone loaded with a program including an application for activating forecast information transmitted from the remote control device 200 and embankment and river information including 3D virtual space images.

In the remote control device 200, the operation communication unit 230 performs a function of communicating with the topographic information and image information collection unit 110 and the environment information collection unit 120 constituting the river information collection device 100. The monitoring unit 240 performs a function of outputting the information transmitted from the topographic information and image information collection unit 110 and the environment information collection unit 120 and finally analyzed information. The operation storage unit 250 performs a function of storing information transmitted from the topographic information and image information collection unit 110 and environment information collection unit 120 and finally analyzed information. The operation control unit 260 calculates and stores coordinate values for the shooting area based on GPS information and transmits them to the topographic information and image information collecting unit 110, or moves and operates the topographic information and image information collecting unit 110. is remotely controlled, and through a 3D virtual space program, a 3D virtual space image reflecting terrain-image information, actual image information, environment information, and analyzed prediction information is implemented, output to the monitoring unit 240, and operation storage unit 250 On the other hand, it performs a function of controlling the operation of the operational communication unit 230 for communication with the topographic information and image information collection unit 110 and the environment information collection unit 120.

Below, <information analysis program> and <3D virtual space program> provided in the analysis and 3D imaging unit 210 of the remote control device 200 will be described in more detail.

Figure 8 is a schematic block diagram showing the configuration of <information analysis program> provided in the analysis and 3D imaging unit 210 is shown. The <information analysis program> analyzes the information and data collected by the river information collection device 100 and transmitted through the communication network in real time to identify and predict the presence or absence of abnormalities or abnormal changes within the shooting area of the river area subject to information provision . Specifically, as illustrated in FIG. 8, the <information analysis program> includes hyperspectral image information and RGB image information transmitted from the topographic information and image information collection unit 110 and the environment information collection unit 120. It includes a data integration module that collects information, actual image information and environment information, and analyzed prediction information, converts them into images and text, outputs them to the monitor unit, and stores them in the operation storage unit. In addition, the <Information Analysis Program> analyzes the topography, water level, flow velocity, temperature and humidity of the corresponding shooting area of the river area subject to information provision, and analyzes disasters such as embankment collapse and flood within the corresponding filming area of the river area subject to information provision. Determining whether or not other abnormal phenomena have occurred, analyzing the contents of the abnormal phenomenon, predicting the possibility of an abnormal occurrence, generating prediction information through such analysis and prediction, outputting it to the monitor unit, and storing it in the operation storage unit. It may be configured to include an analysis module, and an environmental evaluation module that inputs final prediction information according to a table set in advance, processes it into environmental evaluation data for the shooting area, and provides it.

Also, as described above, the analysis and 3D imaging unit 210 includes a <3D virtual space program>. <3D Virtual Space Program> implements terrain-image information, actual image information and environment information, and analyzed prediction information into 3D virtual space images. 9 is a schematic block diagram showing the configuration of <3D virtual space program> provided in the analysis and 3D imaging unit 210 . As illustrated in FIG. 9, the <3D virtual space program> includes a virtual space information management part and an image control part. Specifically, the virtual space information management part of <3D virtual space program> is composed of a collection information DB module, an image collection module, an image matching processing module, a search module, a data processing module, and a monitoring module. In the collection information DB module, terrain-image information from the terrain information and image information collection unit 110, actual image information from the environment information collection unit 120, reference images and video images, and SIFT descriptor data is stored That is, the collection information DB module stores topographic-image information of the topographic information and image information collection unit 110, reference image and video image of the environment information collection unit 120, and SIFT descriptor data. The image collection module collects reference images of the space according to the shooting angles for each camera position of the topographic information and image information collection unit 110 and the environment information collection unit 120, The shooting point is set according to the reference image and stored in the collection information DB module. The image matching processing module analyzes the video image, sets SIFT descriptor data for each section in the video image according to the SIFT algorithm, stores it in the collection information DB module, and determines the intersection of adjacent video images based on the SIFT descriptor data. By matching, a virtual space image is created and stored in the collection information DB module. The monitoring module performs a function of monitoring the processing status of the image matching processing module.

The image control part of the <3D virtual space program> includes a search module for searching the collection information DB module for necessary information, a data processing module for controlling the execution of the image collection module, image matching processing module, and monitoring module; It has a configuration including a spatial image editing module that executes a dashboard for outputting the control status of the data processing module and inputting control information.

As described above, the remote control device 200 includes an information processing and forecast management unit 220 . In the information processing and forecast management unit 220, the data predicted and generated by the <information analysis program> and <3D virtual space program> are stored and output to the control monitor at the same time, and the river area subject to information provision according to the analysis result If it is determined that an abnormal change has occurred within, an <information processing program> for transmitting and guiding the 3D virtual space image and an abnormal change alert to the local residents' personal communication terminal 300 and the other person's personal communication terminal 400 through the communication network will be installed. can In addition, in the information processing and forecast management unit 220, personal information collection, confirmation, and approval are performed in advance to use the forecast service in relation to the local residents' personal communication terminal 300 to make a forecast <local forecast service program (algorithm)> may be installed, and furthermore, if a personal communication terminal 400 of another person is captured in the region through a communication network, if the forecast service is used after checking whether it is used, personal information is collected, confirmed, and approved. A <foreigner forecast service program (algorithm)> that performs an operation to make a forecast may be additionally installed in the information processing and forecast management unit 220 .

The remote control device 200 is installed in the river management entity, that is, the government or local government or environment-related management institutions and research institutes, and is a monitor unit installed in public offices, public facilities, etc. in the river area to be provided information related to the river area to be provided. While outputting information and 3D virtual space images, it outputs immediate emergency guidance information in the event of an abnormality including flood.

The remote control device 200 controls the operation of the topographic information and image information collection unit 110. For example, shooting and angle change or rotation of a photographing means fixed at a corresponding location, or an unmanned air vehicle operating in a corresponding area. Set the flight route or remotely control it in real time to make the movement. At this time, when the means for collecting the hyperspectral image and the RGB image of the topographical information and image information collection unit 110 is mounted on the unmanned aerial vehicle, the unmanned aerial vehicle is equipped with an automatic navigation device to enable autonomous driving, so the shooting area in advance. When a GPS coordinate point for is input, the unmanned aerial vehicle moves according to the set coordinates of the corresponding embankment along a preset flight path and acquires a hyperspectral image and an RGB image. In addition, the topographic information and image information collecting unit 110 moves along a pre-set navigation route, but detects a location through a GPS signal and automatically navigates to correct data for rolling and pitching of the topographic information collecting device 110. simultaneously record the attitude value and save their flight path. In this state, the topographic information and image information collection unit 110 captures a hyperspectral image with a hyperspectral sensor such as a near-infrared image sensor, a multispectral image sensor, or a hyperspectral image sensor, and images of previously set spectral or RGB image information. Depending on the degree of (color) gradient, RGB image information is additionally captured and analyzed in close proximity to a place where an event has occurred, that is, a flood has occurred or a flood is suspected.

As described above, in the present invention, as a result of analyzing the spectroscopic image taken by the hyperspectral image sensor of the topographic information and image information collection unit 110, the water level or velocity of the river in the river area to be provided information rapidly increases or a situation in which flooding is suspected When this occurs, the flight body temporarily departs from the preset flight path, moves to the corresponding coordinates, takes an RGB image, and transmits it to the remote control device 200 for analysis, so that it does not depend only on the analysis algorithm or program. Admins can further improve the accuracy of their analysis by adding intuitive rating analysis via photo verification.

That is, in the present invention, as described above, the hyperspectral image and RGB transmitted after being photographed by the hyperspectral sensor of the photographing means including the unmanned aerial vehicle flying along the set navigation route of the river including the embankment or various types of cameras fixed in the sky The image is analyzed by the information analysis program of the information processing and forecasting management unit 220, and according to the analysis result, if the water level or flow speed in the river increases rapidly or flooding is suspected, the unmanned air vehicle, etc. temporarily deviate from the preset navigation route. It moves to the corresponding coordinates, takes an RGB image, and transmits the hyperspectral image and the RGB image to the remote control device 200. Accordingly, the remote control device 200 collects the transmitted information, analyzes whether the water level and flow velocity are approaching or included in the flood range when flooding is expected in the river area to be provided information through the self-loaded information analysis program, and provides information The cross section of the river in the target river area is analyzed and converted into data. Therefore, according to the present invention, it is possible to improve the precision or accuracy of information analysis on the river area subject to information provision, and the analyzed data can be provided as evaluation data for the possibility of disasters such as river environment evaluation and flood occurrence. will be able to

In addition, according to the present invention, multi-layered information collection and analysis are made based on hyperspectral image information by utilizing ultraviolet and infrared characteristics, which cannot be confirmed by general RGB images, that is, characteristics that cannot be seen by the human eye. By making it possible to collect multi-dimensional and three-dimensional information and analyze the condition of the river area to be provided information through this, it is possible to analyze a wide range of information about the river area to be provided information. In particular, in the present invention, multi-layered information collection and analysis is performed based on hyperspectral image information that utilizes ultraviolet and infrared characteristics, not the naked eye, so that the manager does not visually check the water level, flow rate, temperature, and humidity of the river directly from the embankment. etc. can be analyzed.

Furthermore, according to the present invention, through the improvement of the precision or accuracy of the analysis of the state information of the river area subject to information provision and the additional analysis scalability, the environmental investigation of the river area subject to information provision can be quantitatively performed, and accordingly, the future embankment The advantage is that environmental assessments and assessments of the possibility of disasters such as earthquakes and floods can be additionally performed.

As described above, in the present invention, moving images and still images of the river are taken in the information provision target river area through the CCTV module constituting the environmental information collection unit 120, the water level of the river is measured through the water level sensor, and the temperature sensor The remote control device (200 ) is sent to

The remote control device 200 collects the data captured or measured by the topographic information and image information collection unit 110 and the environment information collection unit 120, corrects the deviation and outputs it as integrated analysis data, or the deviation exceeds the set range. If it exceeds, it has a control function to manage re-shooting and measurement for the location. When the remote control device 200 collects the data captured or measured by the topographic information and image information collection unit 110 and the environment information collection unit 120 and corrects the deviation, various analysis values are obtained from the collected photographed or measured data. It is desirable to calibrate the total sum of by the average value divided by the number of measurements, and if it exceeds the set deviation range, it means that a change has occurred in the corresponding location of the river, including at least the embankment, for example, a flood (or drought) has occurred. , By operating the unmanned aerial vehicle of the topographic information and image information collection unit 110 to re-photograph and measure the entire embankment, or move to the corresponding coordinates of the embankment and re-photograph and measure to perform reanalysis, the state of the embankment allow for more accurate analysis.

In the present invention, the collected and analyzed information about whether or not there is an anomaly or anomaly change information about the information provision target river area is implemented as a 3D virtual space image. To this end, the operation control unit 260 of the remote control device 200 sets an area to implement a 3D virtual space. It is to select the scope of EDC virtual space based on the basic information of EDC (Eco Delta City) obtained by collecting data to review the scope of virtual space. 10 is a schematic illustration showing an example of setting an area to implement a 3D virtual space.

In the present invention, by the analysis of the remote control device 200 and the 3D virtual space program provided in the 3D imaging unit 210, the terrain-image information of the topographic information and image information collection unit 110, and the environment information collection unit ( 120) based on the actual video information and environment information, storing the reference image, video image, and SIFT descriptor data, and shooting by camera position of the geographic information and image information collection unit 110 and the environment information collection unit 120 The reference image of the space according to each angle is collected, and the shooting point of the video image collected by re-shooting the indoor space is set according to the reference image and stored in the collection information DB module. In addition, <3D virtual space program> analyzes the video image, sets SIFT descriptor data for each section in the video image according to the SIFT algorithm, and stores it in the collection information DB module. Matching based on the data creates a virtual space image and stores it in the collection information DB module. And in the <3D virtual space program>, the processing status of the image matching processing module is monitored, the collection information DB module is searched for necessary information, and the dashboard for outputting the control status of the data processing module and inputting control information is executed.

In the present invention, the collected and analyzed information on whether or not an anomaly has occurred or anomaly change in the information provision target river area is implemented as a 3D virtual space image. To this end, the operation control unit 260 of the remote control device 200 sets a 3D virtual space realization zone. It is to select the scope of EDC virtual space based on the basic information of EDC (Eco Delta City) obtained by collecting data to review the scope of virtual space.

In the present invention, by analysis of the remote control device 200 and <3D virtual space program> provided in the 3D imaging unit 210, terrain-image information and environmental information of the topographic information and image information collection unit 110 are collected. Stores the reference image, video image, and SIFT descriptor data according to the actual video information and environment information of the unit 120, and the camera positions of the geographic information and image information collection unit 110 and the environment information collection unit 120 The reference image of the space according to each shooting angle is collected, and the shooting point of the video image collected by re-shooting of the indoor space is set according to the reference image and stored in the collection information DB module. In addition, <3D virtual space program> analyzes the video image, sets SIFT descriptor data for each section in the video image according to the SIFT algorithm, and stores it in the collection information DB module. Matching based on the data creates a virtual space image and stores it in the collection information DB module. And in the <3D virtual space program>, the processing status of the image matching processing module is monitored, the collection information DB module is searched for necessary information, and the dashboard for outputting the control status of the data processing module and inputting control information is executed.

To explain this in more detail, when the topographic information and image information collection unit 110 and the environment information collection unit 120 collect and transmit video images taken according to the corresponding shooting angle, <3D virtual space program> The image collection module stores the transmitted video image in the collection information DB module.

The image matching processing module compares the collected image with the standard image. If the image is found to be inconsistent with the reference image, the image matching processing module adjusts the shooting angle information of the inconsistent image to the shooting angle of the reference image. correct Specifically, the collected image and the video image must be taken and collected at the same shooting angle, and furthermore, the collected image and the video image must be taken in the same section. The collected image of the shooting angle and the video image are compared with each other to determine whether there is an error. If the error is confirmed, the shooting angle information of the corresponding video image is adjusted with the shooting angle information of the collected image, and the corrected video image is stored in the collection information DB module. is to save

In addition, the image matching processing module analyzes the video image, sets SIFT descriptor data for each section in the video image according to the SIFT algorithm, stores it in the collection information DB module, and determines the intersection of adjacent video images based on the SIFT descriptor data. By matching, an image of an indoor space is created. Since the cameras of the topographic information and image information collection unit 110 and the environmental information collection unit 120 capture the monitoring target, that is, the river including the embankment, at various shooting angles, the image matching processing module has a number of It is necessary to select only a specific section from a video image and perform processing to connect neighboring video images. To this end, the image matching processing module analyzes the video images linked to the corresponding shooting angles, finds sections serving as references from neighboring shooting angles, connects them, and performs matching. For this matching, a specific target that can be a matching criterion is required for video images, and the image matching processing module checks the image of the specific target, matches the video images with each other, and edits them.

This image matching processing module analyzes video images based on the SIFT algorithm to classify and set specific targets. SIFT of SIFT algorithm stands for Scale-Invariant Feature Transform, and is a basic solution for matching multiple video images to each other. The image matching processing module determines based on the location pixel value and distance measurement information of feature points through 3D interpolation, which is an extreme localization process, in a section that can be targeted according to the SIFT algorithm.

The image matching processing module finds a locally swollen part in the image of the object (Scale-space extrema detection). That is, it is to find a characteristic part (a part that appears prominently) in the video image, and the found part is classified as a feature point of the object. In addition, the image matching processing module selects a key point, which is a reliable final feature point, from among previously identified feature points. To this end, the image matching processing module first selects the final feature point based on the pixel value (intensity) of the corresponding feature point and the position or size corresponding to the corner of the object among the feature points, and sets it as a key point of the corresponding video image. Then, the image matching processing module obtains the gradient of the area around the key point, and obtains the directions indicated by the pixel values of the area around the key point as a whole. That is, since the feature point set as the key point corresponds to a corner of the corresponding object image, one or more side images are included around the feature point, and pixel values of the side image are formed toward pixels of the corresponding key point.

Thereafter, the image matching processing module rotates the direction of the constituent pixels of the peripheral area to be 0 degrees, sets the portion corresponding to the peripheral area as SIFT descriptor data, and stores it in the collection information DB module. Through this, one or more SIFT descriptor data is configured in the video image. Therefore, even if there is a change in the video image according to the shooting angle, the video matching processing module recognizes the surrounding area set as the SIFT descriptor data as the same section. For reference, the SIFT descriptor data includes pixel values of a region surrounding a key point, and histogram information based on direction information of pixel values of a region surrounding the key point. Therefore, the SIFT descriptor data enables the image matching processing module to identify targets representing the same section in the image changed according to the photographing angle and accurately match adjacent image images.

In general, the recommended histogram dimension in the SIFT algorithm is 128-dimension, so regardless of the shooting angle of the camera, the video image containing the same section is accurately extracted by the image matching processing module and shared in neighboring video images. A video image is matched based on the SIFT descriptor data, and other necessary sections are combined with each other to generate a precise image for the river area to be provided. An example of the generated image is illustrated in FIG. 11 .

In the present invention, existing template data of a 3D virtual space image to be completed may be utilized in the process of performing video image matching by the image matching processing module. To this end, the virtual space information management part included in the <3D virtual space program> of the analysis and 3D imaging unit 210 may further include an existing information DB for storing existing video images and template data for the same indoor space. The image matching processing module searches the existing information DB under the control of the search part for the existing image image for the river area to be provided, and performs matching processing of the new image image according to the SIFT algorithm based on the template data do. That is, if there is an existing image of the same information provision target river area, the image matching processing module searches the existing template data of the corresponding spatial image from the existing information DB, and based on the template data, searches for a combination of image images. Easy to do.

The image matching processing module formats the spatial image generated according to the above process and stores it in the collection information DB module. The formatting converts the spatial images completed by matching all the video images to each other and converts them into a designated format, through which The operator can search and output the spatial image to be output with the image control part.

In this way, in the present invention, in the process of implementing a 3D virtual space in <3D virtual space program>, the terrain-image information collected in real time or periodically by the terrain information and image information collection unit 110 and the environment information collection unit 120 , by substituting and realizing changes in actual image information and environmental information, change information on the state of the river area to be provided information, for example, prediction of bank subsidence or collapse and the possibility of flood or drought, and corresponding information and risk situations It is possible to intuitively provide information to river management entities and residents of surrounding areas through 3D virtual space images.

In addition, in the present invention, information on the state of the river zone to be provided is quickly and intuitively provided through 3D virtual space images, so that the possibility of flood occurrence in the river zone to be provided and the corresponding location are easily identified. , it is possible to ensure that the initial response is made quickly and accurately.

Although the present invention has been described and illustrated in relation to preferred embodiments for illustrating the principles of the present invention, the present invention is not limited to the configuration and operation as shown and described. Additionally, those skilled in the art will appreciate that many changes and modifications may be made to the present invention without departing from the spirit and scope of the appended claims. Accordingly, all such appropriate changes and modifications and equivalents should be regarded as falling within the scope of the present invention.

100: river information collection device
110: topographic information and image information collection unit
120: environmental information collection unit
200: remote control device
210: analysis and 3D imaging unit
220: Information processing and forecast management department
230: operation communication department
240: monitoring unit
250: operation storage unit
260: operation control unit
300: personal communication terminal for local residents
400: personal communication terminal of stranger

Claims (10)

For the river area subject to provision of information, topography-image information including hyperspectral image information and RGB image information is collected, and actual image information and water level, current velocity, temperature and humidity are collected from multiple points on the ground or above water in the subject river area to be provided information. River information collection device for collecting environmental information in real time, including; and
Based on the information data collected and transmitted by the river information collection device, whether an anomaly has occurred or an anomaly has changed within the river area to be provided information is analyzed, and the terrain-image information, actual image information, environmental information, and analyzed prediction information are analyzed. Implemented as a 3D virtual space image, saved and output. According to the analysis results, if it is judged that an abnormal change has occurred or an abnormal change is predicted to occur within the river area subject to information provision, 3D virtual space images and abnormal change alerts are sent to the personal communication terminals of local residents and others subscribed to the forecast service. A river condition information providing system characterized in that it has a configuration including a remote control device for guiding transmission. According to claim 1,
The river information collection device,
a topographic information and image information collection unit that collects hyperspectral image information and RGB image information for a river area subject to information provision; and
Features include an environmental information collection unit that collects actual image information at multiple points along the river in the river area subject to information provision, and collects environmental information including the water level and flow rate of the river, and the temperature and humidity of the river and its surroundings River condition information providing system to be. According to claim 2,
Geographic information and image information collection department,
a hyperspectral sensor having spectral information characteristics in the ultraviolet and infrared regions, which captures images by subdividing the visible and near-infrared wavelength bands; and
A river condition information providing system comprising a digital camera for taking RGB images. According to any one of claims 1 to 3,
Environmental information collection department,
A plurality of CCTV modules installed on the ground along the river of the river area subject to information provision and acquiring actual image information by capturing moving images and still images;
A water level sensor installed on the water surface of the river to measure the water level;
Temperature sensors installed on land and water along rivers including embankments to measure land and water temperatures;
A humidity sensor installed on the ground along the river including the embankment to measure the humidity around the river;
a data logger that stores and manages the measured or measured information by time period; and
A river state information providing system comprising a network sensor providing a communication path for collecting and transmitting the measured or measured information by wire or wirelessly. According to any one of claims 1 to 3,
The remote control device includes an analysis and 3D imaging unit, and an information processing and forecast management unit;
The analysis and 3D imaging unit, when the information data collected by the river information collection device is transmitted, an information analysis program that predicts the presence or absence of abnormalities or changes in abnormalities within the shooting area of the river area to be provided information and turns them into information, and the information analysis program Includes a 3D virtual space program that implements prediction information, terrain-image information, and environmental information made by predicting and informatizing in 3D virtual space images;
The information processing and forecast management department stores the data generated by the information analysis program and the 3D virtual space program and outputs it to the control monitor. According to the analysis result, if it is determined that there is an abnormal change in the river area to be provided information, the 3D virtual space image A river condition information providing system characterized by transmitting and guiding an abnormal change alert to a personal communication terminal of a local resident and a personal communication terminal of another person through a communication network. According to claim 5,
The remote control device is
an operating communication unit for communicating with the topographic information and image information collection unit constituting the river information collection device and the environment information collection unit;
a monitoring unit outputting information transmitted from the topographic information and image information collection unit and the environment information collection unit and finally analyzed information;
Operation storage unit for storing the information transmitted from the topographic information and image information collection unit, and the environment information collection unit and finally analyzed information; and
Based on GPS information, coordinate values for the shooting area are calculated and stored, and they are transmitted to the topographic information and image information collection unit, or the movement and operation of the topographic information and image information collection unit are remotely controlled. Information, actual image information, environment information, and analyzed prediction information are implemented as 3D virtual space images, output to the monitoring unit, stored in the operation storage unit, and an operation control unit for controlling the operation of the operation communication unit. information provision system. According to claim 5,
The information analysis program of the analysis and 3D imaging department,
Terrain-image information including hyperspectral image information and RGB image information transmitted from the topographic information and image information collection unit and the environment information collection unit. A data integration module that collects actual image information, environment information, and analysis information, converts them into images and text, outputs them to the monitor unit, and stores them in the operating storage unit;
Based on terrain-image information, actual image information and environmental information, and the analyzed information, the topography, water level, flow velocity, temperature, and humidity of the river area subject to information provision are analyzed to determine whether anomalies have occurred or abnormal changes in the river area subject to information provision A change occurrence analysis module for generating prediction information by determining and analyzing, outputting it to the monitor unit, and storing it in the operation storage unit; and
River state information providing system, characterized in that it is configured to include an environmental evaluation module that inputs prediction information according to a table set in advance, processes it into environmental evaluation data for the shooting area of the river area to be provided information, and provides it. According to claim 5,
The 3D virtual space program of the analysis and 3D imaging unit is composed of a virtual space information management part and an image control part;
The virtual spatial information management part includes a collection information DB module in which topography-image information of the topographic information and image information collection unit, reference image and video image of the environment information collection unit, and SIFT descriptor data are stored; The geographic information and image information collection unit 110 and the environment information collection unit collect reference images of the space according to the shooting angle for each camera position, and set the shooting point of the video image collected by re-shooting the indoor space according to the reference image Image collection module to store in the collection information DB module; The video image is analyzed, SIFT descriptor data is set for each section within the video image according to the SIFT algorithm, stored in the collection information DB module, and the intersection section of neighboring video images is matched based on the SIFT descriptor data to obtain a virtual space image Image matching processing module for generating and storing in the collection information DB module; and a monitoring module for monitoring the processing status of the image matching processing module;
The image control part includes a search module for searching the collection information DB module to retrieve necessary information; a data processing module controlling execution of the image collection module, image matching processing module, and monitoring module; and a spatial image editing module that executes a dashboard for outputting the control status of the data processing module and inputting control information. According to claim 5,
In the information processing and forecast management department,
The data predicted and generated by the information analysis program of the analysis and 3D imaging department and the 3D virtual space program are stored and output to the control monitor at the same time, and if it is determined that an abnormal change in the measurement target area has occurred according to the analysis result, the 3D virtual space image Information processing program for transmitting and guiding abnormal change alerts to local residents' personal communication terminals and other people's personal communication terminals through a communication network;
A local forecast service program that collects, confirms, and approves personal information in advance with local residents' personal communication terminals to make forecasts for the use of forecast services; and
When a personal communication terminal of another person is captured in the region through a communication network, a forecast service program of a third party that collects, confirms, and approves personal information is performed to make a forecast in case of application for use after checking whether or not the forecast service is used. A river condition information providing system characterized in that it is mounted. A method for providing river condition information by collecting and analyzing terrain-image information, environmental information, and actual image information through a river condition information providing system equipped with a river information collection device and a remote control device,
Through the river information collection device, topographic-image information including hyperspectral image information and RGB image information for the river including the embankment in the measurement target area, actual image information at multiple points on the ground or above the water including the corresponding embankment, and water level , Collecting environmental information including flow rate, temperature and humidity in real time; and
Through the remote control device, based on the information and data collected and transmitted by the river information collection device, it is determined and analyzed whether an anomaly has occurred and the contents of the anomaly in the measurement target river area, and the occurrence of the anomaly is predicted, topographic-image information, By combining environmental information, actual image information, and analyzed prediction information, it is realized, saved, and output as a 3D virtual space image. According to the analysis result, if it is determined that an abnormality has occurred or an abnormal occurrence is predicted, a step of transmitting and guiding a 3D virtual space image and anomaly change alert to local residents' personal communication terminals subscribed to the forecast service in advance and other personal communication terminals River state information providing method characterized in that it comprises.

Images