KR102569406B1 - System and server for monitoring green and red tide using multi-spectral camera, and method thereof - Google Patents

Abstract

In the green algae/red tide monitoring system according to an embodiment of the present invention, an analysis model for analyzing green algae/red tide information in multispectral data and a learning model for learning multispectral data in an environment in which a problem occurs are constructed, An AI server that receives 1 multispectral data from a camera connected to the UAV, analyzes the first multispectral data using the analysis model, and transmits an analysis result of the first multispectral data to an application server, and the AI server An application server that generates a notification message or a notice message based on the analysis result received from and transmits the generated message to an external electronic device, and various other embodiments may be possible.

Description

Green tide/red tide monitoring system and server using multi-spectral camera and method thereof {SYSTEM AND SERVER FOR MONITORING GREEN AND RED TIDE USING MULTI-SPECTRAL CAMERA, AND METHOD THEREOF}

The present invention relates to a real-time green/red tide monitoring system and server using a multi-spectral camera and a method therefor.

Recently, due to abnormal climate, green algae and red tide problems (eg, occurrence of green algae and red tides) have occurred nationwide, causing damage to farms and problems with supply and demand of drinking water. Accordingly, a plan to prevent and respond to green algae and red tide problems in advance is required, and a method of monitoring green algae and red tides using data obtained from manned planes or satellites is being used.

On the other hand, the method in which the user monitors green and red tides using data from a lure or satellite can take a lot of time to identify problems with green and red tides and come up with countermeasures, and reading errors may occur depending on user fatigue and expertise. The probability of occurrence is high, and analysis ability is not consistent, analysis time is delayed, or accurate detection may be difficult.

In addition, a method of monitoring green algae and red tides using an airborne device may be considered, but it may be more accurate than user analysis, but excessive costs may be required.

Therefore, the present invention seeks to acquire accurate and rapid monitoring analysis results by acquiring multispectral images and analyzing the acquired multispectral images using artificial intelligence technology in order to accurately monitor green and red tides in real time. The purpose.

In addition, an object of the present invention is to build and update a model for analyzing and predicting problems of green algae and red tides based on monitoring analysis results.

According to an embodiment of the present invention proposed to solve the above problems, a method for monitoring green algae and red algae in a control server of a green algae and red tide monitoring system is an analysis model for analyzing green algae and red tide information in multispectral data. A process of controlling an AI server to build a learning model for learning multispectral data in green and red tides where a problem occurred, a process of controlling the AI server to receive first multispectral data from a camera device connected to an UAV, The process of controlling the AI server to analyze the first multispectral data using the analysis model, the process of controlling the AI server to transmit the analysis result of the first multispectral data to an application server, and The method may include generating a notification message or a notice message based on the received analysis result, and controlling the application server to transmit the generated message to an external electronic device.

According to an embodiment of the present invention, a green algae/red tide monitoring system includes a camera device connected to an unmanned aerial vehicle to obtain multispectral data, an analysis model for analyzing green algae/red tide information from the multispectral data, and an area where green algae/red tides occur. When first multispectral data is received from an AI server that builds a learning model for learning multispectral data in, an application server that generates a message and transmits the generated message to an external electronic device, and the camera device, Controls the AI server to analyze the first multispectral data using the analysis model, controls the AI server to transmit an analysis result of the first multispectral data to an application server, and and a control server controlling the application server to transmit a notification message or a notice message generated based on analysis results to the external electronic device, and the green algae/red tide information may include information related to green algae or red tides. there is.

In the green algae/red tide monitoring system and server according to the present invention, the problem of green algae/red tide is accurately monitored using multispectral data, and the result of the monitoring is transmitted to the user's electronic device in the form of a notification message, so that the user can view the data in real time. It is effective in monitoring green algae and red tides and predicting the occurrence of green algae and red tides or problems.

Effects of the present invention are not limited thereto, and various effects will be described in detail below with reference to each embodiment.

1 is a diagram showing the structure of a green algae/red algae monitoring system according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a camera device according to an embodiment of the present invention.
3 is an operational flowchart illustrating an operation of monitoring green and red tides according to an embodiment of the present invention.
4 is a diagram illustrating a screen configuration of a green/red tide monitoring application according to an embodiment of the present invention.
5 is a diagram showing the configuration of a notification message transmitted from the green/red tide monitoring system according to an embodiment of the present invention.
6 is a diagram showing a screen displaying green algae and red tide information in a green algae and red tide monitoring application according to an embodiment of the present invention.
7 is a diagram showing the structure of a green algae/red algae monitoring system according to another embodiment of the present invention.
8 is an operational flowchart illustrating an operation of monitoring green algae and red tides in a system for monitoring green algae and red tides according to another embodiment of the present invention.

Since the technology to be described below can have various changes and various embodiments, specific embodiments will be illustrated in the drawings and described in detail. However, it should be understood to include all modifications, equivalents, or substitutes included in the spirit and scope of the technology described below.

Terms such as first, second, A, B, etc. may be used to describe various elements, but the elements are not limited by the above terms, and are merely used to distinguish one element from another. used only as For example, without departing from the scope of the technology described below, a first element may be referred to as a second element, and similarly, the second element may be referred to as a first element. The terms and/or include any combination of a plurality of related recited items or any of a plurality of related recited items. For example, 'A and/or B' may be interpreted as meaning 'at least one of A or B'. Also, '/' can be interpreted as 'and' or 'or'.

In the terms used in this specification, singular expressions should be understood to include plural expressions unless clearly interpreted differently in context, and terms such as “comprising” refer to the described features, numbers, steps, operations, and components. , parts or combinations thereof, but it should be understood that it does not exclude the possibility of the presence or addition of one or more other features or numbers, step-action components, parts or combinations thereof.

Prior to a detailed description of the drawings, it is to be clarified that the classification of components in the present specification is merely a classification for each main function in charge of each component. That is, two or more components to be described below may be combined into one component, or one component may be divided into two or more for each more subdivided function. In addition, each component to be described below may additionally perform some or all of the functions of other components in addition to its main function, and some of the main functions of each component may be performed by other components. Of course, it may be dedicated and performed by .

In addition, in performing a method or method of operation, each process constituting the method may occur in a different order from the specified order unless a specific order is clearly described in context. That is, each process may occur in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order.

1 is a diagram showing the structure of a green algae/red algae monitoring system according to an embodiment of the present invention.

Referring to FIG. 1 , the green/red tide monitoring system 100 includes a control server 101, a camera device 102, an AI server 103, an application (APP) server 104, and a database (DB) server ( 105) may be included.

According to one embodiment of the present invention, the control server 101 may control operations in the overall green/red tide monitoring system 100 . For example, the control server 101 transmits the multispectral data and images obtained from the camera device 102 to the AI server 103 in real time, controls the analysis of the multispectral data to be performed in real time, and controls the AI server ( The analysis result in 103) can be controlled to be processed into application data through the app server 104. In addition, the control server 101 may store in the DB server 105 an analysis result of green/red tide information and a learning model for analyzing multispectral data.

According to one embodiment of the present invention, the camera device 102 is mounted on the unmanned aerial vehicle 201 (or drone) and can be controlled to photograph green and red tides in real time while flying according to the movement of the unmanned aerial vehicle 201.

According to an embodiment of the present invention, the AI server 103 may monitor and analyze green tide/red tide information in real time based on multispectral data received from the camera device 102 or the control server 101.

According to an embodiment of the present invention, the AI server 103 may receive, from the control server 101 , an image of an area where green algae or red tides occur, information about an area where green algae or red tides occur, and time information. For example, the AI server 103 builds a learning model for determining/predicting green or red tide based on the information received from the control server 101, and updates the learning model based on multispectral data that is subsequently input. can do.

According to an embodiment of the present invention, the AI server 103 may set a green algae/red algae phenomenon detection filter based on a learning model. The green algae/red tide detection filter is for classifying a green algae or red tide phenomenon occurrence area according to the flight time, flight direction, altitude or speed of the unmanned aerial vehicle 201 . For example, the AI server 103 may apply multispectral data to the green/red tide discrimination filter.

According to an embodiment of the present invention, as the sensor data, image data, and information of the multispectral image data of the multispectral data correspond to the set values of the green/red tide discrimination filter, the AI server 103 determines the corresponding multispectral data. The area where the data was acquired can be identified as an area where red tide or algal bloom is suspected.

According to one embodiment of the present invention, the green algae phenomenon may mainly occur in rivers or lakes, and the red tide phenomenon may mainly occur in the sea. Accordingly, the AI server 103 further checks surrounding environment information for an area where red tide or green algae are suspected (eg, a river, lake, or sea) to determine which of the red tides or green algae has occurred in the corresponding area. It is possible to build a green tide/red tide phenomenon judgment learning model for judgment. The surrounding environment information may be a flight path of the UAV 201 and GPS information in a part except for an image of a region in which red tide or green tide is suspected to occur on image data of multispectral data.

According to an embodiment of the present invention, the AI server 103 may further learn climate prediction information as a result of learning with the green algae/red tide determination learning model to set the green algae/red tide action level. The climate prediction information may include weather-related information such as expected temperature, expected wind volume, expected precipitation, expected humidity, and expected atmospheric pressure. For example, the AI server 103 learns as a learning model for determining green algae/red tides according to climate prediction information, and for green algae or red tides occurring in a specific region, a serious state requiring urgent action, a normal state requiring action, or action It can be judged as one of the good states that do not require

According to an embodiment of the present invention, the AI server 103 may store information on a learning model for green and red tide information in the DB server 104 . For example, the DB server 104 may store data for a learning model capable of determining and predicting green and red tide information for each climate and time zone.

According to an embodiment of the present invention, the AI server 103 receives multispectral data from the camera device 102, and determines whether green algae or red tides are confirmed or expected to occur in the received multispectral data based on the learning model. can predict

According to one embodiment of the present invention, the AI server 103 checks whether the area where the UAV 201 shoots is a river, lake or sea, and information on the background environment in each area, the flight path of the UAV 201 Alternatively, the occurrence of green or red tide may be predicted by further considering GPS information. For example, as a result of analyzing the received multispectral data, the AI server 103 analyzes the received multispectral data, but algae does not occur. As the GPS information is determined to be a place where algal blooms frequently occur, it can be predicted that algal blooms will occur in the corresponding region.

According to an embodiment of the present invention, the app server 104 may process the green algae/red tide information analyzed by the AI server 103 into data that can be output through an application and transmit the data to an external device. For example, the app server 104 may process the data to be transmitted to the external device by analyzing it according to the display, processable memory, etc. of the external device. For example, the green tide/red tide information may include a forecast and a current green/red tide phenomenon state.

According to an embodiment of the present invention, the app server 104 may transmit information monitored by the control server 101 to an external device in the form of a notification message. For example, the monitoring information includes information notifying that algal blooms or red tides have occurred or that algal blooms or red tides are expected to occur in a specific area, and includes information such as the location, weather, time, etc., and map information of the marine area. and state information of green algae or red algae.

According to an embodiment of the present invention, the app server 104 transmits green/red tide monitoring information to an external device, and the external device can output the transmitted information through an application installed in the external device. The information may be output in the form of a pop-up/notification message or may be output through a UI/UX set in an application.

According to an embodiment of the present invention, the DB server 105 may store green tide/red tide information monitored for a certain period of time by region or time zone, and various other conditions (eg, spectral band, temperature, humidity, or season). Depending on the information, green tide and red tide information can be classified and stored.

According to an embodiment of the present invention, the AI server 103 may perform analysis on green algae and red tides monitored based on green algae and red tide information stored in the DB server 105 . For example, if data on the occurrence of green algae or red tides of a certain amount or more is stored in a specific region, specific weather, or specific time zone, the AI server 103 predicts that the corresponding region, weather, or time zone has a high possibility of occurrence of green algae or red tide. conditions can be set.

2 is a block diagram showing the configuration of a camera device according to an embodiment of the present invention.

Referring to FIG. 2 , the camera device 102 may include a control module 210, a communication module 220, a sensor module 230, a multi-spectral sensor 240 and an image sensor 250. can In addition, the camera device 102 is configured to be coupled to or included in the UAV 201, and may obtain multispectral data or image data while flying according to the movement of the UAV 201.

According to one embodiment of the present invention, the control module 210 may control the overall operation of the camera device 102 . For example, the control module 210 transmits and receives information related to the control of the unmanned aerial vehicle 201 through the communication module 220, obtains multispectral data using the multispectral sensor 240, and at the same time uses the sensor module 230 and the image sensor 250 to obtain GPS data and image data.

According to one embodiment of the present invention, the control module 210 may transmit a control command to the UAV 201 through the communication module 220 and control the UAV 201 to fly according to the control command. For example, the control command includes flight setting information for flying in a certain direction, angle, speed, or height, a marine area in which the unmanned aerial vehicle 201 can fly, or an area in which shooting with the unmanned aerial vehicle 201 is permitted for each user. Local information including information about may be included.

According to an embodiment of the present invention, the control command may include route information for photographing green tide/red tide information for each time zone or for each sunrise direction. For example, the control module 210 transmits a control command according to the guard mode to the UAV 201 when it is desired to obtain green tide/red tide information in the guard mode, and in response, the UAV 201 moves to a designated point at each designated time period. It is possible to photograph green and red tides while turning them in a designated order (eg, clockwise, counterclockwise, or user setting).

According to an embodiment of the present invention, the control module 210 may determine that a green algae/red tide problem has occurred in a specific area while the unmanned aerial vehicle 201 is photographing the green algae/red tide. At this time, the control module 210 transmits a control command resetting the return time, shooting time or shooting direction of the UAV 201 to the UAV 201 so that the UAV 201 can view the area at various angles for a certain period of time. You can control it to shoot and return.

According to an embodiment of the present invention, the control module 210 may check photographing information allowing the green/red tide color components to be identified at least a certain amount according to the photographing angle, altitude, or time zone of the unmanned aerial vehicle 201 . For example, in the case of red tide, a red color component is mainly included, so that when the sun rises or sets, a control command for the UAV 201 to photograph in a direction facing the sun can be transmitted to the UAV 201 . The control command may include information for setting a photographing angle and altitude (or height) of the unmanned aerial vehicle 201 according to the height of the sun.

According to one embodiment of the present invention, the communication module 220 transmits control information to the unmanned aerial vehicle 201 to control the flight of the unmanned aerial vehicle 201 or information related to flight from the unmanned aerial vehicle 201 (eg, flight speed). , distance or expected path) can be received.

According to an embodiment of the present invention, the sensor module 230 can detect a sensor (eg, a gyroscope, acceleration sensor, angular velocity, GPS, etc.) capable of detecting movement information such as the position and speed of a camera and height information. sensors (e.g. depth sensor, displacement sensor) and sensors capable of detecting environmental information (e.g. color sensor, clock, temperature sensor or humidity sensor) in the marine area being monitored, such as time of flight, humidity, temperature, etc. may include

According to an embodiment of the present invention, the camera device 102 may be combined with the UAV 201 and obtain multispectral data while flying by the UAV 201 . In this case, the camera device 102 may obtain location and speed information for the multispectral data using sensors, and obtain information on time, weather, humidity, or temperature at the time the multispectral data was acquired.

According to an embodiment of the present invention, the multi-spectral sensor 240 acquires image data by classifying it for each spectral band, and can detect more spectral light compared to the image sensor 250 . For example, a specific pigment of phytoplankton, which is a main component of green algae, may be identified through an image taken in a specific spectral band.

According to one embodiment of the present invention, phytoplankton have a similar color to general green algae, so it is not easy to distinguish them on an image captured by the image sensor 250. On the other hand, if the image obtained by the multispectral sensor 240 is used, color components that can be identified only in a specific spectral band can be photographed. .

According to an embodiment of the present invention, the camera device 102 may acquire images of green and red tides using the image sensor 250 . For example, the camera device 102 transmits an image acquired by the image sensor 250 and an image of the multi-spectral sensor 240 obtained at the same time as the image to the AI server 103, and the AI server 103 By comparing the images, monitoring information related to green and red tides can be analyzed.

3 is an operational flowchart illustrating an operation of monitoring green and red tides according to an embodiment of the present invention.

According to an embodiment of the present invention, the servers of the green/red tide monitoring system 100 (e.g., control server 101, camera device 102, AI server 103, app server 104, DB server ( 105)) may perform green/red tide monitoring operation.

Referring to FIG. 3 , in operation 310 , multispectral images of green and red tides may be captured by the camera device 102 installed in the drone 201 .

In operation 320, the camera device 102 may transmit multispectral data including sensor data, image data, and a multispectral image obtained at the same time to the AI server 103 using the communication module 220.

In operation 330, the AI server 103 may perform analysis on the multispectral data. For example, the AI server 103 analyzes the multispectral images received from the camera device 102 using a learning model or analysis model stored in the DB server 105 or artificial intelligence technology stored in the AI server 103. can do.

According to an embodiment of the present invention, the AI server 103 and the DB server 105 are connected through a pipeline, and multispectral data may be transmitted from the AI server 103 to the DB server 105. The DB server 105 may transmit to the AI server 103 information on an analysis model including sensor data corresponding to the received multispectral data among the stored analysis models and information on green algae and red tides.

According to an embodiment of the present invention, the AI server 103 analyzes the multi-spectral data using the analysis model received from the DB server 105, and checks whether there is a difference compared to the existing environment as a result of the analysis to check whether there is a green or red tide. can determine whether it has occurred.

According to an embodiment of the present invention, the AI server 103 checks the sensor data transmitted together with the multi-spectral image, and the green algae/red tide phenomenon related to the sensor data among the green algae/red tide prediction information stored in the DB server 105 occurrence information can be retrieved. For example, the sensor data may include environmental information about humidity, temperature, time, wind volume or wind direction.

According to an embodiment of the present invention, the AI server 103 inputs information included in the data received from the camera device 102 to create an analysis model for searching green/red tide occurrence information stored in the DB server 105. can be built For example, the analysis model is based on the occurrence information of green algae/red tide stored in the DB server 105 as values for environmental information included in the sensor data are input, the region where the green algae/red tide occurred, the area where it occurs, and the amount of occurrence. Or you can search for the generated speed.

According to an embodiment of the present invention, the DB server 105 may store green/red tide occurrence information according to environmental information such as humidity, temperature, time, wind volume, or wind direction. In addition, the DB server 105 may construct a learning model for green algae/red tide by classifying green algae/red tide occurrence information into a time zone where green algae/red tide occur frequently, an amount of occurrence, or an occurrence rate.

In operation 340, the AI server 103 may transmit the analysis result of the multispectral data to the app server 104. For example, the analysis result may include content notifying that green algae and red tides have occurred or predicting the occurrence of green algae and red tides.

According to an embodiment of the present invention, the AI server 103 determines that the data amount of green/red tide occurrence information for sensor data exceeds a preset reference value or that a specific color component exceeds a certain area in a multispectral image. , it can be expected that green/red tides will occur in the area.

In operation 350, the app server 104 generates a notification message or a notice message based on the analysis result received from the AI server 103, and sends the generated message to an external electronic device (eg, a smartphone, a laptop or a tablet PC, etc.) ) can be transmitted. For example, the notice message is information indicating that it is determined that the occurrence of green algae/red tides is highly likely to occur in a specific region, and may include information on an area in which green algae/red tides are expected to occur, an estimated time of occurrence, an estimated amount of occurrence, or an expected rate of occurrence. can

According to an embodiment of the present invention, an application for accessing the green/red tide monitoring system 100 is installed in the external electronic device, and a notification message or a notice message can be received and displayed through the application. The user of the electronic device can access the green algae/red tide monitoring system 100 by inputting user account information using the application, and can check the green algae/red tide monitoring information displayed through the application.

According to an embodiment of the present invention, the app server 104 may transmit message-related information to an external electronic device together with a notification or notice message. The message-related information is information for displaying the notification or notice message on the electronic device, and includes a displayed location (eg, widget, notification panel), display type (eg, pop-up message, icon), and display setting (eg, widget, notification panel). resolution, size), UI/UX information or layout.

In operation 360, the AI server 103 may receive a response message to a notification or notice message from the app server 104. The response message may be a message notifying that the electronic device receiving the message has confirmed the corresponding message, or a message notifying that the problem of green algae/red algae notified by a notification message has occurred and has been resolved.

In operation 370, the AI server 103 may analyze the received response message. For example, when the AI server 103 analyzes the response message and confirms that the notification message has been received by the user, it can check information that is not applied to the analysis model among multispectral data related to the notification message.

In operation 380, the AI server 103 may request an update of the analysis model to the DB server 105. For example, when the multispectral data not applied to the analysis model is confirmed according to the above-described operation 370, the AI server 103 may request the DB server 105 to update the analysis model to include the corresponding multispectral data. .

In operation 380, the DB server 105 may update the analysis model according to the request of the AI server 103. Thereafter, the DB server 105 may transmit the updated analysis model to the AI server 103 so as to analyze the multispectral data using the updated analysis model.

4 is a diagram illustrating a screen configuration of a green/red tide monitoring application according to an embodiment of the present invention.

Referring to FIG. 4 , an electronic device (eg, a smartphone) may display a login screen 400 when a green/red tide monitoring application is executed. The login screen 400 may include an input window for inputting access information (eg, ID 410, password 420) and a login button 430 to access the green/red tide monitoring system 100, Other various login options (eg, 'Remember ID' function) may be included.

According to an embodiment of the present invention, when a user inputs access information and selects the login button 430, the electronic device may transmit the access information to the app server 104. Accordingly, the app server 104 may identify a user account according to the input access information and transmit green tide/red tide information of a marine area that can be monitored with the corresponding user account to the electronic device in the form of application data.

According to an embodiment of the present invention, when receiving application data from the app server 104, the electronic device may display green algae/red tide information corresponding to the application data received through the application.

5 is a diagram showing the configuration of a notification message transmitted from the green/red tide monitoring system according to an embodiment of the present invention.

Referring to FIG. 5 , a notification message may be displayed through a notification panel 500 (or widget) displaying various settings or notifications in an electronic device. In addition, the notification message may be output as various types of data (eg, voice data, vibration data) through an input/output device (eg, a speaker, a display, a touch screen, or a vibration motor) connected to an electronic device.

According to an embodiment of the present invention, when receiving a notification message from the green/red tide monitoring system 100, the electronic device may display some of the information of the received notification message on the notification panel 500. For example, the notification message 510 displayed on the notification panel 500 is content notifying that it has been received from the green algae/red tide monitoring system 100 (eg, "green algae/red tide monitoring notification") or green algae/red tide monitoring information indicating an algal bloom. It may include content notifying that it has been detected (eg, "Algae algae has been detected.").

According to an embodiment of the present invention, the user inputs (eg, hover input, drag, tap, double tap) to the notification message 510 using various input devices (eg, touch screen, keyboard, stylus pen) of the electronic device. ) can be added. For example, in an electronic device, as a “tap” input is input to the notification message 510, green algae/red tide information corresponding to application data received from the app server 104 may be displayed using a green algae/red tide monitoring application. there is. In addition, as the "drag" input is input to the notification message 510 in the electronic device, it is determined that the user has checked the notification message 510 received, and a response message informing of this is sent to the AI server through the app server 104. (103).

6 is a diagram showing a screen displaying green algae and red tide information in a green algae and red tide monitoring application according to an embodiment of the present invention.

Referring to FIG. 6 , in the electronic device, a user inputs access information through a log-in screen 400 of a green/red tide monitoring application to access a user account or inputs a user specified in a notification message 510 displayed on a notification panel 500. When is input, application data received from the app server 104 may be displayed on the application screen 600 .

According to an embodiment of the present invention, the application screen 600 of the green algae/red tide monitoring application may include a map 610, a green algae/red tide status (eg, good or severe), and information predicting green algae/red tides. there is. For example, if the AI server 103 determines that the green algae/red tide phenomenon has occurred in an area selected by the user, it transmits information on the status and expected degree of the green algae/red tide phenomenon to the app server 104, and the app server ( 104) may generate application data on green/red tide information received from the AI server 103 and transmit the information to the corresponding user's electronic device.

According to one embodiment of the present invention, although it has been described that the green tide/red tide monitoring application displays the map 610 of a specific area, maps for other areas registered in a user account may be further displayed, and the specific area The map can be displayed by zooming in or zooming out. For example, a user may input a user input (eg, drag, pinch, tap and drag) on the marine map 610 through a touch screen of an electronic device, and the electronic device may display a map of a different region according to the type of user input. It may be continuously displayed on the marine map 610 or displayed by zooming in or zooming out the map 610 .

According to an embodiment of the present invention, the electronic device may display green tide/red tide status information for a specific area on the map 610 to be visually distinguished from other areas. For example, the electronic device may display green or blue color when the green/red tide condition is good, yellow color when there is no change in the condition, and red color when the condition is serious.

According to an embodiment of the present invention, the green algae/red tide monitoring system 100 obtains multi-spectral data, accurately monitors the green algae/red tide problem in real time, and sends the monitoring result to the user's electronic device in the form of a notification message. can transmit In addition, the green algae/red tide monitoring system 100 may construct and update a model for analyzing and predicting a problem of green algae/red tide according to transmission of a notification message.

7 is a diagram showing the structure of a green algae/red algae monitoring system according to another embodiment of the present invention.

Referring to FIG. 7 , the green algae/red tide monitoring system 100 communicates with the control server 101 and the DB server 105 with the control server 101, the AI server 103 and the app server 104, , The control server 101 may be connected to the camera device 102 to pre-process the multi-spectral image received from the camera device 102 and transmit the pre-processed multi-spectral image to the DB server 105 .

According to another embodiment of the present invention, the control server 101 identifies a plurality of multi-spectral images classified by spectral bands in the multi-spectral data, integrates the plurality of multi-spectral images into one multi-spectral image, and integrates the multi-spectral images into one multi-spectral image. Preprocessing may be performed to convert the multispectral image into an image format that can be processed by a specific server (eg, the AI server 103 or the app server 104). In addition, of course, the control server 101 may pre-process the multispectral image to include various shapes and features according to settings in each server.

According to another embodiment of the present invention, the control server 101 transmits the preprocessed image to the DB server 105, and the DB server 105 may store the received preprocessed image. For example, the DB server may transmit the preprocessed image to the AI server 103 or the app server 104.

According to another embodiment of the present invention, the AI server 103 may receive a pre-processed multispectral image from the DB server 105 . For example, the AI server 103 directly receives the preprocessed multispectral image from the DB server 105 without going through the control server 101, analyzes the multispectral data, and monitors green and red tide accordingly. . In addition, the AI server 103 may transmit information on the result of monitoring green/red tide to the DB server 105 so that it is stored in the DB server 105 .

According to another embodiment of the present invention, the app server 104 may receive information on the result of monitoring green/red tide from the DB server 105 . For example, the app server 104 may generate application data for monitoring green algae and red tides by using the received information on the result of monitoring green algae and red tides. For example, the application data may include data for displaying green tide/red tide information or transmitting and displaying a notification or notice message through an application installed on a user's electronic device.

8 is an operational flowchart illustrating an operation of monitoring green algae and red tides in a system for monitoring green algae and red tides according to another embodiment of the present invention.

Referring to FIG. 8 , the green/red tide monitoring system may include a control server 101, a camera device 102, an AI server 103, an app server 104, and a database (DB) server 105. .

According to another embodiment of the present invention, the camera device 102 includes an RGB camera (eg, the image sensor 250), a multi-spectral camera (eg, the multi-spectral sensor 240), and a drone FC (flight controller) for data collection. ) (eg, a drone (eg, UAV 201) including a control module 210), a small mission computer for performing mission computing, and an LTE router for long-term evolution (LTE) communication ( A communication module 220 including a router) may be included.

According to another embodiment of the present invention, in one operation, the camera device 102 may acquire captured image data from a drone and transmit the obtained captured image data to a small mission computer. For example, the small mission computer may perform real-time multispectral analysis by checking captured image data received in real time, and transmit the result value of the multispectral image analysis to the DB server 105 through the communication module 220 .

According to another embodiment of the present invention, in operation 2, the camera device 102 may convert image data including results of multispectral image analysis into a designated image format (eg, tiff) and transmit the converted image data to the DB server 105. there is.

According to another embodiment of the present invention, in operation 3, the DB server 105 may transmit image data received through an AI image analysis pipeline with a preset AI server 103.

According to another embodiment of the present invention, the AI server 103 may check the received image data, detect whether a green algae/red algae phenomenon occurs, and output the detection result as an AI image analysis result value.

According to another embodiment of the present invention, in operation 4, the AI server 103 may transmit the AI image analysis result value to the DB server 105 as text data in a designated form (eg, json). For example, the DB server 105 may store the received text data as an AI image analysis result value.

According to another embodiment of the present invention, in operation 5, the DB server 105 may transmit the stored AI image analysis result value to the control server 101 in the form of image/text data. For example, the control server 101 controls a multi-spectral camera based on the received data, integrates views of a Geographic Coordinate System (GCS), monitors the surrounding environment, and displays data from a plurality of multi-spectral cameras in real time. It performs real-time multi-analysis and visualizes AI image analysis results.

According to another embodiment of the present invention, the app server 104 may receive multi-spectral analysis data from the DB server 105 to monitor green algae and red tides, notify and forecast. In addition, the app server 104 may receive an AI image analysis result value from the DB server 105 and store the received value.

According to another embodiment of the present invention, the app server 104 may provide a green/red tide forecasting application through an application programming interface (API). The green algae/red tide application may provide a service for forecasting green algae/red tide phenomena.

An embodiment according to the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of hardware implementation, one embodiment of the present invention provides one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), FPGAs ( field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, etc.

In addition, in the case of implementation by firmware or software, an embodiment of the present invention is implemented in the form of a module, procedure, function, etc. that performs the functions or operations described above, and is stored on a recording medium readable through various computer means. can be recorded. Here, the recording medium may include program commands, data files, data structures, etc. alone or in combination. Program instructions recorded on the recording medium may be those specially designed and configured for the present invention, or those known and usable to those skilled in computer software. For example, recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs (Compact Disk Read Only Memory) and DVDs (Digital Video Disks), floptical It includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, such as a floptical disk, and ROM, RAM, flash memory, and the like. Examples of program instructions may include high-level language codes that can be executed by a computer using an interpreter or the like as well as machine language codes generated by a compiler. These hardware devices may be configured to act as one or more software modules to perform the operations of the present invention, and vice versa.

In addition, an apparatus or terminal according to the present invention may be driven by a command that causes one or more processors to perform the functions and processes described above. For example, such instructions may include interpreted instructions, such as script instructions such as JavaScript or ECMAScript instructions, or executable code or other instructions stored on a computer readable medium. Furthermore, the device according to the present invention may be implemented in a distributed manner over a network, such as a server farm, or may be implemented in a single computer device.

In addition, a computer program (also known as a program, software, software application, script or code) loaded into a device according to the present invention and executing the method according to the present invention includes a compiled or interpreted language or a priori or procedural language. It can be written in any form of programming language, and can be deployed in any form, including stand-alone programs, modules, components, subroutines, or other units suitable for use in a computer environment. A computer program does not necessarily correspond to a file in a file system. A program may be in a single file provided to the requested program, or in multiple interacting files (e.g., one or more modules, subprograms, or files that store portions of code), or parts of files that hold other programs or data. (eg, one or more scripts stored within a markup language document). A computer program may be deployed to be executed on a single computer or multiple computers located at one site or distributed across multiple sites and interconnected by a communication network.

For convenience of description, each drawing has been divided and described, but it is also possible to design to implement a new embodiment by merging the embodiments described in each drawing. In addition, the present invention is not limited to the configuration and method of the described embodiments as described above, but the above-described embodiments are configured by selectively combining all or part of each embodiment so that various modifications can be made. It could be.

In addition, although preferred embodiments have been shown and described above, this specification is not limited to the specific embodiments described above, and those skilled in the art in the art to which the specification pertains without departing from the subject matter claimed in the claims Of course, various modifications are possible by the person, and these modifications should not be individually understood from the technical spirit or perspective of the present specification.

100: Green algae and red tide monitoring system
101: control server
102: camera device
103: AI server
104: app server
105: DB server
201: drone
210: control module
220: communication module
230: sensor module
240: multispectral sensor
250: image sensor

Claims (15)

In the method of monitoring green algae and red algae in the control server of the green algae and red tide monitoring system,
A process of controlling an AI server to build an analysis model for analyzing green and red tide information in multispectral data and a learning model for learning multispectral data in an environment in which a problem occurs;
controlling the AI server to receive first multispectral data from a camera device connected to the UAV;
controlling the AI server to analyze the first multispectral data using the analysis model;
controlling the AI server to transmit an analysis result of the first multispectral data to an application server; and
Based on the analysis result received from the AI server, a notification message notifying the occurrence of the green algae/red tide phenomenon or a notice message predicting the occurrence of the green algae/red tide phenomenon is generated, and the generated message is transmitted to an external electronic device. Including; the process of controlling the application server;
The process of controlling the AI server to analyze the first multispectral data,
When the analysis result of the first multispectral data indicates that the green algae/red tide phenomenon occurs in the first region where the first multispectral data is captured, the point at which the first multispectral data received from the drone is photographed Check flight information including flight time, flight direction, altitude or speed information of the unmanned aerial vehicle in
When the unmanned aerial vehicle flies according to the confirmed flight information, when second multi-spectral data captured by the camera device is received from the camera device, the green and red tides are located in a second area where the second multi-spectral data is captured. An operation of controlling the AI server to predict the occurrence of a phenomenon; including, a method for monitoring green and red tides. delete According to claim 1,
A process of controlling the AI server to analyze the first multispectral data using the analysis model to determine whether green or red tides in the first region have occurred or to predict whether green or red tides in the first region will occur Further comprising, green algae / red tide monitoring method. According to claim 3,
The AI server is connected to the DB server through a pipeline,
The process of controlling the AI server to analyze the first multispectral data received from the DB server through the pipeline using a learning model; According to claim 4,
Checking sensor data included in the first multispectral data;
Searching for green tide/red tide prediction information corresponding to the identified sensor data among the green tide/red tide prediction information stored in the DB server;
controlling the AI server to transmit the searched green/red tide prediction information to the application server; and
Generating the notice message using the green algae/red tide prediction information received from the AI server, and controlling the application server to transmit the generated notice message to the external electronic device; Red tide monitoring method. According to claim 5,
The sensor data included in the first multispectral data,
Characterized in that the data obtained by measuring humidity, temperature, time, air volume or wind direction in the first area, a method for monitoring green algae and red tides. According to claim 6,
When information corresponding to sensor data included in the first multi-spectral data is searched in an amount exceeding a designated value among the green tide/red tide prediction information stored in the DB server, the green tide or red tide phenomenon occurs in the first area. A method for monitoring green and red tides, further comprising; controlling the AI server to predict that it will be. delete In the green algae/red tide monitoring system,
A camera device connected to the UAV to obtain multispectral data;
an AI server for constructing an analysis model for analyzing green algae and red tide information in the multispectral data and a learning model for learning multispectral data for green algae and red tides in which a problem occurred;
an application server that generates a message and transmits the generated message to an external electronic device; and
When first multi-spectral data is received from the camera device, controlling the AI server to analyze the first multi-spectral data using the analysis model;
Controlling the AI server to transmit an analysis result of the first multispectral data to an application server;
Control for controlling the application server to transmit a notification message notifying the occurrence of the green algae/red tide phenomenon or a notice message predicting the occurrence of the green algae/red tide phenomenon to the external electronic device based on the analysis result received from the AI server. including a server;
The control server,
When the analysis result of the first multispectral data indicates that the green algae/red tide phenomenon occurs in the first region where the first multispectral data is captured, the point at which the first multispectral data received from the drone is photographed Check flight information including flight time, flight direction, altitude or speed information of the unmanned aerial vehicle in
When the unmanned aerial vehicle flies according to the confirmed flight information, when second multi-spectral data captured by the camera device is received from the camera device, the green and red tides are located in a second area where the second multi-spectral data is captured. A green algae/red tide monitoring system that controls the AI server to predict the occurrence of a phenomenon. According to claim 9,
The AI server,
Characterized in that the first multispectral data is analyzed using the analysis model to determine whether the green algae/red tide problem in the first region has occurred or to predict the occurrence of green algae/red tide in the first region. ·Red tide monitoring system. According to claim 10,
Further comprising; a DB server connected to the AI server through a pipeline;
The AI server analyzes the first multispectral data received from the DB server through the pipeline using a learning model. According to claim 11,
The AI server,
Checking sensor data included in the first multispectral data;
Searching for green tide/red tide prediction information corresponding to the identified sensor data among the green tide/red tide prediction information stored in the DB server;
Transmitting the searched green tide/red tide prediction information to the application server;
The application server,
The green algae/red tide monitoring system, characterized in that the notice message is generated using the green algae/red tide information received from the AI server, and the generated notice message is transmitted to the external electronic device. According to claim 12,
The sensor data included in the first multispectral data,
Characterized in that the data obtained by measuring humidity, temperature, time, air volume or wind direction in the first area, the green algae/red tide monitoring system. According to claim 13,
The AI server,
When information corresponding to sensor data included in the first multi-spectral data is searched in an amount exceeding a designated value among the green tide/red tide prediction information stored in the DB server, the green tide or red tide phenomenon occurs in the first area. A green algae/red tide monitoring system, characterized in that it is predicted to be. delete

Images