KR101855652B1 - System of total cloud cover retrieval from satellite observation using machine learning and method thereof - Google Patents
System of total cloud cover retrieval from satellite observation using machine learning and method thereof Download PDFInfo
- Publication number
- KR101855652B1 KR101855652B1 KR1020180017469A KR20180017469A KR101855652B1 KR 101855652 B1 KR101855652 B1 KR 101855652B1 KR 1020180017469 A KR1020180017469 A KR 1020180017469A KR 20180017469 A KR20180017469 A KR 20180017469A KR 101855652 B1 KR101855652 B1 KR 101855652B1
- Authority
- KR
- South Korea
- Prior art keywords
- satellite
- machine learning
- observation
- himawari
- learning model
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01W—METEOROLOGY
- G01W1/00—Meteorology
- G01W1/02—Instruments for indicating weather conditions by measuring two or more variables, e.g. humidity, pressure, temperature, cloud cover or wind speed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01W—METEOROLOGY
- G01W2201/00—Weather detection, monitoring or forecasting for establishing the amount of global warming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Environmental & Geological Engineering (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Ecology (AREA)
- Mathematical Analysis (AREA)
- Environmental Sciences (AREA)
- Biodiversity & Conservation Biology (AREA)
- Algebra (AREA)
- Computational Mathematics (AREA)
- Atmospheric Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Mathematical Optimization (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pure & Applied Mathematics (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Image Processing (AREA)
Abstract
In the satellite-based full-scale calculation system using the machine learning of the present invention, the satellite-based full-scale calculation archive server 20 using the machine learning uses the satellite- A preprocessing unit 110 for generating input data of a machine learning model in which cloud false pixels such as snowfall are classified using brightness temperature and reflectivity; A light determination unit 120 for sequentially driving a machine learning model trained for each cluster through the machine learning model input data created in the preprocessing unit 110 to perform a function of determining the total amount of light; And an image display and point-based tallying unit (130) for performing a function of displaying the result of the calculation of the traffic light by the lightness determining unit (120) as aggregate information for each image and point.
Description
The present invention relates to a system and a method for calculating an electric current by applying a sight observed on the ground using satellite observations to machine learning, and more particularly, to a system and method for estimating electric power by mitigating volatility using time- The present invention relates to a system and a method for calculating a satellite-based full-scale cloud computing system using machine learning,
The machine learning used in the invention randomly learns a plurality of decision trees through a random forest (RF) method to construct a plurality of decision trees to classify or predict when input data comes in. Here, the decision tree is an optional branch used to make a decision, and is a technique for dividing a complex problem into a hierarchical structure composed of simple problems. The most important characteristic of RF is that it consists of trees with slightly different characteristics due to randomness, which makes the predictions of each tree to be de-correlated and consequently improves the generalization performance.
Until now, the cloudiness has been determined through the eyes of the observer. The accuracy of the observed cloudiness is comparatively accurate, but it has the disadvantage of the limitation of the observation area of the point observation and the subjective decision reflecting the human psyche.
In addition, since 2011, the computation and live observation of the Cheonryan satellite have been carried out through observation data of Cheollian satellite and the explicit algorithm. However, since the cloud cloud of Cheollian satellite is affected by the cloud data of Cheollian satellite, The accuracy of cloud determination is different. In addition, the algorithm uses the cloud shape ratio to calculate the electric current. Since the condition does not reflect the characteristics of the satellite observation data, The accuracy of 1 ~ 9% of the lightness in the light is not good. Since cloudiness is of great importance as forecast data for weather forecasts, forecasts for minimum temperature and radiation, and as a key climatic variable, an accurate and objective calculation of the electric power is necessary in a wide area.
An object of the present invention is to provide a system for providing precise weather information to a user and expressing a weather forecast by expressing it as a sky level (sunny, cloudy, cloudy, cloudy) using machine learning .
Another object of the present invention is to provide a method and system for estimating satellite cloud characteristics by using machine learning to solve the problem of the use of the preceding products and the problem of ineffective reflection of the satellite observation characteristics by the explicit condition (application of cloud shape, etc.) And to provide a satellite-based computation technique.
Yet another object of the present invention is to provide a satellite-based computation method using machine learning that solves limitations on point observation and subjective determination of the observed cloud.
Another object of the present invention is to provide a satellite-based computation method using machine learning using a sequential cluster model in order to increase the accuracy of the whole cloud determination.
In order to accomplish the above object, in a satellite-based full-scale calculation system using machine learning according to the present invention, a satellite-based full-scale calculation server using machine learning calculates a brightness A preprocessing unit which performs input and output of the input data of a machine learning model in which cloud mispredicted pixels such as snowfall are classified using temperature and reflectivity; A shade decision unit for sequentially driving a machine learning model trained by the clusters through the machine learning model input data created in the preprocessing unit to perform a function of determining the electric power; And an image display and point-by-point tallying unit for performing a function of displaying the result of the calculation of the traffic light by the lightness determining unit as aggregate information for each image and point.
Here, the machine learning is to randomly learn a plurality of decision trees in a random forest (RF) manner to form a plurality of decision trees to classify or predict when input data is received, May be the total cost calculation software through the machine learning model utilizing the observational satellite Himawari-8 meteorological satellite observation data.
Here, the brightness determination unit may use a brightness temperature difference (BTD) of the infrared region channels observed in the Himawari-8 weather satellite of the observation satellite.
Here, the preprocessor may divide the snowfall and the cloud area with a 1.6 탆 reflectance through the observation value of the Himawari-8 weather satellite of the observation satellite.
Here, the pre-processing unit may use a brightness temperature difference of 3.9 μm and 11.2 μm at night through observation values of the Himawari-8 weather satellite of the observation satellite.
Here, the preprocessing unit may use
Here, the pre-processing unit may use Equation (2), which is a normalization operator presented by Li and Shibata.
Here, the parameters used in the RF model training are largely the combination of the average infrared channel brightness temperature difference (18x18 km 2 ) and the combination of 3.9 μm in the 18 × 18 km 2 region and the window channel (10.4 μm, 11.2 μm, 12.3 [micro] m) may be one that uses the specific pixel number category specified by the brightness temperature difference condition.
Here, the number of pixels specified by the brightness temperature difference condition of 3.9 탆 within the
In order to accomplish another object of the present invention, there is provided a satellite-based total-cost calculation method using machine learning, comprising the steps of: (a) Performing a function of creating input data of a machine learning model in which cloud false pixels such as snowfall are classified using the brightness temperature and the reflectivity transmitted from the observation satellite; (b) performing a function of sequentially driving a machine learning model trained by the clusters through the machine learning model input data created in the preprocessing unit by using the calculator for calculating the amount of cloud, And (c) performing a function of displaying the total lightness result calculated by the lightness determination unit by the image display and the point-by-point aggregate calculation software using image and point-by-point aggregate information. . ≪ / RTI >
Here, the machine learning is to randomly learn a plurality of decision trees in a random forest (RF) manner to form a plurality of decision trees to classify or predict when input data is received, May be the total cost calculation software through the machine learning model utilizing the observational satellite Himawari-8 meteorological satellite observation data.
The step (b) may further include the step of classifying the total amount of the cloud decision unit into a clear, cloudy or cloudy cloudy level.
The step (b) may further include the step of classifying the amount of the cloudiness to 0 or 1 to 5, and the step of classifying the cloudiness to 1 or 2 or 3 or 4 or 5 degrees .
Here, the step (b) may further include the step of classifying the light quantity of the light
Here, the step (b) may further include the step of classifying the light quantity into 6, 7, or 8 halo.
The step (b) may further include the step of classifying the light quantity of the light quantity determination unit as 9 or 10.
In order to achieve another object of the present invention, a satellite-based computerized calculation method using machine learning may be implemented by a computer program stored in a computer-readable recording medium.
In order to achieve the above and other objects of the present invention, there is provided a satellite-based computer-readable storage medium storing a computer-readable recording medium storing a program.
Specific details of other embodiments are included in the " Detailed Description of the Invention "and the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS The advantages and / or features of the present invention and the manner of achieving them will be apparent by reference to various embodiments described in detail below with reference to the accompanying drawings.
However, the present invention is not limited to the configurations of the embodiments described below, but may be embodied in various other forms, and each embodiment disclosed in this specification is intended to be illustrative only, It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
According to the present invention, the user can calculate and use the electric information about the desired area more precisely and conveniently by calculating the objective electric current data at the ground level and expressing the image based on the sky state And the information can be used for weather forecasting.
In addition, machine learning can search for features that are difficult to define with explicit conditions as part of artificial intelligence, and can apply the searched features to the analysis target prediction.
In addition, it is expected that it will be useful for automation of cloud observation by a method that is specialized for electric cloud observation.
It is also expected to be useful for forecasting weather forecasts nationwide or regionally because it can be applied as an input data to the short - term predictive numerical model.
In addition, because the weather forecast is an important factor for forecasting weather and climate data, many applications are expected and a large reduction of input budget and human resources related to terrestrial weather observation is expected.
1 is a block diagram illustrating a satellite-based total-cost calculation system using the machine learning of the present invention.
FIG. 2 is a configuration diagram of the satellite-based full-scale calculation archive server of FIG. 1. FIG.
Fig. 3 is a graph showing the frequency of the clouding of the eyes. Fig.
Fig. 4 is a schematic diagram showing the criterion and classification of the sky status classification.
FIG. 5 (a) is a graph showing a space-averaged distribution of brightness temperature differences among infrared channels of
6 (b) is a photograph of brightness temperature difference between
Fig. 7 is a graph showing the result of the calculation of the total amount of air.
FIG. 8 is a diagram showing a physical analysis of a color of a final image. FIG.
Fig. 9 (a) is a chart for each point, and Fig. 9 (b) is a time series chart graph.
FIG. 10 is a diagram illustrating an example of a software implementation of the electric vehicle calculation system according to the present invention.
11 is a schematic diagram showing a satellite-based total-cost calculation method using machine learning using a satellite-based total-cost calculation system using the machine learning of the present invention.
FIG. 12 is an operation diagram illustrating a satellite-based electric-power calculation method using machine learning using a satellite-based electric-power calculation system using the machine learning of FIG.
FIG. 13 is a flowchart illustrating a satellite-based total-cost calculation method using machine learning using the satellite-based total-cost calculation system using the machine learning of FIG.
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Before describing the present invention in detail, terms and words used herein should not be construed as being unconditionally limited in a conventional or dictionary sense, and the inventor of the present invention should not be interpreted in the best way It is to be understood that the concepts of various terms can be properly defined and used, and further, these terms and words should be interpreted in terms of meaning and concept consistent with the technical idea of the present invention.
That is, the terms used herein are used only to describe preferred embodiments of the present invention, and are not intended to specifically limit the contents of the present invention, It should be noted that this is a defined term.
Furthermore, in this specification, the singular forms "a", "an", and "the" include plural referents unless the context clearly dictates otherwise, and it should be understood that they may include singular do.
Where an element is referred to as "comprising" another element throughout this specification, the term " comprises " does not exclude any other element, It can mean that you can do it.
Further, when it is stated that an element is "inside or connected to" another element, the element may be directly connected to or in contact with the other element, A third component or means for fixing or connecting the component to another component may be present when the component is spaced apart from the first component by a predetermined distance, It should be noted that the description of the components or means of 3 may be omitted.
On the other hand, it should be understood that there is no third component or means when an element is described as being "directly connected" or "directly connected" to another element.
Likewise, other expressions that describe the relationship between the components, such as "between" and "immediately", or "neighboring to" and "directly adjacent to" .
In this specification, terms such as "one side", "other side", "one side", "other side", "first", "second" Is used to clearly distinguish one element from another element, and it should be understood that the meaning of the element is not limited by such term.
It is also to be understood that terms related to positions such as "top", "bottom", "left", "right" in this specification are used to indicate relative positions in the drawing, Unless an absolute position is specified for these positions, it should not be understood that these position-related terms refer to absolute positions.
Furthermore, in the specification of the present invention, the terms "part", "unit", "module", "device" and the like mean units capable of handling one or more functions or operations, , Or a combination of hardware and software.
In this specification, the same reference numerals are used for the respective components of the drawings to denote the same reference numerals even though they are shown in different drawings, that is, the same reference numerals throughout the specification The symbols indicate the same components.
In the drawings attached to the present specification, the size, position, coupling relationship, and the like of each constituent element of the present invention may be partially or exaggerated or omitted or omitted for the sake of clarity of description of the present invention or for convenience of explanation May be described, and therefore the proportion or scale may not be rigorous.
Further, in the following description of the present invention, a detailed description of a configuration that is considered to be unnecessarily blurring the gist of the present invention, for example, a known technology including the prior art may be omitted.
1 is a block diagram illustrating a satellite-based total-cost calculation system using the machine learning of the present invention.
FIG. 2 is a configuration diagram of the satellite-based full-scale calculation archive server of FIG. 1. FIG.
Fig. 3 is a graph showing the frequency of the clouding of the eyes. Fig.
Fig. 4 is a schematic diagram showing the criterion and classification of the sky status classification.
FIG. 5 (a) is a graph showing a space-averaged distribution of brightness temperature differences among infrared channels of
6 (b) is a photograph of brightness temperature difference between
Fig. 7 is a graph showing the result of the calculation of the total amount of air.
FIG. 8 is a diagram showing a physical analysis of a color of a final image. FIG.
Fig. 9 (a) is a chart for each point, and Fig. 9 (b) is a time series chart graph.
FIG. 10 is a diagram illustrating an example of a software implementation of the electric vehicle calculation system according to the present invention.
11 is a schematic diagram showing a satellite-based total-cost calculation method using machine learning using a satellite-based total-cost calculation system using the machine learning of the present invention.
FIG. 12 is an operation diagram illustrating a satellite-based electric-power calculation method using machine learning using a satellite-based electric-power calculation system using the machine learning of FIG.
FIG. 13 is a flowchart illustrating a satellite-based total-cost calculation method using machine learning using the satellite-based total-cost calculation system using the machine learning of FIG.
In the satellite-based full-scale calculation system using the machine learning of the present invention, the satellite-based full-traffic
Referring to FIG. 1, a configuration diagram of a satellite-based total-cost calculation system using machine learning of the present invention is disclosed.
One embodiment of the satellite-based electric-power calculation system using the machine learning of the present invention is a satellite data broadcasting service HimawariCast through
Currently, the Japan Weather Satellite Center (MSC) is operating the Himawari cast by Himawari satellite data reception service. Direct transmission of satellite images to High Rate Information Transmission (HRIT) and Low Rate Information Transmission (LRIT) receiving stations (MDUS and SDUS) that were formerly Himawari 6 (MTSAT-1R) Service was completed in November 2015, and data transmission service via communication satellite was started in January 2015 instead. In Himawari No. 8, the observation frequency is greatly improved compared with Himawari No. 7 (MTSAT-2), and the light bulb is observed for 10 minutes, so the satellite image is transmitted every 10 minutes at Himawari cast.
Himawari cast began transmitting satellite images of
The SATAID format of the Himawari cast is used primarily to transmit numerical forecast grid point values (GPV) and observational data to meteorological agencies in developing countries. These data can be superimposed on satellite images with SATAID software.
(DVB-S2 (Digital Video Broadcasting-Satellite-Second Generation)
In the case where the terrestrial circuit environment is not good as in a developing country, the Himawari cast service is used via the
In the embodiment of the satellite-based electric-power calculation system using the machine learning of the present invention, the Himawari satellite data archive
In addition, a time-series display web application can be used. NIKT Science Cloud's Scalable Time Series Data Disclosure Technology (STARStouch) enables you to view the Himawari satellite data retention period and visual images in a time series. Another providing site, DIAS, is the data integration and analysis system of Tokyo University, which is the main site for research use. It creates meta data in a uniform format for each data set and creates a document converted into readable formats (HTML and PDF) . The data transmitted through the cloud includes Himawari standard data (full disk, Japanese area, startup observation area), netCDF data (Japan area, startup observation area), color image data (full disk, Japan area, The service contents are different for the general public and the researcher such as NICT. In order to use the service for the researcher, the account acquisition and the procedure are necessary. With DIAS service, you can obtain the corrected image you need by setting the period, data format setting, observation area, RGB setting, gamma correction, mask overlay, channel and so on.
Such a Himawari cloud service (18) is a service in Japan. If you wish to provide Himawari data from abroad, it is a principle to ask each national weather agency, but direct acquisition from DIAS and NICT is also possible. In addition, the Japan Meteorological Agency (JMA) (12) on the means of using Himawari cloud service (18) does not distinguish between users assumed in NICT and DIAS, and it is decided according to user convenience only. For each site, basic images that can perform basic operations such as time designation and enlargement / reduction can be used only by URL access without login.
In addition, in real-time, it supports 30 languages in addition to displaying the current position using GPS function, and since it takes a URL preservation method for a specific period of video that a specific user was watching on the web, The user can also view the same image. In relation to the web, browsing information can be shared with various SNSs such as e-mail, Facebook, Twitter, LINE, etc., and the images can download the basic images and videos of the designated time through the WSDB (World Science Data Bank) . These images are used for individual users, research utilization and education, exhibition of science museum, magazine, newspaper, web exhibition, international event display. With the provision of Himawari data through such a web service, there is a one-stop service because of its use in the research community, sufficient data storage capacity, and other related scientific data and products.
In one embodiment of the satellite-based computation system using machine learning of the present invention, machine learning is introduced. This is to solve the problem of the use of the preceding products and the limitation of the problem of inefficient reflection of the satellite observation characteristics and calculation of the overaccumulation decision by the explicit condition (application of the cloud shape, etc.) in the Chunlian satellite satellite cloud algorithm. Machine learning is a part of artificial intelligence that can be searched for features that are difficult to define with explicit conditions and can be applied to explored analytical predictions.
Referring to FIG. 2, in the satellite-based total-power calculation system using the machine learning of the present invention, the satellite-based total-
The
The
The image display and point-by-
In the satellite-based full-scale calculation system using the machine learning of the present invention, a machine learning technique called Random Forest (hereinafter, referred to as RF) is applied and observation data of each channel of the Himawari- And used in the training parameters and the lightning determination input data of the RF model included in the light
Since the observing
Since no 1.6 탆 reflectivity was observed at night, the brightness temperature difference of 3.9 탆 and 11.2 탆 was used. It is difficult to remove completely but most boundary conditions are used because it shows -1.8K ~ 0.7K in most snow areas. Since the Cirrus region can be removed when the normalized 1.6 ㎛ reflectivity and the brightness temperature difference of 3.9 urn and 11.2 탆 are applied, the brightness temperature difference between 11.2 탆 and 8.6 탆 and the brightness temperature difference between 11.2 탆 and 13.3 탆 Use to recover the cirrus area.
In an embodiment of the satellite-based computation system using the machine learning of the present invention, the ensemble technique of randomly learning a plurality of decision trees by machine learning applied to the Himawari-8 cloud is described in Random Forest (RF; Breiman, 2001 ; H2O.ai team, 2016) was used. The data applied to the training and verification of the RF model were measured at the brightness of 3.9 ㎛, 6.2 ㎛, 7.0 ㎛, 7.3 ㎛, 8.6 ㎛, 9.6 ㎛, 10.4 ㎛, 11.2 ㎛, 12.3 ㎛ and 13.3 ㎛, which were observed at Himawari - And Cloud Amount (CA) observed at the weather station. In general, 1, 5, and 9 are not declared well, so the RF model can be trained to a certain amount of cloudiness. To compensate for this, weighted average cloudiness (CA ') is applied as a target variable , And the calculation formula is as shown in Equation (3).
Here, h is on-time. However, RF model verification was performed at the time of day. The reason for limiting the RF model training to weekly cases is because the nighttime accuracy is low. The infrared channel brightness temperature difference (IRBTD) used as a cloud decision variable is a space-averaged value for a 9 × 9 pixel region corresponding to about 18 × 18 km 2 which is a region of the eye. Also, we applied a condition variable (Count Value of BTD 3.9 μm-window) that utilizes difference of 3.9 μm and waiting window channel for determination error of snowing area and determination of cloudiness for nightly underwash.
In the training set, the frequency distribution of the observed cloud in 2016 shows an uneven distribution of 0 or 10% cloudiness, so we created an RF model for each cluster based on sky conditions. Himawari-8 cloudiness is calculated by preprocessing process (removal of cloud-error pixels, etc.) and trained six RF models, and the performance is calculated by comparing PC and Bias, RMSE, and Correlation with observed cloudiness. Bias and RMSE are closer to 0 and Correlation and PC (± 0 / ± 1 / ± 2) are closer to 1, which means better coincidence.
As a result of the Himawari-8 cloud output through the RF model, it shows generally high qualitative agreement with infrared images. As a result of applying the RF model for January 2017, 71.5% of the PC (difference between the satellite and the middles) ± 1, 87.2% of the PC ± 2 (about 90% of the PC ± 2 between the ground and the airbase) and RMSE of 1.74 , Corr. Is about 90%, which is better than most of the proved indicators for the same period.
Referring to FIG. 3, a satellite-based total cloud computing system using the machine learning of the present invention applies a sequential cluster model in order to increase the accuracy of the total cloud determination. As shown in FIG. 3, the whole-cloud observation data used as a target value of the machine learning model shows a relatively uneven distribution of the majority of the cloudiness of 0 and 10%. Since machine learning is dependent on the number of data of the target value, when the result is reflected in the machine learning without refining, the result is focused on 0 or 10% of the cloud, and the accuracy of determination for the cloud of 1 ~ 9 is weakened Lt; / RTI >
Referring to FIG. 4, a machine learning model for each cluster is sequentially generated in consideration of the number of class data of the whole traffic on the basis of the sky state prescribed by the Korea Meteorological Administration, and the system is constructed to improve the accuracy of the range of 1 to 9 hours.
The satellite-based computation system using the machine learning of the present invention uses a brightness temperature difference (BTD) of infrared region channels observed in a satellite. This is to solve the cloud decision subjectivity and the observation area limitation.
For example, the Himawari-8 weather satellite will be described as an example of a satellite-based total-power calculation system using the machine learning of the present invention. The Himawari-8 meteorological satellite observation data can observe the full disk area in real time, so it can solve the area limitation of the spot observation. And 16 channels (0.46, 0.51, 0.64, 0.86, 1.6, 2.3, 3.9, 6.2, 7.0, 7.3, 8.6, 9.6, 12.3 ㎛, and 13.3 ㎛) have intrinsic physical characteristics for each wavelength band. In general, the temperature difference between infrared channels is used to minimize the seasonal satellite observation variability and determine the specific weather phenomenon.
FIG. 5 (a) is a graph showing a spatial average distribution of brightness temperature differences between channels 14 (11.2 탆) to 16 (13.3 탆) for the entire traffic class, and FIG. 5 (b) Averaged infrared channel brightness temperature difference distribution of channel 13 (10.4 占 퐉) to channel 14 (11.2 占 퐉).
5 (a) and 5 (b), since a specific tendency is shown in the brightness-temperature difference between the infrared channels of the space-averaged region in the same region as the cloud resolution of each cloud class, a machine learning model It can be used as a training variable and it can guarantee the objectivity of the decision of the traffic.
The satellite-based full-scale calculation system using the machine learning of the present invention applies a preprocessing process for distinguishing pixels that can be mistakenly mistaken as clouds in order to prevent erroneous determination. For example, the Himawari-8 weather satellite will be described as an example of a satellite-based total-power calculation system using the machine learning of the present invention. Generally, because the brightness temperature differences between infrared channels are similar for certain weather phenomena (eg, clouds, snow), the erroneous results can be calculated from the full-range decision of the machine learning model.
6 (b) is a photograph of the brightness temperature difference between the channel 15 (11.2 m) and the channel 16 (13.3 m) in the snowy and rolling region, and Fig. 6 c) is a photograph of channel 5 (1.6 탆) in the snow and cloud areas.
6 (a) and 6 (b), it is assumed that the snowfall (dark blue sky area in FIG. 6 (a)) and the cloud image (white area in FIG. 6 Though the brightness temperature difference between channels is generally similar, it is possible to distinguish snow and cloud areas with 1.6 ㎛ reflectivity. In other words, if the machine learning model is applied to distinguish parts that can be mistaken as cloud through the observations of Himawari-8 weather satellite, the accuracy of the calculation results of the whole clouds can be increased. The boundary value of the preprocessing process is based on the boundary values of the Himawari-8 fog detection products of the National Weather Satellite Center of Japan, as shown in Table 1.
Referring to FIG. 7, the comparison between the result of the calculation and the result of the calculation is shown in FIG. 7. As a general rule, the tendency of the calculation before the calculation is in good agreement with the tendency of the observation, and the accuracy of the calculation is improved.
8, the satellite based around the cloud cover on the basis of 18 x 18 km 2 area on each pixel in the observed result of the entire cloud cover image of the calculation system white the cloudiness to 0-2, light aqua using a machine learning of the present invention It means clear, clear, cloudy, cloudy, cloudy, and cloudy, respectively, with a range of 3 ~ . The interpretation of these colors is based on the sky conditions prescribed by the Korea Meteorological Administration.
9 (a) and 9 (b), an aggregate table and a time series chart, which are aggregated on a point-by-point basis at intervals of one hour, are used to calculate the total cloudiness results calculated by the satellite-based cloud computing system using the machine learning of the present invention .
This is to support live weather monitoring and weather forecasting for the branch office, and it is possible to add branches and adjust the aggregation time interval. In addition, it is possible to store the traffic data at each point in a specific time range.
Referring to FIG. 10, the satellite-based total-cost calculation method using the machine learning of the present invention includes steps S100 to S600.
Step S100 is a step of observing the atmospheric state of the earth at the observing
The step S200 is a step of producing the data observed in the step S100 by the satellite-based computerized calculation system using the machine learning.
In step S300, the image of the data produced in step S200 is processed by the satellite-based computerized calculation system using the machine learning.
In step S400, the image processed in step S300 is processed by the satellite-based computation system using machine learning using the preprocessing input data, auxiliary data, and sensor response functions.
Step S500 is a step of verifying the data processed in step S400 with various weather observation data.
The step S600 is a step of calculating, distributing and storing the data obtained in step S500 by the satellite-based computation system using machine learning.
Referring to FIG. 11, the satellite-based total-cost calculation method using the machine learning of the present invention includes steps S1000 to S3000.
In step S1000, the satellite-based total-cost calculation method using the machine learning of the present invention is performed in the satellite-based total-cost
In step S2000, the satellite-based full-scale calculation method using the machine learning of the present invention is performed in the satellite-based full-scale
In step S3000, the satellite-based full-scale calculation method using the machine learning of the present invention is performed in the satellite-based full-scale
The above-described machine learning is to randomly learn a plurality of decision trees in a random forest (RF) manner to form a plurality of decision trees to classify or predict when input data is received. Himawari-8 It can be a total-cost calculation software through a machine learning model using meteorological satellite observation data.
The operation of the satellite-based full-scale calculation method using the machine learning using the satellite-based full-scale system using the machine learning of the present invention will be described with reference to the drawings.
Referring to FIG. 12, an operation method of the
The total number of RF models trained by each cluster shown in Fig. 12 is six, and each model is trained in consideration of the unevenness of the number of data of the class of the target cloud, which is the target value, and the sky condition prescribed by the Korea Meteorological Administration. RF1 models are 0 to 5 and 6 to 10, RF2 models are 0 and 1 to 5, RF3 models are 6 to 8 and 9 to 10, RF4 models are 1, 2, 3, 4 The RF5 model was trained as an eigenvalue assigned to a cluster divided into 6, 7, 8, and RF6 models divided into 9, 10, and 10 halos.
The parameters used in each RF model training are largely the spatial temperature (18x18 km 2 ) average of the combination of the infrared channel-to-channel brightness temperature difference and the brightness temperature of 3.9 μm in the 18 × 18 km 2 region and the air window channels (10.4 μm, 11.2 μm, 12.3 μm) The specific pixel count category specified by the difference condition was used. As mentioned above, since the brightness-temperature difference between the spatial averaged infrared channels was specific for each cloud class, it was used as a training variable. However, the combination of brightness temperature difference variables related to 13.3 ㎛ was excluded because the importance of the variables in the model was high, but it was sensitive to the snowy area and recognized as cloud. Also, the combinations of the water vapor channels 6.2 μm, 7.0 μm, and 7.3 μm were used only for the RF models that determine the 6 to 10% cloudiness, because the importance was low.
The specific number of pixels defined by the brightness temperature difference condition of 3.9 μm in the second
Snow and sunshine: -3K <corresponding brightness temperature difference <3K (night) or 10K (weekly)
Night Fog and Downstairs: The corresponding brightness temperature difference <-3K
Daytime Cloudy Clouds Including: 10K <corresponding brightness temperature difference
Table 2 shows the electric conductivity verification index, which is the result of the verification between the electric power calculation system and the observation light. Because of the subjectivity of the observer, the accuracy of the measurement is often 87 ± 90%, which is mainly determined by the PC ± 2 (± 2 accuracy between the eye and the pre-calculation). This is similar to the PC ± 2 result (over 85%) between the terrestrial weather station and the aeronautical observatory, and the calculation result of the present invention can be judged to be a human observation level.
Referring to FIG. 13, there is shown an example of software for implementing a satellite-based total-cost calculating method using machine learning of a total-amount calculation system through a machine learning model using Himawari-8 meteorological satellite observation data according to the present invention have.
The satellite-based traffic calculation method using the machine learning of the present invention can be implemented by a computer program stored in a computer-readable recording medium.
The computer program of the satellite-based network calculation method using the machine learning of the present invention can be stored and implemented in a computer-readable recording medium.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
In addition, since the present invention can be embodied in various other forms, the present invention is not limited by the above description, and the above description is intended to be a complete description of the present invention, It will be understood by those of ordinary skill in the art that the present invention is only provided to fully inform the person skilled in the art of the scope of the present invention and that the present invention is only defined by the claims of the claims.
10: Observation satellite (meteorological satellite)
12: Meteorological Office
14: CTS operator
16: Communication satellite
18: Cloud Services
20: Satellite-based network calculation server
22: NMHSs
24: User
26: PC with software
28: DVB-S2 Receiver
30: LNB
32: C-band antenna
110:
120:
130: Video presentation and aggregation by branch
Claims (18)
The satellite-based full-traffic calculation archive server 20,
Using the brightness and temperature calculations of the observed satellite 10 and the reflectivity, the computer 10 performs the function of creating the input data of the machine learning model in which cloud false pixels such as snowfall are classified A preprocessing unit 110;
A lightness determining unit (120) that performs a function of sequentially driving a machine learning model trained by the clusters through the machine learning model input data created in the preprocessing unit (110) by using the total light amount calculating software to determine the total light amount; And
And an image display and point-by-point tallying unit (130) for performing the function of displaying the total traffic result calculated by the lightness determination unit (120) by the image and point-by-point aggregation information by using the total lightness calculation software ,
A satellite - based computation system using machine learning.
The machine learning is to randomly learn a plurality of decision trees through a random forest (RF) method to construct a plurality of decision trees to classify or predict when input data is received.
Characterized in that the electric-power calculation software is electric-power calculation software through a machine-learning model using the Himawari-8 weather satellite observation data of the observation satellite (10)
A satellite - based computation system using machine learning.
Wherein the brightness determining unit 120 uses a brightness temperature difference (BTD) of infrared region channels observed from a Himawari-8 weather satellite of the observation satellite 10. [
A satellite - based computation system using machine learning.
Wherein the preprocessing unit 110 divides snowfall and cloud regions with a 1.6 占 퐉 reflection rate through observations of the Himawari-8 weather satellite of the observation satellite 10. [
A satellite - based computation system using machine learning.
Wherein the preprocessing unit (110) uses a brightness temperature difference of 3.9 탆 and 11.2 탆 at night through observation values of Himawari-8 weather satellite of the observation satellite (10)
A satellite - based computation system using machine learning.
The preprocessing unit 110 uses Equation 1, which is a normalized reflectance conversion formula.
A satellite - based computation system using machine learning.
(1)
The preprocessing unit 110 uses Equation 2, which is a normalization operator given by Li and Shibata.
A satellite - based computation system using machine learning.
(2)
The lightness determining unit 120
The parameters used in each RF model training are largely the spatial temperature (18x18 km 2 ) average of the combination of the infrared channel-to-channel brightness temperature difference and the brightness temperature of 3.9 μm in the 18 × 18 km 2 region and the air window channels (10.4 μm, 11.2 μm, 12.3 μm) And the specific pixel number category specified by the difference condition is used.
A satellite - based computation system using machine learning.
The lightness determining unit 120
The specific number of pixels defined by the brightness temperature difference condition of 3.9 μm in the 18 × 18 km 2 variable area and the window channels (10.4 μm, 11.2 μm, and 12.3 μm) in the variable category increases the accuracy of the total light determination for the nighttime subgrade, Which is a factor used to distinguish between snow and snow,
A satellite - based computation system using machine learning.
In the satellite-based full-traffic calculation archive server 20
(a) The preprocessing unit 110 uses the brightness temperature and the reflectivity transmitted from the meteorological satellite using the computation software through a machine learning model using meteorological satellite observation data to calculate cloudiness such as snowfall Performing a function of creating input data of a machine learning model in which pixels are classified;
(b) The cloud determination unit 120 acquires the machine learning model training data on the basis of the machine learning model input data created in the preprocessing unit 110 by using the computerized learning model software using the meteorological satellite observation data, Performing a function of sequentially driving the model to determine the electric current; And
(c) The image display and point-by-point tallying unit 130 calculates and displays the result of the calculation of the lightness calculated by the lightness determination unit 120 using the computerized calculation software through the machine learning model using the weather satellite observation data, Performing a function of displaying the classified aggregate information; / RTI >
Computation of Satellite - based Electricity Using Machine Learning.
The machine learning is to randomly learn a plurality of decision trees through a random forest (RF) method to construct a plurality of decision trees to classify or predict when input data is received.
Wherein said electric power calculation software is electric power calculation software through a machine learning model using Himawari-8 weather satellite observation data,
Computation of Satellite - based Electricity Using Machine Learning.
The step (b)
Further comprising the step of classifying the traffic light into fine clouds, cloudy clouds or cloudy clouds,
Computation of Satellite - based Electricity Using Machine Learning.
The step (b)
The lightness determining unit 120 classifies the electric current as 0 or 1 to 5 halo; And
Further comprising the step of causing the light quantity determination unit (120) to classify the electric quantity as 1 or 2 or 3 or 4 or 5,
Computation of Satellite - based Electricity Using Machine Learning.
The step (b)
The light quantity determining unit 120 classifies the electric quantity as 6 to 8 or 9 to 10; ≪ / RTI >
Computation of Satellite - based Electricity Using Machine Learning.
The step (b)
The light quantity determining unit 120 classifies the electric wave as 6, 7, or 8 halo; ≪ / RTI >
Computation of Satellite - based Electricity Using Machine Learning.
The step (b)
Further comprising the step of the light quantity determining unit (120) classifying the electric wave as 9 or 10 halo.
Computation of Satellite - based Electricity Using Machine Learning.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020180017469A KR101855652B1 (en) | 2018-02-13 | 2018-02-13 | System of total cloud cover retrieval from satellite observation using machine learning and method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020180017469A KR101855652B1 (en) | 2018-02-13 | 2018-02-13 | System of total cloud cover retrieval from satellite observation using machine learning and method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101855652B1 true KR101855652B1 (en) | 2018-06-25 |
Family
ID=62806103
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020180017469A KR101855652B1 (en) | 2018-02-13 | 2018-02-13 | System of total cloud cover retrieval from satellite observation using machine learning and method thereof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101855652B1 (en) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102000630B1 (en) * | 2018-12-20 | 2019-07-16 | 한국해양과학기술원 | Apparatus for detecting cloud based on satellite image and method thereof |
KR102042385B1 (en) | 2019-06-10 | 2019-11-07 | 세종대학교산학협력단 | Method and apparatus for virtual satellite image generation |
KR102209866B1 (en) | 2020-03-03 | 2021-01-29 | 대한민국 | Preprocessing Method of Distortion Image for Ground Based Total Cloude Cover Automatic Retrieval |
KR20210032075A (en) * | 2019-09-16 | 2021-03-24 | (주)시정 | System for image analysis using artificial intelligence and method using the same |
KR20210064672A (en) * | 2019-11-26 | 2021-06-03 | 한국항공우주연구원 | Earth Observation Image Transmission Priority Determination Method and Apparatus |
KR20210111578A (en) | 2020-03-03 | 2021-09-13 | 대한민국(기상청 국립기상과학원장) | Distortion Method of Total Cloude Cover in Night Time using Ground Based Whole Sky Image Data |
CN113534158A (en) * | 2021-06-10 | 2021-10-22 | 国家卫星气象中心(国家空间天气监测预警中心) | Static orbit meteorological satellite radar reflectivity factor inversion method based on deep learning |
CN113570642A (en) * | 2021-06-10 | 2021-10-29 | 国家卫星气象中心(国家空间天气监测预警中心) | Stationary orbit satellite convection birth early warning method based on background field data and machine learning |
CN113780439A (en) * | 2021-09-15 | 2021-12-10 | 国家气象中心 | Multi-cloud identification system of different types of meteorological satellites based on unsupervised domain adaptation |
KR20210158677A (en) * | 2020-06-24 | 2021-12-31 | 대한민국(기상청 국립기상과학원장) | calculating method of total cloud in night time using method of classifying image |
CN113987782A (en) * | 2021-10-26 | 2022-01-28 | 武汉大学 | Near-ground ultraviolet irradiance satellite missing data completion method based on cloud information |
KR102417412B1 (en) * | 2021-10-26 | 2022-07-06 | (주)유에스티21 | Cloud detection system for periodic composite of satellite images and method thereof |
CN115542431A (en) * | 2022-11-25 | 2022-12-30 | 成都远望探测技术有限公司 | Convection current birth monitoring method based on foundation cloud radar and satellite data |
KR20230018624A (en) | 2021-07-30 | 2023-02-07 | 대한민국(기상청 국립기상과학원장) | Method of Calculating Day and Night Total Cloud Cover using Photographing Image Ground Camera-based and Support Vector Machine Algorithm |
US11620819B2 (en) | 2021-08-27 | 2023-04-04 | Si Analytics Co., Ltd | Method for scheduling of shooting satellite images based on deep learning |
CN117371333A (en) * | 2023-11-17 | 2024-01-09 | 中国农业科学院农业资源与农业区划研究所 | Surface temperature product angle normalization method based on nuclear drive model |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101709860B1 (en) | 2015-09-01 | 2017-02-23 | 강릉원주대학교산학협력단 | Former all-sky cloud cover in the sky using a RGB color image data output method and system |
-
2018
- 2018-02-13 KR KR1020180017469A patent/KR101855652B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101709860B1 (en) | 2015-09-01 | 2017-02-23 | 강릉원주대학교산학협력단 | Former all-sky cloud cover in the sky using a RGB color image data output method and system |
Non-Patent Citations (2)
Title |
---|
(L. Weng, et al., ‘Computing Cloud Cover Fraction in Satellite Images using Deep Extreme Learning Machine’, International Journal of Simulation - Systems, Science & Techno; 2016.12, Vol. 17 Issue 48. |
이병일 외 4인, ‘MTSAT-1R 정지기상위성 자료를 이용한 전운량 산출 알고리즘 개발’, 한국기상학회 봄 학술대회 논문집, 2007. |
Cited By (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102000630B1 (en) * | 2018-12-20 | 2019-07-16 | 한국해양과학기술원 | Apparatus for detecting cloud based on satellite image and method thereof |
KR102042385B1 (en) | 2019-06-10 | 2019-11-07 | 세종대학교산학협력단 | Method and apparatus for virtual satellite image generation |
KR102359306B1 (en) * | 2019-09-16 | 2022-02-07 | (주)시정 | System for image analysis using artificial intelligence and method using the same |
KR20210032075A (en) * | 2019-09-16 | 2021-03-24 | (주)시정 | System for image analysis using artificial intelligence and method using the same |
KR20210064672A (en) * | 2019-11-26 | 2021-06-03 | 한국항공우주연구원 | Earth Observation Image Transmission Priority Determination Method and Apparatus |
KR102440457B1 (en) | 2019-11-26 | 2022-09-05 | 한국항공우주연구원 | Earth Observation Image Transmission Priority Determination Method and Apparatus |
KR102209866B1 (en) | 2020-03-03 | 2021-01-29 | 대한민국 | Preprocessing Method of Distortion Image for Ground Based Total Cloude Cover Automatic Retrieval |
KR20210111578A (en) | 2020-03-03 | 2021-09-13 | 대한민국(기상청 국립기상과학원장) | Distortion Method of Total Cloude Cover in Night Time using Ground Based Whole Sky Image Data |
KR20210158677A (en) * | 2020-06-24 | 2021-12-31 | 대한민국(기상청 국립기상과학원장) | calculating method of total cloud in night time using method of classifying image |
KR102428016B1 (en) | 2020-06-24 | 2022-08-03 | 대한민국 | calculating method of total cloud in night time using method of classifying image |
CN113570642B (en) * | 2021-06-10 | 2024-01-05 | 国家卫星气象中心(国家空间天气监测预警中心) | Static orbit satellite convection primary early warning method based on background field data and machine learning |
CN113534158B (en) * | 2021-06-10 | 2024-06-11 | 国家卫星气象中心(国家空间天气监测预警中心) | Static orbit meteorological satellite radar reflectivity factor inversion method based on deep learning |
CN113570642A (en) * | 2021-06-10 | 2021-10-29 | 国家卫星气象中心(国家空间天气监测预警中心) | Stationary orbit satellite convection birth early warning method based on background field data and machine learning |
CN113534158A (en) * | 2021-06-10 | 2021-10-22 | 国家卫星气象中心(国家空间天气监测预警中心) | Static orbit meteorological satellite radar reflectivity factor inversion method based on deep learning |
KR20230018624A (en) | 2021-07-30 | 2023-02-07 | 대한민국(기상청 국립기상과학원장) | Method of Calculating Day and Night Total Cloud Cover using Photographing Image Ground Camera-based and Support Vector Machine Algorithm |
US11620819B2 (en) | 2021-08-27 | 2023-04-04 | Si Analytics Co., Ltd | Method for scheduling of shooting satellite images based on deep learning |
CN113780439B (en) * | 2021-09-15 | 2023-09-22 | 国家气象中心 | Multi-cloud identification system of different types of meteorological satellites based on unsupervised domain adaptation |
CN113780439A (en) * | 2021-09-15 | 2021-12-10 | 国家气象中心 | Multi-cloud identification system of different types of meteorological satellites based on unsupervised domain adaptation |
KR102417412B1 (en) * | 2021-10-26 | 2022-07-06 | (주)유에스티21 | Cloud detection system for periodic composite of satellite images and method thereof |
CN113987782A (en) * | 2021-10-26 | 2022-01-28 | 武汉大学 | Near-ground ultraviolet irradiance satellite missing data completion method based on cloud information |
CN115542431A (en) * | 2022-11-25 | 2022-12-30 | 成都远望探测技术有限公司 | Convection current birth monitoring method based on foundation cloud radar and satellite data |
CN115542431B (en) * | 2022-11-25 | 2023-03-10 | 成都远望探测技术有限公司 | Convection current birth monitoring method based on foundation cloud radar and satellite data |
CN117371333A (en) * | 2023-11-17 | 2024-01-09 | 中国农业科学院农业资源与农业区划研究所 | Surface temperature product angle normalization method based on nuclear drive model |
CN117371333B (en) * | 2023-11-17 | 2024-03-22 | 中国农业科学院农业资源与农业区划研究所 | Surface temperature product angle normalization method based on nuclear drive model |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101855652B1 (en) | System of total cloud cover retrieval from satellite observation using machine learning and method thereof | |
Souza-Echer et al. | A simple method for the assessment of the cloud cover state in high-latitude regions by a ground-based digital camera | |
Francini et al. | Near-real time forest change detection using PlanetScope imagery | |
Derrien et al. | MSG/SEVIRI cloud mask and type from SAFNWC | |
Alonso-Montesinos et al. | Solar irradiance forecasting at one-minute intervals for different sky conditions using sky camera images | |
CA2996216C (en) | Method and system for solar power forecasting | |
US10692013B2 (en) | Solar irradiation modeling and forecasting using community based terrestrial sky imaging | |
JP7415347B2 (en) | Information processing equipment, information processing method, program, sensing system | |
Alonso et al. | Sky camera imagery processing based on a sky classification using radiometric data | |
CN109919250B (en) | Soil moisture-considered evapotranspiration space-time characteristic fusion method and device | |
CN111782689A (en) | Multi-task parallel processing method based on satellite data | |
Werkmeister et al. | Comparing satellite-to ground-based automated and manual cloud coverage observations–a case study | |
Hünerbein et al. | Cloud mask algorithm from the EarthCARE Multi-Spectral Imager: the M-CM products | |
Chen et al. | LAI-NOS: An automatic network observation system for leaf area index based on hemispherical photography | |
Huertas-Tato et al. | Using a multi-view convolutional neural network to monitor solar irradiance | |
Kim et al. | Data-to-data translation-based nowcasting of specific sea fog using geostationary weather satellite observation | |
CN117808708A (en) | Cloud and fog remote sensing image processing method, device, equipment and medium | |
Alonso-Montesinos et al. | Impact of a Saharan dust intrusion over southern Spain on DNI estimation with sky cameras | |
US20230281475A1 (en) | Turbulence prediction system and method | |
CN111912819B (en) | Ecological detection method based on satellite data | |
Shaffery et al. | Automated construction of clear-sky dictionary from all-sky imager data | |
Gacal et al. | Ground-based detection of nighttime clouds above Manila Observatory (14.64° N, 121.07° E) using a digital camera | |
d'Entremont et al. | Analysis of geostationary satellite imagery using a temporal-differencing technique | |
CN115049754B (en) | Method and device for generating infrared thermodynamic diagram on orbit based on satellite | |
Tapakis et al. | Monitoring cloud motion in cyprus for solar irradiance prediction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GRNT | Written decision to grant |