CN116359285A - Oil gas concentration intelligent detection system and method based on big data - Google Patents
Oil gas concentration intelligent detection system and method based on big data Download PDFInfo
- Publication number
- CN116359285A CN116359285A CN202310392587.4A CN202310392587A CN116359285A CN 116359285 A CN116359285 A CN 116359285A CN 202310392587 A CN202310392587 A CN 202310392587A CN 116359285 A CN116359285 A CN 116359285A
- Authority
- CN
- China
- Prior art keywords
- data
- oil gas
- module
- gas concentration
- concentration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 38
- 238000000034 method Methods 0.000 title claims abstract description 24
- 230000008859 change Effects 0.000 claims abstract description 25
- 238000012545 processing Methods 0.000 claims abstract description 21
- 238000007405 data analysis Methods 0.000 claims abstract description 20
- 238000013079 data visualisation Methods 0.000 claims abstract description 14
- 238000012544 monitoring process Methods 0.000 claims abstract description 14
- 238000004458 analytical method Methods 0.000 claims abstract description 9
- 238000003912 environmental pollution Methods 0.000 claims abstract description 8
- 230000005540 biological transmission Effects 0.000 claims abstract description 5
- 239000013307 optical fiber Substances 0.000 claims abstract description 5
- 239000007789 gas Substances 0.000 claims description 78
- 238000012549 training Methods 0.000 claims description 20
- 239000003344 environmental pollutant Substances 0.000 claims description 14
- 231100000719 pollutant Toxicity 0.000 claims description 14
- 239000003053 toxin Substances 0.000 claims description 14
- 231100000765 toxin Toxicity 0.000 claims description 14
- 108700012359 toxins Proteins 0.000 claims description 14
- 239000002912 waste gas Substances 0.000 claims description 14
- 238000013528 artificial neural network Methods 0.000 claims description 12
- 238000012706 support-vector machine Methods 0.000 claims description 12
- 238000013499 data model Methods 0.000 claims description 9
- 238000013500 data storage Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 claims description 9
- 238000000605 extraction Methods 0.000 claims description 9
- 230000002159 abnormal effect Effects 0.000 claims description 7
- 238000007781 pre-processing Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 7
- 238000003066 decision tree Methods 0.000 claims description 6
- 238000012417 linear regression Methods 0.000 claims description 6
- 238000012163 sequencing technique Methods 0.000 claims description 6
- 238000004140 cleaning Methods 0.000 claims description 4
- 238000007726 management method Methods 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N27/00—Investigating or analysing materials by the use of electric, electrochemical, or magnetic means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/0004—Gaseous mixtures, e.g. polluted air
- G01N33/0009—General constructional details of gas analysers, e.g. portable test equipment
- G01N33/0062—General constructional details of gas analysers, e.g. portable test equipment concerning the measuring method or the display, e.g. intermittent measurement or digital display
- G01N33/0063—General constructional details of gas analysers, e.g. portable test equipment concerning the measuring method or the display, e.g. intermittent measurement or digital display using a threshold to release an alarm or displaying means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/0004—Gaseous mixtures, e.g. polluted air
- G01N33/0009—General constructional details of gas analysers, e.g. portable test equipment
- G01N33/0062—General constructional details of gas analysers, e.g. portable test equipment concerning the measuring method or the display, e.g. intermittent measurement or digital display
- G01N33/0068—General constructional details of gas analysers, e.g. portable test equipment concerning the measuring method or the display, e.g. intermittent measurement or digital display using a computer specifically programmed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/10—Pre-processing; Data cleansing
- G06F18/15—Statistical pre-processing, e.g. techniques for normalisation or restoring missing data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A50/00—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE in human health protection, e.g. against extreme weather
- Y02A50/20—Air quality improvement or preservation, e.g. vehicle emission control or emission reduction by using catalytic converters
Landscapes
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Computational Biology (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Biochemistry (AREA)
- Analytical Chemistry (AREA)
- Food Science & Technology (AREA)
- Medicinal Chemistry (AREA)
- Combustion & Propulsion (AREA)
- Electrochemistry (AREA)
- Chemical Kinetics & Catalysis (AREA)
- Probability & Statistics with Applications (AREA)
- Investigating Or Analyzing Materials By The Use Of Fluid Adsorption Or Reactions (AREA)
Abstract
The invention provides an oil gas concentration intelligent detection system and method based on big data, and relates to the technical field of oil gas concentration intelligent detection. The system comprises a big data oil gas concentration intelligent detection system, a data acquisition module, a data receiving module, a big data analysis module and a data visualization module. The invention provides an oil gas concentration intelligent detection system and method based on big data, when an oil gas sensor detects that the oil gas concentration exists in the environment, the system uploads the collected data to a cloud storage platform through an optical fiber transmission mode for data processing and analysis, and then the collected data is processed to monitor the change trend and the exceeding condition of the oil gas concentration, and timely send out early warning, so that the monitoring and management of environmental pollution are realized, the purpose of intelligent detection is achieved, the participation of manpower is greatly reduced, and the detection efficiency of the oil gas concentration is improved.
Description
Technical Field
The invention relates to the technical field of intelligent detection of oil gas concentration, in particular to an intelligent detection system and method of oil gas concentration based on big data.
Background
The large data refer to a large amount of diversified data which are emerging at high speed, the characteristics of the large data can be simply summarized into 3V, namely Velocity, volume, variety, the large scale of the large data can make the traditional data processing software be unprecedented, the novel large data technology can rapidly and efficiently process the data, in the detection process of the oil gas concentration, great convenience can be brought to people by calculating the large data, and the intelligent detection of the oil gas concentration based on the large data can be realized by utilizing the large data technology and related algorithms to monitor, analyze and predict the oil gas concentration in an oil field in real time so as to improve the oil gas exploitation efficiency, ensure the ecological environment and public safety and timely early warn and respond to abnormal conditions.
However, the traditional oil gas concentration detection mainly depends on methods such as manual sampling, laboratory analysis and the like, and has the problems of complex operation, long time loss, poor real-time performance, large human factors and the like, so that technical improvement is urgently needed.
Disclosure of Invention
(one) solving the technical problems
Aiming at the defects of the prior art, the invention provides an oil gas concentration intelligent detection system and method based on big data, which can solve the problem that the traditional oil gas concentration detection mainly depends on manual sampling, and simultaneously solve the problems of complicated operation, long time loss and poor instantaneity of the traditional oil gas concentration detection.
(II) technical scheme
In order to achieve the above purpose, the invention is realized by the following technical scheme: the system comprises a big data oil gas concentration intelligent detection system, a data acquisition module, a data receiving module, a big data analysis module and a data visualization module;
when the oil gas sensor detects that the oil gas concentration exists in the environment, the system uploads the collected data to the cloud storage platform in an optical fiber transmission mode for data processing and analysis, and the collected data is processed to monitor the change trend and the exceeding condition of the oil gas concentration and timely send out early warning, so that the monitoring and management of the environmental pollution are realized, and the purpose of intelligent detection is achieved;
the data acquisition module is used for acquiring the detected oil gas concentration data;
the data receiving module is used for processing and cleaning the collected oil gas concentration data, and extracting concentration-related characteristics such as geological geographic conditions, temperature, humidity, time and the like from the data;
the big data analysis module analyzes the oil gas concentration data to obtain the distribution condition of various indexes, detects the occurrence condition of toxin and waste gas pollutants and determines the influence of the toxin and waste gas pollutants on human bodies, ecology and environment;
a data visualization module that presents predictions, such as line graphs and thermodynamic diagrams, to better understand concentration changes.
Preferably, the data acquisition module comprises an oil gas concentration sensor and an air quality monitoring instrument, the purpose of monitoring the oil gas concentration in the environment in real time can be achieved through the oil gas concentration sensor, meanwhile, the oil gas sensor detects by utilizing an electrical principle, and the air quality monitoring instrument detects and analyzes the oil gas component in the air, so that the oil gas concentration is rapidly and accurately detected and monitored, and the problem of environmental pollution is effectively avoided.
Preferably, the data receiving module comprises a data preprocessing module, and the data preprocessing module processes and cleans the collected original data, and mainly comprises the steps of selecting a data column to be analyzed, renaming a column name, deleting a repeated value, processing a missing value, conforming, sequencing, processing an abnormal value and the like, wherein the operations can be realized by using related tools and libraries of programming languages such as Python and the like.
Preferably, the data receiving module comprises a data feature extraction module, features related to the analysis target are extracted from the data through the data feature extraction module, feature selection is required to be frequently carried out in the early modeling process, and only the features related to the target are guaranteed to be used for subsequent calculation.
Preferably, the data receiving module comprises a data storage module and a cloud storage platform.
Preferably, the big data analysis module comprises a model training module and a data model selection module, wherein the model training module is used for selecting a proper learning model, such as linear regression, a decision tree, a support vector machine and a neural network, according to actual conditions, and the model training module is used for training the selected model through historical data to obtain a model support vector machine and the neural network for predicting future concentration change.
Preferably, the big data analysis module comprises a concentration prediction module, and the trained model is used for predicting the concentration change of the oil field in a future period of time according to the current geographic conditions, weather conditions and the like through the concentration prediction module.
Preferably, the intelligent detection method for the oil gas concentration based on big data comprises the following steps:
s1, data acquisition module
Firstly, detecting the oil gas concentration data of the geographic position of oil gas storage in real time through a data acquisition module;
s2, data receiving module
The method mainly comprises the steps of selecting a data column to be analyzed, renaming the column name, deleting the repeated value, processing the missing value, unifying, sequencing, processing the abnormal value and the like, and simultaneously, the operations can be realized by using related tools and libraries of programming languages such as Python and the like;
s3, data feature extraction module
Extracting concentration-related characteristics from the data, such as geological geographic conditions, temperature, humidity, time and the like;
s4, data storage module
Secondly, transmitting the data to a cloud storage platform through a data storage module;
s5, big data analysis module
Analyzing the oil gas concentration data through a big data analysis module to obtain the distribution condition of various indexes, detecting the occurrence condition of toxins and waste gas pollutants, and determining the influence of the toxins and waste gas pollutants on human bodies, ecology and environment;
s6, data model selection module
Selecting a proper learning model, such as linear regression, a decision tree, a support vector machine and a neural network, according to actual conditions by a data model selection module;
s7, model training module
Training the selected model through historical data by a model training module to obtain a model support vector machine and a neural network for predicting future concentration change;
s8, concentration prediction module
The trained model is made to predict the oilfield concentration change in a period of time in the future according to the current geographic, meteorological and other conditions by a concentration prediction module;
s9, data visualization module
And then, the data visualization module displays the prediction results, such as a line graph and a thermodynamic diagram, so that the concentration change and the oilfield concentration change in a future trend period are better understood.
(III) beneficial effects
The invention provides an oil gas concentration intelligent detection system and method based on big data. The beneficial effects are as follows:
1. the invention provides an oil gas concentration intelligent detection system and method based on big data, when an oil gas sensor detects that the oil gas concentration exists in the environment, the system uploads the collected data to a cloud storage platform through an optical fiber transmission mode for data processing and analysis, and then the collected data is processed to monitor the change trend and the exceeding condition of the oil gas concentration and timely send out early warning, so that the monitoring and management of environmental pollution are realized, the purpose of intelligent detection is achieved, the participation of manpower is greatly reduced, and the detection efficiency of the oil gas concentration is improved.
2. The invention provides an oil gas concentration intelligent detection system and method based on big data, the method analyzes the oil gas concentration data through a big data analysis module to obtain the distribution situation of various indexes, detects the occurrence situation of toxins and waste gas pollutants, determines the influence of the toxins and waste gas pollutants on human bodies, ecology and environment, and simultaneously displays the prediction results, such as a line graph and a thermodynamic diagram, through a data visualization module, thereby better understanding the concentration change and the oilfield concentration change in a future trend in a period of time.
Drawings
FIG. 1 is a block diagram of a method of the present invention;
fig. 2 is a block diagram of the system architecture of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Examples:
1-2, the embodiment of the invention provides an oil gas concentration intelligent detection system and method based on big data, wherein the system comprises a big data oil gas concentration intelligent detection system, a data acquisition module, a data receiving module, a big data analysis module and a data visualization module;
when the oil gas sensor detects that the oil gas concentration exists in the environment, the system uploads the collected data to the cloud storage platform in an optical fiber transmission mode for data processing and analysis, and the collected data is processed to monitor the change trend and the exceeding condition of the oil gas concentration and timely send out early warning, so that the monitoring and management of the environmental pollution are realized, and the purpose of intelligent detection is achieved;
the data acquisition module is used for acquiring the detected oil gas concentration data;
the data receiving module is used for processing and cleaning the collected oil gas concentration data, and extracting concentration-related characteristics such as geological geographic conditions, temperature, humidity, time and the like from the data;
the big data analysis module analyzes the oil gas concentration data to obtain the distribution condition of various indexes, detects the occurrence condition of toxin and waste gas pollutants and determines the influence of the toxin and waste gas pollutants on human bodies, ecology and environment;
a data visualization module that presents predictions, such as line graphs and thermodynamic diagrams, to better understand concentration changes.
The data acquisition module comprises an oil gas concentration sensor and an air quality monitoring instrument, the purpose of monitoring the oil gas concentration in the environment in real time can be achieved through the oil gas concentration sensor, meanwhile, the oil gas sensor detects and analyzes the oil gas component in the air by utilizing an electrical principle, further, the oil gas concentration is rapidly and accurately detected and monitored by the air quality monitoring instrument, the occurrence of the environmental pollution problem is effectively avoided, the data receiving module comprises a data preprocessing module, the data preprocessing module is used for processing and cleaning the acquired original data, the data preprocessing module mainly comprises the steps of selecting data columns needing to be analyzed, repeatedly naming, deleting repeated values, processing missing values, conforming, sequencing, processing abnormal values and the like, and meanwhile, the operations can be realized by using related tools and libraries of programming languages such as Python, the data receiving module comprises a data feature extraction module, the data feature extraction module is used for extracting features related to an analysis target from data, feature selection is needed to be carried out frequently in the early modeling process, only the features related to the target are guaranteed to be used for subsequent calculation, the data receiving module comprises a data storage module and a cloud storage platform, the big data analysis module comprises a model training module and a data model selection module, a proper learning model such as linear regression, a decision tree, a support vector machine and a neural network is selected according to actual conditions through the model training module, the selected model is trained through historical data through the model training module, a model support vector machine and a neural network for predicting future concentration change are obtained, the big data analysis module comprises a concentration prediction module, the trained model is enabled through the concentration prediction module, and predicting the change of the oilfield concentration in a future period of time according to the current geographical conditions, weather conditions and the like.
An oil gas concentration intelligent detection method based on big data comprises the following steps:
s1, data acquisition module
Firstly, detecting the oil gas concentration data of the geographic position of oil gas storage in real time through a data acquisition module;
s2, data receiving module
The method mainly comprises the steps of selecting a data column to be analyzed, renaming the column name, deleting the repeated value, processing the missing value, unifying, sequencing, processing the abnormal value and the like, and simultaneously, the operations can be realized by using related tools and libraries of programming languages such as Python and the like;
s3, data feature extraction module
Extracting concentration-related characteristics from the data, such as geological geographic conditions, temperature, humidity, time and the like;
s4, data storage module
Secondly, transmitting the data to a cloud storage platform through a data storage module;
s5, big data analysis module
Analyzing the oil gas concentration data through a big data analysis module to obtain the distribution condition of various indexes, detecting the occurrence condition of toxins and waste gas pollutants, and determining the influence of the toxins and waste gas pollutants on human bodies, ecology and environment;
s6, data model selection module
Selecting a proper learning model, such as linear regression, a decision tree, a support vector machine and a neural network, according to actual conditions by a data model selection module;
s7, model training module
Training the selected model through historical data by a model training module to obtain a model support vector machine and a neural network for predicting future concentration change;
s8, concentration prediction module
The trained model is made to predict the oilfield concentration change in a period of time in the future according to the current geographic, meteorological and other conditions by a concentration prediction module;
s9, data visualization module
And then, the data visualization module displays the prediction results, such as a line graph and a thermodynamic diagram, so that the concentration change and the oilfield concentration change in a future trend period are better understood.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (8)
1. Oil gas concentration intelligent detection system based on big data, its characterized in that: the system comprises a big data oil gas concentration intelligent detection system, a data acquisition module, a data receiving module, a big data analysis module and a data visualization module;
when the oil gas sensor detects that the oil gas concentration exists in the environment, the system uploads the collected data to the cloud storage platform in an optical fiber transmission mode for data processing and analysis, and the collected data is processed to monitor the change trend and the exceeding condition of the oil gas concentration and timely send out early warning, so that the monitoring and management of the environmental pollution are realized, and the purpose of intelligent detection is achieved;
the data acquisition module is used for acquiring the detected oil gas concentration data;
the data receiving module is used for processing and cleaning the collected oil gas concentration data, and extracting concentration-related characteristics such as geological geographic conditions, temperature, humidity, time and the like from the data;
the big data analysis module analyzes the oil gas concentration data to obtain the distribution condition of various indexes, detects the occurrence condition of toxin and waste gas pollutants and determines the influence of the toxin and waste gas pollutants on human bodies, ecology and environment;
a data visualization module that presents predictions, such as line graphs and thermodynamic diagrams, to better understand concentration changes.
2. The intelligent detection system for oil gas concentration based on big data according to claim 1, wherein: the data acquisition module comprises an oil gas concentration sensor and an air quality monitoring instrument, the purpose of monitoring the oil gas concentration in the environment in real time can be achieved through the oil gas concentration sensor, meanwhile, the oil gas sensor detects by utilizing an electrical principle, and the air quality monitoring instrument detects and analyzes the oil gas component in the air, so that the oil gas concentration is rapidly and accurately detected and monitored, and the problem of environmental pollution is effectively avoided.
3. The intelligent detection system for oil gas concentration based on big data according to claim 1, wherein: the data receiving module comprises a data preprocessing module, processes and cleans the collected original data through the data preprocessing module, and mainly comprises the steps of selecting a data column needing to be analyzed, renaming the column name, deleting the repeated value, processing the missing value, conforming, sequencing, processing the abnormal value and the like, wherein the operations can be realized by using related tools and libraries of programming languages such as Python and the like.
4. The intelligent detection system for oil gas concentration based on big data according to claim 1, wherein: the data receiving module comprises a data feature extraction module, features related to the analysis target are extracted from the data through the data feature extraction module, feature selection is required to be carried out frequently in the early modeling process, and only the features related to the target are guaranteed to be used for subsequent calculation.
5. The intelligent detection system for oil gas concentration based on big data according to claim 1, wherein: the data receiving module comprises a data storage module and a cloud storage platform.
6. The intelligent detection system for oil gas concentration based on big data according to claim 1, wherein: the big data analysis module comprises a model training module and a data model selection module, wherein the model training module is used for selecting a proper learning model such as linear regression, a decision tree, a support vector machine and a neural network according to actual conditions, and the model training module is used for training the selected model through historical data to obtain a model support vector machine and a neural network for predicting future concentration change.
7. The intelligent detection system for oil gas concentration based on big data according to claim 1, wherein: the big data analysis module comprises a concentration prediction module, and the trained model is used for predicting the concentration change of the oil field in a future period of time according to the current geographic conditions, weather conditions and the like through the concentration prediction module.
8. An oil gas concentration intelligent detection method based on big data is characterized in that: the method comprises the following steps:
s1, data acquisition module
Firstly, detecting the oil gas concentration data of the geographic position of oil gas storage in real time through a data acquisition module;
s2, data receiving module
The method mainly comprises the steps of selecting a data column to be analyzed, renaming the column name, deleting the repeated value, processing the missing value, unifying, sequencing, processing the abnormal value and the like, and simultaneously, the operations can be realized by using related tools and libraries of programming languages such as Python and the like;
s3, data feature extraction module
Extracting concentration-related characteristics from the data, such as geological geographic conditions, temperature, humidity, time and the like;
s4, data storage module
Secondly, transmitting the data to a cloud storage platform through a data storage module;
s5, big data analysis module
Analyzing the oil gas concentration data through a big data analysis module to obtain the distribution condition of various indexes, detecting the occurrence condition of toxins and waste gas pollutants, and determining the influence of the toxins and waste gas pollutants on human bodies, ecology and environment;
s6, data model selection module
Selecting a proper learning model, such as linear regression, a decision tree, a support vector machine and a neural network, according to actual conditions by a data model selection module;
s7, model training module
Training the selected model through historical data by a model training module to obtain a model support vector machine and a neural network for predicting future concentration change;
s8, concentration prediction module
The trained model is made to predict the oilfield concentration change in a period of time in the future according to the current geographic, meteorological and other conditions by a concentration prediction module;
s9, data visualization module
And then, the data visualization module displays the prediction results, such as a line graph and a thermodynamic diagram, so that the concentration change and the oilfield concentration change in a future trend period are better understood.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310392587.4A CN116359285A (en) | 2023-04-13 | 2023-04-13 | Oil gas concentration intelligent detection system and method based on big data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310392587.4A CN116359285A (en) | 2023-04-13 | 2023-04-13 | Oil gas concentration intelligent detection system and method based on big data |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116359285A true CN116359285A (en) | 2023-06-30 |
Family
ID=86908268
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202310392587.4A Pending CN116359285A (en) | 2023-04-13 | 2023-04-13 | Oil gas concentration intelligent detection system and method based on big data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116359285A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116776104A (en) * | 2023-08-21 | 2023-09-19 | 华南理工大学 | Method and system for analyzing change rule of atmospheric components based on machine learning |
CN117434227A (en) * | 2023-12-20 | 2024-01-23 | 河北金隅鼎鑫水泥有限公司 | Method and system for monitoring waste gas components of cement manufacturing plant |
-
2023
- 2023-04-13 CN CN202310392587.4A patent/CN116359285A/en active Pending
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116776104A (en) * | 2023-08-21 | 2023-09-19 | 华南理工大学 | Method and system for analyzing change rule of atmospheric components based on machine learning |
CN116776104B (en) * | 2023-08-21 | 2023-11-10 | 华南理工大学 | Method and system for analyzing change rule of atmospheric components based on machine learning |
CN117434227A (en) * | 2023-12-20 | 2024-01-23 | 河北金隅鼎鑫水泥有限公司 | Method and system for monitoring waste gas components of cement manufacturing plant |
CN117434227B (en) * | 2023-12-20 | 2024-04-30 | 河北金隅鼎鑫水泥有限公司 | Method and system for monitoring waste gas components of cement manufacturing plant |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN116359285A (en) | Oil gas concentration intelligent detection system and method based on big data | |
CN115578015B (en) | Sewage treatment whole process supervision method, system and storage medium based on Internet of things | |
CN111985567B (en) | Automatic pollution source type identification method based on machine learning | |
CN116186566B (en) | Diffusion prediction method and system based on deep learning | |
CN107480698A (en) | Method of quality control based on multiple monitoring indexes | |
CN116340723B (en) | Rural water pollution quick tracing method and system based on big data | |
CN117370900B (en) | Water quality monitoring system for environmental protection monitoring | |
CN111622735A (en) | Environment-friendly drilling machine automatic control and monitoring system and method based on Internet of things | |
CN108875118B (en) | Method and device for evaluating accuracy of prediction model of silicon content of blast furnace molten iron | |
CN115575584B (en) | Atmospheric environment cadmium content monitoring and early warning method and system | |
CN115730684A (en) | Air quality detection system based on LSTM-CNN model | |
CN113592308A (en) | Monitoring data alarm threshold extraction method based on normal model | |
CN113008806A (en) | Agricultural product production area heavy metal spatial distribution determination method | |
CN116861369A (en) | Air compressor health assessment method and system for industrial internet heterogeneous data fusion | |
CN116341776A (en) | Forest fire prevention intelligent detection system and method based on big data | |
CN114970977A (en) | Abnormal data detection method and system for digital urban air quality monitoring data | |
CN113267601B (en) | Industrial production environment remote real-time monitoring cloud platform based on machine vision and data analysis | |
CN113469938B (en) | Pipe gallery video analysis method and system based on embedded front-end processing server | |
CN110850837A (en) | System life analysis and fault diagnosis method based on long-time and short-time memory neural network | |
CN116930423A (en) | Automatic verification and evaluation method and system for air quality model simulation effect | |
CN111160490A (en) | Deep learning dangerous rock deformation prediction method and device based on multiple time sequences | |
CN113836813B (en) | Blast furnace tuyere water leakage detection method based on data analysis | |
CN113468821B (en) | Decision regression algorithm-based slope abortion sand threshold determination method | |
CN114648095A (en) | Air quality concentration inversion method based on deep learning | |
Ari et al. | A genetic programming based pollutant concentration predictor design for urban pollution monitoring based on multi-sensor electronic nose |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |