CN111930733A - Industrial equipment big data storage system based on monitoring of Internet of things - Google Patents
Industrial equipment big data storage system based on monitoring of Internet of things Download PDFInfo
- Publication number
- CN111930733A CN111930733A CN202010789942.8A CN202010789942A CN111930733A CN 111930733 A CN111930733 A CN 111930733A CN 202010789942 A CN202010789942 A CN 202010789942A CN 111930733 A CN111930733 A CN 111930733A
- Authority
- CN
- China
- Prior art keywords
- data
- data storage
- storage server
- industrial equipment
- transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses an industrial equipment big data storage system based on monitoring of the Internet of things, which comprises a data acquisition module, a data processing module, a data transmission module, a first data storage server, a second data storage server, a standby data storage server and a task allocation module, wherein the data acquisition module is used for acquiring data; the data acquisition module is used for acquiring and analyzing equipment information generated by industrial equipment; the data processing module is used for processing the set type data to obtain set processing data; the task allocation module is used for receiving the set processing data transmitted by the data transmission module and allocating the set processing data to be stored to the first data storage server, the second data storage server and the standby data storage server. The invention solves the problems that the classification storage can not be carried out according to the stored value of the data generated by the industrial equipment and the wireless transmission can not be carried out by reasonably selecting the staff; redundant data is greatly reduced; the high efficiency of data storage is guaranteed.
Description
Technical Field
The invention relates to the technical field of data storage, in particular to an industrial equipment big data storage system based on monitoring of the Internet of things.
Background
Industrial equipment used in production processes generates a lot of data including production volume, part model, etc.; data is continuously collected and stored, the current data is passively collected and stored, and the problems that classification storage cannot be carried out according to the stored value of the data generated by industrial equipment and employees can not be reasonably selected for wireless transmission exist; the collected data is inevitably mixed with defective data or useless data, and the storage space is occupied;
the storage capacity of a single server is limited when the storage is carried out by the single server, the waste of server resources is easily caused when a plurality of servers exist, and the problem is not reasonably solved all the time.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide an industrial equipment big data storage system based on monitoring of the Internet of things, and solves the problems that classified storage can not be carried out according to the stored values of data generated by industrial equipment and employees can not be reasonably selected for wireless transmission; the collected data is subjected to primary processing, the defective data is repaired, and useless data are deleted; messy codes and repeated parts contained in the acquired data are removed, and the length of the acquired data is controlled, so that data standardization is realized, and redundant data is greatly reduced;
according to the invention, auxiliary storage is carried out through the standby storage server according to the historical data storage states of the two data storage servers, so that the high efficiency of data storage is ensured; meanwhile, the invention can ensure that the data storage is not influenced by the standby data storage server within the time of obtaining the historical data storage state.
The purpose of the invention can be realized by the following technical scheme: the industrial equipment big data storage system based on the monitoring of the Internet of things comprises a data acquisition module, a data processing module, a data transmission module, a first data storage server, a second data storage server, a standby data storage server and a task allocation module;
the data acquisition module is used for acquiring and analyzing equipment information generated by industrial equipment; the method comprises the following specific steps:
the method comprises the following steps: labeling the industrial device as Qi; setting all models of the industrial equipment to correspond to a preset value, matching the models in the equipment information with all models to obtain corresponding preset values, and marking the preset values as X1Qi；
Step two: marking the times of acquiring the operation data of the industrial equipment in the preset time period as CQiMarking the time when the industrial equipment operation data is collected as TQia;
step three, marking the current time of the system as A and utilizing a formula
Calculating to obtain a close value f (TQia) of each acquisition; wherein a1 and sigma are preset coefficient factors;
step four: using formulas
Calculating to obtain an operation priority value MQi of the industrial equipment; wherein a2, a3 and a4 are all coefficient factors;
step five: setting operation data generated by industrial equipment to comprise a plurality of data types, matching the acquired operation data of the industrial equipment with the plurality of data types by a data acquisition module to obtain corresponding data types, collecting the data of the same type, marking the data as collection type data, and expressing the data with a symbol Qij;
step six: setting all data types to correspond to a set value, matching the data types corresponding to the set type data with all the data types, obtaining the corresponding set value after the matching is successful, and marking the set value as X2Pij；
Step seven: using the formula WPij＝MQi×b1+X2PijXb 2 obtaining the stored value W for the Collection-type dataPij(ii) a Wherein, b1 and b2 are both preset proportionality coefficients;
the data processing module is used for transmitting the set processing data to the data transmission module; the data transmission module is used for transmitting the set processing data of the industrial equipment, and the specific transmission steps are as follows:
s1: when the storage value of the set processing data is larger than the set threshold value, the data transmission module transmits the set processing data to a first data storage server through an optical fiber for storage, and simultaneously marks the set processing data as optical fiber data;
s2: when the storage value of the set processing data is less than or equal to the set threshold value, the data transmission module distributes and transmits the set processing data and marks the set processing data as distribution data;
s3: the data transmission module sends the position of the industrial equipment corresponding to the distribution data to a mobile phone terminal of a transmission person, and the transmission person sends a real-time position to the data transmission module through the mobile phone terminal after arriving at the position of the industrial equipment corresponding to the distribution data;
s4: the data transmission module receives and verifies the real-time position sent by the transmission personnel, when the real-time position of the transmission personnel is the same as the position of the industrial equipment corresponding to the distribution data, the verification is successful, the data transmission module controls the industrial equipment corresponding to the distribution data to be in Bluetooth connection with the mobile phone terminal of the transmission personnel, and meanwhile, the industrial equipment transmits the distribution data to the mobile phone terminal of the transmission personnel through Bluetooth;
and the transmission personnel sends the distribution data to the second data storage server through the mobile phone terminal for storage, and the transmission times of the transmission personnel are increased once.
Further, the data processing module is used for processing the set type data to obtain set processing data; the data processing module comprises a data preprocessing unit, a data cleaning unit and a data aggregation unit; the data preprocessing unit is used for repairing defective data in the set type data and deleting useless data; the data cleaning unit is used for removing messy codes and repeated parts contained in the collected set type data, and controlling the length of the collected set type data to realize data standardization; the data aggregation unit is used for aggregating the cleaned set type data; the specific treatment process is as follows:
x1: classifying the data types according to the data suffixes to generate a data type database;
x2: the data preprocessing unit repairs defective data in the set type data, replaces original data suffixes with specific data suffixes in the data type database as suffixes of the defective data, and deletes useless data;
x3: the preprocessed set type data enter a data cleaning unit, and the data cleaning unit is used for removing messy codes and repeated parts contained in the collected set type data, controlling the length of the collected set type data and realizing data standardization;
x4: the data aggregation unit is used for aggregating the cleaned set type data; acquiring set processing data; the stored value of the set processing data is the stored value of the set type data.
Further, the step S2 of specifically assigning includes:
s21: acquiring workers working at the current time and marking the workers as primary selection workers;
s22: calculating the distance difference between the position of the initially selected person and the position of the industrial equipment corresponding to the set processing data to obtain a person distance, and marking the person distance as SD;
s23: calculating the time difference between the registration time of the wireless transmission personnel and the current time of the system to obtain the registration time length and marking the registration time length as SA;
s24: setting the age of the primary selected person as SF; setting the transmission times of the primary selection personnel as SG;
s25: acquiring transmission information of a primary selection person, wherein the model of a mobile phone terminal, the residual package flow of the mobile phone terminal, the uploading rate of the mobile phone terminal and the residual memory of the mobile phone terminal are transmitted; analyzing and calculating the transmission information of the primary selection personnel, and specifically comprising the following steps:
s251: setting all mobile phone terminal models to correspond to a preset terminal value, matching the mobile phone terminal model of the primary selection person with all mobile phone terminal models to obtain a corresponding preset terminal value, and marking the preset terminal value as Z1;
s252: acquiring the residual package flow of the mobile phone terminal of the primary election person and marking the residual package flow as Z2; acquiring the uploading rate of the mobile phone terminal of the primary selection personnel and marking the uploading rate as Z3; acquiring the residual memory of the mobile phone terminal of the primary election person and marking the residual memory as Z4;
s253: carrying out dequantization processing on a preset terminal value, the flow of the rest package, the uploading rate and the rest memory and taking the numerical values of the dequantization processing and the uploading rate and the rest memory;
s254: obtaining a terminal value ZS of the primary candidate by using a formula ZS of Z1 × c1+ Z2 × c2+ Z3 × c3+ Z4 × c 4;
s26: carrying out dequantization processing on the personnel interval, the registration time, the age, the transmission times and the terminal value and taking the numerical values;
s27: using formulas
Acquiring a transmission value WS of the primary election personnel; wherein beta is a correction coefficient and takes the value of 0.9535; d1, d2, d3, d4 and d5 are all preset proportionality coefficients;
s28: and selecting the primary selection personnel with the maximum transmission value WS as the transmission personnel.
Further, the system also comprises a registration login module; the registration login module is used for submitting registration information to register by staff of an enterprise corresponding to the industrial equipment through a mobile phone terminal and sending the successfully registered registration information to the first data storage server for storage; the first data storage server marks the moment when the registration information is received as the registration time of the employee; the registration information comprises a name, a mobile phone number, a model of a mobile phone terminal, a rated memory of the mobile phone and a residual memory of the mobile phone.
Further, the task allocation module is used for receiving the set processing data transmitted by the data transmission module and allocating the set processing data to be stored to the first data storage server, the second data storage server and the standby data storage server; the specific distribution steps are as follows:
SS 1: the first data storage server and the second data storage server send real-time data storage progress to the task allocation module, the first data storage server and the second data storage server continuously work for at least 48 hours, and the task allocation module records the data storage progress of the first data storage server and the second data storage server by taking 24 hours as a period and taking 1 hour as a recording frequency;
SS 2: the task allocation module records data storage schedules of a first data storage server and a second data storage server in at least two periods, and compares the storage schedules of the first data storage server and the second data storage server at the same recording time point in the two periods;
SS 3: if the first data storage server is higher than the storage progress of the second data storage server at the same recording time point in two periods, the second data storage server sends half of the received data to the standby data storage server at the data recording point in the next period, and if the second data storage server is higher than the storage progress of the first data storage server at the same recording time point in two periods, the first data storage server at the time recording point sends half of the received data to the standby data storage server at the next period.
Further, when the continuous working time of the first data storage server and the second data storage server is less than 48 hours, if the data storage progress of any one of the first data storage server and the second data storage server is lower than 30%, the server with the data storage progress lower than 30% sends half of the received data to the standby data storage server.
Further, the equipment information comprises the position, the model and the running state of the industrial equipment, the name and the yield of production accessories, the name and the mobile phone number of a person in charge of the industrial equipment; the operation state comprises the time and the times of acquiring the operation data of the equipment in a preset time period.
The invention has the beneficial effects that:
(1) the method comprises the steps of acquiring equipment information generated by industrial equipment through a data acquisition module and analyzing the equipment information; obtaining a stored value of the set type data by combining a correlation algorithm; the data processing module is used for processing the set type data to obtain set processing data; the stored value of the set processing data is the stored value of the set type data; the data processing module is used for repairing defective data in the set type data and deleting useless data; the method is used for removing messy codes and repeated parts contained in the collected set type data, and controlling the length of the collected set type data to realize data standardization; redundant data is greatly reduced;
(2) the data transmission module transmits the set processing data of the industrial equipment, when the storage value of the set processing data is larger than a set threshold value, the data transmission module transmits the set processing data to the first data storage server through the optical fiber for storage, and when the storage value of the set processing data is smaller than or equal to the set threshold value, the data transmission module distributes and transmits the set processing data; acquiring workers working at the current time and marking the workers as primary selection workers; calculating the distance difference between the position of the initially selected person and the position of the industrial equipment corresponding to the set processing data to obtain the distance between the persons; calculating the time difference between the registration time of the wireless transmission personnel and the current time of the system to obtain the registration duration; acquiring the age and the transmission times of the primary selection personnel; acquiring transmission information of the primary election personnel, and analyzing and calculating the transmission information of the primary election personnel to obtain a terminal value of the primary election personnel; carrying out dequantization processing on the personnel interval, the registration time, the age, the transmission times and the terminal value and taking the numerical values; obtaining the transmission value of the primary selection personnel by using a formula, and selecting the primary selection personnel with the maximum transmission value as the transmission personnel; the transmission personnel sends the distribution data to a second data storage server through the mobile phone terminal for storage; the collected processing data are distributed to the first data storage server and the second data storage server through the stored values to be stored separately, so that the storage pressure is relieved, the distributed data are transmitted wirelessly, and corresponding employees are selected to transmit the distributed data through mobile phone terminals; the storage efficiency is improved;
(3) the task allocation module is used for receiving the set processing data transmitted by the data transmission module and allocating the set processing data to be stored to the first data storage server, the second data storage server and the standby data storage server; according to the historical data storage states of the two data storage servers, auxiliary storage is carried out through the standby storage server, and the high efficiency of data storage is guaranteed; meanwhile, the invention can ensure that the data storage is not influenced by the standby data storage server within the time of obtaining the historical data storage state.
Drawings
In order to facilitate understanding for those skilled in the art, the present invention will be further described with reference to the accompanying drawings.
FIG. 1 is a block diagram of the system of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, the industrial equipment big data storage system based on monitoring of the internet of things comprises a data acquisition module, a data processing module, a data transmission module, a first data storage server, a second data storage server, a standby data storage server and a task allocation module;
the data acquisition module is used for acquiring and analyzing equipment information generated by the industrial equipment, wherein the equipment information comprises the position, the model number, the running state, the name and the yield of production accessories of the industrial equipment, and the name and the mobile phone number of a person in charge of the industrial equipment; the running state comprises the time and the times of collecting the running data of the equipment in a preset time period; the method comprises the following specific steps:
the method comprises the following steps: labeling the industrial device as Qi; setting all models of the industrial equipment to correspond to a preset value, matching the models in the equipment information with all models to obtain corresponding preset values, and marking the preset values as X1Qi；
Step two: marking the times of acquiring the operation data of the industrial equipment in the preset time period as CQiMarking the time when the industrial equipment operation data is collected as TQia;
step three, marking the current time of the system as A and utilizing a formula
Calculating to obtain a close value f (TQia) of each acquisition; wherein a1 and sigma are preset coefficient factors;
step four: using formulas
Calculating to obtain an operation priority value MQi of the industrial equipment; wherein a2, a3 and a4 are all coefficient factors;
step five: setting operation data generated by industrial equipment to comprise a plurality of data types, matching the acquired operation data of the industrial equipment with the plurality of data types by a data acquisition module to obtain corresponding data types, collecting the data of the same type, marking the data as collection type data, and expressing the data with a symbol Qij;
step six: setting all data types to correspond to a set value, matching the data types corresponding to the set type data with all the data types, obtaining the corresponding set value after the matching is successful, and marking the set value as X2Pij；
Step seven: using the formula WPij＝MQi×b1+X2PijXb 2 obtaining the stored value W for the Collection-type dataPij(ii) a Wherein, b1 and b2 are both preset proportionality coefficients;
the data processing module is used for processing the set type data to obtain set processing data; the data processing module comprises a data preprocessing unit, a data cleaning unit and a data aggregation unit; the data preprocessing unit is used for repairing defective data in the set type data and deleting useless data; the data cleaning unit is used for removing messy codes and repeated parts contained in the collected set type data, and controlling the length of the collected set type data to realize data standardization; the data aggregation unit is used for aggregating the cleaned set type data; the specific treatment process is as follows:
x1: classifying the data types according to the data suffixes to generate a data type database;
x2: the data preprocessing unit repairs defective data in the set type data, replaces original data suffixes with specific data suffixes in the data type database as suffixes of the defective data, and deletes useless data;
x3: the preprocessed set type data enter a data cleaning unit, and the data cleaning unit is used for removing messy codes and repeated parts contained in the collected set type data, controlling the length of the collected set type data and realizing data standardization;
x4: the data aggregation unit is used for aggregating the cleaned set type data; acquiring set processing data; the stored value of the set processing data is the stored value of the set type data;
the data processing module is used for transmitting the set processing data to the data transmission module; the data transmission module is used for transmitting the set processing data of the industrial equipment, and the specific transmission steps are as follows:
s1: when the storage value of the set processing data is larger than the set threshold value, the data transmission module transmits the set processing data to a first data storage server through an optical fiber for storage, and simultaneously marks the set processing data as optical fiber data;
s2: when the storage value of the set processing data is less than or equal to the set threshold value, the data transmission module distributes and transmits the set processing data and marks the set processing data as distribution data; the specific distribution steps are as follows:
s21: acquiring workers working at the current time and marking the workers as primary selection workers;
s22: calculating the distance difference between the position of the initially selected person and the position of the industrial equipment corresponding to the set processing data to obtain a person distance, and marking the person distance as SD;
s23: calculating the time difference between the registration time of the wireless transmission personnel and the current time of the system to obtain the registration time length and marking the registration time length as SA;
s24: setting the age of the primary selected person as SF; setting the transmission times of the primary selection personnel as SG;
s25: acquiring transmission information of a primary selection person, wherein the model of a mobile phone terminal, the residual package flow of the mobile phone terminal, the uploading rate of the mobile phone terminal and the residual memory of the mobile phone terminal are transmitted; analyzing and calculating the transmission information of the primary selection personnel, and specifically comprising the following steps:
s251: setting all mobile phone terminal models to correspond to a preset terminal value, matching the mobile phone terminal model of the primary selection person with all mobile phone terminal models to obtain a corresponding preset terminal value, and marking the preset terminal value as Z1;
s252: acquiring the residual package flow of the mobile phone terminal of the primary election person and marking the residual package flow as Z2; acquiring the uploading rate of the mobile phone terminal of the primary selection personnel and marking the uploading rate as Z3; acquiring the residual memory of the mobile phone terminal of the primary election person and marking the residual memory as Z4;
s253: carrying out dequantization processing on a preset terminal value, the flow of the rest package, the uploading rate and the rest memory and taking the numerical values of the dequantization processing and the uploading rate and the rest memory;
s254: obtaining a terminal value ZS of the primary candidate by using a formula ZS of Z1 × c1+ Z2 × c2+ Z3 × c3+ Z4 × c 4;
s26: carrying out dequantization processing on the personnel interval, the registration time, the age, the transmission times and the terminal value and taking the numerical values;
s27: using formulas
s28: selecting the primary selection personnel with the maximum transmission value WS as transmission personnel;
s3: the data transmission module sends the position of the industrial equipment corresponding to the distribution data to a mobile phone terminal of a transmission person, and the transmission person sends a real-time position to the data transmission module through the mobile phone terminal after arriving at the position of the industrial equipment corresponding to the distribution data;
s4: the data transmission module receives and verifies the real-time position sent by the transmission personnel, when the real-time position of the transmission personnel is the same as the position of the industrial equipment corresponding to the distribution data, the verification is successful, the data transmission module controls the industrial equipment corresponding to the distribution data to be in Bluetooth connection with the mobile phone terminal of the transmission personnel, and meanwhile, the industrial equipment transmits the distribution data to the mobile phone terminal of the transmission personnel through Bluetooth;
the transmission personnel sends the distribution data to a second data storage server through the mobile phone terminal for storage, and the transmission times of the transmission personnel are increased once;
the system also comprises a registration login module; the registration login module is used for submitting registration information to register by staff of an enterprise corresponding to the industrial equipment through a mobile phone terminal and sending the successfully registered registration information to the first data storage server for storage; the first data storage server marks the moment when the registration information is received as the registration time of the employee; the registration information comprises a name, a mobile phone number, a model of a mobile phone terminal, a rated memory of the mobile phone and a residual memory of the mobile phone;
the task allocation module is used for receiving the set processing data transmitted by the data transmission module and allocating the set processing data to be stored to the first data storage server, the second data storage server and the standby data storage server; the specific distribution steps are as follows:
SS 1: the first data storage server and the second data storage server send real-time data storage progress to the task allocation module, the first data storage server and the second data storage server continuously work for at least 48 hours, and the task allocation module records the data storage progress of the first data storage server and the second data storage server by taking 24 hours as a period and taking 1 hour as a recording frequency;
SS 2: the task allocation module records data storage schedules of a first data storage server and a second data storage server in at least two periods, and compares the storage schedules of the first data storage server and the second data storage server at the same recording time point in the two periods;
SS 3: if the first data storage server is higher than the storage progress of the second data storage server at the same recording time point in two periods, the second data storage server sends half of the received data to the standby data storage server at the data recording point in the next period, and if the second data storage server is higher than the storage progress of the first data storage server at the same recording time point in two periods, the first data storage server at the time recording point sends half of the received data to the standby data storage server at the next period;
when the continuous working time of the first data storage server and the second data storage server is less than 48 hours, if the data storage progress of any one of the first data storage server and the second data storage server is lower than 30%, the server with the data storage progress lower than 30% sends half of the received data to the standby data storage server; according to the historical data storage states of the two data storage servers, auxiliary storage is carried out through the standby storage server, and the high efficiency of data storage is guaranteed; meanwhile, the invention can ensure that the data storage is not influenced by the standby data storage server within the time of obtaining the historical data storage state.
When the industrial equipment big data storage system based on monitoring of the Internet of things works, firstly, a data acquisition module acquires and analyzes equipment information generated by industrial equipment; obtaining a stored value of the set type data by combining a correlation algorithm; the data processing module is used for processing the set type data to obtain set processing data; the stored value of the set processing data is the stored value of the set type data; the data processing module comprises a data preprocessing unit, a data cleaning unit and a data aggregation unit; the data preprocessing unit is used for repairing defective data and deleting useless data; the data cleaning unit is used for removing messy codes and repeated parts contained in the acquired data and controlling the length of the acquired data to realize data standardization, and the data aggregation unit is used for aggregating the cleaned data; the data is subjected to preliminary processing, so that redundant data is greatly reduced;
the data processing module transmits the set processing data to the data transmission module; the data transmission module transmits the set processing data of the industrial equipment, when the storage value of the set processing data is larger than a set threshold value, the data transmission module transmits the set processing data to the first data storage server through the optical fiber for storage, and when the storage value of the set processing data is smaller than or equal to the set threshold value, the data transmission module distributes and transmits the set processing data: acquiring workers working at the current time and marking the workers as primary selection workers; calculating the distance difference between the position of the initially selected person and the position of the industrial equipment corresponding to the set processing data to obtain the distance between the persons; calculating the time difference between the registration time of the wireless transmission personnel and the current time of the system to obtain the registration duration; acquiring the age and the transmission times of the primary selection personnel; acquiring transmission information of the primary election personnel, and analyzing and calculating the transmission information of the primary election personnel to obtain a terminal value of the primary election personnel; carrying out dequantization processing on the personnel interval, the registration time, the age, the transmission times and the terminal value and taking the numerical values; obtaining the transmission value of the primary selection personnel by using a formula, and selecting the primary selection personnel with the maximum transmission value as the transmission personnel; the transmission personnel sends the distribution data to a second data storage server through the mobile phone terminal for storage; the collected processing data are distributed to the first data storage server and the second data storage server through the stored values to be stored separately, so that the storage pressure is relieved, the distributed data are transmitted wirelessly, and corresponding employees are selected to transmit the distributed data through mobile phone terminals; the storage efficiency is improved;
the task allocation module is used for receiving the set processing data transmitted by the data transmission module and allocating the set processing data to be stored to the first data storage server, the second data storage server and the standby data storage server; if the first data storage server is higher than the storage progress of the second data storage server at the same recording time point in two periods, the second data storage server of the data recording point sends half of the received data to the standby data storage server in the next period, and if the second data storage server is higher than the storage progress of the first data storage server at the same recording time point in two periods, the first data storage server of the time recording point sends half of the received data to the standby data storage server in the next period; according to the historical data storage states of the two data storage servers, auxiliary storage is carried out through the standby storage server, and the high efficiency of data storage is guaranteed; meanwhile, the invention can ensure that the data storage is not influenced by the standby data storage server within the time of obtaining the historical data storage state.
The above formulas are all obtained by collecting a large amount of data to perform software simulation and performing parameter setting and storage by corresponding experts, and the formulas are in accordance with real results.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (7)
1. The industrial equipment big data storage system based on monitoring of the Internet of things is characterized by comprising a data acquisition module, a data processing module, a data transmission module, a first data storage server, a second data storage server, a standby data storage server and a task allocation module;
the data acquisition module is used for acquiring and analyzing equipment information generated by industrial equipment; the method comprises the following specific steps:
the method comprises the following steps: labeling the industrial device as Qi; setting all models of industrial equipment to correspond to a preset value, and comparing the models in the equipment information with the preset valueMatching with models to obtain corresponding preset values and marking the preset values as X1Qi；
Step two: marking the times of acquiring the operation data of the industrial equipment in the preset time period as CQiMarking the time when the industrial equipment operation data is collected as TQia;
step three, marking the current time of the system as A and utilizing a formula
Calculating to obtain a close value f (TQia) of each acquisition; wherein a1 and sigma are preset coefficient factors;
step four: using formulas
Calculating to obtain an operation priority value MQi of the industrial equipment; wherein a2, a3 and a4 are all coefficient factors;
step five: setting operation data generated by industrial equipment to comprise a plurality of data types, matching the acquired operation data of the industrial equipment with the plurality of data types by a data acquisition module to obtain corresponding data types, collecting the data of the same type, marking the data as collection type data, and expressing the data with a symbol Qij;
step six: setting all data types to correspond to a set value, matching the data types corresponding to the set type data with all the data types, obtaining the corresponding set value after the matching is successful, and marking the set value as X2Pij；
Step seven: using the formula WPij＝MQi×b1+X2PijXb 2 obtaining the stored value W for the Collection-type dataPij(ii) a Wherein, b1 and b2 are both preset proportionality coefficients;
the data processing module is used for transmitting the set processing data to the data transmission module; the data transmission module is used for transmitting the set processing data of the industrial equipment, and the specific transmission steps are as follows:
s1: when the storage value of the set processing data is larger than the set threshold value, the data transmission module transmits the set processing data to a first data storage server through an optical fiber for storage, and simultaneously marks the set processing data as optical fiber data;
s2: when the storage value of the set processing data is less than or equal to the set threshold value, the data transmission module distributes and transmits the set processing data and marks the set processing data as distribution data;
s3: the data transmission module sends the position of the industrial equipment corresponding to the distribution data to a mobile phone terminal of a transmission person, and the transmission person sends a real-time position to the data transmission module through the mobile phone terminal after arriving at the position of the industrial equipment corresponding to the distribution data;
s4: the data transmission module receives and verifies the real-time position sent by the transmission personnel, when the real-time position of the transmission personnel is the same as the position of the industrial equipment corresponding to the distribution data, the verification is successful, the data transmission module controls the industrial equipment corresponding to the distribution data to be in Bluetooth connection with the mobile phone terminal of the transmission personnel, and meanwhile, the industrial equipment transmits the distribution data to the mobile phone terminal of the transmission personnel through Bluetooth;
and the transmission personnel sends the distribution data to the second data storage server through the mobile phone terminal for storage, and the transmission times of the transmission personnel are increased once.
2. The industrial equipment big data storage system based on monitoring of the internet of things according to claim 1, wherein the data processing module is used for processing the set type data to obtain set processing data; the data processing module comprises a data preprocessing unit, a data cleaning unit and a data aggregation unit; the data preprocessing unit is used for repairing defective data in the set type data and deleting useless data; the data cleaning unit is used for removing messy codes and repeated parts contained in the collected set type data, and controlling the length of the collected set type data to realize data standardization; the data aggregation unit is used for aggregating the cleaned set type data; the specific treatment process is as follows:
x1: classifying the data types according to the data suffixes to generate a data type database;
x2: the data preprocessing unit repairs defective data in the set type data, replaces original data suffixes with specific data suffixes in the data type database as suffixes of the defective data, and deletes useless data;
x3: the preprocessed set type data enter a data cleaning unit, and the data cleaning unit is used for removing messy codes and repeated parts contained in the collected set type data, controlling the length of the collected set type data and realizing data standardization;
x4: the data aggregation unit is used for aggregating the cleaned set type data; acquiring set processing data; the stored value of the set processing data is the stored value of the set type data.
3. The Internet of things monitoring-based industrial equipment big data storage system according to claim 1, wherein the specific allocation step in the step S2 includes:
s21: acquiring workers working at the current time and marking the workers as primary selection workers;
s22: calculating the distance difference between the position of the initially selected person and the position of the industrial equipment corresponding to the set processing data to obtain a person distance, and marking the person distance as SD;
s23: calculating the time difference between the registration time of the wireless transmission personnel and the current time of the system to obtain the registration time length and marking the registration time length as SA;
s24: setting the age of the primary selected person as SF; setting the transmission times of the primary selection personnel as SG;
s25: acquiring transmission information of a primary selection person, wherein the model of a mobile phone terminal, the residual package flow of the mobile phone terminal, the uploading rate of the mobile phone terminal and the residual memory of the mobile phone terminal are transmitted; analyzing and calculating the transmission information of the primary selection personnel, and specifically comprising the following steps:
s251: setting all mobile phone terminal models to correspond to a preset terminal value, matching the mobile phone terminal model of the primary selection person with all mobile phone terminal models to obtain a corresponding preset terminal value, and marking the preset terminal value as Z1;
s252: acquiring the residual package flow of the mobile phone terminal of the primary election person and marking the residual package flow as Z2; acquiring the uploading rate of the mobile phone terminal of the primary selection personnel and marking the uploading rate as Z3; acquiring the residual memory of the mobile phone terminal of the primary election person and marking the residual memory as Z4;
s253: carrying out dequantization processing on a preset terminal value, the flow of the rest package, the uploading rate and the rest memory and taking the numerical values of the dequantization processing and the uploading rate and the rest memory;
s254: obtaining a terminal value ZS of the primary candidate by using a formula ZS of Z1 × c1+ Z2 × c2+ Z3 × c3+ Z4 × c 4;
s26: carrying out dequantization processing on the personnel interval, the registration time, the age, the transmission times and the terminal value and taking the numerical values;
s27: using formulas
Acquiring a transmission value WS of the primary election personnel; wherein beta is a correction coefficient and takes the value of 0.9535; d1, d2, d3, d4 and d5 are all preset proportionality coefficients;
s28: and selecting the primary selection personnel with the maximum transmission value WS as the transmission personnel.
4. The industrial equipment big data storage system based on monitoring of the internet of things according to claim 1, further comprising a registration login module; the registration login module is used for submitting registration information to register by staff of an enterprise corresponding to the industrial equipment through a mobile phone terminal and sending the successfully registered registration information to the first data storage server for storage; the first data storage server marks the moment when the registration information is received as the registration time of the employee; the registration information comprises a name, a mobile phone number, a model of a mobile phone terminal, a rated memory of the mobile phone and a residual memory of the mobile phone.
5. The industrial equipment big data storage system based on monitoring of the internet of things according to claim 1, wherein the task allocation module is used for receiving the set processing data transmitted by the data transmission module and allocating the set processing data to be stored to the first data storage server, the second data storage server and the standby data storage server; the specific distribution steps are as follows:
SS 1: the first data storage server and the second data storage server send real-time data storage progress to the task allocation module, the first data storage server and the second data storage server continuously work for at least 48 hours, and the task allocation module records the data storage progress of the first data storage server and the second data storage server by taking 24 hours as a period and taking 1 hour as a recording frequency;
SS 2: the task allocation module records data storage schedules of a first data storage server and a second data storage server in at least two periods, and compares the storage schedules of the first data storage server and the second data storage server at the same recording time point in the two periods;
SS 3: if the first data storage server is higher than the storage progress of the second data storage server at the same recording time point in two periods, the second data storage server sends half of the received data to the standby data storage server at the data recording point in the next period, and if the second data storage server is higher than the storage progress of the first data storage server at the same recording time point in two periods, the first data storage server at the time recording point sends half of the received data to the standby data storage server at the next period.
6. The industrial equipment big data storage system based on monitoring of the internet of things as claimed in claim 1, wherein when the continuous working time of the first data storage server and the second data storage server is less than 48 hours, if the data storage progress of any one of the first data storage server and the second data storage server is lower than 30%, the server with the data storage progress lower than 30% sends half of the received data to the standby data storage server.
7. The industrial equipment big data storage system based on monitoring of the internet of things as claimed in claim 1, wherein the equipment information comprises the position, model and running state of the industrial equipment, the name and yield of production accessories, the name and mobile phone number of a person in charge of the industrial equipment; the operation state comprises the time and the times of acquiring the operation data of the equipment in a preset time period.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010789942.8A CN111930733A (en) | 2020-08-07 | 2020-08-07 | Industrial equipment big data storage system based on monitoring of Internet of things |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010789942.8A CN111930733A (en) | 2020-08-07 | 2020-08-07 | Industrial equipment big data storage system based on monitoring of Internet of things |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111930733A true CN111930733A (en) | 2020-11-13 |
Family
ID=73307225
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010789942.8A Withdrawn CN111930733A (en) | 2020-08-07 | 2020-08-07 | Industrial equipment big data storage system based on monitoring of Internet of things |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111930733A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113098898A (en) * | 2021-04-29 | 2021-07-09 | 王小平 | Service data monitoring and early warning platform and early warning method |
| CN114050645A (en) * | 2021-10-22 | 2022-02-15 | 山东佳安保全安防科技有限公司 | Power consumption safety monitoring device of wisdom networking |
| CN114968715A (en) * | 2022-05-23 | 2022-08-30 | 重庆伏特猫科技有限公司 | Comprehensive energy management system based on Internet |
| CN115395661A (en) * | 2022-09-28 | 2022-11-25 | 国家电投集团广西电力有限公司运营服务分公司 | New energy remote centralized control center communication system constructed based on power private network |
| CN117061549A (en) * | 2023-08-04 | 2023-11-14 | 江苏城乡建设职业学院 | Intelligent security system based on cloud platform |
-
2020
- 2020-08-07 CN CN202010789942.8A patent/CN111930733A/en not_active Withdrawn
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113098898A (en) * | 2021-04-29 | 2021-07-09 | 王小平 | Service data monitoring and early warning platform and early warning method |
| CN114050645A (en) * | 2021-10-22 | 2022-02-15 | 山东佳安保全安防科技有限公司 | Power consumption safety monitoring device of wisdom networking |
| CN114968715A (en) * | 2022-05-23 | 2022-08-30 | 重庆伏特猫科技有限公司 | Comprehensive energy management system based on Internet |
| CN115395661A (en) * | 2022-09-28 | 2022-11-25 | 国家电投集团广西电力有限公司运营服务分公司 | New energy remote centralized control center communication system constructed based on power private network |
| CN117061549A (en) * | 2023-08-04 | 2023-11-14 | 江苏城乡建设职业学院 | Intelligent security system based on cloud platform |
| CN117061549B (en) * | 2023-08-04 | 2024-07-19 | 江苏城乡建设职业学院 | Intelligent security system based on cloud platform and operation method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111930733A (en) | Industrial equipment big data storage system based on monitoring of Internet of things | |
| CN111047082B (en) | Early warning method and device of equipment, storage medium and electronic device | |
| CN110728443A (en) | Motor full life cycle management and control system | |
| CN110769032B (en) | System and method for rapidly detecting and maintaining power grid equipment fault | |
| CN112925673B (en) | Big data storage management method and system for power monitoring | |
| CN111311133B (en) | Monitoring system applied to power grid production equipment | |
| CN110309967A (en) | Prediction technique, system, equipment and the storage medium of customer service session grading system | |
| CN114971356A (en) | Electric power engineering project progress prediction system and method | |
| CN110809260A (en) | Local data processing method of electricity consumption information acquisition system | |
| CN114819213A (en) | Intelligent operation and maintenance management method and system for electric automobile public charging facility | |
| CN111949795A (en) | Work order automatic classification method and device | |
| CN115603464B (en) | Intelligent generation management system for power grid operation ticket based on digital twin | |
| CN113111115A (en) | Data information management system and method thereof | |
| CN112734447A (en) | Grain cloud after-market service cloud platform and method thereof | |
| CN106447242A (en) | Power consumption service acceptance time limit management method and device | |
| CN117094688B (en) | Digital control method and system for power supply station | |
| CN115689320A (en) | Health management method and device for base station operation and computer readable storage medium | |
| CN116128413B (en) | Intelligent warehouse material statistics system based on Bluetooth communication | |
| CN111194014A (en) | Equipment fault real-time repair reporting system and method thereof | |
| CN117273375B (en) | Distribution network fault handling decision supervision and lifting system based on knowledge graph | |
| CN202424777U (en) | Water conservancy supervising device | |
| CN113065733B (en) | Electrical asset management method based on artificial intelligence | |
| CN207588561U (en) | Secondary equipment of intelligent converting station with defect processing module | |
| CN116866148A (en) | Internet of things equipment state identification method and system | |
| CN117097727A (en) | Edge computing system based on industrial Internet of things platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20201113 |