CN115374212A - Computing method based on artificial intelligence data processing - Google Patents
Computing method based on artificial intelligence data processing Download PDFInfo
- Publication number
- CN115374212A CN115374212A CN202211071161.0A CN202211071161A CN115374212A CN 115374212 A CN115374212 A CN 115374212A CN 202211071161 A CN202211071161 A CN 202211071161A CN 115374212 A CN115374212 A CN 115374212A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- central processing
- processing system
- wireless
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a computing method based on artificial intelligence data processing, which specifically comprises the following steps: the data acquisition module is used for acquiring and mining required source data, the acquired data are uploaded to the central processing system, and the central processing system transmits the data to the data preprocessing unit; s2, the data receiving module receives the acquired data in real time, and the invention relates to the technical field of data processing. According to the computing method based on artificial intelligence data processing, in the data processing process, collected data are stored through the storage module after being preprocessed and classified and integrated, so that repeated or invalid data are deleted, the requirement on a storage medium is lowered, the storage module is used for storing model computing result data, collected source data and computing result data are separately stored, a high-performance, low-delay and high-throughput storage system is formed, and the utilization rate of resources is improved.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a computing method based on artificial intelligence data processing.
Background
Artificial intelligence is a branch of computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a manner similar to human intelligence, a field of research that includes robotics, language recognition, image recognition, natural language processing, and expert systems, among others.
Data processing is a basic link of system engineering and automatic control, the development of data processing technology and the breadth and depth of application thereof run through various fields of social production and social life, the development of human society is greatly influenced, data is an expression form of facts, concepts or instructions, can be processed by manual or automatic devices, becomes information after being interpreted and endowed with certain meanings, the data processing is collection, storage, retrieval, processing, transformation and transmission of the data, and the basic purpose of the data processing is to extract and deduce valuable and meaningful data for certain specific people from a large amount of data which can be disordered and difficult to understand.
In the process of carrying out data processing by artificial intelligence at present, the data processing amount is large, the storage space is limited, and when the data are calculated and analyzed, the acquired source data are directly analyzed, so that the data processing calculation amount is large, the processing efficiency is low, and the calculation result is easy to deviate.
Disclosure of Invention
Technical problem to be solved
Aiming at the defects of the prior art, the invention provides a computing method based on artificial intelligence data processing, which solves the problems that the storage space is limited, and the acquired source data are directly analyzed when the data are computed and analyzed, so that the data processing has larger calculated amount, the processing efficiency is lower, and the computing result is easy to generate deviation.
(II) technical scheme
In order to achieve the purpose, the invention is realized by the following technical scheme: a computing method based on artificial intelligence data processing specifically comprises the following steps:
the data acquisition module is used for acquiring and mining required source data, the acquired data are uploaded to the central processing system, and the central processing system transmits the data to the data preprocessing unit;
s2, the data receiving module receives acquired data in real time, the data cleaning module deletes incomplete data, wrong data and repeated data, the data conversion module is used for reducing the number of effective variables of the data and normalizing the data, the data integration module organically concentrates the data with different sources, formats and characteristic properties logically or physically, and the preprocessed data are uploaded to the data analysis unit;
s3, the classification module is used for classifying and sorting the preprocessed data, the statistical module is used for counting the preprocessed data, the characteristic analysis module is used for analyzing according to data characteristics and summarizing the data into the same type of data, the analyzed data are uploaded to the central processing system, the central processing system uploads the preprocessed and classified data to the storage module, and the storage module is used for storing the acquired source data;
s4, when data are operated, the data selection module collects corresponding data from the data analysis unit, the selected data are displayed through the data display module, then the algorithm editing module edits a processing algorithm corresponding to the selected data according to the drawn logic diagram, the model generation module generates the edited algorithm, and after the algorithm is generated, the calculation analysis module calculates the data according to the algorithm to obtain a required result and uploads the calculation result data to the central processing system;
s5, the central processing system transmits the calculation result data to a database, the calculation result data are stored through a storage module, a backup module backs up the data in the storage module and uploads the data to a cloud server for storage, an encryption module conducts encryption protection on the cloud server and the storage module, and a deletion module deletes the data in the storage module after being uploaded to the cloud server;
and S6, the data retrieval module is used for retrieving the data after inputting the data characteristics, and the output module is used for displaying the retrieved data.
Preferably, in step S1, the data acquisition module acquires data through a website, an APP, a third-party platform, a service log and other channels.
The invention also discloses a system for the artificial intelligence-based data processing and calculating method, which comprises a central processing system, wherein the central processing system is in bidirectional connection with a data acquisition module through a wireless interface, the central processing system is in bidirectional connection with a data preprocessing unit through a wireless interface, the data preprocessing unit is in bidirectional connection with a data analysis unit through a wireless interface, the data analysis unit is in bidirectional connection with the central processing system through a wireless interface, the central processing system is in bidirectional connection with a storage module through a wireless interface, the central processing system is in bidirectional connection with a modeling unit through a wireless interface, the central processing system is in bidirectional connection with a database through a wireless interface, the central processing system is in bidirectional connection with a data retrieval module through a wireless interface, and the data retrieval module is in bidirectional connection with an output module through a wireless interface.
Preferably, the data preprocessing unit comprises a data receiving module, a data cleaning module, a data transformation module and a data integration module, and the data analysis unit comprises a classification module, a statistic module and a feature analysis module.
Preferably, the modeling unit comprises a data selection module, an output end of the data selection module is electrically connected with an input end of the data display module, and an output end of the data display module is electrically connected with an input end of the algorithm editing module.
Preferably, the output end of the algorithm editing module is electrically connected with the input end of the model generating module, and the output end of the model generating module is electrically connected with the input end of the calculation analyzing module.
Preferably, the database comprises a storage module, the output end of the storage module is electrically connected with the input end of the backup module, the output end of the backup module is electrically connected with the input end of the cloud server, and the cloud server is in bidirectional connection with the encryption module through wireless.
Preferably, the encryption module is in bidirectional connection with the storage module through wireless, and the storage module is in bidirectional connection with the deletion module through wireless.
(III) advantageous effects
The invention provides a computing method based on artificial intelligence data processing. The method has the following beneficial effects:
(1) According to the computing method based on artificial intelligence data processing, in the data processing process, collected data are stored through the storage module after being preprocessed and classified and integrated, repeated or invalid data are deleted, the requirement on a storage medium is lowered, the storage module is used for storing model computing result data, collected source data and the computing result data are stored separately, a high-performance, low-delay and high-throughput storage system is formed, and the utilization rate of resources is improved.
(2) According to the calculation method based on artificial intelligence data processing, data are cleaned, transformed and integrated through the data preprocessing unit, meanwhile, the data analysis unit is classified and integrated according to the preprocessed data and analyzed according to data characteristics, and the data are summarized into the same type of data, so that the follow-up selection of modeling operation data is more convenient, the data processing efficiency is improved, the data are accurate and easy to obtain, and time and labor are saved.
(3) According to the calculation method based on artificial intelligence data processing, the central processing system is in bidirectional connection with the database in a wireless mode, the storage module can upload model calculation result data to the cloud server through the backup module, the data uploaded to the cloud server are deleted through the deletion module, storage space is enlarged, follow-up retrieval and retrieval of the data are facilitated, and sharing of the calculation result data can be achieved.
Drawings
FIG. 1 is a schematic block diagram of the architecture of the system of the present invention;
FIG. 2 is a schematic block diagram of the structure of a data preprocessing unit according to the present invention;
FIG. 3 is a schematic block diagram of the structure of a data analysis unit according to the present invention;
FIG. 4 is a schematic block diagram of the structure of a modeling unit of the present invention;
FIG. 5 is a schematic block diagram of the structure of the database of the present invention.
In the figure: the system comprises a central processing system 1, a data acquisition module 2, a data preprocessing unit 3, a data receiving module 31, a data cleaning module 32, a data transformation module 33, a data integration module 34, a data analysis unit 4, a classification module 41, a statistical module 42, a characteristic analysis module 43, a storage module 5, a modeling unit 6, a data selection module 61, a data display module 62, an algorithm editing module 63, a model generation module 64, a calculation analysis module 65, a database 7, a storage module 71, a backup module 72, a cloud server 73, an encryption module 74, a deletion module 75, a data retrieval module 8 and an output module 9.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-5, an embodiment of the present invention provides a technical solution: a computing method based on artificial intelligence data processing specifically comprises the following steps:
the data acquisition module 2 is used for acquiring and mining required source data, the acquired data are uploaded to the central processing system 1, and the central processing system 1 transmits the data to the data preprocessing unit 3;
s2, the data receiving module 31 receives acquired data in real time, the data cleaning module 32 deletes incomplete data, error data and repeated data, the data transformation module 33 is used for reducing the number of effective variables of the data and normalizing the data, the data integration module 34 organically concentrates the data with different sources, formats and characteristic properties logically or physically, and the preprocessed data are uploaded to the data analysis unit 4;
s3, the classification module 41 is used for classifying and sorting the preprocessed data, the statistics module 42 is used for carrying out statistics on the preprocessed data, the characteristic analysis module 43 is used for analyzing according to data characteristics and summarizing the data into the same type of data, so that the subsequent modeling operation data can be more conveniently selected, the data processing efficiency is improved, the data is accurate and easy to obtain, the analyzed data are uploaded to the central processing system 1, the central processing system 1 uploads the preprocessed and classified data to the storage module 5, and the storage module 5 is used for storing the acquired source data;
s4, when data are operated, the data selecting module 61 collects corresponding data from the data analyzing unit 4, the selected data are displayed through the data display module 62, then the algorithm editing module 63 edits a processing algorithm corresponding to the selected data according to the drawn logic diagram, the model generating module 64 generates the edited algorithm, and after the algorithm is generated, the calculation analyzing module 65 calculates the data according to the algorithm to obtain a required result and uploads the calculation result data to the central processing system 1;
s5, the central processing system 1 transmits the calculation result data to the database 7, the calculation result data are stored through the storage module 71, the backup module 72 backs up the data in the storage module 71 and uploads the data to the cloud server 73 for storage, the storage space is enlarged, the encryption module 74 conducts encryption protection on the cloud server 73 and the storage module 71, and the deletion module 75 deletes the data in the storage module 71 after being uploaded to the cloud server 73;
and S6, the data retrieval module 8 is used for retrieving the data after inputting the data characteristics, and the output module 9 is used for displaying the retrieved data.
In the embodiment of the invention, in the step S1, the data acquisition module 2 acquires data through channels such as a self-owned website, an APP, a third-party platform, a service log and the like.
The invention also discloses a system for the artificial intelligence-based data processing and calculating method, which comprises a central processing system 1, wherein the central processing system 1 is in bidirectional connection with a data acquisition module 2 through wireless, the central processing system 1 is in bidirectional connection with a data preprocessing unit 3 through wireless, the data preprocessing unit 3 is in bidirectional connection with a data analysis unit 4 through wireless, the data analysis unit 4 is in bidirectional connection with the central processing system 1 through wireless, the central processing system 1 is in bidirectional connection with a storage module 5 through wireless, the central processing system 1 is in bidirectional connection with a modeling unit 6 through wireless, the central processing system 1 is in bidirectional connection with a database 7 through wireless, the central processing system 1 is in bidirectional connection with a data retrieval module 8 through wireless, and the data retrieval module 8 is in bidirectional connection with an output module 9 through wireless.
In the embodiment of the present invention, the data preprocessing unit 3 includes a data receiving module 31, a data cleaning module 32, a data transforming module 33 and a data integrating module 34, and the data analyzing unit 4 includes a classifying module 41, a counting module 42 and a feature analyzing module 43.
In the embodiment of the present invention, the modeling unit 6 includes a data selecting module 61, an output end of the data selecting module 61 is electrically connected to an input end of a data displaying module 62, and an output end of the data displaying module 62 is electrically connected to an input end of an algorithm editing module 63.
In the embodiment of the present invention, the output end of the algorithm editing module 63 is electrically connected to the input end of the model generating module 64, and the output end of the model generating module 64 is electrically connected to the input end of the calculation analyzing module 65.
In the embodiment of the present invention, the database 7 includes a storage module 71, an output end of the storage module 71 is electrically connected to an input end of a backup module 72, an output end of the backup module 72 is electrically connected to an input end of a cloud server 73, and the cloud server 73 is bidirectionally connected to the encryption module 74 through wireless.
In the embodiment of the present invention, the encryption module 74 is in bidirectional connection with the storage module 71 through wireless, and the storage module 71 is in bidirectional connection with the deletion module 75 through wireless.
And those not described in detail in this specification are well within the skill of those in the art.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (8)
1. A computing method based on artificial intelligence data processing is characterized in that: the method specifically comprises the following steps:
the data acquisition module is used for acquiring and mining required source data, the acquired data are uploaded to the central processing system, and the central processing system transmits the data to the data preprocessing unit;
s2, the data receiving module receives the acquired data in real time, the data cleaning module deletes incomplete data, wrong data and repeated data, the data transformation module is used for reducing the number of effective variables of the data and normalizing the data, the data integration module organically concentrates the data with different sources, formats and characteristic properties logically or physically, and the preprocessed data are uploaded to the data analysis unit;
s3, the classification module is used for classifying and sorting the preprocessed data, the statistical module is used for counting the preprocessed data, the characteristic analysis module analyzes the data according to data characteristics and summarizes the data into the same type of data, the analyzed data are uploaded to the central processing system, the central processing system uploads the preprocessed and classified data to the storage module, and the storage module is used for storing the acquired source data;
s4, when data are operated, the data selection module collects corresponding data from the data analysis unit, the selected data are displayed through the data display module, then the algorithm editing module edits a processing algorithm corresponding to the selected data according to the drawn logic diagram, the model generation module generates the edited algorithm, and after the algorithm is generated, the calculation analysis module calculates the data according to the algorithm to obtain a required result and uploads the calculation result data to the central processing system;
s5, the central processing system transmits the calculation result data to a database, the calculation result data are stored through a storage module, a backup module backs up the data in the storage module and uploads the data to a cloud server for storage, an encryption module conducts encryption protection on the cloud server and the storage module, and a deletion module deletes the data in the storage module after being uploaded to the cloud server;
and S6, the data retrieval module is used for retrieving the data after inputting the data characteristics, and the output module is used for displaying the retrieved data.
2. The computing method based on artificial intelligence data processing, according to claim 1, wherein: and the data acquisition module in the step S1 acquires data through channels such as a self-owned website, an APP, a third-party platform, a service log and the like.
3. A system for artificial intelligence based data processing computing method according to any of claims 1-2, comprising a central processing system, characterized in that: the central processing system realizes bidirectional connection with the data acquisition module through wireless, the central processing system realizes bidirectional connection with the data preprocessing unit through wireless, the data preprocessing unit realizes bidirectional connection with the data analysis unit through wireless, the data analysis unit realizes bidirectional connection with the central processing system through wireless, the central processing system realizes bidirectional connection with the storage module through wireless, the central processing system realizes bidirectional connection with the modeling unit through wireless, the central processing system realizes bidirectional connection with the database through wireless, the central processing system realizes bidirectional connection with the data retrieval module through wireless, the data retrieval module realizes bidirectional connection with the output module through wireless.
4. The system according to claim 3, wherein said computing system is further configured to: the data preprocessing unit comprises a data receiving module, a data cleaning module, a data transformation module and a data integration module, and the data analysis unit comprises a classification module, a statistical module and a characteristic analysis module.
5. The system for artificial intelligence based data processing computing method of claim 3, wherein: the modeling unit comprises a data selection module, the output end of the data selection module is electrically connected with the input end of the data display module, and the output end of the data display module is electrically connected with the input end of the algorithm editing module.
6. The system according to claim 5, wherein said computing system is further configured to: the output end of the algorithm editing module is electrically connected with the input end of the model generating module, and the output end of the model generating module is electrically connected with the input end of the calculation and analysis module.
7. The system according to claim 3, wherein said computing system is further configured to: the database comprises a storage module, the output end of the storage module is electrically connected with the input end of a backup module, the output end of the backup module is electrically connected with the input end of a cloud server, and the cloud server is in bidirectional connection with an encryption module in a wireless mode.
8. The system according to claim 7, wherein said computing system is further configured to: the encryption module is in bidirectional connection with the storage module through wireless, and the storage module is in bidirectional connection with the deletion module through wireless.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211071161.0A CN115374212A (en) | 2022-09-01 | 2022-09-01 | Computing method based on artificial intelligence data processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211071161.0A CN115374212A (en) | 2022-09-01 | 2022-09-01 | Computing method based on artificial intelligence data processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115374212A true CN115374212A (en) | 2022-11-22 |
Family
ID=84069446
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211071161.0A Pending CN115374212A (en) | 2022-09-01 | 2022-09-01 | Computing method based on artificial intelligence data processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115374212A (en) |
-
2022
- 2022-09-01 CN CN202211071161.0A patent/CN115374212A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114048870A (en) | Power system abnormity monitoring method based on log characteristic intelligent mining | |
| CN114003791B (en) | Depth map matching-based automatic classification method and system for medical data elements | |
| CN113094512B (en) | Fault analysis system and method in industrial production and manufacturing | |
| CN113268370B (en) | Root cause alarm analysis method, system, equipment and storage medium | |
| CN114281864A (en) | Correlation analysis method for power network alarm information | |
| CN111914166B (en) | Correction strategy personalized recommendation system applied to community correction personnel | |
| CN116245107B (en) | Electric power audit text entity identification method, device, equipment and storage medium | |
| CN117131449A (en) | Data management-oriented anomaly identification method and system with propagation learning capability | |
| CN117371933A (en) | Intelligent laboratory management system based on Internet of things | |
| CN112784919B (en) | Classification method for intelligent manufacturing multi-mode data | |
| CN117609278A (en) | Multi-mode power data management method and system based on deep measurement learning | |
| CN117495422A (en) | Cost management system and method based on power communication network construction | |
| CN112783865A (en) | Semi-supervised man-machine combined operation and maintenance fault library generation method and system | |
| CN117291575A (en) | Equipment maintenance method, equipment maintenance device, computer equipment and storage medium | |
| CN115374212A (en) | Computing method based on artificial intelligence data processing | |
| CN116796894A (en) | Construction method of efficient deep learning weather prediction model | |
| CN113807704A (en) | Intelligent algorithm platform construction method for urban rail transit data | |
| CN113673684B (en) | Edge-end DNN model loading system and method based on input pruning | |
| Pushpa et al. | Video summarization using submodular convex optimization with dynamic support vector machine for forest fire sequence classification | |
| CN113271106B (en) | Sparse representation power plant data compression method | |
| CN117668229A (en) | Meta model automatic acquisition and classification management method, device and storage medium | |
| CN116992101A (en) | Method, device, equipment and computer readable storage medium for converting data into visual chart | |
| CN113989015A (en) | Credit rating method based on monotone ordered decision tree integration | |
| CN118364020A (en) | Multi-source heterogeneous global energy data acquisition system and method | |
| CN117851768A (en) | Predictive analysis system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |