CN110569235A - Error filtering method and system based on cloud platform - Google Patents
Error filtering method and system based on cloud platform Download PDFInfo
- Publication number
- CN110569235A CN110569235A CN201910722464.6A CN201910722464A CN110569235A CN 110569235 A CN110569235 A CN 110569235A CN 201910722464 A CN201910722464 A CN 201910722464A CN 110569235 A CN110569235 A CN 110569235A
- Authority
- CN
- China
- Prior art keywords
- data
- cloud platform
- incomplete
- complete
- error filtering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Fuzzy Systems (AREA)
- Quality & Reliability (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Computational Linguistics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
the invention provides a method and a system for filtering errors based on a cloud platform, wherein the method comprises the following steps: s1, a cloud platform receives initial data generated by a user and transfers the initial data to a background data processing module; s2, the data processing module classifies and filters the initial data; and S3, using the classified and error-filtered data by the user through the cloud platform. The system comprises a data receiving module, a background data processing module and a data processing module, wherein the data receiving module is used for configuring a cloud platform to receive initial data generated by a user and transferring the initial data to the background data processing module; the data classification error filtering module is used for configuring the data processing module to classify and filter the initial data; and the data using module is used for configuring the data after the user uses the classification and error filtering through the cloud platform. According to the method and the device, when the user performs operations such as creation and the like, the user does not need to worry about selecting unavailable incomplete data, more time is saved, the user can conveniently perform unified management on unavailable junk data subsequently, and the usability of the cloud platform is improved.
Description
Technical Field
the invention belongs to the technical field of cloud platform data processing, and particularly relates to an error filtering method and system based on a cloud platform.
background
in the using process (such as creation, modification and the like) of a cloud platform, a user can encounter incomplete data, the incomplete data causes great troubles to the user at present, for example, when a cloud host is created, a virtual control center lacking an available domain is selected, the creation is failed, the selection needs to be carried out again, the user experience is very poor, and when a subsequent administrator manages, a function of processing junk data in a centralized manner is also needed. The existing cloud platform only has the function of collecting the junk data actively deleted by the user at present, but cannot automatically identify the junk data, so that the junk data can be conveniently processed by the user.
Therefore, it is very necessary to provide a method and a system for error filtering based on a cloud platform to overcome the above-mentioned drawbacks in the prior art.
disclosure of Invention
aiming at the defects that incomplete data can be encountered in the using process of the cloud platform in the prior art, the existing cloud platform only has the function of collecting junk data actively deleted by a user at present and cannot automatically identify the junk data, the invention provides an error filtering method and system based on the cloud platform to solve the technical problems.
in a first aspect, the present invention provides an error filtering method based on a cloud platform, including the following steps:
s1, a cloud platform receives initial data generated by a user and transfers the initial data to a background data processing module;
S2, the data processing module classifies and filters the initial data;
and S3, using the classified and error-filtered data by the user through the cloud platform.
Further, the step S2 specifically includes the following steps:
s21, judging whether the initial data is original data or supplementary data of the existing data by the data processing module;
if the original data is the current data, the process goes to step S22 directly;
s22, judging whether the current data is complete;
if the data is incomplete, setting the current data as incomplete data; proceeding to step S23;
s23, judging whether the application scene of the incomplete data requires the incomplete data to be complete or not;
if yes, the incomplete data is filtered out, and the process proceeds to step S3. By screening the data, the user is guaranteed not to be exposed to unavailable data.
further, in step S21, if the data is supplementary data to the existing data, the supplementary data is supplemented to the existing data, and the supplemented data is used as current data, and the process proceeds to step S22. The operation of the step is applicable to the supplement of the original incomplete data by the user or the modification of the original complete data.
further, in step S22, if the current data is complete, the current data is set as complete data; the process advances to step S3. And if the data is complete, the data can be normally used without additional judgment, the data is originally unavailable, and if the data becomes complete data after the supplement of the user is received, the integrity attribute of the data is modified.
further, in step S23, if the application scenario of the initial data does not require that the initial data is complete, the incomplete data is retained, and the process proceeds to step S3. The data is incomplete, the use is not influenced, and errors are not generated, so that the data does not need to be processed, and the original data is reserved.
In a second aspect, the invention provides an error filtering system based on a cloud platform, which comprises
the data receiving module is used for configuring the cloud platform to receive initial data generated by a user and transferring the initial data to the background data processing module;
The data classification error filtering module is used for configuring the data processing module to classify and filter the initial data;
and the data using module is used for configuring the data after the user uses the classification and error filtering through the cloud platform.
further, the data classification error filtering module comprises:
The data type judging unit is used for judging whether the initial data is original data or supplementary data of the existing data, and setting the data as the current data when the data is the original data;
The data integrity judging unit is used for judging whether the current data is complete or not;
The incomplete data setting unit is used for setting the current data as incomplete data when the data are incomplete;
the complete necessity judgment unit is used for judging whether the application scene of the incomplete data requires the incomplete data to be complete or not;
and the data filtering unit is used for filtering the incomplete data when the application scene of the incomplete data requires that the incomplete data must be complete.
further, the data classification error filtering module further comprises:
and the data merging unit is used for supplementing the supplementary data and the corresponding existing data when the data is supplementary data of the existing data, and the supplemented data is used as the current data.
further, the data classification error filtering module further comprises:
And the complete data setting unit is used for setting the data as complete data when the current data is complete.
Further, the data classification error filtering module further comprises:
And the incomplete data retaining unit is used for retaining the incomplete data when the application scene of the incomplete data does not require the incomplete data to be complete.
the beneficial effect of the invention is that,
according to the error filtering method and system based on the cloud platform, provided by the invention, when a user performs operations such as creation and the like, the user does not need to worry about selecting unavailable incomplete data, so that more time is saved, the user can conveniently perform unified management on unavailable junk data subsequently, and the usability of the cloud platform is improved.
In addition, the invention has reliable design principle, simple structure and very wide application prospect.
Therefore, compared with the prior art, the invention has prominent substantive features and remarkable progress, and the beneficial effects of the implementation are also obvious.
drawings
in order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1 is a first schematic flow chart of the method of the present invention;
FIG. 2 is a second schematic flow chart of the method of the present invention;
FIG. 3 is a schematic diagram of the system of the present invention;
In the figure, 1-data receiving module; 2-data classification error filtering module; 2.1-data type judging unit; 2.2-data integrity judgment unit; 2.3 — incomplete data setting unit; 2.4-complete necessity judgment unit; 2.5-data filtering unit; 2.6-data merging unit; 2.7-complete data setting unit; 2.8 — incomplete data retention unit; and 3, a data use module.
Detailed Description
in order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1:
as shown in fig. 1 and 2, the invention provides an error filtering method based on a cloud platform, which includes the following steps:
s1, a cloud platform receives initial data generated by a user and transfers the initial data to a background data processing module;
S2, the data processing module classifies and filters the initial data; the step S2 includes the following steps:
S21, judging whether the initial data is original data or supplementary data of the existing data by the data processing module;
If the original data is the current data, the process goes to step S22 directly;
If the current data is supplementary data of the existing data, supplementing the supplementary data and the corresponding existing data, taking the supplemented data as the current data, and entering step S22;
s22, judging whether the current data is complete;
if the data is incomplete, setting the current data as incomplete data; proceeding to step S23;
if the current data is complete, setting the current data as complete data; proceeding to step S3;
S23, judging whether the application scene of the incomplete data requires the incomplete data to be complete or not;
if yes, filtering out the incomplete data, and entering step S3;
if not, the incomplete data is reserved, and the step 3 is entered;
and S3, using the classified and error-filtered data by the user through the cloud platform.
example 2:
the invention provides a cloud platform-based error filtering method, which comprises the following steps:
s1, a cloud platform receives initial data generated by a user and transfers the initial data to a background data processing module; when a user creates new initial virtual data center data, switching to a background data processing module; the initial virtual center data is one of the initial data received by the user;
s2, the data processing module classifies and filters the initial virtual data center data; the step S2 includes the following steps:
S21, judging whether the initial virtual data center data is original virtual data center data or supplementary data of the existing virtual data center data by the data processing module;
If the original virtual data center data is the current data, the process directly proceeds to step S22; the raw virtual center data is one of raw data;
if the data is supplementary data of the existing virtual data center data, supplementing the supplementary data and the corresponding existing data, taking the supplemented data as current data, and performing integrity judgment in step S22;
s22, judging whether the current virtual data center data is complete; the virtual data center data is judged to be a complete virtual data center according to whether the virtual data center data has data such as a virtual control center, an available domain, a network, an IP address, a resource specification and a host, and all or part of indexes can be selected as integrity judgment bases according to self-defined setting;
if the data is incomplete, setting the current virtual data center data as incomplete data; proceeding to step S23;
if the current virtual data center data is complete, setting the current virtual data center data as complete data; at this time, if the current data is supplemented virtual data center data, the current data is supplemented, and then the current data enters complete data center data, and the step S3 is performed;
s23, judging whether the application scene of the incomplete virtual data center data requires to be complete or not;
If yes, filtering out the incomplete virtual data center data to avoid the user selecting the incomplete virtual data center data, and entering step S3;
if not, the incomplete virtual data center data is retained, and the step S3 is entered;
S3, using the classified and error-filtered data by the user through the cloud platform; when a user creates a cloud host through the cloud platform, the data processing module processes the virtual data center meeting the user-defined standard and only displays the available virtual data center.
the Virtual Data center, VDC-Virtual Data center for short, is a Virtual Data center, and the initial Virtual Data center Data is one of initial Data received by a user. The VDC is a new data center modality that applies the cloud computing concept to data centers. The VDC can abstract and integrate physical resources through a virtualization technology, dynamically allocate and schedule resources, realize automatic deployment of the data center and greatly reduce the operation cost of the data center.
Example 3:
as shown in FIG. 3, the invention provides an error filtering system based on a cloud platform, which comprises
The data receiving module 1 is used for configuring a cloud platform to receive initial data generated by a user and transferring the initial data to the background data processing module;
The data classification error filtering module 2 is used for configuring a data processing module to classify and filter the initial data; the data classification error filtering module 2 comprises:
The data type judging unit 2.1 is used for judging whether the initial data is original data or supplementary data of the existing data, and setting the data as the current data when the data is the original data;
A data integrity judgment unit 2.2, configured to judge whether current data is complete;
an incomplete data setting unit 2.3, configured to set the current data as incomplete data when the data is incomplete;
a completeness necessity judgment unit 2.4, configured to judge whether an application scenario of incomplete data requires that the application scenario must be complete;
The data filtering unit 2.5 is used for filtering the incomplete data when the application scene of the incomplete data requires that the incomplete data must be complete;
the data merging unit 2.6 is used for complementing the supplementary data and the corresponding existing data when the data is supplementary data of the existing data, and the complemented data is used as current data;
a complete data setting unit 2.7, configured to set the current data as complete data when the data is complete;
an incomplete data retention unit 2.8 for retaining incomplete data when its application scenario does not require it to be complete;
and the data using module 3 is used for configuring the data after the classification and the error filtering are used by the user through the cloud platform.
Although the present invention has been described in detail by referring to the drawings in connection with the preferred embodiments, the present invention is not limited thereto. Various equivalent modifications or substitutions can be made on the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and these modifications or substitutions are within the scope of the present invention/any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. a cloud platform-based error filtering method is characterized by comprising the following steps:
s1, a cloud platform receives initial data generated by a user and transfers the initial data to a background data processing module;
s2, the data processing module classifies and filters the initial data;
And S3, using the classified and error-filtered data by the user through the cloud platform.
2. the cloud platform-based error filtering method according to claim 1,
the step S2 includes the following steps:
s21, judging whether the initial data is original data or supplementary data of the existing data by the data processing module;
if the original data is the current data, the process goes to step S22 directly;
S22, judging whether the current data is complete;
if the data is incomplete, setting the current data as incomplete data; proceeding to step S23;
S23, judging whether the application scene of the incomplete data requires the incomplete data to be complete or not;
If yes, the incomplete data is filtered out, and the process proceeds to step S3.
3. the cloud platform-based error filtering method of claim 2, wherein in step S21, if the data is supplementary to the existing data, the supplementary data is supplemented to the corresponding existing data, and the supplemented data is used as current data, and the process proceeds to step S22.
4. The cloud platform-based error filtering method of claim 2, wherein in step S22, if the current data is complete, the current data is set as complete data; return is made to step S1.
5. the method of claim 2, wherein in step S23, if the application scenario of the initial data does not require it to be complete, the incomplete data is retained, and step S3 is entered.
6. an error filtering system based on a cloud platform is characterized by comprising
The data receiving module (1) is used for configuring a cloud platform to receive initial data generated by a user and transferring the initial data to the background data processing module;
the data classification error filtering module (2) is used for configuring the data processing module to classify and filter the initial data;
And the data using module (3) is used for configuring the data after classification and error filtering for the user through the cloud platform.
7. the cloud platform-based error filtering system of claim 6, wherein the data classification error filtering module (2) comprises:
the data type judging unit (2.1) is used for judging whether the initial data is original data or supplementary data of the existing data, and setting the data as the current data when the data is the original data;
the data integrity judging unit (2.2) is used for judging whether the current data is complete;
An incomplete data setting unit (2.3) for setting the data as incomplete data when the current data is incomplete;
A completeness necessity judgment unit (2.4) for judging whether the application scene of the incomplete data requires completeness;
and the data filtering unit (2.5) is used for filtering the incomplete data when the application scene of the incomplete data requires that the incomplete data must be complete.
8. The cloud platform-based error filtering system of claim 7, wherein the data classification error filtering module (2) further comprises:
and the data merging unit (2.6) is used for complementing the supplementary data and the corresponding existing data when the data is supplementary data of the existing data, and the complemented data is used as the current data.
9. The cloud platform-based error filtering system of claim 7, wherein the data classification error filtering module (2) further comprises:
and a complete data setting unit (2.7) for setting the data as complete data when the current data is complete.
10. The cloud platform-based error filtering system of claim 7, wherein the data classification error filtering module (2) further comprises:
and an incomplete data retaining unit (2.8) for retaining incomplete data when the application scene of the incomplete data does not require that it must be complete.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910722464.6A CN110569235A (en) | 2019-08-06 | 2019-08-06 | Error filtering method and system based on cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910722464.6A CN110569235A (en) | 2019-08-06 | 2019-08-06 | Error filtering method and system based on cloud platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110569235A true CN110569235A (en) | 2019-12-13 |
Family
ID=68774669
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910722464.6A Withdrawn CN110569235A (en) | 2019-08-06 | 2019-08-06 | Error filtering method and system based on cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110569235A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112068933A (en) * | 2020-09-02 | 2020-12-11 | 成都鱼泡科技有限公司 | Real-time distributed data monitoring method |
-
2019
- 2019-08-06 CN CN201910722464.6A patent/CN110569235A/en not_active Withdrawn
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112068933A (en) * | 2020-09-02 | 2020-12-11 | 成都鱼泡科技有限公司 | Real-time distributed data monitoring method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111371696B (en) | Method for realizing Pod network flow control in Kubernetes | |
| CN109818934B (en) | Method and device for automatically processing logs and computing equipment | |
| US10942785B2 (en) | Integration of software applications with infrastructure | |
| CN105095103A (en) | Storage device management method and device used for cloud environment | |
| CN110855509A (en) | Novel cloud SPTN network architecture | |
| CN113709810B (en) | Method, equipment and medium for configuring network service quality | |
| CN102752294A (en) | Method and system for synchronizing data of multiple terminals on basis of equipment capacity | |
| CN106354566A (en) | Command processing method and server | |
| CN103414739B (en) | Use Cloud Server automatic monitored control system and the method for automatic drift | |
| CN112235133A (en) | Design method of universal cloud pipe platform and universal cloud pipe platform | |
| CN107181626B (en) | Method and system for monitoring network bandwidth of distributed storage cluster system | |
| CN114840223A (en) | Resource processing method and device | |
| CN110569235A (en) | Error filtering method and system based on cloud platform | |
| CN104636441A (en) | Network file system realization method and device | |
| CN113220235B (en) | Read-write request processing method, device, equipment and storage medium | |
| CN104933077A (en) | Rule-based multi-file information analysis method | |
| CN105607606A (en) | Data acquisition device and data acquisition method based on double-mainboard framework | |
| CN101022633B (en) | Allocation data recovering method, system and device | |
| CN114070889B (en) | Configuration method, traffic forwarding device, storage medium, and program product | |
| CN116860527A (en) | Migration method for container using local storage in Kubernetes environment | |
| US20230393859A1 (en) | Techniques for bootstrapping across secure air gaps with edge device cluster | |
| CN106571943A (en) | Distributed-type configuration cluster capacity-expanding method and device | |
| CN114281600A (en) | Disaster recovery backup and recovery method, device, equipment and storage medium | |
| CN113434473A (en) | Distributed log processing method, device, medium and electronic equipment | |
| CN114564211A (en) | Cluster deployment method, cluster deployment device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20191213 |
|
| WW01 | Invention patent application withdrawn after publication |