CN116796206A - Operation data processing method and system based on integrated platform - Google Patents
Operation data processing method and system based on integrated platform Download PDFInfo
- Publication number
- CN116796206A CN116796206A CN202310767511.5A CN202310767511A CN116796206A CN 116796206 A CN116796206 A CN 116796206A CN 202310767511 A CN202310767511 A CN 202310767511A CN 116796206 A CN116796206 A CN 116796206A
- Authority
- CN
- China
- Prior art keywords
- target
- platform
- clustering
- preset
- integrated platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 21
- 238000012545 processing Methods 0.000 claims abstract description 54
- 238000011161 development Methods 0.000 claims abstract description 36
- 238000000034 method Methods 0.000 claims abstract description 18
- 238000012544 monitoring process Methods 0.000 claims abstract description 11
- 238000005259 measurement Methods 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 13
- 238000007726 management method Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 5
- 238000013500 data storage Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application discloses an operation data processing method and system based on an integrated platform, and relates to the technical field of data processing, wherein the method comprises the following steps: reading target development requirements, analyzing through development components in the integrated platform to obtain a target function module set, and constructing the target function module set in a combined way to form a target integrated platform; dynamically monitoring to obtain a target platform log, wherein the target platform log comprises a plurality of groups of platform operation data with time identifiers; reading a preset clustering scheme, and clustering a plurality of groups of platform operation data with time identifiers based on the preset clustering scheme to obtain a data clustering result; and reading a preset storage scheme, and storing and processing the data clustering result based on the preset storage scheme. The application solves the technical problem of low intelligent level of operation data processing of the integrated platform in the prior art, and achieves the technical effect of improving the intelligent level of operation data processing of the integrated platform.
Description
Technical Field
The application relates to the technical field of data processing, in particular to an operation data processing method and system based on an integrated platform.
Background
The integrated platform is a work management platform which is not divided into modules and is built by taking actual business and work content of an enterprise as a base starting point. The method can realize automatic real-time exchange and association of the working information in the platform, strengthen the information gathering and processing capacity, and have the advantages of low cost, flexible deployment, information island breaking and data sharing realization. However, the integrated platform operation has more related fields, the data content is complicated, the current data processing method is not intelligent and efficient enough, and the management difficulty is increased.
Disclosure of Invention
The application provides an operation data processing method and system based on an integrated platform, which are used for solving the technical problem of low intelligent level of operation data processing of the integrated platform in the prior art.
In a first aspect of the present application, there is provided an operation data processing method based on an integrated platform, the method comprising: reading target development requirements, and analyzing the target development requirements through a development component in the integrated platform to obtain a target function module set; building the target function module set in a combined way to form a target integrated platform; dynamically monitoring the target integrated platform to obtain a target platform log, wherein the target platform log comprises a plurality of groups of platform operation data with time identifiers; reading a preset clustering scheme, and clustering the plurality of groups of platform operation data with time identifiers based on the preset clustering scheme to obtain a data clustering result; and reading a preset storage scheme, and storing the data clustering result based on the preset storage scheme.
In a second aspect of the present application, there is provided an integrated platform based operational data processing system, the system comprising: the target function module set acquisition module is used for reading target development requirements and analyzing the target development requirements through a development component in the integrated platform to obtain a target function module set; the integrated platform building module is used for building the target function module set in a combined way to form a target integrated platform; the target platform log acquisition module is used for dynamically monitoring the target integrated platform to obtain a target platform log, wherein the target platform log comprises a plurality of groups of platform operation data with time identifiers; the data clustering result acquisition module is used for reading a preset clustering scheme, and clustering the plurality of groups of platform operation data with time identifiers based on the preset clustering scheme to obtain a data clustering result; and the storage processing module is used for reading a preset storage scheme and carrying out storage processing on the data clustering result based on the preset storage scheme.
One or more technical schemes provided by the application have at least the following technical effects or advantages:
the application provides an operation data processing method based on an integrated platform, which relates to the technical field of data processing and forms an integrated target platform by obtaining a target function module set and constructing the integrated target function module set in a combined way; dynamically monitoring to obtain a target platform log, wherein the target platform log comprises a plurality of groups of platform operation data with time identifiers; reading a preset clustering scheme, and clustering a plurality of groups of platform operation data with time identifiers based on the preset clustering scheme to obtain a data clustering result; the method comprises the steps of reading a preset storage scheme, storing and processing data clustering results based on the preset storage scheme, solving the technical problem of low intelligent level of operation data processing of the integrated platform in the prior art, and realizing the technical effect of improving the intelligent level of operation data processing of the integrated platform.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of an operation data processing method based on an integrated platform according to an embodiment of the present application;
fig. 2 is a schematic flow chart of obtaining a target function module set in the integrated platform-based operation data processing method according to the embodiment of the present application;
fig. 3 is a schematic flow chart of storing and processing a data clustering result in the integrated platform-based operation data processing method according to the embodiment of the present application;
fig. 4 is a schematic structural diagram of an operation data processing system based on an integrated platform according to an embodiment of the present application.
Reference numerals illustrate: the system comprises a target function module set acquisition module 11, an integrated platform construction module 12, a target platform log acquisition module 13, a data clustering result acquisition module 14 and a storage processing module 15.
Detailed Description
The application provides an operation data processing method based on an integrated platform, which is used for solving the technical problem of low intelligent level of operation data processing of the integrated platform in the prior art.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. It will be apparent that the described embodiments are only some, but not all, embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above-described drawings are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or modules not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
As shown in fig. 1, the present application provides an operation data processing method based on an integrated platform, the method comprising:
s100: reading target development requirements, and analyzing the target development requirements through a development component in the integrated platform to obtain a target function module set;
specifically, the target development requirement is read, that is, the type of an integrated platform required by a customer is obtained, the integrated platform comprises the related field and platform functions, such as an enterprise management integrated platform, the target development requirement is analyzed through a development component in the integrated platform, the development component is a function development module of the operation data processing system and is used for matching the corresponding platform function through the type of the platform required by the customer, the specific development process can be that the target development requirement is input into the development component, the development component matches the corresponding function module from a function module library through the type of the integrated platform required by the customer, the target function module set is used as a basic module of a subsequent target integrated platform.
Further, as shown in fig. 2, step S100 of the embodiment of the present application further includes:
s110: constructing an integrated platform set based on big data, and extracting a first integrated platform in the integrated platform set;
s120: collecting functional modules in the first integrated platform and forming a first integrated functional module set;
s130: and performing union operation on the first integrated functional module set to obtain a comprehensive module set, and storing the comprehensive module set into the development assembly.
Specifically, a plurality of types of integrated platforms are obtained based on big data, for example, a research and development production integrated platform, a proposal execution integrated platform, a budget management integrated platform, an enterprise management integrated platform, an information integrated platform and the like, a first integrated function module set is formed by a plurality of function modules of the intelligent community integrated management platform, and the like.
S200: building the target function module set in a combined way to form a target integrated platform;
specifically, all the functional modules in the target functional module set are combined and built, the logic relation and the data transmission relation among the target functional modules are combed, the target functional modules are connected in a hardware and software combination mode, communication and data transmission can be carried out among the target functional modules in a data flow mode, and a target integrated platform with a plurality of target functions is obtained, and the target integrated platform can meet the personalized function requirements of users.
S300: dynamically monitoring the target integrated platform to obtain a target platform log, wherein the target platform log comprises a plurality of groups of platform operation data with time identifiers;
specifically, real-time dynamic monitoring is performed on the target integrated platform, daily operation data of the target integrated platform is recorded, an operation log of the target integrated platform is obtained and is used as a target platform log, the target platform log comprises a plurality of groups of platform operation data with time identifiers, the time identifiers can map occurrence time of each item of platform operation data, and the platform operation data are connected in series by using time logic, so that data calling and tracing are facilitated.
Further, step S300 of the embodiment of the present application further includes:
s310: acquiring a first proposal collaboration;
s320: analyzing the first proposal cooperation through a target cooperation front module in the target integrated platform to obtain a first cooperation plan, wherein the first cooperation plan comprises a first stage plan and a second stage plan;
s330: wherein the first-stage plan comprises a plurality of member first job plans with deadlines and achievement identifications;
s340: wherein the second-stage plan comprises a plurality of member second job plans with deadlines and achievement identifications;
s350: and obtaining a first collaborative planning time sequence according to the first-stage planning and the second-stage planning.
Specifically, any event needing to be cooperatively processed on the target integrated platform is randomly acquired as a first proposal for cooperation, the first proposal for cooperation is analyzed through a target cooperation front module in the target integrated platform, the target cooperation front module is a module for carrying out flow planning on a cooperative event in advance, according to the event characteristics and the data processing requirements of the first proposal for cooperation, a data processing framework of the target integrated platform is combined to generate a processing flow of the event, the processing flow of the event is used as a first cooperation plan, the first cooperation plan comprises a first-stage plan and a second-stage plan, namely the first-proposal cooperation processing flow is divided into two stages, the first-stage plan comprises a plurality of member first operation plans with deadlines and achievement identifiers, the second stage comprises a plurality of member second operation plans with deadlines and time identifiers, the deadlines identifiers indicate the completion time nodes of all links of the event processing flow, the identifiers can be used for judging data needing to be obtained by each link, the first member and the first member can form a first-stage cooperation plan according to the first time sequence of the first proposal, and the first member cooperation plan can form a first-stage cooperation plan according to the first time sequence of the first proposal, and the first-stage cooperation plan can form a first-stage cooperation plan.
Further, step S300 of the embodiment of the present application further includes:
s360: sequentially collecting first-stage operation information and second-stage operation information of a first member;
s370: the first-stage operation information refers to first operation duration and first operation achievements of the first member in a first stage;
s380: the second-stage operation information refers to second operation duration and second operation achievements of the first member in a second stage;
s390: obtaining a first member operation information time sequence according to the first-stage operation information and the second-stage operation information, and forming a first operation information time sequence;
s3100: and forming the target platform log based on the first collaborative planning time sequence and the first job information time sequence.
Specifically, according to a first collaborative planning time sequence, first-stage operation information and second-stage operation information of a first member are sequentially collected, the first member is any event which needs to be subjected to collaborative processing on the target integrated platform, the first-stage operation information comprises first operation duration and first operation achievements of the first member in the first stage, the second-stage operation information comprises second operation duration and second operation achievements of the first member in the second stage, and the first-stage operation information comprises first-stage operation duration and second operation achievements of an enterprise management integrated platform. The first-stage operation information and the second-stage operation information form a first member operation information time sequence, the first member operation information time sequence is processing procedure information with time marks of any event, the processing procedure information comprises operation steps executed at each time point, obtained data and the like, the first member operation information time sequence of a plurality of different events forms a first operation information time sequence, and the first cooperation planning time sequence and the first operation information time sequence form the target platform log which can be used as a data source for acquiring platform operation data.
S400: reading a preset clustering scheme, and clustering the plurality of groups of platform operation data with time identifiers based on the preset clustering scheme to obtain a data clustering result;
specifically, a predetermined data clustering scheme is read, and the clustering is a process of classifying data into different classes or clusters, so that objects in the same cluster have great similarity, and objects among different clusters have great dissimilarity. Clustering differs from classification in that the class into which clustering requires partitioning is unknown. The data clustering scheme is a clustering analysis rule set for different parameters and clustering directions, such as a scheme for clustering according to the type of data, a scheme for clustering according to the processing time of the data, and the like, and is characterized in that the plurality of groups of platform operation data with time identifiers are clustered based on the preset clustering scheme, and the platform operation data are grouped into a plurality of data sets composed of similar objects, so that the data are used as data clustering results, and the subsequent data storage is facilitated.
Further, as shown in fig. 3, step S400 of the embodiment of the present application further includes:
s410: acquiring a preset time;
s420: extracting the preset platform operation data under the preset time in the target platform log through a target collaborative module in the target integrated platform;
s430: wherein the predetermined platform operation data comprises a predetermined collaboration plan and predetermined job information;
s440: comparing the preset cooperation plan with preset operation information to obtain a comparison result;
s450: generating a preset label of the preset time according to the comparison result, wherein the preset label refers to an operation state grade mark under the preset time;
s460: and constructing a first tag group of the first proposal cooperation based on the preset tag, and generating a performance measurement result of the target integrated platform according to the first tag group.
Specifically, a predetermined time is obtained, the predetermined time may be any period of operation time in the past of the target integrated platform, the predetermined platform operation data in the predetermined time is extracted from the target platform log through a target post-cooperation module in the target integrated platform, and the target post-cooperation module may be regarded as an operation data processing module of the operation data processing system and is used for processing and archiving the operation data of the target integrated platform. The operation data of the preset platform comprise preset cooperation planning and preset operation information in the preset time, the preset cooperation planning refers to event processing effects of all cooperation events planned in advance in the preset time, the preset operation information refers to event processing effects actually achieved by all cooperation events in the preset time, the preset cooperation planning is compared with the preset operation information, namely, a target event effect is compared with an actual event effect to obtain an effect difference value as a comparison result, a preset label of the preset time is generated according to the comparison result, namely, operation state grading is conducted according to the operation effect of the target integrated platform in the preset time, the preset label is set according to the assessed operation state grade, and the smaller the deviation of the preset cooperation planning and the preset operation information is, the higher the operation state grade is, namely, the operation condition accords with the planning, and the better the application effect of the platform is indicated. And constructing a first tag group of the first proposal collaboration based on the preset tag, wherein the first tag group is the collaboration processing effect of the first proposal collaboration within a preset time, quantifying the actual application value of the target integrated platform according to the first tag group, and comparing the deviation and processing time of the preset collaboration planning and the preset operation information with the data of the target integrated platform when the target integrated platform is not used to obtain the efficacy measurement result of the target integrated platform, wherein the efficacy measurement result can be used for judging whether the working quality and the collaboration efficiency are improved after the platform is used.
S500: and reading a preset storage scheme, and storing the data clustering result based on the preset storage scheme.
Specifically, reading a preset data storage scheme, and storing the data clustering result according to the preset storage scheme. The preset storage scheme refers to an operation data storage scheme of the target integrated platform, which is set in advance, and the content of the scheme can comprise the position of data storage, the type of a used storage space, the storage form of data and the like, and the data clustering result is stored and processed so as to facilitate the follow-up data tracing analysis and avoid data loss.
Further, step S500 of the embodiment of the present application further includes:
s510: acquiring a Hadoop distributed cloud storage space, wherein the Hadoop distributed cloud storage space comprises a first space layer and a second space layer;
s520: respectively extracting a label clustering scheme and a period clustering scheme in the preset clustering scheme;
s530: clustering the first tag group according to the tag clustering scheme to obtain a first clustering result, wherein the first clustering result comprises a plurality of first clustering clusters;
s540: clustering the target platform logs according to the time period clustering scheme to obtain a second clustering result, wherein the second clustering result comprises a plurality of second clustering clusters;
s550: the plurality of first clusters are stored to the first spatial layer and the plurality of second clusters are stored to the second spatial layer based on the predetermined storage scheme.
Specifically, based on a Hadoop distributed system infrastructure, a Hadoop distributed cloud storage space is constructed, the Hadoop is a software framework capable of performing distributed processing on a large amount of data, a distributed program can be developed under the condition that the detail of a distributed bottom layer is not known, and the power of a cluster is fully utilized for high-speed operation and storage. After a user registers and logs in the Hadoop distributed cloud storage space, the data file can be stored in the cloud, and operations such as file management and downloading can be performed through a browser at any time. The Hadoop distributed cloud storage space comprises a first space layer and a second space layer, wherein the first space layer and the second space layer are used for storing different types of data. And respectively extracting a label clustering scheme and a period clustering scheme in the preset clustering scheme, wherein the label clustering scheme is a clustering scheme for clustering according to operation levels, the period clustering scheme is a scheme for clustering according to a data processing stage, all operation levels in the first label group are clustered according to the label clustering scheme, so that a plurality of clustering clusters with different level ranges are obtained, the clustering clusters are used as a first clustering result, the first clustering result comprises a plurality of first clustering clusters, and the first clustering clusters are clustering clusters divided by the level ranges. And clustering the target platform logs according to the period clustering scheme and the processing stages of the data to obtain a plurality of clustering clusters with different processing stage ranges, wherein the clustering clusters are used as second clustering results, and the second clustering results comprise a plurality of second clustering clusters. And storing the plurality of first clustering clusters to the first space layer according to the preset storage scheme, storing the plurality of second clustering clusters to the second space layer, and storing the operation data of the target integrated platform in the cloud in a classified manner so as to achieve the purposes of facilitating data tracing analysis and avoiding data loss.
Further, the embodiment of the present application further includes step S600, where step S600 further includes:
s610: extracting a target first cluster in the plurality of first clusters;
s620: and storing the target first cluster to a target digital middle station based on the predetermined storage scheme.
Specifically, the label cluster with the lowest operation state level in the plurality of first cluster clusters is extracted and used as a target first cluster, the target first cluster is stored to a target digital middle station based on the preset storage scheme, the target digital middle station is a scheduling and operation center of data and service of the target integrated platform, and the data and operation center is shared for each service unit to use in the forms of interfaces, components and the like, so that reference and feedback can be provided for decision making, and closed loop of operation and management can be realized. And storing the target first cluster into a target number middle station, so that the data in the target first cluster can be directly called from the target number middle station, and the calling response rate of the target first cluster is further improved.
In summary, the embodiment of the application has at least the following technical effects:
according to the application, the target development requirements are read, and the development components in the integrated platform are analyzed to obtain a target function module set, and the target function module set is built in a combined way to form a target integrated platform; dynamically monitoring to obtain a target platform log, wherein the target platform log comprises a plurality of groups of platform operation data with time identifiers; reading a preset clustering scheme, and clustering a plurality of groups of platform operation data with time identifiers based on the preset clustering scheme to obtain a data clustering result; and reading a preset storage scheme, and storing and processing the data clustering result based on the preset storage scheme.
The technical effect of improving the intelligent level of the operation data processing of the integrated platform is achieved.
Example two
Based on the same inventive concept as the operation data processing method based on the integrated platform in the foregoing embodiment, as shown in fig. 4, the present application provides an operation data processing system based on the integrated platform, and the system and method embodiments in the embodiments of the present application are based on the same inventive concept. Wherein the system comprises:
the target function module set acquisition module 11 is used for reading target development requirements, and analyzing the target development requirements through a development component in the integrated platform to obtain a target function module set;
an integrated platform building module 12, wherein the integrated platform building module 12 is used for building the target function module set in a combined way to form a target integrated platform;
the target platform log obtaining module 13 is used for dynamically monitoring the target integrated platform to obtain a target platform log, wherein the target platform log comprises a plurality of groups of platform operation data with time identifiers;
the data clustering result acquisition module 14 is used for reading a preset clustering scheme, and clustering the plurality of groups of platform operation data with time identifiers based on the preset clustering scheme to obtain a data clustering result;
and the storage processing module 15 is used for reading a preset storage scheme and carrying out storage processing on the data clustering result based on the preset storage scheme.
Further, the target function module set obtaining module 11 is further configured to perform the following steps:
constructing an integrated platform set based on big data, and extracting a first integrated platform in the integrated platform set;
collecting functional modules in the first integrated platform and forming a first integrated functional module set;
and performing union operation on the first integrated functional module set to obtain a comprehensive module set, and storing the comprehensive module set into the development assembly.
Further, the target platform log obtaining module 13 is further configured to perform the following steps:
acquiring a first proposal collaboration;
analyzing the first proposal cooperation through a target cooperation front module in the target integrated platform to obtain a first cooperation plan, wherein the first cooperation plan comprises a first stage plan and a second stage plan;
wherein the first-stage plan comprises a plurality of member first job plans with deadlines and achievement identifications;
wherein the second-stage plan comprises a plurality of member second job plans with deadlines and achievement identifications;
and obtaining a first collaborative planning time sequence according to the first-stage planning and the second-stage planning.
Further, the target platform log obtaining module 13 is further configured to perform the following steps:
sequentially collecting first-stage operation information and second-stage operation information of a first member;
the first-stage operation information refers to first operation duration and first operation achievements of the first member in a first stage;
the second-stage operation information refers to second operation duration and second operation achievements of the first member in a second stage;
obtaining a first member operation information time sequence according to the first-stage operation information and the second-stage operation information, and forming a first operation information time sequence;
and forming the target platform log based on the first collaborative planning time sequence and the first job information time sequence.
Further, the data clustering result obtaining module 14 is further configured to perform the following steps:
acquiring a preset time;
extracting the preset platform operation data under the preset time in the target platform log through a target collaborative module in the target integrated platform;
wherein the predetermined platform operation data comprises a predetermined collaboration plan and predetermined job information;
comparing the preset cooperation plan with preset operation information to obtain a comparison result;
generating a preset label of the preset time according to the comparison result, wherein the preset label refers to an operation state grade mark under the preset time;
and constructing a first tag group of the first proposal cooperation based on the preset tag, and generating a performance measurement result of the target integrated platform according to the first tag group.
Further, the storage processing module 15 is further configured to perform the following steps:
acquiring a Hadoop distributed cloud storage space, wherein the Hadoop distributed cloud storage space comprises a first space layer and a second space layer;
respectively extracting a label clustering scheme and a period clustering scheme in the preset clustering scheme; clustering the first tag group according to the tag clustering scheme to obtain a first clustering result, wherein the first clustering result comprises a plurality of first clustering clusters;
clustering the target platform logs according to the time period clustering scheme to obtain a second clustering result, wherein the second clustering result comprises a plurality of second clustering clusters;
the plurality of first clusters are stored to the first spatial layer and the plurality of second clusters are stored to the second spatial layer based on the predetermined storage scheme.
Further, the system further comprises:
the target first cluster extraction module is used for extracting target first clusters in the plurality of first clusters;
and the target first cluster storage module is used for storing the target first cluster to a target number middle station based on the preset storage scheme.
It should be noted that the sequence of the embodiments of the present application is only for description, and does not represent the advantages and disadvantages of the embodiments. And the foregoing description has been directed to specific embodiments of this specification. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
The foregoing description of the preferred embodiments of the application is not intended to limit the application to the precise form disclosed, and any such modifications, equivalents, and alternatives falling within the spirit and scope of the application are intended to be included within the scope of the application.
The specification and figures are merely exemplary illustrations of the present application and are considered to cover any and all modifications, variations, combinations, or equivalents that fall within the scope of the application. It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the scope of the application. Thus, the present application is intended to include such modifications and alterations insofar as they come within the scope of the application or the equivalents thereof.
Claims (8)
1. The operation data processing method based on the integrated platform is characterized in that the operation data processing method is applied to an operation data processing system, the operation data processing system is in communication connection with the integrated platform, and the operation data processing method comprises the following steps:
reading target development requirements, and analyzing the target development requirements through a development component in the integrated platform to obtain a target function module set;
building the target function module set in a combined way to form a target integrated platform;
dynamically monitoring the target integrated platform to obtain a target platform log, wherein the target platform log comprises a plurality of groups of platform operation data with time identifiers;
reading a preset clustering scheme, and clustering the plurality of groups of platform operation data with time identifiers based on the preset clustering scheme to obtain a data clustering result;
and reading a preset storage scheme, and storing the data clustering result based on the preset storage scheme.
2. The method for processing operation data according to claim 1, wherein the analyzing the target development requirement by the development component in the integrated platform to obtain the target function module set includes:
constructing an integrated platform set based on big data, and extracting a first integrated platform in the integrated platform set;
collecting functional modules in the first integrated platform and forming a first integrated functional module set;
and performing union operation on the first integrated functional module set to obtain a comprehensive module set, and storing the comprehensive module set into the development assembly.
3. The method for processing operation data according to claim 1, wherein the dynamically monitoring the target integrated platform to obtain a target platform log includes:
acquiring a first proposal collaboration;
analyzing the first proposal cooperation through a target cooperation front module in the target integrated platform to obtain a first cooperation plan, wherein the first cooperation plan comprises a first stage plan and a second stage plan;
wherein the first-stage plan comprises a plurality of member first job plans with deadlines and achievement identifications;
wherein the second-stage plan comprises a plurality of member second job plans with deadlines and achievement identifications;
and obtaining a first collaborative planning time sequence according to the first-stage planning and the second-stage planning.
4. The operational data processing method according to claim 3, comprising, after said deriving a first collaborative planning timing from said first phase planning and said second phase planning:
sequentially collecting first-stage operation information and second-stage operation information of a first member;
the first-stage operation information refers to first operation duration and first operation achievements of the first member in a first stage;
the second-stage operation information refers to second operation duration and second operation achievements of the first member in a second stage;
obtaining a first member operation information time sequence according to the first-stage operation information and the second-stage operation information, and forming a first operation information time sequence;
and forming the target platform log based on the first collaborative planning time sequence and the first job information time sequence.
5. The operation data processing method according to claim 4, wherein after the composing the target platform log based on the first cooperation planning timing and the first job information timing, comprising:
acquiring a preset time;
extracting the preset platform operation data under the preset time in the target platform log through a target collaborative module in the target integrated platform;
wherein the predetermined platform operation data comprises a predetermined collaboration plan and predetermined job information;
comparing the preset cooperation plan with preset operation information to obtain a comparison result;
generating a preset label of the preset time according to the comparison result, wherein the preset label refers to an operation state grade mark under the preset time;
and constructing a first tag group of the first proposal cooperation based on the preset tag, and generating a performance measurement result of the target integrated platform according to the first tag group.
6. The operation data processing method according to claim 5, wherein the storing the data clustering result based on the predetermined storage scheme includes:
acquiring a Hadoop distributed cloud storage space, wherein the Hadoop distributed cloud storage space comprises a first space layer and a second space layer;
respectively extracting a label clustering scheme and a period clustering scheme in the preset clustering scheme;
clustering the first tag group according to the tag clustering scheme to obtain a first clustering result, wherein the first clustering result comprises a plurality of first clustering clusters;
clustering the target platform logs according to the time period clustering scheme to obtain a second clustering result, wherein the second clustering result comprises a plurality of second clustering clusters;
the plurality of first clusters are stored to the first spatial layer and the plurality of second clusters are stored to the second spatial layer based on the predetermined storage scheme.
7. The operational data processing method of claim 6, further comprising:
extracting a target first cluster in the plurality of first clusters;
and storing the target first cluster to a target digital middle station based on the predetermined storage scheme.
8. An integrated platform based operational data processing system, characterized in that the system is adapted to perform the method of any one of claims 1 to 7, the system comprising:
the target function module set acquisition module is used for reading target development requirements and analyzing the target development requirements through a development component in the integrated platform to obtain a target function module set;
the integrated platform building module is used for building the target function module set in a combined way to form a target integrated platform;
the target platform log acquisition module is used for dynamically monitoring the target integrated platform to obtain a target platform log, wherein the target platform log comprises a plurality of groups of platform operation data with time identifiers;
the data clustering result acquisition module is used for reading a preset clustering scheme, and clustering the plurality of groups of platform operation data with time identifiers based on the preset clustering scheme to obtain a data clustering result;
and the storage processing module is used for reading a preset storage scheme and carrying out storage processing on the data clustering result based on the preset storage scheme.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310767511.5A CN116796206B (en) | 2023-06-27 | 2023-06-27 | Operation data processing method and system based on integrated platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310767511.5A CN116796206B (en) | 2023-06-27 | 2023-06-27 | Operation data processing method and system based on integrated platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116796206A true CN116796206A (en) | 2023-09-22 |
| CN116796206B CN116796206B (en) | 2024-04-16 |
Family
ID=88049289
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310767511.5A Active CN116796206B (en) | 2023-06-27 | 2023-06-27 | Operation data processing method and system based on integrated platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116796206B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200394708A1 (en) * | 2018-05-06 | 2020-12-17 | Strong Force TX Portfolio 2018, LLC | Robotic process automation system for negotiation |
| US20210004642A1 (en) * | 2019-07-02 | 2021-01-07 | Beijing Baidu Netcom Science Technology Co., Ltd. | Ai capability research and development platform and data processing method |
| CN113706263A (en) * | 2021-09-03 | 2021-11-26 | 长沙昂易电子科技有限公司 | Electronic commerce system based on cloud platform |
| CN113918533A (en) * | 2021-09-07 | 2022-01-11 | 杭州和佳汇智技术有限公司 | RCS unified message cloud service system based on big data direction and use method thereof |
| US11272011B1 (en) * | 2020-10-30 | 2022-03-08 | Johnson Controls Tyco IP Holdings LLP | Systems and methods of configuring a building management system |
| CN114265927A (en) * | 2021-12-21 | 2022-04-01 | 中国电信股份有限公司 | Data query method and device, storage medium and electronic device |
| CN115081025A (en) * | 2022-08-19 | 2022-09-20 | 湖南华菱电子商务有限公司 | Sensitive data management method and device based on digital middlebox and electronic equipment |
| CN115375146A (en) * | 2022-08-24 | 2022-11-22 | 中建安装集团有限公司 | Digital construction integrated platform |
| CN116302433A (en) * | 2023-03-24 | 2023-06-23 | 中国工商银行股份有限公司 | Data processing method, device, computer equipment and storage medium |
-
2023
- 2023-06-27 CN CN202310767511.5A patent/CN116796206B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200394708A1 (en) * | 2018-05-06 | 2020-12-17 | Strong Force TX Portfolio 2018, LLC | Robotic process automation system for negotiation |
| US20210004642A1 (en) * | 2019-07-02 | 2021-01-07 | Beijing Baidu Netcom Science Technology Co., Ltd. | Ai capability research and development platform and data processing method |
| US11272011B1 (en) * | 2020-10-30 | 2022-03-08 | Johnson Controls Tyco IP Holdings LLP | Systems and methods of configuring a building management system |
| CN113706263A (en) * | 2021-09-03 | 2021-11-26 | 长沙昂易电子科技有限公司 | Electronic commerce system based on cloud platform |
| CN113918533A (en) * | 2021-09-07 | 2022-01-11 | 杭州和佳汇智技术有限公司 | RCS unified message cloud service system based on big data direction and use method thereof |
| CN114265927A (en) * | 2021-12-21 | 2022-04-01 | 中国电信股份有限公司 | Data query method and device, storage medium and electronic device |
| CN115081025A (en) * | 2022-08-19 | 2022-09-20 | 湖南华菱电子商务有限公司 | Sensitive data management method and device based on digital middlebox and electronic equipment |
| CN115375146A (en) * | 2022-08-24 | 2022-11-22 | 中建安装集团有限公司 | Digital construction integrated platform |
| CN116302433A (en) * | 2023-03-24 | 2023-06-23 | 中国工商银行股份有限公司 | Data processing method, device, computer equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 吴俊亮;彭勤;邹斌;张洪彬;: "智能轨道快运系统综合运营一体化平台研究", 控制与信息技术, no. 01, 5 February 2020 (2020-02-05), pages 71 - 76 * |
| 李厚恩;黄安子;张云翔;余里程;: "基于数字化运营体系的企业级运营监控平台设计与实现", 现代信息科技, no. 02, 25 January 2020 (2020-01-25), pages 178 - 180 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116796206B (en) | 2024-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11995438B2 (en) | System and method for software architecture redesign | |
| US8326982B2 (en) | Method and apparatus for extracting and visualizing execution patterns from web services | |
| Dani et al. | A methodology for best practice knowledge management | |
| CN114021970A (en) | Enterprise data asset model construction method based on data middlebox | |
| CN112651218A (en) | Automatic generation method and management method of bidding document, medium and computer | |
| CN102411540A (en) | Automatic management system of workflow-based common software testing process | |
| CN111652468A (en) | Business process generation method and device, storage medium and computer equipment | |
| CN115983809B (en) | Enterprise office management method and system based on intelligent portal platform | |
| Meyer et al. | A Reference Process Model for Usage Data-Driven Product Planning | |
| CN116796206B (en) | Operation data processing method and system based on integrated platform | |
| CN113205808A (en) | AI (Artificial intelligence) consultation based cloud computing building method and system | |
| CN112765014A (en) | Automatic test system for multi-user simultaneous operation and working method | |
| CN109669777B (en) | Industrial internet big data element demand service providing method and system | |
| US20080300950A1 (en) | Chronicling for Process Discovery in Model Driven Business Transformation | |
| CN110262973B (en) | Data maintenance method, device, equipment and computer storage medium | |
| CN113610225A (en) | Quality evaluation model training method and device, electronic equipment and storage medium | |
| Keller et al. | Modelling collaborative processes for Virtual Organisations in the building industry | |
| CN112488658A (en) | Task portrait construction algorithm, device, terminal and storage medium for digital human resource management | |
| Berlas | A Review Report on Requirements Analysis with Data Mining | |
| CN111680918A (en) | Intelligent manufacturing service flow determining method and system | |
| CN110399337A (en) | File automating method of servicing and system based on data-driven | |
| CN113282561B (en) | Link generation method and device | |
| CN118569820A (en) | Collaborative optimization management method and system for supply chain departments | |
| Estrada et al. | Using a goal-refinement tree to obtain and refine organizational requirements | |
| CN113626428A (en) | Server bill of material modularization customization method, system, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |