CN112199449B - Data processing system - Google Patents

Data processing system Download PDF

Info

Publication number
CN112199449B
CN112199449B CN202011007467.0A CN202011007467A CN112199449B CN 112199449 B CN112199449 B CN 112199449B CN 202011007467 A CN202011007467 A CN 202011007467A CN 112199449 B CN112199449 B CN 112199449B
Authority
CN
China
Prior art keywords
data
cycle
component information
value
result data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011007467.0A
Other languages
Chinese (zh)
Other versions
CN112199449A (en
Inventor
安嘉晨
梁丹璐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu xichip Financial Technology Co.,Ltd.
Original Assignee
Fofinvesting Technology Beijing Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fofinvesting Technology Beijing Co ltd filed Critical Fofinvesting Technology Beijing Co ltd
Priority to CN202011007467.0A priority Critical patent/CN112199449B/en
Publication of CN112199449A publication Critical patent/CN112199449A/en
Application granted granted Critical
Publication of CN112199449B publication Critical patent/CN112199449B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to a data processing system comprising a database, a processor and a memory storing a computer program which, when executed by the processor, performs the steps of: acquiring cycle result data from the n-M cycle to the n cycle and preset M +1 pieces of data component information corresponding to each cycle result data from the database, wherein the M +1 pieces of data component information comprise M pieces of first data component information and 1 piece of second data component information; inputting the cycle result data from the n-M cycle to the n cycle and M +1 pieces of data component information corresponding to each preset cycle result data into a pre-trained data processing model for processing; and the data processing model outputs the ratio of each data component information corresponding to the cycle result data of the nth cycle. The method can accurately and quickly acquire the proportion of the random data component in each continuous period corresponding to the periodic result data based on the periodic result data.

Description

Data processing system
Technical Field
The invention relates to the technical field of data processing, in particular to a data processing system.
Background
The field of data processing is an important branch of the computer field. In the field of computers, data may include a variety of text data, image data, audio data, video data, and the like, depending on the manner of presentation; depending on the manner of storage, the data may be stored to a database, text file, a file of a particular format (e.g.,. doc/. xls), etc.; depending on the manner in which the data is formed, static data and dynamic data, particularly data that changes over time, such as temperature data acquired by a temperature sensor, network traffic data acquired by a network device such as a router switch, device LBS data acquired by GPS or beidou, or the like, may be included. The data processing may be "forward processing", such as processing the image with an algorithm to make it clearer, or "reverse processing", such as separating the plurality of original images used by the composite image by a computer program given the clarity of the composite image.
"reverse processing" of static data is relatively easy. However, because most of the dynamic data is data that changes with time (especially data that changes with time at a high frequency), the influence of the time dimension on the association relationship needs to be considered, which not only occupies more computer storage resources, retrieval resources, and calculation processing resources, but also has unsatisfactory processing accuracy, and therefore, how to efficiently obtain the association relationship of the dynamic data through the "reverse processing" of the data becomes a difficulty in data processing.
In addition, due to the influence of time, how to better complete the visual presentation of the dynamic data association relationship also becomes a technical problem to be overcome by the invention.
Disclosure of Invention
The invention aims to provide a data processing system which can accurately and quickly acquire the proportion of random data components in each continuous period corresponding to periodic result data based on the periodic result data.
The invention provides a data processing system comprising a database, a processor and a memory storing a computer program which, when executed by the processor, performs the steps of:
acquiring cycle result data from an n-M cycle to an n cycle from the database and preset M +1 pieces of data component information corresponding to each cycle result data, wherein the M +1 pieces of data component information comprise M pieces of first data component information and 1 piece of second data component information, the data component information is continuous cycle random data, n, M and M are positive integers, and n is greater than or equal to M;
inputting the cycle result data from the n-M cycle to the n cycle and M +1 pieces of data component information corresponding to each preset cycle result data into a pre-trained data processing model for processing;
and the data processing model outputs the ratio of each data component information corresponding to the cycle result data of the nth cycle.
Compared with the prior art, the invention has obvious advantages and beneficial effects. By means of the technical scheme, the data processing system provided by the invention can achieve considerable technical progress and practicability, has wide industrial utilization value and at least has the following advantages:
the method can accurately and quickly acquire the proportion of the random data component of each continuous period corresponding to the period result data based on the period result data, and provides support for evaluation or further prediction based on the period result data.
The foregoing description is only an overview of the technical solutions of the present invention, and in order to make the technical means of the present invention more clearly understood, the present invention may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present invention more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Drawings
FIG. 1 is a schematic diagram of a data processing system according to an embodiment of the present invention;
fig. 2 is a flowchart of a process of executing, by the data processing system according to the embodiment of the present invention, a ratio value process of obtaining each data component information corresponding to cycle result data of an nth cycle;
FIG. 3 is a flowchart illustrating an embodiment of selecting M first data component information;
FIG. 4 is a rolling stacked graph intent of a data processing system based on multiple cycles of data component information display provided by an embodiment of the present invention;
fig. 5 is a schematic diagram of a scrolling stacked graph according to an embodiment of the present invention, which is intended to dynamically display a numerical value.
[ notation ] to show
11: the database 12: processor with a memory having a plurality of memory cells
13: the memory 14: information interaction interface
Detailed Description
To further illustrate the technical means and effects of the present invention adopted to achieve the predetermined objects, the following detailed description of a data processing system and its effects according to the present invention will be provided with reference to the accompanying drawings and preferred embodiments.
An embodiment of the present invention provides a data processing system, as shown in fig. 1, including a database 11, a processor 12 and a memory 13 storing a computer program, where when the computer program is executed by the processor 12, the following steps are implemented, as shown in fig. 2:
step S1, obtaining cycle result data from the nth cycle to the nth cycle from the database 11 and M +1 pieces of data component information corresponding to each preset cycle result data, where the M +1 pieces of data component information include M pieces of first data component information and 1 piece of second data component information;
wherein the database 11 comprises a first data table (table) and a second data table.
Each record of the first data table is cycle result data, the cycle result data may be sampling data, and a field (field) of the first data table includes a result data ID, X time-sampling value pairs, a cycle identifier, M first data indexes, and 1 second data index. Wherein, X is the fixed sampling times in the sampling period, and the period identifier is determined according to the time range formed by the earliest time and the latest time in X time-sampling value pairs.
The fields of the second data table include a random data identification, a random data sample time, and a random data sample value.
As an example, the step S1 further includes:
step S11, receiving the n-m period to n period input by the user;
step S12, retrieving the cycle identifier of the first data table according to the ith cycle, and obtaining the sample values in the corresponding X time-sample value pairs, and M first data indexes and 1 second data index, where i is n-M, n-M +1 … n;
step S13, acquiring cycle result data of the ith cycle according to the sampling values in the X time-sampling value pairs;
the period result data may be a mean value, a median value, a maximum value, a minimum value, a last time sample value, a first time sample value, and the like of the X time sample values, wherein the mean value may be a weighted average value, and preferably, the period result data is a weighted average value of the X time sample values.
Step S14, retrieving in the random data sampling time of the second data table according to the ith period, retrieving in the random data identifier of the second data table according to M first data indexes and 1 second data index, and acquiring M groups of first random data sampling values and 1 group of second random data sampling values;
step S15, obtaining M pieces of first data component information and 1 piece of second data component information according to M sets of first random data sample values and 1 set of second random data sample values.
Each group of data component information can be the mean value, median, maximum value, minimum value, last time sampling value, first time sampling value and the like of the corresponding random data sampling value, wherein the mean value can be a weighted mean value, and preferably, each group of data component information is the weighted mean value of the corresponding random data sampling value.
The data component information is continuous periodic random data, wherein n, M and M are positive integers, n is larger than or equal to M, the periodic result data refers to result data corresponding to each period, and each data component takes one value in the period as the corresponding data component information of the periodic result data.
Step S2, inputting the cycle result data from the n-M cycle to the n cycle and M +1 pieces of preset data component information corresponding to each cycle result data into a pre-trained data processing model for processing;
the period result data corresponds to a plurality of pieces of first data component information, and the preset M pieces of first data component information are M pieces of first data component information selected from the plurality of pieces of first data component information.
Step S3, the data processing model outputs a ratio of each data component information corresponding to the cycle result data of the nth cycle.
As an example, the field of the first data table further includes first weights of M first data components, and the M first weights are filled with the duty value in S3.
The steps S1 to S3 can accurately and quickly predict the ratio of each data component information corresponding to the result data of the current cycle based on the historical cycle data and the current cycle data and the data processing model, and provide support for evaluation or further prediction based on the cycle result data.
The number of the consecutive data component information corresponding to the period result data is extremely huge, and may be thousands, but only a small amount of the first data component information in the thousands plays a great role in the period result data, and the part of data can become data with interpretation degree on the period result data. The rest of the first data component information only plays a small role in the cycle result data and can be almost ignored, the part of the data can be data without interpretation degree on the cycle result data, if all the first data component information is used in the process of constructing the data processing model and predicting the occupation ratio value, the calculation amount is greatly increased, so that a large amount of memory is occupied, most of the calculation is operation without effect on the occupation ratio value prediction result, the cost is wasted, and therefore before the proportion of each continuous cycle random data component corresponding to the cycle result data needs to be acquired, the data component with interpretation degree on the result data needs to be selected. As an example, the system further implements the following steps when the computer program is executed by the processor 12:
step S10, selecting M pieces of first data component information having interpretations of the period result data from all pieces of first data component information, as shown in fig. 3, specifically including:
step S101, obtaining periodic result data and all first data component information corresponding to the periodic result data from the database;
the detailed steps of how to obtain the cycle result data and the first data component information from the database are described in detail in steps S11-S15, and are not described herein again.
Step S102, performing regression on the cycle result data and all first data component information corresponding to the cycle result data to obtain marginal goodness of fit corresponding to each first data component information, wherein the marginal goodness of fit corresponding to the first data component information refers to goodness of fit increment of the whole regression process after the first data component information is added into the regression;
step S103, the marginal goodness of fit corresponding to all the first data component information is sorted from big to small, and the first M pieces of first data component information are selected from the marginal goodness of fit, wherein M is a preset number.
As an example, in step S102, the performing regression based on the cycle result data and all the first data component information corresponding to the cycle result data to obtain the marginal goodness of fit corresponding to each of the first data component information includes the following steps:
step S1021, acquiring first correlations of each piece of first data component information and periodic result data one by one, determining first data component information F1 with the maximum absolute value of the first correlations, performing regression operation on the F1 based on the periodic result data to obtain a goodness of fit R1 and a first residual sequence Y1, and determining the marginal goodness of fit corresponding to F1 as R1;
step S1022, acquiring second correlations of all the first data component information except F1 and Y1 one by one, determining first data component information F2 with the maximum absolute value of the second correlation, performing regression operation on F1 and F2 based on the cycle result data to obtain a goodness of fit R2 and a second residual sequence Y2, and determining the marginal goodness of fit corresponding to F2 as R2-R1;
step S1023, acquiring third correlations of Y2 and all other first data component information except F1 and F2 one by one, determining first data component information F3 with the maximum absolute value of the third correlation, performing regression operation on F1, F2 and F3 based on the cycle result data to obtain a goodness of fit R3 and a second residual sequence Y3, and determining the marginal goodness of fit corresponding to F3 as R3-R2;
and step S1024, circularly executing the processes according to the rule until the marginal goodness of fit corresponding to all the first data component information is obtained.
Wherein the regression may be a linear regression operation.
As an example, in step S103, sorting the marginal goodness of fit corresponding to all the first data component information in descending order, and selecting the first M first data component information from the marginal goodness of fit, includes:
step S1031, obtaining the sum Wq of the previous Q marginal goodness-of-fit values one by one, where Q is 1,2,3 … Q, and Q is the total number of the first data component information;
step S1032, comparing Wq with a preset goodness-of-fit threshold, and when Wq is greater than the preset goodness-of-fit threshold, taking M as q, and selecting the first M pieces of first data component information.
The goodness-of-fit threshold is set according to factors such as a specific application scenario and calculation accuracy, but it can be understood that the first M pieces of first data component information are selected to be data having explanatory power on the cycle result data, and the first M pieces of second data component information have negligible effect on the cycle result data.
As an example, in the data selecting process, some application scenarios may directly determine the amount of the first data component information to be selected, and therefore, the method may further include step S104, receiving a user input M value through the information interaction interface, and setting M to the preset amount.
The data processing efficiency and accuracy of the data processing system can be further improved by accurately and quickly selecting first data component information with interpretability of periodic result data from massive continuous periodic random data components.
As an example, the system further implements the following steps when the computer program is executed by the processor 12:
step S20, establishing the data processing model, wherein the step S20 specifically comprises the following steps:
step S201, obtaining a plurality of period result data and M +1 data component information corresponding to the period result data as a training set, training a model based on the training set and a preset ratio condition:
Figure GDA0003167233660000071
wherein y represents cycle result data, xiRepresenting the ith first data component information, betaiDenotes xiRatio of (a) xbRepresenting second data component information, betabDenotes xbAlpha represents a first parameter item, epsilon represents a second parameter item;
step S202, establishing a ratio beta corresponding to each data component information corresponding to the cycle result data of the nth cycle and the cycle result data of the nth cycle by taking the cycle result data of the nth cycle and the preset M +1 data component information corresponding to each cycle result data as inputi、βbThe model is processed for the output data.
As shown in fig. 1, the system further includes an information interaction interface 14, configured to receive a set ratio value condition instruction input by a user, and set the preset ratio value condition according to the set ratio value condition instruction input by the user. Specifically, the preset ratio condition is betai≥0,
Figure GDA0003167233660000072
Wherein beta isbmaxIs a preset betabThe user-entered set fraction value conditional instruction may include betabmaxSpecific values of (e.g.. beta.)bmax40 percent can be obtained.
As an example, the information interaction interface 14 is further configured to display, according to a preset display rule, a ratio value corresponding to each data component information corresponding to cycle result data of an m-th cycle to an N-th cycle, and specifically includes:
s301, establishing a coordinate graph with the abscissa as time and the ordinate as a ratio;
step S302, inputting cycle result data from 0 th cycle to M th cycle and preset M +1 pieces of data component information corresponding to each cycle result data into the data processing model, outputting a proportion value of each piece of data component information corresponding to the cycle result data of the M th cycle, and generating an M-th cross-section point diagram on the coordinate graph based on the time value of the M-th cycle and the proportion value of each piece of data component information;
step S303, inputting cycle result data from a first cycle to an M +1 th cycle and preset M +1 data component information corresponding to each cycle result data into the data processing model, outputting a ratio value of each data component information corresponding to the cycle result data of the M +1 th cycle, and generating an M +1 th cross-section point diagram on the coordinate graph based on the time value of the M +1 th cycle and the ratio value of each corresponding data component information;
… … (… … represents execution in accordance with the above rules)
Step S304, inputting cycle result data from the (N-M) th cycle to the (N) th cycle and preset M +1 pieces of data component information corresponding to each cycle result data into the data processing model, outputting a proportion value of each piece of data component information corresponding to the cycle result data of the Nth cycle, and generating an N-th section point diagram on the coordinate diagram based on the time value of the Nth cycle and the proportion value of each piece of data component information;
and S305, respectively connecting the ratio values of the data component information corresponding to all the obtained cross-section point diagrams in series, filling the gaps between the adjacent lines with colors, and obtaining a rolling stacking diagram for displaying.
When the abscissa is the same, the cross-sectional point map is formed by corresponding points on the plurality of ordinates. Taking M6 as an example, one abscissa point will correspond to 7 fraction values, and each period corresponds to one time value on the abscissa and 7 fraction values on the ordinate, as shown in fig. 4 for example. The fluctuation condition of each data component information along with the periodic variation can be visually displayed on the basis of the rolling stack diagram.
As an example, the information interaction interface is further configured to, when receiving a click display instruction on the scrolling stacked graph, obtain a numerical value of each ordinate data point on an abscissa corresponding to a click point, and display the numerical value, where the abscissa corresponds to a period of 2020-7-22, and the displayed numerical value of each ordinate data point is as shown in fig. 5.
As another example of a dynamic display, the system, when the computer program is executed by the processor 12, further implements the steps of:
step S401, acquiring a difference value of the ratio value of each data component information corresponding to the period result data of two continuous periods based on the rolling stacking chart;
and S402, when the preset fluctuation threshold value is exceeded, dynamically displaying the ratio of the data component information on the rolling stack diagram by the information interaction interface.
Wherein the fluctuation threshold may be set according to specific data processing requirements, for example, the fluctuation threshold is set to 3%.
The system can also verify the established data processing model, and further improves the processing accuracy of the data processing model. For example, in the system, when the computer program is executed by the processor 12, the following steps are also implemented:
step S50, checking the data processing model, wherein the step S50 specifically comprises:
step S501, acquiring a ratio value of each data component information corresponding to the periodic result data of two continuous periods through the data processing model;
step S502, determining the difference of the ratio of each data component information of two continuous periods to obtain the variation state of each component information;
step S503, comparing the variation state of each component information with the actual variation state of each component information, if the variation states of each component information are consistent, the data processing model passes the inspection, otherwise, acquiring a new training set to retrain the data processing model.
As an example, the data component fluctuates in each period of time, the value of the data component information is a preset weighted average value of the data component in the period, it should be noted that the preset weighted average value is directly generated in each period, and data can be directly obtained without performing calculation, so that the calculation efficiency can be further improved. Further, the data component may be data with daily frequency fluctuation within a preset fluctuation range, for example, data with daily frequency fluctuation within ± 10%.
Although the present invention has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. A data processing system is characterized by comprising a database, a processor and a memory stored with a computer program, wherein the database comprises a first data table and a second data table, each record of the first data table is period result data, the period result data is sampling data, and a field of the first data table comprises a result data ID, X time-sampling value pairs, a period identifier, M first data indexes and 1 second data index, wherein X is the fixed sampling times in a sampling period; fields of the second data table comprise random data identification, random data sampling time and random data sampling values;
when executed by a processor, the computer program implementing the steps of:
step S1, obtaining cycle result data from the n-M cycle to the n cycle from the database and M +1 pieces of preset data component information corresponding to each cycle result data, wherein the M +1 pieces of data component information include M pieces of first data component information and 1 piece of second data component information, the data component information is continuous cycle random data, n, M and M are positive integers, and n is greater than or equal to M;
the step S1 includes:
step S11, receiving the n-m period to n period input by the user;
step S12, retrieving the cycle identifier of the first data table according to the ith cycle, and obtaining the sample values in the corresponding X time-sample value pairs, and M first data indexes and 1 second data index, where i is n-M, n-M +1 … n;
step S13, acquiring cycle result data of the ith cycle according to the sampling values in the X time-sampling value pairs;
step S14, retrieving in the random data sampling time of the second data table according to the ith period, retrieving in the random data identifier of the second data table according to M first data indexes and 1 second data index, and acquiring M groups of first random data sampling values and 1 group of second random data sampling values;
step S15, obtaining M pieces of first data component information and 1 piece of second data component information according to M sets of first random data sample values and 1 set of second random data sample values;
step S2, inputting the cycle result data from the n-M cycle to the n cycle and M +1 pieces of preset data component information corresponding to each cycle result data into a pre-trained data processing model for processing;
step S3, the data processing model outputs the ratio value of each data component information corresponding to the cycle result data of the nth cycle;
wherein the fields of the first data table further include first weights of M first data components, the M first weights being populated with the fractional values in step S3.
2. The data processing system of claim 1,
when executed by a processor, further performs the steps of:
step S20, establishing the data processing model, specifically including the following steps:
step S201, obtaining a plurality of period result data and M +1 data component information corresponding to the period result data as a training set, training a model based on the training set and a preset ratio condition:
Figure FDA0003167233650000021
wherein y represents cycle result data, xiRepresenting the ith first data component information, betaiDenotes xiThe ratio of (a) to (b),xbrepresenting second data component information, betabDenotes xbAlpha represents a first parameter item, epsilon represents a second parameter item;
step S202, establishing a ratio beta corresponding to each data component information corresponding to the cycle result data of the nth cycle and the cycle result data of the nth cycle by taking the cycle result data of the nth cycle and the preset M +1 data component information corresponding to each cycle result data as inputi、βbThe model is processed for the output data.
3. The data processing system of claim 2,
the system also comprises an information interaction interface which is used for receiving a set ratio value condition instruction input by a user and setting the preset ratio value condition according to the set ratio value condition instruction input by the user.
4. The data processing system of claim 3,
the preset ratio condition is betai≥0,
Figure FDA0003167233650000022
Wherein beta isbmaxIs a preset betabIs measured.
5. The data processing system of claim 3,
the information interaction interface is further configured to display, according to a preset display rule, a proportion value corresponding to each data component information corresponding to cycle result data of the mth cycle to the nth cycle, and specifically includes:
s301, establishing a coordinate graph with the abscissa as time and the ordinate as a ratio;
step S302, inputting cycle result data from 0 th cycle to M th cycle and preset M +1 pieces of data component information corresponding to each cycle result data into the data processing model, outputting a proportion value of each piece of data component information corresponding to the cycle result data of the M th cycle, and generating an M-th cross-section point diagram on the coordinate graph based on the time value of the M-th cycle and the proportion value of each piece of data component information;
step S303, inputting cycle result data from a first cycle to an M +1 th cycle and preset M +1 data component information corresponding to each cycle result data into the data processing model, outputting a ratio value of each data component information corresponding to the cycle result data of the M +1 th cycle, and generating an M +1 th cross-section point diagram on the coordinate graph based on the time value of the M +1 th cycle and the ratio value of each corresponding data component information;
executing according to the rule of the step S302 and the step S303, and sequentially generating an m +2 th cross-section point diagram, an m +3 th cross-section point diagram and an … (an N-1 st interface point diagram);
step S304, inputting cycle result data from the (N-M) th cycle to the (N) th cycle and preset M +1 pieces of data component information corresponding to each cycle result data into the data processing model, outputting a proportion value of each piece of data component information corresponding to the cycle result data of the Nth cycle, and generating an N-th section point diagram on the coordinate diagram based on the time value of the Nth cycle and the proportion value of each piece of data component information;
and S305, respectively connecting the ratio values of the data component information corresponding to all the obtained cross-section point diagrams in series, filling the gaps between the adjacent lines with colors, and obtaining a rolling stacking diagram for displaying.
6. The data processing system of claim 5,
and the information interaction boundary is further used for acquiring the numerical value of each ordinate data point under the abscissa corresponding to the clicking position for displaying when a clicking display instruction on the rolling stack graph is received.
7. The data processing system of claim 5,
when executed by a processor, further performs the steps of:
step S401, acquiring a difference value of the ratio value of each data component information corresponding to the period result data of two continuous periods based on the rolling stacking chart;
and S402, when the preset fluctuation threshold value is exceeded, dynamically displaying the ratio of the data component information on the rolling stack diagram by the information interaction interface.
8. The data processing system of claim 1,
when executed by a processor, further performs the steps of:
step S50, verifying the data processing model, specifically including:
step S501, acquiring a ratio value of each data component information corresponding to the periodic result data of two continuous periods through the data processing model;
step S502, determining the difference of the ratio of each data component information of two continuous periods to obtain the variation state of each component information;
step S503, comparing the variation state of each component information with the actual variation state of each component information, if the variation states of each component information are consistent, the data processing model passes the inspection, otherwise, acquiring a new training set to retrain the data processing model.
9. The data processing system of claim 1,
the period result data is the average value, the median, the maximum value, the minimum value, the last time sampling value or the first time sampling value of the X time-sampling values;
each group of data component information is the mean value, median, maximum value, minimum value, last time sampling value or first time sampling value of the corresponding random data sampling value.
10. The data processing system of claim 9,
the data component may be data whose daily frequency fluctuation is within a preset fluctuation range.
CN202011007467.0A 2020-09-23 2020-09-23 Data processing system Active CN112199449B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011007467.0A CN112199449B (en) 2020-09-23 2020-09-23 Data processing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011007467.0A CN112199449B (en) 2020-09-23 2020-09-23 Data processing system

Publications (2)

Publication Number Publication Date
CN112199449A CN112199449A (en) 2021-01-08
CN112199449B true CN112199449B (en) 2021-09-14

Family

ID=74016050

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011007467.0A Active CN112199449B (en) 2020-09-23 2020-09-23 Data processing system

Country Status (1)

Country Link
CN (1) CN112199449B (en)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102915346B (en) * 2012-09-26 2015-07-01 中国科学院软件研究所 Data index building and query method for Internet of Things intellisense
US9959248B1 (en) * 2015-02-28 2018-05-01 Cloud & Stream Gears Llc Iterative simple linear regression coefficient calculation for big data using components
US10417111B2 (en) * 2016-05-09 2019-09-17 Oracle International Corporation Correlation of stack segment intensity in emergent relationships
CN110147388A (en) * 2017-09-29 2019-08-20 华为技术有限公司 A kind of method and device of data processing
CN111311321B (en) * 2020-02-14 2021-11-02 北京百度网讯科技有限公司 User consumption behavior prediction model training method, device, equipment and storage medium
CN111372286B (en) * 2020-03-03 2023-06-23 浙江每日互动网络科技股份有限公司 Mobile terminal data processing method, medium and electronic equipment
CN111611251B (en) * 2020-04-24 2021-06-29 华智众创(北京)投资管理有限责任公司 Data processing system

Also Published As

Publication number Publication date
CN112199449A (en) 2021-01-08

Similar Documents

Publication Publication Date Title
Gobet et al. Multivariate Cutoff Level Analysis (MultiCoLA) of large community data sets
Tocher et al. The automatic programming of simulations
US20100325134A1 (en) Accuracy measurement of database search algorithms
US20210182680A1 (en) Processing sequential interaction data
Zhang et al. CPU load predictions on the computational grid
US9977818B2 (en) Local extrema based data sampling system
EP3912099A1 (en) Compound model scaling for neural networks
Wu et al. Exploring the critical pillars and causal relations within the NRI: An innovative approach
CN112199449B (en) Data processing system
CN112181982B (en) Data selection method, electronic device, and medium
Zoun et al. Interactive chord visualization for metaproteomics
US20180067938A1 (en) Method and system for determining a measure of overlap between data entries
CN112463334A (en) Training task queuing reason analysis method, system, equipment and medium
CN112100177A (en) Data storage method and device, computer equipment and storage medium
Lin et al. Sequencing single machine multiple-class customer order jobs using heuristics and improved simulated annealing algorithms
CN111784069B (en) User preference prediction method, device, equipment and storage medium
CN113177613A (en) System resource data distribution method and device
CN113780666A (en) Missing value prediction method and device and readable storage medium
CN115796984A (en) Training method of item recommendation model, storage medium and related equipment
Canovas et al. Permutations and time series analysis
CN112286933B (en) Data processing system
CN112035232B (en) Job operation priority determining method and related equipment
Bai et al. New heuristics for flow shop problem to minimize makespan
Chen et al. Urban Talent Demand Analysis Based on Deep Learning and Wavelet Threshold Denoising
CN112286932B (en) Data processing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20211223

Address after: 610095 No. 0306, block B, No. 1677, north section of Tianfu Avenue, Chengdu hi tech Zone, Chengdu pilot Free Trade Zone, Sichuan Province

Patentee after: Chengdu xichip Financial Technology Co.,Ltd.

Address before: 100020 19th floor, Guoan building, 1 guandongdian North Street, Chaoyang District, Beijing

Patentee before: FOFINVESTING TECHNOLOGY (BEIJING) CO.,LTD.