CN114238452A - House maintenance resource data processing method and device and computer equipment - Google Patents

House maintenance resource data processing method and device and computer equipment Download PDF

Info

Publication number
CN114238452A
CN114238452A CN202111376599.5A CN202111376599A CN114238452A CN 114238452 A CN114238452 A CN 114238452A CN 202111376599 A CN202111376599 A CN 202111376599A CN 114238452 A CN114238452 A CN 114238452A
Authority
CN
China
Prior art keywords
target
increment
full
data
index
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111376599.5A
Other languages
Chinese (zh)
Inventor
杜培辉
陈颢
林润杰
韦珺瀚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Construction Bank Corp
Original Assignee
China Construction Bank Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Construction Bank Corp filed Critical China Construction Bank Corp
Priority to CN202111376599.5A priority Critical patent/CN114238452A/en
Publication of CN114238452A publication Critical patent/CN114238452A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/248Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/904Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/20Administration of product repair or maintenance

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Computational Linguistics (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The application relates to a house maintenance resource data processing method and device, computer equipment and a storage medium. The method comprises the following steps: and screening the incremental standard data matched with the plurality of service index numbers from the incremental unloading files related to the house maintenance resources. And dividing the time period of the increment standard data according to the unloading period to obtain a plurality of increment sub-time periods. And determining a target increment mechanism included in the increment standard data, and generating a plurality of target increment index tasks based on the target increment mechanism and the increment sub-time period. And executing each target increment index task to perform summarizing processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to the house maintenance resources. Therefore, based on the increment data table carrying the time dimension and the mechanism dimension, the response speed can be greatly improved.

Description

House maintenance resource data processing method and device and computer equipment
Technical Field
The present application relates to the field of big data analysis technologies, and in particular, to a house maintenance resource data processing method, apparatus, computer device, and storage medium.
Background
With the continuous development of urbanization, the house in the aging period needs to be repaired. In the house maintenance process, resource data related to house maintenance resource data in the house maintenance resource business system needs to be analyzed and processed.
In the related art, the house maintenance resource service system only supports resource data of a single-center dimension, and cannot rapidly extract and display the resource data of a multi-level mechanism. Therefore, developers must be familiar with various maintenance resource business rules, source table design and table relationships to obtain resource data of a multilevel mechanism and perform subsequent development work, and the problem of low response speed to various data visualization requirements and report requirements exists.
Disclosure of Invention
In view of the above, it is necessary to provide a house repair resource data processing method, apparatus, computer device and storage medium for solving the above technical problems.
A method of house repair resource data processing, the method comprising:
acquiring an incremental unloading file related to house maintenance resources;
screening out increment standard data matched with a plurality of service index numbers from the increment unloading file;
dividing the time period of the incremental standard data according to the unloading period to obtain a plurality of incremental sub-time periods;
determining a target increment mechanism included in the increment standard data, and generating a plurality of target increment index tasks based on the target increment mechanism and the increment sub-time period;
and executing each target increment index task to perform summarizing processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to the house maintenance resources.
A premise repair resource data processing apparatus, the apparatus comprising:
the acquisition module is used for acquiring an incremental unloading file related to house maintenance resources;
the screening module is used for screening the increment standard data matched with the service index numbers from the increment unloading file;
the determining module is used for dividing the time period of the increment standard data according to the unloading period to obtain a plurality of increment sub-time periods;
the generating module is used for determining a target increment mechanism included in the increment standard data and generating a plurality of target increment index tasks based on the target increment mechanism and the increment sub-time period;
and the execution module is used for executing each target increment index task so as to summarize the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to the house maintenance resources.
A computer apparatus comprising a memory storing a computer program and a processor implementing any of the above house repair resource data processing methods when the processor executes the computer program.
A computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements any of the above-described house repair resource data processing methods.
The house maintenance resource data processing method, the house maintenance resource data processing device, the computer equipment and the storage medium acquire the incremental unloading file related to the house maintenance resources. And screening the increment standard data matched with the plurality of service index numbers from the increment unloading file. And dividing the time period of the increment standard data according to the unloading period to obtain a plurality of increment sub-time periods. And determining a target increment mechanism included in the increment standard data, and generating a plurality of target increment index tasks based on the target increment mechanism and the increment sub-time period. And executing each target increment index task to perform summarizing processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to the house maintenance resources. Therefore, in the process of actual development of developers, based on the incremental data table carrying the time dimension and the mechanism dimension, data corresponding to actual development requirements can be responded quickly, and the data can be displayed and visualized from the mechanism dimension and the time dimension accurately. Therefore, based on the incremental data table carrying the time dimension and the mechanism dimension, the actual development requirements of developers can be quickly and accurately responded, and the response speed is greatly improved.
Drawings
FIG. 1 is a diagram of an exemplary implementation of a data processing method for a house repair resource;
FIG. 2 is a schematic flow chart diagram illustrating a method for processing data of a house repair resource in one embodiment;
FIG. 3 is a flowchart illustrating the steps for obtaining an incremental data table of a house repair resource in one embodiment;
FIG. 4 is a flowchart illustrating the steps for obtaining a full data table of house repair resources in one embodiment;
FIG. 5 is a flowchart illustrating the steps of obtaining a target data table in one embodiment;
FIG. 6 is a flowchart illustrating the steps for obtaining an incremental data table of a house repair resource in another embodiment;
FIG. 7 is a flowchart illustrating the steps for obtaining a full size data table of house repair resources in another embodiment;
FIG. 8 is a block diagram showing the construction of a house repair resource data processing apparatus according to an embodiment;
FIG. 9 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The house maintenance resource data processing method provided by the application can be applied to the application environment shown in fig. 1. Wherein the terminal 102 communicates with the server 104 via a network. The terminal 102 and the server 104 may be used individually to perform the house repair resource data processing method in the present application. The house repair resource data processing method in the present application is executed by the server 104 alone. The house repair resource data processing method in the present application is described as being performed by the server 104 alone. Server 104 obtains an incremental unload file associated with the house repair resource. The server 104 screens out the increment standard data matched with the service index numbers from the increment unloading file. The server 104 divides the time period of the incremental standard data according to the unloading period to obtain a plurality of incremental sub-time periods. The server 104 determines a target increment mechanism included in the increment criterion data, and generates a plurality of target increment index tasks based on the target increment mechanism and the increment sub-period. The server 104 executes each target increment index task to perform summary processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to the house maintenance resources. The terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the server 104 may be implemented by an independent server or a server cluster formed by a plurality of servers.
In one embodiment, as shown in fig. 2, a house repair resource data processing method is provided, which is described by taking an example of the method applied to a computer device, and the computer device may specifically be a terminal or a server in fig. 1. The house maintenance resource data processing method comprises the following steps:
step S202, an incremental unloading file related to house maintenance resources is obtained.
Wherein the house maintenance resource is a house maintenance fund. The unloading is the process of unloading data from one system to another system, and the unloading file is generated according to the data standard in the data sheet of the special maintenance fund management basic information of the residence. The incremental unloading file is generated by unloading the newly added business data every day according to the data specifications in the basic information data sheet of the special maintenance fund management of the residence.
Specifically, a computer device obtains an incremental unload number file associated with a house repair resource. The increment unloading file is generated by unloading the newly added service data in the system every day according to the data specification.
And step S204, screening out the increment standard data matched with the service index numbers from the increment unloading file.
The incremental standard data includes service information related to the house maintenance resource data, such as organization number, service time, and data update time. The service index number is used for representing information of each service of the house maintenance resource data, such as first payment information and subsequent payment information corresponding to the payment service.
Specifically, the computer device obtains an index information table from a database, and determines a plurality of service index numbers from the index information table. And the computer equipment screens the incremental standard data matched with the plurality of service index numbers from the incremental unloading file according to the service information carried by the incremental standard data in the incremental unloading file.
For example, the computer device obtains an incremental unloading file related to the house maintenance resource, and after checking, converting and loading the incremental unloading file, obtains incremental standard data related to the house maintenance resource. The computer equipment determines a plurality of service index numbers from the index information table based on the index information table in the database, and screens the incremental standard data matched with the service index numbers from the incremental standard data obtained from the unloading file.
The index information table is a table in a database MySQL, and is used for describing index parameters related to the same properties and classified by values in the index. The index value is business data related to the maintenance resources. The database also stores an index classification table (the index classification information table contains classification names and classification code descriptions), an index data table (a daily table, a monthly table, a seasonal table, a semiannual table, and a monthly table), an organization information table, a central task control table, and a central task-history table. The function of which is shown in table 1.
Table 1 database table
Figure BDA0003364127260000051
The contents contained in the index information table are shown in table 2:
TABLE 2 index information Table
Index number Data type
Index classification char (1) (fixed length character type)
First order classification VARchar (32) (variable length character type)
Two stage classification VARchar (32) (variable length character type)
Three-level classification VARchar (32) (variable length character type)
Source of index VARchar (32) (variable length character type)
Index statistical method VARchar (32) (variable length character type)
Index name VARchar (128) (variable length character type)
Index statistics control bits VARchar (32) (variable length character type)
Description of the index VARchar (128) (variable length character type)
Index type mark char (1) (fixed length character type)
Whether the index is an end-of-term state value char (1) (fixed length character type)
Classification number VARchar (32) (variable length character type)
Step S206, dividing the time period of the increment standard data according to the unloading period to obtain a plurality of increment sub-time periods.
The unloading period is the unloading time specified by each service, namely the data of the service is unloaded from one system to another system within the specified unloading time.
Specifically, the computer device determines a time period corresponding to each incremental standard data based on the service time corresponding to each incremental standard data. The computer equipment divides the time period of the increment standard data based on the unloading period to obtain a plurality of increment sub-time periods, wherein the increment sub-time periods comprise the increment standard data of which the service time is not in the unloading time and the increment standard data corresponding to the preset time.
For example, the increment standard data includes increment standard data a whose service time is not in the unloading time, increment standard data B whose service time is in the unloading time and whose service time is the previous day, increment standard data C whose service time is in the unloading time and whose service time is the previous two days, and so on. And on the basis of the unloading period, the computer equipment respectively takes the time period of which the service time is not in the unloading time and the time period of which the service time is in the unloading time but the service time is n days before in the time period of the increment standard data as increment sub-time periods.
In one embodiment, the computer device obtains the increment standard data, takes the service time of the increment standard data as the previous day as an increment sub-time period, and takes the time service time of the increment standard data in the increment standard data as a non-unloading period as an increment sub-time period.
And step S208, determining a target increment mechanism included in the increment standard data, and generating a plurality of target increment index tasks based on the target increment mechanism and the increment sub-time period.
The organization number is used to represent the organization attribute of the incremental standard data, and may be composed of multiple digits, for example, the organization number of a certain province is 130000, the organization number of a certain city of a certain province is 130100, and the organization number of a certain district of a certain city of a certain province is 130102.
Specifically, the computer device determines a target incremental mechanism included in the incremental standard data based on the mechanism number in the incremental standard data. The computer device acquires the increment sub-time period and generates a plurality of target increment index tasks based on the target increment mechanism and the increment sub-time period.
And step S210, executing each target increment index task to perform summarizing processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to house maintenance resources.
Specifically, the computer device executes each target increment index task, and performs summary processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task based on the mechanism dimension and the time dimension respectively to obtain an increment data table of a plurality of time dimensions related to the house maintenance resources. Wherein the time dimension comprises a day dimension, a month dimension, a season dimension, a half year dimension, a year dimension. The information types of the incremental data tables of the time dimensions are the same, and taking the incremental data table of the day dimension as an example, the following table 3:
TABLE 3 incremental data sheet-DATAY
Organization number VARchar (32) (variable length character type)
Number of statistical sessions VARchar (32) (variable length character type)
Index coding VARchar (32) (variable length character type)
Index type mark char (1) (fixed length character type)
Classification number VARchar (32) (variable length character type)
Sort number VARchar (32) (variable length character type)
Statistical value Of the DECOMAL type
In the house maintenance resource data processing method, an incremental unloading file related to house maintenance resources is obtained. And screening the increment standard data matched with the plurality of service index numbers from the increment unloading file. And dividing the time period of the increment standard data according to the unloading period to obtain a plurality of increment sub-time periods. And determining a target increment mechanism included in the increment standard data, and generating a plurality of target increment index tasks based on the target increment mechanism and the increment quantum time period. And executing each target increment index task to perform summarizing processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to the house maintenance resources. Therefore, in the process of actual development of developers, based on the incremental data table carrying the time dimension and the mechanism dimension, data corresponding to actual development requirements can be responded quickly, and the data can be displayed and visualized from the mechanism dimension and the time dimension accurately. Therefore, based on the incremental data table carrying the time dimension and the mechanism dimension, the actual development requirements of developers can be quickly and accurately responded, and the response speed is greatly improved.
In one embodiment, the generating a plurality of target incremental indicator tasks based on the target incremental mechanism and the incremental sub-time period includes: and determining the increment standard subdata respectively corresponding to the increment sub-time periods. And determining the service index number and the counting period corresponding to each increment standard subdata, and generating a corresponding target increment index task according to the service index number, the mechanism number and the counting period corresponding to each increment standard subdata.
Specifically, the computer device acquires a plurality of increment sub-periods, and determines increment standard sub-data respectively corresponding to the respective increment sub-periods based on the plurality of increment sub-periods. And the computer equipment determines the service index number and the counting period corresponding to each increment standard subdata. Wherein the statistical period is the actual service time. And the computer equipment generates a corresponding target increment index task by executing a createIndexTask creating index task based on the service index number, the mechanism number and the counting period of the target increment mechanism which are respectively corresponding to each increment standard subdata.
For example, the computer device determines the corresponding incremental standard sub-data based on the incremental sub-time period. The increment table subdata corresponds to a service A, and a corresponding service index number A00001 and a counting period number i in the current month are determined based on the increment table subdata. If the target increment mechanism is acquired by the computer to be in j county of a certain city, the computer equipment generates a target increment index task A by executing a createIndexTask according to the organization dimension and the time dimension based on the service index number, the organization number and the statistical period of the target increment mechanismij
In the present embodiment, increment standard sub-data respectively corresponding to the respective increment sub-periods is determined. And determining the service index number and the counting period corresponding to each increment standard subdata, and generating a corresponding target increment index task according to the service index number, the mechanism number and the counting period corresponding to each increment standard subdata. Therefore, the increment standard data can be summarized in multiple dimensions based on the target increment index task carrying time dimension information and mechanism dimension information. Therefore, multi-dimensional display and visualization of data related to house maintenance resources can be achieved, and development requirements of developers can be responded quickly. In addition, data statistics not in the unloading time can be supported through the target increment index task, so that the integrity of data can be further ensured, and development work of developers is facilitated.
In one embodiment, as shown in fig. 3, the executing each target incremental indicator task to aggregate the incremental standard data according to the target incremental mechanism and the incremental sub-time period in the corresponding target incremental indicator task to obtain a plurality of incremental data tables about the house maintenance resource includes:
step S302, based on the target increment mechanism and the increment target sub-time period in each target increment index task, determining a first target increment index task in the aspect of mechanism dimension and a second target increment index task in the aspect of time dimension.
Specifically, based on a target increment mechanism and an increment target sub-time period in each target increment index task, the target increment index task is divided according to mechanism dimensions and time dimensions, and a first target increment index task in the aspect of the mechanism dimensions and a second target increment index task in the aspect of the time dimensions are determined.
Step S304, mechanism dimension summarizing processing is carried out on the plurality of incremental standard data by executing the first target incremental index task, and a mechanism summarizing result corresponding to each mechanism dimension is obtained; and the mechanism summary result of the same mechanism dimension comprises index values corresponding to a plurality of target sub-time periods, wherein the index values are service data related to the maintenance resources.
Specifically, the computer device executes the first target increment index task, and performs mechanism dimension summarizing processing on the plurality of increment standard data based on the association sequence of each mechanism dimension to obtain a mechanism summarizing result corresponding to each mechanism dimension. And the mechanism summary result of each mechanism dimension comprises index values corresponding to a plurality of target sub-time periods. Wherein the correlation sequence of the mechanism dimension is a process of correlation step by step upwards based on the lowest mechanism, for example, a1Provincial organization number of province is 130000, a1Province a12The city-level organization number of the city is 130100, a1Province a12City a123If the number of the district-level organization of the district is 130102, the district-level organization dimension at the lowest level is associated with the city-level organization dimension at the upper level of the district-level organization dimension, and then the city-level organization dimension is associated with the provincial organization dimension at the upper level of the city-level organization dimension.
For example, based on the first target increment index task, the computer device performs screening of the county organization dimensions on the plurality of increment standard data to obtain a summary result of each county organization dimension. Based on the summary result of each county and institution dimension, the computer device summarizes a plurality of county and institution dimensions belonging to the institution dimension of the same city to obtain the summary result of each city and institution dimension. Based on the summary result of each city institution dimension, the computer equipment summarizes a plurality of city institution dimensions of the same provincial institution dimension to obtain the summary result of each provincial institution dimension. And summarizing the provincial institution dimensions by the computer equipment to obtain a summarizing result of the national institution dimensions. And the mechanism summary result of each mechanism dimension comprises index values corresponding to a plurality of target sub-time periods.
And step S306, performing time dimension summarizing processing based on the summarizing result of each mechanism by executing the second target increment index task to obtain a plurality of increment data tables related to the house maintenance resources.
Specifically, the computer device executes the second target increment index task, and performs time dimension summarizing processing based on the association sequence of each time dimension and the summarizing result of each organization to obtain a plurality of increment data tables related to the house maintenance resources. The association sequence of the time dimension is a process of associating upwards step by step based on the lowest level mechanism, for example, based on the lowest level day-time dimension, associating the previous month-time dimension of the day-time dimension, associating the month-time dimension, and associating the previous season-time dimension of the month-time dimension.
For example, based on the second target increment index task, the computer device summarizes the time dimension of the day in the summary results of the organizations to obtain the summary results of the time dimension of the day. The computer equipment collects a plurality of day-time dimensions of the same month-time dimension to obtain a collection result of each month-time dimension. The computer equipment collects a plurality of month time dimensions of the same quarter time dimension to obtain a collection result of each quarter time dimension. And the computer equipment collects the multiple quarterly time dimensions of the time dimension in the same year to obtain a collection result of the multiple quarterly time dimensions of the time dimension in each year. And the computer equipment summarizes the time dimensions in a plurality of years of the same year time dimension to obtain a summarizing result of each year time dimension. The computer device obtains a plurality of incremental data tables for the house repair resource based on the summaries of the respective time dimensions.
In this embodiment, a first target incremental indicator task in the mechanism dimension and a second target incremental indicator task in the time dimension are determined based on the target incremental mechanism and the incremental target sub-time period in each target incremental indicator task. Performing mechanism dimension summarizing processing on the plurality of incremental standard data by executing the first target incremental index task to obtain a mechanism summarizing result corresponding to each mechanism dimension; and the mechanism summary result of the same mechanism dimension comprises index values corresponding to a plurality of target sub-time periods, wherein the index values are service data related to the maintenance resources. And performing time dimension summarizing processing based on the summarizing result of each mechanism by executing the second target increment index task to obtain a plurality of increment data tables related to the house maintenance resources. Like this, based on the increment data table that carries time dimension and mechanism dimension, can carry out the show and the visualization of a plurality of dimensions with the data that house maintenance resource is relevant, the actual development demand of response developer that can be quick and accurate, promoted response speed greatly.
In one embodiment, as shown in fig. 4, the method further comprises:
step S402, acquiring a full unloading file related to house maintenance resources, wherein the full unloading file comprises warehousing time corresponding to each data.
Wherein the house maintenance resource is a house maintenance fund. The unloading is the process of unloading data from one system to another system, and the unloading file is generated according to the data standard in the data sheet of the special maintenance fund management basic information of the residence. The total unloading file is generated by unloading historical business data according to data specifications in a residential special maintenance fund management basic information data sheet of the department of housing construction.
Specifically, the computer device obtains a full offload file associated with the house repair resource. The full unloading file is generated by unloading the historical service data in the system according to the data specification. The full unloading file comprises the warehousing time corresponding to each data. And the warehousing time is the time when each data enters the database MySQL.
Step S404, acquiring the full-quantity transmission parameters, determining a target full-quantity warehousing time period based on the full-quantity transmission parameters, and screening initial full-quantity standard data matched with the target full-quantity warehousing time period from the full-quantity unloading file.
The total standard data includes service information related to the house maintenance resource data, such as organization number, service time, and data update time. The service index number is used for representing information of each service of the house maintenance resource data, such as first payment information and subsequent payment information corresponding to the payment service. The full amount is transmitted with parameters for characterizing the time period.
Specifically, the computer device obtains a full-scale transmitted parameter and determines a start time point and an end time point from the full-scale transmitted parameter. The computer device determines a target full-amount warehousing time period based on the initial time point and the end time point. And the computer equipment screens out initial full-scale standard data matched with the target full-scale warehousing time period from the full-scale unloading file according to the service information carried by the full-scale standard data in the full-scale unloading file.
For example, when the parameters startTime and endTime of YYYYMMDD are acquired, the target full-amount warehousing time period is determined. The computer equipment acquires a full unloading file related to the house maintenance resources, and after checking, converting and loading the full unloading file, full standard data related to the house maintenance resources are acquired. And the computer equipment screens out initial full-scale standard data matched with the target full-scale warehousing time period from the multiple full-scale standard data.
Step S406, screening out a plurality of full standard data with the service index numbers matched from the plurality of initial full standard data.
Specifically, the computer device determines a plurality of service index numbers from an index information table in a database based on the index information table, and the computer device screens out full standard data matched with the plurality of service index numbers from the plurality of initial full standard data.
Step S408, dividing the time period of the full-scale standard data according to the unloading period to obtain a plurality of full-scale sub-time periods.
The unloading period is the unloading time specified by each service, namely the data of the service is unloaded from one system to another system within the specified unloading time.
Specifically, the computer device determines a time period corresponding to each full standard data based on the service time corresponding to each full standard data. And the computer equipment divides the time period of the full-scale standard data based on the unloading period to obtain a plurality of full-scale sub-time periods, wherein the full-scale sub-time periods comprise the full-scale standard data of which the service time is not in the unloading time and the full-scale standard data corresponding to the preset time.
For example, the full standard data includes full standard data a whose service time is not in the unloading time, full standard data B whose service time is in the unloading time but the service time is the previous day, full standard data C whose service time is in the unloading time but the service time is the previous two days, and so on. And on the basis of the unloading period, the computer equipment respectively takes the time period of which the service time is not in the unloading time and the time period of which the service time is in the unloading time but the service time is n days before in the time period of the full standard data as full quantum time periods.
In one embodiment, the computer device obtains the full-scale standard data, takes the service time of the full-scale standard data as the previous day as a full-scale sub-time period, and takes the time service time of the full-scale standard data in the full-scale standard data as a non-dump cycle as a full-scale sub-time period.
Step S410, determining a target full-scale mechanism included in the full-scale standard data, and generating a plurality of target full-scale index tasks based on the target full-scale mechanism and the full-scale sub-time period.
The organization number is used to represent the organization attribute of the full-scale standard data, and may be composed of multiple digits, for example, the organization number of a certain province is 130000, the organization number of a certain city of a certain province is 130100, and the organization number of a certain district of a certain city of a certain province is 130102.
Specifically, the computer device determines a target full-size organization included in the full-size standard data based on the organization number in the full-size standard data. The computer device obtains the full quantum time period, and generates a plurality of target full indicator tasks based on the target full mechanism and the full quantum time period.
And step S412, executing each target full index task to perform summary processing on the full standard data according to the target full mechanisms and the full sub-time periods in the corresponding target full index tasks to obtain a plurality of full data tables related to the house maintenance resources.
Specifically, the computer device executes each target full index task, and summarizes the full standard data according to the target full mechanism and the full sub-time period in the corresponding target full index task based on the mechanism dimension and the time dimension respectively to obtain a plurality of full data tables related to the house maintenance resources.
In this embodiment, a full unloading file related to the house maintenance resource is obtained, where the full unloading file includes the warehousing time corresponding to each data. Acquiring a full-quantity transmission parameter, determining a target full-quantity warehousing time period based on the full-quantity transmission parameter, and screening initial full-quantity standard data matched with the target full-quantity warehousing time period from the full-quantity unloading file. And screening out a plurality of full standard data with matched service index numbers from the plurality of initial full standard data. And dividing the time period of the full standard data according to the unloading period to obtain a plurality of full sub-time periods. And determining a target full-scale mechanism included in the full-scale standard data, and generating a plurality of target full-scale index tasks based on the target full-scale mechanism and the full-scale sub-time period. And executing each target full index task to perform summarizing processing on the full standard data according to the target full mechanisms and the full sub-time periods in the corresponding target full index tasks to obtain a plurality of full data tables related to house maintenance resources. Therefore, based on the full data table with the time dimension and the mechanism dimension, the full unloading file can be subjected to data processing, historical data related to the house maintenance resources can be displayed and visualized in multiple dimensions, and the response speed of initial data related to the house maintenance resources can be increased.
In an embodiment, as shown in fig. 5, the incremental unloading file includes entry time corresponding to each data, and the method further includes:
step S502, if the situation that the number unloading fails in the increment standard data obtained by screening based on the service index number is determined, whether the parameter corresponding to the data re-pushing request is received or not is judged.
Wherein the parameters are transmitted by the recurrence for representing the time period.
Specifically, if it is determined that the number unloading failure of the incremental standard data obtained by screening the service index number exists, the computer device determines to perform a re-push task, and determines whether a re-push transmission parameter corresponding to the re-push request data is received.
Step S504, if the parameters which are retransmitted are obtained, determining a target warehousing time period based on the parameters which are retransmitted, and screening the retransmission standard data matched with the target warehousing time period from the incremental unloading file.
Specifically, if it is obtained that the parameter of the re-push transmission is day ═ N, the target warehousing time period is from the previous N days to the current date in the morning; if the parameters of the re-push transmission are acquired to include a start date (startDay) and an end date (endDay), the target warehousing time period is a time period from the start date to the end date. And the computer equipment screens out the re-pushing standard data matched with the target warehousing time period from the increment unloading file.
Step S506, the time period of the recursive standard data is divided according to the unloading period, so as to obtain a plurality of recursive sub-time periods.
Specifically, the computer device determines a time period corresponding to each piece of the redraw standard data based on the service time corresponding to each piece of the redraw standard data. The computer equipment divides the time period of the re-pushing standard data based on the unloading period to obtain a plurality of re-pushing sub-time periods, wherein the re-pushing sub-time periods comprise the re-pushing standard data of which the service time is not in the unloading time and the re-pushing standard data corresponding to the preset time.
Step S508, determining a target re-pushing mechanism included in the re-pushing standard data, and generating a plurality of target re-pushing index tasks based on the target re-pushing mechanism and the re-pushing sub-time period.
Specifically, the computer device determines each organization number based on the re-pushing standard data, determines the activation condition of each organization number from the organization information table, and determines the organization with the organization number in the re-pushing standard data in the activation state as the target re-pushing organization. The computer device obtains the redraw sub-time period, and generates a plurality of target redraw index tasks based on the target redraw mechanism and the redraw sub-time period.
The organization information table is used for describing basic organization information and the superior organization, and the content of the organization information table is as shown in table 4:
table 4 organization information table
Organization number VARchar (32) (variable length character type)
Name of organization TEXT (TEXT type)
Type of mechanism char (1) (fixed length character type)
Superior organization number VARchar (32) (variable length character type)
State of the mechanism char (1) (fixed length character type)
Organization address TEXT (TEXT type)
Administrative division code VARchar (32) (variable length character type)
Step S510, executing each target re-pushing index task to perform summary processing on the re-pushing standard data according to the target re-pushing mechanism and the re-pushing sub-time period in the corresponding target re-pushing index task, so as to obtain a plurality of re-pushing data tables related to the house maintenance resources.
Specifically, the computer device executes each target re-pushing index task, and collects the re-pushing standard data according to the target re-pushing mechanism and the re-pushing sub-time period in the corresponding target re-pushing index task based on the mechanism dimension and the time dimension respectively to obtain a plurality of re-pushing data tables related to the house maintenance resources.
And step S512, updating the incremental data table by combining the re-pushing data table to obtain a target data table.
Specifically, the computer acquires the incremental data table, and updates the incremental data table based on the pushback data table to obtain a target data table.
In this embodiment, if it is determined that the incremental standard data obtained by screening based on the service index number has a failure in unloading, it is determined whether a parameter related to a push transmission corresponding to a push data request is received. And if the parameters transmitted by the re-pushing are acquired, determining a target warehousing time period based on the parameters transmitted by the re-pushing, and screening out re-pushing standard data matched with the target warehousing time period from the incremental unloading file. And dividing the time period of the re-pushing standard data according to the unloading period to obtain a plurality of re-pushing sub-time periods. And determining a target re-pushing mechanism included in the re-pushing standard data, and generating a plurality of target re-pushing index tasks based on the target re-pushing mechanism and the re-pushing sub-time period. And updating the incremental data table by combining the re-push data table to obtain a target data table. Therefore, once the condition of failure in unloading the number occurs, the incremental data table is updated based on the pushback data table, the data which is successfully unloaded and related to the house maintenance resources can be displayed, the accuracy of data display and visualization is ensured, and the reliability is greatly increased.
In one embodiment, the method further comprises: and if the condition that the number unloading fails to exist in the increment standard data obtained by screening based on the service index number is determined, judging whether a parameter corresponding to a data re-pushing request is received or not. And if the parameters which are retransmitted by the re-pushing are not obtained, returning to the increment standard data which are screened from the increment unloading file and matched with the service index numbers, and repeatedly executing until a new increment data table is obtained. And combining the original plurality of incremental data tables and the new incremental data table to obtain a target data table.
Specifically, if it is determined that the number unloading failure of the incremental standard data obtained by screening the service index number exists, the computer device determines to perform a re-push task, and determines whether a re-push transmission parameter corresponding to the re-push request data is received. And if the computer equipment does not acquire the parameters which are retransmitted by the re-push, returning to the increment standard data which are screened from the increment unloading file and matched with the service index numbers, and repeatedly executing until a new increment data table is obtained. And the computer equipment updates the original plurality of incremental data tables based on the new incremental data table to obtain a target data table.
In this embodiment, if it is determined that the incremental standard data obtained by screening based on the service index number has a failure in unloading, it is determined whether a parameter related to a push transmission corresponding to a push data request is received. And if the parameters which are retransmitted by the re-pushing are not obtained, returning to the increment standard data which are screened from the increment unloading file and matched with the service index numbers, and repeatedly executing until a new increment data table is obtained. And combining the original plurality of incremental data tables and the new incremental data table to obtain a target data table. Therefore, once the condition of failure in unloading the number occurs and the condition that parameters transmitted by the re-pushing are not received, the incremental data table can be updated based on the re-pushing data table, the data which is successfully unloaded and related to the house maintenance resources can be displayed, the accuracy of data display and visualization is ensured, and the reliability is greatly increased.
In one embodiment, the method further comprises: and if the summarizing processing time reaches the preset time, acquiring the task execution state of each target index task from the central task control table. And transferring the target index task with the task execution state being successful in task execution from the central task control table to the central task table.
The central task control table is a task generated by indexes, and the central task history table is all executed tasks. The central task control table and the central task history table are stored in a database MySQL. The database also stores an index classification table, an index data table (a daily table, a monthly table, a rose table, a semi-annual table, and a monthly table), and an organization information table. The contents in the central task control table and the central task history table are shown in tables 5 and 6 as follows:
TABLE 5 Central task control Table
Task object VARchar (32) (variable length character type)
Task object type char (1) (fixed length character type)
Organization number VARchar (32) (variable length character type)
Number of statistical sessions VARchar (32) (variable length character type)
Task type char (1) (fixed length character type)
Classification number VARchar (32) (variable length character type)
Sort number VARchar (32) (variable length character type)
Task execution state char (1) (fixed length character type)
Data entry start time DATETIME (time)
End time of data warehousing DATETIME (time)
Task recording time DATETIME (time)
TABLE 6 Central task History Table
Task object VARchar (32) (variable length character type)
Task object type char (1) (fixed length character type)
Organization number VARchar (32) (variable length character type)
Number of statistical sessions VARchar (32) (variable length character type)
Task type char (1) (fixed length character type)
Classification number VARchar (32) (variable length character type)
Sort number VARchar (32) (variable length character type)
Task execution state char (1) (fixed length character type)
Data entry start time DATETIME (time)
End time of data warehousing DATETIME (time)
Task recording time DATETIME (time)
Specifically, if the summarizing processing time for executing each target incremental indicator task reaches the preset time, the computer equipment judges that the summarizing processing process is finished, and acquires the task execution state of each target incremental indicator task from the central task control table. The computer equipment transfers the task execution state as a target index task of successful task execution from the central task control table to a central task table (executeToTaskHis).
In one embodiment, if the summary processing time reaches a predetermined time, the task execution state of each target index task is acquired from the central task control table. And transferring the target index task with the task execution state being successful in task execution from the central task control table to the central task table. Therefore, the completion state of the target index task can be rapidly and clearly known, and the processing condition of the target index task can be timely mastered.
A more detailed embodiment is provided to facilitate a clearer understanding of the data processing associated with the incremental destage file in the present application. As shown in fig. 6. And each central business system unloads the newly added business data every day according to the data standard of 'the basic information data standard of residential special maintenance fund management' of the department of housing to generate an incremental unloading file. The maintenance fund statistical analysis platform can be regarded as computer equipment. And acquiring the incremental unloading file, and preprocessing (namely downloading, verifying, decompressing and reading) the incremental unloading file to acquire incremental standard data related to house maintenance resources. The computer device executes a daily task (executedayindexttask) based on the incremental standard data, and determines a plurality of service index numbers from an index information table by acquiring the index information table from the database. And screening out the incremental standard data matched with the plurality of service index numbers from the incremental unloading file according to the service information carried by the incremental standard data in the incremental unloading file. And the computer equipment determines the time period corresponding to each increment standard data based on the service time corresponding to each increment standard data. The computer equipment divides the time period of the increment standard data based on the unloading period to obtain a plurality of increment sub-time periods, wherein the increment sub-time periods comprise the increment standard data of which the service time is not in the unloading time and the increment standard data corresponding to the preset time. The computer device obtains a plurality of increment sub-time periods, and based on the plurality of increment sub-time periods, increment standard sub-data respectively corresponding to the increment sub-time periods is determined. The computer equipment determines the service index number and the statistical installments respectively corresponding to each incremental standard subdata by executing a basic creation index task (createIndexTask). Wherein the statistical period is the actual service time. The computer equipment generates a corresponding target incremental index task by executing a createIndexTask (createIndexTask) based on the service index number, the mechanism number and the counting period of the target incremental mechanism which are respectively corresponding to each incremental standard subdata. Based on a target increment mechanism and an increment target sub-time period in each target increment index task, dividing the target increment index task according to mechanism dimension and time dimension respectively, and determining a first target increment index task in the aspect of the mechanism dimension and a second target increment index task in the aspect of the time dimension. And the computer equipment executes the first target increment index task, and performs mechanism dimension summarizing processing on the plurality of increment standard data based on the sequence of each mechanism dimension to obtain a mechanism summarizing result corresponding to each mechanism dimension. And the mechanism summary result of each mechanism dimension comprises index values corresponding to a plurality of target sub-time periods. And the computer equipment executes the second target increment index task, and performs time dimension summarizing processing based on the sequence of each time dimension and the summarizing result of each mechanism to obtain a plurality of data tables related to the house maintenance resources. If the summarizing processing time for executing each target increment index task reaches the preset time, the computer equipment judges that the summarizing processing process is finished, and obtains the task execution state of each target index task from the central task control table. The computer equipment transfers the task execution state as a target index task of successful task execution from the central task control table to a central task table (executeToTaskHis).
If the situation that the number unloading of the increment standard data obtained by screening the service index number fails is determined, the computer equipment executes a replay creation index task (createindexTaskJob), and judges whether a parameter corresponding to the replay request data is received or not by determining to execute the replay task. If the obtained parameter of the re-push transmission is day is N, the target warehousing time period is from the previous N days to the current morning; if the parameters of the re-push transmission are acquired to include a start date (startDay) and an end date (endDay), the target warehousing time period is a time period from the start date to the end date. And the computer equipment screens out the re-pushing standard data matched with the target warehousing time period from the increment unloading file. And the computer equipment determines the time period corresponding to each piece of the re-push standard data based on the service time corresponding to each piece of the re-push standard data. The computer equipment divides the time period of the re-pushing standard data based on the unloading period to obtain a plurality of re-pushing sub-time periods, wherein the re-pushing sub-time periods comprise the re-pushing standard data of which the service time is not in the unloading time and the re-pushing standard data corresponding to the preset time. The computer device determines a target pushback mechanism included in the pushback standard data based on the mechanism number in the pushback standard data. The computer device obtains the redraw sub-time period, and generates a plurality of target redraw index tasks based on the target redraw mechanism and the redraw sub-time period. And the computer equipment executes each target re-pushing index task, and summarizes the re-pushing standard data according to the target re-pushing mechanism and the re-pushing sub-time period in the corresponding target re-pushing index task based on the mechanism dimension and the time dimension respectively to obtain a plurality of re-pushing data tables related to the house maintenance resources. And the computer acquires the incremental data table and updates the incremental data table based on the re-pushing data table to obtain a target data table. And if the condition that the number unloading of the increment standard data obtained by screening the service index number fails is determined, the computer equipment determines to perform a re-pushing task, and judges whether a re-pushing transmission parameter corresponding to the re-pushing request data is received or not. And if the computer equipment does not acquire the parameters which are retransmitted by the re-push, returning to the increment standard data which are screened from the increment unloading file and matched with the service index numbers, and repeatedly executing until a new increment data table is obtained. And the computer equipment updates the original plurality of incremental data tables based on the new incremental data table to obtain a target data table. The computer equipment generates a new index corresponding to the implementation class by adding an implementation class for implementing an interface corresponding to the new index and initializing index basic information from an index information table in a database.
When the computer device processes and analyzes the data related to the maintenance resources for the first time, the data processing process related to the incremental unloading file is involved, and as shown in fig. 7, each central service system unloads the historical service data according to the data standard of the "data standard of basic information for managing residence-specific maintenance funds" of the ministry of housing, so as to generate a full unloading file. The computer equipment acquires a full unloading file related to the house maintenance resources, acquires full transmission parameters by executing a timing task (CreateIndexTaskByTimeJob) with the parameters, and determines a starting time point and an ending time point from the full transmission parameters. The computer device determines a target full-amount warehousing time period based on the initial time point and the end time point. And the computer equipment screens out initial full-scale standard data matched with the target full-scale warehousing time period from the full-scale unloading file according to the service information carried by the full-scale standard data in the full-scale unloading file. The computer device determines a plurality of service index numbers from an index information table based on the index information table in the database, and the computer device screens out full standard data matched with the plurality of service index numbers from the plurality of initial full standard data. And the computer equipment determines the time period corresponding to each full standard data based on the service time corresponding to each full standard data. And the computer equipment divides the time period of the full-scale standard data based on the unloading period to obtain a plurality of full-scale sub-time periods, wherein the full-scale sub-time periods comprise the full-scale standard data of which the service time is not in the unloading time and the full-scale standard data corresponding to the preset time. The computer device determines a target full-scale organization included in the full-scale standard data based on the organization number in the full-scale standard data by executing an index task (ExecuteIndexTask). The computer device obtains the full quantum time period, and generates a plurality of target full indicator tasks based on the target full mechanism and the full quantum time period. The computer equipment executes each target full index task by executing a timing task (ExecuteToTaskHis), and summarizes the full standard data according to a target full mechanism and a full sub-time period in the corresponding target full index task based on the mechanism dimension and the time dimension respectively to obtain a plurality of full data tables related to the house maintenance resources.
In this embodiment, an incremental unload file associated with a house repair resource is obtained. And screening the increment standard data matched with the plurality of service index numbers from the increment unloading file. And dividing the time period of the increment standard data according to the unloading period to obtain a plurality of increment sub-time periods. And determining a target increment mechanism included in the increment standard data, and generating a plurality of target increment index tasks based on the target increment mechanism and the increment quantum time period. And executing each target increment index task to perform summarizing processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to the house maintenance resources. Like this, based on the increment data table that carries time dimension and mechanism dimension, can carry out the show and the visualization of a plurality of dimensions with the data that house maintenance resource is relevant, the actual development demand of response developer that can be quick and accurate, promoted response speed greatly. In addition, by adding indexes rapidly, the development cost can be greatly reduced.
It should be understood that although the various steps in the flowcharts of fig. 2-7 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-7 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 8, there is provided a house repair resource data processing apparatus including: an obtaining module 802, a screening module 804, a determining module 806, a generating module 808, and an executing module 810, wherein:
an obtaining module 802 is configured to obtain an incremental unloading file related to the house maintenance resource.
And the screening module 804 is configured to screen the increment standard data matched with the plurality of service index numbers from the increment unloading file.
The determining module 806 is configured to divide the time period of the increment standard data according to the unloading period to obtain a plurality of increment sub-time periods.
A generating module 808, configured to determine a target increment mechanism included in the increment standard data, and generate a plurality of target increment index tasks based on the target increment mechanism and the increment sub-period.
And the execution module 810 is configured to execute each target increment index task, so as to perform summarizing processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task, and obtain a plurality of increment data tables related to the house maintenance resources.
In one embodiment, the generating module 808 is configured to determine incremental standard sub-data corresponding to each incremental sub-time period. And determining the service index number and the counting period corresponding to each increment standard subdata, and generating a corresponding target increment index task according to the service index number, the mechanism number and the counting period corresponding to each increment standard subdata.
In one embodiment, the execution module 810 is configured to determine a first target incremental indicator task in the mechanism dimension and a second target incremental indicator task in the time dimension based on the target incremental mechanism and the incremental target sub-time period in each target incremental indicator task. Performing mechanism dimension summarizing processing on the plurality of incremental standard data by executing the first target incremental index task to obtain a mechanism summarizing result corresponding to each mechanism dimension; and the mechanism summary result of the same mechanism dimension comprises index values corresponding to a plurality of target sub-time periods, wherein the index values are service data related to the maintenance resources. And performing time dimension summarizing processing based on the summarizing result of each mechanism by executing the second target increment index task to obtain a plurality of data tables related to the house maintenance resources.
In an embodiment, the obtaining module 802 is further configured to obtain a full unloading file related to the house maintenance resource, where the full unloading file includes warehousing times corresponding to the data respectively.
The screening module 804 is further configured to obtain a full-volume transmitted parameter, determine a target full-volume warehousing time period based on the full-volume transmitted parameter, and screen out initial full-volume standard data matched with the target full-volume warehousing time period from the full-volume unloading file.
The screening module 804 is further configured to screen out a plurality of full standard data with matching service index numbers from the plurality of initial full standard data.
The determining module 806 is further configured to divide the time period of the full-scale standard data according to the unloading period to obtain a plurality of full-scale sub-time periods.
The generating module 808 is further configured to determine a target full-scale mechanism included in the full-scale standard data, and generate a plurality of target full-scale index tasks based on the target full-scale mechanism and the full-scale sub-time period.
The executing module 810 is further configured to execute each target full indicator task, so as to perform summarization processing on the full standard data according to the target full mechanism and the full sub-time period in the corresponding target full indicator task, and obtain a plurality of full data tables related to the house maintenance resources.
In an embodiment, the executing module 810 is further configured to determine whether a push transmission parameter corresponding to a push data request is received if it is determined that the number unloading of the incremental standard data obtained by screening based on the service index number fails. And if the parameters transmitted by the re-pushing are acquired, determining a target warehousing time period based on the parameters transmitted by the re-pushing, and screening out re-pushing standard data matched with the target warehousing time period from the incremental unloading file. And dividing the time period of the re-pushing standard data according to the unloading period to obtain a plurality of re-pushing sub-time periods. And determining a target re-pushing mechanism included in the re-pushing standard data, and generating a plurality of target re-pushing index tasks based on the target re-pushing mechanism and the re-pushing sub-time period. And executing each target re-pushing index task to perform summarizing processing on the re-pushing standard data according to the target re-pushing mechanism and the re-pushing sub time period in the corresponding target re-pushing index task to obtain a plurality of re-pushing data tables related to house maintenance resources. And updating the incremental data table by combining the re-push data table to obtain a target data table.
In an embodiment, the executing module 810 is further configured to determine whether a push transmission parameter corresponding to a push data request is received if it is determined that the number unloading of the incremental standard data obtained by screening based on the service index number fails. And if the parameters which are retransmitted by the re-pushing are not obtained, returning to the increment standard data which are screened from the increment unloading file and matched with the service index numbers, and repeatedly executing until a new increment data table is obtained. And combining the original plurality of incremental data tables and the new incremental data table to obtain a target data table.
In an embodiment, the executing module 810 is further configured to obtain a task execution state of each target indicator task from the central task control table if the summarized processing time reaches a predetermined time. And transferring the target index task with the task execution state being successful in task execution from the central task control table to the central task table.
For specific limitations of the housing repair resource data processing apparatus, reference may be made to the above limitations of the housing repair resource data processing method, which are not described in detail herein. All or part of each module in the house maintenance resource data processing device can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 9. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing house maintenance resource data processing data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a house repair resource data processing method.
Those skilled in the art will appreciate that the architecture shown in fig. 9 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having stored therein a computer program, the processor implementing the steps of the above-described method embodiments when executing the computer program.
In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (16)

1. A house repair resource data processing method, characterized in that the method comprises:
acquiring an incremental unloading file related to house maintenance resources;
screening out increment standard data matched with a plurality of service index numbers from the increment unloading file;
dividing the time period of the incremental standard data according to the unloading period to obtain a plurality of incremental sub-time periods;
determining a target increment mechanism included in the increment standard data, and generating a plurality of target increment index tasks based on the target increment mechanism and the increment quantum time period;
and executing each target increment index task to perform summarizing processing on the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to the house maintenance resources.
2. The method of claim 1, wherein generating a plurality of target incremental indicator tasks based on the target incremental mechanism and the incremental quantum time period comprises:
determining increment standard subdata respectively corresponding to each increment sub-time period;
and determining the service index number and the counting period corresponding to each increment standard subdata, and generating a corresponding target increment index task according to the service index number, the mechanism number and the counting period corresponding to each increment standard subdata.
3. The method of claim 1, wherein the executing each target incremental indicator task to summarize the incremental standard data according to the target incremental mechanism and the incremental sub-time period in the corresponding target incremental indicator task to obtain a plurality of incremental data tables for the house maintenance resource comprises:
determining a first target increment index task in the aspect of mechanism dimension and a second target increment index task in the aspect of time dimension based on a target increment mechanism and an increment target sub-time period in each target increment index task;
performing mechanism dimension summarizing processing on the plurality of incremental standard data by executing the first target incremental index task to obtain a mechanism summarizing result corresponding to each mechanism dimension; the mechanism summary result of the same mechanism dimension comprises index values corresponding to a plurality of target sub-time periods, wherein the index values are service data related to maintenance resources;
and performing time dimension summarizing processing based on the summarizing result of each mechanism by executing the second target increment index task to obtain a plurality of increment data tables related to the house maintenance resources.
4. The method of claim 1, further comprising:
acquiring a full unloading file related to house maintenance resources, wherein the full unloading file comprises warehousing time corresponding to each data;
acquiring a full-quantity transmission parameter, determining a target full-quantity warehousing time period based on the full-quantity transmission parameter, and screening initial full-quantity standard data matched with the target full-quantity warehousing time period from the full-quantity unloading file;
screening out a plurality of full standard data with matched service index numbers from the plurality of initial full standard data;
dividing the time period of the full standard data according to the unloading period to obtain a plurality of full sub-time periods;
determining a target full-scale mechanism included in the full-scale standard data, and generating a plurality of target full-scale index tasks based on the target full-scale mechanism and the full-scale time period;
and executing each target full index task to perform summarizing processing on the full standard data according to the target full mechanisms and the full sub-time periods in the corresponding target full index tasks to obtain a plurality of full data tables related to house maintenance resources.
5. The method of claim 1, wherein the incremental destage file includes a warehousing time corresponding to each data, and the method further comprises:
if the situation that the number unloading fails to exist in the increment standard data obtained by screening based on the service index number is determined, whether a parameter corresponding to a data re-pushing request is received or not is judged;
if the parameters transmitted by the re-pushing are obtained, determining a target warehousing time period based on the parameters transmitted by the re-pushing, and screening out re-pushing standard data matched with the target warehousing time period from the incremental unloading file;
dividing the time period of the re-pushing standard data according to the unloading period to obtain a plurality of re-pushing sub-time periods;
determining a target re-pushing mechanism included in the re-pushing standard data, and generating a plurality of target re-pushing index tasks based on the target re-pushing mechanism and the re-pushing sub-time period;
executing each target re-pushing index task to perform summarizing processing on the re-pushing standard data according to a target re-pushing mechanism and a re-pushing sub time period in the corresponding target re-pushing index task to obtain a plurality of re-pushing data tables related to house maintenance resources;
and updating the incremental data table by combining the re-push data table to obtain a target data table.
6. The method of claim 1, further comprising:
if the situation that the number unloading fails to exist in the increment standard data obtained by screening based on the service index number is determined, whether a parameter corresponding to a data re-pushing request is received or not is judged;
if the parameters which are re-pushed and transmitted are not obtained, returning to the increment standard data which are screened from the increment unloading file and matched with a plurality of service index numbers for repeated execution until a new increment data table is obtained;
and combining the original plurality of incremental data tables and the new incremental data table to obtain a target data table.
7. The method according to any one of claims 1 to 6, further comprising:
if the summarizing processing time reaches the preset time, acquiring the task execution state of each target index task from the central task control table;
and transferring the target index task with the task execution state being successful in task execution from the central task control table to the central task table.
8. A house repair resource data processing apparatus, characterized in that the apparatus comprises:
the acquisition module is used for acquiring an incremental unloading file related to house maintenance resources;
the screening module is used for screening the increment standard data matched with the service index numbers from the increment unloading file;
the determining module is used for dividing the time period of the increment standard data according to the unloading period to obtain a plurality of increment sub-time periods;
the generation module is used for determining a target increment mechanism included in the increment standard data and generating a plurality of target increment index tasks based on the target increment mechanism and the increment quantum time period;
and the execution module is used for executing each target increment index task so as to summarize the increment standard data according to the target increment mechanism and the increment sub-time period in the corresponding target increment index task to obtain a plurality of increment data tables related to house maintenance resources.
9. The house repair resource data processing apparatus of claim 8, wherein the generating module is configured to determine incremental standard sub-data corresponding to each incremental sub-time period; and determining the service index number and the counting period corresponding to each increment standard subdata, and generating a corresponding target increment index task according to the service index number, the mechanism number and the counting period corresponding to each increment standard subdata.
10. The house repair resource data processing apparatus of claim 8, wherein the execution module is configured to determine a first target incremental indicator task in a mechanism dimension and a second target incremental indicator task in a time dimension based on the target incremental mechanism and the incremental target sub-time period in each target incremental indicator task; performing mechanism dimension summarizing processing on the plurality of incremental standard data by executing the first target incremental index task to obtain a mechanism summarizing result corresponding to each mechanism dimension; the mechanism summary result of the same mechanism dimension comprises index values corresponding to a plurality of target sub-time periods, wherein the index values are service data related to maintenance resources; and performing time dimension summarizing processing based on the summarizing result of each mechanism by executing the second target increment index task to obtain a plurality of increment data tables related to the house maintenance resources.
11. The house maintenance resource data processing device according to claim 8, wherein the obtaining module is further configured to obtain a full unloading file related to the house maintenance resource, and the full unloading file includes warehousing times corresponding to the respective data;
the screening module is further used for acquiring the full-quantity transmitted parameters, determining a target full-quantity warehousing time period based on the full-quantity transmitted parameters, and screening initial full-quantity standard data matched with the target full-quantity warehousing time period from the full-quantity unloading file; screening out a plurality of full standard data with matched service index numbers from the plurality of initial full standard data;
the determining module is further configured to divide the time period of the full-scale standard data according to an unloading period to obtain a plurality of full-scale sub-time periods;
the generation module is further configured to determine a target full-scale mechanism included in the full-scale standard data, and generate a plurality of target full-scale index tasks based on the target full-scale mechanism and the full-scale time period;
the execution module is further configured to execute each target full-scale index task, so as to perform summary processing on the full-scale standard data according to the target full-scale mechanism and the full-scale sub-time period in the corresponding target full-scale index task, and obtain a plurality of full-scale data tables related to the house maintenance resources.
12. The house maintenance resource data processing device according to claim 8, wherein the incremental unloading file includes warehousing time corresponding to each data, and the execution module is further configured to determine whether a parameter corresponding to a data re-pushing request is received if it is determined that the unloading failure of the incremental standard data obtained by screening based on the service index number exists; if the parameters transmitted by the re-pushing are obtained, determining a target warehousing time period based on the parameters transmitted by the re-pushing, and screening out re-pushing standard data matched with the target warehousing time period from the incremental unloading file; dividing the time period of the re-pushing standard data according to the unloading period to obtain a plurality of re-pushing sub-time periods; determining a target re-pushing mechanism included in the re-pushing standard data, and generating a plurality of target re-pushing index tasks based on the target re-pushing mechanism and the re-pushing sub-time period; executing each target re-pushing index task to perform summarizing processing on the re-pushing standard data according to a target re-pushing mechanism and a re-pushing sub time period in the corresponding target re-pushing index task to obtain a plurality of re-pushing data tables related to house maintenance resources; and updating the incremental data table by combining the re-push data table to obtain a target data table.
13. The house maintenance resource data processing device according to claim 8, wherein the execution module is further configured to determine whether a push-to-transfer parameter corresponding to the push-to-data request is received if it is determined that the number unloading failure of the incremental standard data obtained by screening based on the service index number exists; if the parameters which are re-pushed and transmitted are not obtained, returning to the increment standard data which are screened from the increment unloading file and matched with a plurality of service index numbers for repeated execution until a new increment data table is obtained; and combining the original plurality of incremental data tables and the new incremental data table to obtain a target data table.
14. The house maintenance resource data processing device according to any one of claims 8 to 13, wherein the execution module is further configured to obtain a task execution state of each target index task from the central task control table if the summarized processing time reaches a predetermined time; and transferring the target index task with the task execution state being successful in task execution from the central task control table to the central task table.
15. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any of claims 1 to 7.
16. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
CN202111376599.5A 2021-11-19 2021-11-19 House maintenance resource data processing method and device and computer equipment Pending CN114238452A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111376599.5A CN114238452A (en) 2021-11-19 2021-11-19 House maintenance resource data processing method and device and computer equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111376599.5A CN114238452A (en) 2021-11-19 2021-11-19 House maintenance resource data processing method and device and computer equipment

Publications (1)

Publication Number Publication Date
CN114238452A true CN114238452A (en) 2022-03-25

Family

ID=80750170

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111376599.5A Pending CN114238452A (en) 2021-11-19 2021-11-19 House maintenance resource data processing method and device and computer equipment

Country Status (1)

Country Link
CN (1) CN114238452A (en)

Similar Documents

Publication Publication Date Title
US9195713B2 (en) Outlier data point detection
US10169461B2 (en) Analysis of data utilization
CN111159183B (en) Report generation method, electronic device and computer readable storage medium
CN111915340B (en) Method, device, equipment and storage medium for identifying merchant type
CN111046240B (en) Gateway traffic statistics method, device, computer equipment and storage medium
CN116579580A (en) Method, device, computer equipment and storage medium for processing bill
CN114238452A (en) House maintenance resource data processing method and device and computer equipment
CN115878707A (en) Foreign exchange market data processing method and device, storage medium and equipment
CN115129981A (en) Information recommendation method, device, equipment and storage medium
CN113868110B (en) Method and device for evaluating health degree of enterprise digital center service
CN115599787A (en) Level sub-metering method and device, electronic equipment and storage medium
CN114372867A (en) User credit verification and evaluation method and device and computer equipment
CN111221817B (en) Service information data storage method, device, computer equipment and storage medium
US11907194B2 (en) Systems and methods for executing and hashing modeling flows
CN111309623B (en) Coordinate class data classification test method and device
US20240104083A1 (en) Data anomaly detection
CN118071518A (en) Data modification method, device, computer equipment and storage medium
CN115439229A (en) Service data processing method and device, computer equipment and storage medium
CN117851476A (en) Query request processing method and device, computer equipment and storage medium
CN114254170A (en) Data processing method, system, electronic equipment and storage medium
CN115526731A (en) Task batch processing method and device, computer equipment and storage medium
CN115587285A (en) Target object identification method and device, computer equipment and storage medium
CN117520314A (en) Data processing method, device, electronic equipment and readable medium
CN116932486A (en) File generation method, device, computer equipment and storage medium
CN113515703A (en) Information recommendation method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination