CN112699151A - Data processing method, device, equipment and medium - Google Patents

Data processing method, device, equipment and medium Download PDF

Info

Publication number
CN112699151A
CN112699151A CN202110005002.XA CN202110005002A CN112699151A CN 112699151 A CN112699151 A CN 112699151A CN 202110005002 A CN202110005002 A CN 202110005002A CN 112699151 A CN112699151 A CN 112699151A
Authority
CN
China
Prior art keywords
settlement
processed
data
service
service data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110005002.XA
Other languages
Chinese (zh)
Other versions
CN112699151B (en
Inventor
王志浩
郑晨
周建城
陈恩龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202110005002.XA priority Critical patent/CN112699151B/en
Publication of CN112699151A publication Critical patent/CN112699151A/en
Application granted granted Critical
Publication of CN112699151B publication Critical patent/CN112699151B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/248Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2221/00Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/21Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/2141Access rights, e.g. capability lists, access control lists, access tables, access matrices

Abstract

The embodiment of the application provides a data processing method, a device, equipment and a medium, wherein the method can be applied to a data settlement scene of electronic map production operation and comprises the following steps: inquiring at least two configuration data tables in a settlement platform to obtain a target configuration data table associated with the service application to which the service data to be processed belongs; according to the access configuration information in the target configuration data table, verifying the service data to be processed, and if the service data to be processed passes the verification, storing the service data to be processed into a database; when a settlement triggering instruction aiming at the service data to be processed is received, inquiring at least two settlement configuration information in a settlement platform to obtain target settlement configuration information associated with the service application to which the service data to be processed belongs; and carrying out settlement processing on the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed. By adopting the embodiment of the application, the settlement efficiency of the service data can be improved.

Description

Data processing method, device, equipment and medium
Technical Field
The present application relates to the field of internet technologies, and in particular, to a data processing method, apparatus, device, and medium.
Background
In the production operation of the electronic map, a plurality of platform data such as roads, buses and the like can be accessed, and each platform accessed to the electronic map can generate a large amount of platform data, so that data settlement needs to be carried out on all the platform data respectively.
In the prior art, a settlement system (a set of code logic) can be developed for a platform according to information such as a settlement mode and settlement time corresponding to the platform, the settlement system is used for settling the data of the platform, and a final settlement result is calculated and stored in a database. However, when the number of platforms accessing the electronic map is large, since the settlement methods, the settlement time, the access data check items, and the like corresponding to different platforms are different, an independent settlement system needs to be developed in advance for each platform to perform settlement processing on the platform data corresponding to each platform, that is, after new platform data is accessed in the electronic map each time, a settlement system needs to be developed, and thus the platform data settlement efficiency in the electronic map is too low.
Disclosure of Invention
The embodiment of the application provides a data processing method, a data processing device, equipment and a medium, which can improve the settlement efficiency of service data.
An embodiment of the present application provides a data processing method, including:
acquiring to-be-processed service data accessed in a settlement platform, and inquiring at least two configuration data tables which are stored in an isolated manner by using the same data access structure in the settlement platform to obtain a target configuration data table associated with service application to which the to-be-processed service data belongs; at least two configuration data tables respectively correspond to different service applications;
according to the access configuration information in the target configuration data table, verifying the service data to be processed to obtain a verification result corresponding to the service data to be processed, and if the verification result is a correct verification result, storing the service data to be processed into a database;
when a settlement triggering instruction aiming at the service data to be processed is received, inquiring at least two pieces of settlement configuration information which are stored in an isolated way in the same data storage structure in a settlement platform to obtain target settlement configuration information associated with the service application to which the service data to be processed belongs; at least two settlement configuration information respectively correspond to different service applications;
and carrying out settlement processing on the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed.
An embodiment of the present application provides a data processing apparatus, including:
the system comprises a first query module, a second query module and a third query module, wherein the first query module is used for acquiring to-be-processed service data accessed in a settlement platform, and querying at least two configuration data tables which are stored in an isolated manner by using the same data access structure in the settlement platform to obtain a target configuration data table associated with a service application to which the to-be-processed service data belongs; at least two configuration data tables respectively correspond to different service applications;
the verification module is used for verifying the service data to be processed according to the access configuration information in the target configuration data table to obtain a verification result corresponding to the service data to be processed, and if the verification result is a correct verification result, the service data to be processed is stored in the database;
the second query module is used for querying at least two pieces of settlement configuration information which are stored in an isolated manner in the same data storage structure in the settlement platform when a settlement trigger instruction for the to-be-processed service data is received, so as to obtain target settlement configuration information associated with the service application to which the to-be-processed service data belongs; at least two settlement configuration information respectively correspond to different service applications;
and the data settlement module is used for performing settlement processing on the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed.
Wherein, the first inquiry module comprises:
a service identifier obtaining unit, configured to obtain service data to be processed accessed in the settlement platform, determine a service application providing the service data to be processed as a target service application, and obtain a service identifier corresponding to the target service application;
and the target configuration table determining unit is used for inquiring at least two configuration data tables which are stored in an isolated manner by using the same data access structure in the settlement platform according to the service identifier and determining the configuration data table corresponding to the service identifier as the target configuration data table.
The access configuration information comprises a reconciliation mode;
the verification module comprises:
the account checking unit is used for acquiring an account checking mode contained in the access configuration information and performing account checking on the to-be-processed service data according to the account checking mode;
the account checking correct unit is used for determining a check result corresponding to the business data to be processed as a check correct result when the business data to be processed meets the account checking condition corresponding to the account checking mode;
the account checking error unit is used for determining a checking result corresponding to the to-be-processed business data as a checking error result when the to-be-processed business data does not meet the account checking condition corresponding to the account checking mode, and transmitting warning information to a target business application providing the to-be-processed business data; the alarm information is used for indicating the target service application to check the service data to be processed and pushing the service data to be processed to the settlement platform again;
and the data storage unit is used for storing the to-be-processed business data and the account checking record corresponding to the to-be-processed business data in the database if the verification result is a correct verification result.
Wherein, the data settlement module includes:
the formula loading unit is used for loading the target settlement configuration information, acquiring a settlement function associated with the to-be-processed service data, and splitting the to-be-processed service data into at least two sub-service data according to parameter information in the settlement function;
and the result determining unit is used for inputting the at least two sub-service data into the settlement function and determining the settlement result corresponding to the service data to be processed according to the settlement function.
The database comprises message queues, wherein the message queues are used for storing the service data to be processed, the number of the service data to be processed is M, and M is a positive integer;
the data settlement module comprises:
a timestamp obtaining unit, configured to obtain to-be-processed service data D from the M to-be-processed service data in the message queueiAnd pending service data DjObtaining the service data D to be processediAnd pending service data DjRespectively and correspondingly adding timestamps; i and j are positive integers less than or equal to M;
a data deleting unit for deleting the service data D to be processed when the service data D to be processed is detectediAnd pending service data DjWhen the same, deleting the service data D to be processed in the message queuejObtaining an updated message queue; to-be-processed service data DjThe corresponding added timestamp is larger than the service data D to be processediCorrespondingly adding a time stamp;
and the business data settlement unit is used for sequentially performing settlement processing on the to-be-processed business data in the updated message queue according to the target settlement configuration information to obtain a settlement result corresponding to the to-be-processed business data in the updated message queue.
Wherein, the device still includes:
the query request acquisition module is used for acquiring a query request aiming at the settlement result in the settlement platform and determining a query user aiming at the settlement result according to the query request;
the inquiry authority determining module is used for acquiring user information corresponding to the inquiry user and determining inquiry authority information of the inquiry user aiming at the target service application according to the user information;
and the settlement result display module is used for acquiring result display dimension information corresponding to the target service application when the inquiry authority information is in an authorized state, and displaying the settlement result according to the result display dimension information.
Wherein, the device still includes:
the access configuration acquisition module is used for acquiring access configuration item sets respectively corresponding to at least two service applications in the settlement platform and respectively converting the at least two access configuration item sets into configuration data tables with the same data access structure;
and the access configuration storage module is used for carrying out isolated storage on the configuration data tables respectively corresponding to the at least two service applications in a database of the settlement platform.
Wherein, the device still includes:
the settlement configuration acquisition module is used for acquiring settlement display fields corresponding to at least two service applications in the settlement platform respectively and converting the at least two settlement display fields into settlement configuration information with the same data storage structure respectively;
and the settlement configuration storage module is used for carrying out isolated storage on settlement configuration information respectively corresponding to at least two service applications in a database of the settlement platform.
The number of the at least two settlement display fields is N, and N is a positive integer;
the settlement configuration acquisition module includes:
a data conversion unit for acquiring settlement display field F from N settlement display fieldskAcquiring a data storage structure in a settlement platform and displaying a settlement field FkConverting into candidate settlement configuration information with a data storage structure; k is a positive integer less than or equal to N;
and the semantic checking unit is used for performing semantic checking on the candidate settlement configuration information and determining the candidate settlement configuration information passing the checking as the settlement configuration information.
Wherein, the semantic check unit includes:
the first determining subunit is used for carrying out semantic inspection on the candidate settlement configuration information and determining the candidate settlement configuration information passing the inspection as the settlement configuration to be approved;
the configuration approval subunit is used for acquiring approval information associated with the to-be-approved settlement configuration, and approving the to-be-approved settlement configuration according to the approval information to obtain state information corresponding to the to-be-approved settlement configuration;
and the second determining subunit is used for determining the to-be-approved settlement configuration as the settlement configuration information if the state information is the valid state.
Wherein, the device still includes:
the configuration updating request receiving module is used for acquiring the service application to be updated corresponding to the configuration updating request and acquiring the configuration updating information corresponding to the service application to be updated when the configuration updating request in the settlement platform is received;
and the settlement configuration updating module is used for updating the settlement configuration information corresponding to the service application to be updated according to the configuration updating information, generating updated settlement configuration information, and replacing the settlement configuration information corresponding to the service application to be updated in the database with the updated settlement configuration information.
In one aspect, an embodiment of the present application provides a computer device, including a memory and a processor, where the memory is connected to the processor, the memory is used for storing a computer program, and the processor is used for calling the computer program, so that the computer device executes the method provided in the above aspect in the embodiment of the present application.
An aspect of the embodiments of the present application provides a computer-readable storage medium, in which a computer program is stored, where the computer program is adapted to be loaded and executed by a processor, so as to enable a computer device with the processor to execute the method provided by the above aspect of the embodiments of the present application.
According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided by the above-mentioned aspect.
The method and the device for processing the business data can acquire the business data to be processed accessed in the settlement platform, inquire at least two configuration data tables which are stored in an isolated mode through the same data access structure in the settlement platform to obtain a target configuration data table associated with the business data to be processed, check the business data to be processed according to access configuration information in the target configuration data table, and store the business data to be processed into a database after the check is passed; when a settlement triggering instruction aiming at the service data to be processed is received, at least two pieces of settlement configuration information which are stored in an isolated mode in the same data storage structure can be inquired in a settlement platform to obtain target settlement configuration information associated with the service data to be processed, and then settlement processing can be carried out on the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed, wherein different service applications have different configuration data tables and settlement configuration information. It can be seen that the settlement platform has a unified data access structure and a data storage structure, each business application accessed into the settlement platform can set corresponding access configuration information and settlement configuration information, the access configuration information of all the business applications is stored in the database in the form of the data access structure, and the settlement configuration information of all the business applications is stored in the database in the form of the data storage structure; any accessed service application can push the service data to be processed to a settlement platform, access configuration information and settlement configuration information corresponding to the service data to be processed are searched in the settlement platform, the service data to be processed is verified by adopting the inquired access configuration information, and the service data to be processed after the verification is passed can be settled by adopting the inquired settlement configuration information to obtain a settlement result of the service data to be processed, namely, the settlement platform can be adopted to realize data settlement processing of a plurality of service applications, so that the settlement efficiency of the service data can be improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a network architecture according to an embodiment of the present application;
fig. 2 is a schematic diagram of a data settlement scenario provided in an embodiment of the present application;
fig. 3 is a schematic flowchart of a data processing method according to an embodiment of the present application;
fig. 4 is a schematic flowchart of checking to-be-processed service data according to an embodiment of the present application;
fig. 5 is a schematic flowchart of setting settlement configuration information according to an embodiment of the present application;
FIG. 6 is a schematic diagram of an interface for settlement configuration information provided in an embodiment of the present application;
FIG. 7 is a diagram illustrating elimination of redundant data in a message queue according to an embodiment of the present application;
fig. 8 is a schematic diagram illustrating a settlement processing flow of pending service data according to an embodiment of the present application;
fig. 9 is a schematic diagram illustrating a data settlement process in a settlement platform according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a network architecture according to an embodiment of the present disclosure. As shown in fig. 1, the network architecture may include a server 10d and a user terminal cluster, which may include one or more user terminals, where the number of user terminals is not limited. As shown in fig. 1, the user terminal cluster may specifically include a user terminal 10a, a user terminal 10b, a user terminal 10c, and the like. The server 10d may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, a middleware service, a domain name service, a security service, a CDN, a big data and artificial intelligence platform, and the like. The user terminal 10a, the user terminal 10b, the user terminal 10c, and the like may each include: the smart terminal has a video/image playing function, such as a smart phone, a tablet computer, a notebook computer, a palm computer, a Mobile Internet Device (MID), a wearable device (e.g., a smart watch, a smart bracelet, etc.), and a smart television. As shown in fig. 1, the user terminal 10a, the user terminal 10b, the user terminal 10c, etc. may be respectively connected to the server 10d via a network, so that each user terminal may interact data with the server 10d via the network.
Taking the user terminal 10a as an example, a settlement platform may be started in the user terminal 10a, where the settlement platform may refer to a system formed by a series of code logics, the settlement platform may access the service applications in the electronic map, configure different service applications by using a data structure specified in the settlement platform, and store configuration information corresponding to each service application in the database. The server 10d may be a background server corresponding to the settlement platform, and may be configured to store configuration information corresponding to service data in different service applications, perform settlement on the corresponding service data according to the configuration information, transmit the settlement result to the user terminal 10a, and display the settlement result according to different dimension information in the settlement platform of the user terminal 10 a. It can be understood that different service data (e.g., road data, bus data, store data, etc.) can be introduced into the electronic map, different service data can be settled in different settlement manners, and the settlement platform is configurable, that is, the settlement platform can provide a configuration function for different service data, and the settlement processing process for different service data can be realized by using the settlement platform, so that the settlement efficiency of the service data can be improved.
Referring to fig. 2, fig. 2 is a schematic view of a data settlement scenario provided in an embodiment of the present application. The following describes a settlement process of service data in an electronic map production job, taking a settlement platform in the user terminal 10a as an example. As shown in fig. 2, when the business application a accesses the settlement platform 20f, configuration information associated with the business application a needs to be set in the settlement platform 20f, where the configuration information includes an access configuration item set 20a and a settlement configuration item set 20b for the business application a, for example, the access configuration item set 20a may include an access configuration item 1, an access configuration item 2, an access configuration item 3, and the like, and the settlement configuration item set 20b may include a settlement configuration item 1, a settlement configuration item 2, a settlement configuration item 3, and the like; the user terminal 10a may store the access configuration item set 20a and the settlement configuration item set 20b in the database 20e, respectively. When the business application B accesses the settlement platform 20f, configuration information associated with the business application B needs to be set in the settlement platform 20f, where the configuration information includes an access configuration item set 20c and a settlement configuration item set 20d for the business application B, for example, the access configuration item set 20c may include an access configuration item 4, an access configuration item 5, an access configuration item 6, and the like, and the settlement configuration item set 20d may include a settlement configuration item 4, a settlement configuration item 5, a settlement configuration item 6, and the like; the user terminal 10a may store the access configuration item set 20c and the settlement configuration item set 20d in the database 20e, respectively. In other words, after each service application is accessed to the settlement platform 20f, a corresponding access configuration item set and settlement configuration item set may be set for each service application in the settlement platform 20 f. The access configuration item sets corresponding to different service applications can adopt the same data access structure to perform isolated storage in the settlement platform; the settlement configuration item sets corresponding to different service applications may adopt the same data storage structure to perform isolated storage in the settlement platform, for example, the access configuration item set may be a storage table structure. Of course, in order to perform security control on different service applications in the settlement platform, service data corresponding to the different service applications may also be stored in an isolated manner.
After the service application a and the service application B access the settlement platform 20f, both the service application a and the service application B may establish a communication connection with the settlement platform 20f, and each service application may transmit service data to the settlement platform 20f through the communication connection. When a service application a generates new service data a, the service application a may access the service data a to the settlement platform 20f, and after receiving the service data a accessed by the service application a, the settlement platform 20f may obtain an access configuration item set 20a associated with the service application a from the database 20e, check the service data a according to the access configuration items included in the access configuration item set 20a, and when the service data a passes the check, store the service data a in a message queue, where the message queue is used to store the checked and unpattled service data. For example, the access configuration item 1 may be represented as a value domain (which may be understood as a value range of the service data), the access configuration item 2 may be represented as a reconciliation mode, and when the service data a belongs to the value domain represented by the access configuration item 1, and meets a reconciliation condition corresponding to the reconciliation mode, and also meets the remaining access configuration items included in the access configuration item set 20a, it may be determined that the service data passes the inspection.
For the service data (including service data a) stored in the message queue, the service data contained in the message queue can be triggered to perform settlement processing through modes of configuration updating, manual triggering, timing task and the like. When the settlement platform 20f obtains the manual trigger instruction for the message queue, the data settlement range in the message queue may be determined according to the manual trigger instruction, and further, according to the settlement configuration items included in the settlement configuration item set 20b, the settlement processing may be performed on the service data belonging to the data settlement range, so as to obtain a settlement result corresponding to the service data, and the settlement result may be stored in the database 20 e. The data settlement range can be a time range or a geographical area range; for example, the service application a may be expressed as road data, and the service data to be subjected to the settlement processing may be service data of the service application a in a time range from T1 to T2, or service data of the service application a in an xx street area.
Optionally, the service data included in the message queue may trigger settlement in a manner of a timing task, for example, a settlement period for the service application a may be configured in the settlement configuration item set 20b, when the system time in the settlement platform 20f meets the settlement period, the settlement platform 20f may obtain a timing task trigger instruction for the message queue, perform settlement processing on the service data of the service application a included in the message queue according to the timing task trigger instruction, and obtain a settlement result corresponding to the service application a. Optionally, when the settlement configuration in the settlement configuration item set 20b stored in the database 20e is changed, the settlement platform 20f may be triggered to perform settlement processing on the service data of the service application a included in the message queue, so as to obtain a settlement result corresponding to the service application a.
It can be understood that the settlement results corresponding to the business application a may be displayed in the settlement platform 20f, as shown in fig. 2, if the user queries the settlement platform 20f for the data settlement results of the business application a in the geographic area-a and the geographic area-B, the settlement results corresponding to the business application a may be displayed hierarchically, for example, the business application a includes the area-a and the area-B, the area a may include the area-a 1 and the area-a 2, and the area B may include the area-B1 and the area B2; the settlement result for region-a 1 is: result aa, the settlement result for region-B is: result bb, area-A1 corresponds to a settlement result of: result cc, region-A2 corresponds to a settlement result of: result dd, area-B1 corresponds to a settlement result of: result ee, settlement result for region-B2 is: the result ff; here, the sum of result cc and result dd is result aa, and the sum of result ee and result ff is result bb.
In the application, different service applications can be configured through a unified configuration data structure, the data settlement processing process of the different service applications can be completed in one settlement platform, and the data settlement efficiency can be improved.
Referring to fig. 3, fig. 3 is a schematic flow chart of a data processing method according to an embodiment of the present disclosure. As can be appreciated. The data processing method may be executed by a computer device, which may be a user terminal, or an independent server, or a server cluster composed of a plurality of servers, or a system composed of a server and a user terminal, or a computer program application (including program code), and is not limited specifically herein. As shown in fig. 3, the data processing method may include the steps of:
step S101, acquiring service data to be processed accessed in a settlement platform, and inquiring at least two configuration data tables which are stored in an isolated manner by using the same data access structure in the settlement platform to obtain a target configuration data table associated with service application to which the service data to be processed belongs; at least two configuration data tables respectively correspond to different service applications.
Specifically, different service applications can be accessed in the settlement platform, and all the service applications accessed to the settlement platform can push service data generated by the service applications to the settlement platform. When detecting that new service data is accessed into the settlement platform, the computer device may obtain the new service data accessed into the settlement platform, where the new service data refers to the service data that needs to be settled, and thus the new service data may be referred to as service data to be processed. The computer device may determine the service application providing the service data to be processed as a target service application, and obtain a service identifier (e.g., a service name, a service number, a service identifier symbol, etc.) corresponding to the target service application, and further may query, according to the service identifier, at least two configuration data tables that are separately stored in the same data access structure in the settlement platform, and determine the configuration data table corresponding to the service identifier as a target configuration data table of the target service application in the settlement platform, that is, a target configuration data table corresponding to the service data to be processed.
The service application may refer to one or more service lines included in the integrated system; for example, when the integrated system is an electronic map application, the business application at this time may include a road, a public transportation, a Point of interest (POI) and other business lines, where the POI may refer to a hotel, a shop, a gas station, a hospital, a station and the like in the electronic map; when the integrated system is applied to the e-commerce, the service application can comprise service lines such as clothes, skin care cosmetics, accessories, numbers, household appliances, books and the like; when the integrated system can be a financial management system, the business application at this time can be a business line of process management, fund management, interface management, content management and the like. The settlement platform can establish communication connection with the accessed service applications, and the settlement platform can preset interval time periods respectively corresponding to each service application, namely the settlement platform can request the service data to be processed from the corresponding service application through the communication connection every other interval time period; or after the service application generates the service data to be processed, the service data to be processed may be actively pushed to the settlement platform in the form of a message queue, that is, after the service application generates the service data to be processed, the service data to be processed may be added to the message queue, and once the settlement platform monitors that new service data to be processed is added to the message queue, the service data to be processed may be obtained from the message queue, and the message queue at this time may refer to a message queue of the service data to be processed in an access phase, and may also be referred to as a data access message queue.
It can be understood that, when there is access of the service application a to the settlement platform, the user of the service application a can set the access configuration item of the service application a in the settlement platform. When the user sets the access configuration item associated with the service application a in the settlement platform and selects to store, the computer device may acquire all the access configuration items associated with the service application a in the settlement platform, and form an access configuration item set a with the acquired access configuration items, that is, one service application may correspond to one access configuration item set. The access configuration item set a may include information such as a data check item and a reconciliation manner corresponding to the service application a; the number of the access configuration items included in the access configuration item set a may be one or more, and in the implementation of the present application, the number of the access configuration items may be determined according to the actual service requirement of the service application a. The computer device can obtain a data access structure in the settlement platform, convert the access configuration item set A into a configuration data table A with the data access structure, and store the configuration data table A into a database corresponding to the settlement platform. The database may be a local database in the settlement platform, or may be a cloud database in a cloud server (the settlement platform may access the database).
When at least two service applications are accessed into the settlement platform, the computer equipment can acquire access configuration item sets respectively corresponding to the at least two service applications in the settlement platform, the at least two access configuration item sets are respectively converted into configuration data tables with the same data access structure, and the configuration data tables respectively corresponding to the at least two service applications can be stored in a database of the settlement platform in an isolated manner, namely different service applications correspond to different configuration data tables, and the different configuration data tables are mutually independent; the settlement platform can access all the configuration data tables stored in the database, and the service application can only access the self configuration data tables stored in the database, but cannot access the configuration data tables corresponding to other service applications. For example, the configuration data table corresponding to the service application a is: the configuration data table A, the configuration data table corresponding to the service application B is: the configuration data table B is independent from the configuration data table A at the moment, and the settlement platform has the right to access the configuration data table A and the configuration data table B; the service application A has the right to access the configuration data table A and does not have the right to access the configuration data table B; the service application B has the right to access the configuration data B and does not have the right to access the configuration data table A.
Step S102, according to the access configuration information in the target configuration data table, the service data to be processed is checked to obtain a check result corresponding to the service data to be processed, and if the check result is a correct check result, the service data to be processed is stored in a database.
Specifically, the computer device may read the access configuration information in the target configuration data table, and may check the to-be-processed service data according to the access configuration information to obtain a check result corresponding to the to-be-processed service data. When the service data to be processed meets each access configuration item in the access configuration information, determining that a verification result corresponding to the service data to be processed is a correct verification result, and storing the service data to be processed into a database corresponding to a settlement platform; when the service data to be processed has the access configuration item which does not meet the condition, the check result corresponding to the service data to be processed can be determined as a check error result, that is, the service data to be processed is abnormal data, and alarm information can be sent to the target service application which improves the service data to be processed, wherein the alarm information is used for prompting that the target application needs to push the service data to be processed again. It should be noted that the database storing the to-be-processed service data and the database storing the configuration data table may refer to the same database or different databases.
Optionally, the verification process of the to-be-processed service data may be executed in the consuming process. After the target service application is accessed in the settlement platform and the target configuration data table corresponding to the target service application is stored in the database, a new consumption process can be established for the target service application in the settlement platform, and the consumption process can be used for accessing, verifying and storing the service data to be processed. The number of consumption processes of the target business application can be set according to the business data scale of the target business application, and the larger the business data scale is, the larger the number of consumption processes is. In other words, a plurality of consuming processes can be started simultaneously in the settlement platform to verify the pending service data.
Optionally, the access configuration information may include an account checking manner, and the process of checking the to-be-processed service data by the computer device may include account checking processing of the to-be-processed service data. At this time, the computer device can acquire an account checking mode contained in the access configuration information, and perform account checking processing on the to-be-processed service data according to the account checking mode; when the business data to be processed meets the reconciliation condition corresponding to the reconciliation mode, determining that the verification result corresponding to the business data to be processed is a correct verification result, and storing the business data to be processed and the reconciliation record corresponding to the business data to be processed in a database of a settlement platform. And when the business data to be processed does not meet the account checking condition corresponding to the account checking mode, determining that a checking result corresponding to the business data to be processed is a checking error result, transmitting warning information to a target business application providing the business data to be processed, wherein the warning information is used for indicating the target business application to perform problem troubleshooting on the business data to be processed, and pushing the business data to be processed to a settlement platform again.
The reconciliation processing can be checking data records corresponding to the target business application in the computing platform and to-be-processed business data provided by the target business application; the reconciliation condition may include a time range, a quantity of the business data, a number of reconciliation retries, and the like. If the time for accessing the to-be-processed service data into the settlement platform belongs to the time range in the reconciliation condition, the quantity of the to-be-processed service data does not exceed the quantity of the service data in the reconciliation condition, and the reconciliation times of the to-be-processed service data is less than the reconciliation retry times in the reconciliation condition, the verification result corresponding to the to-be-processed service data can be determined to be a correct verification result, and then the to-be-processed service data and a reconciliation record generated in the reconciliation processing process of the to-be-processed service data can be stored in a database of the settlement platform. If the time for accessing the to-be-processed service data into the settlement platform exceeds the time range in the reconciliation condition, or the number of the to-be-processed service data exceeds the number of the service data in the reconciliation condition, or the reconciliation times of the to-be-processed service data exceeds the reconciliation retry times in the reconciliation condition, the verification result corresponding to the to-be-processed service data can be determined as a verification error result, namely, the reconciliation is not uniform, and then the alarm information aiming at the to-be-processed service data can be generated and transmitted to the target service application. After receiving the alarm information transmitted by the settlement platform, the target service application can perform specific problem investigation on the previously pushed service data to be processed based on the alarm information, and can push the service data to be processed to the settlement platform again after specific problems are investigated.
Referring to fig. 4, fig. 4 is a schematic flowchart illustrating a process of verifying pending service data according to an embodiment of the present application. As shown in fig. 4, when a new service application is accessed in a settlement platform, a field name, a type, a value field, a default value, a primary key, a minimum strength, an index, an alarm configuration, a reconciliation mode, and the like may be set in the settlement platform; the field name may refer to an identifier corresponding to an access configuration item associated with the new service application; the type may refer to a service type corresponding to the new service application; the value range may refer to a value range of service data to be processed in the new service application, for example, the provider value range is [ a, B, C ], which indicates that the service data to be processed is accessed to the settlement platform, and may be service data provided by the provider a, the provider B, and the provider C; the default value (also referred to as default value) may refer to an initial value of an attribute or parameter corresponding to the new service application before being modified, for example, the time-consuming default value may be 0; a primary key (primary key) may refer to one or more fields in a data table, and a value of the primary key may be used to uniquely identify a record in the data table, e.g., a task id; the minimum strength can be understood as a service attribute, and the minimum strength can be used for being associated with other attributes when the to-be-processed service data is checked, and is the finest granularity of the to-be-processed service data; the index can refer to index information corresponding to the data table; the alarm configuration can be used for setting alarm frequency and alarm personnel; the reconciliation mode can be used for setting a reconciliation condition corresponding to the new business application, and the reconciliation condition can include a time range, the quantity of business data, the number of reconciliation retries and the like.
The computer equipment can newly establish a configuration data table for the new service application according to the set information such as the field name, the type, the value field, the default value, the main key, the minimum strength, the index, the alarm configuration, the account checking mode and the like, and the data structure of the configuration data table can be a data access structure in a settlement platform (can be a data table structure in a relational database); and then, a new consumption process can be established for the new service application, the consumption process can be used for receiving, verifying and storing the service data to be processed, and the new establishment number of the consumption process can be set to a specific numerical value according to the service data scale of the new service application. When the to-be-processed service data in the new service application is accessed to the settlement platform, the computer device may consume data in a newly-created consumption process (the consumption data may refer to receiving, verifying, and storing the to-be-processed service data in the new service application), and the computer device may verify the received to-be-processed service data in the consumption process, where the specific verification process may refer to the description in step S102, and is not described here again. When the to-be-processed service data is correctly verified, the to-be-processed service data can be stored in a database in the settlement platform; when the service data to be processed is checked to be wrong, alarm information can be generated and transmitted to the new service application, and the new service application pushes the service data to be processed to the settlement platform again.
The computer equipment can perform account checking processing on the to-be-processed business data according to the accounting mode in the configuration data table, and when the account checking of the to-be-processed business data is correct, account checking records of the to-be-processed business data in the account checking process can be stored in the database; when the account of the service data to be processed is not aligned, alarm information can be generated and transmitted to the new service application, and the new service application pushes the service data to be processed to the settlement platform again. Optionally, the reconciliation processing of the to-be-processed service data may belong to a verification process of the to-be-processed service data.
Step S103, when receiving a settlement triggering instruction aiming at the service data to be processed, inquiring at least two pieces of settlement configuration information which are stored in an isolated way in the same data storage structure in a settlement platform to obtain target settlement configuration information associated with the service application to which the service data to be processed belongs; at least two settlement configuration information respectively correspond to different service applications.
Specifically, the computer device may perform batch settlement processing on the accessed to-be-processed service data in the settlement platform. When the settlement platform receives a settlement triggering instruction aiming at the service data to be processed, at least two pieces of settlement configuration information which are stored in an isolated manner by using the same data storage structure can be inquired in the settlement platform to obtain target settlement configuration information associated with a target service application to which the service data to be processed belongs, and the at least two pieces of settlement configuration information respectively correspond to different service applications. The settlement trigger command may be generated by a timer task, a manual trigger, or a change in configuration.
Optionally, a timing task may be set in the settlement platform, and when a trigger condition of the timing task is reached, settlement processing of the to-be-processed service data in the settlement platform may be triggered. For example, if the trigger condition of the timing task is zero-time-of-day, the timing task at zero-time-of-day may trigger the data settlement processing operation in the settlement platform, that is, the settlement platform may receive a settlement trigger instruction for the service data to be processed at zero-time-of-day, and then may query the target settlement configuration information associated with the service data to be processed in the settlement platform. It should be noted that, when data settlement is triggered each time, the settled to-be-processed service data are different, that is, after the to-be-processed service data are settled, the state of the part of to-be-processed data can be updated to the processed service data, so that repeated calculation can be avoided.
Optionally, the settlement platform may provide a data settlement function control, a user (e.g., an operation and maintenance person) may perform a trigger operation on the data settlement function control in the settlement platform, and the settlement platform may respond to the trigger operation for the data settlement function control, that is, receive a settlement trigger instruction generated by the trigger operation, and further may query, in the settlement platform, target settlement configuration information associated with the to-be-processed service data. Optionally, the user of data settlement may further set a settlement range of the to-be-processed service data in the settlement platform, such as a time range and a provider for specifying the to-be-processed service data, and then perform a trigger operation on the data settlement function control, and the settlement platform in the computer device may perform settlement processing only on the to-be-processed service data within the settlement range.
Optionally, the settlement configuration information stored in the settlement platform may be updated, and the settlement platform may provide a configurable configurator, that is, a user (e.g., a provider) may input information such as a service application type and the like in the settlement platform to query settlement configuration information that is desired to be changed, and the computer device may display the queried settlement configuration information in a client of the settlement platform; the user can change the original settlement configuration information and store the changed settlement configuration information, the computer equipment can generate a settlement trigger instruction according to the change result of the settlement configuration information at the moment and determine the changed settlement configuration information as target settlement configuration information, and the to-be-processed service data needing data settlement can be service data provided by the service application corresponding to the changed settlement configuration information.
It can be understood that when the service application is accessed to the settlement platform, the corresponding settlement configuration information needs to be set for the service application, and after the settlement configuration information is set in the settlement platform, the settlement processing can be performed on the service data to be processed according to the settlement configuration information. When settlement configuration information corresponding to the service application is set in the settlement platform, the settlement display field can be input in the settlement platform, and then the settlement display field can be converted into settlement configuration information with a data storage structure. In other words, when at least two service applications are accessed in the settlement platform, and a user (such as an operation and maintenance person) inputs a settlement display field for each service application in the settlement platform, the computer device may obtain the settlement display fields corresponding to the at least two service applications in the settlement platform, respectively convert the at least two settlement display fields into settlement configuration information having the same data storage structure, and separately store the settlement configuration information corresponding to the at least two service applications in a database of the settlement platform, that is, different service applications correspond to different settlement configuration information, and the different settlement configuration information are independent of each other.
Wherein, assuming that the number of at least two service applications is N, the number of settlement display fields is also N, wherein N is a positive integer; selecting one service application k from N service applications at will, wherein the settlement display field corresponding to the service application k can be expressed as a settlement display field FkWherein k is a positive integer less than or equal to N. The process of determining the settlement configuration information corresponding to the service application k may include: the computer equipment can obtain the data storage structure in the settlement platform and display the settlement field FkAnd converting the data into candidate settlement configuration information with a data storage structure, and further performing semantic check on the candidate settlement configuration information, wherein the checked candidate settlement configuration information is determined as settlement configuration information, and the semantic check can be syntax and lexical check. Furthermore, after the computer device passes the grammar and lexical examination of the candidate settlement configuration information, the candidate settlement configuration information can enter an approval process, that is, the computer device can determine the candidate settlement configuration information passing the grammar and lexical examination as the to-be-approved settlement configuration, further can acquire approval information associated with the to-be-approved settlement configuration, approve the to-be-approved settlement configuration according to the approval information, and obtain state information corresponding to the to-be-approved settlement configuration; if the state information is an effective state, determining the to-be-audited settlement configuration as settlement configuration information, wherein the settlement configuration information can be used for performing settlement processing on to-be-processed business data of the business application k; if the status information is to be updatedAnd if the pending settlement configuration is not approved, the pending settlement configuration indicates that the pending settlement configuration is configuration information which is not valid, and at this time, the business application k does not have valid settlement configuration information in the settlement platform, so that the pending business data corresponding to the business application k cannot be settled temporarily.
Referring to fig. 5, fig. 5 is a schematic view illustrating a process of setting settlement configuration information according to an embodiment of the present application. As shown in fig. 5, in an actual application, when the settlement configuration information of the service application a needs to be changed, or the settlement configuration information is added to the service application a, the user may trigger the configuration change function or the configuration add-on function in the settlement platform, at this time, the computer device may respond to a trigger operation for the configuration change function or the configuration add-on function, and may query the settlement configuration information corresponding to the service application a in the settlement platform, and if the computer device queries the settlement configuration information corresponding to the service application a in the settlement platform, that is, the service application a has the settlement configuration information in the settlement platform, it may be determined that the state of the settlement configuration information corresponding to the service application a is about to be converted into the state to be updated, so as to implement the update process of the settlement configuration information. In other words, before the settlement configuration information corresponding to the service application a is updated, the to-be-processed service data, which is provided by the service application a and has not yet been subjected to the settlement processing in the settlement platform, needs to be subjected to the settlement processing, that is, the to-be-processed service data corresponding to the service application a needs to be cleared, which may also be referred to as order clearing; and then, the updated settlement configuration information input by the user in the settlement platform can be acquired, and the updated settlement configuration information can be adopted to perform settlement processing on the to-be-processed service data accessed to the settlement platform after the service application A triggers the configuration updating function.
If the computer device does not inquire the settlement configuration information corresponding to the business application a in the settlement platform, that is, the business application a does not have the settlement configuration information in the settlement platform, the user can input a settlement display field in the settlement platform, for example, a settlement month (which may be called a settlement period), a settlement object (for example, a supplier, an operator in the electronic map production operation, and the like), a price package, a yield package, a measurement dimension, an approval configuration, and the like can be set for the business application a; wherein, price package can mean a calculation formula for defining unit price; a yield package may refer to a calculation formula for calculating yield; the measurement dimension may refer to an association relationship between the calculation object and configuration information such as each package; approval configuration may refer to adding an approval flow to each configuration information.
Referring to fig. 6, an interface display request for a user to input a settlement display field in a settlement platform is shown, and fig. 6 is an interface schematic diagram of settlement configuration information provided in an embodiment of the present application. As shown in fig. 6, in the process of setting settlement configuration information for a service application a, a corresponding configurator may be automatically generated according to field configuration corresponding to the service application a (for example, field information set when accessing to a settlement platform), where the configurator may be used to set a package, and a chinese part in the package is bound to a service application corresponding to the package, for example, the package corresponding to the service application a may be represented as: (three-way picture flow + three-way trace flow) × 28. It should be noted that, when setting settlement configuration information for different service applications in the settlement platform, the configurator structure corresponding to different service applications is the same as that shown in fig. 6, and the difference is only that the descriptions (such as numbers, operation symbols, and fields) in the configurator are different.
Further, as shown in fig. 5, after acquiring the settlement display field input by the user in the configurator, the computer device may acquire a data storage structure in the settlement platform, establish a mapping relationship between the settlement configuration information and the service application a based on the data storage structure, and automatically generate the settlement configuration information corresponding to the service application a. Subsequently, the computer device may perform syntax and lexical checking on the settlement configuration information, for example, check whether the settlement configuration information conforms to the syntax and the lexical of the database language, and after the settlement configuration information passes the syntax and the lexical checking, add the production line corresponding to the service application a to the message queue to be settled, where the production line may be used to distinguish different service applications, and the different service applications may correspond to different production lines, that is, add the service data to be processed corresponding to the service application a to the message queue to be settled; at the same time, the settlement configuration information may also be added to the database.
Optionally, if the settlement configuration information includes approval configuration, the settlement configuration information stored in the database needs to be approved, approval information associated with the service application a can be acquired, the settlement configuration information is approved according to the approval information, if the approval of the settlement configuration information passes, the settlement configuration information is valid settlement configuration information, and to-be-processed service data (production line) corresponding to the service application a can be triggered to perform data settlement processing; if the approval of the settlement configuration information is not passed, the settlement configuration information is invalid, at this time, the configuration state corresponding to the service application a may be set to "to be updated", and the approval or the change of the settlement configuration information may be waited. Optionally, if the settlement configuration information does not include the approval configuration, the settlement configuration information stored in the database may be directly determined as valid settlement configuration information. A configurable configurator is provided for users in the settlement platform, so that the applicability of the settlement platform can be improved, the settlement period corresponding to the service data can be reduced, and the settlement efficiency of the service data can be improved.
Optionally, after the user triggers the data settlement function in the settlement platform, the computer device may receive the configuration update request in the settlement platform, and further may obtain the service application to be updated corresponding to the configuration update request, and obtain the configuration update information corresponding to the service application to be updated; the computer equipment can update the settlement configuration information corresponding to the service application to be updated according to the configuration update information, generate updated settlement configuration information, and replace the settlement configuration information corresponding to the service application to be updated in the database with the updated settlement configuration information. Before configuration updating information corresponding to the service application to be updated is acquired, settlement processing needs to be performed on service data to be processed, which is provided by the service application to be updated in the settlement platform and is not subjected to settlement processing, and the service data to be processed, which is provided by the service application to be updated in the settlement platform, needs to be emptied. After clearing, acquiring configuration updating information corresponding to the service application to be updated, generating updated settlement configuration information according to the configuration updating information, wherein the updated settlement configuration information also needs to be checked by grammar and lexical method, and the settlement configuration information corresponding to the service application to be updated in the database can be replaced by the updated settlement configuration information after the check of the grammar and the lexical method is passed; the updated settlement configuration information also needs to be approved, after the approval is passed, the updated settlement configuration information is represented as effective settlement configuration information, and then data settlement processing can be carried out according to the updated settlement configuration information.
And step S104, performing settlement processing on the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed.
Specifically, after determining the target settlement configuration information corresponding to the service data to be processed, the computer device may load the target settlement configuration information, obtain a settlement function (also referred to as a calculation formula) associated with the service data to be processed, split the service data to be processed into at least two sub-service data according to parameter information in the settlement function, input the at least two sub-service data into the settlement function, and determine a settlement result corresponding to the service data to be processed according to the settlement function. The settlement function may refer to a package (e.g., price package, yield package) in the target settlement configuration information, and splits the to-be-processed service data based on the number of parameters in the settlement function, and inputs at least two pieces of sub-service data obtained by splitting into the settlement function to obtain a settlement result corresponding to the to-be-processed service data; as shown in fig. 6, the settlement function obtained after loading the target settlement configuration information may be represented as: (three-party picture flow + three-party track flow) × 28, the computer device can divide the service data to be processed into the three-party picture flow and the three-party track flow, and the divided three-party picture flow and the three-party track flow are input into a settlement function, so that a settlement result corresponding to the service data to be processed can be obtained.
Optionally, the service data to be processed can be put into a message team to be settledIn the column, in order to improve the processing efficiency of the to-be-processed service data, batch settlement processing may be performed on the to-be-processed service data in the settlement platform, that is, settlement processing may be performed on a batch of to-be-processed service data in the settlement platform each time settlement is triggered. The database in the settlement platform may include a message queue to be settled, the message queue to be settled may be configured to store service data to be processed, and when the number of the service data to be processed is M (where M is a positive integer), the computer device may obtain service data D to be processed from the M service data to be processed in the message queueiAnd pending service data DjAnd obtaining the service data D to be processediAnd pending service data DjRespectively and correspondingly adding timestamps, wherein i and j are positive integers less than or equal to M; when the pending service data D is detectediAnd pending service data DjWhen the same, deleting the service data D to be processed in the message queuejTo obtain an updated message queue, at which the pending service data D is to be processedjThe corresponding added timestamp is larger than the service data D to be processediAnd correspondingly adding the timestamp, and further sequentially settling the to-be-processed service data in the updated message queue according to the target settlement configuration information to obtain a settlement result corresponding to the to-be-processed service data in the updated message queue. In other words, there is pending service data D in the message queueiAnd pending service data DjWhen the message queue is the same as the message queue, the redundant data exists in the message queue, so that only the to-be-processed service data with the smallest added timestamp can be reserved in the message queue, and the redundant data in the message queue is prevented from being repeatedly calculated.
Optionally, the message queue to be settled may include a plurality of production lines corresponding to the service applications, each production line may be added to the message queue in a message form, and each production line may include at least one service data to be processed. The message queue can include a plurality of messages of the same service application, and the settlement configuration information corresponding to the same service application is the same, so that the plurality of messages of the same service application can be combined to obtain a combined new message, the adding time stamp of the combined new message is updated, and the computer equipment can perform settlement processing on the new message in the message queue according to the adding time stamp sequence.
Optionally, to improve the performance of the settlement platform, the calculation result of the service data to be processed may be preprocessed, for example, stored by day or hour, the result of all packages included in the settlement configuration information may be calculated, and streaming calculation may be used.
Referring to fig. 7, fig. 7 is a schematic diagram illustrating elimination of redundant data in a message queue according to an embodiment of the present application. As shown in fig. 7, the message queue to be settled includes a message 30a, a message 30b, and a message 30c, and each message may correspond to one or more pieces of service data to be processed; because the message 30a and the message 30c are the same, the data range executed by the message 30a and the message 30c is the same, the computer device only executes the logic triggered after the message 30a and the message 30b, and is the same as the logic triggered after the message 30a, the message 30b, and the message 30c, so the message 30a and the message 30c can be merged to obtain a merged message 30d, and the message 30d can refer to merging the to-be-processed service data corresponding to the message 30a and the message 30c to obtain a message 30d, and further can execute a settlement operation on the to-be-processed service data corresponding to the message 30b and the message 30d in the message queue according to the timestamp inserted in the message queue by the message 30b and the message 30 d.
Optionally, the computer device may store the settlement result corresponding to the service data to be processed in the database of the settlement platform. A provider in the service application can inquire corresponding settlement results in the settlement platform, when the computer equipment acquires an inquiry request aiming at the settlement results in the settlement platform, an inquiry user aiming at the settlement results can be determined according to the inquiry request, further user information corresponding to the inquiry user can be acquired, and inquiry authority information of the inquiry user aiming at the target service application is determined according to the user information; when the inquiry authority information is in an authorized state, acquiring result display dimension information corresponding to the target service application, and displaying the calculation result according to the result display dimension information; when the inquiry authority information is in an unauthorized state, the inquiry user is identified not to have the authority of inquiring the settlement result, so that the settlement result cannot be displayed in the settlement platform. Wherein, the result display dimension information may include but is not limited to: geographic region, time period, provider, type of service, etc.; for example, the settlement results may be displayed hierarchically according to the geographic region, the settlement results may be displayed according to provinces, the settlement results corresponding to each province may be further displayed according to a city, the settlement results corresponding to each city may be further displayed according to a county city, and the like; for example, the settlement result may be displayed for each supplier, and the settlement result may be displayed for each of the suppliers a, B, C, and the like. It is understood that the hierarchical presentation form of the settlement result may be set in the settlement platform, that is, the hierarchical presentation configuration information may be added when setting the access configuration item set.
Referring to fig. 8, fig. 8 is a schematic diagram illustrating a settlement processing flow of pending service data according to an embodiment of the present application. As shown in fig. 8, when data settlement is triggered by a timing task, a manual trigger, a configuration change, or the like, a computer device may receive a data settlement instruction, and further put a production line primary key associated with the data settlement instruction into a message queue to be settled, where the production line primary key may be a primary key in a configuration data table corresponding to a business application; the service data to be processed in the message queue may be sorted according to the timestamps added to the message queue, and settlement processing is performed on the service data to be processed in the message queue according to the sorting order of the timestamps. A computing module in the settlement platform may compute the to-be-processed service data in the message queue in a distributed computing form, for example, may use zset of Redis as the message queue, use a timestamp inserted into the message queue as a score, insert the to-be-processed service data into the message queue later, and execute settlement operations later, where Redis (remote Dictionary server), which is a remote Dictionary service, is an open-source database written using ANSI C (standard of C language), supports a network, a log-type database and a Key-Value database that may be based on a memory or may be persistent, and provides application program interfaces of multiple languages; zset is an ordered set of Redis.
A settlement module of the settlement platform can provide workflow and intelligent downloading service, the intelligent downloading service is a common requirement of each service application, and can be used for downloading original service data corresponding to settled service data, if the data volume of the original service data exceeds a quantity threshold (which can be preset, such as the quantity threshold is 30000), the original service data can be added into a downloading queue, and meanwhile, asynchronous processing can be performed, and a data downloading address is informed; if the data volume of the original service data does not exceed the quantity threshold, synchronous downloading can be directly carried out. The to-be-processed business data which is subjected to settlement processing can be filed, and the state of the to-be-processed business data is set to be a final state; if the state corresponding to the service data newly added into the database is the final state, a warning can be sent out to mark the service data as abnormal data. For the settlement result corresponding to the to-be-processed service data, the dimension information can be displayed based on different results, and hierarchical display is performed in the settlement platform.
It should be noted that the settlement platform in the embodiment of the present application may include a data access module, a configuration module, a calculation module, a settlement module, a report display module, and an authority module. Decoupling among modules in the settlement platform can be carried out through microservice.
The data access module can be used for configuring field names, main keys, indexes, types, value range ranges, alarm configuration, account checking modes and the like. The service data to be processed can be pushed to a settlement platform through a message queue; after the settlement platform acquires the service data to be processed, access configuration information corresponding to the service data to be processed can be acquired, the service data to be processed is verified according to the access configuration information, if the service data to be processed is abnormal (namely the service data to be processed does not pass the verification), warning information is sent to the service application, and the service application is required to push the service data to be processed again; and if the data is correct (namely the service data to be processed passes the verification), storing the data into the database. The settlement platform can also trigger reconciliation according to a reconciliation mode in the access configuration information, if the reconciliation is correct, a reconciliation record can be stored, and if the reconciliation is abnormal, warning information is sent to the business application. The service data to be processed accessed to the settlement platform can be stored in a database of the settlement platform in an isolated manner according to different service applications.
The configuration module may include a settlement month configuration, a price package configuration, a yield package configuration, and a settlement object configuration (e.g., a configuration provider), and each configuration information may set a hierarchical approval flow, for example, a hierarchical approval flow corresponding to a yield package configuration may be: project responsible person- > department responsible person- > general manager, namely the configuration of the yield package can enter a hierarchical examination and approval process after being set, the project responsible person firstly conducts examination and approval, the project responsible person submits to the department responsible person after passing the examination and approval, the department responsible person submits to the general manager after passing the examination and approval, and the general manager shows that the configuration of the yield package is effective configuration information after passing the examination and approval. The measurement dimension can be used for setting the association relationship between the minimum settlement strength and the settlement period, the settlement object, the yield package and the price package respectively.
The calculation module may be used to set the calculation frequency. Ways to trigger settlement in the settlement platform include, but are not limited to: timing tasks, configuration changes, manual triggers, etc. If redundant messages (which can be understood as the same service data to be processed) exist in the message queue waiting for settlement, the redundant messages can be combined to avoid repeated calculation.
The settlement module can be used for setting the display level of the settlement result, configuring the workflow, defining the settlement state (final state declaration), downloading corresponding original data (intelligent downloading: adding the data into a downloading queue for asynchronous execution if the downloading exceeds a threshold value) and other configuration information; and after the record of the service data to be processed is set to the final state, archiving the original service data to be processed.
The report system can perform summary processing on the calculation result in different dimensions according to the actual requirements of the industrial application and display the calculation result in different modes. The authority module can be used for defining roles, groups and authorities so as to perform security control on relevant data (including to-be-processed service data, access configuration information, settlement results, account checking records and the like) corresponding to the individual service applications in the settlement platform.
The settlement platform in the embodiment of the application can provide a general access and configuration mode, can perform high multiplexing and is decoupled from service logic. The data access configuration can be transferred to each business application, the settlement configuration (such as price and yield configuration) can be transferred to operation and maintenance personnel of the settlement platform, the change of the settlement configuration information can be effective in real time, and further the settlement period of the business data can be greatly shortened.
Referring to fig. 9, fig. 9 is a schematic diagram of a data settlement process in a settlement platform according to an embodiment of the present disclosure. As shown in fig. 9, the complete flow of data settlement in the settlement platform may include: when the service application is accessed into the settlement platform, data access configuration information, settlement configuration information and the like can be set through the data access module and the configuration module, and the access configuration information, the settlement configuration information and the like are stored in the database. When service data to be processed in service application is accessed to a settlement platform, access configuration information and settlement configuration information corresponding to the service data to be processed can be inquired in the settlement platform, and then the service data to be processed can be verified according to the access configuration information, wherein the verification process can comprise two stages: checking the service data to be processed in the first stage, entering the second stage after the service data to be processed is checked to be correct, checking the account of the service data to be processed in an account checking mode accessed into the configuration information, and storing the service data to be processed into a database of a settlement platform when the account of the service data to be processed is correct; the to-be-processed service data is checked wrongly or the to-be-processed service data is checked correctly and then account checking is not uniform, so that the alarm information can be transmitted to the service application providing the to-be-processed service data, and the to-be-processed service data needs to be pushed again.
When data settlement is triggered in a settlement platform in a mode of timing task, manual triggering and the like, the computer equipment can receive a data settlement instruction, inquire corresponding settlement configuration information in the settlement platform, obtain a calculation formula (also called a settlement function) by carrying out formula loading on the settlement configuration information, carry out data calculation on service data to be processed in a message queue by using an addition formula to obtain a calculation result corresponding to the service data to be processed, further carry out settlement on the calculation result to obtain a final settlement result, and when the settlement in the message queue is terminated, archive the settlement result and original service data set to be in a final state; when the settlement in the message queue is not terminated, the settlement processing can be continuously carried out on the service data to be processed in the message queue. For the settlement result corresponding to the service data to be processed, the report form display can be carried out in the settlement platform; and performing hierarchical display on the settlement result corresponding to the service data to be processed according to the preset result display dimension information of the service application.
Optionally, data settlement may be triggered in the settlement platform by means of configuration update, and if package configuration in the settlement configuration information is changed and the change is successful, the changed package configuration may enter an approval process, and after approval is passed, data settlement processing in the settlement platform may be triggered; if the package configuration in the calculation configuration information is changed and the change fails, or the package configuration is changed successfully and the approval fails, the original package configuration is still kept in the calculation platform, and the data settlement processing in the settlement platform is not triggered.
In the embodiment of the application, a settlement platform is provided with a uniform data access structure and a uniform data storage structure, each business application accessed into the settlement platform can be provided with corresponding access configuration information and settlement configuration information, the access configuration information of all the business applications is stored in a database in the form of the data access structure, and the settlement configuration information of all the business applications is stored in the database in the form of the data storage structure; any accessed service application can push the service data to be processed to a settlement platform, the access configuration information and the settlement configuration information corresponding to the service data to be processed are searched in the settlement platform, the service data to be processed is verified by adopting the inquired access configuration information, and the service data to be processed after the verification can be settled by adopting the inquired settlement configuration information to obtain a settlement result of the service data to be processed, namely the settlement platform can be adopted to realize the data settlement processing of a plurality of service applications, so that the settlement efficiency of the service data can be improved; the settlement platform can manage the service data of a plurality of service applications, thereby improving the service management efficiency of the service applications; the settlement platform provided by the embodiment of the application is adopted to perform settlement processing on the service data of each service application, so that the automation, configuration, unification and transparency of the settlement of the service data can be realized.
Referring to fig. 10, fig. 10 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application. It is understood that the data processing apparatus may be a computer program (including program code) running in a computer device, and the data processing apparatus may be configured to execute the corresponding steps in the method provided by the corresponding embodiment in fig. 3. As shown in fig. 10, the data processing apparatus 1 may include: a first query module 11, a verification module 12, a second query module 13 and a data settlement module 14;
the first query module 11 is configured to obtain service data to be processed accessed in the settlement platform, and query at least two configuration data tables stored in an isolated manner in the same data access structure in the settlement platform to obtain a target configuration data table associated with a service application to which the service data to be processed belongs; at least two configuration data tables respectively correspond to different service applications;
the checking module 12 is configured to check the service data to be processed according to the access configuration information in the target configuration data table to obtain a checking result corresponding to the service data to be processed, and store the service data to be processed in the database if the checking result is a correct checking result;
the second query module 13 is configured to, when receiving a settlement trigger instruction for the to-be-processed service data, query at least two pieces of settlement configuration information separately stored in the same data storage structure in the settlement platform to obtain target settlement configuration information associated with the service application to which the to-be-processed service data belongs; at least two settlement configuration information respectively correspond to different service applications;
and the data settlement module 14 is configured to perform settlement processing on the to-be-processed service data according to the target settlement configuration information, so as to obtain a settlement result corresponding to the to-be-processed service data.
The specific functional implementation manners of the first query module 11, the check module 12, the second query module 13, and the data settlement module 14 may refer to steps S101 to S104 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible embodiments, the first query module 11 may include: a service identifier obtaining unit 111, a target configuration table determining unit 112;
a service identifier obtaining unit 111, configured to obtain service data to be processed accessed in the settlement platform, determine a service application providing the service data to be processed as a target service application, and obtain a service identifier corresponding to the target service application;
and a target configuration table determining unit 112, configured to query, in the settlement platform, at least two configuration data tables that are stored in an isolated manner with the same data access structure according to the service identifier, and determine the configuration data table corresponding to the service identifier as a target configuration data table.
The specific functional implementation manners of the service identifier obtaining unit 111 and the target configuration table determining unit 112 may refer to step S101 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible embodiments, the access configuration information may include a reconciliation approach;
the verification module 12 may include: a reconciliation unit 121, a reconciliation correct unit 122, a reconciliation error unit 123;
the account checking unit 121 is configured to acquire an account checking mode included in the access configuration information, and perform account checking on the to-be-processed service data according to the account checking mode;
the account checking correct unit 122 is configured to determine, when the to-be-processed service data meets an account checking condition corresponding to an account checking mode, that a check result corresponding to the to-be-processed service data is a correct check result;
the account checking error unit 123 is configured to determine, when the to-be-processed service data does not meet the account checking condition corresponding to the account checking manner, that a check result corresponding to the to-be-processed service data is a check error result, and transmit warning information to a target service application that provides the to-be-processed service data; the alarm information is used for indicating the target service application to check the service data to be processed and pushing the service data to be processed to the settlement platform again;
and the data storage unit 124 is configured to store the to-be-processed service data and the reconciliation record corresponding to the to-be-processed service data in the database if the verification result is the correct verification result.
For specific functional implementation manners of the reconciliation unit 121, the reconciliation correct unit 122, the reconciliation error unit 123, and the reconciliation error unit 123, reference may be made to step S102 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible embodiments, the database includes a message queue, where the message queue is used to store the to-be-processed service data, the number of the to-be-processed service data is M, and M is a positive integer;
the data settlement module 14 may include: a timestamp acquisition unit 141, a data deletion unit 142, a service data settlement unit 143;
a timestamp obtaining unit 141, configured to obtain to-be-processed service data D from the M to-be-processed service data in the message queueiAnd pending service data DjObtaining the service data D to be processediAnd pending service data DjRespectively and correspondingly adding timestamps; i and j are positive integers less than or equal to M;
a data deleting unit 142, configured to delete the pending service data D when detectediAnd pending service data DjWhen the same, deleting the service data D to be processed in the message queuejObtaining an updated message queue; to-be-processed service data DjThe corresponding added timestamp is larger than the service data D to be processediCorrespondingly adding a time stamp;
and the service data settlement unit 143 is configured to perform settlement processing on the to-be-processed service data in the updated message queue in sequence according to the target settlement configuration information, so as to obtain a settlement result corresponding to the to-be-processed service data in the updated message queue.
The specific functional implementation manners of the timestamp obtaining unit 141, the data deleting unit 142, and the service data settling unit 143 may refer to step S104 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible embodiments, the data settlement module 14 may include: a formula loading unit 144, a result determination unit 145;
a formula loading unit 144, configured to load the target settlement configuration information, obtain a settlement function associated with the to-be-processed service data, and split the to-be-processed service data into at least two sub-service data according to parameter information in the settlement function;
and the result determining unit 145 is configured to input at least two pieces of sub-service data to the settlement function, and determine a settlement result corresponding to the service data to be processed according to the settlement function.
The specific functional implementation manners of the formula loading unit 144 and the result determining unit 145 may refer to step S104 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible embodiments, the data processing apparatus 1 may further include: a query request acquisition module 15, a query authority determination module 16 and a settlement result display module 17;
the query request acquisition module 15 is configured to acquire a query request for the settlement result in the settlement platform, and determine a query user for the settlement result according to the query request;
the inquiry authority determining module 16 is configured to obtain user information corresponding to an inquiry user, and determine inquiry authority information of the inquiry user for the target service application according to the user information;
and the settlement result display module 17 is configured to, when the inquiry permission information is in an authorized state, obtain result display dimension information corresponding to the target service application, and display the settlement result according to the result display dimension information.
The specific functional implementation manners of the query request obtaining module 15, the query permission determining module 16, and the settlement result displaying module 17 may refer to step S104 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible embodiments, the data processing apparatus 1 may further include: an access configuration acquisition module 18, an access configuration storage module 19;
an access configuration obtaining module 18, configured to obtain, in the settlement platform, access configuration item sets corresponding to at least two service applications, and convert the at least two access configuration item sets into configuration data tables with the same data access structure, respectively;
and the access configuration storage module 19 is configured to store, in the database of the settlement platform, the configuration data tables corresponding to the at least two service applications in an isolated manner.
The specific functional implementation manners of the access configuration obtaining module 18 and the access configuration storing module 19 may refer to step S101 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible embodiments, the data processing apparatus 1 may further include: a settlement configuration acquisition module 20 and a settlement configuration storage module 21;
a settlement configuration obtaining module 20, configured to obtain settlement display fields corresponding to at least two service applications in a settlement platform, and convert the at least two settlement display fields into settlement configuration information having the same data storage structure;
and the settlement configuration storage module 21 is configured to store, in the database of the settlement platform, the settlement configuration information corresponding to each of the at least two service applications in an isolated manner.
The specific functional implementation manners of the settlement configuration obtaining module 20 and the settlement configuration storing module 21 may refer to step S103 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible embodiments, the number of the at least two settlement display fields is N, where N is a positive integer;
the settlement configuration acquiring module 20 may include: a data conversion unit 201, a semantic check unit 202;
a data conversion unit 201 for obtaining a settlement display field F from the N settlement display fieldskAcquiring a data storage structure in a settlement platform and displaying a settlement field FkConverting into candidate settlement configuration information with a data storage structure; k is a positive integer less than or equal to N;
a semantic checking unit 202, configured to perform semantic checking on the candidate settlement configuration information, and determine the candidate settlement configuration information that passes the checking as the settlement configuration information.
The specific functional implementation manners of the data conversion unit 201 and the semantic check unit 202 may refer to step S103 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible implementations, the semantic check unit 202 may include: a first determining subunit 2021, a configuration approving subunit 2022, and a second determining subunit 2023;
a first determining subunit 2021, configured to perform semantic check on the candidate settlement configuration information, and determine the candidate settlement configuration information that passes the check as the pending settlement configuration;
the configuration approval subunit 2022 is configured to acquire approval information associated with the to-be-approved settlement configuration, and approve the to-be-approved settlement configuration according to the approval information to obtain state information corresponding to the to-be-approved settlement configuration;
a second determining subunit 2023, configured to determine the pending settlement configuration as the settlement configuration information if the state information is the valid state.
The specific functional implementation manners of the first determining subunit 2021, the configuration approval subunit 2022, and the second determining subunit 2023 may refer to step S103 in the embodiment corresponding to fig. 3, which is not described herein again.
In some possible embodiments, the data processing apparatus 1 may further include: a configuration update request receiving module 22, a settlement configuration update module 23;
a configuration update request receiving module 22, configured to, when receiving a configuration update request in the settlement platform, obtain a service application to be updated corresponding to the configuration update request, and obtain configuration update information corresponding to the service application to be updated;
and the settlement configuration updating module 23 is configured to update the settlement configuration information corresponding to the service application to be updated according to the configuration update information, generate updated settlement configuration information, and replace the settlement configuration information corresponding to the service application to be updated in the database with the updated settlement configuration information.
The specific functional implementation manners of the configuration update request receiving module 22 and the settlement configuration update module 23 may refer to step S103 in the embodiment corresponding to fig. 3, which is not described herein again.
In the embodiment of the application, a settlement platform is provided with a uniform data access structure and a uniform data storage structure, each business application accessed into the settlement platform can be provided with corresponding access configuration information and settlement configuration information, the access configuration information of all the business applications is stored in a database in the form of the data access structure, and the settlement configuration information of all the business applications is stored in the database in the form of the data storage structure; any accessed service application can push the service data to be processed to a settlement platform, the access configuration information and the settlement configuration information corresponding to the service data to be processed are searched in the settlement platform, the service data to be processed is verified by adopting the inquired access configuration information, and the service data to be processed after the verification can be settled by adopting the inquired settlement configuration information to obtain a settlement result of the service data to be processed, namely the settlement platform can be adopted to realize the data settlement processing of a plurality of service applications, so that the settlement efficiency of the service data can be improved; the settlement platform can manage the service data of a plurality of service applications, thereby improving the service management efficiency of the service applications; the settlement platform provided by the embodiment of the application is adopted to perform settlement processing on the service data of each service application, so that the automation, configuration, unification and transparency of the settlement of the service data can be realized.
Referring to fig. 11, fig. 11 is a schematic structural diagram of a computer device according to an embodiment of the present application. As shown in fig. 11, the computer apparatus 1000 may include: the processor 1001, the network interface 1004, and the memory 1005, and the computer apparatus 1000 may further include: a user interface 1003, and at least one communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display) and a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a standard wireless interface. Optionally, the network interface 1004 may include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory 1005 may also be at least one memory device located remotely from the processor 1001. As shown in fig. 11, a memory 1005, which is a kind of computer-readable storage medium, may include therein an operating system, a network communication module, a user interface module, and a device control application program.
In the computer device 1000 shown in fig. 11, the network interface 1004 may provide a network communication function; the user interface 1003 is an interface for providing a user with input; and the processor 1001 may be used to invoke a device control application stored in the memory 1005 to implement:
acquiring to-be-processed service data accessed in a settlement platform, and inquiring at least two configuration data tables which are stored in an isolated manner by using the same data access structure in the settlement platform to obtain a target configuration data table associated with service application to which the to-be-processed service data belongs; at least two configuration data tables respectively correspond to different service applications;
according to the access configuration information in the target configuration data table, verifying the service data to be processed to obtain a verification result corresponding to the service data to be processed, and if the verification result is a correct verification result, storing the service data to be processed into a database;
when a settlement triggering instruction aiming at the service data to be processed is received, inquiring at least two pieces of settlement configuration information which are stored in an isolated way in the same data storage structure in a settlement platform to obtain target settlement configuration information associated with the service application to which the service data to be processed belongs; at least two settlement configuration information respectively correspond to different service applications;
and carrying out settlement processing on the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed.
It should be understood that the computer device 1000 described in this embodiment of the present application may perform the description of the data processing method in the embodiment corresponding to fig. 3, and may also perform the description of the data processing apparatus 1 in the embodiment corresponding to fig. 10, which is not described herein again. In addition, the beneficial effects of the same method are not described in detail.
Further, here, it is to be noted that: an embodiment of the present application further provides a computer-readable storage medium, where the computer program executed by the data processing apparatus 1 mentioned above is stored in the computer-readable storage medium, and the computer program includes program instructions, and when the processor executes the program instructions, the description of the data processing method in the embodiment corresponding to fig. 3 can be performed, so that details are not repeated here. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in embodiments of the computer-readable storage medium referred to in the present application, reference is made to the description of embodiments of the method of the present application. As an example, the program instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or distributed across multiple sites and interconnected by a communication network, which may constitute a block chain system.
Further, it should be noted that: embodiments of the present application also provide a computer program product or computer program, which may include computer instructions, which may be stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor can execute the computer instruction, so that the computer device executes the description of the data processing method in the embodiment corresponding to fig. 3, which is described above, and therefore, the description thereof will not be repeated here. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in the embodiments of the computer program product or the computer program referred to in the present application, reference is made to the description of the embodiments of the method of the present application.
It should be noted that, for simplicity of description, the above-mentioned embodiments of the method are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the order of acts described, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.
The modules in the device can be merged, divided and deleted according to actual needs.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present application and is not to be construed as limiting the scope of the present application, so that the present application is not limited thereto, and all equivalent variations and modifications can be made to the present application.

Claims (14)

1. A data processing method, comprising:
acquiring to-be-processed service data accessed in a settlement platform, and inquiring at least two configuration data tables which are stored in an isolated manner by using the same data access structure in the settlement platform to obtain a target configuration data table associated with a service application to which the to-be-processed service data belongs; the at least two configuration data tables respectively correspond to different service applications;
according to the access configuration information in the target configuration data table, verifying the to-be-processed service data to obtain a verification result corresponding to the to-be-processed service data, and if the verification result is a correct verification result, storing the to-be-processed service data in a database;
when a settlement triggering instruction aiming at the service data to be processed is received, inquiring at least two pieces of settlement configuration information which are stored in an isolated way in the same data storage structure in the settlement platform to obtain target settlement configuration information associated with the service application to which the service data to be processed belongs; the at least two settlement configuration information respectively correspond to different service applications;
and carrying out settlement processing on the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed.
2. The method according to claim 1, wherein the obtaining of the to-be-processed service data accessed in the settlement platform, and querying at least two configuration data tables separately stored in the same data access structure in the settlement platform to obtain a target configuration data table associated with the service application to which the to-be-processed service data belongs, comprises:
acquiring to-be-processed service data accessed in a settlement platform, determining a service application providing the to-be-processed service data as a target service application, and acquiring a service identifier corresponding to the target service application;
and inquiring at least two configuration data tables which are stored in an isolated manner by using the same data access structure in the settlement platform according to the service identifier, and determining the configuration data table corresponding to the service identifier as a target configuration data table.
3. The method of claim 1, wherein the access configuration information comprises a reconciliation mode;
the verifying the to-be-processed service data according to the access configuration information in the target configuration data table to obtain a verification result corresponding to the to-be-processed service data includes:
acquiring an account checking mode contained in the access configuration information, and performing account checking on the to-be-processed business data according to the account checking mode;
when the business data to be processed meets the reconciliation condition corresponding to the reconciliation mode, determining a verification result corresponding to the business data to be processed as a correct verification result;
when the business data to be processed does not meet the reconciliation condition corresponding to the reconciliation mode, determining that a verification result corresponding to the business data to be processed is a verification error result, and transmitting warning information to a target business application providing the business data to be processed; the alarm information is used for indicating the target service application to check the service data to be processed and pushing the service data to be processed to the settlement platform again;
if the check result is a correct check result, storing the to-be-processed service data into a database, including:
and if the checking result is a correct checking result, storing the to-be-processed business data and the account checking record corresponding to the to-be-processed business data in the database.
4. The method according to claim 1, wherein the performing settlement processing on the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed comprises:
loading the target settlement configuration information, acquiring a settlement function associated with the to-be-processed service data, and splitting the to-be-processed service data into at least two sub-service data according to parameter information in the settlement function;
and inputting the at least two sub-service data into the settlement function, and determining a settlement result corresponding to the service data to be processed according to the settlement function.
5. The method according to claim 1, wherein the database comprises a message queue, the message queue is used for storing the service data to be processed, the number of the service data to be processed is M, and M is a positive integer;
the settling the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed, including:
obtaining the service data D to be processed from the M service data to be processed of the message queueiAnd pending service data DjObtaining the service data D to be processediAnd the service data D to be processedjRespectively and correspondingly adding timestamps; i and j are positive integers less than or equal to M;
when the service data D to be processed is detectediAnd pending service data DjWhen the same, deleting the service data D to be processed in the message queuejObtaining an updated message queue; the service data D to be processedjThe corresponding added timestamp is larger than the service data D to be processediCorrespondingly adding a time stamp;
and according to the target settlement configuration information, sequentially performing settlement processing on the to-be-processed service data in the updated message queue to obtain a settlement result corresponding to the to-be-processed service data in the updated message queue.
6. The method of claim 1, further comprising:
acquiring a query request aiming at the settlement result in the settlement platform, and determining a query user aiming at the settlement result according to the query request;
acquiring user information corresponding to the inquiring user, and determining inquiring authority information of the inquiring user aiming at the target service application according to the user information;
and when the inquiry authority information is in an authorized state, acquiring result display dimension information corresponding to the target service application, and displaying the settlement result according to the result display dimension information.
7. The method of claim 1, further comprising:
acquiring access configuration item sets respectively corresponding to at least two service applications in the settlement platform, and respectively converting the at least two access configuration item sets into configuration data tables with the same data access structure;
and in a database of the settlement platform, carrying out isolated storage on configuration data tables respectively corresponding to the at least two service applications.
8. The method of any one of claims 1-7, further comprising:
acquiring settlement display fields corresponding to at least two service applications in the settlement platform respectively, and converting the at least two settlement display fields into settlement configuration information with the same data storage structure respectively;
and in a database of the settlement platform, performing isolated storage on settlement configuration information respectively corresponding to the at least two service applications.
9. The method according to claim 8, wherein the number of the at least two settlement presentation fields is N, N being a positive integer;
the converting at least two settlement display fields into settlement configuration information with the same data storage structure respectively comprises:
obtaining settlement display field F from N settlement display fieldskAcquiring a data storage structure in the settlement platform, and displaying the settlement display field FkConverting into candidate settlement configuration information having the data storage structure; k is a positive integer less than or equal to N;
and performing semantic check on the candidate settlement configuration information, and determining the candidate settlement configuration information passing the check as the settlement configuration information.
10. The method of claim 9, wherein semantically checking the candidate settlement configuration information, and determining the candidate settlement configuration information passing the checking as the settlement configuration information comprises:
performing semantic inspection on the candidate settlement configuration information, and determining the candidate settlement configuration information passing the inspection as the settlement configuration to be approved;
acquiring approval information associated with the to-be-approved settlement configuration, and approving the to-be-approved settlement configuration according to the approval information to obtain state information corresponding to the to-be-approved settlement configuration;
and if the state information is a valid state, determining the to-be-approved settlement configuration as settlement configuration information.
11. The method of claim 8, further comprising:
when a configuration updating request in the settlement platform is received, acquiring a service application to be updated corresponding to the configuration updating request, and acquiring configuration updating information corresponding to the service application to be updated;
updating the settlement configuration information corresponding to the service application to be updated according to the configuration updating information, generating updated settlement configuration information, and replacing the settlement configuration information corresponding to the service application to be updated in the database with the updated settlement configuration information.
12. A data processing apparatus, comprising:
the system comprises a first query module, a second query module and a third query module, wherein the first query module is used for acquiring to-be-processed service data accessed in a settlement platform, and querying at least two configuration data tables which are separately stored in the same data access structure in the settlement platform to obtain a target configuration data table associated with a service application to which the to-be-processed service data belongs; the at least two configuration data tables respectively correspond to different service applications;
the verification module is used for verifying the to-be-processed service data according to the access configuration information in the target configuration data table to obtain a verification result corresponding to the to-be-processed service data, and if the verification result is a correct verification result, the to-be-processed service data is stored in a database;
the second query module is used for querying at least two pieces of settlement configuration information which are stored in an isolated manner in the same data storage structure in the settlement platform when a settlement trigger instruction for the to-be-processed service data is received, so as to obtain target settlement configuration information associated with the service application to which the to-be-processed service data belongs; the at least two settlement configuration information respectively correspond to different service applications;
and the data settlement module is used for performing settlement processing on the service data to be processed according to the target settlement configuration information to obtain a settlement result corresponding to the service data to be processed.
13. A computer device comprising a memory and a processor;
the memory is coupled to the processor, the memory for storing a computer program, the processor for invoking the computer program to cause the computer device to perform the method of any of claims 1 to 11.
14. A computer-readable storage medium, in which a computer program is stored which is adapted to be loaded and executed by a processor to cause a computer device having said processor to carry out the method of any one of claims 1 to 11.
CN202110005002.XA 2021-01-04 2021-01-04 Data processing method, device, equipment and medium Active CN112699151B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110005002.XA CN112699151B (en) 2021-01-04 2021-01-04 Data processing method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110005002.XA CN112699151B (en) 2021-01-04 2021-01-04 Data processing method, device, equipment and medium

Publications (2)

Publication Number Publication Date
CN112699151A true CN112699151A (en) 2021-04-23
CN112699151B CN112699151B (en) 2022-04-22

Family

ID=75514586

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110005002.XA Active CN112699151B (en) 2021-01-04 2021-01-04 Data processing method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN112699151B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113900561A (en) * 2021-10-27 2022-01-07 北京字跳网络技术有限公司 Form processing method, apparatus, electronic device, medium, and program product
CN115099681A (en) * 2022-07-18 2022-09-23 北京师范大学 Library management system and method based on block chain
CN115292343A (en) * 2022-10-09 2022-11-04 工保科技(浙江)有限公司 Data processing method and device

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101329627A (en) * 2008-07-29 2008-12-24 上海众恒信息产业有限公司 Secondary developing platform based on data model
CN102456028A (en) * 2010-10-27 2012-05-16 金蝶软件(中国)有限公司 Multi-tenant-oriented data acquisition method, device and system
CN102469089A (en) * 2010-11-17 2012-05-23 金蝶软件(中国)有限公司 Method and device for dynamically sharing and isolating data
CN102479201A (en) * 2010-11-26 2012-05-30 金蝶软件(中国)有限公司 Processing method and system of public data
US20130091547A1 (en) * 2011-10-05 2013-04-11 HCL Technologies, Ltd. Method and System for Enabling Non-Intrusive Multi Tenancy Enablement
US20150025917A1 (en) * 2013-07-15 2015-01-22 Advanced Insurance Products & Services, Inc. System and method for determining an underwriting risk, risk score, or price of insurance using cognitive information
CN105119974A (en) * 2015-07-21 2015-12-02 信阳启航信息科技有限公司 Internet-of-things system using hybrid cloud architecture and realization method
CN105183834A (en) * 2015-08-31 2015-12-23 上海电科智能系统股份有限公司 Ontology library based transportation big data semantic application service method
CN105635465A (en) * 2015-12-30 2016-06-01 中科创达软件股份有限公司 Data isolation method, data isolation device and terminal
CN105893049A (en) * 2016-04-01 2016-08-24 无锡中科富农物联科技有限公司 Data separation framework applied to electronic map application system
CN107315786A (en) * 2017-06-12 2017-11-03 腾讯科技(深圳)有限公司 Business datum storage method and device
CN109495551A (en) * 2018-10-31 2019-03-19 广西民族大学 A kind of intelligent monitor system and its collecting method
CN109885624A (en) * 2019-01-23 2019-06-14 金蝶软件(中国)有限公司 Data processing method, device, computer equipment and storage medium
CN111339560A (en) * 2020-02-26 2020-06-26 中国邮政储蓄银行股份有限公司 Data isolation method, device and system

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101329627A (en) * 2008-07-29 2008-12-24 上海众恒信息产业有限公司 Secondary developing platform based on data model
CN102456028A (en) * 2010-10-27 2012-05-16 金蝶软件(中国)有限公司 Multi-tenant-oriented data acquisition method, device and system
CN102469089A (en) * 2010-11-17 2012-05-23 金蝶软件(中国)有限公司 Method and device for dynamically sharing and isolating data
CN102479201A (en) * 2010-11-26 2012-05-30 金蝶软件(中国)有限公司 Processing method and system of public data
US20130091547A1 (en) * 2011-10-05 2013-04-11 HCL Technologies, Ltd. Method and System for Enabling Non-Intrusive Multi Tenancy Enablement
US20150025917A1 (en) * 2013-07-15 2015-01-22 Advanced Insurance Products & Services, Inc. System and method for determining an underwriting risk, risk score, or price of insurance using cognitive information
CN105119974A (en) * 2015-07-21 2015-12-02 信阳启航信息科技有限公司 Internet-of-things system using hybrid cloud architecture and realization method
CN105183834A (en) * 2015-08-31 2015-12-23 上海电科智能系统股份有限公司 Ontology library based transportation big data semantic application service method
CN105635465A (en) * 2015-12-30 2016-06-01 中科创达软件股份有限公司 Data isolation method, data isolation device and terminal
CN105893049A (en) * 2016-04-01 2016-08-24 无锡中科富农物联科技有限公司 Data separation framework applied to electronic map application system
CN107315786A (en) * 2017-06-12 2017-11-03 腾讯科技(深圳)有限公司 Business datum storage method and device
CN109495551A (en) * 2018-10-31 2019-03-19 广西民族大学 A kind of intelligent monitor system and its collecting method
CN109885624A (en) * 2019-01-23 2019-06-14 金蝶软件(中国)有限公司 Data processing method, device, computer equipment and storage medium
CN111339560A (en) * 2020-02-26 2020-06-26 中国邮政储蓄银行股份有限公司 Data isolation method, device and system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
曹利峰等: "基于L-DHT的多租户虚拟域隔离构建方法", 《通信学报》 *
葛思江等: "云计算网络中基于隔离边界的安全审计体系研究", 《智能计算机及应用》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113900561A (en) * 2021-10-27 2022-01-07 北京字跳网络技术有限公司 Form processing method, apparatus, electronic device, medium, and program product
CN115099681A (en) * 2022-07-18 2022-09-23 北京师范大学 Library management system and method based on block chain
CN115099681B (en) * 2022-07-18 2023-01-31 北京师范大学 Library management system and method based on block chain
CN115292343A (en) * 2022-10-09 2022-11-04 工保科技(浙江)有限公司 Data processing method and device

Also Published As

Publication number Publication date
CN112699151B (en) 2022-04-22

Similar Documents

Publication Publication Date Title
CN112699151B (en) Data processing method, device, equipment and medium
US7877682B2 (en) Modular distributed mobile data applications
US9886441B2 (en) Shard aware near real time indexing
CN107798038B (en) Data response method and data response equipment
CN112434059B (en) Data processing method, data processing device, computer equipment and storage medium
US20110295791A1 (en) System and method for specifying metadata extension input for extending data warehouse
US10078676B2 (en) Schema evolution in multi-tenant environment
CN108647357B (en) Data query method and device
CN112988770B (en) Method, device, electronic equipment and storage medium for updating serial number
US8756205B2 (en) System and method for rule-based data object matching
US20170011128A1 (en) Dynamic domain query and query translation
CN114253939A (en) Data model construction method and device, electronic equipment and storage medium
US10685019B2 (en) Secure query interface
CN116701330A (en) Logistics information sharing method, device, equipment and storage medium
US20230099501A1 (en) Masking shard operations in distributed database systems
CN113760948A (en) Data query method and device
CN113568923A (en) Method and device for querying data in database, storage medium and electronic equipment
US20080148220A1 (en) System infrastructure structure formulation supporting system and supporting method
CN115422202A (en) Service model generation method, service data query method, device and equipment
CN115017185A (en) Data processing method, device and storage medium
CN113934729A (en) Data management method based on knowledge graph, related equipment and medium
CN114003614A (en) Data synchronization device, method, online transaction system, computer equipment and storage medium
CN114547404B (en) Big data platform system
US11561979B2 (en) Dynamically detecting and correcting errors in queries
Utama et al. E-Government Integration of Sidoarjo Regency using Service Oriented Architecture (SOA)

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40041986

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant