CN113486035A - Data record batch processing method and device, storage medium and electronic equipment - Google Patents
Data record batch processing method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN113486035A CN113486035A CN202110765426.6A CN202110765426A CN113486035A CN 113486035 A CN113486035 A CN 113486035A CN 202110765426 A CN202110765426 A CN 202110765426A CN 113486035 A CN113486035 A CN 113486035A
- Authority
- CN
- China
- Prior art keywords
- data record
- record list
- list
- data
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title abstract description 14
- 238000000034 method Methods 0.000 claims abstract description 39
- 238000012545 processing Methods 0.000 claims abstract description 21
- 238000000605 extraction Methods 0.000 claims description 15
- 238000012216 screening Methods 0.000 claims description 10
- 238000010923 batch production Methods 0.000 claims description 8
- 238000001914 filtration Methods 0.000 claims description 3
- 230000002123 temporal effect Effects 0.000 claims 3
- 238000004801 process automation Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000007115 recruitment Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2379—Updates performed during online database operations; commit processing
- G06F16/2386—Bulk updating operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
Abstract
The embodiment of the application discloses a data record batch processing method and device, a storage medium and electronic equipment. The method comprises the steps of determining time search conditions corresponding to batch processing; determining a first data record list according to the time search condition, wherein the first data record list is composed of first data records which meet the time search condition and are used for recording attribute information related to the first account and the service; determining a second data record list according to the time search condition, wherein the second data record list is composed of second data records which meet the time search condition and are used for recording service mode information; acquiring a service mode configuration management table; and updating the service mode configuration management table according to the first data record list and the second data record list. According to the embodiment of the application, the data records are updated in a batch processing mode, so that the labor cost is saved, the whole-process automation of data updating is realized, and omission is avoided.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a data record batch processing method, a data record batch processing device, a storage medium and electronic equipment.
Background
In a service scenario, data related to a user may change frequently in response to an operation of the user, and may affect related service configuration data, and the service configuration data cannot be updated actively with the operation of the user, but only depends on passive updating. In order to ensure consistency of the service configuration data, in the related art, a great deal of effort is often required to perform consistency maintenance on the service configuration data that needs to be passively updated, and such consistency maintenance needs to be performed manually and cannot be performed automatically, so that updating efficiency is low, and carelessness easily occurs.
Disclosure of Invention
In order to solve at least one technical problem, embodiments of the present application provide a data record batch processing method, an apparatus, a storage medium, and an electronic device.
In one aspect, an embodiment of the present application provides a data record batch processing method, where the method includes:
determining time search conditions corresponding to batch processing;
determining a first data record list according to the time search condition, wherein the first data record list is composed of first data records which meet the time search condition and are used for recording attribute information related to the first account and the service;
determining a second data record list according to the time search condition, wherein the second data record list is composed of second data records which meet the time search condition and are used for recording service mode information;
acquiring a service mode configuration management table;
and updating the service mode configuration management table according to the first data record list and the second data record list.
In one embodiment, the determining the time search condition corresponding to the batch process includes:
determining a start-up time interval for the batch process;
and determining the time search condition according to the time interval.
In one embodiment, the determining a first data record list according to the time search condition includes:
acquiring a first record table, wherein the first record table at least comprises the following fields: the method comprises the steps of identifying a first account, a service association subject, a service association account, a second account, creation time and updating time;
and inquiring the first record table according to the time search condition to obtain a first data record list, wherein the creation time or the updating time of each record in the first data record list accords with the time search condition.
In one embodiment, the determining the second data record list according to the time search condition includes:
acquiring a second record table, wherein the second record table at least comprises the following fields: the service correlation main body, the service correlation account, the second account identifier, the service mode and the time interval;
and inquiring the second record table according to the time search condition to obtain a second data record list, wherein the time interval of each record in the second data record list accords with the time search condition.
In one embodiment, the updating the service mode configuration management table according to the first data record list and the second data record list includes:
screening the second data record list based on the first data record list to obtain a target second data record list;
determining field extraction conditions according to the business association main body, the business association account and the business mode;
performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list;
and updating the service mode configuration management table based on the third data record list.
In one embodiment, the traffic pattern configuration management table includes at least the following fields: the updating of the service mode configuration management table based on the third data record list includes:
determining a target third list of data records based on the traffic pattern configuration management table, records in the target third list of data records not being hit by the traffic pattern configuration management table and being hit by the third list of data records;
determining a corresponding service configuration resource for each record in the target third data record list;
generating a corresponding service mode configuration record according to the service configuration resource;
and adding the service mode configuration record to the service mode configuration management table.
In one embodiment, the filtering the second data record list based on the first data record list to obtain a target second data record list includes:
screening the second data record list based on the first data record list to obtain an alternative record list, wherein a second account identifier in the alternative record list is hit by a record in the first data record list;
grouping the records in the alternative record list according to the business association main body, the business association account and the business mode to obtain a plurality of grouping results;
and determining a record in each grouping result to form the target second data record list.
On the other hand, an embodiment of the present application provides a data record batch processing apparatus, including:
the time search condition determining module is used for determining time search conditions corresponding to batch processing;
the first data record searching module is used for determining a first data record list according to the time searching condition, wherein the first data record list is composed of first data records which meet the time searching condition and are used for recording attribute information related to a first account and a service;
the second data record searching module is used for determining a second data record list according to the time searching condition, wherein the second data record list is formed by second data records which meet the time searching condition and are used for recording the service mode information;
a service mode configuration management table obtaining module, configured to obtain a service mode configuration management table;
and the service mode configuration management table updating module is used for updating the service mode configuration management table according to the first data record list and the second data record list.
In one embodiment, the time search condition determining module is configured to determine a starting time interval of the batch process; and determining the time search condition according to the time interval.
In one embodiment, the first data record searching module is configured to obtain a first record table, where the first record table includes at least the following fields: the method comprises the steps of identifying a first account, a service association subject, a service association account, a second account, creation time and updating time; and inquiring the first record table according to the time search condition to obtain a first data record list, wherein the creation time or the updating time of each record in the first data record list accords with the time search condition.
In one embodiment, the second data record searching module is configured to obtain a second record table, where the second record table includes at least the following fields: the service correlation main body, the service correlation account, the second account identifier, the service mode and the time interval; and inquiring the second record table according to the time search condition to obtain a second data record list, wherein the time interval of each record in the second data record list accords with the time search condition.
In one embodiment, the service mode configuration management table updating module is configured to perform the following operations:
screening the second data record list based on the first data record list to obtain a target second data record list;
determining field extraction conditions according to the business association main body, the business association account and the business mode;
performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list;
and updating the service mode configuration management table based on the third data record list.
In one embodiment, the traffic pattern configuration management table includes at least the following fields: the service mode configuration management table updating module is further used for executing the following operations:
determining a target third list of data records based on the traffic pattern configuration management table, records in the target third list of data records not being hit by the traffic pattern configuration management table and being hit by the third list of data records;
determining a corresponding service configuration resource for each record in the target third data record list;
generating a corresponding service mode configuration record according to the service configuration resource;
and adding the service mode configuration record to the service mode configuration management table.
In one embodiment, the service mode configuration management table updating module is further configured to perform the following operations:
screening the second data record list based on the first data record list to obtain an alternative record list, wherein a second account identifier in the alternative record list is hit by a record in the first data record list;
grouping the records in the alternative record list according to the business association main body, the business association account and the business mode to obtain a plurality of grouping results;
and determining a record in each grouping result to form the target second data record list.
In another aspect, an embodiment of the present application provides a computer-readable storage medium, where at least one instruction or at least one program is stored in the computer-readable storage medium, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the data record batch processing method described above.
In another aspect, an embodiment of the present application provides an electronic device, including at least one processor, and a memory communicatively connected to the at least one processor; the memory stores instructions executable by the at least one processor, and the at least one processor implements the data record batch processing method by executing the instructions stored in the memory.
The embodiment of the application provides a data record batch processing method and device, a storage medium and electronic equipment. The embodiment of the application provides that the data record is updated in a batch processing mode, so that the labor cost is saved, the whole-process automation of data updating is realized, and omission is avoided. And further, a batch processing updating method is disclosed, which can automatically update the service configuration data in a linkage manner according to the active updating of the user.
Drawings
In order to more clearly illustrate the technical solutions and advantages of the embodiments of the present application or the related art, the drawings used in the description of the embodiments or the related art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without inventive efforts.
FIG. 1 is a schematic flow chart diagram illustrating a batch processing method for data records according to an embodiment of the present application;
fig. 2 is a flowchart illustrating a method for updating a service mode configuration management table according to an embodiment of the present application;
fig. 3 is a flowchart for obtaining a target second data record list according to an embodiment of the present application;
fig. 4 is a flowchart for updating the service mode configuration management table according to an embodiment of the present application;
fig. 5 is a block diagram of a data record batch processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without any creative effort belong to the protection scope of the embodiments in the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of the embodiments of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In order to make the objects, technical solutions and advantages disclosed in the embodiments of the present application more clearly apparent, the embodiments of the present application are described in further detail below with reference to the accompanying drawings and the embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the embodiments of the application and are not intended to limit the embodiments of the application.
In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present embodiment, "a plurality" means two or more unless otherwise specified.
A data record batch processing method according to an embodiment of the present application, which can be applied to the above application environment, is described below. Fig. 1 shows a flow diagram of a data record batch processing method provided by an embodiment of the present application, which provides the method operation steps as described in the embodiment or the flow diagram, but may include more or less operation steps based on conventional or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When a practical system or server product executes, it may execute sequentially or in parallel (e.g. in the context of parallel processors or multi-threaded processing) according to the embodiments or methods shown in the drawings, and the methods may include:
s101, determining time search conditions corresponding to batch processing.
The time search condition in the embodiment of the application is determined according to the starting frequency of batch processing. Specifically, the start time interval of the batch process may be determined; and determining the time search condition according to the time interval. For example, if the batch process is started once a day, and the time interval is one day, the time search condition may be determined as one day, that is, only the relevant data change in one day is concerned.
S102, determining a first data record list according to the time search condition, wherein the first data record list is formed by first data records which meet the time search condition and are used for recording attribute information related to the first account and the service.
In the embodiment of the present application, the first data record list is obtained by searching the first record list according to the time search condition, and the first record list is not limited in the present application and is a table structure for recording attribute information related to the first account and the service. The first account is not limited in this application, and may correspond to a certain role participating in the service, and may be, for example, a member user qualified to participate in the service.
In the embodiment of the present application, the first record table at least includes the following fields: the method comprises the steps of first account identification, a business association subject, a business association account, second account identification, creation time and updating time. The service-related main body and the service-related account are related main bodies which generate service interaction with the first account, and for example, taking a recruitment scenario as an example, the first account may be an applicant, the service-related main body may be an enterprise side, and the service-related account may be a labor side. The second account is used for managing orders related to the service, i.e. the second account identification can be understood as an order identification. In some scenarios, a new record may be generated based on the proactive action of the first account, the generation time of the new record appearing in the creation time field, and in other scenarios, an existing record may be updated based on the proactive action of the first account, the update appearing in the update time field.
Further, the first record table is queried according to the time search condition to obtain a first data record list, and the creation time or the update time of each record in the first data record list meets the time search condition. For example, taking the time search condition as "one day", the records in the first record table whose created time or updated time is within the last day may be screened out to form the first data record table.
And S103, determining a second data record list according to the time search condition, wherein the second data record list is formed by second data records which meet the time search condition and are used for recording the service mode information.
In this embodiment of the present application, the second data record list is obtained by searching the second record list according to the time search condition, and the present application does not limit the second record list, which is a table structure for recording the service mode information.
In this embodiment, the second record table at least includes the following fields: the service association main body, the service association account, the second account identification, the service mode and the time interval. The embodiment of the present application does not limit the service mode, and the service mode may be various service modes, such as a service settlement mode, a service operation mode, and the like. The time interval is used for limiting the effective time of the service mode, so that the method provided by the application can be suitable for automatic updating of the relevant configuration of the time-limited service mode.
Further, the second record table is queried according to the time search condition to obtain a second data record list, and a time interval of each record in the second data record list meets the time search condition.
And S104, acquiring a service mode configuration management table.
In the embodiment of the present application, the service mode configuration management may be understood as an object that is updated passively, where the service mode configuration management table at least includes the following fields: the service configuration method comprises a service association main body, a service association account, a service mode and service configuration resources. That is to say, according to the service association subject, the service association account, and the service mode, the service configuration resource corresponding to the service association subject should be determined, and by the method in the embodiment of the present application, the target triple, that is, "the service association subject, the service association account, and the service mode" may be automatically determined, and the service configuration resource corresponding to the target triple may be automatically determined, and the service mode configuration management table may be updated accordingly, so as to implement automatic and passive update of the service mode configuration management table, which may not only maintain the consistency between the target triple and the actively updated related data, but also may be automatically executed, and no longer need to rely on manual work, improve the update efficiency, and reduce the error probability.
And S105, updating the service mode configuration management table according to the first data record list and the second data record list.
Referring to fig. 2, a schematic diagram of an updating method of a service mode configuration management table is shown, where the updating the service mode configuration management table according to the first data record list and the second data record list includes:
s1051, screening the second data record list based on the first data record list to obtain a target second data record list.
In an embodiment, referring to fig. 3, the filtering the second data record list based on the first data record list to obtain a target second data record list includes:
s10511, screening the second data record list based on the first data record list to obtain an alternative record list, wherein the second account identification in the alternative record list is hit by the record in the first data record list.
Each record in the first list of data records and the second list of data records contains a field for a second account identification. For a first record in the first data record list, if the second account identifier of the above record is recorded in a certain first record in the first data record list, the embodiment considers that the second record identifier is hit by the first data record list, and the second record may participate in forming the alternative record list. If the second account id of the record is not recorded in any first record in the first data record list, the embodiment considers that the second record id is not hit by the first data record list, and cannot participate in forming the candidate record list.
S10512, grouping the records in the alternative record list according to the business association main body, the business association account and the business mode to obtain a plurality of grouping results.
And S10513, determining a record in each grouping result to form the target second data record list.
Steps S10512 to S10513 are to obtain valid data, which is the target second data record list, by packet deduplication.
And S1052, determining field extraction conditions according to the business association main body, the business association account and the business mode.
And S1053, field extraction is carried out on the target second data record list based on the field extraction conditions, and a third data record list is generated.
And for each record in the target second data record list, only extracting three fields of a service association main body, a service association account and a service mode to obtain a third data record list. It can be considered that each record in the third list of data records forms one of the above-mentioned target triples.
And S1054, updating the service mode configuration management table based on the third data record list.
In an embodiment, referring to fig. 4, the updating the service mode configuration management table based on the third data record list includes:
s10541, determining a target third data record list based on the business mode configuration management table, wherein the records in the target third data record list are not hit by the business mode configuration management table and are hit by the third data record list.
Specifically, for each target triple in the third data record list, if a certain record in the service mode configuration management table includes the target triple, the present embodiment regards that the target triple is hit by the service mode configuration management table, which indicates that the target triple does not need to update the corresponding service configuration resource, and if any record in the service mode configuration management table does not include the target triple, the present embodiment regards that the target triple is not hit by the service mode configuration management table, which indicates that the target triple needs to configure its corresponding service configuration resource in the service configuration mode configuration table, and then the target triple is used to form the target third data record list.
And S10542, aiming at each record in the target third data record list, determining a corresponding service configuration resource.
And S10543, generating a corresponding service mode configuration record according to the service configuration resource.
And S10544, adding the service mode configuration record to the service mode configuration management table.
The method for determining the service configuration resource is not limited in the present application, and specifically, the method may be directly generated by using the target triple as a parameter according to a preset rule, or may be determined manually.
The embodiment of the application provides that the data record is updated in a batch processing mode, so that the labor cost is saved, the whole-process automation of data updating is realized, and omission is avoided. And further, a batch processing updating method is disclosed, which can automatically update the service configuration data in a linkage manner according to the active updating of the user.
The embodiment of the present application further discloses that the embodiment of the present application provides a data record batch processing apparatus, as shown in fig. 5, the apparatus includes:
and the time search condition determining module 101 is configured to determine a time search condition corresponding to the batch processing.
The first data record searching module 102 is configured to determine a first data record list according to the time search condition, where the first data record list is formed by first data records that satisfy the time search condition and are used for recording attribute information related to the first account and the service.
And a second data record searching module 103, configured to determine a second data record list according to the time search condition, where the second data record list is formed by second data records that satisfy the time search condition and are used for recording the service mode information.
A service mode configuration management table obtaining module 104, configured to obtain the service mode configuration management table.
A service mode configuration management table updating module 105, configured to update the service mode configuration management table according to the first data record list and the second data record list.
In one embodiment, the time search condition determining module is configured to determine a starting time interval of the batch process; and determining the time search condition according to the time interval.
In an embodiment, the first data record searching module is configured to obtain a first record table, where the first record table at least includes the following fields: the method comprises the steps of identifying a first account, a service association subject, a service association account, a second account, creation time and updating time; and inquiring the first record table according to the time search condition to obtain a first data record list, wherein the creation time or the update time of each record in the first data record list accords with the time search condition.
In an embodiment, the second data record searching module is configured to obtain a second record table, where the second record table at least includes the following fields: the service correlation main body, the service correlation account, the second account identifier, the service mode and the time interval; and inquiring the second record table according to the time search condition to obtain a second data record list, wherein the time interval of each record in the second data record list accords with the time search condition.
In an embodiment, the service mode configuration management table updating module is configured to perform the following operations:
screening the second data record list based on the first data record list to obtain a target second data record list;
determining field extraction conditions according to the business association main body, the business association account and the business mode;
performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list;
and updating the service mode configuration management table based on the third data record list.
In one embodiment, the service mode configuration management table at least includes the following fields: the service mode configuration management table updating module is further used for executing the following operations:
determining a target third data record list based on the service mode configuration management table, wherein records in the target third data record list are not hit by the service mode configuration management table and are hit by the third data record list;
determining a corresponding service configuration resource for each record in the target third data record list;
generating a corresponding service mode configuration record according to the service configuration resource;
and adding the service mode configuration record to the service mode configuration management table.
In an embodiment, the service mode configuration management table updating module is further configured to perform the following operations:
screening the second data record list based on the first data record list to obtain an alternative record list, wherein a second account identifier in the alternative record list is hit by a record in the first data record list;
grouping the records in the alternative record list according to the business association main body, the business association account and the business mode to obtain a plurality of grouping results;
and determining a record in each grouping result to form the target second data record list.
Specifically, the embodiment of the present application discloses a data record batch processing apparatus and the corresponding method embodiments are all based on the same inventive concept. For details, please refer to the method embodiment, which is not described herein.
Embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to cause the computer device to execute the data record batch processing method.
Embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium may store a plurality of instructions. The instructions may be adapted to be loaded by a processor and to perform the data record batching method described in the embodiments of the present application.
The embodiment of the application provides an electronic device, which comprises at least one processor and a memory which is in communication connection with the at least one processor; the memory stores instructions executable by the at least one processor, and the at least one processor implements the complex data record batch processing method by executing the instructions stored in the memory.
It should be noted that: the sequence of the embodiments of the present application is only for description, and does not represent the advantages and disadvantages of the embodiments. And specific embodiments thereof have been described above. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The embodiments in the present application are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the device and server embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the partial description of the method embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk.
The above description is only a preferred embodiment of the present application and should not be taken as limiting the present application, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present application should be included in the scope of the present application.
Claims (10)
1. A method of batch processing of data records, the method comprising:
determining time search conditions corresponding to batch processing;
determining a first data record list according to the time search condition, wherein the first data record list is composed of first data records which meet the time search condition and are used for recording attribute information related to the first account and the service;
determining a second data record list according to the time search condition, wherein the second data record list is composed of second data records which meet the time search condition and are used for recording service mode information;
acquiring a service mode configuration management table;
and updating the service mode configuration management table according to the first data record list and the second data record list.
2. The method of claim 1, wherein determining the temporal search criteria for the batch process comprises:
determining a start-up time interval for the batch process;
and determining the time search condition according to the time interval.
3. The method of claim 1, wherein determining a first list of data records based on the temporal search criteria comprises:
acquiring a first record table, wherein the first record table at least comprises the following fields: the method comprises the steps of identifying a first account, a service association subject, a service association account, a second account, creation time and updating time;
and inquiring the first record table according to the time search condition to obtain a first data record list, wherein the creation time or the updating time of each record in the first data record list accords with the time search condition.
4. The method of claim 3, wherein determining the second list of data records according to the temporal search criteria comprises:
acquiring a second record table, wherein the second record table at least comprises the following fields: the service correlation main body, the service correlation account, the second account identifier, the service mode and the time interval;
and inquiring the second record table according to the time search condition to obtain a second data record list, wherein the time interval of each record in the second data record list accords with the time search condition.
5. The method of claim 4, wherein updating the traffic pattern configuration management table according to the first data record list and the second data record list comprises:
screening the second data record list based on the first data record list to obtain a target second data record list;
determining field extraction conditions according to the business association main body, the business association account and the business mode;
performing field extraction on the target second data record list based on the field extraction condition to generate a third data record list;
and updating the service mode configuration management table based on the third data record list.
6. The method of claim 5, wherein the traffic pattern configuration management table comprises at least the following fields: the updating of the service mode configuration management table based on the third data record list includes:
determining a target third list of data records based on the traffic pattern configuration management table, records in the target third list of data records not being hit by the traffic pattern configuration management table and being hit by the third list of data records;
determining a corresponding service configuration resource for each record in the target third data record list;
generating a corresponding service mode configuration record according to the service configuration resource;
and adding the service mode configuration record to the service mode configuration management table.
7. The method of claim 5 or 6, wherein the filtering the second data record list based on the first data record list to obtain a target second data record list comprises:
screening the second data record list based on the first data record list to obtain an alternative record list, wherein a second account identifier in the alternative record list is hit by a record in the first data record list;
grouping the records in the alternative record list according to the business association main body, the business association account and the business mode to obtain a plurality of grouping results;
and determining a record in each grouping result to form the target second data record list.
8. A data record batching device, characterized in that said device comprises:
the time search condition determining module is used for determining time search conditions corresponding to batch processing;
the first data record searching module is used for determining a first data record list according to the time searching condition, wherein the first data record list is composed of first data records which meet the time searching condition and are used for recording attribute information related to a first account and a service;
the second data record searching module is used for determining a second data record list according to the time searching condition, wherein the second data record list is formed by second data records which meet the time searching condition and are used for recording the service mode information;
a service mode configuration management table obtaining module, configured to obtain a service mode configuration management table;
and the service mode configuration management table updating module is used for updating the service mode configuration management table according to the first data record list and the second data record list.
9. An electronic device comprising a processor and a memory, wherein at least one instruction or at least one program is stored in the memory, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the data record batching method according to any one of claims 1 to 7.
10. A computer readable storage medium having stored therein at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by a processor to implement the data record batching method as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110765426.6A CN113486035A (en) | 2021-07-07 | 2021-07-07 | Data record batch processing method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110765426.6A CN113486035A (en) | 2021-07-07 | 2021-07-07 | Data record batch processing method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113486035A true CN113486035A (en) | 2021-10-08 |
Family
ID=77941535
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110765426.6A Pending CN113486035A (en) | 2021-07-07 | 2021-07-07 | Data record batch processing method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113486035A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030223320A1 (en) * | 2002-06-03 | 2003-12-04 | Pioneer Corporation And Tech Experts Incorporation | Information recording/reproducing apparatus, list generation method and information recorded medium |
| US20090187551A1 (en) * | 2008-01-17 | 2009-07-23 | Oracle International Corporation | Search results when searching for records of a business object |
| US20100235380A1 (en) * | 2009-03-11 | 2010-09-16 | Hitachi, Ltd. | Data processing method, apparatus and program |
| US20150254323A1 (en) * | 2014-03-07 | 2015-09-10 | International Business Machines Corporation | Framework for continuous processing of a set of documents by multiple software applications |
| US20200125660A1 (en) * | 2018-10-19 | 2020-04-23 | Ca, Inc. | Quick identification and retrieval of changed data rows in a data table of a database |
| CN111125176A (en) * | 2019-12-20 | 2020-05-08 | 北京百度网讯科技有限公司 | Service data searching method and device, electronic equipment and storage medium |
| CN112148711A (en) * | 2020-09-21 | 2020-12-29 | 建信金融科技有限责任公司 | Processing method and device for batch processing tasks |
| CN112182093A (en) * | 2020-10-23 | 2021-01-05 | 腾讯科技（深圳）有限公司 | Data storage method, device, equipment and computer readable storage medium |
-
2021
- 2021-07-07 CN CN202110765426.6A patent/CN113486035A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030223320A1 (en) * | 2002-06-03 | 2003-12-04 | Pioneer Corporation And Tech Experts Incorporation | Information recording/reproducing apparatus, list generation method and information recorded medium |
| US20090187551A1 (en) * | 2008-01-17 | 2009-07-23 | Oracle International Corporation | Search results when searching for records of a business object |
| US20100235380A1 (en) * | 2009-03-11 | 2010-09-16 | Hitachi, Ltd. | Data processing method, apparatus and program |
| US20150254323A1 (en) * | 2014-03-07 | 2015-09-10 | International Business Machines Corporation | Framework for continuous processing of a set of documents by multiple software applications |
| US20200125660A1 (en) * | 2018-10-19 | 2020-04-23 | Ca, Inc. | Quick identification and retrieval of changed data rows in a data table of a database |
| CN111125176A (en) * | 2019-12-20 | 2020-05-08 | 北京百度网讯科技有限公司 | Service data searching method and device, electronic equipment and storage medium |
| CN112148711A (en) * | 2020-09-21 | 2020-12-29 | 建信金融科技有限责任公司 | Processing method and device for batch processing tasks |
| CN112182093A (en) * | 2020-10-23 | 2021-01-05 | 腾讯科技（深圳）有限公司 | Data storage method, device, equipment and computer readable storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 徐国天;: "Oracle数据库全库自动搜索方法研究", 信息网络安全, no. 05, pages 12 - 14 * |
| 赵曦: "云计算架构在银行批处理流程优化中的应用研究", 《软件导刊》, 25 October 2013 (2013-10-25), pages 1 - 4 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109543462B (en) | Equipment identification determination method, device, server and storage medium | |
| CN108280150B (en) | Distributed asynchronous service distribution method and system | |
| CN108762949B (en) | Centralized scheduling method, system, computer equipment and storage medium | |
| CN113760476B (en) | Task dependency processing method and related device | |
| CN112491609B (en) | Business service-based system application architecture discovery method and system | |
| CN109165175B (en) | Equipment identifier generation method and device | |
| CN111026568A (en) | Data and task relation construction method and device, computer equipment and storage medium | |
| US20190361844A1 (en) | Data management method and data analysis system | |
| CN110674231A (en) | Data lake-oriented user ID integration method and system | |
| CN110580293A (en) | Entity relationship storage method and device | |
| CN107368513B (en) | Method and device for updating client database | |
| CN114328632A (en) | User data analysis method and device based on bitmap and computer equipment | |
| CN111047434A (en) | Operation record generation method and device, computer equipment and storage medium | |
| CN107968798B (en) | Network management resource label obtaining method, cache synchronization method, device and system | |
| CN113486035A (en) | Data record batch processing method and device, storage medium and electronic equipment | |
| WO2023185137A1 (en) | Task management method and apparatus, and device and storage medium | |
| CN107422991B (en) | Storage strategy management system | |
| CN111125226A (en) | Configuration data acquisition method and device | |
| US20180357119A1 (en) | File information collection system and method, and storage medium | |
| CN113282586A (en) | Information processing method, device, equipment and readable storage medium | |
| CN110221952B (en) | Service data processing method and device and service data processing system | |
| CN110333883B (en) | Method and device for updating persistent data | |
| CN114385621A (en) | Locking method, device, equipment and medium | |
| CN114547184A (en) | Personnel information synchronization method, terminal device and storage medium | |
| CN110968467A (en) | Remote automatic test method for GPU and algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |