CN111369302A - Method, system and computer readable storage medium for generating points in real time - Google Patents
Method, system and computer readable storage medium for generating points in real time Download PDFInfo
- Publication number
- CN111369302A CN111369302A CN202010184774.XA CN202010184774A CN111369302A CN 111369302 A CN111369302 A CN 111369302A CN 202010184774 A CN202010184774 A CN 202010184774A CN 111369302 A CN111369302 A CN 111369302A
- Authority
- CN
- China
- Prior art keywords
- transaction
- integral
- transaction flow
- flow information
- real time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0207—Discounts or incentives, e.g. coupons or rebates
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/02—Banking, e.g. interest calculation or account maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Abstract
The invention provides a method for generating integration in real time, which comprises the following steps: acquiring an integral generation rule; acquiring transaction flow information of a user in real time and sending the transaction flow information to a message queue; taking out transaction flow information from the message queue and synchronizing the transaction flow information to a storm cluster; reading transaction flow information and matching with the integral generation rule; and saving the generated integral record according to the matching result. The invention also provides a system for generating the integral in real time and a computer readable storage medium storing the method. The invention solves the problems of delay of integral generation and low timeliness under the condition of large concurrent large data volume.
Description
Technical Field
The invention belongs to the field of bank big data processing, and particularly relates to a method and a system for generating points in real time and a computer-readable storage medium.
Background
At present, for the generation of the comprehensive points of the mail and storage bank, most of the comprehensive points depend on the computing capacity of a big data platform, but because the files are processed in batches at the end of each day in an interaction mode with the big data platform, and source data required by the big data platform for generating the points according to rules come from each associated system, the generation timeliness of the points is from T +1 to T +4 days, and the timeliness is not high, so that the problem of realizing the real-time generation of the points under the condition of large concurrent large data volume is urgently needed to be solved in society.
Disclosure of Invention
In order to overcome the problems in the related art, the application provides a method and a system for generating integration in real time. The method and the system thereof have simple and reasonable operation steps and high processing speed, and are suitable for realizing the real-time generation of the integral under the condition of large concurrency and large data volume.
In order to achieve the purpose, the invention provides the following technical scheme:
a first aspect of the invention provides a method of generating integrals in real time, comprising:
acquiring an integral generation rule;
acquiring transaction flow information of a user in real time and sending the transaction flow information to a message queue;
taking the transaction flow information out of the message queue and synchronizing the transaction flow information to a storm cluster;
reading the transaction flow information and matching with the integral generation rule;
and saving the generated integral record according to the matching result.
Further, synchronizing the transaction orchestration information to the storm cluster comprises:
aggregating a plurality of transaction streams in the transaction stream information into a transaction stream file according to rules;
and inquiring a storage path of the transaction flow file through the storm cluster, pulling the transaction flow file to the storm cluster according to the storage path, and reading the transaction flow in the transaction flow file.
Further, after the transaction pipeline of the transaction pipeline file is matched, the transaction pipeline file is deleted.
Further, in the process of saving the generated score record according to the matching result, the method further comprises the following steps:
judging whether the user reaches the upper limit of the preset integral quantity, if so, not processing;
judging whether a personal point account is opened by the user, and if not, opening the point account for the user;
and updating the acquired integral record.
A second aspect of the invention provides a system for generating points in real time, comprising:
the data acquisition module is used for acquiring the point generation rule and the transaction flow information of the user and sending the transaction flow information to the message queue;
the data synchronization module is used for taking the transaction flow information out of the message queue and synchronizing the transaction flow information to the storm cluster;
the data matching module is used for reading the transaction flow information and matching the transaction flow information with the integral generation rule;
and the data storage module is used for storing the integral generation rule and the integral record formed by matching.
Further, the data synchronization module includes:
the data aggregation unit is used for aggregating a plurality of transaction running water in the transaction running water information into a transaction running water file according to rules;
and the data pulling unit is used for inquiring the storage path of the transaction running file and pulling the transaction running file to the storm cluster according to the storage path.
Further, the data synchronization module further comprises: and the data deleting unit is used for deleting the formed transaction running file after the integral matching of the data matching module is finished.
Further, the storage path of the transaction pipeline file is stored in the storage module.
Further, the system further comprises: and the judging module is used for judging whether the daily integral of the user reaches the upper limit and whether the user opens an integral account after the integral matching of the data matching module is finished, wherein if the daily integral of the user reaches the upper limit, the user does not process the daily integral, and if the daily integral of the user does not open the integral account, the user opens the integral account.
In a third aspect of the invention, a computer-readable storage medium having computer-readable program instructions stored thereon for performing the method described above is provided.
The technical scheme provided by the embodiment of the application has the following beneficial effects:
the invention synchronizes the source data in different environments with the real-time generation point system in real time through the message queue, and then utilizes the transaction running water information processed by the storm cluster to be matched with the point generation rule to generate the point, thereby effectively solving the problems of delay and low timeliness of point generation under the condition of large concurrent large data volume.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
Fig. 1 is a schematic flow chart of a method for generating an integral in real time according to an embodiment of the present invention;
fig. 2 is an architecture diagram of a real-time generation integration system according to an embodiment of the invention.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of methods and apparatus consistent with certain aspects of the present application, as detailed in the appended claims.
As shown in fig. 1, an embodiment of the present invention discloses a method for generating an integral in real time, which includes the following steps:
step S1, acquiring an integral generation rule;
specifically, after daily cutting, the logic centralized system of the bank pushes an integral generation rule, the integral generation rule mainly comprises an integral group table, an integral pool table, a corresponding relation table of the integral group and the integral pool and the like, and the integral generation rule is obtained and is led into the database for storage and is used as a basis for generating the integral through subsequent calculation.
Step S2, acquiring the transaction flow information of the user in real time and sending the transaction flow information to a message queue;
specifically, the real-time generated user transaction flow confidence is important source data for calculating and generating points, but because the number is huge and the generation position and the operation of the points are not in the same environment, the information queue is required to serve as a communication pipeline so as to achieve the purpose of quickly synchronizing the user transaction flow information. In addition, if the receiver is not available when the message queue sends the message, the message queue can retain the message until the message can be successfully delivered, so that the loss of data is effectively avoided, and the generation of user points is prevented from generating errors. Meanwhile, the message queue can also play a role in peak clipping by setting a threshold value and a time interval of the transmission data volume, so that a large amount of data is prevented from flooding into a computing system in a short time to cause system breakdown.
Step S3, the transaction flow information is taken out from the message queue and synchronized to the storm cluster.
The transaction pipelining in the message queue is consumed in real time and is processed by the storm cluster, the storm cluster is used as a streaming data processing technology framework, the biggest characteristic is that every time one pipelining is processed, the real-time performance is strong, therefore, the transaction pipelining information in the message queue needs to be synchronized into the storm cluster in real time for processing, the transaction pipelining information can be correspondingly matched with the point generating rule, and the timeliness of point generation is guaranteed.
In step S3, when synchronizing the transaction pipeline to the storm cluster, a preferred embodiment is:
firstly, aggregating a plurality of transaction streams in the transaction stream information into a transaction stream file according to rules;
and inquiring a storage path of the transaction running file through the storm cluster, pulling the transaction running file to the storm cluster according to the storage path, and reading the transaction running in the transaction running file.
Specifically, the aggregated transaction flow information is to reduce the number of files when the transaction flow is saved as a file, ten million pieces of flow data exist in one day, and if each flow corresponds to one file, ten million files are generated, and the system cannot bear such a large data volume. According to the invention, a plurality of streams are aggregated into one file (for example, hundreds of individual streams are packaged into one file), so that the number of files is greatly reduced, and the feasibility on performance is ensured on the premise of not affecting the real-time performance.
Step S4, reading the transaction flow information and matching with the integral generation rule;
specifically, reading transaction running water information processed by the storm cluster, matching the transaction running water information with a score generation rule, and calculating whether the running water of the user can meet the condition of generating the score and the number of the generated score. In addition, in this embodiment, after the transaction pipeline of the transaction pipeline file is matched, the transaction pipeline file is automatically deleted. Because the storm cluster can process data with large concurrency in real time, continuous massive transaction flow files are undoubtedly great pressure on the system, but the transaction flow of the transaction flow files loses the existing value after the transaction flow is matched, so that the load of the system can be greatly reduced by automatically deleting the transaction flow files, and the redundancy of the system is improved.
Step S5, the generated score record is saved according to the matching result.
When the integrals are matched, the method further comprises the following judgment process:
judging whether the user reaches the upper limit of the preset integral quantity, if so, not processing;
judging whether a personal point account is opened by the user, and if not, opening the point account for the user;
and updating the acquired integral record.
Specifically, in reality, the number of points that can be obtained by a user in a period is often limited, so that it is necessary to make a judgment before the user is settled, check whether the number of points of the user has reached the upper limit of the amount, and if so, do not process the number of points. Meanwhile, whether the user opens the personal point account or not is also checked, and the user cannot be informed of the fact that the point record cannot be imported into the account. And finally, after a series of operations are finished, updating the point record, such as updating the data of the obtained point quantity, the time limit and the like, so that the user can conveniently inquire the point record.
The embodiment skillfully utilizes the message queue to synchronize the source data which does not belong to the local storm cluster to the storm cluster, matches the transaction flow information of the user with the score generation rule in real time, and calculates the score according to the corresponding relation of the transaction flow information and the score generation rule, thereby solving the problem of real-time generation of the score under the condition of large concurrency and large data volume with high performance and low delay.
Further, alternatively, the above-described method can be implemented by a computer program product, i.e., a computer-readable storage medium. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therein for carrying out aspects of the present invention. The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
As shown in fig. 2, another embodiment of the present invention provides a system for generating an integral in real time, corresponding to the method in the above embodiment, the system comprising:
the data acquisition module is used for acquiring the point generation rule and the transaction flow information of the user and sending the transaction flow information to the message queue;
the data synchronization module is used for taking out transaction flow information from the message queue and synchronizing the transaction flow information to the storm cluster;
the data matching module reads the transaction running information and matches the transaction running information with the integral generation rule;
and the data storage module is used for storing the integral generation rule and the integral record formed by matching.
Specifically, the data acquisition module mainly acquires the credit generation rule and the transaction flow information of the user from an existing logic centralized system of a bank, wherein the logic centralized system is a core system for managing personal financial business transactions of the existing bank, such as deposit and withdrawal and transfer, and is a source system for generating transaction flow according to the credit generation. And then, the transaction flow information is synchronized to the storm cluster by using the data synchronization module for data processing, so that the data matching module can be matched with the score generation rule to generate the score. The data storage module is preferably a database and stores the integral generation rule and the integral record formed by matching so as to conveniently and quickly inquire and manage the information and data related to the generated integral.
In this embodiment, the data synchronization module includes:
the data aggregation unit is used for aggregating a plurality of transaction streams in the transaction stream information into a transaction stream file according to rules;
and the data pulling unit is used for inquiring the storage path of the transaction running file and pulling the transaction running file to the storm cluster according to the storage path.
The data aggregation unit aggregates a plurality of running water into one file, so that the number of the files is greatly reduced, certain real-time performance is sacrificed, but feasibility on performance is gained, in addition, the transaction running water files are not stored in the database, the performance of the database is influenced due to frequent writing of the running water files, the query function of the database is interfered, the database has the advantage of fast random query, and the running water data does not need to be processed because each piece of the running water data needs to be processed. In this embodiment, it is preferable that the running files are only temporarily stored randomly, only the storage paths of the running files are stored in the database, when the running files are consumed, the storage paths of the transaction running files are queried first, and then the running files are pulled to the storm cluster for processing according to the database temporarily stored by the paths.
In this embodiment, the data synchronization module further includes a data deletion unit, and when the matching of the points corresponding to all the pipelining information in a certain file is completed, a matched feedback instruction is given to the data deletion unit, and the transaction pipelining file therein is deleted. Specifically, because the running files are continuously formed and stored, a great bearing pressure is generated on the whole system, but the transaction running of the transaction running files loses the existing value after the transaction running is completed, and therefore the matched transaction running files are deleted by the data deleting unit to reduce the pressure of the system.
In this embodiment, the system for generating points in real time further includes a determining module, which determines whether the points of the user on the same day have reached the upper limit and whether the user has opened a point account after the data matching module finishes the point matching, wherein if the points have reached the upper limit, no processing is performed, and if the points have not been opened, the point account is opened for the user.
To sum up, in this embodiment, the data obtaining module first obtains the point generation rule and the transaction flow information from the logic centralized system, where the point generation rule is imported into the database, the transaction flow information is aggregated into a transaction flow file by the data aggregation unit of the data synchronization module through the message queue, and the data pulling unit pulls the aggregated transaction flow file to the storm cluster for processing. And then the data matching module matches the processed transaction running file with the score generation rule to generate a score, and finally the data storage module records the score formed by matching. In addition, after the transaction flow files are matched, the data deleting unit deletes the transaction flow files so as to relieve the bearing pressure of the system.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (10)
1. A method of generating integrals in real time, comprising:
acquiring an integral generation rule;
acquiring transaction flow information of a user in real time and sending the transaction flow information to a message queue;
taking the transaction flow information out of the message queue and synchronizing the transaction flow information to a storm cluster;
reading the transaction flow information and matching with the integral generation rule;
and saving the generated integral record according to the matching result.
2. The method of generating points in real-time as claimed in claim 1, wherein synchronizing the transaction flow information to a storm cluster comprises:
aggregating a plurality of transaction streams in the transaction stream information into a transaction stream file according to rules;
and inquiring a storage path of the transaction flow file through the storm cluster, pulling the transaction flow file to the storm cluster according to the storage path, and reading the transaction flow in the transaction flow file.
3. The method of generating points in real time as claimed in claim 2, wherein the transaction pipeline file is deleted after the transaction pipeline of the transaction pipeline file is matched.
4. The method for generating points in real time according to any one of claims 1 to 3, wherein the step of saving the generated point record according to the matching result comprises:
judging whether the user reaches the upper limit of the preset integral quantity, if so, not processing;
judging whether a personal point account is opened by the user, and if not, opening the point account for the user;
and updating the acquired integral record.
5. A system for generating points in real time, comprising:
the data acquisition module is used for acquiring the point generation rule and the transaction flow information of the user and sending the transaction flow information to the message queue;
the data synchronization module is used for taking out the transaction flow information from the message queue and synchronizing the transaction flow information to the storm cluster;
the data matching module is used for reading the transaction flow information and matching the transaction flow information with the point generating rule;
and the data storage module is used for storing the integral generation rule and the integral record formed by matching.
6. The system for generating points in real time of claim 5, wherein the data synchronization module comprises:
the data aggregation unit is used for aggregating a plurality of transaction running water in the transaction running water information into a transaction running water file according to rules;
and the data pulling unit is used for inquiring the storage path of the transaction running file and pulling the transaction running file to the storm cluster according to the storage path.
7. The system for generating points in real time of claim 6, wherein the data synchronization module further comprises: and the data deleting unit is used for deleting the formed transaction running file after the integral matching of the data matching module is finished.
8. The system for generating points in real time of claim 6, wherein the storage path of the transaction pipeline file is stored in the storage module.
9. A system for generating points in real time as claimed in any one of claims 5 to 7, further comprising: and the judging module is used for judging whether the daily integral of the user reaches the upper limit and whether the user opens an integral account after the integral matching of the data matching module is finished, wherein if the daily integral of the user reaches the upper limit, the user does not process the daily integral, and if the daily integral of the user does not open the integral account, the user opens the integral account.
10. A computer readable storage medium having computer readable program instructions stored thereon for performing the method of any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010184774.XA CN111369302A (en) | 2020-03-17 | 2020-03-17 | Method, system and computer readable storage medium for generating points in real time |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010184774.XA CN111369302A (en) | 2020-03-17 | 2020-03-17 | Method, system and computer readable storage medium for generating points in real time |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111369302A true CN111369302A (en) | 2020-07-03 |
Family
ID=71210541
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010184774.XA Pending CN111369302A (en) | 2020-03-17 | 2020-03-17 | Method, system and computer readable storage medium for generating points in real time |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111369302A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112085488A (en) * | 2020-09-28 | 2020-12-15 | 中国建设银行股份有限公司 | General point account management method and system |
| CN113378622A (en) * | 2021-04-06 | 2021-09-10 | 青岛以萨数据技术有限公司 | Specific person identification method, device, system and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105468626A (en) * | 2014-09-04 | 2016-04-06 | 腾讯科技（北京）有限公司 | Data processing method and system |
| CN105843959A (en) * | 2016-04-18 | 2016-08-10 | 中国建设银行股份有限公司 | Bonus point calculation method and system based on processing of big data |
| CN110362600A (en) * | 2019-07-22 | 2019-10-22 | 广西大学 | A kind of random ordering data flow distribution aggregate query method, system and medium |
| CN110750562A (en) * | 2018-07-20 | 2020-02-04 | 武汉烽火众智智慧之星科技有限公司 | Storm-based real-time data comparison early warning method and system |
-
2020
- 2020-03-17 CN CN202010184774.XA patent/CN111369302A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105468626A (en) * | 2014-09-04 | 2016-04-06 | 腾讯科技（北京）有限公司 | Data processing method and system |
| CN105843959A (en) * | 2016-04-18 | 2016-08-10 | 中国建设银行股份有限公司 | Bonus point calculation method and system based on processing of big data |
| CN110750562A (en) * | 2018-07-20 | 2020-02-04 | 武汉烽火众智智慧之星科技有限公司 | Storm-based real-time data comparison early warning method and system |
| CN110362600A (en) * | 2019-07-22 | 2019-10-22 | 广西大学 | A kind of random ordering data flow distribution aggregate query method, system and medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112085488A (en) * | 2020-09-28 | 2020-12-15 | 中国建设银行股份有限公司 | General point account management method and system |
| CN113378622A (en) * | 2021-04-06 | 2021-09-10 | 青岛以萨数据技术有限公司 | Specific person identification method, device, system and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022126974A1 (en) | Kafka-based incremental data synchronization method and apparatus, device, and medium | |
| CN105373541B (en) | The processing method and system of the data operation request of database | |
| CN109063109A (en) | A kind of data query system based on ether mill | |
| CN105069109B (en) | A kind of method and system of distributed data base dilatation | |
| CN104317957B (en) | A kind of open platform of report form processing, system and report processing method | |
| CN113282611B (en) | Method, device, computer equipment and storage medium for synchronizing stream data | |
| CN103793493A (en) | Method and system for processing car-mounted terminal mass data | |
| CN111369302A (en) | Method, system and computer readable storage medium for generating points in real time | |
| CN110502583A (en) | Distributed Data Synchronization method, apparatus, equipment and readable storage medium storing program for executing | |
| CN113094434A (en) | Database synchronization method, system, device, electronic equipment and medium | |
| CN112527801A (en) | Data synchronization method and system between relational database and big data system | |
| CN112328569A (en) | Construction method based on Flume distributed data collection architecture | |
| CN110597821B (en) | Method and device for changing database table structure | |
| CN105786877B (en) | A kind of date storage method, system and querying method | |
| CN115291806A (en) | Processing method, processing device, electronic equipment and storage medium | |
| CN115292414A (en) | Method for synchronizing service data to data bins | |
| CN107273462A (en) | One kind builds HBase cluster full-text index methods, method for reading data and method for writing data | |
| CN116383207A (en) | Data tag management method and device, electronic equipment and storage medium | |
| CN110472972B (en) | Synchronous snapshot method and system for block chain storage data | |
| CN109614380A (en) | Log processing method, system, computer equipment and readable medium | |
| CN106096824B (en) | A kind of main distribution integrative graph resource share method | |
| CN109240599A (en) | A kind of big data stocking system is integrated | |
| CN115408546A (en) | Time sequence data management method, device, equipment and storage medium | |
| CN109308310A (en) | A kind of subsystem data interconnection processing method for asset management platform | |
| CN112948410A (en) | Data processing method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |