CN116700632B - High-reliability financial information data storage method - Google Patents

High-reliability financial information data storage method Download PDF

Info

Publication number
CN116700632B
CN116700632B CN202310982901.4A CN202310982901A CN116700632B CN 116700632 B CN116700632 B CN 116700632B CN 202310982901 A CN202310982901 A CN 202310982901A CN 116700632 B CN116700632 B CN 116700632B
Authority
CN
China
Prior art keywords
data
storage
distributed storage
information
distributed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310982901.4A
Other languages
Chinese (zh)
Other versions
CN116700632A (en
Inventor
常念
熊桃
肖鹏
邓美菊
廖韵祺
马艺玮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan Zhongying Dream Commercial Factoring Co ltd
Original Assignee
Hunan Zhongying Dream Commercial Factoring Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan Zhongying Dream Commercial Factoring Co ltd filed Critical Hunan Zhongying Dream Commercial Factoring Co ltd
Priority to CN202310982901.4A priority Critical patent/CN116700632B/en
Publication of CN116700632A publication Critical patent/CN116700632A/en
Application granted granted Critical
Publication of CN116700632B publication Critical patent/CN116700632B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • G06F3/0619Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/062Securing storage systems
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention provides a high-reliability financial information data storage method, and relates to the technical field of financial data storage. The method comprises the steps of obtaining writing request information, performing preparation analysis of writing data according to the writing request information, and generating and sending writing verification information; according to the writing request information, historical storage data are called to prepare for writing and storing, and writing permission judgment is carried out by obtaining the writing data; matching the history storage data with the written data to form initial matching update data; acquiring all written data in the arrangement period, and performing time-based sequential adjustment analysis on the initial matching update data according to the written data to form storage update data; and establishing a distributed storage model, and performing distributed storage on the storage update data. The method can reasonably store the financial information data in a distributed manner while improving the storage safety of the financial information data, and improves the storage efficiency and reliability.

Description

High-reliability financial information data storage method
Technical Field
The invention relates to the technical field of financial data storage, in particular to a high-reliability financial information data storage method.
Background
The financial data has high accuracy and real-time performance, and correspondingly has high requirements on storage. Because the updating frequency of the financial data is high, the updating speed is high, and meanwhile, for a storage center, the financial data can come from different data uploading points in a short time, so that the storage of the financial data is required to have high storage efficiency and large storage volume, and the data processing requirement of a large number of data uploading points can be met.
Currently, with the development of storage technology, a financial storage system can basically meet the requirements of financial storage, but because financial data also has strong privacy, data protection of the financial storage needs to be considered seriously, because the influence caused by disclosure of the financial data is huge. In addition, the current common financial data storage mode is distributed storage, so that the volume of data storage is improved, and the storage safety is further improved. But how to reasonably perform distributed storage is a problem which needs to be considered seriously at present.
Therefore, designing a highly reliable financial information data storage method, which can reasonably perform distributed storage while improving the security of financial information data storage, improves the storage efficiency and reliability is a problem to be solved at present.
Disclosure of Invention
The invention aims to provide a high-reliability financial information data storage method, which is characterized in that through reasonably verifying the writing requirements of a request point for writing and storing financial data, a financial data safety transmission channel between the request point and a storage center is established by utilizing a verification means, so that the safety of storing and transmitting the financial data is improved, and on the other hand, reasonable preparation for storing the financial data is realized in the verification process, the effect that the storage center orderly and reasonably performs storage processing under a large number of high-frequency financial data writing requests is realized, and the storage process is optimized while the storage efficiency is improved. In addition, the logic adjustment of writing the financial data is performed periodically, so that the logic connection accuracy between the newly stored financial data and the old data is further improved, and more accurate and reliable financial storage data is formed. Meanwhile, the newly generated storage data is reasonably distributed and stored, so that the optimization of the storage capacity is facilitated, and meanwhile, the accidental loss and loss of the data can be avoided.
In a first aspect, the present invention provides a highly reliable financial information data storage method, including obtaining write request information, performing a preparation analysis of write data according to the write request information, generating and transmitting write verification information; according to the writing request information, historical storage data are called to prepare for writing and storing, and writing permission judgment is carried out by obtaining the writing data; matching the history storage data with the written data to form initial matching update data; acquiring all written data in the arrangement period, and performing time-based sequential adjustment analysis on the initial matching update data according to the written data to form storage update data; and establishing a distributed storage model, and performing distributed storage on the storage update data.
According to the method, the request points for writing and storing the financial data are reasonably verified through the writing requirements, a financial data safety transmission channel between the request points and the storage center is established by utilizing verification means, the safety of storing and transmitting the financial data is improved, reasonable preparation for storing the financial data is realized in the verification process, the storage center is enabled to orderly and reasonably conduct storage processing under a large number of high-frequency financial data writing requests, and the storage process is optimized while the storage efficiency is improved. In addition, the logic adjustment of writing the financial data is performed periodically, so that the logic connection accuracy between the newly stored financial data and the old data is further improved, and more accurate and reliable financial storage data is formed. Meanwhile, the newly generated storage data is reasonably distributed and stored, so that the optimization of the storage capacity is facilitated, and meanwhile, the accidental loss and loss of the data can be avoided.
As one possible implementation manner, obtaining the writing request information, performing preparation analysis of writing data according to the writing request information, generating and sending writing verification information, including: acquiring writing request information, and determining the type of writing data according to the writing request information; determining the writing memory of the writing data according to the writing request information And recording write request arrival time of acquiring write request information +.>The method comprises the steps of carrying out a first treatment on the surface of the Setting a first request authentication function->Wherein, the method comprises the steps of, wherein,representing a numerical function over time, +.>Representing a digitizing function for the storage amount; according to write request arrival time->And write memory +.>Verifying the function with the first request +.>Determining a first write verification value; write request arrival time +.>And the first write verification value is transmitted as write verification information.
In the invention, in order to improve the security of financial data transmission between different request points and a storage center, a secure transmission channel between the request points and the storage center is established before the request points send financial data to be written to the storage center. Here, this is achieved by performing verification of the write request information. The storage amount and the arrival time of the request are used as the first verification mode, and on one hand, a safer verification mode can be established with mutual verification between the request points according to the characteristics of the data written by the request. I.e. the requesting point synchronizes the first verification function with the data center, a bi-directional verification is enabled. If the data is intercepted in the middle of the process to decrypt, the first verification function, the writing request time, the first writing verification value and the writing storage amount are required to be known at the same time, the intersection of each transmission of the four data does not occur, the complete acquisition is difficult, and the reliability of the data transmission is improved; on the other hand, when verification is performed, a reasonable writing storage mode is established based on the acquired request data to provide initial preparation data, so that the problem that storage efficiency is low and data storage errors are generated due to the fact that writing data from a plurality of different sources are directly acquired for storage is avoided. The first write verification value can be obtained by the write request arrival time and the write memory amount using the first request verification function at the memory center. And then the first write verification value and the write request arrival time are sent to a request point, a first request verification function is also defined in the request point, the request point uses the acquired write request arrival time and the write memory volume directly acquired from the write data by the request point to carry out the operation of the verification function so as to compare the operation result with the first write verification value, and if the operation result is the same, the request point and the memory center establish a protocol channel for financial data transmission. For comparison between the first written verification value and the operation result, the subjective or objective reason setting range value of the whole system can be considered for comparison, so that comparison confirmation of the verification value can be more reasonably carried out. It should be noted that, for the first request verification function, the form is various, and it is preferable that the first request verification function can form a one-to-one mapping result based on different variables without repetition. Of course, for the numerical function, the function is selected as the same as the first request verification function, and the data acquired after the function processing is required to be the numerical function of which the first request verification function can perform the input processing.
As one possible implementation manner, the preparation of writing and storing is performed by retrieving the historical storage data according to the writing request information, and the judgment of writing permission is performed by acquiring the writing data, including: according to the type of the written data, the same type of storage data in a threshold period is obtained, and storage matching type data are formed; determining feature information to be stored according to the stored matching type data; acquiring written data, extracting written financial data, and determining the actual storage amount of the written financial dataAnd extracts the license verification value +.>Recording the actual arrival time of the written data +.>The method comprises the steps of carrying out a first treatment on the surface of the According to the actual storage capacity->License verification value->And actual arrival time->And performing first permission verification.
In the invention, after the storage center finishes the preparation analysis of the writing request information and sends the verification information, in order to further improve the storage efficiency of the financial information data, the storage center extracts and processes the historical storage data of the same type matched with the data to be written according to the writing request information in advance, and simultaneously, the request point sends the financial data to be written and stored to the storage center after acquiring the writing verification information and verifying the writing request information, and carries out permission verification on the received financial information data before the storage center uses the financial information data. Here too, the license verification uses a verification function, which combines the storage amount, the arrival time of the write request and the duration of the data transfer. It can be understood that, in order to ensure that the request point and the storage center both complete the verification under the license verification, the request point first uses these data to perform the verification, and sends the license verification result formed by the verification to the storage center together for the verification. In the process of permission verification, the transmitted verification data is only a part, so that the verification data cannot be intercepted and cracked in the middle, the verification safety can be ensured, and the financial information data transmission safety is further improved. It should be noted that, for the determination of the threshold period, the time length of the history data that may be affected by the newly written financial information data in the time dimension may be determined based on the big data analysis, so that the sufficiency of the data that is called for matching may be ensured, and the matching of the data may be completed efficiently.
As a possible implementation, according to the actual storage amountLicense verification value->And actual arrival timePerforming a first license verification, comprising: setting a first license verification functionWherein->A funnel function representing a length of time; according to the actual storage capacity->Write request arrival time->Actual arrival time +.>Determining the actual license verification value +.>The method comprises the steps of carrying out a first treatment on the surface of the According to the license verification value->And the actual license verification value +.>The following determination was made: if->=/>The permission passes, and otherwise the permission does not pass.
In the invention, the transmission time is taken as a new verification parameter of permission verification, the request point carries out transmission prediction according to the data quantity of written financial data, and the permission verification value is determined by combining the predicted value. And the memory center performs permission verification based on the actual transmission time. In this way, the request point has a certain data deviation between the permission verification value determined according to the predicted value and the permission verification value determined by the storage center based on the actual transmission time length, so that the result judgment of the permission verification is affected, and therefore, the elimination processing of the result deviation is performed by setting a funnel function, and the effectiveness and the correctness of the verification are improved. The funnel function is used for providing an allowable process of deviation between the actual transmission time length and the estimated transmission time length of the request point, namely, a certain actual length change range can obtain the data with the same estimated time length. The function of the funnel is to map a range of values onto a fixed value, which may be a piecewise function, or other types of functions, etc.
As one possible implementation, matching the historical stored data with the written data to form initial matched updated data includes: according to the characteristic information, carrying out characteristic extraction on the written financial data to obtain storage characteristic information; and logically associating the stored characteristic information with the characteristic information, and updating the intermediate variable data with influence after the information association to form initial matching update data.
According to the invention, the characteristic extraction is carried out, so that the content which is the same as the storage format or storage form of the historical storage data can be formed, the information connection of the historical storage data and the current writing data can be carried out more conveniently and rapidly, the data matching is completed, the data relevance is established, the waste of direct classified storage on the storage space is reduced, the data storage form is unified on the other hand, the data is clearer and more orderly, the complete data can be obtained quickly and efficiently in the subsequent data extraction and analysis, and the data storage is further optimized. In addition, only the logical connection and updating of the feature information are not enough, for example, the cashing of the amount in the financial data involves the change of interest or profit, so after the accounting of the cashing is completed, the calculation basis and basis of the interest or profit are also required to be updated.
As one possible implementation manner, obtaining all the writing data in the finishing period, and performing time-based sequential adjustment analysis on the initial matching update data according to the writing data to form storage update data, including: acquiring all the written data in the arrangement period, and extracting the generation time of the written financial data in the written data; acquiring the arrival time of a write request of each write data, and determining the current storage sequence of each write data according to the sequence of the arrival time of the write request in the time dimension; arranging the generation time in the time dimension, and determining the data generation sequence; comparing the current storage sequence with the data generation sequence, and if the sequence difference exists, performing write adjustment on initial matching update data corresponding to the write data in the current storage sequence by taking the data generation sequence as a reference to form storage update data.
In the invention, because of the high frequency and high data volume of the updating of the financial data, although the writing sequence numbers are provided for different data written in a short time by a verification mode, a certain sequence exists among the writing data, and the sequences can influence the actual situation of the financial data, such as that the cashes stored by taking the writing time as the sequence are paid first and then pay out, reasonable interest is generated during the period, but the writing sequence is actually paid first and then paid out in time due to the influence of objective and subjective reasons such as the transmission time, the business handling of the request point and the like of different request points, and the profit is generated during the period, but the liability interest is paid out, so the correction of the sequence of the stored data is needed to be regularly, and the accuracy and the correctness of the financial data are ensured. Of course, regarding the sort cycle, considering the nature of quick update of the financial data, a shorter time cycle can be used as the adjustment cycle, and when talking, the sort of financial data to be stored can be designed according to the type of financial data, so as to reasonably utilize the resources of the storage center while meeting the requirements.
As one possible implementation manner, establishing a distributed storage model, and performing distributed storage on storage update data, including: analyzing the data type and the data relativity of the stored updated data to form distributed stored data information; acquiring information of distributed storage points and distributed storage capacity of each distributed storage point; establishing a distributed storage model by combining distributed storage data information, distributed storage point information and distributed storage capacity; and carrying out distributed storage on the storage update data according to the distributed storage model.
In the invention, the storage center is used for storing the financial information data, on the basis of the distributed storage, on one hand, the storage data of the distributed storage points are obtained, and on the other hand, the situation that the storage center needs to store the data is obtained to establish a corresponding storage model, so that the storage flow is further optimized, and the storage efficiency is improved.
As one possible implementation manner, the analysis of the data type and the data relatedness of the stored update data to form distributed stored data information includes: setting a distributed storage period, and acquiring data types of storage update data in the distributed storage period to form a storage type set A, wherein: a= [ ,/>,…,/>]N represents a reference number for storing the data type in the update data; setting a sub-package threshold alpha, and counting the characteristic information quantity of the data written each time in each data type to form the total written characteristic quantity +.>M represents the number of times of writing data in the distributed storage period, and the following data packing process is performed to form a data packet set of each data, i.e. +.>=[/>,/>,…,/>]K is the sequential number of the data packets formed by the data types numbered n in the distributed storage period,/v>The storage amount of a packet with a packet number k: when->And when the alpha is less than or equal to the alpha, packaging the data corresponding to the feature total quantity which meets the condition in the time dimension, and forming a data packet.
In the present invention, if the financial data of the storage center is stored in a distributed manner, the relevance of the financial information data needs to be considered, because the distributed storage manner reduces the relevance of the financial information data with logical connection. According to the invention, by establishing a reasonable sub-package threshold and combining the relativity between the characteristic information amounts with logic relation brought by each type of data when writing in batches, the two writing data with lower relativity are used as the data segmentation basis of distributed storage, so that the relativity between the same type of financial information data on different distributed sites can be optimized as much as possible, the loss of the logic relativity between the data is avoided, and the node control cost of the distributed storage is reduced.
As one possible implementation manner, in combination with the distributed storage data information, the distributed storage point information, and the distributed storage amount, the building a distributed storage model includes: acquiring the number i of distributed storage points and the distributed storage amount corresponding to each distributed storage pointAnd combine storage type set A and data packet set +.>The following determination was made: when n > i, the total amount of storage of each data type on the distributed storage period is acquired +.>All data types are stored in total +.>Arranging the distributed storage points from small to large, and arranging the distributed storage points according to the distributed storage amount +.>Arranging the data types in order of small to large, and storing the total amount +.>The determined order and the distributed storage point are distributed according to the distributed storage amount +.>The determined sequence is in one-to-one correspondence, for the multiple data types, corresponding data packets are combined according to the condition that the arrangement sequence is unchanged, and after the proportion of the storage quantity between the strokes of combination is closest to the proportion of the storage quantity of the distributed storage points, the data packets are distributed and stored in the corresponding distributed storage points in a combination mode; when n=i, the storage total amount of each data type on the distributed storage period is acquired +. >All data types are stored in total +.>Arranging the distributed storage points from small to large, and arranging the distributed storage points according to the distributed storage amount +.>Arranging the data from small to largeType +_according to storage total->The determined order and the distributed storage point are distributed according to the distributed storage amount +.>The determined order is stored in a one-to-one correspondence.
In the present invention, there is provided a way to perform distributed storage for two cases: first, the number of distributed storage points is smaller than the type of written financial information data. In this case, the number of the distributed storage points is small, so as to avoid the confusion of data caused by excessive data types stored on each distributed storage point, after the distributed stations are stored in a one-to-one correspondence manner, the excessive data types are combined according to the situation that the storage quantity ratio of the distributed storage points is small according to the data packet, so that the effect of reducing the number of the storage types of each distributed storage point can be realized while the storage space is reasonably arranged, and the storage efficiency is facilitated. Here, the number of data packets is not less than the number of storage points, so that the reasonable packet dividing threshold α needs to be designed with the number of storage points known. In the case where the number of distributed storage points is equal to the type of the written financial information data, the distributed storage points may be stored in a one-to-one correspondence with different data types.
As one possible implementation manner, in combination with the distributed storage data information, the distributed storage point information, and the distributed storage amount, the building a distributed storage model includes: when n < i, the total storage amount of each data type on the distributed storage period is obtainedAll data types are stored in total +.>Arranging from small to large, and determining the storage ratio after sequencing; according to the distributed storage amount corresponding to the distributed storage point +.>And (3) carrying out combination, determining the combination closest to the storage ratio, and storing the combination in one-to-one correspondence with the data types according to the combination ratio.
In the present invention, as well, for the case where the number of distributed storage points is larger than the type of written financial information data. The storage capacity of the distributed storage points is considered, so that the reasonable utilization of the storage capacity is realized. By distributing the total storage amount of different types according to the size relation, the storage efficiency and the consistent availability of data can be further improved.
The high-reliability financial information data storage method provided by the invention has the beneficial effects that:
according to the method, the request points for writing and storing the financial data are reasonably verified, a financial data safety transmission channel between the request points and the storage center is established by utilizing verification means, the safety of storing and transmitting the financial data is improved, reasonable preparation for storing the financial data is realized in the verification process, the effect that the storage center orderly and reasonably performs storage processing under a large number of high-frequency financial data writing requests is realized, and the storage process is optimized while the storage efficiency is improved. In addition, the logic adjustment of writing the financial data is performed periodically, so that the logic connection accuracy between the newly stored financial data and the old data is further improved, and more accurate and reliable financial storage data is formed. Meanwhile, the newly generated storage data is reasonably distributed and stored, so that the optimization of the storage capacity is facilitated, and meanwhile, the accidental loss and loss of the data can be avoided.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments of the present invention will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and should not be considered as limiting the scope, and other related drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a step diagram of a highly reliable financial information data storage method according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.
The financial data has high accuracy and real-time performance, and correspondingly has high requirements on storage. Because the updating frequency of the financial data is high, the updating speed is high, and meanwhile, for a storage center, the financial data can come from different data uploading points in a short time, so that the storage of the financial data is required to have high storage efficiency and large storage volume, and the data processing requirement of a large number of data uploading points can be met.
Currently, with the development of storage technology, a financial storage system can basically meet the requirements of financial storage, but because financial data also has strong privacy, data protection of the financial storage needs to be considered seriously, because the influence caused by disclosure of the financial data is huge. In addition, the current common financial data storage mode is distributed storage, so that the volume of data storage is improved, and the storage safety is further improved. But how to reasonably perform distributed storage is a problem which needs to be considered seriously at present.
Referring to fig. 1, an embodiment of the present invention provides a highly reliable financial information data storage method. According to the method, the request points for writing and storing the financial data are reasonably verified, a financial data safety transmission channel between the request points and the storage center is established by utilizing verification means, the safety of storing and transmitting the financial data is improved, reasonable preparation for storing the financial data is realized in the verification process, the effect that the storage center orderly and reasonably performs storage processing under a large number of high-frequency financial data writing requests is realized, and the storage process is optimized while the storage efficiency is improved. In addition, the logic adjustment of writing the financial data is performed periodically, so that the logic connection accuracy between the newly stored financial data and the old data is further improved, and more accurate and reliable financial storage data is formed. Meanwhile, the newly generated storage data is reasonably distributed and stored, so that the optimization of the storage capacity is facilitated, and meanwhile, the accidental loss and loss of the data can be avoided.
The high-reliability financial information data storage method specifically comprises the following steps:
s1: write request information is acquired, write data is prepared and analyzed according to the write request information, and write verification information is generated and sent.
The method comprises the following steps: acquiring writing request information, and determining the type of writing data according to the writing request information; determining the writing memory of the writing data according to the writing request informationAnd recording the arrival time of the write request for acquiring the information of the write requestThe method comprises the steps of carrying out a first treatment on the surface of the Setting a first request authentication function->Wherein->Representing a numerical function over time, +.>Representing a digitizing function for the storage amount; according to write request arrival time->And write memoryVerifying the function with the first request +.>Determining a first write verification value; write request arrival time +.>And the first write verification value is transmitted as write verification information.
In order to improve the security of the financial data transmission between different request points and the storage center, a secure transmission channel between the request points and the storage center is established before the request points send the financial data to be written to the storage center. Here, this is achieved by performing verification of the write request information. The storage amount and the arrival time of the request are used as the first verification mode, and on one hand, a safer verification mode can be established with mutual verification between the request points according to the characteristics of the data written by the request. I.e. the requesting point synchronizes the first verification function with the data center, a bi-directional verification is enabled. If the data is intercepted in the middle of the process to decrypt, the first verification function, the writing request time, the first writing verification value and the writing storage amount are required to be known at the same time, the intersection of each transmission of the four data does not occur, the complete acquisition is difficult, and the reliability of the data transmission is improved; on the other hand, when verification is performed, a reasonable writing storage mode is established based on the acquired request data to provide initial preparation data, so that the problem that storage efficiency is low and data storage errors are generated due to the fact that writing data from a plurality of different sources are directly acquired for storage is avoided. The first write verification value can be obtained by the write request arrival time and the write memory amount using the first request verification function at the memory center. And then the first write verification value and the write request arrival time are sent to a request point, a first request verification function is also defined in the request point, the request point uses the acquired write request arrival time and the write memory volume directly acquired from the write data by the request point to carry out the operation of the verification function so as to compare the operation result with the first write verification value, and if the operation result is the same, the request point and the memory center establish a protocol channel for financial data transmission. For comparison between the first written verification value and the operation result, the subjective or objective reason setting range value of the whole system can be considered for comparison, so that comparison confirmation of the verification value can be more reasonably carried out. It should be noted that, for the first request verification function, the form is various, and it is preferable that the first request verification function can form a one-to-one mapping result based on different variables without repetition. Of course, for the numerical function, the function is selected as the same as the first request verification function, and the data acquired after the function processing is required to be the numerical function of which the first request verification function can perform the input processing.
S2: and according to the writing request information, the historical storage data is called to prepare for writing storage, and the writing data is obtained to judge writing permission.
The method for preparing the writing and storing by calling the history storage data according to the writing request information and obtaining the writing data to judge the writing permission comprises the following steps: according to the type of the written data, the same type of storage data in a threshold period is obtained, and storage matching type data are formed; determining feature information to be stored according to the stored matching type data; acquiring written data, extracting written financial data, and determining the actual storage amount of the written financial dataAnd extracts the license verification value +.>Recording the actual arrival time of the written data +.>The method comprises the steps of carrying out a first treatment on the surface of the According to the actual storage capacity->License verification value->And actual arrival time->And performing first permission verification.
After the storage center finishes preparation analysis of the writing request information and sends verification information, in order to further improve the storage efficiency of the financial information data, the storage center extracts and processes the historical storage data of the same type matched with the data to be written according to the writing request information in advance, meanwhile, the request point sends the financial data which needs to be written and stored to the storage center after acquiring the writing verification information and verifying the writing verification information, and the storage center carries out permission verification before using the received financial information data. Here too, the license verification uses a verification function, which combines the storage amount, the arrival time of the write request and the duration of the data transfer. It can be understood that, in order to ensure that the request point and the storage center both complete the verification under the license verification, the request point first uses these data to perform the verification, and sends the license verification result formed by the verification to the storage center together for the verification. In the process of permission verification, the transmitted verification data is only a part, so that the verification data cannot be intercepted and cracked in the middle, the verification safety can be ensured, and the financial information data transmission safety is further improved. It should be noted that, for the determination of the threshold period, the time length of the history data that may be affected by the newly written financial information data in the time dimension may be determined based on the big data analysis, so that the sufficiency of the data that is called for matching may be ensured, and the matching of the data may be completed efficiently.
According to the actual storage amountLicense verification value->And actual arrival time->Performing a first license verification, comprising: setting the first license verification function +.>Wherein->Leakage indicating length of timeA bucket function; according to the actual storage capacity->Write request arrival time->Actual arrival time +.>Determining the actual license verification value +.>The method comprises the steps of carrying out a first treatment on the surface of the According to the license verification value->And the actual license verification value +.>The following determination was made: if->=/>The permission passes, and otherwise the permission does not pass.
And taking the transmission time length as a new verification parameter of the permission verification, performing transmission prediction by the request point according to the data quantity of the written financial data, and determining a permission verification value by combining the predicted value. And the memory center performs permission verification based on the actual transmission time. In this way, the request point has a certain data deviation between the permission verification value determined according to the predicted value and the permission verification value determined by the storage center based on the actual transmission time length, so that the result judgment of the permission verification is affected, and therefore, the elimination processing of the result deviation is performed by setting a funnel function, and the effectiveness and the correctness of the verification are improved. The funnel function is used for providing an allowable process of deviation between the actual transmission time length and the estimated transmission time length of the request point, namely, a certain actual length change range can obtain the data with the same estimated time length. The function of the funnel is to map a range of values onto a fixed value, which may be a piecewise function, or other types of functions, etc.
S3: and matching the historical storage data with the written data to form initial matching update data.
Matching the history storage data with the writing data to form initial matching update data, comprising: according to the characteristic information, carrying out characteristic extraction on the written financial data to obtain storage characteristic information; and logically associating the stored characteristic information with the characteristic information, and updating the intermediate variable data with influence after the information association to form initial matching update data.
The method has the advantages that the characteristic extraction can be carried out, the content which is the same as the storage format or storage form of the historical storage data can be formed, the information connection of the historical storage data and the current writing data can be carried out more conveniently and rapidly, the data matching is completed, the relevance of the data is established, the waste of direct classified storage to the storage space is reduced, the data storage form is unified, the data are clearer and more orderly, the complete data can be obtained quickly and efficiently during the follow-up data extraction and analysis, and the data storage is further optimized. In addition, only the logical connection and updating of the feature information are not enough, for example, the cashing of the amount in the financial data involves the change of interest or profit, so after the accounting of the cashing is completed, the calculation basis and basis of the interest or profit are also required to be updated.
S4: and acquiring all the written data in the arrangement period, and performing time-based sequential adjustment analysis on the initial matching update data according to the written data to form storage update data.
Acquiring all the written data in the arrangement period, and performing time-based sequential adjustment analysis on the initial matching update data according to the written data to form storage update data, wherein the method comprises the following steps: acquiring all the written data in the arrangement period, and extracting the generation time of the written financial data in the written data; acquiring the arrival time of a write request of each write data, and determining the current storage sequence of each write data according to the sequence of the arrival time of the write request in the time dimension; arranging the generation time in the time dimension, and determining the data generation sequence; comparing the current storage sequence with the data generation sequence, and if the sequence difference exists, performing write adjustment on initial matching update data corresponding to the write data in the current storage sequence by taking the data generation sequence as a reference to form storage update data.
Because of the high frequency and high data volume of the updating of the financial data, although the writing sequence numbers are provided for different data written in a short time by a verification mode, a certain sequence exists among the writing data, and the sequences also influence the actual situation of the financial data, such as that the cashes stored in the sequence of writing time are paid first and then paid, reasonable interest is generated during the period, but the writing sequence is actually paid first and then paid in the time due to the influence of objective and subjective reasons such as transmission time, business handling of the request point and the like of different request points, profit is generated during the period, and the paying of liability interest is generated, so that the sequence correction of the stored data is required regularly, and the accuracy and the correctness of the financial data are ensured. Of course, regarding the sort cycle, considering the nature of quick update of the financial data, a shorter time cycle can be used as the adjustment cycle, and when talking, the sort of financial data to be stored can be designed according to the type of financial data, so as to reasonably utilize the resources of the storage center while meeting the requirements.
S5: and establishing a distributed storage model, and performing distributed storage on the storage update data.
Establishing a distributed storage model, and performing distributed storage on storage update data, wherein the method comprises the following steps: analyzing the data type and the data relativity of the stored updated data to form distributed stored data information; acquiring information of distributed storage points and distributed storage capacity of each distributed storage point; establishing a distributed storage model by combining distributed storage data information, distributed storage point information and distributed storage capacity; and carrying out distributed storage on the storage update data according to the distributed storage model.
And on the basis of distributed storage, the storage center acquires the storage data of the distributed storage points on one hand, and acquires the condition that the storage center needs to store the data to establish a corresponding storage model on the other hand, thereby further optimizing the storage flow and improving the storage efficiency.
The method for analyzing the data type and the data relativity of the stored updated data to form distributed stored data information comprises the following steps: setting a distributed storage period, and acquiring data types of storage update data in the distributed storage period to form a storage type set A, wherein: N represents a reference number for storing the data type in the update data; setting a sub-package threshold alpha, and counting the characteristic information quantity of the data written each time in each data type to form the total written characteristic quantityM represents the number of times of writing data in the distributed storage period, and the following data packing process is performed to form a data packet set of each data, i.e. +.>K is the sequential number of the data packets formed by the data types numbered n in the distributed storage period,/v>The storage amount of a packet with a packet number k: when->And packaging the data corresponding to the feature total quantity which meets the condition in the time dimension to form a data packet.
If the financial data of the storage center is stored in a distributed manner, the relevance of the financial information data needs to be considered, because the distributed storage manner can reduce the relevance of the financial information data with logical connection. According to the invention, by establishing a reasonable sub-package threshold and combining the relativity between the characteristic information amounts with logic relation brought by each type of data when writing in batches, the two writing data with lower relativity are used as the data segmentation basis of distributed storage, so that the relativity between the same type of financial information data on different distributed sites can be optimized as much as possible, the loss of the logic relativity between the data is avoided, and the node control cost of the distributed storage is reduced.
Combining the distributed storage data information, the distributed storage point information and the distributed storage amount to build a distributed storage model, wherein the method comprises the following steps: acquiring the number i of distributed storage points and the distributed storage amount corresponding to each distributed storage pointAnd combine storage type set A and data packet set +.>The following determination was made: when n > i, the total amount of storage of each data type on the distributed storage period is acquired +.>All data types are stored in total +.>Arranging the distributed storage points from small to large, and arranging the distributed storage points according to the distributed storage amount +.>Arranging the data types in order of small to large, and storing the total amount +.>The determined order and the distributed storage point are distributed according to the distributed storage amount +.>The determined order is in one-to-one correspondence, and for the multiple data types, the corresponding data packets are combined according to the condition that the arrangement order is unchanged, and the strokes are stored between the combinationsAfter the ratio of the quantity is closest to the ratio of the storage quantity of the distributed storage points, distributing and storing the storage quantity into the corresponding distributed storage points in a combined mode; when n=i, the total amount of storage of each data type over the distributed storage period is obtainedAll data types are stored in total +. >Arranging the distributed storage points from small to large, and arranging the distributed storage points according to the distributed storage amount +.>Arranging the data types in order of small to large, and storing the total amount +.>The determined order and the distributed storage point are distributed according to the distributed storage amount +.>The determined order is stored in a one-to-one correspondence.
There is provided a way to perform distributed storage for two cases: first, the number of distributed storage points is smaller than the type of written financial information data. In this case, the number of the distributed storage points is small, so as to avoid the confusion of data caused by excessive data types stored on each distributed storage point, after the distributed stations are stored in a one-to-one correspondence manner, the excessive data types are combined according to the situation that the storage quantity ratio of the distributed storage points is small according to the data packet, so that the effect of reducing the number of the storage types of each distributed storage point can be realized while the storage space is reasonably arranged, and the storage efficiency is facilitated. Here, the number of data packets is not less than the number of storage points, so that the reasonable packet dividing threshold α needs to be designed with the number of storage points known. In the case where the number of distributed storage points is equal to the type of the written financial information data, the distributed storage points may be stored in a one-to-one correspondence with different data types.
Combining the distributed storage data information, the distributed storage point information and the distributed storage amount to build a distributed storage model, wherein the method comprises the following steps: when n < i, the total storage amount of each data type on the distributed storage period is obtainedAll data types are stored in total +.>Arranging from small to large, and determining the storage ratio after sequencing; according to the distributed storage amount corresponding to the distributed storage point +.>And (3) carrying out combination, determining the combination closest to the storage ratio, and storing the combination in one-to-one correspondence with the data types according to the combination ratio.
Also, for the case where the number of distributed storage points is greater than the type of written financial information data. The storage capacity of the distributed storage points is considered, so that the reasonable utilization of the storage capacity is realized. By distributing the total storage amount of different types according to the size relation, the storage efficiency and the consistent availability of data can be further improved.
In summary, the high-reliability financial information data storage method provided by the embodiment of the invention has the following beneficial effects:
according to the method, the request points for writing and storing the financial data are reasonably verified, a financial data safety transmission channel between the request points and the storage center is established by utilizing verification means, the safety of storing and transmitting the financial data is improved, reasonable preparation for storing the financial data is realized in the verification process, the effect that the storage center orderly and reasonably performs storage processing under a large number of high-frequency financial data writing requests is realized, and the storage process is optimized while the storage efficiency is improved. In addition, the logic adjustment of writing the financial data is performed periodically, so that the logic connection accuracy between the newly stored financial data and the old data is further improved, and more accurate and reliable financial storage data is formed. Meanwhile, the newly generated storage data is reasonably distributed and stored, so that the optimization of the storage capacity is facilitated, and meanwhile, the accidental loss and loss of the data can be avoided.
In the present invention, "at least one" means one or more, and "a plurality" means two or more. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b, or c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or plural.
It should be understood that, in various embodiments of the present invention, the sequence numbers of the foregoing processes do not mean the order of execution, and the order of execution of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
Those of ordinary skill in the art will appreciate that the elements and method steps of the examples described in connection with the embodiments disclosed herein can be implemented as electronic hardware, or as a combination of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.
In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the invention, which are described in detail and are not to be construed as limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.

Claims (7)

1. A highly reliable financial information data storage method, comprising:
write request information is acquired, write data preparation analysis is carried out according to the write request information, and write verification information is generated and sent:
acquiring the writing request information, and determining a writing data type according to the writing request information;
determining the writing memory amount of the writing data according to the writing request informationAnd recording a write request arrival time of acquiring the write request information>The method comprises the steps of carrying out a first treatment on the surface of the Setting a first request authentication function->Wherein->Representing a numerical function over time, +.>Representing a digitizing function for the storage amount; according to the write request arrival time +. >And the write memory amount +.>Using the first request validation functionDetermining a first write verification value; the write request arrival time +.>And the first write verification value is transmitted as the write verification information;
according to the writing request information, historical storage data are called to prepare for writing storage, and the writing data are obtained to judge writing permission:
according to the write-in data type, the same type of storage data in a threshold period is obtained, and storage matching type data is formed; determining feature information to be stored according to the storage matching type data; acquiring the written data, extracting the written financial data, and determining the actual storage amount S of the written financial data 1 And extracts the license verification value L 1 Recording the actual arrival time T of the written data 1 The method comprises the steps of carrying out a first treatment on the surface of the According to the actual storage amount S 1 Said license verification value L 1 And the actual arrival time T 1 Performing a first license verification;
matching the history storage data with the writing data to form initial matching update data;
acquiring all the written data in the arrangement period, and performing time-based sequential adjustment analysis on the initial matching update data according to the written data to form storage update data:
Acquiring all the written data in the arrangement period, and extracting the generation time of the written financial data in the written data; acquiring the arrival time of the write request of each write data, and determining the current storage sequence of each write data according to the sequence of the arrival time of the write request in the time dimension; arranging the generation time in a time dimension, and determining a data generation sequence; comparing the current storage sequence with the data generation sequence, and if the sequence difference exists, taking the data generation sequence as a reference, and performing write adjustment on the initial matching update data corresponding to the write data in the current storage sequence to form the storage update data;
and establishing a distributed storage model, and performing distributed storage on the storage update data.
2. The highly reliable financial information data storage method as claimed in claim 1, wherein said data storage method is based on said actual storage amount S 1 Said license verification value L 1 And the actual arrival time T 1 Performing a first license verification, comprising:
setting a first license verification functionWherein- >A funnel function representing a length of time;
according to the actual storage amount S 1 The write request arrival time T 0 Said actual time of arrival T 1 Determining an actual license verification value L 2
According to the license verification value L 1 And the actual license verification value L 2 The following determination was made:
if L 1 =L 2 The permission passes, and otherwise the permission does not pass.
3. The highly reliable financial information data storage method of claim 2 wherein said matching said historically stored data with said written data to form initial matching update data comprises:
according to the characteristic information, carrying out characteristic extraction on the written financial data to obtain storage characteristic information;
and logically associating the stored characteristic information with the characteristic information, and updating the intermediate variable data with influence after information association to form the initial matching update data.
4. The highly reliable financial information data storage method of claim 1 wherein said establishing a distributed storage model for distributed storage of stored update data comprises:
analyzing the data type and the data relativity of the stored updated data to form distributed stored data information;
Acquiring information of distributed storage points and distributed storage capacity of each distributed storage point;
establishing a distributed storage model by combining the distributed storage data information, the distributed storage point information and the distributed storage amount;
and carrying out distributed storage on the storage update data according to the distributed storage model.
5. The highly reliable financial information data storage method of claim 4 wherein said analyzing said stored update data for data type and data connectivity forms distributed stored data information comprising:
setting a distributed storage period, and acquiring the data type of the storage update data in the distributed storage period to form a storage type set A, wherein:
A=[A 1 ,A 2 ,…,A n ]n represents the index of the data type in the stored update data;
setting a sub-packet threshold alpha, and counting the characteristic information quantity of the data written each time in each data type to form a written characteristic total quantity b m M represents writing in the distributed storage periodThe number of times of data, and performing the following data packaging processes to form a data packet set of each data, namelyK is the sequential number of the data packets formed by the data types numbered n in the distributed storage period, " >Representing the storage amount of the data packet with the data packet number k:
when b m And when the alpha is less than or equal to the alpha, packaging the data corresponding to the feature total quantity which meets the condition in the time dimension, and forming the data packet.
6. The highly reliable financial information data storage method of claim 5 wherein said combining said distributed storage data information, said distributed storage point information, and said distributed storage amount to build a distributed storage model comprises:
acquiring the number i of distributed storage points and the distributed storage amount C corresponding to each distributed storage point i And combine the storage type set A and the data packet set A n The following determination was made:
when n < i, acquiring the storage total amount of each data type on the distributed storage periodAll data types are stored according to the total quantity a n Arranging the distributed storage points from small to large, and arranging the distributed storage points according to the distributed storage amount +.>Arranging the data types in order of from small to large, and arranging the data types in the total storage amount +.>The determined order and the distributed storage points are distributed according to the distributionMemory capacity->The determined sequence is in one-to-one correspondence, for the multiple data types, corresponding data packets are combined according to the condition that the arrangement sequence is unchanged, and after the storage ratio between the strokes of combination is closest to the storage ratio of the distributed storage points, the data packets are distributed and stored in the corresponding distributed storage points in a combination mode;
When n=i, acquiring the total amount of storage of each data type on the distributed storage periodAll data types are stored according to the total amount +.>Arranging the distributed storage points from small to large, and arranging the distributed storage points according to the distributed storage amount +.>Arranging the data types in order of from small to large, and arranging the data types in the total storage amount +.>The determined order and the distributed storage point are distributed according to the distributed storage amount +.>The determined order is stored in a one-to-one correspondence.
7. The highly reliable financial information data storage method of claim 5 wherein said combining said distributed storage data information, said distributed storage point information, and said distributed storage amount to build a distributed storage model comprises:
when n > i, the total amount of storage of each data type on the distributed storage cycle is obtainedAll data types are stored according to the total amount +.>Arranging from small to large, and determining the storage ratio after sequencing;
according to the distributed storage amount corresponding to the distributed storage pointAnd carrying out combination, determining the combination closest to the storage ratio, and storing the combination and the data type in a one-to-one correspondence mode according to the combination ratio.
CN202310982901.4A 2023-08-07 2023-08-07 High-reliability financial information data storage method Active CN116700632B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310982901.4A CN116700632B (en) 2023-08-07 2023-08-07 High-reliability financial information data storage method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310982901.4A CN116700632B (en) 2023-08-07 2023-08-07 High-reliability financial information data storage method

Publications (2)

Publication Number Publication Date
CN116700632A CN116700632A (en) 2023-09-05
CN116700632B true CN116700632B (en) 2023-10-24

Family

ID=87837844

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310982901.4A Active CN116700632B (en) 2023-08-07 2023-08-07 High-reliability financial information data storage method

Country Status (1)

Country Link
CN (1) CN116700632B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105630808A (en) * 2014-10-31 2016-06-01 北京奇虎科技有限公司 Distributed file system based file reading and writing method and node server
CN110619019A (en) * 2019-08-07 2019-12-27 平安科技(深圳)有限公司 Distributed storage method and system of data
CN111192144A (en) * 2020-01-03 2020-05-22 湖南工商大学 Financial data prediction method, device, equipment and storage medium
CN112948409A (en) * 2021-03-31 2021-06-11 中国建设银行股份有限公司 Data processing method and device, electronic equipment and storage medium
CN113297309A (en) * 2021-05-31 2021-08-24 平安证券股份有限公司 Stream data writing method, device, equipment and storage medium
CN115437571A (en) * 2022-09-16 2022-12-06 中国建设银行股份有限公司 Data writing method and device, computer equipment and storage medium
CN115981572A (en) * 2023-02-13 2023-04-18 浪潮电子信息产业股份有限公司 Data consistency verification method and device, electronic equipment and readable storage medium

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9864769B2 (en) * 2014-12-12 2018-01-09 Pure Storage, Inc. Storing data utilizing repeating pattern detection
CN106527958B (en) * 2015-09-09 2020-03-10 阿里巴巴集团控股有限公司 Method and equipment for writing data and acquiring data for distributed storage system
KR101791901B1 (en) * 2016-03-30 2017-10-31 재단법인차세대융합기술연구원 The apparatus and method of smart storage platfoam for efficient storage of big data
US20190286342A1 (en) * 2018-03-16 2019-09-19 Seagate Technology Llc Efficient storage drive read-write head verification
KR102549545B1 (en) * 2018-03-22 2023-06-29 삼성전자주식회사 Storage device and method of operating the storage device
US11507558B2 (en) * 2018-11-20 2022-11-22 Elastic Flash Inc. Distributed data storage and analytics system
US20200250174A1 (en) * 2019-01-31 2020-08-06 Salesforce.Com, Inc. Systems, methods, and apparatuses for implementing efficient storage and validation of data and metadata within a blockchain using distributed ledger technology (dlt)
US11269525B2 (en) * 2020-01-06 2022-03-08 International Business Machines Corporation Co-processing a plurality of dependent systems with a finite number of processing threads
US20230085773A1 (en) * 2020-02-18 2023-03-23 Freeverse, S.L. System and method for dynamic computation scaling in distributed ledger networks

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105630808A (en) * 2014-10-31 2016-06-01 北京奇虎科技有限公司 Distributed file system based file reading and writing method and node server
CN110619019A (en) * 2019-08-07 2019-12-27 平安科技(深圳)有限公司 Distributed storage method and system of data
CN111192144A (en) * 2020-01-03 2020-05-22 湖南工商大学 Financial data prediction method, device, equipment and storage medium
CN112948409A (en) * 2021-03-31 2021-06-11 中国建设银行股份有限公司 Data processing method and device, electronic equipment and storage medium
CN113297309A (en) * 2021-05-31 2021-08-24 平安证券股份有限公司 Stream data writing method, device, equipment and storage medium
CN115437571A (en) * 2022-09-16 2022-12-06 中国建设银行股份有限公司 Data writing method and device, computer equipment and storage medium
CN115981572A (en) * 2023-02-13 2023-04-18 浪潮电子信息产业股份有限公司 Data consistency verification method and device, electronic equipment and readable storage medium

Also Published As

Publication number Publication date
CN116700632A (en) 2023-09-05

Similar Documents

Publication Publication Date Title
CN112153085B (en) Data processing method, node and block chain system
CN108776934B (en) Distributed data calculation method and device, computer equipment and readable storage medium
CN112650762B (en) Data quality monitoring method and device, electronic equipment and storage medium
CN108681565B (en) Block chain data parallel processing method, device, equipment and storage medium
CN108959337A (en) Big data acquisition methods, device, equipment and storage medium
CN110830234B (en) User traffic distribution method and device
CN109614336A (en) A kind of generation method and equipment of test script
CN104518987A (en) Method and device for processing parallel multithreading messages
CN110110160A (en) Determine the method and device of data exception
CN107330680A (en) Red packet control method, device, computer equipment and computer-readable recording medium
CN106302421B (en) A kind of information intercepting processing method and device
CN111290696A (en) Flow control method and device for application program assembly
CN106970841A (en) A kind of resource constraint and dynamic adjusting method based on cloud computing
CN111680900A (en) Work order issuing method and device, electronic equipment and storage medium
CN110120928A (en) A kind of identity authentication method, device, server and computer-readable medium
CN102118361B (en) Method and device for controlling data transmission based on network protocol
CN113595926B (en) API data transmission method, device, equipment and medium based on data middlebox
WO2021233109A1 (en) Blockchain-based message processing method and apparatus, and device and storage medium
CN116700632B (en) High-reliability financial information data storage method
CN107742141B (en) Intelligent identity information acquisition method and system based on RFID technology
CN106294457B (en) Network information pushing method and device
CN115563117B (en) Multi-tenant management application based on SaaS technology and implementation method thereof
WO2023082871A1 (en) Flow service modeling method and apparatus, and platform, electronic device and storage medium
CN114707134A (en) High-performance password card security management method, device and system
CN109558744B (en) Data processing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant