CN114443566B - Method for judging consistency of incremental snapshot market data - Google Patents

Method for judging consistency of incremental snapshot market data Download PDF

Info

Publication number
CN114443566B
CN114443566B CN202210081439.6A CN202210081439A CN114443566B CN 114443566 B CN114443566 B CN 114443566B CN 202210081439 A CN202210081439 A CN 202210081439A CN 114443566 B CN114443566 B CN 114443566B
Authority
CN
China
Prior art keywords
data
ddr
market data
consistent
judgment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210081439.6A
Other languages
Chinese (zh)
Other versions
CN114443566A (en
Inventor
温士魁
杨海钢
贾一平
涂开辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhongke Shengxin Technology Co ltd
Original Assignee
Beijing Zhongke Shengxin Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhongke Shengxin Technology Co ltd filed Critical Beijing Zhongke Shengxin Technology Co ltd
Priority to CN202210081439.6A priority Critical patent/CN114443566B/en
Publication of CN114443566A publication Critical patent/CN114443566A/en
Application granted granted Critical
Publication of CN114443566B publication Critical patent/CN114443566B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/128Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1405Saving, restoring, recovering or retrying at machine instruction level
    • G06F11/141Saving, restoring, recovering or retrying at machine instruction level for bus or memory accesses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/04Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • General Engineering & Computer Science (AREA)
  • Finance (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Databases & Information Systems (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Technology Law (AREA)
  • General Business, Economics & Management (AREA)
  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)

Abstract

The invention relates to a method for judging consistency of incremental snapshot market data, and belongs to the technical field of data processing. The method performs the steps of 1) receiving market data; if the snapshot type return value is 1, outputting the market data to the DDR; if the snapshot type return value is 2, jumping to the step 2); 2) Judging according to the operational characters in the market data; 3) Reading all field values of corresponding security codes in the DDR, and sequentially judging whether the price, the bid amount, the total entrustment number and the DDR are consistent or not; if the judgment is consistent, the existing data in the DDR is directly output, and if the judgment is inconsistent, the existing data in the DDR is updated. The invention finishes the judgment by three values, namely the consistency of the front data and the back data is determined, and the process is only 3 clock cycles. The processing flows of the three data are consistent, and decoding can be realized by only one set of program, so that the logic resources are reduced.

Description

Method for judging consistency of incremental snapshot market data
Technical Field
The invention relates to a method for judging consistency of incremental snapshot market data, and belongs to the technical field of data processing.
Background
The upper evidence Level-2 market data source adopts a FAST coding format, and effectively compresses the original data, wherein the snapshot market further compresses the data in a full and incremental manner, the full data of the snapshot is transmitted every 3 seconds, and only incremental data needing to be updated fields are transmitted at other times. The delta data needs to be recovered from all the previous field data. The customer may have the same incremental data for two times before and after for various reasons, and how to restore the same incremental data for two times into full data is a problem to be considered. If the second data is still recovered from the previous data, it is clear that the erroneous data is recovered. In a traditional PC side software decoding mode, data can be completely stored in a memory, then consistency comparison is carried out on incremental data, and if the incremental data are consistent, the operation is abandoned for the second time. The FPGA can also do this by storing data into ram twice, and then comparing the data one by one, but the gear entrusted data is very much, reading and comparing all the data can take a very long clock cycle, and for a financial acceleration system with low delay requirement, this scheme is not acceptable, so we need to perform a special design to solve this problem.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: a method for consistency determination of incremental snapshot market data is provided.
In order to solve the technical problems, the technical scheme provided by the invention is as follows: a method for judging consistency of incremental snapshot market data executes the following steps:
1) Receiving market data;
if the snapshot type return value is 1, outputting the market data to the DDR;
if the snapshot type return value is 2, jumping to the step 2);
2) Judging whether the market data is a new adding operation, an updating operation or a deleting operation relative to the previous market data according to the operational characters in the market data;
the operational characters are the price, the bid amount and the total entrusting stroke number in the market data in the step 2);
3) Reading all field values of corresponding security codes in the DDR, and sequentially judging whether the price is consistent with the price in the DDR, the bid amount is consistent with the bid amount in the DDR, and the total entrusting number is consistent with the total entrusting number in the DDR;
if the judgment is consistent, the existing data in the DDR is directly output, and if the judgment is inconsistent, the existing data in the DDR is updated.
The improvement of the technical scheme is as follows: after skipping to the step 2) according to the snapshot type value, searching existing data in the DDR according to security codes in the market data, and storing the price, the bid amount and the total entrusting number into a keyword information register; storing the market data into a first-in first-out memory while searching for DDR; and after the judgment of the step 3) is finished, reading the market data from the first-in first-out memory, and carrying out corresponding processing according to the judgment result of the step 3).
The invention has the beneficial effects that: the invention can determine the consistency of the front and back data only by three values, and the whole process only needs 3 clock cycles. And the processing flows of the three data are consistent, so that decoding can be realized only by one set of program, and the logic resources are reduced.
Drawings
FIG. 1 is a schematic flow chart of a method according to an embodiment of the present invention.
Fig. 2 is a schematic flow chart of consistency determination.
FIG. 3 is a flow diagram of incremental data processing.
FIG. 4 is a flow chart of incremental process state logic control.
Detailed Description
Example one
In this embodiment, as shown in fig. 1, a method for determining consistency of incremental snapshot market data performs the following steps:
1) Receiving market data;
if the snapshot type (ImageStatus) return value is 1, outputting the market data to the DDR;
if the snapshot type return value is 2, jumping to the step 2);
2) Judging whether the market data is a new adding operation, an updating operation or a deleting operation relative to the previous market data according to the operational characters in the market data;
the operational characters are the price, the bid amount and the total entrusted stroke number in the market data in the step 2);
3) Reading all field values of corresponding security codes (SecurityID) in the DDR, and sequentially judging whether the price is consistent with the price in the DDR, the bid amount is consistent with the bid amount in the DDR, and the total entrusting number is consistent with the total entrusting number in the DDR;
if the above judgments are all consistent, the existing data in the DDR is directly output, and if the above judgments have inconsistent positions, the existing data in the DDR is updated, and the flow is shown in fig. 2.
After jumping to step 2) according to the snapshot type, searching the existing data in the DDR according to the security codes in the market data, and storing the price, the bid amount and the total entrustment stroke number into a keyword information register; storing the market data into a first-in first-out memory while searching for DDR; after the judgment of step 3) is completed, reading the market data from the fifo, and performing corresponding processing according to the judgment result of step 3), wherein the flow is shown in fig. 3.
The logic control in the above steps is performed by a state machine, the state machine jumps as shown in fig. 4, when the data of the fifo memory is not empty and the DDR data is completely read, the jump is started, and at the same time, the data in the fifo memory is read, when the read price data state is jumped to, the value is compared with the highest price of the data in the last DDR, if the data is equal, the signal bid _ first _ price is set to 1, then the jump is performed backwards, when the read purchase quantity data state is jumped to, the value is compared with the highest purchase quantity of the data in the last DDR, if the data is equal, the signal bid _ sa _ qty is set to 1, then the jump is performed backwards, when the read total purchase quantity data state is jumped to, the signal bid _ sam _ operation is compared with the total purchase quantity of the highest price of the data in the last DDR, if the signal bid _ sam _ sa _ operation is consistent, the next status is judged, the signal bid _ amp _ sa _ operation is proved to be consistent, if the increment data is the increment data, and the data in the last DDR is completely output, and the RAM data is directly notified if the increment data is the increment data, and the data is not needed to be the last data. If the data is 0, the incremental data is different from the previous incremental data, normal processing is carried out later, data in the RAM is updated by using data in the first-in first-out memory later, after the updating is finished, the data is output to the PCIE on one hand, and on the other hand, the data is stored in the DDR again to overwrite the previous data and is used by the subsequent incremental data updating. And after the state machine finishes processing, jumping back to the IDLE state, waiting for the next incremental data to arrive, and repeating the process.
The present invention is not limited to the specific technical solutions described in the above embodiments, and the present invention may have other embodiments in addition to the above embodiments. It will be understood by those skilled in the art that various changes, substitutions of equivalents, and alterations can be made without departing from the spirit and scope of the invention.

Claims (1)

1. A method for judging consistency of incremental snapshot market data is characterized by comprising the following steps:
1) Receiving market data;
if the snapshot type return value is 1, namely the full data, the market data is output to the DDR;
if the snapshot type return value is 2, namely the incremental data, jumping to the step 2);
2) Judging whether the operation data is a new adding operation, an updating operation or a deleting operation relative to the last market data according to the operational characters in the market data;
the operational characters correspond to the price, the bid amount and the total entrusted stroke number in the market data in the step 2);
3) Reading all field values of the corresponding security codes in the DDR, and sequentially judging whether the price is consistent with the price in the DDR, the bid quantity is consistent with the bid quantity in the DDR, and the total entrusting stroke number is consistent with the total entrusting stroke number in the DDR;
if the judgment is consistent, the existing data in the DDR is directly output, and if the judgment is inconsistent, the existing data in the DDR is updated;
after jumping to the step 2) according to the snapshot type return value, searching the existing data in the DDR according to the security codes in the market data, and storing the price, the purchase applying amount and the total entrustment number into a keyword information register; storing the market data into a first-in first-out memory while searching for DDR; and after the judgment of the step 3) is finished, reading the market data from the first-in first-out memory, and carrying out corresponding processing according to the judgment result of the step 3).
CN202210081439.6A 2022-01-24 2022-01-24 Method for judging consistency of incremental snapshot market data Active CN114443566B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210081439.6A CN114443566B (en) 2022-01-24 2022-01-24 Method for judging consistency of incremental snapshot market data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210081439.6A CN114443566B (en) 2022-01-24 2022-01-24 Method for judging consistency of incremental snapshot market data

Publications (2)

Publication Number Publication Date
CN114443566A CN114443566A (en) 2022-05-06
CN114443566B true CN114443566B (en) 2023-03-24

Family

ID=81368962

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210081439.6A Active CN114443566B (en) 2022-01-24 2022-01-24 Method for judging consistency of incremental snapshot market data

Country Status (1)

Country Link
CN (1) CN114443566B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018067257A (en) * 2016-10-21 2018-04-26 上田ハーロー 株式会社 Transaction device, transaction program and transaction method
CN109254911A (en) * 2018-08-13 2019-01-22 兴业证券股份有限公司 Transaction software market monitoring method and storage medium
CN112003814A (en) * 2019-05-27 2020-11-27 招商证券股份有限公司 Market data processing method and device, terminal equipment and storage medium
CN112650499A (en) * 2020-12-29 2021-04-13 国泰君安证券股份有限公司 System for realizing hardware decoding processing of exchange level-2FAST market based on OpenCL platform
CN112822256A (en) * 2020-12-31 2021-05-18 上海英方软件股份有限公司 Method and device for transmitting data stream of quotation file

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6839686B1 (en) * 1999-03-29 2005-01-04 Dlj Long Term Investment Corporation Method and system for providing financial information and evaluating securities of a financial debt instrument
CN101515362A (en) * 2008-12-26 2009-08-26 上证所信息网络有限公司 Method for transmitting data of an overall snapshot of a securities quotation order
CN109086111B (en) * 2018-07-12 2021-10-08 越信智能科技(深圳)有限公司 Image-text display method and system for transaction interface data
CN112000675B (en) * 2019-05-27 2023-12-01 招商证券股份有限公司 Quotation data updating method and device, terminal equipment and storage medium
CN111815445A (en) * 2020-06-29 2020-10-23 浪潮电子信息产业股份有限公司 Method and related device for reconstructing market data
CN112347020A (en) * 2020-10-26 2021-02-09 东方证券股份有限公司 FAST market analysis system and method based on CGRA

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018067257A (en) * 2016-10-21 2018-04-26 上田ハーロー 株式会社 Transaction device, transaction program and transaction method
CN109254911A (en) * 2018-08-13 2019-01-22 兴业证券股份有限公司 Transaction software market monitoring method and storage medium
CN112003814A (en) * 2019-05-27 2020-11-27 招商证券股份有限公司 Market data processing method and device, terminal equipment and storage medium
CN112650499A (en) * 2020-12-29 2021-04-13 国泰君安证券股份有限公司 System for realizing hardware decoding processing of exchange level-2FAST market based on OpenCL platform
CN112822256A (en) * 2020-12-31 2021-05-18 上海英方软件股份有限公司 Method and device for transmitting data stream of quotation file

Also Published As

Publication number Publication date
CN114443566A (en) 2022-05-06

Similar Documents

Publication Publication Date Title
CN114443566B (en) Method for judging consistency of incremental snapshot market data
CN110851390B (en) Method and system for realizing 4M 1553B bus protocol based on FPGA
US3781814A (en) Method and apparatus for applying source language statements to a digital computer
CN112434092A (en) Data processing method and device, electronic equipment and readable storage medium
US11874753B2 (en) Log compression
US11176018B1 (en) Inline hardware compression subsystem for emulation trace data
CN115794186A (en) Game data hot updating method, device, server and storage medium
CN111541747B (en) Data check point setting method and device
CN109614656B (en) TLM (transport layer management Module) system for OpenGL (open graphics library) display list calling
CN111158994A (en) Pressure testing performance testing method and device
JPH11353205A (en) Processor built-in trace memory
CN109614148B (en) Data logic operation method, monitoring method and device
CN100383798C (en) Stimulating platform and method for random storage package file
CN111708572B (en) Automatic control flow chart generation method based on Clang program structure
CN110727402B (en) High-speed FC data real-time receiving and frame loss-free storage method
CN114840545B (en) Block chain fine-grained editing method supporting rapid state updating
CN114218441B (en) Method for calling and displaying UOF document
GB2366634A (en) Gray code program counter and address compiler
CN111224896B (en) Multi-pointer message management method and device
US20220237500A1 (en) Test case execution sequences
CN117938172A (en) Hardware GZIP data compression system based on RISC-V architecture
JP4406119B2 (en) In-circuit emulator
CN113886351A (en) Method, system, equipment and storage medium for generating task operation instruction mapping model training data
CN112486910A (en) Method for rapidly analyzing mass data files
CN115952326A (en) Chain table type data structure and data processing method thereof, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant