CN112200683A - Financial market member end holographic market information acquisition method - Google Patents
Financial market member end holographic market information acquisition method Download PDFInfo
- Publication number
- CN112200683A CN112200683A CN202011125119.3A CN202011125119A CN112200683A CN 112200683 A CN112200683 A CN 112200683A CN 202011125119 A CN202011125119 A CN 202011125119A CN 112200683 A CN112200683 A CN 112200683A
- Authority
- CN
- China
- Prior art keywords
- market
- stroke
- price
- data
- quotations
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 28
- 230000006870 function Effects 0.000 claims description 3
- 238000012217 deletion Methods 0.000 claims description 2
- 230000037430 deletion Effects 0.000 claims description 2
- 238000010276 construction Methods 0.000 abstract description 3
- 238000011161 development Methods 0.000 abstract description 3
- 230000008569 process Effects 0.000 abstract description 2
- 238000012545 processing Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/06—Asset management; Financial planning or analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2255—Hash tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24553—Query execution of query operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Development Economics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computer Security & Cryptography (AREA)
- Technology Law (AREA)
- Strategic Management (AREA)
- Software Systems (AREA)
- Marketing (AREA)
- Databases & Information Systems (AREA)
- Economics (AREA)
- General Business, Economics & Management (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Entrepreneurship & Innovation (AREA)
- Game Theory and Decision Science (AREA)
- Human Resources & Organizations (AREA)
- Operations Research (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
本发明提供了一种金融市场会员端全息行情获取方法，通过内核旁路获取金融交所的网络数据；包括对获取的网络数据包按对应的金融交易所行情协议重组，获取逐笔行情；从所述逐笔行情中提取消息记录号，判断是否缺失对应逐笔行情；数据存放于共享内存中，这样即使进程退出后，数据依然存在；根据逐笔行情中的合约哈希值分发逐笔数据到不同的Disruptor队列中；订单簿和内容生成器组成一条业务流水线，流水线的入口是Disruptor队列；订单簿构建完成后，并发的生成行情给投资者。本发明提供的方法解决了金融市场盘口信息不能快速完整获取的问题，此方法构建盘口信息完整，延迟低，扩展性高，架构简单，开发迭代和上市速度快。The invention provides a method for obtaining holographic market quotations on a member terminal of a financial market, which obtains network data of a financial exchange through a kernel bypass; the method includes reorganizing the acquired network data packets according to the corresponding financial exchange quotation protocol to obtain the quotations one by one; The message record number is extracted from the tick-by-ticket quotations, and it is judged whether the corresponding tick-by-tick quotations are missing; the data is stored in the shared memory, so that even after the process exits, the data still exists; the tick-by-tick data is distributed according to the contract hash value in the tick-by-tick quotations into different Disruptor queues; the order book and the content generator form a business pipeline, and the entry of the pipeline is the Disruptor queue; after the order book is constructed, the market quotations are generated concurrently to investors. The method provided by the invention solves the problem that the market information of the financial market cannot be quickly and completely obtained. The method has the advantages of complete construction of the market information, low delay, high scalability, simple structure, and fast development iteration and listing speed.
Description
Technical Field
The invention belongs to the technical field of computer data processing, and relates to a financial market member end holographic market information acquisition method.
Background
The financial exchange issues each consignment and deal information, which we call as "data by data"
The data of market transmitted by the financial exchange in real time includes entrusted ID, entrusted contract, entrusted quantity and entrusted price, and also includes withdrawal order and deal. All the commissions on the day are accumulated according to price, the withdrawal and the transaction are deducted, and the total price of the commissions from the drop to the rise is obtained, all the commissions which are not committed are collected together to be called 'holographic quotations', and a data structure containing the information is generally recorded as 'order book (OrderBook)'.
Since there is a limit of the minimum price change unit (denoted as TickSize) in the trade rules of a contract, the price step number (denoted as LevelCount) can be calculated by the following formula within the range of fluctuation range formed by the highest price (denoted as HighLimit) and the lowest price (denoted as LowLimit) of a single contract: LevelCount ═ Int ((HighLimit-LowLimit)/TickSize) + 1.
With the development of the global financial market, more and more users participate in financial transactions such as stock and futures, the dynamic state of a trading disk is changed and becomes more and more complex, the price grade number provided by the current market system is generally below 10 grades, the complete comprehensiveness of the information of the disk is sacrificed, the visual field of the users is limited, and great challenges are brought to the clear dynamic state of the disk. The high frequency transaction requires a market system that can provide more complete, lower delay market data, higher extensibility, and requires products to be quickly marketed.
Disclosure of Invention
1. The technical problem to be solved is as follows:
the existing financial market opening information can not be acquired quickly and completely.
2. The technical scheme is as follows:
in order to solve the above problems, the invention provides a financial market member end holographic market acquiring method, which comprises the following steps: the method comprises the following steps: acquiring a market quotation network data packet of a financial transaction by a kernel bypass; step two: recombining the acquired market quotation network data packets according to corresponding financial exchange market quotation protocols to acquire market quotations one by one; step three: extracting message record numbers from the market quotations one by one, judging whether the market quotations corresponding to the missing information are missing or not, and requesting missing data from a transaction according to the missing message record numbers if the market quotations are missing; step four: distributing the stroke-by-stroke data to different Disproptor queues according to contract hash values in the stroke-by-stroke quotation, wherein the hash function is as follows: (ii) a Step five: dividing a market into a plurality of mutually independent contract sets according to contracts, wherein one contract set is distributed with one service pipeline, and each pipeline is mutually independent and does not share resources; step six: inputting stroke-by-stroke data and constructing an order book; the stroke-by-stroke data comprises stroke-by-stroke entrusting and stroke-by-stroke bargaining; step seven: and after the order book is constructed, generating quotations to investors concurrently.
The method for judging the deletion in the third step comprises the following steps: and judging whether the message record numbers extracted from the strokes are continuously and monotonically increased by 1 or not, and if not, generating data loss.
And step two, storing the acquired quotations one by one in a shared memory.
The data includes entrusted ID, entrusted contract, entrusted quantity, entrusted price, and also includes withdrawn quantity and transaction price.
The specific steps of the input stroke-by-stroke entrusting are as follows: firstly, storing the one-by-one entrusts, searching a corresponding price gear group array according to a contract, obtaining a price gear group in a corresponding direction in the price gear group array according to a buying and selling direction, finding a corresponding price gear in the price gear group according to the price, and adding the total number of the gears to the number of the current one-by-one entrusts if the price is the buying direction; if the price is the selling direction, the total number of the gear is subtracted by the current consignment-by-delivery number, and if the total number of the current price units is 0, the data of the gear is deleted from the price gear group.
And the data is stored one by adopting a hash table structure.
The specific steps of the input stroke-by-stroke deal making are as follows: if the buyer entrustment index is 0, the corresponding buyer entrustment does not exist, and if the buyer entrustment index is 1, the corresponding buyer entrustment exists, the buyer entrustment information record number is used for searching the memory base, and the corresponding entrustment is stored one by one; if the seller entrusted index is 0, which means no corresponding seller entrusts, and 1, which means corresponding seller entrusts, the seller entrusted message record number is used to search the memory base, and the stored corresponding entrusts are ordered one by one.
In step seven, the quotation is produced according to the theme by adopting a multicast UDP mode.
The theme includes: frequency of holographic market generation, contract number and gear.
3. Has the advantages that:
the method provided by the invention solves the problem that the financial market inventory information can not be rapidly and completely acquired, and the method has the advantages of complete construction inventory information, low delay, high expansibility, simple architecture and high development iteration and marketing speed. Compared with the prior art, the invention has the following advantages: the information of the disc opening is complete; order book construction and market generation can be performed in parallel, processing delay is low, and microsecond-level penetration delay is achieved; the expansibility is good, more CPU cores are adapted, and higher throughput is obtained. The data of multiple periods and multiple gears can be flexibly generated to the client.
Detailed Description
The present invention will be described in detail below with reference to examples.
Example 1
A holographic quotation obtaining method for financial market member end includes obtaining network data packet by kernel bypass mode, bypassing high delay of kernel network protocol stack of traditional operation system, recombining obtained quotation network data packet according to corresponding financial exchange quotation protocol to obtain quotation one by one, and dividing into entrusting and bargaining. And then extracting a message record number (sequence number) from the market quotation, judging whether the message record number is continuously and monotonically increased by 1, if not, the data is lost, and requesting the lost data from the exchange according to the lost message record number.
In order to ensure the integrity of the data, the data is stored in the shared memory, so that the data still exists even after the process exits, the reliability of the system is improved, the service is quickly recovered after the self fault of the system is ensured, and the holographic market information service is provided for investors.
Then distributing the stroke-by-stroke data to different Disproptor queues according to contract hash values in the stroke-by-stroke quotation,a contract is generally a string of characters that is converted to an integer and then the integer is used to compute a hash value. The hash function is
The number of the dispatcher queues needs to be prime numbers, such as 2,3,5 and 7 …, and only one modular operation is needed, so that the algorithm for distributing data is low in complexity and high in speed.
The method comprises the steps of dividing a market into a plurality of mutually independent contract sets according to contracts, distributing a service production line by one contract set, enabling each service production line to be mutually independent and not to share any resource, linearly expanding the service production lines according to the number of CPUs (central processing units) of a server, realizing load balance and expanding throughput.
Example 2
On the basis of example 1, entrusts one by one: the method is characterized in that firstly, the one-by-one entrusts are saved, the one-by-one data are saved by adopting a hash table structure, compared with the traditional array form, more space is saved, the query is more efficient, the key of the hash table is a message record number, and the value is the one-by-one entrusts.
The data includes ID of entrustment, entrustment contract, entrustment quantity and entrustment price, and also includes withdrawal and deal. All the commissions on the day are accumulated according to price, the withdrawal order and the completed commitment are deducted, and the total price of the commitment from the drop to the rise is obtained, and all the commissions which are not completed are collected together, so that the 'holographic quotation (HologricQuotes)'.
And searching a corresponding price gear group array according to the contract, obtaining a price gear group in a corresponding direction in the price gear group array according to the buying and selling direction, and finding a corresponding price gear in the price gear group according to the price. Calculating the quantity, if the direction is buying, adding the total quantity of the gears to the quantity of current one-by-one entrusts; if the price is the selling direction, the total number of the gear is subtracted by the current consignment-by-delivery number, and if the total number of the current price units is 0, the data of the gear is deleted from the price gear group.
And (3) carrying out transaction by stroke: if the buyer entrustment index is 0, no corresponding buyer entrustment exists, if the buyer entrustment index is 1, corresponding entrustment in the memory is searched by using the buyer entrustment message record number, and thus the entrustment processing flow is entered, if the seller entrustment index is 0, no corresponding seller entrustment exists, if the seller entrustment index is 1, corresponding entrustment in the memory is searched by using the seller entrustment message record number, and thus the entrustment processing flow is entered.
In example 3
On the basis of the embodiment 1 or the embodiment 2, after the single book is constructed, a market is concurrently generated to investors, and generally, a multicast UDP mode is adopted to generate contents according to a theme. The theme may include: frequency of holographic market generation, contract number, gear, etc.
And the market data issued to investors under the condition of less gears are not compressed. And for the condition of more gears, the released gear data is compressed for the investor in real time.
Although the present invention has been described with reference to the preferred embodiments, it should be understood that various changes and modifications can be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (9)
1. A financial market member end holographic market acquisition method comprises the following steps: the method comprises the following steps: acquiring a market quotation network data packet of a financial transaction by a kernel bypass; step two: recombining the acquired market quotation network data packets according to corresponding financial exchange market quotation protocols to acquire market quotations one by one; step three: extracting message record numbers from the market quotations one by one, judging whether the market quotations corresponding to the missing information are missing or not, and requesting missing data from a transaction according to the missing message record numbers if the market quotations are missing; step four: distributing the stroke-by-stroke data to different Disproptor queues according to contract hash values in the stroke-by-stroke quotation, wherein the hash function is as follows:
(ii) a Step five: according to the contract, the market conditions are changed one by oneDividing the contract into a plurality of independent contract sets, distributing a service pipeline by one contract set, wherein each pipeline is independent and does not share resources; step six: inputting stroke-by-stroke data and constructing an order book; the stroke-by-stroke data comprises stroke-by-stroke entrusting and stroke-by-stroke bargaining; step seven: and after the order book is constructed, generating quotations to investors concurrently.
2. The method of claim 1, wherein: the method for judging the deletion in the third step comprises the following steps: and judging whether the message record numbers extracted from the strokes are continuously and monotonically increased by 1 or not, and if not, generating data loss.
3. The method of claim 1, wherein: and step two, storing the acquired quotations one by one in a shared memory.
4. The method of claim 1, wherein: the data includes entrusted ID, entrusted contract, entrusted quantity, entrusted price, and also includes withdrawn quantity and transaction price.
5. The method of any one of claims 1-4, wherein: the specific steps of the input stroke-by-stroke entrusting are as follows: firstly, storing the one-by-one entrusts, searching a corresponding price gear group array according to a contract, obtaining a price gear group in a corresponding direction in the price gear group array according to a buying and selling direction, finding a corresponding price gear in the price gear group according to the price, and adding the total number of the gears to the number of the current one-by-one entrusts if the price is the buying direction; if the price is the selling direction, the total number of the gear is subtracted by the current consignment-by-delivery number, and if the total number of the current price units is 0, the data of the gear is deleted from the price gear group.
6. The method of claim 5, wherein: and the data is stored one by adopting a hash table structure.
7. The method of any one of claims 1-4, wherein: the specific steps of the input stroke-by-stroke deal making are as follows: if the buyer entrustment index is 0, the corresponding buyer entrustment does not exist, and if the buyer entrustment index is 1, the corresponding buyer entrustment exists, the buyer entrustment information record number is used for searching the memory base, and the corresponding entrustment is stored one by one; if the seller entrusted index is 0, which means no corresponding seller entrusts, and 1, which means corresponding seller entrusts, the seller entrusted message record number is used to search the memory base, and the stored corresponding entrusts are ordered one by one.
8. The method of any one of claims 1-4, wherein: in step seven, the quotation is produced according to the theme by adopting a multicast UDP mode.
9. The method of claim 9, wherein: the theme includes: frequency of holographic market generation, contract number and gear.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011125119.3A CN112200683A (en) | 2020-10-20 | 2020-10-20 | Financial market member end holographic market information acquisition method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011125119.3A CN112200683A (en) | 2020-10-20 | 2020-10-20 | Financial market member end holographic market information acquisition method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112200683A true CN112200683A (en) | 2021-01-08 |
Family
ID=74009763
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011125119.3A Pending CN112200683A (en) | 2020-10-20 | 2020-10-20 | Financial market member end holographic market information acquisition method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112200683A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113962807A (en) * | 2021-09-28 | 2022-01-21 | 中泰证券股份有限公司 | Method for deeply restoring millisecond order book Level2-plus service |
| CN114549129A (en) * | 2022-02-22 | 2022-05-27 | 上海金融期货信息技术有限公司 | Low-delay high-throughput real-time order book generation method |
| CN115686869A (en) * | 2022-12-29 | 2023-02-03 | 杭州迈拓大数据服务有限公司 | Resource processing method, system, electronic device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120317051A1 (en) * | 2011-06-07 | 2012-12-13 | Tall Iv Charles H | System and Method for Delegated Pricing and Quote Maintenance for Trading of Dependent Financial Instruments |
| CN107748797A (en) * | 2017-11-07 | 2018-03-02 | 众安信息技术服务有限公司 | The processing method of financial market data |
| CN107808261A (en) * | 2017-11-29 | 2018-03-16 | 上海大智慧信息科技有限公司 | ACE decision-making stock analysis method and system |
| CN108269188A (en) * | 2016-12-30 | 2018-07-10 | 上海金融期货信息技术有限公司 | A kind of exchange's quotation information processing method and system based on FPGA |
-
2020
- 2020-10-20 CN CN202011125119.3A patent/CN112200683A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120317051A1 (en) * | 2011-06-07 | 2012-12-13 | Tall Iv Charles H | System and Method for Delegated Pricing and Quote Maintenance for Trading of Dependent Financial Instruments |
| CN108269188A (en) * | 2016-12-30 | 2018-07-10 | 上海金融期货信息技术有限公司 | A kind of exchange's quotation information processing method and system based on FPGA |
| CN107748797A (en) * | 2017-11-07 | 2018-03-02 | 众安信息技术服务有限公司 | The processing method of financial market data |
| CN107808261A (en) * | 2017-11-29 | 2018-03-16 | 上海大智慧信息科技有限公司 | ACE decision-making stock analysis method and system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113962807A (en) * | 2021-09-28 | 2022-01-21 | 中泰证券股份有限公司 | Method for deeply restoring millisecond order book Level2-plus service |
| CN114549129A (en) * | 2022-02-22 | 2022-05-27 | 上海金融期货信息技术有限公司 | Low-delay high-throughput real-time order book generation method |
| CN115686869A (en) * | 2022-12-29 | 2023-02-03 | 杭州迈拓大数据服务有限公司 | Resource processing method, system, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108200203B (en) | Block chain system based on double-layer network | |
| JP5871619B2 (en) | Method and apparatus for high-speed processing of financial market depth data | |
| CN112200683A (en) | Financial market member end holographic market information acquisition method | |
| US8626625B2 (en) | Trade engine processing of mass quote messages and resulting production of market data | |
| US20200092084A1 (en) | System and methods for operating a blockchain network | |
| US8392322B2 (en) | Transformation of a multi-leg security definition for calculation of implied orders in an electronic trading system | |
| US8791948B2 (en) | Methods and systems to generate graphical representations of relationships between persons based on transactions | |
| US8775475B2 (en) | Transaction data representations using an adjacency matrix | |
| CN108347483B (en) | Decentralized computing system based on two-layer network | |
| CN110941771B (en) | Commodity parallel dynamic pushing method in e-commerce platform | |
| CN111488352A (en) | Point exchange method and device based on business data block chain | |
| EP4561027A1 (en) | Data processing method and apparatus based on hierarchical chain network, and device and medium | |
| CN114253957B (en) | Data processing method, related equipment, storage medium and computer program product | |
| CN111488613A (en) | Data efficient query method and device for service data block chain | |
| CN110321218A (en) | A method of based on point to point network system solution MIXED INTEGER program | |
| Henker et al. | Hephaistos: A management system for massive order book data from multiple centralized crypto exchanges with an internal unified order book | |
| Brunet et al. | Exploring the data of blockchain-based metaverses | |
| CN111522662B (en) | Node system for financial analysis and implementation method thereof | |
| Abbas et al. | Understanding world economy dynamics based on indicators and events | |
| CN111695132A (en) | Voting data storage method and system based on service data block chain | |
| CN109951521A (en) | A kind of Online Video management based on IPFS system and use system | |
| AU2011201335B2 (en) | A system for matching orders in a single threaded matching engine for stock exchanges | |
| US20240257149A1 (en) | Method and system for generation of insights from regulatory filings | |
| Ivohin et al. | Making Real Time Bidding Solution for Video ADS | |
| KR20230148643A (en) | Method for implementing product supplychain service and financial service and apparatus for performing the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210108 |
|
| RJ01 | Rejection of invention patent application after publication |