CN116823263A - Method for realizing transaction asset certificate data elements in ceramic industry - Google Patents
Method for realizing transaction asset certificate data elements in ceramic industry Download PDFInfo
- Publication number
- CN116823263A CN116823263A CN202311053806.2A CN202311053806A CN116823263A CN 116823263 A CN116823263 A CN 116823263A CN 202311053806 A CN202311053806 A CN 202311053806A CN 116823263 A CN116823263 A CN 116823263A
- Authority
- CN
- China
- Prior art keywords
- data
- transaction
- layer
- certificate
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 28
- 239000000919 ceramic Substances 0.000 title claims abstract description 20
- 238000012545 processing Methods 0.000 claims abstract description 15
- 238000013479 data entry Methods 0.000 claims abstract description 6
- 230000002776 aggregation Effects 0.000 claims abstract description 4
- 238000004220 aggregation Methods 0.000 claims abstract description 4
- 238000012544 monitoring process Methods 0.000 claims description 18
- 239000002994 raw material Substances 0.000 claims description 13
- 239000000463 material Substances 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 3
- 230000001960 triggered effect Effects 0.000 claims description 3
- 238000011144 upstream manufacturing Methods 0.000 claims description 3
- 238000011156 evaluation Methods 0.000 claims 1
- 238000013461 design Methods 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 11
- 238000011161 development Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013524 data verification Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a method for realizing transaction asset certificate data elements in the ceramic industry, which comprises the following steps: data entry: extracting data of a plurality of data sources to a transaction platform number bin through data aggregation; and (3) data processing: the transaction platform number bin processes the data of the data sources to form three-layer data elements of the transaction evidence chain certificate; transaction proof chain certificate: performing upper block chain on the data elements with three layers; the invention aims to provide a method for realizing transaction asset certificate data elements in the ceramic industry, which ensures that the data elements can be accurately delivered in real time through a flow-batch integrated technical architecture; by applying the three-layer mode design, data display can be clearly performed.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a method for realizing transaction asset certificate data elements in the ceramic industry.
Background
In the ceramic industry, with the development of society, the system is generally subjected to comprehensive digital transformation. In the prior art of data elements of the data asset product, the real-time performance is not particularly strong, the table design is not clear enough, and the data verification method has the problems of more used resources and the like. The industrial trust environment is constructed through the data elements, so that the problems of nonstandard operation mode of the ceramic industry, difficult identification of raw material transaction cost and high enterprise operation cost for a long time are solved, and the high-quality development of the traditional industry on a new data race track is practically enabled.
Disclosure of Invention
The invention aims to provide a method for realizing transaction asset certificate data elements in the ceramic industry, which ensures that the data elements can be accurately delivered in real time through a flow-batch integrated technical architecture; by applying the three-layer mode design, data display can be clearly performed.
To achieve the purpose, the invention adopts the following technical scheme: a method implemented for trading asset certificate data elements for the ceramic industry, comprising the steps of:
data entry: extracting data of a plurality of data sources to a transaction platform number bin through data aggregation;
and (3) data processing: the transaction platform number bin processes the data of the data sources to form three-layer data elements of the transaction evidence chain certificate;
transaction proof chain certificate: the data elements of the application three layers are subjected to block chaining.
Preferably, in the step of data entry, the plurality of data sources includes a raw material platform, a member center, a Ming-Sum system, ming-Sum monorail data, raw material platform file resources, and a background system module.
Preferably, in the data processing step, the transaction platform number bin includes a monitoring log and a number bin modeling;
the monitoring log comprises MySQL and MongoDB; storing data of a raw material platform, a member center, a clear-number pound list system, raw material platform file resources and a background system module to MySQL; storing the Ming few pounds of monorail data to MongoDB;
storing MySQL and MongoDB data into a plurality of bins for modeling through real-time synchronization and offline synchronization, wherein the real-time synchronization adopts Canal to monitor a BinLog log of MySQL, and the BinLog log is imported into Kafka, and then the Bin log is imported into Doris in real time by using a route Load of Doris; offline synchronization adopts Spark timing for one hour to extract MySQL and MongoDB data to Doris;
and taking the data extracted from the monitoring log as an original layer of a plurality of bins in the modeling of the bins, directly carrying out logic operation on the data of the original layer by adopting DorisSQL, generating the data to an application layer, and delivering and uploading the data of the application layer.
Preferably, the data processing step includes the following substeps:
confirm that the customer has completed payment: receiving and judging whether a signal of completing payment of service fees by a client is received;
sending and monitoring message queues: sending a message queue through RabbitMQ, and judging whether the message queue is received or not through a SpringBoot application monitoring service;
generating an application three-layer table: after the message queue is monitored, the DorisSQL is triggered to generate an application three-layer table of the transaction evidence chain, a unique value of three-layer Hash is generated based on data of the application three-layer table, the unique value exists on the MySQL, a new message queue is sent by the RabbitMQ, and finally, after the new message queue is received by the monitoring service, the whole data is uplink.
Preferably, the three layers of the data element specifically include a third layer below the data element as transaction detailed information authentication data, a second layer in the middle as transaction rating authentication data, and a first layer at the top as transaction total rating authentication data.
Preferably, in the transaction detail information authentication data, the relevant data table is subjected to association processing by the DorisSQL to generate a version number, the version numbers of the rest of the data tables are judged by the version numbers of the trade list detail tables, the version numbers of the trade list detail tables are judged by the transaction detail information authentication data, the default is 1 when the transaction detail information authentication data is generated for the first time, otherwise, 1 is added, and the data table names of the trade list detail tables are started by ads_thread.
Preferably, in the transaction rating authentication data, the material information, the pound sheet information, the quality standard, the detection standard and the use in the material ledger are evaluated by DorisSQL, the transportation track, the driving license information and the driving license information in the material ledger, the upstream payment certificate, the statement information and the sales invoice information in the fund ledger, the contract information and the order information in the transaction ledger and the accumulated transaction behavior in the transaction behavior are scored, each item is checked and scored, a scoring data table is generated, the naming of the data table starts with ads_two, the score of the whole transaction is obtained, and the authenticity of the transaction behavior is judged according to the scoring result.
Preferably, in the transaction total score authentication data, the score data table of the second layer is summarized by using DorisSQL to obtain a summarized score authentication table, and the data table name of the summarized score authentication table starts with ads_one.
The technical scheme of the invention has the beneficial effects that: the transaction platform number bin guarantees that the data elements can be accurately delivered in real time through a flow-batch integrated technical architecture; the data can be clearly displayed by applying the three-layer mode design; in the implementation process, a data grading and checking method is adopted in the data processing process, and a mode of 'comparing firstly and then counting secondly' is used, so that service resources are greatly reduced; brings direct economic value to enterprises. The first data product, "Zhong-ceramic-linked transaction evidence chain certificate," introduced according to the present invention, has formally been on-line with Guangzhou data exchange branded-! The invention mainly describes the realization path of the data elements of the 'Zhong-ceramic linked transaction evidence chain certificate'.
Drawings
FIG. 1 is a schematic flow diagram of an implementation of one embodiment of the present invention;
FIG. 2 is a schematic diagram of a data table of a plurality of data sources according to one embodiment of the invention;
FIG. 3 is a schematic diagram of a transaction platform digital bin technology flow architecture according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a full technology flow of an implementation of the entire data element according to one embodiment of the invention;
FIG. 5 is a schematic diagram of the application of three layers in one embodiment of the invention;
FIG. 6 is a data representation of transaction detail data according to one embodiment of the invention;
FIG. 7 is a schematic diagram of a trade bill specification implementation according to one embodiment of the present invention;
FIG. 8 is a schematic diagram of an accessory details table implementation of one embodiment of the present invention;
FIG. 9 is a schematic diagram of a menu list implementation of one embodiment of the present invention;
FIG. 10 is a schematic diagram of a scoring rule data table according to one embodiment of the invention;
FIG. 11 is a schematic diagram of a scoring data table according to one embodiment of the invention;
FIG. 12 is a schematic diagram of a data table of a scoring authentication table summarized in accordance with one embodiment of the invention.
Detailed Description
The technical scheme of the invention is further described below by the specific embodiments with reference to the accompanying drawings.
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings. The embodiments described below by referring to the drawings are illustrative only and are not to be construed as limiting the invention.
In the description of the present invention, unless otherwise indicated, the meaning of "a plurality" is two or more.
Referring to fig. 1-12, a method implemented for trading asset certificate data elements for the ceramic industry, comprising the steps of:
data entry: extracting data of a plurality of data sources to a transaction platform number bin through data aggregation;
and (3) data processing: the transaction platform number bin processes the data of the data sources to form three-layer data elements of the transaction evidence chain certificate;
transaction proof chain certificate: the data elements of the application three layers are subjected to block chaining.
The transaction platform number bin guarantees that the data elements can be accurately delivered in real time through a flow-batch integrated technical architecture; the data can be clearly displayed by applying the three-layer mode design; in the implementation process, a data grading and checking method is adopted in the data processing process, and a mode of 'comparing firstly and then counting secondly' is used, so that service resources are greatly reduced; brings direct economic value to enterprises. The 2023 platform is expected to produce 8000 certificates in total, and the product income is 2800 ten thousand yuan. The first data product, "Zhong-ceramic-linked transaction evidence chain certificate," introduced according to the present invention, has formally been on-line with Guangzhou data exchange branded-! The invention mainly describes the realization path of the data elements of the 'Zhong-ceramic linked transaction evidence chain certificate'.
Specifically, in the data entry step, the plurality of data sources include a raw material platform, a member center, a Ming-Sum system, ming-Sum monorail data, raw material platform file resources, and a background system module.
Specifically, in the data processing step, the transaction platform number bin comprises a monitoring log and a number bin modeling;
the monitoring log comprises MySQL and MongoDB; storing data of a raw material platform, a member center, a clear-number pound list system, raw material platform file resources and a background system module to MySQL; storing the Ming few pounds of monorail data to MongoDB;
the transaction platform number bin uses a technical architecture integrating flow batch, and comprises real-time synchronization and off-line synchronization, mySQL and MongoDB data are stored into a number bin modeling through the real-time synchronization and the off-line synchronization, the real-time synchronization adopts Canal to monitor a BinLog log of MySQL, the BinLog log is imported into Kafka, and then the Bin log is imported into Doris in real time by using a route Load of Doris; offline synchronization adopts Spark timing for one hour to extract MySQL and MongoDB data to Doris;
the data extracted from the monitoring log is used as an original layer of a data warehouse in the modeling of the data warehouse, in order to ensure that the certificate data elements of the transaction evidence chain can be generated quickly, the data of the original layer is directly subjected to logic operation by using DorisSQL and generated to an application layer, and the data of the application layer is delivered and uplink.
Preferably, the data processing step includes the following substeps:
confirm that the customer has completed payment: receiving and judging whether a signal of completing payment of service fees by a client is received;
sending and monitoring message queues: sending a message queue through RabbitMQ, and judging whether the message queue is received or not through a SpringBoot application monitoring service;
generating an application three-layer table: after the message queue is monitored, the DorisSQL is triggered to generate an application three-layer table of the transaction evidence chain, a unique value of three-layer Hash is generated based on data of the application three-layer table, the unique value exists on the MySQL, a new message queue is sent by the RabbitMQ, and finally, after the new message queue is received by the monitoring service, the whole data is uplink.
Preferably, the three layers of the data element specifically include a third layer below the data element as transaction detailed information authentication data, a second layer in the middle as transaction rating authentication data, and a first layer at the top as transaction total rating authentication data.
Preferably, in the transaction detail information authentication data, the relevant data table is subjected to association processing by the DorisSQL to generate a version number, the version numbers of the rest of the data tables are judged by the version numbers of the trade list detail tables, the version numbers of the trade list detail tables are judged by the transaction detail information authentication data, the default is 1 when the transaction detail information authentication data is generated for the first time, otherwise, 1 is added, and the data table names of the trade list detail tables are started by ads_thread.
Preferably, in the transaction rating authentication data, the material information, the pound sheet information, the quality standard, the detection standard and the use in the material ledger are evaluated by DorisSQL, the transportation track, the driving license information and the driving license information in the material ledger, the upstream payment certificate, the statement information and the sales invoice information in the fund ledger, the contract information and the order information in the transaction ledger and the accumulated transaction behavior in the transaction behavior are scored, each item is checked and scored, a scoring data table is generated, the naming of the data table starts with ads_two, the score of the whole transaction is obtained, and the authenticity of the transaction behavior is judged according to the scoring result. The transaction score is a judgment of the authenticity of the transaction behavior, and the more accurate and complete the information filled by the user in the transaction process, the higher the score, the stronger the authenticity. Each item is verified through DorisSQL in implementation in a 'compare first, then statistics' manner, since this can greatly reduce the resource usage of the server.
Preferably, in the transaction total score authentication data, the score data table of the second layer is summarized by using DorisSQL to obtain a summarized score authentication table, and the data table name of the summarized score authentication table starts with ads_one.
In the description herein, reference to the term "embodiment," "example," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The technical principle of the present invention is described above in connection with the specific embodiments. The description is made for the purpose of illustrating the general principles of the invention and should not be taken in any way as limiting the scope of the invention. Other embodiments of the invention will be apparent to those skilled in the art from consideration of this specification without undue burden.
Claims (8)
1. A method implemented for trading asset certificate data elements for the ceramic industry, comprising the steps of:
data entry: extracting data of a plurality of data sources to a transaction platform number bin through data aggregation;
and (3) data processing: the transaction platform number bin processes the data of the data sources to form three-layer data elements of the transaction evidence chain certificate;
transaction proof chain certificate: the data elements of the application three layers are subjected to block chaining.
2. The method of claim 1, wherein in the step of entering the data, the plurality of data sources comprises a raw materials platform, a membership center, a modular system, modular system data, raw materials platform file resources, and a background system module.
3. The method for realizing the data element of the transaction asset certificate in the ceramic industry according to claim 2, wherein in the data processing step, the transaction platform number bin comprises a monitoring log and a number bin modeling;
the monitoring log comprises MySQL and MongoDB; storing data of a raw material platform, a member center, a clear-number pound list system, raw material platform file resources and a background system module to MySQL; storing the Ming few pounds of monorail data to MongoDB;
storing MySQL and MongoDB data into a plurality of bins for modeling through real-time synchronization and offline synchronization, wherein the real-time synchronization adopts Canal to monitor a BinLog log of MySQL, and the BinLog log is imported into Kafka, and then the Bin log is imported into Doris in real time by using a route Load of Doris; offline synchronization adopts Spark timing for one hour to extract MySQL and MongoDB data to Doris;
and taking the data extracted from the monitoring log as an original layer of a plurality of bins in the modeling of the bins, directly carrying out logic operation on the data of the original layer by adopting DorisSQL, generating the data to an application layer, and delivering and uploading the data of the application layer.
4. A method for implementing a ceramic industry transaction asset certificate data element as in claim 3, wherein said data processing step comprises the sub-steps of:
confirm that the customer has completed payment: receiving and judging whether a signal of completing payment of service fees by a client is received;
sending and monitoring message queues: sending a message queue through RabbitMQ, and judging whether the message queue is received or not through a SpringBoot application monitoring service;
generating an application three-layer table: after the message queue is monitored, the DorisSQL is triggered to generate an application three-layer table of the transaction evidence chain, a unique value of three-layer Hash is generated based on data of the application three-layer table, the unique value exists on the MySQL, a new message queue is sent by the RabbitMQ, and finally, after the new message queue is received by the monitoring service, the whole data is uplink.
5. A method for implementing a ceramic industry transaction asset certification data element according to claim 3, wherein the three layers of the data element include a third layer below which is transaction detail information authentication data, a second layer in the middle which is transaction rating authentication data and a first layer at the top which is transaction total rating authentication data.
6. The method according to claim 5, wherein in the transaction detail information authentication data, the relevant data table is processed by DorisSQL to generate a version number, the version numbers of the rest of the data tables are judged by the version numbers of the trade list, the version numbers of the trade list are judged by itself, the default is 1 when the transaction detail information authentication data is generated for the first time, otherwise, 1 is added, and the data table of the trade list is named as ads_thread.
7. The method for realizing the property certificate data element of the transaction in the ceramic industry according to claim 5, wherein in the transaction rating authentication data, the material information, the pound bill information, the quality standard, the detection standard and the use evaluation in the material ledger are carried out through DorisSQL, the transportation track, the driving license information and the driving license information in the logistics ledger, the upstream payment certificate, the statement information and the sales invoice information in the fund ledger, the contract information and the order information in the transaction ledger and the accumulated transaction behavior scoring in the transaction behavior are checked and scored, a scoring data table is generated, the naming of the data table is carried out by taking ads_two as the beginning, the scoring of the whole transaction is obtained, and the authenticity of the transaction behavior is judged according to the scoring result.
8. The method for implementing the ceramic industry transaction asset certificate data element according to claim 7, wherein in the transaction total score authentication data, the score data table of the second layer is summarized by using DorisSQL to obtain a summarized score authentication table, and the name of the data table of the summarized score authentication table is named as ads_one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311053806.2A CN116823263A (en) | 2023-08-21 | 2023-08-21 | Method for realizing transaction asset certificate data elements in ceramic industry |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311053806.2A CN116823263A (en) | 2023-08-21 | 2023-08-21 | Method for realizing transaction asset certificate data elements in ceramic industry |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116823263A true CN116823263A (en) | 2023-09-29 |
Family
ID=88124314
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311053806.2A Pending CN116823263A (en) | 2023-08-21 | 2023-08-21 | Method for realizing transaction asset certificate data elements in ceramic industry |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116823263A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117933944A (en) * | 2024-03-14 | 2024-04-26 | 佛山众陶联供应链服务有限公司 | Transaction data processing method and system convenient for tax rapid inspection |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102364520A (en) * | 2011-08-29 | 2012-02-29 | 大连明江咨询服务有限公司 | Electronic trading data processing method |
| CN110751484A (en) * | 2019-10-28 | 2020-02-04 | 北京金融资产交易所有限公司 | Account receivable management system based on block chain |
| CN114528346A (en) * | 2022-01-27 | 2022-05-24 | 中科大数据研究院 | Method for sharing transaction of multi-source heterogeneous data assets by depending on block chain |
| CN115664679A (en) * | 2022-10-27 | 2023-01-31 | 成都质数斯达克科技有限公司 | Method, device and equipment for block chain supervision of trusted data and storage medium |
| CN115801268A (en) * | 2022-10-27 | 2023-03-14 | 成都质数斯达克科技有限公司 | Method, device and equipment for transmitting block chain trusted data |
| CN116579816A (en) * | 2023-03-21 | 2023-08-11 | 合肥工业大学 | Transaction method and system for data element circulation based on hyperlink |
-
2023
- 2023-08-21 CN CN202311053806.2A patent/CN116823263A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102364520A (en) * | 2011-08-29 | 2012-02-29 | 大连明江咨询服务有限公司 | Electronic trading data processing method |
| CN110751484A (en) * | 2019-10-28 | 2020-02-04 | 北京金融资产交易所有限公司 | Account receivable management system based on block chain |
| CN114528346A (en) * | 2022-01-27 | 2022-05-24 | 中科大数据研究院 | Method for sharing transaction of multi-source heterogeneous data assets by depending on block chain |
| CN115664679A (en) * | 2022-10-27 | 2023-01-31 | 成都质数斯达克科技有限公司 | Method, device and equipment for block chain supervision of trusted data and storage medium |
| CN115801268A (en) * | 2022-10-27 | 2023-03-14 | 成都质数斯达克科技有限公司 | Method, device and equipment for transmitting block chain trusted data |
| CN116579816A (en) * | 2023-03-21 | 2023-08-11 | 合肥工业大学 | Transaction method and system for data element circulation based on hyperlink |
Non-Patent Citations (3)
| Title |
|---|
| WX58763B21AE3ED: "Springboot使用RabbitMQ发送消息，监听接收消息", pages 1, Retrieved from the Internet <URL:https://blog.51cto.com/u_12516227/6103254> * |
| 李军: "企业轻量化大数据架构研究", 信息与智能, vol. 21, no. 15, pages 101 - 102 * |
| 胡典钢: "工业物联网：平台架构、关键技术与应用实践", 31 March 2022, 机械工业出版社, pages: 236 - 237 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117933944A (en) * | 2024-03-14 | 2024-04-26 | 佛山众陶联供应链服务有限公司 | Transaction data processing method and system convenient for tax rapid inspection |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111177275A (en) | Block chain-based management method, terminal, device and storage medium | |
| CN105913219A (en) | Method and system used for monitoring and managing whole actuating process of electronic contract | |
| CN104715402B (en) | Electronic invoice generation method based on digital signature | |
| CN107153646B (en) | Data processing method and equipment | |
| CN116823263A (en) | Method for realizing transaction asset certificate data elements in ceramic industry | |
| CN112437936A (en) | Point-to-point transfer of accounts | |
| CN105976218A (en) | Order management system | |
| CN111130988A (en) | ETC (electronic toll Collection) handling method, client, server and system based on WeChat applet | |
| CN113408008B (en) | Data processing method, device, equipment and medium | |
| CN110941674A (en) | Block chain-based compliance audit method, device, system and storage medium | |
| CN112651733A (en) | Channel route selection method, device, equipment and storage medium | |
| CN114677074A (en) | Multi-mode combined transportation and single system verification system and method based on block chain | |
| CN116342141A (en) | Method, device and equipment for identifying empty shell enterprises | |
| CN111598502A (en) | Block chain-based waybill processing method, system, equipment and storage medium | |
| CN113706091B (en) | Intelligent remote auditing method, device, system, computer equipment and storage medium | |
| CN113095747B (en) | Electronic bill of lading circulation method and device based on block chain technology | |
| KR20000049507A (en) | Auction method of carrying freight of computer network and computer-readable medium which the method is recorded | |
| CN115222497B (en) | Financial data verification processing method and system | |
| CN110322346A (en) | A kind of condition that supporting uxto model can set method of payment and system | |
| WO2021120760A1 (en) | Method and device for issuing electronic invoice employing blockchain | |
| US9916586B2 (en) | Client-side deposit packaging compliance | |
| CN113781179A (en) | Method for intelligently generating environment-friendly solution based on environment-friendly technical data | |
| CN112330252A (en) | Cold chain logistics monitoring system based on block chain technology | |
| CN114626904A (en) | Method and device for determining entry invoice | |
| CN113298459A (en) | Order cross-border declaration method, system and device and computing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |