CN117422489A - Mass data optimization method device, equipment and readable medium under electronic market scene - Google Patents

Mass data optimization method device, equipment and readable medium under electronic market scene Download PDF

Info

Publication number
CN117422489A
CN117422489A CN202311422722.1A CN202311422722A CN117422489A CN 117422489 A CN117422489 A CN 117422489A CN 202311422722 A CN202311422722 A CN 202311422722A CN 117422489 A CN117422489 A CN 117422489A
Authority
CN
China
Prior art keywords
data
transaction
service
transaction data
merchant
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311422722.1A
Other languages
Chinese (zh)
Inventor
尹建东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CITIC Aibank Corp Ltd
Original Assignee
CITIC Aibank Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CITIC Aibank Corp Ltd filed Critical CITIC Aibank Corp Ltd
Priority to CN202311422722.1A priority Critical patent/CN117422489A/en
Publication of CN117422489A publication Critical patent/CN117422489A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201Market modelling; Market analysis; Collecting market data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2219Large Object storage; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof

Abstract

The invention discloses a mass data optimization method under an electronic market scene, which comprises the steps of establishing a service account table, correspondingly generating required information according to information contained in transaction data by the service account table, and correspondingly storing the transaction data into the information corresponding to the service account table; the business ledger sheet is judged according to the type of the transaction, logic operation is carried out according to the judging result and the result data are integrated, the result data are reserved in the business ledger sheet, a number bin is built, and the generated transaction data are stored. The invention effectively reduces the data volume through data judgment and logic operation, improves the operation performance of an application system, and the data processing in the mode does not need to invasively modify the transaction mode of the e-commerce clear distribution, can realize smooth switching and reduces the operation cost; the invention also provides a data processing device, equipment and a readable medium with the effects.

Description

Mass data optimization method device, equipment and readable medium under electronic market scene
Technical Field
The present invention relates to the field of internet communications technologies, and in particular, to a method apparatus, device, and readable medium for optimizing mass data in an electronic market
Background
With the high-speed development of the internet, online shopping has become a main mode of purchasing commodities by people, the data volume of a generated service list table is continuously accumulated and increased while the online shopping brings convenience, the maximum data volume exceeds 10 hundred million, and due to the restriction of service rules, an e-commerce sorting system can inquire and calculate historical data, so that the data volume cannot be reduced in a mode of cleaning the historical data, and the problems of increased space occupation cost, reduced database performance and the like are also caused by the large data volume.
Chinese patent No.: the invention patent of CN101086732A discloses a mass data management method, which divides a large database table into a plurality of partitions, each partition is equivalent to a small database table, the partitions are divided according to the date, and data insertion is performed according to the sequence of the partitions and circularly updated in the range of partition numbers; and five database table spaces are additionally built, so that the parallel insertion and query efficiency of the databases is further improved. By adopting the technical means, the reduction of the performance of the whole application system due to large data volume can be avoided. However, the technical means can only disperse the data in a form of sub-tables, and does not solve the high requirement of mass data on storage space, and the transaction mode of electronic commerce clear sub-tables is required to be invasively modified by using the method to process a large number of data tables, so that smooth switching cannot be realized, and the modification cost is high. It follows that this method has the following problems: excessive data volume results in slow operation and invasive modification results in excessive operating costs.
Disclosure of Invention
Therefore, the invention provides a mass data optimization method and a readable medium under an electronic market, which are used for solving the problems of increased space occupation cost, reduced database performance and overhigh operation cost caused by invasive transformation due to excessive data quantity in the prior art.
In order to achieve the above purpose, the present invention provides a method for optimizing mass data in an electronic market, comprising:
establishing a service ledger table, wherein the service ledger table correspondingly generates required information according to the information contained in the transaction data, and the service ledger table comprises the following steps: merchant number, service order number, payment amount, subsidy amount, amount to be settled, amount to be presented, whether to consume order, etc.;
each merchant corresponds to the unique merchant number, and each transaction belongs to the unique business order number; according to different transaction types and different merchants, storing transaction data into information corresponding to the business account table; the business account table is judged according to the type of the transaction, and logic operation is carried out according to the judging result, wherein the logic operation is to carry out operation integration on the transaction data of the same type, the transaction data of different types are divided into business account tables matched with the business account table, operation integration is carried out, the final operation result is reserved in the business account table, and a number bin is additionally built and used for storing a plurality of transaction data.
3. Further, the judgment is based on the business order number, when a plurality of transaction data are generated, the transaction data are divided according to the business order number, transaction amount is summarized, and business circulation is carried out through the business order number.
Further, the service ledger sheet is provided with a data matching function, and each time a new transaction data is generated, the service ledger sheet searches corresponding transaction merchants according to the type of the generated transaction data and the corresponding merchants, and carries out logic operation according to the corresponding relation of the transaction data.
Further, the service ledger sheet calls the historical data in the number bin, and carries out operation according to the determined logical relationship to generate the initial data of the service ledger sheet.
A data processing apparatus includes a generating unit, a matching unit, a judging unit, a transmitting unit;
the generating unit is configured to establish a service ledger table, where the service ledger table correspondingly generates required information according to information included in transaction data, and includes: merchant number, service order number, payment amount, subsidy amount, amount to be settled, cash amount to be extracted, and whether to consume order;
establishing a plurality of bins for storing the generated transaction data;
the matching unit is used for each merchant to correspond to the unique merchant number, and each transaction belongs to the unique business order number; according to different transaction types and different merchants, storing transaction data into information corresponding to the business account table;
the judging unit is used for judging the business account table according to the type of the transaction, carrying out logic operation according to the judging result, carrying out operation integration on the transaction data of the same type, dividing the transaction data of the different type into the business account table matched with the business account table, carrying out operation integration,
the transmission unit is used for transmitting the data judged by the judging unit to the service ledger sheet.
Further, the judgment is based on the business order number, when a plurality of transaction data are generated, the transaction data are divided according to the business order number, transaction amount is summarized, and business circulation is carried out through the business order number.
Further, the service ledger sheet is provided with a data matching function, and each time a new transaction data is generated, the service ledger sheet searches corresponding transaction merchants according to the type of the generated transaction data and the corresponding merchants, and carries out logic operation according to the corresponding relation of the transaction data.
Further, the service ledger sheet calls the historical data in the number bin, and carries out operation according to the determined logical relationship to generate the initial data of the service ledger sheet.
In another aspect, the present application also provides a computing device, comprising:
a memory for storing program instructions;
and a processor for invoking program instructions stored in said memory and executing any of the method steps described above in accordance with the obtained program instructions.
Second, the present application also provides a computer-readable medium comprising: computer readable instructions which, when read and executed by a computer, implement any of the method steps described above, the readable medium may be a plurality of, the plurality of readable media being capable of running independently of each other.
Compared with the prior art, the invention has the beneficial effects that the data quantity is effectively reduced through data judgment and logic operation, the performance of the whole application system is prevented from being reduced due to overlarge data quantity, the number of records can be reduced, and the occupation of disk space can be reduced; moreover, the transaction mode cleared by the electronic commerce does not need to be invasively transformed by using the method to process a large amount of data, so that smooth switching can be realized, and the operation cost is effectively reduced; by arranging a plurality of readable media in the server, the readable media run independently of each other, so that influence caused by change is not needed in the use process of the merchant, the plurality of readable media can finish updating after being stopped in turn, and normal use of the merchant is not influenced during updating. And a deployment mode of micro-service is adopted, a plurality of readable media provide service together, and the service can be updated and restarted after offline in turn when the scheme is implemented.
Drawings
FIG. 1 is a flow chart of a mass data optimizing method under an electronic market scene;
FIG. 2 is a schematic flow chart of a specific embodiment of a mass data optimization method under an electronic market provided by the invention;
fig. 3 is a block diagram of an embodiment of a method for optimizing mass data in an electronic market provided by the invention.
Detailed Description
In order to better understand the aspects of the present invention, the present invention will be described in further detail with reference to the accompanying drawings and detailed description. It will be apparent that the described embodiments are only some, but not all, embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The core of the invention is to provide a mass data optimization method under an electronic market, a flow diagram of a specific implementation mode is shown in figure 1, which comprises,
s1: establishing a service ledger table, wherein the service ledger table correspondingly generates required information according to the information contained in the transaction data, and the service ledger table comprises the following steps: merchant number, service order number, payment amount, subsidy amount, amount to be settled, cash amount to be extracted, and whether to consume order;
s2: each merchant corresponds to the unique merchant number, and each transaction belongs to the unique business order number; according to different transaction types and different merchants, storing transaction data into information corresponding to the business account table;
s3: judging the business account table according to the type of the transaction, and performing logic operation according to the judging result, wherein the logic operation is to integrate the transaction data of the same type, divide the transaction data of different types into the business account table matched with the business account table, and then integrate the operation;
s4: and reserving the final operation result data in a business ledger sheet, and establishing a plurality of bins for storing the generated transaction data.
Further, the judgment is based on the business order number, when a plurality of transaction data are generated, the transaction data are divided according to the business order number, transaction amount is summarized, and business circulation is carried out through the business order number.
Further, the service ledger sheet is provided with a data matching function, and each time a new transaction data is generated, the service ledger sheet searches corresponding transaction merchants according to the type of the generated transaction data and the corresponding merchants, and carries out logic operation according to the corresponding relation of the transaction data.
Further, the service ledger sheet calls the historical data in the number bin, and carries out operation according to the determined logical relationship to generate the initial data of the service ledger sheet.
The following describes the specific procedure of the present invention in detail by way of one example:
the customer A purchases the product of the merchant B on the e-commerce platform, spends 100 yuan, wherein the customer actually pays 98 yuan, and the platform subsidizes 2 yuan.
Implementation rules:
amount to be settled: increasing transaction amount (payment amount + subsidy amount)
The cash amount can be offered: unchanged
Order settlement 30 yuan, give the superior commercial tenant
Rules:
(newly added) amount to be settled of the superior merchant: 0
(newly added) the presentable amount of the superior merchant: increasing the transaction amount the merchant's amount to be settled: subtracting the transaction amount
The merchant can be presented with the cash amount: 0
Instruction settlement 70 yuan, give this commercial tenant
Rules:
the amount to be settled of the merchant: subtracting the transaction amount
The merchant can be presented with the cash amount: increasing transaction amount commission, 0.18 yuan for upper merchant settlement
Rules:
(newly added) platform merchant to-be-settled amount: 0
(newly added) platform merchant's presentable amount: increasing transaction amount
The amount to be settled of the superior merchant: unchanged
The cash amount of the superior merchant can be: subtracting the transaction amount
Commission is received, 0.42 yuan is received for the settlement of the merchant
Rules:
the amount to be settled of the platform merchant: unchanged
The presentable amount of the platform merchant: increasing transaction amount
The amount to be settled of the merchant: unchanged
The merchant can be presented with the cash amount: subtracting the transaction amount
0.6 element commission is divided into two, 0.42 element commission is carried out by the merchant, and 0.18 element commission is carried out by the upper merchant
Rules:
the amount to be settled of the platform merchant: unchanged
The presentable amount of the platform merchant: minus the transaction amount 0.6
The amount to be settled of the merchant: unchanged
The merchant can be presented with the cash amount: increase transaction amount 0.42
The amount to be settled of the superior merchant: unchanged
The cash amount of the superior merchant can be: increasing the transaction amount by 0.18
Reverse instruction settlement 60 yuan, which is completed by two instructions, 42 yuan for the present stage reverse settlement and 18 yuan for the upper stage reverse settlement
Rules:
the amount to be settled of the merchant: increasing transaction amount 42, increasing transaction amount 18 (in two increases, here only a combined display, not one increase)
The merchant can be presented with the cash amount: reducing transaction amount 42
The amount to be settled of the superior merchant: unchanged
The cash amount of the superior merchant can be: reducing transaction amount 18
Refund 60 yuan, pay amount refund 1.2 yuan, subsidy amount refund 58.8 yuan
Rules:
payment amount of the merchant: the reduction of 58.8 yuan
The subsidy amount of the merchant: 1.2 yuan reduction
Description: according to the above example, the related transactions share the consumption order, the instruction settlement, the commission collection, the commission refund, the reverse instruction settlement and the refund, the number of the generated orders is 8, the detail number of the generated funds is 10, 18 records are counted in total, the number of records is 3 after the algorithm calculation is carried out on the business account, the number of records is reduced by about 83%, and the effects of reducing the number of records and the occupation of disk space can be achieved.
FIG. 2 is a diagram of another embodiment of the present invention, referring to FIG. 2, specifically illustrating the process of the present invention for invoking a transaction table with respect to a data store:
the business ledger sheet can be implemented in stages and used according to actual conditions.
1) The service ledger data up to a certain day is generated using the data of the several bins according to the above rule, because part of the data may have been deleted from the original order form, and only the data of the several bins has the most complete data.
2) Running batch once every day, updating business ledger data every day through running batch tasks, and marking update date. This step is to update the service ledger data continuously to facilitate cleaning up the service checksum data.
3) On-line transaction business verification using business ledger data and real-time data summary calculation after business ledger update date
4) After confirming that the service ledger data is generated, cleaning work of historical order data before the service ledger update date can be started, and the number of records of an order form and the occupation of disk space can be obviously reduced after all cleaning is completed.
The following describes a data processing device provided by an embodiment of the present invention, where the data processing device described below and the method for optimizing mass data under the electronic market described above may be referred to correspondingly.
Fig. 3 is a block diagram of a data processing apparatus according to an embodiment of the present invention, and referring to fig. 3, a data processing apparatus includes: the device comprises a generating unit, a matching unit, a judging unit and a transmission unit;
the generating unit is configured to establish a service ledger table, where the service ledger table correspondingly generates required information according to information included in transaction data, and includes: the merchant number, the business order number, the payment amount, the subsidy amount, the amount to be settled, the cash amount which can be extracted, whether to consume the order and the like, and the business order number, the payment amount, the subsidy amount, the amount to be settled, whether to place the order or not are also used for establishing a plurality of bins for storing the generated transaction data;
the matching unit is used for each merchant to correspond to the unique merchant number, and each transaction belongs to the unique business order number; according to different transaction types and different merchants, storing transaction data into information corresponding to the business account table;
the judging unit is used for judging the business ledger sheet according to the type of the transaction, and carrying out logic operation according to the judging result, wherein the logic operation is to carry out operation integration on the transaction data of the same type, divide the transaction data of different types into the business ledger sheet matched with the business ledger sheet, and then carry out operation integration;
the transmission unit is used for transmitting the data calculated by the logic calculation unit to the service ledger sheet.
Further, the judgment rule gathers transaction amount according to the business order number and business circulation is carried out through the business order number.
Further, the service ledger sheet is provided with a data matching function, and each time a new transaction data is generated, the service ledger sheet searches corresponding transaction merchants according to the type of the generated transaction data and the corresponding merchants, and carries out logic operation according to the corresponding relation of the transaction data.
Further, the service ledger sheet calls the historical data in the number bin, and carries out operation according to the determined logical relationship to generate the initial data of the service ledger sheet.
The data processing apparatus of this embodiment is configured to implement the foregoing method for optimizing mass data under an electronic market, so that the specific implementation in the data processing apparatus may be the foregoing embodiment part of the method for optimizing mass data under an electronic market, for example, the generating unit 100, the matching unit 200, the determining unit 300, and the transmitting unit 400 are respectively configured to implement steps S1, S2, S3, and S4 in the foregoing information processing method, so that the specific implementation thereof may refer to the description of the corresponding embodiment of each part and will not be repeated herein.
In another aspect, the present application also provides a computing device, comprising:
a memory for storing program instructions;
and the processor is used for calling the program instructions stored in the memory and executing the steps of any one of the methods according to the obtained program instructions.
Second, the present application also provides a computer-readable medium comprising: computer readable instructions which, when read and executed by a computer, perform the steps of a method as any one of the above.
Thus far, the technical solution of the present invention has been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of protection of the present invention is not limited to these specific embodiments. Equivalent modifications and substitutions for related technical features may be made by those skilled in the art without departing from the principles of the present invention, and such modifications and substitutions will be within the scope of the present invention.
The foregoing description is only of the preferred embodiments of the invention and is not intended to limit the invention; various modifications and variations of the present invention will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. The mass data optimization method under the electronic market scene is characterized by comprising the following steps of:
establishing a service ledger table, wherein the service ledger table correspondingly generates required information according to the information contained in the transaction data, and the service ledger table comprises the following steps: merchant number, service order number, payment amount, subsidy amount, amount to be settled, cash amount to be extracted, and whether to consume order;
each merchant corresponds to the unique merchant number, and each transaction belongs to the unique business order number; according to different transaction types and different merchants, storing transaction data into information corresponding to the business account table; the business account table is judged according to the type of the transaction, and logic operation is carried out according to the judging result, wherein the logic operation is to carry out operation integration on the transaction data of the same type, the transaction data of different types are divided into business account tables matched with the business account table, operation integration is carried out, the final operation result is reserved in the business account table, and a number bin is additionally built and used for storing a plurality of transaction data.
2. The method for optimizing mass data according to claim 1, wherein the determining is based on a service order number, when generating a plurality of transaction data, dividing according to the service order number, and summarizing transaction amounts, and performing service circulation through the service order number.
3. The method for optimizing mass data according to claim 2, wherein the service ledger table is provided with a data matching function, and each time a new transaction data is generated, the service ledger table searches corresponding transaction merchants according to the type of the generated transaction data and performs logic operation according to the corresponding relation of the transaction data.
4. The method for optimizing mass data according to claim 1, wherein the service ledger table calls the historical data in the number bin, and performs operation according to the determined logical relationship to generate the initial data of the service ledger table.
5. The data processing device is characterized by comprising a generating unit, a matching unit, a judging unit and a transmission unit;
the generating unit is configured to establish a service ledger table, where the service ledger table correspondingly generates required information according to information included in transaction data, and includes: merchant number, service order number, payment amount, subsidy amount, amount to be settled, cash amount to be extracted, and whether to consume order;
establishing a plurality of bins for storing the generated transaction data;
the matching unit is used for each merchant to correspond to the unique merchant number, and each transaction belongs to the unique business order number; according to different transaction types and different merchants, storing transaction data into information corresponding to the business account table;
the judging unit is used for judging the business account table according to the type of the transaction, carrying out logic operation according to the judging result, carrying out operation integration on the transaction data of the same type, dividing the transaction data of the different type into the business account table matched with the business account table, carrying out operation integration,
the transmission unit is used for transmitting the data judged by the judging unit to the service ledger sheet.
6. The apparatus of claim 5, wherein the determination is based on a service order number,
when generating a plurality of transaction data, dividing according to the service order numbers, summarizing transaction amounts, and carrying out service circulation through the service order numbers.
7. The apparatus of claim 5, wherein the service ledger table is provided with a data matching function, and each time a new transaction data is generated, the service ledger table performs a logic operation according to the type of the generated transaction data, according to the corresponding merchant search and the corresponding transaction merchant, and according to the corresponding relationship of the transaction data.
8. The apparatus of claim 5, wherein the service ledger table invokes the historical data in the number bin, operates according to the determined logical relationship, and generates the start data of the service ledger table.
9. A computing device, comprising:
a memory for storing program instructions;
a processor for invoking program instructions stored in the memory and performing the method according to any of claims 1-4 in accordance with the obtained program instructions.
10. A computer readable medium comprising computer readable instructions which, when read and executed by a computer, perform the method of any one of claims 1 to 4, the readable medium being a plurality of, the plurality of readable media being capable of running independently of each other.
CN202311422722.1A 2023-10-30 2023-10-30 Mass data optimization method device, equipment and readable medium under electronic market scene Pending CN117422489A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311422722.1A CN117422489A (en) 2023-10-30 2023-10-30 Mass data optimization method device, equipment and readable medium under electronic market scene

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311422722.1A CN117422489A (en) 2023-10-30 2023-10-30 Mass data optimization method device, equipment and readable medium under electronic market scene

Publications (1)

Publication Number Publication Date
CN117422489A true CN117422489A (en) 2024-01-19

Family

ID=89524387

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311422722.1A Pending CN117422489A (en) 2023-10-30 2023-10-30 Mass data optimization method device, equipment and readable medium under electronic market scene

Country Status (1)

Country Link
CN (1) CN117422489A (en)

Similar Documents

Publication Publication Date Title
CN111699486B (en) Accounting method, accounting system, account system and payment system
US6078905A (en) Method for optimizing risk management
US20070233597A1 (en) Least cost network routing for electronic transactions
CN103678447B (en) Multivariate transaction classification
CN104866484A (en) Data processing method and device
JP2003534605A (en) Trading system
CN109816169A (en) It is a kind of based on order goods-receiving-sell the management control method and system of tracking
CN107945012A (en) A kind of amount computational methods, device, equipment and storage medium
CN111461836A (en) Information processing method and device for promoting commodity transaction
CN112052385A (en) Investment and financing project recommendation method and device, electronic equipment and readable storage medium
CA2711254C (en) Merchant rate lookup
CN117422489A (en) Mass data optimization method device, equipment and readable medium under electronic market scene
CN111260367A (en) Transaction limit determining method and device
CN111105306A (en) Resource transaction strategy determination method and device and server
CN106156977A (en) A kind of order processing method and system
TWM630723U (en) Automated Debt Processing System
CN112035681B (en) Method and device for determining credit card rate information based on knowledge graph
CN112184025A (en) Intelligent money distribution method and device for foreign currency reservation
CN110443691A (en) Odd corpus shops distribution method and system
CN112308583A (en) Medical platform management method and system based on virtual integration
EP1471449A1 (en) Credit authorisation system
KR102468742B1 (en) Cost-settling method and system thereof for multi-cloud management service
TWI814311B (en) Automated debt processing system and method
CN109272373A (en) A kind of computer based brand recommended method
KR100750970B1 (en) System for accumulating points and using the points, and method therefor on banking

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination