CN113554325A - Order synchronous processing system and method - Google Patents
Order synchronous processing system and method Download PDFInfo
- Publication number
- CN113554325A CN113554325A CN202110859708.2A CN202110859708A CN113554325A CN 113554325 A CN113554325 A CN 113554325A CN 202110859708 A CN202110859708 A CN 202110859708A CN 113554325 A CN113554325 A CN 113554325A
- Authority
- CN
- China
- Prior art keywords
- order
- shop
- authorization information
- company
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 33
- 230000001360 synchronised effect Effects 0.000 title claims abstract description 29
- 238000000034 method Methods 0.000 title claims description 15
- 238000013475 authorization Methods 0.000 claims abstract description 54
- 238000003672 processing method Methods 0.000 claims abstract description 10
- 238000012544 monitoring process Methods 0.000 claims description 16
- 238000004140 cleaning Methods 0.000 claims description 14
- 238000012937 correction Methods 0.000 claims description 10
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 238000007726 management method Methods 0.000 description 22
- 238000005516 engineering process Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000013024 troubleshooting Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0633—Lists, e.g. purchase orders, compilation or processing
- G06Q30/0635—Processing of requisition or of purchase orders
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Finance (AREA)
- Development Economics (AREA)
- Marketing (AREA)
- Accounting & Taxation (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Tourism & Hospitality (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Game Theory and Decision Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses an order synchronous processing system, which comprises a cloud platform, a data authorization module and an operation service center, wherein the cloud platform is used for storing a plurality of orders; the cloud platform is used for configuring and managing store authorization information and company resource information; the data authorization module is used for acquiring the shop authorization information, storing the shop authorization information to the local, and performing centralized management and distribution on the shop authorization information of each company; the operation service center is used for constructing an operation service framework and synchronously processing the business order data through the operation service framework. The invention also discloses an order synchronous processing method, S1, the shop authorization information and the company resource information are configured and managed on the cloud platform; s2, obtaining the shop authorization information, storing the shop authorization information locally, and centrally managing and distributing the shop authorization information of each company; s3, constructing a job service framework, wherein the job service framework specifically carries out synchronous processing on the business order data through company resource configuration information provided by the cloud platform.
Description
Technical Field
The invention relates to the technical field of information, in particular to an order synchronous processing system and method.
Background
The existing e-commerce order synchronization method generally adopts an OAUTH2 mode to obtain authorization information before requesting a service API, then calls the service API through the authorization information, and finally performs cleaning action on order information, so that the coupling between functions is strong. When the e-commerce is greatly promoted, orders cannot be completely synchronized in real time, merchants cannot effectively track the order synchronization condition of each shop in real time, the service downtime cannot be found in time, the running condition of the whole program is influenced due to unreasonable use of a single service resource node, and the CPU and the memory resource of the server cannot be effectively utilized.
Disclosure of Invention
The invention provides an order synchronous processing method and system, which can be used for removing functional coupling through business separation, functional module splitting and service management micro-servitization, and simultaneously realizing stability, real-time performance and high concurrent processing of order synchronous e-commerce in a large promotion period by adopting a producer and consumer mode and thread operation management in order processing and combining a mainstream cache technology, and further improving the customer conversion rate, the order combination rate and the customer unit price.
In order to achieve the purpose, the invention adopts the following technical scheme:
the order synchronous processing system comprises a cloud platform, a data authorization module and an operation service center;
the cloud platform is used for configuring and managing store authorization information and company resource information;
the data authorization module is used for acquiring the shop authorization information, storing the shop authorization information to the local, and performing centralized management and distribution on the shop authorization information of each company;
the operation service center is used for constructing an operation service framework and synchronously processing the business order data through the operation service framework.
Preferably, the job service framework comprises a message queue central part, an order data cleaning module, a log output module and a monitoring and early warning module;
the message queue central part is used for decoupling order subscription and storage service;
the order data cleaning module is used for cleaning the business order data;
the log output module is used for providing an extensible backup scheme for the log;
the monitoring and early warning module is used for providing monitoring and early warning capability for operation.
Preferably, the data authorization module obtains the shop authorization information by way of OAUTH 2.
Preferably, the company resource information configuration management is specifically database sub-base connection management, service load balancing control, scheduling operation frequency control and thread number management.
Preferably, the JOB service framework performs synchronous processing on the business order data through company resource configuration information provided by the cloud platform, and realizes dynamic management of frequency scheduling and dynamic configuration of thread number through defining JOB service.
The order synchronization processing method specifically comprises the following steps:
s1, carrying out configuration management on the shop authorization information and the company resource information on the cloud platform;
s2, obtaining the shop authorization information, storing the shop authorization information locally, and centrally managing and distributing the shop authorization information of each company;
s3, constructing a job service framework, wherein the job service framework specifically carries out synchronous processing on the business order data through company resource configuration information provided by the cloud platform.
Preferably, the method for allocating and managing company resource information in step S1 specifically includes database sub-base connection management, service load balancing control, scheduling job frequency control, and thread number management.
Preferably, the obtaining of the store authorization information in step S2 is performed by way of OAUTH 2.
Preferably, the JOB service framework in step S3 implements frequency scheduling dynamic management and thread number dynamic configuration by defining JOB service.
Preferably, the method for the job service framework to perform synchronous processing on the service order data through the company resource configuration information provided by the cloud platform in step S3 specifically includes breakpoint synchronous recording, company resource sequencing, module decoupling, order automatic error correction, order data cleaning, order manual error correction, log output, and monitoring and early warning.
After adopting the technical scheme, compared with the background technology, the invention has the following advantages:
the invention provides an order synchronous processing method and system, which can be used for removing functional coupling through business separation, functional module splitting and service management micro-servitization, and simultaneously realizing stability, real-time performance and high concurrent processing of order synchronous e-commerce in a large promotion period by adopting a producer and consumer mode and thread operation management in order processing and combining a mainstream cache technology, and further improving the customer conversion rate, the order combination rate and the customer unit price.
Drawings
FIG. 1 is a flow chart illustrating the steps of the method of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the present invention, it should be noted that the terms "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. are all based on the orientation or positional relationship shown in the drawings, and are only for convenience of describing the present invention and simplifying the description, but do not indicate or imply that the apparatus or element of the present invention must have a specific orientation, and thus, should not be construed as limiting the present invention.
Examples
The invention discloses an order synchronous processing system, which comprises a cloud platform, a data authorization module and an operation service center, wherein the cloud platform is used for storing a plurality of orders;
the cloud platform is used for configuring and managing the shop authorization information and the company resource information; the shop authorization information comprises shop authorization information of each POP open platform, and the company resource information configuration management specifically comprises the steps of performing warehouse division and connection management, service load balance control, scheduling operation frequency control and thread number management on each company database, and provides accurate configuration for SAAS (intelligent service for business applications as a service).
The data authorization module acquires the store authorization information from the cloud platform in an OAUTH2 mode and stores the store authorization information locally, and the condition that an order producer corresponding to each company independently goes to the POP open platform to acquire the store authorization information is avoided, so that the store authorization information of each company is centrally managed and distributed, and data transmission capability is provided for the cloud platform through an application program interface of the open POP open platform.
The operation service center is used for constructing an operation service framework and synchronously processing the business order data through the operation service framework.
The operation service framework performs synchronous processing on the business order data through company resource configuration information provided by the cloud platform, separates the business order data according to companies, and imports the business order data into a company business database, wherein thread resource sharing is performed on different shop order data of the same family. And frequency scheduling dynamic management and thread number dynamic configuration are realized by defining JOB service. When the CPU resource utilization ratio of the server is within 90%, the data processing capacity can be improved by increasing the number of threads, and the service frequency can be dynamically adjusted according to the real-time requirement of the service data.
The operation service framework comprises a message queue central part, an order data cleaning module, a log output module and a monitoring and early warning module;
message queue centerpiece: aiming at a large amount of order data scenes needing to synchronize a POP open platform in real time in a large promotion period, order subscription and storage services are decoupled by using message middleware, a consumer processes an order by utilizing multiple threads, and the balance of an order producer and the consumer is effectively monitored, so that the requirement of synchronizing the order in real time is met;
an order data cleaning module: aiming at order consumers, the order consumer relies on MQ monitoring service, MQ messages are pulled in real time, order data cleaning is realized, the order locking updating is overweight by combining a cache technology, and the breakpoint synchronization and automatic error correction mechanism of an operation service frame is utilized in the data cleaning process, so that the data integrity is ensured, and the API call flow cost is effectively avoided.
The job service framework supports breakpoint synchronous recording, is not limited to storage files, DB, cache, OSS, and dynamically partitions data by recording the last run time and maximum ID of the service. Through breakpoint synchronization, when service is restarted or abnormal interruption starts to synchronize from the last successful node, the cost of recalling the API is effectively avoided.
The operation service framework adopts a compensation mechanism scheme for solving the problem of order omission or non-latest state scenes caused by special conditions in order synchronization by automatic order error correction, so that the integrity of data is ensured;
an order missing scene: comparing whether the number of the order of the POP open platform is consistent with that of the order of the current company service database in a specified time range, if the order is missed, adopting the missing order number to call the application program interface of the POP open platform again to synchronize order data;
non-latest state scenarios: and when the number of the POP platform orders in the specified time range is consistent with that of the current database orders, comparing the order updating time to judge whether the order states are consistent, and under the condition of inconsistency, calling the application program interface of the POP open platform again to update the order information.
A log output module: the Log output module adopts an open source Log component and a non-relational database, and performs high-speed concurrent processing on the non-relational database mainly by mongoDB to provide an extensible backup scheme for the Log
The monitoring and early warning module: the monitoring and early warning module provides more powerful monitoring and early warning capability for operation by adding a third-party chatting reminding tool, and is used for providing monitoring and early warning capability for operation. Wherein the third party chat tools include, but are not limited to, a nailer robot, WeChat group, QQ group.
The log output module and the monitoring and early warning module effectively cope with complex problem troubleshooting under the situation of big data, and meanwhile, the manual processing dependence and intervention cost are reduced.
And the operation service framework automatically matches the synchronous frequency and weight according to the designated time in the period of promotion, and automatically sequences the resource priority of each POP open platform.
The operation service framework further comprises an order manual error correction function, the order manual error correction function is used for providing an additional record of historical orders for newly accessed stores, and historical order data are obtained from each POP open platform through a time range.
As shown in fig. 1, the order synchronization processing method specifically includes the following steps:
s1, carrying out configuration management on the shop authorization information and the company resource information on the cloud platform; the shop authorization information comprises shop authorization information of each POP open platform, and the company resource information configuration management specifically comprises the steps of performing warehouse division and connection management, service load balance control, scheduling operation frequency control and thread number management on each company database, and provides accurate configuration for SAAS (intelligent service for business applications as a service).
S2, the data authorization module acquires the shop authorization information from the cloud platform in an OAUTH2 mode, stores the shop authorization information locally, and centrally manages and distributes the shop authorization information of each company;
and S3, constructing a job service framework, wherein the job service framework specifically carries out synchronous processing on the business order data through company resource configuration information provided by the cloud platform.
The method for the operation service framework to synchronously process the business order data through the company resource configuration information provided by the cloud platform specifically comprises breakpoint synchronous recording, company resource sequencing, module decoupling, automatic order error correction, order data cleaning, order missing and loss compensation, state scene updating, manual order error correction, log output and monitoring early warning.
The JOB service framework realizes dynamic management of frequency scheduling and dynamic configuration of thread number by defining JOB service. When the CPU resource utilization ratio of the server is within 90%, the data processing capacity can be improved by increasing the number of threads, and the service frequency can be dynamically adjusted according to the real-time requirement of the service data.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. Order synchronous processing system, its characterized in that: the system comprises a cloud platform, a data authorization module and an operation service center;
the cloud platform is used for configuring and managing store authorization information and company resource information;
the data authorization module is used for acquiring the shop authorization information, storing the shop authorization information to the local, and performing centralized management and distribution on the shop authorization information of each company;
the operation service center is used for constructing an operation service framework and synchronously processing the business order data through the operation service framework.
2. The order synchronization processing system of claim 1, wherein: the operation service framework comprises a message queue central part, an order data cleaning module, a log output module and a monitoring and early warning module;
the message queue central part is used for decoupling order subscription and storage service;
the order data cleaning module is used for cleaning the business order data;
the log output module is used for providing an extensible backup scheme for the log;
the monitoring and early warning module is used for providing monitoring and early warning capability for operation.
3. The order synchronization processing system of claim 1, wherein: the data authorization module acquires the shop authorization information in an OAUTH2 mode.
4. The order synchronization processing system of claim 1, wherein: the company resource information configuration management specifically includes database sub-base connection management, service load balancing control, scheduling operation frequency control and thread number management.
5. The order synchronization processing system of claim 1, wherein: the operation service framework performs synchronous processing on business order data through company resource configuration information provided by the cloud platform, and realizes dynamic management of frequency scheduling and dynamic configuration of thread number through defining JOB service.
6. The order synchronous processing method according to any one of claims 1 to 5, wherein the method is implemented based on the order synchronous processing system, and specifically comprises the following steps:
s1, carrying out configuration management on the shop authorization information and the company resource information on the cloud platform;
s2, obtaining the shop authorization information, storing the shop authorization information locally, and centrally managing and distributing the shop authorization information of each company;
s3, constructing a job service framework, wherein the job service framework specifically carries out synchronous processing on the business order data through company resource configuration information provided by the cloud platform.
7. The order synchronization processing method according to claim 6, wherein: the method for managing company resource information allocation in step S1 specifically includes database sub-base connection management, service load balancing control, scheduling operation frequency control, and thread number management.
8. The order synchronization processing method according to claim 6, wherein: the obtaining of the store authorization information in step S2 is specifically performed by the OAUTH2 method.
9. The order synchronization processing method according to claim 6, wherein: in step S3, the JOB service framework implements dynamic management of frequency scheduling and dynamic configuration of thread number by defining JOB service.
10. The order synchronization processing method according to claim 6, wherein: the method for the job service framework to perform synchronous processing on the service order data through the company resource configuration information provided by the cloud platform in step S3 specifically includes breakpoint synchronous recording, company resource sequencing, module decoupling, automatic order error correction, order data cleaning, manual order error correction, log output, and monitoring and early warning.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110859708.2A CN113554325A (en) | 2021-07-28 | 2021-07-28 | Order synchronous processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110859708.2A CN113554325A (en) | 2021-07-28 | 2021-07-28 | Order synchronous processing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113554325A true CN113554325A (en) | 2021-10-26 |
Family
ID=78133176
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110859708.2A Pending CN113554325A (en) | 2021-07-28 | 2021-07-28 | Order synchronous processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113554325A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007133793A (en) * | 2005-11-14 | 2007-05-31 | Cns:Kk | Electronic commerce system, method, and program |
| CN109447545A (en) * | 2018-10-10 | 2019-03-08 | 四川长虹电器股份有限公司 | The order status real-time synchronization resolver and implementation method of electric business plateform system |
| CN111402005A (en) * | 2020-03-18 | 2020-07-10 | 上海东普信息科技有限公司 | E-commerce ERP system and management method thereof |
-
2021
- 2021-07-28 CN CN202110859708.2A patent/CN113554325A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007133793A (en) * | 2005-11-14 | 2007-05-31 | Cns:Kk | Electronic commerce system, method, and program |
| CN109447545A (en) * | 2018-10-10 | 2019-03-08 | 四川长虹电器股份有限公司 | The order status real-time synchronization resolver and implementation method of electric business plateform system |
| CN111402005A (en) * | 2020-03-18 | 2020-07-10 | 上海东普信息科技有限公司 | E-commerce ERP system and management method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112073265B (en) | Internet of things monitoring method and system based on distributed edge computing | |
| CN109857558A (en) | A kind of data flow processing method and system | |
| CN108062243B (en) | Execution plan generation method, task execution method and device | |
| CN101854400A (en) | Database synchronization deployment and monitoring method and device | |
| US11068499B2 (en) | Method, device, and system for peer-to-peer data replication and method, device, and system for master node switching | |
| CN105471960A (en) | Information interaction system and method between private clouds and public cloud | |
| WO2021057514A1 (en) | Task scheduling method and apparatus, computer device, and computer readable medium | |
| CN112272291B (en) | Video storage method, device, management equipment and readable storage medium | |
| CN110113406B (en) | Distributed computing service cluster system | |
| CN108140035B (en) | Database replication method and device for distributed system | |
| CN115146000A (en) | Database data synchronization method and device, electronic equipment and storage medium | |
| CN104410511A (en) | Server management method and system | |
| CN114610567A (en) | Container monitoring method, network device and storage medium | |
| EP3905591A1 (en) | Server abnormality processing method and management device | |
| CN101789963A (en) | Data synchronization system | |
| CN113157701A (en) | Dual-activity mechanism deployment method and device of ORACLE database | |
| CN107105037B (en) | Distributed video CDN resource management system and method based on file verification | |
| CN106886452B (en) | Method for simplifying task scheduling of cloud system | |
| US20120102168A1 (en) | Communication And Coordination Between Web Services In A Cloud-Based Computing Environment | |
| CN113761079A (en) | Data access method, system and storage medium | |
| CN113554325A (en) | Order synchronous processing system and method | |
| CN111008095A (en) | State snapshot generation and recovery method facing edge cloud | |
| CN110912979A (en) | Method for solving multi-server resource synchronization conflict | |
| CN113965538B (en) | Equipment state message processing method, device and storage medium | |
| CN115629909A (en) | Service data processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |