CN113487340A - Service decoupling processing method, device, equipment and storage medium - Google Patents
Service decoupling processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113487340A CN113487340A CN202110566369.9A CN202110566369A CN113487340A CN 113487340 A CN113487340 A CN 113487340A CN 202110566369 A CN202110566369 A CN 202110566369A CN 113487340 A CN113487340 A CN 113487340A
- Authority
- CN
- China
- Prior art keywords
- service
- data
- processing
- coupon
- basic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 29
- 238000012545 processing Methods 0.000 claims abstract description 241
- 238000000034 method Methods 0.000 claims abstract description 41
- 238000012544 monitoring process Methods 0.000 claims abstract description 25
- 238000004806 packaging method and process Methods 0.000 claims abstract description 15
- 238000004458 analytical method Methods 0.000 claims description 45
- 230000006870 function Effects 0.000 claims description 20
- 238000006243 chemical reaction Methods 0.000 claims description 15
- 238000005538 encapsulation Methods 0.000 claims description 10
- 238000012423 maintenance Methods 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 29
- 230000006399 behavior Effects 0.000 description 14
- 230000000694 effects Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000008878 coupling Effects 0.000 description 7
- 238000010168 coupling process Methods 0.000 description 7
- 238000005859 coupling reaction Methods 0.000 description 7
- 238000007726 management method Methods 0.000 description 7
- 238000013467 fragmentation Methods 0.000 description 5
- 238000006062 fragmentation reaction Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000008571 general function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000004304 visual acuity Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0207—Discounts or incentives, e.g. coupons or rebates
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Game Theory and Decision Science (AREA)
- Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to the technical field of operation and maintenance, and discloses a service decoupling processing method, a device, equipment and a storage medium, wherein the method comprises the following steps: acquiring basic service data of a target service, recording the basic service data and storing the basic service data into a preset basic data table; extracting operation parameters in the service basic data, recording the operation parameters and generating a binary log; analyzing and packaging the binary log into a message body; monitoring a message body, and performing extended service processing on the message body to obtain service extended data corresponding to a target service; and starting the multi-task parallel processing service expansion data. The invention divides the service processing logic into basic service logic and extended service logic, realizes asynchronous decoupling, simultaneously starts multi-task parallel processing data and improves the data processing efficiency.
Description
Technical Field
The present invention relates to the field of operation and maintenance technologies, and in particular, to a service decoupling processing method, apparatus, device, and storage medium.
Background
The coupon is a common sales promotion mode for discount marketing of an operation merchant, a consumer obtains the coupon through channels such as active picking or directional distribution of an operation platform of the merchant, and the coupon can be used when a threshold is met when a specified commodity is purchased and placed. In the application development process, the business processing logic of the coupon is usually based on one business logic to realize another business logic. To implement such functions, it is common to embed an implementation method of one service logic into another service logic.
When the number of implementation methods of another business logic is large, the implementation methods are all embedded in the business logic, and thus the readability of the business logic code is seriously affected. For example, when the time-limited derating processing logic of the coupon is embedded into the original coupon logic, due to strong coupling between the two business logics, when one business logic is abnormal, the other business logic cannot operate normally. Therefore, how to solve the strong coupling between the coupon business processing logics is an urgent problem to be solved.
Disclosure of Invention
The invention mainly aims to solve the technical problem of strong coupling between business processing logics in the prior art.
The first aspect of the present invention provides a service decoupling processing method, where the service decoupling processing method includes: acquiring basic service data of a target service, recording the basic service data and storing the basic service data into a preset basic data table; extracting operation parameters in the service basic data, recording the operation parameters, and generating a binary log; analyzing and packaging the binary log into a message body; monitoring the message body, and performing extended service processing on the message body to obtain service extended data corresponding to the target service; and starting multitask and processing the service expansion data in parallel.
Optionally, in a first implementation manner of the first aspect of the present invention, parsing and encapsulating the binary log into a message body includes: analyzing the binary log based on a preset log analysis rule to obtain analysis data; extracting the universal format of the target service, and converting the analysis data into the data in the universal format; and performing message encapsulation on the data in the general format to obtain a message body.
Optionally, in a second implementation manner of the first aspect of the present invention, the analyzing the binary log based on a preset log analysis rule to obtain analysis data includes: analyzing the binary log and converting the binary log into readability data based on a preset data format conversion rule; and extracting a public function in the readability data, and analyzing the public function to obtain analysis data.
Optionally, in a third implementation manner of the first aspect of the present invention, before the acquiring basic service data of the target service, and recording and storing the service basic data in a preset basic data table, the method further includes: acquiring a service, and configuring relevant information for the service, wherein the relevant information at least comprises a service attribute and a service type; and converting the service into a target service based on the related information.
Optionally, in a fourth implementation manner of the first aspect of the present invention, before the starting the multitask parallel processing on the service expansion data, the method further includes: extracting relevant information of the target service; and inputting the relevant information of the target service into a preset service expansion data table.
Optionally, in a fifth implementation manner of the first aspect of the present invention, the starting of the multitask parallel processing on the service extension data includes: extracting service expansion data processing time corresponding to the target service from the service expansion data table; comparing whether the service expansion data processing time is consistent with the current time or not; if yes, according to the relevant information of the target service in the service expansion data table and a preset service processing strategy, multi-tasks are started to carry out parallel processing on the service expansion data.
A second aspect of the present invention provides a service decoupling processing apparatus, where the service decoupling processing apparatus includes: the acquisition module is used for acquiring basic service data of a target service, recording the basic service data and storing the basic service data into a preset basic data table; the generating module is used for extracting the operation parameters in the service basic data, recording the operation parameters and generating a binary log; the packaging module is used for analyzing and packaging the binary log into a message body; the monitoring module is used for monitoring the message body and performing extended service processing on the message body to obtain service extended data corresponding to the target service; and the processing module is used for starting multiple tasks and processing the service expansion data in parallel.
Optionally, in a first implementation manner of the second aspect of the present invention, the encapsulation module includes: the analysis unit is used for analyzing the binary log based on a preset log analysis rule to obtain analysis data; the conversion unit is used for extracting the universal format of the target service and converting the analysis data into the data in the universal format; and the packaging unit is used for packaging the message of the data with the general format to obtain a message body.
Optionally, in a second implementation manner of the second aspect of the present invention, the parsing unit is specifically configured to: analyzing the binary log and converting the binary log into readability data based on a preset data format conversion rule; and extracting a public function in the readability data, and analyzing the public function to obtain analysis data.
Optionally, in a third implementation manner of the second aspect of the present invention, the service decoupling processing apparatus further includes a configuration module, which is specifically configured to: acquiring a service, and configuring relevant information for the service, wherein the relevant information at least comprises a service attribute and a service type; and converting the service into a target service based on the related information.
Optionally, in a fourth implementation manner of the second aspect of the present invention, the service decoupling processing apparatus further includes a logging module, which is specifically configured to: extracting relevant information of the target service; and inputting the relevant information of the target service into a preset service expansion data table.
Optionally, in a fifth implementation manner of the second aspect of the present invention, the processing module is specifically configured to: extracting service expansion data processing time corresponding to the target service from the service expansion data table; comparing whether the service expansion data processing time is consistent with the current time or not; and if the processing time of the service expansion data is consistent with the current time, starting multiple tasks to perform parallel processing on the service expansion data according to the relevant information of the target service in the service expansion data table and a preset service processing strategy.
A third aspect of the present invention provides a service decoupling processing device, where the service decoupling processing device includes: a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line; the at least one processor calls the instructions in the memory to cause the service decoupling processing device to execute the steps of the service decoupling processing method.
A fourth aspect of the present invention provides a computer-readable storage medium having stored thereon instructions which, when run on a computer, cause the computer to perform the steps of the traffic decoupling processing method described above.
In the technical scheme provided by the invention, a target service processing process is actually divided into a basic service processing stage and an extended service processing stage, wherein the basic service processing stage is responsible for processing common unchangeable logic of a service, the extended service processing stage is responsible for processing special changeable logic of the service, basic service data of the target service is obtained, service basic data is recorded, a binary log is generated at the same time, the binary log is synchronously obtained and analyzed in the extended service processing stage, a message body containing the service basic data is finally packaged and sent out, service extension processing is carried out on the content of the message body, namely the service basic data, by monitoring the message body, so that service extended data is obtained, and then multi-task parallel high-efficiency processing is simultaneously started to process the service extended data. The technical scheme of the invention realizes the decoupling high-efficiency processing of the service and improves the efficiency of service processing.
Drawings
Fig. 1 is a schematic diagram of a first embodiment of a service decoupling processing method in an embodiment of the present invention;
fig. 2 is a schematic diagram of a second embodiment of a service decoupling processing method in the embodiment of the present invention;
fig. 3 is a schematic diagram of a third embodiment of a service decoupling processing method in the embodiment of the present invention;
fig. 4 is a schematic diagram of a fourth embodiment of a service decoupling processing method in the embodiment of the present invention;
fig. 5 is a schematic diagram of an embodiment of a service decoupling processing apparatus in an embodiment of the present invention;
fig. 6 is a schematic diagram of another embodiment of a service decoupling processing apparatus in an embodiment of the present invention;
fig. 7 is a schematic diagram of an embodiment of a service decoupling processing device in the embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a service decoupling processing method, a device, equipment and a storage medium, wherein basic service data of a target service are acquired, and the basic service data are recorded and stored in a preset basic data table; extracting operation parameters in the service basic data, recording the operation parameters, and generating a binary log; analyzing and packaging the binary log into a message body; simultaneously monitoring the message body and performing extended service processing to obtain service extended data corresponding to the target service; and starting the multi-task parallel processing service expansion data. The invention divides the service processing logic into basic service logic and extended service logic, realizes asynchronous decoupling, simultaneously starts multi-task parallel processing data and improves the data processing efficiency.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," or "having," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of understanding, the following describes specific contents of an embodiment of the present invention, and with reference to fig. 1, a first embodiment of a service decoupling processing method according to an embodiment of the present invention includes:
101, acquiring basic service data of a target service, recording the basic service data and storing the basic service data into a preset basic data table;
when the business processing service receives a request of target business processing, basic business processing is started first, and a new processing record of the target business, namely business basic data, is added in the execution process to ensure that the target business processing behavior is synchronous with the database data. And extracting the service basic data, and recording and storing the service basic data into a preset basic data table.
In this embodiment, a specific description is given by taking a target service as a time-limited derating coupon as an example, where basic service processing mainly refers to receiving the coupon, and expanded service processing mainly refers to time-limited derating. And (3) presetting a coupon template in the server background management system by an operator, perfecting configuration parameters of the coupon template, and finally storing coupon template data into a coupon template table of the MySQL database. In addition, the coupon template can be released to a certain activity marketing page, wherein the information of the coupon template, such as the coupon amount, the using time, the using need and the like, is displayed at a specific position of the activity marketing page, and a getting button is displayed, so that a user can conveniently click the getting button to get the coupon. When a user enters the activity marketing page, the configured coupon can be selected to be received, a user coupon receiving record can be generated when the receiving is successful, the user coupon receiving record is the service basic data, the user coupon receiving record is stored in a user coupon table of the MySQL database, and the process is that a relation record of the user and a coupon template is generated in the user coupon table, wherein the relation record comprises information such as a user account number, a unique identifier of the coupon template, the coupon discount amount, the effective starting time, the effective deadline, the unique identifier of the relation record and the like.
Specifically, after the target coupon is normally received by the user, a user coupon receiving record is generated, the process of storing the receiving record in the user coupon table is equivalent to changing the user coupon table, in the process, corresponding service basic data is generated, recorded and stored in a preset basic data table. The target coupon is a coupon template configured in the server background, and the target coupon can be divided into a conventional coupon and a time-limited discount coupon. The conventional coupon is configured as a fixed-amount coupon valid within a certain time range, for example, one coupon is full of X minus Y, and the validity period is set to 1 month and 1 day to 1 month and 10 days, so that the user can use the coupon only within the validity period. The time-limited derating coupon sets corresponding derating time, the client displays countdown in a matching way, and if the time-limited derating coupon is not used within the specified derating time, the system actively reduces the discount amount of the coupon when the derating time is up.
Further, the conventional coupon cannot create a better coupon urgency, which is not favorable for improving the purchase rate of the user and the usage rate of the coupon. Therefore, after a user takes a coupon, the client displays countdown cooperatively, if the coupon is not used within the specified derating time, the system can actively reduce the discount amount of the coupon when the derating time is up, and the coupon processed in the processing mode is the time-limited derating coupon.
102, extracting operation parameters in the service basic data, recording the operation parameters, and generating a binary log;
when the basic data of the target service is newly added in the basic data table, the database can automatically record the operation behavior to generate a binary log (Binlog log), namely, the operation parameters in the basic data of the service are extracted, and the database records the operation parameters to generate the binary log, wherein the binary log at least comprises the data table name, the operation behavior and the behavior data of the operation.
Specifically, the Binlog is a binary log, records DML operations on database data, and stores the DML operations in a binary form in the MySQL database. The MySQL database is a relational database management system, and the relational database stores data in different tables instead of putting all data in a large database, so that the query speed of system data is increased and the flexibility is improved.
103, analyzing and packaging the binary log into a message body;
after a Bilog log is generated, a Bilog synchronization component is adopted to obtain the Bilog log generated by a database, the Bilog log is analyzed, a RocktMQ message is sent after the Bilog log is analyzed, namely the Bilog analysis data is encapsulated into a message body, wherein the message body at least comprises a data table name, an operation behavior and behavior data of an operation, and a message Topic is named as a basic data table name of the operation, so that the Topic is convenient to subscribe and consume the message.
Specifically, by analyzing the Binlog log, the Binlog log is converted into a message entity which is stored in a message cluster (a distributed message queue rockmq cluster) for a third party to subscribe, wherein the format of the message is a JSON-format character string. When the message entity is output, the Binlog analysis data is mainly encapsulated into the message entity and output.
In this embodiment, the rockmq acts as a distributed message middleware, which can guarantee strict message order, provide stacking capability of hundreds of millions of messages, and keep write latency low even after hundreds of millions of messages are stacked. Because the RocktMQ is adopted in the embodiment, the technical scheme of the embodiment has strong resolving power, supports and can send a large number of messages, and has massive data anti-accumulation capacity through the Message Queue (MQ).
104, monitoring the message body, and performing extended service processing on the message body to obtain service extended data corresponding to the target service;
and monitoring a message body by subscribing and designating the message, wherein the message Topic is a basic data table name, analyzing the message body according to a certain format after monitoring the message body, then performing extended service processing on the target service, and acquiring service extended data corresponding to the target service.
When the target service is a time-limited de-rate coupon, after the target coupon is picked up by a user, a Binlog synchronization component is adopted to obtain a MySQL Binlog log generated when the user successfully picks up the coupon, then the Binlog log is analyzed and a RockettMQ message is sent, wherein the message Topic is named as the table name of a user coupon table, the message is monitored by subscribing the Topic in an extended service processing stage, time-limited de-rate processing is carried out on the time-limited de-rate coupon, the generated extended data is written into the time-limited de-rate table, the asynchronous processing mode is adopted to carry out no service intrusion on the original receiving coupon logic (namely a basic service processing stage), the service module has high cohesion and low coupling, wherein the time-limited de-rate table mainly records the receiving time of the time-limited de-rate coupon, the threshold amount after de-rate, the discount amount after de-rate, the time-limited de-rate processing time, the actual effective cut-off time and the like, and the time-limited de-rate processing time is accurate to a minute, the derating processing frequency of the subsequent timing task is reduced conveniently, and the derating delay is effectively reduced.
And 105, starting the multitask parallel processing service expansion data.
After the task scheduling component service starts multiple tasks, corresponding processing is performed on the target service according to a preset service processing strategy, that is, according to processing parameters in the tasks, a corresponding processing strategy is searched in the preset service processing strategy, and corresponding processing is performed on the target service according to the processing strategy.
In this embodiment, when the target service is the time-limited derating coupon, the related information corresponding to the time-limited derating coupon of the multitask parallel processing is started, that is, the time-limited derating processing time is extracted and compared with the current time, and if the time-limited derating processing time of the time-limited derating coupon is consistent with the current time, the time-limited derating processing is performed on the time-limited derating coupon.
Specifically, the time-limited derating process for the time-limited derated coupons includes the steps that the timing scheduling component starts derating slicing tasks which are issued at regular time every minute, the derating slicing tasks are divided into 10 slicing tasks in total, each slicing task is randomly distributed to one machine in the cluster, when the target coupons are the time-limited derated coupons, target coupon data to be derated in the message prompt list are inquired according to the current time, and then the multi-thread derated target coupons are processed subsequently until the derating process is completed one by one. The fragmentation strategy can reasonably utilize cluster resources, avoids overhigh load of a single machine, improves processing efficiency by adopting a multithreading mode for derating, reduces time delay of time limit derating, and effectively avoids inconsistency between coupon information seen by a user at a client and data actually stored by a server.
The embodiment is realized by deploying a series of service codes to a server, and processing logic of the time-limited derating coupon is realized. And the specific type of the service is supported to be expandable by means of good service data model design. For example, the coupon template is preset with a basic attribute of a coupon type, and only the type of the time-limited derated coupon is expanded and increased on the basic attribute, so that the basic attribute is used for distinguishing a conventional coupon from the time-limited derated coupon, and finally data is stored in the coupon template table. After a user successfully receives a coupon (the coupon can be a conventional coupon or a time-limited derating coupon), a relationship record of the user and a coupon template, namely a user coupon record, is generated in a user coupon table, meanwhile, a Bilog insert log of MySQL is generated, a Bilog synchronization component on a server is responsible for analyzing the Bilog log, the user coupon message body packaged into a certain format is sent to a designated Topic of a RocktMQ cluster, the server is responsible for monitoring the user coupon message in the Topic, the actual consumption logic is to judge whether the coupon received by the user is the time-limited derating coupon according to the user coupon message, if so, relevant data is packaged and written into the user time-limited derating coupon table, and the step is mainly asynchronous decoupling and cannot influence the original coupon receiving logic. After the coupon picking logic is realized, which users pick which time-limited derated coupons are uniformly stored in a user time-limited derated coupon table, a timed scheduling component is subsequently adopted to issue tasks for scanning the user time-limited derated coupon table, data needing derating processing are inquired out, and then derating processing is carried out, and the fragmentation and multithreading mode is adopted to improve the processing efficiency.
The embodiment of the invention actually divides the processing process of the target service into a basic service processing stage and an extended service processing stage, wherein the basic service processing stage is responsible for processing the common unchangeable logic of the service, the extended service processing stage is responsible for processing the logic with special changeable service, acquiring the basic service data of the target service, recording the basic service data, generating a binary operation log at the same time, then synchronously acquiring and analyzing the binary log in the extended service processing stage, finally packaging the binary log into a message body containing the basic service data and sending the message body out, performing service extension processing on the content of the message body, namely the basic service data by monitoring the message body so as to obtain the extended service data, and then simultaneously starting multi-task, paralleling and efficiently processing the extended service data. The embodiment of the invention realizes the decoupling high-efficiency processing of the service, ensures that the original coupon receiving logic is unchanged when the service is the time-limited derating coupon in practical application, adopts a binlogue log synchronization component to acquire and analyze the binlogue log, simultaneously sends the coupon receiving message, realizes asynchronous decoupling by monitoring and collecting the user time-limited derating information, and subsequently adopts multi-task parallel scanning processing aiming at the user time-limited derating information, thereby improving the time-limited derating processing efficiency.
Referring to fig. 2, a second embodiment of the service decoupling processing method according to the embodiment of the present invention includes:
201, acquiring basic service data of a target service, recording the basic service data and storing the basic service data into a preset basic data table;
when the business processing service receives a request of target business processing, basic business processing is started first, and a new processing record of the target business, namely business basic data, is added in the execution process to ensure that the target business processing behavior is synchronous with the database data. And extracting the service basic data, and recording and storing the service basic data into a preset basic data table.
In this embodiment, a specific description is given by taking a target service as a time-limited derating coupon as an example, where basic service processing mainly refers to receiving the coupon, and expanded service processing mainly refers to time-limited derating. And (3) presetting a coupon template in the server background management system by an operator, perfecting configuration parameters of the coupon template, and finally storing coupon template data into a coupon template table of the MySQL database. In addition, the coupon template can be released to a certain activity marketing page, wherein the information of the coupon template, such as the coupon amount, the using time, the using need and the like, is displayed at a specific position of the activity marketing page, and a getting button is displayed, so that a user can conveniently click the getting button to get the coupon. When a user enters the activity marketing page, the configured coupon can be selected to be received, a user coupon receiving record can be generated when the receiving is successful, the user coupon receiving record is the service basic data, the user coupon receiving record is stored in a user coupon table of the MySQL database, and the process is that a relation record of the user and a coupon template is generated in the user coupon table, wherein the relation record comprises information such as a user account number, a unique identifier of the coupon template, the coupon discount amount, the effective starting time, the effective deadline, the unique identifier of the relation record and the like.
Specifically, after the target coupon is normally received by the user, a user coupon receiving record is generated, and the process of storing the receiving record in the user coupon table is equivalent to changing the user coupon table, so that corresponding service basic data can be generated in the process, recorded and stored in a preset basic data table.
202, extracting operation parameters in the service basic data, recording the operation parameters, and generating a binary log;
when the basic data of the target service is newly added in the basic data table, the database can automatically record the operation behavior to generate a binary log (Binlog log), namely, the operation parameters in the basic data of the service are extracted, and the database records the operation parameters to generate the binary log, wherein the binary log at least comprises the data table name, the operation behavior and the behavior data of the operation.
Specifically, the Binlog is a binary log, records DML operations on database data, and stores the DML operations in a binary form in the MySQL database. The MySQL database is a relational database management system, and the relational database stores data in different tables instead of putting all data in a large database, so that the query speed of system data is increased and the flexibility is improved.
203, analyzing the binary log and converting the binary log into readability data based on a preset data format conversion rule;
since the Binlog is a binary log, the Binlog cannot be opened directly by using a text, and specific contents can be checked by using a corresponding analysis tool. And calling a preset Binlog analysis tool, and analyzing the binary log based on a preset log analysis rule to obtain analysis data.
Specifically, the MySQL change data is binary format data, and the binary data is converted into ASCII value data according to the MySQL communication protocol. The data covers the information of adding, deleting and changing the MySQL database. The changed data is converted into a agreed protocol format through format conversion.
By using a Binlog analysis tool, the data added, deleted and changed in the MySQL database can be directly acquired, and the data is converted into a standard format of a protocol, so that quasi-real-time synchronization between homologous or dissimilar source databases can be realized. The unfavorable aspects of analyzing and acquiring the database statements of addition, deletion and modification in other modes are avoided. According to the preset data format conversion rule, the binary data can be converted into readable data.
204, extracting a public function in the readability data, and analyzing the public function to obtain analysis data;
and extracting a public function in the readability data, and analyzing the public function to obtain analysis data. Since the Binlog log is recorded on an event basis. When analyzing, the protocol formats of various events need to be processed respectively, and the events correspond to modules with relatively independent functions. The log analysis part is divided into a general function module and a special function module; the general function module mainly assembles some public functions into the module to achieve the aim of multiplexing to the maximum extent; the special function module is a module part with very independent functions, and corresponds to the design idea of high cohesion and low coupling. The analysis functions of the added data, the changed data and the deleted data correspond to independent modules respectively.
205, extracting the universal format of the target service, and converting the analysis data into the data in the universal format;
206, performing message encapsulation on the data in the universal format to obtain a message body;
in this embodiment, the common format of the target service is extracted, and the parsed data after parsing is subjected to format conversion according to the common format, that is, the parsed data is converted into data in the common format, where a preset format conversion rule is a common format conversion protocol. In addition, the RocktMQ is used as a distributed message middleware, and the obtained data in the general format is subjected to message encapsulation through the RocktMQ to generate a message body for data communication.
207, monitoring the message body, and performing extended service processing on the message body to obtain service extended data corresponding to the target service;
and monitoring a message body by subscribing and designating the message, wherein the message Topic is a basic data table name, analyzing the message body according to a certain format after monitoring the message body, then performing extended service processing on the target service, and acquiring service extended data corresponding to the target service.
When the target service is a time-limited de-rate coupon, after the target coupon is picked up by a user, a Binlog synchronization component is adopted to obtain a MySQL Binlog log generated when the user successfully picks up the coupon, then the Binlog log is analyzed and a RockettMQ message is sent, wherein the message Topic is named as the table name of a user coupon table, the message is monitored by subscribing the Topic in an extended service processing stage, time-limited de-rate processing is carried out on the time-limited de-rate coupon, the generated extended data is written into the time-limited de-rate table, the asynchronous processing mode is adopted to carry out no service intrusion on the original receiving coupon logic (namely a basic service processing stage), the service module has high cohesion and low coupling, wherein the time-limited de-rate table mainly records the receiving time of the time-limited de-rate coupon, the threshold amount after de-rate, the discount amount after de-rate, the time-limited de-rate processing time, the actual effective cut-off time and the like, and the time-limited de-rate processing time is accurate to a minute, the derating processing frequency of the subsequent timing task is reduced conveniently, and the derating delay is effectively reduced.
And 208, starting the multitask parallel processing service expansion data.
After the task scheduling component service starts multiple tasks, corresponding processing is performed on the target service according to a preset service processing strategy, that is, according to processing parameters in the tasks, a corresponding processing strategy is searched in the preset service processing strategy, and corresponding processing is performed on the target service according to the processing strategy.
In this embodiment, when the target service is the time-limited derating coupon, the related information corresponding to the time-limited derating coupon of the multitask parallel processing is started, that is, the time-limited derating processing time is extracted and compared with the current time, and if the time-limited derating processing time of the time-limited derating coupon is consistent with the current time, the time-limited derating processing is performed on the time-limited derating coupon.
Specifically, the time-limited derating process for the time-limited derated coupons includes the steps that the timing scheduling component starts derating slicing tasks which are issued at regular time every minute, the derating slicing tasks are divided into 10 slicing tasks in total, each slicing task is randomly distributed to one machine in the cluster, when the target coupons are the time-limited derated coupons, target coupon data to be derated in the message prompt list are inquired according to the current time, and then the multi-thread derated target coupons are processed subsequently until the derating process is completed one by one. The fragmentation strategy can reasonably utilize cluster resources, avoids overhigh load of a single machine, improves processing efficiency by adopting a multithreading mode for derating, reduces time delay of time limit derating, and effectively avoids inconsistency between coupon information seen by a user at a client and data actually stored by a server.
In the embodiment of the invention, the binary log is analyzed and converted into the readable data, the public function in the readable data is analyzed, the analyzed data is packaged into the message body, and the message body is subjected to extended service processing. The embodiment of the invention realizes the analysis of the binary log, encapsulates the analysis data into the message body, and realizes asynchronous decoupling and improves the service processing efficiency by monitoring and searching the time-limited derating processing information of the coupon contained in the message body.
Referring to fig. 3, a third embodiment of a service decoupling processing method according to the embodiment of the present invention includes:
301, acquiring a service and configuring relevant information for the service;
all services are obtained, corresponding related information is configured for each service, and the related information is converted into services with different attributes. Wherein, the related information at least comprises the service attribute, the service type and the sending time of the service prompting message. The configuration of the related information is combined and configured according to a preset related information type, that is, a service attribute is selected from a preset service attribute category to configure the service, and similarly, the service type is also configured in a related manner.
And when the service is the coupon, acquiring all coupons needing to be configured, and configuring the related information of the coupons. Specifically, the service type is a preferential type, and the service attribute is a basic attribute of the coupon. In addition, the coupon type is one of basic attributes of the coupon, and the coupon type is mainly a fixed amount type and a time-limited derating type. The method can add the coupon in an operation background management system, arbitrarily select a fixed amount type and a limited derating type when the coupon is configured, then configure the basic attribute of the coupon according to the actual service condition, and finally complete the configuration of the template coupon.
302, based on the related information, converting the service into a target service;
and converting the service into a target service according to the corresponding related information configured by each service. When the service is the coupon, the generated target coupon comprises a conventional coupon configured according to a fixed amount type and basic attributes, and a time-limited derated coupon configured according to a time-limited derated type and basic attributes.
303, acquiring basic service data of the target service, recording the basic service data and storing the basic service data into a preset basic data table;
when the business processing service receives a request of target business processing, basic business processing is started first, and a new processing record of the target business, namely business basic data, is added in the execution process to ensure that the target business processing behavior is synchronous with the database data. And extracting the service basic data, and recording and storing the service basic data into a preset basic data table.
In this embodiment, a specific description is given by taking a target service as a time-limited derating coupon as an example, where basic service processing mainly refers to receiving the coupon, and expanded service processing mainly refers to time-limited derating. And (3) presetting a coupon template in the server background management system by an operator, perfecting configuration parameters of the coupon template, and finally storing coupon template data into a coupon template table of the MySQL database. In addition, the coupon template can be released to a certain activity marketing page, wherein the information of the coupon template, such as the coupon amount, the using time, the using need and the like, is displayed at a specific position of the activity marketing page, and a getting button is displayed, so that a user can conveniently click the getting button to get the coupon. When a user enters the activity marketing page, the configured coupon can be selected to be received, a user coupon receiving record can be generated when the receiving is successful, the user coupon receiving record is the service basic data, the user coupon receiving record is stored in a user coupon table of the MySQL database, and the process is that a relation record of the user and a coupon template is generated in the user coupon table, wherein the relation record comprises information such as a user account number, a unique identifier of the coupon template, the coupon discount amount, the effective starting time, the effective deadline, the unique identifier of the relation record and the like.
Specifically, after the target coupon is normally received by the user, a user coupon receiving record is generated, and the process of storing the receiving record in the user coupon table is equivalent to changing the user coupon table, so that corresponding service basic data can be generated in the process, recorded and stored in a preset basic data table.
304, extracting the operation parameters in the service basic data, recording the operation parameters, and generating a binary log;
when the basic data of the target service is newly added in the basic data table, the database can automatically record the operation behavior to generate a binary log (Binlog log), namely, the operation parameters in the basic data of the service are extracted, and the database records the operation parameters to generate the binary log, wherein the binary log at least comprises the data table name, the operation behavior and the behavior data of the operation.
Specifically, the Binlog is a binary log, records DML operations on database data, and stores the DML operations in a binary form in the MySQL database. The MySQL database is a relational database management system, and the relational database stores data in different tables instead of putting all data in a large database, so that the query speed of system data is increased and the flexibility is improved.
305, analyzing the binary log based on a preset log analysis rule to obtain analysis data;
since the Binlog is a binary log, the Binlog cannot be opened directly by using a text, and specific contents can be checked by using a corresponding analysis tool. And calling a preset Binlog analysis tool, and analyzing the binary log based on a preset log analysis rule to obtain analysis data.
306, extracting the general format of the target service, and converting the analysis data into the data in the general format;
307, performing message encapsulation on the data in the universal format to obtain a message body;
in this embodiment, the common format of the target service is extracted, and the parsed data after parsing is subjected to format conversion according to the common format, that is, the parsed data is converted into data in the common format, where a preset format conversion rule is a common format conversion protocol. In addition, the RocktMQ is used as a distributed message middleware, and the obtained data in the general format is subjected to message encapsulation through the RocktMQ to generate a message body for data communication.
308, monitoring the message body, and performing extended service processing on the message body to obtain service extended data corresponding to the target service;
and monitoring a message body by subscribing and designating the message, wherein the message Topic is a basic data table name, analyzing the message body according to a certain format after monitoring the message body, then performing extended service processing on the target service, and acquiring service extended data corresponding to the target service.
When the target service is a time-limited de-rate coupon, after the target coupon is picked up by a user, a Binlog synchronization component is adopted to obtain a MySQL Binlog log generated when the user successfully picks up the coupon, then the Binlog log is analyzed and a RockettMQ message is sent, wherein the message Topic is named as the table name of a user coupon table, the message is monitored by subscribing the Topic in an extended service processing stage, time-limited de-rate processing is carried out on the time-limited de-rate coupon, the generated extended data is written into the time-limited de-rate table, the asynchronous processing mode is adopted to carry out no service intrusion on the original receiving coupon logic (namely a basic service processing stage), the service module has high cohesion and low coupling, wherein the time-limited de-rate table mainly records the receiving time of the time-limited de-rate coupon, the threshold amount after de-rate, the discount amount after de-rate, the time-limited de-rate processing time, the actual effective cut-off time and the like, and the time-limited de-rate processing time is accurate to a minute, the derating processing frequency of the subsequent timing task is reduced conveniently, and the derating delay is effectively reduced.
309, starting the multitask parallel processing service expansion data.
After the task scheduling component service starts multiple tasks, corresponding processing is performed on the target service according to a preset service processing strategy, that is, according to processing parameters in the tasks, a corresponding processing strategy is searched in the preset service processing strategy, and corresponding processing is performed on the target service according to the processing strategy.
In this embodiment, when the target service is the time-limited derating coupon, the related information corresponding to the time-limited derating coupon of the multitask parallel processing is started, that is, the time-limited derating processing time is extracted and compared with the current time, and if the time-limited derating processing time of the time-limited derating coupon is consistent with the current time, the time-limited derating processing is performed on the time-limited derating coupon.
Specifically, the time-limited derating process for the time-limited derated coupons includes the steps that the timing scheduling component starts derating slicing tasks which are issued at regular time every minute, the derating slicing tasks are divided into 10 slicing tasks in total, each slicing task is randomly distributed to one machine in the cluster, when the target coupons are the time-limited derated coupons, target coupon data to be derated in the message prompt list are inquired according to the current time, and then the multi-thread derated target coupons are processed subsequently until the derating process is completed one by one. The fragmentation strategy can reasonably utilize cluster resources, avoids overhigh load of a single machine, improves processing efficiency by adopting a multithreading mode for derating, reduces time delay of time limit derating, and effectively avoids inconsistency between coupon information seen by a user at a client and data actually stored by a server.
In the embodiment of the invention, the service is acquired, the related information is configured for the service to generate the target service, in practical application, when the service is the coupon, the related time-limited derating information is configured for the coupon, and the common coupon is converted into the time-limited derating coupon, so that the coupon strategy of the coupon is expanded, the coupon tension of a user is improved, and meanwhile, the original coupon logic is not changed when the service logic of the time-limited derating coupon runs, and asynchronous decoupling is realized.
Referring to fig. 4, a fourth embodiment of the service decoupling processing method according to the embodiment of the present invention includes:
401, acquiring basic service data of a target service, recording the basic service data and storing the basic service data into a preset basic data table;
402, extracting operation parameters in the service basic data, recording the operation parameters, and generating a binary log;
403, analyzing and packaging the binary log into a message body;
404, monitoring the message body, and performing extended service processing on the message body to obtain service extended data corresponding to the target service;
405, extracting relevant information of the target service;
and extracting relevant information of the target service, and when the target service is the target coupon, extracting relevant information corresponding to the target coupon, namely extracting the discount type, the basic attribute and the time-limited derating processing time of the target coupon.
406, inputting the relevant information of the target service into a service expansion data table;
the related information of the target service is input into a service expansion data table, the service expansion data table, namely a time-limited derating table, mainly records the receiving time, the threshold amount after derating, the discount amount after derating, the time-limited derating processing time, the actual effective cut-off time and the like of the target coupon, the time-limited derating processing time is uniformly accurate to a point for a moment, the subsequent derating processing frequency is reduced conveniently, and the derating delay is effectively reduced.
It should be noted that before the relevant information of the target coupon is entered into the service expansion data table, the coupon type of the target coupon needs to be determined, that is, whether the target coupon is a time-limited discount coupon is determined. When the target coupon is the conventional coupon, the processing is not needed, and when the target coupon is the time-limited derating coupon, the time-limited derating processing time of the target coupon is extracted and recorded into a service expansion data table.
407, extracting service extension data processing time corresponding to the target service from the service extension data table;
and extracting service expansion data processing time corresponding to the target service from the service expansion data table, wherein when the target coupon is a time-limited derating coupon, the service expansion data processing time is the time-limited derating processing time, namely the main process is to search relevant data of the time-limited derating coupon from the service expansion data table and extract the time-limited derating processing time of the time-limited derating coupon.
408, comparing whether the processing time of the service expansion data is consistent with the current time;
and comparing the processing time of the service expansion data with the current time, and detecting whether the processing time of the service expansion data is consistent with the current time, namely comparing whether the time limit derating processing time of the time limit derating coupon is consistent with the current time.
409, if the processing time of the service expansion data is consistent with the current time, starting multi-task to perform parallel processing on the service expansion data according to the relevant information of the target service in the service expansion data table and a preset service processing strategy.
If the time-limited derating processing time of the time-limited derating coupon is consistent with the current time, the time-limited derating coupon is shown to reach the time point needing derating processing, and the system can perform derating processing on the time-limited derating coupon. In addition, if the time limit derating processing time of the time limit derating coupon is not consistent with the current time, the time of the time limit derating is not reached, and the time limit derating processing time of the time limit derating coupon is monitored by a timing scheduling component preset by the server.
Specifically, a timing scheduling component preset by a server starts to issue a derating slicing task at a fixed time per minute, the derating slicing task is divided into 10 slicing tasks in total, each slicing task is randomly distributed to one machine in a cluster, when a target coupon is a time-limited derating coupon, data of the target coupon to be derated in a message prompt table are inquired according to the current time, and the derating target coupon is processed in a multithreading mode subsequently until derating processing is completed one by one. The fragmentation strategy can reasonably utilize cluster resources, avoids overhigh load of a single machine, improves processing efficiency by adopting a multithreading mode for derating, reduces time delay of time limit derating, and effectively avoids inconsistency between coupon information seen by a user at a client and data actually stored by a server.
In this embodiment, the steps 401 and 404 are the same as the steps 101 and 104 in the first embodiment of the service decoupling processing method, and are not described herein again.
In the embodiment of the invention, the service expansion data processing time is extracted from the service expansion data table, and when the service expansion data processing time is consistent with the current time, the multitask parallel processing of the service expansion data is started, so that the service processing efficiency is improved.
With reference to fig. 5, the service decoupling processing method in the embodiment of the present invention is described above, and a service decoupling processing device in the embodiment of the present invention is described below, where an embodiment of the service decoupling processing device in the embodiment of the present invention includes:
an obtaining module 501, configured to obtain basic service data of a target service, record the basic service data, and store the recorded basic service data in a preset basic data table;
a generating module 502, configured to extract an operation parameter from the service basic data, record the operation parameter, and generate a binary log;
an encapsulating module 503, configured to parse and encapsulate the binary log into a message body;
a monitoring module 504, configured to monitor the message body, and perform extended service processing on the message body to obtain service extended data corresponding to the target service;
and the processing module 505 is configured to start multiple tasks and process the service expansion data in parallel.
In the embodiment of the invention, the target service is divided into the basic service processing logic and the extended service processing logic by the service decoupling processing device, thereby realizing asynchronous decoupling of the service logic and improving the efficiency of service processing.
Referring to fig. 6, another embodiment of the service decoupling processing apparatus in the embodiment of the present invention includes:
an obtaining module 501, configured to obtain basic service data of a target service, record the basic service data, and store the recorded basic service data in a preset basic data table;
a generating module 502, configured to extract an operation parameter from the service basic data, record the operation parameter, and generate a binary log;
an encapsulating module 503, configured to parse and encapsulate the binary log into a message body;
a monitoring module 504, configured to monitor the message body, and perform extended service processing on the message body to obtain service extended data corresponding to the target service;
and the processing module 505 is configured to start multiple tasks and process the service expansion data in parallel.
Optionally, the encapsulation module 503 includes:
an analyzing unit 5031, configured to analyze the binary log based on a preset log analysis rule to obtain analysis data;
a converting unit 5032, configured to extract a common format of the target service, and convert the parsing data into data in the common format;
an encapsulating unit 5033, configured to perform message encapsulation on the data in the generic format to obtain a message body.
Optionally, the analyzing unit 5031 is specifically configured to:
analyzing the binary log and converting the binary log into readability data based on a preset data format conversion rule;
and extracting a public function in the readability data, and analyzing the public function to obtain analysis data.
Optionally, the service decoupling processing apparatus further includes a configuration module 506, which is specifically configured to:
acquiring a service, and configuring relevant information for the service, wherein the relevant information at least comprises a service attribute and a service type;
and converting the service into a target service based on the related information.
Optionally, the service decoupling processing apparatus further includes an entry module 507, which is specifically configured to:
extracting relevant information of the target service;
and inputting the relevant information of the target service into a preset service expansion data table.
Optionally, the processing module 505 is specifically configured to:
extracting service expansion data processing time corresponding to the target service from the service expansion data table;
comparing whether the service expansion data processing time is consistent with the current time or not;
and if the processing time of the service expansion data is consistent with the current time, starting multiple tasks to perform parallel processing on the service expansion data according to the relevant information of the target service in the service expansion data table and a preset service processing strategy.
In the embodiment of the invention, the service decoupling processing device generates the target service for the service configuration related information, and performs basic service processing and extended service processing on the target service, thereby realizing asynchronous decoupling, simultaneously starting multi-task parallel processing service extended data, and improving the data processing efficiency.
Referring to fig. 7, an embodiment of the service decoupling processing device in the embodiment of the present invention is described in detail below from a hardware processing perspective.
Fig. 7 is a schematic structural diagram of a service decoupling processing device according to an embodiment of the present invention, where the service decoupling processing device 700 may generate a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 710 (e.g., one or more processors) and a memory 720, and one or more storage media 730 (e.g., one or more mass storage devices) storing an application 733 or data 732. Memory 720 and storage medium 730 may be, among other things, transient storage or persistent storage. The program stored on the storage medium 730 may include one or more modules (not shown), each of which may include a series of instruction operations on the traffic decoupling processing device 700. Further, the processor 710 may be configured to communicate with the storage medium 730 to execute a series of instruction operations in the storage medium 730 on the traffic decoupling processing device 700.
The traffic decoupling processing device 700 may also include one or more power supplies 740, one or more wired or wireless network interfaces 750, one or more input-output interfaces 760, and or one or more operating systems 731, such as Windows server, Mac OS X, Unix, Linux, FreeBSD, and so forth. Those skilled in the art will appreciate that the configuration of the business decoupling processing device shown in fig. 7 does not constitute a limitation of the business decoupling processing device and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.
The present invention also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium, and which may also be a volatile computer-readable storage medium, having stored therein instructions, which, when run on a computer, cause the computer to perform the steps of the traffic decoupling processing method.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A service decoupling processing method is characterized in that the service decoupling processing method comprises the following steps:
acquiring basic service data of a target service, recording the basic service data and storing the basic service data into a preset basic data table;
extracting operation parameters in the service basic data, recording the operation parameters, and generating a binary log;
analyzing and packaging the binary log into a message body;
monitoring the message body, and performing extended service processing on the message body to obtain service extended data corresponding to the target service;
and starting multitask and processing the service expansion data in parallel.
2. The traffic decoupling processing method of claim 1, wherein parsing and encapsulating the binary log into a message body comprises:
analyzing the binary log based on a preset log analysis rule to obtain analysis data;
extracting the universal format of the target service, and converting the analysis data into the data in the universal format;
and performing message encapsulation on the data in the general format to obtain a message body.
3. The service decoupling processing method according to claim 2, wherein the analyzing the binary log based on a preset log analysis rule to obtain analysis data includes:
analyzing the binary log and converting the binary log into readability data based on a preset data format conversion rule;
and extracting a public function in the readability data, and analyzing the public function to obtain analysis data.
4. The service decoupling processing method according to any one of claims 1 to 3, wherein before the acquiring the basic service data of the target service, recording and storing the basic service data into a preset basic data table, the method further includes:
acquiring a service, and configuring relevant information for the service, wherein the relevant information at least comprises a service attribute and a service type;
and converting the service into a target service based on the related information.
5. The service decoupling processing method according to claim 4, further comprising, before the starting of the multitask parallel processing of the service extension data:
extracting relevant information of the target service;
and inputting the relevant information of the target service into a preset service expansion data table.
6. The service decoupling processing method according to claim 5, wherein the starting of multitask parallel processing of the service extension data comprises:
extracting service expansion data processing time corresponding to the target service from the service expansion data table;
comparing whether the service expansion data processing time is consistent with the current time or not;
if yes, according to the relevant information of the target service in the service expansion data table and a preset service processing strategy, multi-tasks are started to carry out parallel processing on the service expansion data.
7. A service decoupling processing apparatus, wherein the service decoupling processing apparatus comprises:
the acquisition module is used for acquiring basic service data of a target service, recording the basic service data and storing the basic service data into a preset basic data table;
the generating module is used for generating a binary log based on the service basic data;
the packaging module is used for analyzing and packaging the binary log into a message body;
the monitoring module is used for monitoring the message body and performing extended service processing on the message body to obtain service extended data corresponding to the target service;
and the processing module is used for starting multiple tasks and processing the service expansion data in parallel.
8. The traffic decoupling processing device of claim 7, wherein the encapsulation module comprises:
the analysis unit is used for analyzing the binary log based on a preset log analysis rule to obtain analysis data;
the conversion unit is used for extracting the universal format of the target service and converting the analysis data into the data in the universal format;
and the packaging unit is used for packaging the message of the data with the general format to obtain a message body.
9. A traffic decoupling processing device, wherein the traffic decoupling processing device comprises:
a memory having instructions stored therein and at least one processor, the memory and the at least one processor interconnected by a line;
the at least one processor invokes the instructions in the memory to cause the traffic decoupling processing device to perform the steps of the traffic decoupling processing method of any one of claims 1-6.
10. A computer-readable storage medium having instructions stored thereon, which when executed by a processor implement the steps of the traffic decoupling processing method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110566369.9A CN113487340B (en) | 2021-05-24 | 2021-05-24 | Service decoupling processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110566369.9A CN113487340B (en) | 2021-05-24 | 2021-05-24 | Service decoupling processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113487340A true CN113487340A (en) | 2021-10-08 |
| CN113487340B CN113487340B (en) | 2024-07-12 |
Family
ID=77933008
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110566369.9A Active CN113487340B (en) | 2021-05-24 | 2021-05-24 | Service decoupling processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113487340B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115794195A (en) * | 2023-02-08 | 2023-03-14 | 湖南三湘银行股份有限公司 | Banking business management and maintenance method and device based on Viper framework |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013016994A1 (en) * | 2011-07-29 | 2013-02-07 | 中兴通讯股份有限公司 | Message sending method and system |
| CN107783975A (en) * | 2016-08-24 | 2018-03-09 | 北京京东尚科信息技术有限公司 | The method and apparatus of distributed data base synchronization process |
| CN108804237A (en) * | 2017-05-05 | 2018-11-13 | 北京京东尚科信息技术有限公司 | Data real-time statistical method, device, storage medium and electronic equipment |
| CN109492012A (en) * | 2018-10-31 | 2019-03-19 | 厦门安胜网络科技有限公司 | A kind of method, apparatus and storage medium of data real-time statistics and retrieval |
| CN110908812A (en) * | 2019-11-11 | 2020-03-24 | 腾讯科技（深圳）有限公司 | Business data processing method and device, readable storage medium and computer equipment |
| CN112131237A (en) * | 2020-09-28 | 2020-12-25 | 京东数字科技控股股份有限公司 | Data synchronization method, device, equipment and computer readable medium |
| WO2021088641A1 (en) * | 2019-11-07 | 2021-05-14 | 中兴通讯股份有限公司 | Data transmission method, data processing method, data reception method and device, and storage medium |
-
2021
- 2021-05-24 CN CN202110566369.9A patent/CN113487340B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013016994A1 (en) * | 2011-07-29 | 2013-02-07 | 中兴通讯股份有限公司 | Message sending method and system |
| CN107783975A (en) * | 2016-08-24 | 2018-03-09 | 北京京东尚科信息技术有限公司 | The method and apparatus of distributed data base synchronization process |
| CN108804237A (en) * | 2017-05-05 | 2018-11-13 | 北京京东尚科信息技术有限公司 | Data real-time statistical method, device, storage medium and electronic equipment |
| CN109492012A (en) * | 2018-10-31 | 2019-03-19 | 厦门安胜网络科技有限公司 | A kind of method, apparatus and storage medium of data real-time statistics and retrieval |
| WO2021088641A1 (en) * | 2019-11-07 | 2021-05-14 | 中兴通讯股份有限公司 | Data transmission method, data processing method, data reception method and device, and storage medium |
| CN110908812A (en) * | 2019-11-11 | 2020-03-24 | 腾讯科技（深圳）有限公司 | Business data processing method and device, readable storage medium and computer equipment |
| CN112131237A (en) * | 2020-09-28 | 2020-12-25 | 京东数字科技控股股份有限公司 | Data synchronization method, device, equipment and computer readable medium |
Non-Patent Citations (3)
| Title |
|---|
| MORAIS, R ETC.: "Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videos", 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 1 January 2019 (2019-01-01) * |
| 周毅: "基于微服务框架的制造执行系统解耦与重构机制研究", 中国博士学位论文全文数据库经济与管理科学辑, no. 02, 15 February 2020 (2020-02-15) * |
| 李宁, 张云云: "基于.NET的一种异常管理模型", 西安科技学院学报, no. 04, 30 December 2004 (2004-12-30) * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115794195A (en) * | 2023-02-08 | 2023-03-14 | 湖南三湘银行股份有限公司 | Banking business management and maintenance method and device based on Viper framework |
| CN115794195B (en) * | 2023-02-08 | 2023-04-28 | 湖南三湘银行股份有限公司 | Banking business management and maintenance method and device based on Viper framework |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113487340B (en) | 2024-07-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110909063B (en) | User behavior analysis method and device, application server and storage medium | |
| CN107220142B (en) | Method and device for executing data recovery operation | |
| CN108920153B (en) | Docker container dynamic scheduling method based on load prediction | |
| CN102236581A (en) | Mapping reduction method and system thereof for data center | |
| CN111045806A (en) | Method and system for realizing delay message queue | |
| CN113973053B (en) | Probe management system and method for network target range | |
| CN109039817B (en) | Information processing method, device, equipment and medium for flow monitoring | |
| CN110784377A (en) | Method for uniformly managing cloud monitoring data in multi-cloud environment | |
| CN112818064A (en) | Multi-system data synchronization method, device, equipment and storage medium | |
| CN113487340B (en) | Service decoupling processing method, device, equipment and storage medium | |
| CN112015795A (en) | System and method for large-data-volume ad hoc query | |
| CN115622906A (en) | Application log capturing system and method | |
| CN108959657B (en) | Data change processing method and device | |
| CN114328152A (en) | Log recording method, device, equipment and medium | |
| CN113360413A (en) | Code testing method and device | |
| CN113434742A (en) | Account screening method and device, storage medium and electronic device | |
| CN110009273B (en) | Information processing method and device, storage medium, and electronic device | |
| CN111367686A (en) | Service interface calling method and device, computer equipment and storage medium | |
| CN107786661B (en) | Information synchronization method | |
| CN115617768A (en) | Log management method, system, electronic device and storage medium | |
| CN116263717A (en) | Order service processing method and device based on event | |
| CN111401819B (en) | Intersystem data pushing method and system | |
| CN114997108A (en) | Order number generation method, device, equipment and storage medium | |
| CN114253914A (en) | Distributed data acquisition system and method | |
| CN113900811A (en) | Event-driven task scheduling method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |