CN114691394A - E-commerce data processing method, device and system - Google Patents

E-commerce data processing method, device and system Download PDF

Info

Publication number
CN114691394A
CN114691394A CN202210349366.4A CN202210349366A CN114691394A CN 114691394 A CN114691394 A CN 114691394A CN 202210349366 A CN202210349366 A CN 202210349366A CN 114691394 A CN114691394 A CN 114691394A
Authority
CN
China
Prior art keywords
event
execution
events
processing
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210349366.4A
Other languages
Chinese (zh)
Inventor
田诗颖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Wodong Tianjun Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN202210349366.4A priority Critical patent/CN114691394A/en
Publication of CN114691394A publication Critical patent/CN114691394A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/542Event management; Broadcasting; Multicasting; Notifications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/547Messaging middleware
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/548Queue

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Stored Programmes (AREA)

Abstract

The invention discloses a method, a device and a system for processing e-commerce data, and relates to the technical field of data processing. One embodiment of the method comprises: receiving a transaction request aiming at E-commerce data sent by a client, and generating one or more events for the transaction request; determining the event type of each event; if the event type belongs to the transaction preset basic requirement type, calling a first execution strategy corresponding to the event through the main program so as to process the event through the first execution strategy; if the event type belongs to the transaction preset additional requirement type, storing the event into a preset message middleware through a main program so as to trigger a second execution strategy processing event corresponding to the event; and determining a processing result corresponding to one or more events, and sending the processing result to the client. According to the embodiment of the invention, one or more events are generated according to the request, and different events are respectively processed according to the event types, so that the decoupling operation on the request is realized.

Description

E-commerce data processing method, device and system
Technical Field
The invention relates to the technical field of data processing, in particular to a method, a device and a system for processing e-commerce data.
Background
In the e-commerce data processing process, a series of events generally need to be processed to complete the e-commerce data processing. For example, for e-commerce data of a merchant entering an e-commerce platform, a series of event processing or specific operations such as account creation, store setting initialization, common functions, and commodity initialization need to be performed. In the existing e-commerce system, a fixed calling sequence is usually set for a series of event processing or specific operations through a main program, and a realization method of each service function is called one by one in the execution process to complete the whole opening operation.
However, when a service function of an additional requirement type needs to be added in the e-commerce data processing process, a service method corresponding to the additional requirement type needs to be added in advance, and a step of calling the method is added to a calling sequence of a main program, so that when the service method corresponding to the additional requirement type cannot be normally called, the completion of the whole e-commerce data processing is affected, and the coupling is serious.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and an apparatus for processing e-commerce data, where one or more events are generated according to a transaction request for the e-commerce data, and different events are respectively processed according to event types, so as to decouple different types of events. Specifically, different execution strategies are called for different events belonging to the transaction preset basic requirement type and the transaction preset additional requirement type, so that the asynchronous processing of the events according to the execution methods of the different event types is realized.
To achieve the above object, according to a first aspect of embodiments of the present invention, there is provided an e-commerce data processing method, including:
receiving an e-commerce data processing transaction request sent by a client, and generating one or more events for the transaction request;
determining an event type to which each of the events belongs; if the event type belongs to a transaction preset basic requirement type, calling a first execution strategy corresponding to the event through a main program so as to process the event through the first execution strategy; if the event type belongs to an event preset additional requirement type, storing the event into a preset message middleware through a main program so as to trigger a second execution strategy corresponding to the event to process the event;
and determining a processing result corresponding to one or more events, and sending the processing result to the client.
Optionally, the invoking, by the main program, a first execution policy corresponding to the event type includes: in the plurality of events, for a plurality of first events belonging to the preset basic requirement type of the transaction, executing: determining an execution order of a plurality of the first events; and calling a first execution strategy corresponding to each first event in sequence according to the execution sequence.
Optionally, in the events, for a plurality of second events belonging to the preset additional requirement type of the transaction, the method further includes: and providing a plurality of second events stored in the message middleware to a second execution strategy corresponding to each second event through multithreading.
Optionally, the method further comprises: setting a corresponding annotation item for each event through monitoring event class annotation in annotation configuration, and setting a corresponding operation for each annotation item, wherein the operation comprises calling the first execution strategy or storing the event to the message middleware;
the determining the event type to which each event belongs includes: and determining the annotation item corresponding to each event.
Optionally, the method further comprises: the execution order is configured by an order class annotation in an annotation configuration.
Optionally, after the storing the event to the preset message middleware through the main program, the method further includes: for the case of event processing exception in the message middleware, executing:
storing the abnormal information corresponding to the abnormal condition into a first abnormal record table; reading abnormal information at regular time according to a preset time period through a regular reading task, repeatedly executing the abnormal information, and storing a compensation state into the first abnormal record table according to an execution result; and confirming whether the second execution strategy is normal or not according to the compensation times and the compensation state in the first abnormal record table.
Optionally, the plurality of first execution strategies and the plurality of second execution strategies are respectively packaged into independent functional subsystems; the main program is packaged into an independent scheduling main system; and remote calling is realized between the dispatching main system and the function subsystem through a standard rpc interface.
Optionally, the method further comprises: configuring an initialization interface configuration table in the scheduling main system according to one or more functional subsystems; wherein an execution order of the one or more functional subsystems is indicated in the initialization interface configuration table.
Optionally, the method further comprises: receiving a newly added function subsystem or a newly added execution method; and constructing the connection between the newly added function subsystem or the newly added execution method and the message middleware so that the newly added function subsystem or the newly added execution method obtains the corresponding event through the message middleware.
Optionally, the method further comprises: recording the execution state of the one or more functional subsystems in real time; for the case that the execution state is failure, executing:
storing the abnormal information corresponding to the failure of the execution state into a second abnormal record table; and through a timing reading task, reading the abnormal information in the second abnormal record table at a timing according to a preset time period, repeatedly executing the abnormal information, and updating the execution state according to an execution result.
To achieve the above object, according to a second aspect of the embodiments of the present invention, there is provided an apparatus for data processing of an e-commerce.
The device for processing the e-commerce data comprises the following components:
the receiving module is used for receiving a request sent by a client and generating one or more events for the request;
the determining module is used for determining the event type of each event; if the event type belongs to a transaction preset basic requirement type, calling a first execution strategy corresponding to the event through a main program so as to process the event through the first execution strategy; if the event type belongs to an event preset additional requirement type, storing the event into a preset message middleware through a main program so as to trigger a second execution strategy corresponding to the event to process the event;
and the processing module is used for determining a processing result corresponding to one or more events and sending the processing result to the client.
Optionally, the determining module is further configured to, in the plurality of events, for a plurality of first events belonging to the preset basic requirement type of the transaction: determining an execution order of a plurality of the first events; and sequentially calling a first execution strategy corresponding to each first event according to the execution sequence.
Optionally, the determining module is further configured to, in the plurality of events, for a plurality of second events belonging to the transaction preset additional requirement type: and providing a plurality of second events stored in the message middleware to a second execution strategy corresponding to each second event through multithreading.
Optionally, the apparatus further includes an annotation module, configured to set a corresponding annotation item for each event through a listening event class in an annotation configuration, and set a corresponding operation for each annotation item, where the operation includes invoking the first execution policy or storing the event to the message middleware;
the determining module is further configured to determine an annotation item corresponding to each of the events.
Optionally, the annotation module is further configured to configure the execution order by an order class annotation in an annotation configuration.
Optionally, the apparatus further includes an exception handling module, configured to, after the event is stored in a preset message middleware through the main program, perform, for an event handling exception in the message middleware,:
storing the abnormal information corresponding to the abnormal condition into a first abnormal record table; reading abnormal information at regular time according to a preset time period through a regular reading task, repeatedly executing the abnormal information, and storing a compensation state into the first abnormal record table according to an execution result; and confirming whether the second execution strategy is normal or not according to the compensation times and the compensation state in the first abnormal record table.
Optionally, the plurality of first execution strategies and the plurality of second execution strategies are respectively packaged into independent functional subsystems; the main program is packaged into an independent scheduling main system; and remote calling is realized between the dispatching main system and the function subsystem through a standard rpc interface.
Optionally, the apparatus further comprises: the configuration module is used for configuring an initialization interface configuration table in the scheduling main system according to one or more functional subsystems; wherein an execution order of the one or more functional subsystems is indicated in the initialization interface configuration table.
Optionally, the apparatus further comprises: the adding module is used for receiving the newly added function subsystem or the newly added execution method; and constructing the connection between the newly added function subsystem or the newly added execution method and the message middleware so that the newly added function subsystem or the newly added execution method obtains the corresponding event through the message middleware.
Optionally, the determining module is further configured to record, in real time, an execution state of the one or more functional subsystems; for the case that the execution state is failure, executing: storing the abnormal information corresponding to the failure of the execution state into a second abnormal record table; and through a timing reading task, reading the abnormal information in the second abnormal record table at a timing according to a preset time period, repeatedly executing the abnormal information, and updating the execution state according to an execution result.
To achieve the above object, according to a third aspect of the embodiments of the present invention, a system for data processing of an e-commerce is provided.
The system for processing the e-commerce data comprises the following components: the system comprises a client and the e-commerce data processing device, wherein the client sends a request to the e-commerce data processing device; and the E-commerce data processing device responds to the request, processes an event corresponding to the request and sends the processing result to the client.
To achieve the above object, according to a fourth aspect of the embodiments of the present invention, there is also provided a system for data processing of an e-commerce.
The system for processing the e-commerce data comprises the following components: a client, a scheduling main system, a plurality of first functional subsystems and a plurality of second functional subsystems, wherein,
the client sends a request to the scheduling main system;
the scheduling main system responds to the request to generate one or more events, determines event types of the one or more events, and calls a first function subsystem matched with the events belonging to the transaction preset basic requirement type aiming at the events of which the event types belong to the transaction preset basic requirement type; aiming at an event of which the event type belongs to an event preset additional requirement type, storing the event belonging to the event preset additional requirement type into message middleware;
the first function subsystem encapsulates a first execution strategy of an event and is used for processing the event through the encapsulated first execution strategy after receiving the call of the scheduling server;
the second function subsystem is encapsulated with a second execution strategy of the event and used for acquiring the event from the message middleware and processing the acquired event through the second execution strategy;
and the scheduling main system determines processing results corresponding to a plurality of events according to the processing results sent by the first functional subsystem and/or the second functional subsystem, and sends the processing results to the client.
To achieve the above object, according to a fifth aspect of the embodiments of the present invention, there is provided an apparatus for processing data of a power line provider.
The equipment for processing and setting the e-commerce data comprises: one or more processors; a storage system for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the method for e-commerce data processing of the embodiment of the present invention.
To achieve the above object, according to a sixth aspect of embodiments of the present invention, there is provided a computer-readable medium.
The computer readable medium of the embodiment of the present invention stores thereon a computer program, which when executed by a processor implements the method of the embodiment of the present invention for e-commerce data processing.
One embodiment of the above invention has the following advantages or benefits: in the embodiment of the invention, one or more events are generated according to a store opening request, the event type of each event is determined, and different processing is subsequently carried out on the events of different event types, namely if the event type belongs to the transaction preset basic requirement type, a first execution strategy corresponding to the event is called through a main program, so that the first execution strategy processes the event; if the event type belongs to the transaction preset additional requirement type, storing the event into a preset message middleware through a main program to trigger a second execution strategy processing event corresponding to the event, so as to realize the decoupling of the execution methods of different event types, thereby carrying out the decoupling processing on the events of different types, and in addition, realizing the asynchronous processing of the execution methods of different event types because the event processing processes of different event types are different.
Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
fig. 1 is a schematic diagram of a main flow of an e-commerce data processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of the main flow of the present invention for a plurality of first events belonging to a transaction preset basic requirement type;
FIG. 3 is a schematic diagram of a main flow of the embodiment of the present invention after storing the event in the preset message middleware through the main program;
FIG. 4 is a schematic diagram of a main flow of updating an execution state of a functional subsystem according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a main flow of a method for processing data of a new power provider according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of the major modules of an e-commerce data processing system of an embodiment of the present invention;
FIG. 7 is a schematic diagram of the overall scheduling of an e-commerce data processing system according to an embodiment of the present invention;
FIG. 8 is a schematic diagram illustrating overall scheduling of a specific e-commerce data processing system according to an embodiment of the present invention;
FIG. 9 is an exemplary system architecture diagram in which embodiments of the present invention may be employed;
fig. 10 is a schematic diagram of a computer system suitable for use in implementing a terminal device or server according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
In the e-commerce field, a series of processing is usually required to be performed on e-commerce data to obtain a specific processing result, such as opening a network account number, opening a credit card, registering a member, and opening a store online, and the e-commerce data processing method and apparatus of the present invention are specifically described in an online store opening scene.
In a general online store opening scenario, a series of store opening steps are often required to be completed one by one to finally complete store opening, for example, store display page configuration, commodity configuration to be displayed, common functions of a store and the like are configured, according to the sequence of the function configuration, configuration information needs to be sequentially called from other subsystems or functions are sequentially configured through other subsystems, only after one function configuration is completed, the configuration of the next function can be performed, that is, the function configurations are strongly coupled, and once a certain link in the middle is wrong, the whole store opening action cannot be completed smoothly. In order to solve the problem, embodiments of the present invention provide a method, an apparatus, and a system for opening e-commerce data processing, which can decouple execution methods of different event types and asynchronously process store opening events of different event types.
Fig. 1 is a schematic main flow chart illustrating a method for processing e-commerce data according to an embodiment of the present invention. As shown in fig. 1, the method may include the steps of:
step S101: receiving a transaction request aiming at E-commerce data sent by a client, and generating one or more events for the transaction request;
step S102: determining the event type of each event, if the event type belongs to an event preset basic requirement type, executing a step S103, and if the event type belongs to an event preset additional requirement type, executing a step S104;
step S103: calling a first execution strategy corresponding to the event type through the main program so as to process the event through the first execution strategy, and executing step S105;
step S104: storing the event to a preset message middleware through a main program so as to trigger a second execution strategy processing event corresponding to the event;
step S105: and determining a processing result corresponding to one or more events, and sending the processing result to the client.
In the embodiment shown in fig. 1, the transaction request is a store opening request, the generated event is a store opening event, different processing is subsequently performed on the store opening events of different event types by determining the event type to which each store opening event belongs, that is, if the event type belongs to an event preset basic requirement type, a first execution policy corresponding to the store opening event is called through a main program, so that the first execution policy processes the store opening event; if the event type belongs to the transaction preset additional requirement type, the store opening event is stored in the preset message middleware through the main program to trigger a second execution strategy corresponding to the store opening event to process the store opening event, decoupling of execution methods of different event types is achieved, decoupling processing is conducted on the store opening events of different types, and in addition, due to the fact that the store opening event processing processes of different event types are different, asynchronous processing of the store opening events of different event types is achieved through the execution methods of different event types.
The event types include, but are not limited to, a transaction preset basic requirement type and a transaction preset additional requirement type, and event division can be performed according to different classifications of actual needs. In the embodiment of the application, the basic requirement type of the business is preset, so that the steps which are required to be executed in sequence to ensure that the store can be smoothly opened are performed, for example, a store ID and a configured commodity are created, if no store ID exists, all subsequent opening operations cannot be performed, and if no commodity is configured in the store, an invalid store is generated, so that the resource waste is caused. Therefore, the creation of the shop ID and the configuration of the commodity are both transaction preset basic requirement types, and the creation of the shop ID must be performed before the configuration of the commodity. The business preset additional requirement type is a step which can be completed synchronously in the store opening process or completed in a subsequent supplement manner, for example, a common function of the store is configured, a part of the common function is lacked, the normal operation of the store is not influenced, and the common function can be added in the subsequent operation process of the store according to actual needs, so that the common function of the store is configured to belong to the business preset additional requirement type.
Further, the message middleware related to step S104 is a container for storing the store opening event belonging to the transaction preset additional requirement type, and in an alternative embodiment, the store opening event belonging to the transaction preset additional requirement type is stored in the message middleware in the form of a message queue, where the message queue is Microsoft' S message processing technology, and provides message processing and message queue functions for any application program in any computer combination installed with Microsoft Windows, no matter whether the computers are on the same network or are on-line at the same time. The store opening events belonging to the type of the business preset additional requirement can be decoupled and asynchronous through the arrangement of the message queue, the execution of the store opening events is not interfered with each other, and the completion of other store opening events is not influenced even if some store opening events are not executed on time under the abnormal condition.
The first execution policy generally refers to a program called by a main program and used for processing an opening event of a transaction preset basic requirement type, and the program can be executed by a server where the main program is located, or can be executed by other servers (servers except the server where the main program is located). The second execution policy generally refers to a program that receives a store opening event trigger stored in the message middleware and processes the store opening event stored in the message middleware, and the program and the main program generally belong to different servers.
With respect to step S102, in an alternative embodiment, the event type to which each store opening event belongs may be determined by adding annotation configuration. The method comprises the steps of setting corresponding annotation items for each store opening event through an @ EventListener class in the spring annotation, and setting corresponding operation for each annotation item, wherein the operation comprises calling a first execution strategy or storing the store opening event to message middleware. When the type of the event to which each store opening event belongs is determined, the annotation item corresponding to each store opening event needs to be determined, and then the operation corresponding to the current annotation item can be obtained.
For step S103, when there are multiple store opening events, presetting multiple first events belonging to the basic requirement type for the transaction, in an optional embodiment, as shown in fig. 2, including:
step S201: determining an execution order of a plurality of first events;
step S202: and calling a first execution strategy corresponding to each first event in sequence according to the execution sequence.
Since the store opening events belonging to the business preset basic requirement type are steps which must be executed in sequence, the execution sequence of the first store opening events is required to be determined in advance. For example, the creation of the shop ID must be performed before the product is configured, and the first execution policy corresponding to the configured product needs to be performed after the creation of the first execution policy corresponding to the shop ID is completed. In an alternative embodiment, the execution Order may be configured by the @ Order class note in the spring note.
For step S104, when there are multiple events, for multiple second events belonging to the transaction preset additional requirement type, in an optional embodiment, further comprising: and providing a plurality of second events stored in the message middleware to a second execution strategy corresponding to each second event through multithreading.
Illustratively, three second store opening events exist in the message middleware, and can be processed synchronously through three different threads, and the processing procedures of the three second store opening events are not mutually interfered.
The application program adopting the multithreading technology can better utilize system resources. The method has the main advantages that the idle time slices of the CPU are fully utilized, and the time as less as possible is used for responding to the requirements of the user, so that the overall running efficiency of the process is greatly improved, and the flexibility of the application program is enhanced. Because all threads of the same process share the same memory, a special data transmission mechanism is not needed, and a shared storage area or a shared file is not needed to be established, so that the problems of coordination operation and operation, data interaction, resource allocation and the like among different tasks are easier to solve. In a further alternative embodiment, an asynchronous annotation may be added to the plurality of second store events, and the second store events that need to be executed asynchronously by threads are annotated with annotation items of the asynchronous annotation, so as to implement asynchronous operations.
In the asynchronous operation, the self-exception condition may occur, but since the whole store opening process is not affected, the store opening event in the message middleware needs to be monitored so as to process the self-exception condition in real time.
In an alternative embodiment, as shown in fig. 3, after storing the event to the preset message middleware through the main program, the method further includes: for the case of event processing exception in the message middleware, executing:
step S301: storing the abnormal information corresponding to the abnormal condition into a first abnormal record table;
step S302: reading abnormal information at regular time according to a preset time period through a regular reading task, repeatedly executing the abnormal information, and storing a compensation state into a first abnormal recording table according to an execution result;
step S303: and confirming whether the second execution strategy is normal or not according to the compensation times and the compensation state in the first abnormal record table.
The first anomaly recording table may record a plurality of anomaly information corresponding to the anomaly of the store-opening event, and as shown in table 1, the anomaly information may include a primary key ID, a service parameter, a service method, anomaly content, a compensation state, a compensation frequency, and the like. When an abnormal condition is encountered, the abnormal information corresponding to the abnormal condition needs to be stored in the first abnormal record table.
TABLE 1 first anomaly record Table
Figure BDA0003578804850000131
In step S302, by a timing reading task, the abnormal information whose compensation status is a compensation failure is sequentially read from the first abnormal record table, and the business method corresponding to the abnormal information is repeatedly executed. For the abnormal information of which the compensation state is successful, the abnormal information is considered to be sudden abnormality possibly caused by objective reasons such as network reasons, and the compensation can be successful after the network recovers to the normal state. However, if the abnormal situation is caused by the second execution strategy, the compensation is not successful after one or more times of repeated execution. Therefore, in an alternative embodiment, it is possible to determine whether the abnormal condition caused by the second execution strategy is caused by setting a threshold value of the compensation times. For example, when the threshold value of the number of compensations is set to 5 times, that is, the number of repeated executions is within 5 times, it is considered as a sudden abnormality, and the final compensation is successful by the multiple compensations. When the number of times of repeated execution is 10, it is considered that the current abnormal condition cannot be compensated through repeated execution for multiple times, and at this time, it is determined that the second execution strategy corresponding to the current abnormal information is abnormal, and an alarm message may be sent to the processing center to prompt a system error, and manual troubleshooting is required to perform compensation and repair.
In an alternative embodiment, the plurality of first execution strategies and the plurality of second execution strategies may be packaged into independent functional subsystems respectively; and packaging the main program into an independent scheduling main system. The remote calling between the scheduling main system and the function subsystem is realized through an interface with standardized parameters, such as a standard rpc interface or an http interface.
For one or more functional subsystems, if the main system calls the functional subsystems, in an alternative embodiment, an initialization interface configuration table needs to be configured in the scheduling main system according to the one or more functional subsystems; the initialization interface configuration table indicates an execution sequence of one or more functional subsystems, and specific contents in the initialization configuration table are shown in table 2.
Table 2 initial interface configuration table
Figure BDA0003578804850000141
In an alternative embodiment, when a function subsystem or a new execution method belonging to the type of the transaction preset basic requirement needs to be newly added, the newly added function subsystem or the newly added execution method needs to be configured in a relevant position in the initialization interface configuration table, and an execution sequence and system functions are set for the newly added function subsystem or the newly added execution method. The new execution method needs to be encapsulated first and configured in the initialization interface configuration table in the form of a functional subsystem.
Further, for the execution status of each functional subsystem, the execution status of one or more functional subsystems may be recorded in real time, and for the case that the execution status is failure, the following steps are performed:
step S401: storing the abnormal information corresponding to the failure of the execution state into a second abnormal record table;
step S402: and through a timing reading task, reading the abnormal information in the second abnormal record table at a timing according to a preset time period, repeatedly executing the abnormal information, and updating the execution state according to an execution result.
The second abnormal record table may record an opening serial number, an execution procedure, an execution state, and the like, as specifically shown in table 3. According to the second abnormal record table, the execution condition of each functional subsystem can be known, so that the functional subsystem with the execution state of failure can be compensated in time.
TABLE 3 second anomaly record Table
Figure BDA0003578804850000151
In another optional embodiment, when a functional subsystem belonging to the type of the transaction preset additional requirement needs to be newly added or an execution method needs to be newly added, the method further includes the following steps:
step S501: receiving a newly added function subsystem or a newly added execution method;
step S502: and establishing connection between the newly added function subsystem or the newly added execution method and the message middleware so that the newly added function subsystem or the newly added execution method acquires corresponding events through the message middleware.
Through the steps, when one new service processing step is needed in the store system store opening process, the new functional subsystem can be added as a novice guide system, and only a method for monitoring the novice guide store opening event needs to be added in a novice guide service interface to perform self service processing without changing the main process. Meanwhile, when a new store opening process for opening different services is added, an opening event is generated for the initialization of the same store setting, common functions and the like, and the related initialization method does not need to be called in the self process, so that the decoupling is completed.
According to the method for processing the e-commerce data, one or more events are generated according to the transaction request aiming at the e-commerce data, and different events are respectively processed according to the event types, so that the purpose of decoupling different types of events is achieved. Specifically, different execution strategies are called for different events belonging to the transaction preset basic requirement type and the transaction preset additional requirement type, so as to realize asynchronous processing of the events according to execution methods of different event types.
According to a second aspect of the embodiments of the present invention, an apparatus for e-commerce data processing applied to a server is provided.
Fig. 6 is a schematic diagram of main modules of an apparatus 600 for e-commerce data processing according to a second aspect of the embodiment of the present invention. As shown in fig. 6, includes:
the receiving module 601 is configured to receive a transaction request for e-commerce data sent by a client, and generate one or more events for the transaction request;
a determining module 602, configured to determine an event type to which each event belongs; if the event type belongs to the transaction preset basic requirement type, calling a first execution strategy corresponding to the event through the main program so as to process the event through the first execution strategy; if the event type belongs to an event preset additional requirement type, storing the event into a preset message middleware through a main program so as to trigger a second execution strategy processing event corresponding to the event;
the processing module 603 is configured to determine a processing result corresponding to one or more events, and send the processing result to the client.
In an optional embodiment of the present invention, the determining module 602 is further configured to, in the event that the plurality of events includes a plurality of first events belonging to the transaction preset basic requirement type: determining an execution order of a plurality of the first events; and calling a first execution strategy corresponding to each first event in sequence according to the execution sequence.
In an optional embodiment of the present invention, the determining module 602 is further configured to, in the event that the transaction is a multiple of the event, for a second event that belongs to the preset additional requirement type of the transaction: and providing a plurality of second events stored in the message middleware to a second execution strategy corresponding to each second event through multithreading.
In an optional embodiment of the present invention, the apparatus further includes an annotation module, configured to set a corresponding annotation item for each event through a listening event class in an annotation configuration, and set a corresponding operation for each annotation item, where the operation includes invoking the first execution policy or storing the event in the message middleware;
the determining module is further configured to determine an annotation item corresponding to each of the events.
In an alternative embodiment of the present invention, the annotation module is further configured to configure the execution order through an order class annotation in the annotation configuration.
In an optional embodiment of the present invention, the apparatus further includes an exception handling module, configured to, after the event is stored in a preset message middleware through the main program, perform, for an event handling exception in the message middleware,:
storing the abnormal information corresponding to the abnormal condition into a first abnormal record table; reading abnormal information at regular time according to a preset time period through a regular reading task, repeatedly executing the abnormal information, and storing a compensation state into the first abnormal record table according to an execution result; and confirming whether the second execution strategy is normal or not according to the compensation times and the compensation state in the first abnormal record table.
In an optional embodiment of the present invention, a plurality of the first execution policies and a plurality of the second execution policies are respectively encapsulated into independent functional subsystems; the main program is packaged into an independent scheduling main system; and remote calling is realized between the dispatching main system and the function subsystem through a standard rpc interface.
In an alternative embodiment of the present invention, the apparatus further comprises: the configuration module is used for configuring an initialization interface configuration table in the scheduling main system according to one or more functional subsystems; wherein an execution order of the one or more functional subsystems is indicated in the initialization interface configuration table.
In an optional embodiment of the invention, the apparatus further comprises: the adding module is used for receiving the newly added function subsystem or the newly added execution method; and constructing the connection between the newly added function subsystem or the newly added execution method and the message middleware so that the newly added function subsystem or the newly added execution method obtains the corresponding event through the message middleware.
In an optional embodiment of the present invention, the determining module is further configured to record, in real time, an execution state of the one or more functional subsystems; for the case that the execution state is failure, executing: storing the abnormal information corresponding to the failure of the execution state into a second abnormal record table; and through a timing reading task, reading the abnormal information in the second abnormal record table at a timing according to a preset time period, repeatedly executing the abnormal information, and updating the execution state according to an execution result.
In addition, an embodiment of the present invention further provides an e-commerce data processing system (not shown in the drawings), where the e-commerce data processing system (not shown in the drawings) may include: the client and the device for processing the e-commerce data provided by the above embodiment, wherein,
the client sends a request to the device for processing the e-commerce data;
and the E-commerce data processing device responds to the request, processes an event corresponding to the request and sends the processing result to the client.
As shown in fig. 7, an embodiment of the present invention provides another system 700 for data processing of an e-commerce, where the system 700 for data processing of an e-commerce includes: a client, a scheduling main system, a plurality of first functional subsystems and a plurality of second functional subsystems, wherein,
the client sends a transaction request to the scheduling main system;
the scheduling main system responds to the transaction request to generate one or more events, determines event types of the one or more events, and calls a first function server matched with the events belonging to the transaction preset basic requirement type aiming at the events of which the event types belong to the transaction preset basic requirement type; aiming at an event of which the event type belongs to an event preset additional requirement type, storing the event belonging to the event preset additional requirement type into message middleware;
the first function subsystem encapsulates a first execution strategy of an event and is used for processing the event through the encapsulated first execution strategy after receiving the call of the scheduling server;
the second function subsystem is encapsulated with a second execution strategy of the event and used for acquiring the event from the message middleware and processing the acquired event through the second execution strategy;
and the scheduling main system determines processing results corresponding to a plurality of events according to the processing results sent by the first functional subsystem and/or the second functional subsystem, and sends the processing results to the client.
The scheduling diagram of the above system is described as a specific example. As shown in fig. 8, the main system directly calls the functional subsystems for the pair with the store opening event belonging to the type of the preset basic requirement of the transaction: the system comprises an account system, a commodity system and a shop system, and is executed according to a preset sequence through corresponding first execution strategies. And storing the store opening event belonging to the type of the business preset additional requirement into the message middleware, and pulling the store opening event of the message middleware by functional subsystems such as a common function subsystem, a novice guide subsystem and the like to execute a corresponding second execution strategy.
Fig. 9 shows an exemplary system architecture 800 of a method or an apparatus for electronic commerce data processing to which the method for electronic commerce data processing according to the embodiment of the present invention may be applied.
As shown in fig. 9, the system architecture 900 may include terminal devices 901, 902, 903, a network 904, a scheduling server 905, a first function server 906, and a second function server 907. The network 904 is used to provide a medium for communication links between the terminal devices 901, 902, 903 and the scheduling server 905, between the scheduling server 905 and the first function server 906, and between the scheduling server 905 and the second function server 907. Network 904 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
The user can use the terminal devices 901, 902, 903 to interact with the scheduling server 905 through the network 904 to transmit a request for opening a store or receive a result of the scheduling server 905 processing the opening of the store, or the like. The terminal devices 901, 902, 903 may have various communication client applications installed thereon, such as an online service application, a web browser application, a search application, an instant messaging tool, a mailbox client, social platform software, and the like.
The terminal devices 901, 902, 903 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The server 905 may be a server that provides various services, such as a background management server that provides support for transaction requests for e-commerce data sent by users using the terminal devices 901, 902, 903, or a server that schedules tasks. The background management server may analyze and process the received data such as the task execution request, and feed back a processing result (for example, a transaction page) to the terminal device.
It should be noted that, in the method for processing e-commerce data provided by the first aspect of the embodiment of the present invention, the scheduling server 905 generally allocates events to the first function server 906 and the second function server 907, and the first function server 906 and the second function server 907 process the events, and accordingly, the apparatus for processing e-commerce data provided by the second aspect of the embodiment of the present invention is generally disposed in the scheduling server 905.
It should be understood that the number of terminal devices, networks, and servers in fig. 9 is merely illustrative. There may be any number of terminal devices, networks, dispatch servers, first function servers, and second function servers, as desired for implementation.
Referring now to FIG. 10, a block diagram of a computer system 1000 suitable for use with a terminal device implementing an embodiment of the invention is shown. The terminal device shown in fig. 10 is only an example, and should not bring any limitation to the functions and the use range of the embodiment of the present invention.
As shown in fig. 10, the computer system 1000 includes a Central Processing Unit (CPU)1001 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)1002 or a program loaded from a storage section 1008 into a Random Access Memory (RAM) 1003. In the RAM 1003, various programs and data necessary for the operation of the system 1000 are also stored. The CPU 701, ROM 1002, and RAM 1003 are connected to each other by a bus 1004. An input/output (I/O) interface 1005 is also connected to bus 1004.
The following components are connected to the I/O interface 1005: an input section 1006 including a keyboard, a mouse, and the like; an output section 1005 including a display device such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage portion 1008 including a hard disk and the like; and a communication section 1009 including a network interface card such as a LAN card, a modem, or the like. The communication section 1009 performs communication processing via a network such as the internet. The driver 1010 is also connected to the I/O interface 1005 as necessary. A removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 1010 as necessary, so that a computer program read out therefrom is mounted into the storage section 1008 as necessary.
In particular, according to embodiments of the present disclosure, the processes described above with reference to the flow diagrams may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 909, and/or installed from the removable medium 1011. The computer program performs the above-described functions defined in the system of the present invention when executed by a Central Processing Unit (CPU) 1001.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present invention may be implemented by software or hardware. The described modules may also be provided in a processor, which may be described as: a processor includes a receiving module, a determining module, and a processing module. The names of the modules do not constitute a limitation to the modules themselves in some cases, for example, the receiving module may also be described as a "module for receiving a transaction request for e-commerce data sent by a client".
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be separate and not incorporated into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to comprise:
receiving a transaction request aiming at E-commerce data sent by a client, and generating one or more events for the transaction request;
determining the event type of each event; if the event type belongs to the transaction preset basic requirement type, calling a first execution strategy corresponding to the event type through the main program so as to process the event through the first execution strategy; if the event type belongs to the transaction preset additional requirement type, storing the event into a preset message middleware through a main program so as to trigger a second execution strategy processing event corresponding to the event;
and determining a processing result corresponding to one or more events, and sending the processing result to the client.
In the method and the device for processing the e-commerce data, one or more events are generated according to the transaction request, the event type of each event is determined, and different processing is subsequently performed on the events of different event types, namely if the event type belongs to the transaction preset basic requirement type, a first execution strategy corresponding to the event is called through a main program to enable the first execution strategy to process the event; if the event type belongs to the transaction preset additional requirement type, storing the event into a preset message middleware through a main program to trigger a second execution strategy processing event corresponding to the event, so as to realize the decoupling of the execution methods of different event types, thereby carrying out the decoupling processing on the events of different types, and in addition, realizing the asynchronous processing of the execution methods of different event types because the event processing processes of different event types are different.
The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (15)

1. An e-commerce data processing method, comprising:
receiving a transaction request aiming at E-commerce data sent by a client, and generating one or more events for the transaction request;
determining an event type to which each of the events belongs;
if the event type belongs to a transaction preset basic requirement type, calling a first execution strategy corresponding to the event through a main program so as to process the event through the first execution strategy;
if the event type belongs to an event preset additional requirement type, storing the event into a preset message middleware through a main program so as to trigger a second execution strategy corresponding to the event to process the event;
and determining a processing result corresponding to one or more events, and sending the processing result to the client.
2. The method of claim 1, wherein the invoking of the first execution policy corresponding to the event by the main program includes:
in the plurality of events, for a plurality of first events belonging to the preset basic requirement type of the transaction, executing:
determining an execution order of a plurality of the first events;
and calling a first execution strategy corresponding to each first event in sequence according to the execution sequence.
3. The method of claim 1,
in a plurality of the events, for a plurality of second events belonging to the transaction preset additional requirement type, performing:
and providing a plurality of second events stored in the message middleware to a second execution strategy corresponding to each second event through multithreading.
4. The method of claim 1, further comprising:
setting a corresponding annotation item for each event through monitoring event class annotation in annotation configuration, and setting a corresponding operation for each annotation item, wherein the operation comprises calling the first execution strategy or storing the event to the message middleware;
the determining the event type to which each event belongs comprises:
and determining the annotation item corresponding to each event.
5. The method of claim 4, further comprising: the execution order is configured by an order class annotation in an annotation configuration.
6. The method according to claim 1, wherein after storing the event to a preset message middleware through a main program, the method further comprises:
for the case of event processing exception in the message middleware, executing:
storing the abnormal information corresponding to the abnormal condition into a first abnormal record table;
reading abnormal information at regular time according to a preset time period through a regular reading task, repeatedly executing the abnormal information, and storing a compensation state into the first abnormal record table according to an execution result;
and confirming whether the second execution strategy is normal or not according to the compensation times and the compensation state in the first abnormal record table.
7. The method of claim 1,
the first execution strategies and the second execution strategies are packaged into independent functional subsystems respectively;
the main program is packaged into an independent scheduling main system;
and the dispatching main system and the function subsystem realize remote calling through a standard rpc interface.
8. The method of claim 7, further comprising:
configuring an initialization interface configuration table in the scheduling main system according to one or more functional subsystems;
wherein an execution order of the one or more functional subsystems is indicated in the initialization interface configuration table.
9. The method of claim 7, further comprising:
receiving a newly added function subsystem or a newly added execution method;
and constructing the connection between the newly added function subsystem or the newly added execution method and the message middleware so that the newly added function subsystem or the newly added execution method obtains the corresponding event through the message middleware.
10. The method of claim 8, further comprising:
recording the execution state of the one or more functional subsystems in real time;
for the case that the execution state is failure, executing:
storing the abnormal information corresponding to the failure of the execution state into a second abnormal record table;
and through a timing reading task, reading the abnormal information in the second abnormal record table at a timing according to a preset time period, repeatedly executing the abnormal information, and updating the execution state according to an execution result.
11. An apparatus for electronic commerce data processing, comprising:
the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving a transaction request aiming at E-commerce data sent by a client and generating one or more events for the request;
the determining module is used for determining the event type of each event;
if the event type belongs to a transaction preset basic requirement type, calling a first execution strategy corresponding to the event type through a main program so as to process the event through the first execution strategy;
if the event type belongs to an event preset additional requirement type, storing the event into a preset message middleware through a main program so as to trigger a second execution strategy corresponding to the event to process the event;
and the processing module is used for determining a processing result corresponding to one or more events and sending the processing result to the client.
12. An e-commerce data processing system, comprising: the client and the device for electronic commerce data processing of claim 11,
the client sends a transaction request to the device for processing the e-commerce data;
and the e-commerce data processing device responds to the transaction request, processes an event corresponding to the transaction request and sends the processing result to the client.
13. An e-commerce data processing system, comprising: a client, a scheduling main system, a plurality of first functional subsystems and a plurality of second functional subsystems, wherein,
the client sends a transaction request to the scheduling main system;
the scheduling main system responds to the transaction request to generate one or more events, determines event types of the one or more events, and calls a first function subsystem matched with the events belonging to the transaction preset basic requirement type aiming at the events of which the event types belong to the transaction preset basic requirement type; aiming at an event of which the event type belongs to an event preset additional requirement type, storing the event belonging to the event preset additional requirement type into message middleware;
the first function subsystem encapsulates a first execution strategy of an event and is used for processing the event through the encapsulated first execution strategy after receiving the call of the scheduling server;
the second function subsystem is encapsulated with a second execution strategy of the event and used for acquiring the event from the message middleware and processing the acquired event through the second execution strategy;
and the scheduling main system determines processing results corresponding to a plurality of events according to the processing results sent by the first functional subsystem and/or the second functional subsystem, and sends the processing results to the client.
14. An apparatus for electronic commerce data processing, comprising: one or more processors;
a storage system for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-10.
15. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-10.
CN202210349366.4A 2022-04-01 2022-04-01 E-commerce data processing method, device and system Pending CN114691394A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210349366.4A CN114691394A (en) 2022-04-01 2022-04-01 E-commerce data processing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210349366.4A CN114691394A (en) 2022-04-01 2022-04-01 E-commerce data processing method, device and system

Publications (1)

Publication Number Publication Date
CN114691394A true CN114691394A (en) 2022-07-01

Family

ID=82141815

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210349366.4A Pending CN114691394A (en) 2022-04-01 2022-04-01 E-commerce data processing method, device and system

Country Status (1)

Country Link
CN (1) CN114691394A (en)

Similar Documents

Publication Publication Date Title
CN107729139B (en) Method and device for concurrently acquiring resources
CN110245011A (en) A kind of method for scheduling task and device
CN109873863B (en) Asynchronous calling method and device of service
CN104579905A (en) Message passing method and system, MOM (message oriented middleware) server and receiving terminal
CN112288577B (en) Transaction processing method, device, electronic equipment and medium for distributed service
CN111767127A (en) Service data processing method and device
CN112445860B (en) Method and device for processing distributed transaction
CN113760522A (en) Task processing method and device
CN110807058B (en) Method and system for exporting data
CN114691394A (en) E-commerce data processing method, device and system
CN109688174A (en) A kind of virtual service implementation method and device based on more agents service
CN113778631A (en) Distributed transaction compensation method and device, electronic equipment and readable storage medium
CN114449040A (en) Configuration issuing method and device based on cloud platform
CN113157461A (en) Method and device for transmitting message in process of executing task list
CN112925623A (en) Task processing method and device, electronic equipment and medium
CN110888770B (en) Method and device for transmitting information
CN112463616A (en) Chaos testing method and device for Kubernetes container platform
CN113157405A (en) Method and device for retrying breakpoint of business process
CN111008202A (en) Distributed transaction processing method and framework
CN113766437B (en) Short message sending method and device
CN110262756B (en) Method and device for caching data
CN110011767B (en) Method and apparatus for TCP connection backup
CN113535421A (en) Service message processing method and device
CN116166404A (en) Task processing method and device
CN113947434A (en) Business processing method and device for multi-business component combination scene

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination