WO2021088641A1 - 数据发送方法、处理方法、接收方法及其设备、存储介质 - Google Patents
数据发送方法、处理方法、接收方法及其设备、存储介质 Download PDFInfo
- Publication number
- WO2021088641A1 WO2021088641A1 PCT/CN2020/122254 CN2020122254W WO2021088641A1 WO 2021088641 A1 WO2021088641 A1 WO 2021088641A1 CN 2020122254 W CN2020122254 W CN 2020122254W WO 2021088641 A1 WO2021088641 A1 WO 2021088641A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- task
- data
- message
- end device
- request message
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 84
- 238000003672 processing method Methods 0.000 title claims abstract description 43
- 230000005540 biological transmission Effects 0.000 title claims abstract description 12
- 238000012545 processing Methods 0.000 claims abstract description 57
- 230000006854 communication Effects 0.000 claims description 17
- 239000000284 extract Substances 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 15
- 238000004891 communication Methods 0.000 claims description 14
- 238000013075 data extraction Methods 0.000 claims description 10
- 238000012544 monitoring process Methods 0.000 claims 1
- 230000007246 mechanism Effects 0.000 description 20
- 230000008569 process Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 12
- 238000013507 mapping Methods 0.000 description 11
- 239000003795 chemical substances by application Substances 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- 230000000007 visual effect Effects 0.000 description 10
- 230000003993 interaction Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 238000012423 maintenance Methods 0.000 description 5
- 238000007726 management method Methods 0.000 description 5
- 238000013500 data storage Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 2
- 238000013523 data management Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 2
- 229910052737 gold Inorganic materials 0.000 description 2
- 239000010931 gold Substances 0.000 description 2
- 238000011068 loading method Methods 0.000 description 2
- 238000003032 molecular docking Methods 0.000 description 2
- 229910052709 silver Inorganic materials 0.000 description 2
- 239000004332 silver Substances 0.000 description 2
- 101100272279 Beauveria bassiana Beas gene Proteins 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012384 transportation and delivery Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/566—Grouping or aggregating service requests, e.g. for unified processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/562—Brokering proxy services
Definitions
- the embodiments of the present application relate to, but are not limited to, the field of information management technology, and in particular to a data sending method, processing method, terminal device, front-end device, data exchange center and receiving method thereof, and computer-readable storage medium.
- tasks are usually scheduled manually or by setting execution strategies. Tasks are started at a fixed time according to a set script, but When the task is completed and the execution result cannot be notified to the third-party business system in time, it can only be checked manually through operation and maintenance on a regular basis, and cannot be effectively combined with the actual business.
- an embodiment of the present application provides a data sending method applied to a terminal device, including: acquiring task data, sending the task data to a first front-end device; and sending the task data to a first front-end device of the first front-end device.
- a message middleware sends a task request message, and the task request message includes a task identifier associated with the task data.
- an embodiment of the present application provides a data processing method applied to a front-end device, including: receiving task data from a first terminal device; receiving a task request message from the first terminal device, the task request message It includes a task identifier, the task identifier is associated with the task data; the task request message is sent to the data exchange center; the data extraction request from the data exchange center is received, and the task data is sent to the data exchange center.
- an embodiment of the present application also provides a data processing method, applied to a data exchange center, including: receiving a task request message from a first front-end device, the task request message including a task identifier; according to the task The request message triggers a data processing task, extracts task data associated with the task identifier in the first intermediate library of the first front-end device, and writes the extracted task data into the second intermediate library of the second front-end device.
- an embodiment of the present application also provides a data processing method applied to a front-end device, including: receiving task data from a data switching center; receiving a task notification message from the data switching center, where the task notification message includes Task identifier, the task identifier is associated with the task data; the task notification message is sent to the second terminal device; the data extraction request from the second terminal device is received, and the task data is sent to the second terminal equipment.
- the present application also provides a data receiving method applied to a terminal device, including: receiving a task notification message from a second front-end device, the task notification message including a task identifier; according to the task notification message, Extract the task data associated with the task identifier in the second intermediate library of the second front-end device.
- the present application also provides a terminal device, including: a memory, a processor, and a computer program stored in the memory and capable of running on the processor.
- a terminal device including: a memory, a processor, and a computer program stored in the memory and capable of running on the processor.
- the processor executes the computer program, the implementation is as described in this application.
- the present application also provides a front-end device, including: a memory, a processor, and a computer program stored in the memory and capable of running on the processor.
- a front-end device including: a memory, a processor, and a computer program stored in the memory and capable of running on the processor.
- the processor executes the computer program
- the computer program Apply for the data processing method described in the embodiment of the second aspect, or implement the data processing method described in the embodiment of the fourth aspect of this application.
- the present application also provides a data exchange center, including: a memory, a processor, and a computer program stored in the memory and running on the processor.
- the processor implements the application when the computer program is executed.
- this application also provides a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are used to execute the data sending method described in the embodiment of the first aspect, or to execute The data processing method described in the embodiment of the second aspect is used to execute the data processing method described in the embodiment of the third aspect or the data processing method described in the embodiment of the fourth aspect is used to execute the data processing method described in the embodiment of the fourth aspect. Perform the data receiving method described in the embodiment of the fifth aspect.
- Figure 1 is a system schematic diagram of an existing ETL system
- Figure 2 is a system schematic diagram of a data management system provided by an embodiment of the present application.
- FIG. 3 is a method flowchart of a first embodiment of a data sending method for a first terminal device according to an embodiment of the present application
- FIG. 4 is a method flowchart of a first embodiment of a data processing method for a first front-end device according to an embodiment of the present application
- FIG. 5 is a method flowchart of a first embodiment of a data processing method of a data exchange center provided by an embodiment of the present application
- FIG. 6 is a flowchart of an implementation manner of step 301 in FIG. 5;
- FIG. 7 is a flowchart of another implementation manner of step 301 in FIG. 5;
- FIG. 8 is a method flowchart of a second embodiment of a data processing method for a data exchange center according to an embodiment of the present application
- FIG. 9 is a method flowchart of the first embodiment of the data processing method of the second front-end device provided by an embodiment of the present application
- FIG. 10 is a method flowchart of a first embodiment of a data receiving method for a first terminal device according to an embodiment of the present application
- FIG. 11 is a flowchart of an implementation manner of step 501 in FIG. 10;
- FIG. 12 is a flowchart of another implementation manner of step 501 in FIG. 10;
- FIG. 13 is a structural block diagram of a terminal device according to an embodiment of the present application.
- FIG. 14 is a structural block diagram of a front-end device according to an embodiment of the present application.
- FIG. 15 is a structural block diagram of a data exchange center according to an embodiment of the present application.
- FIG. 16 is a visual interface diagram of a Jms message interface configuration according to an embodiment of the present application.
- FIG. 17 is a visual configuration interface diagram of Jms message service configuration according to an embodiment of the present application.
- FIG. 18 is a visual configuration interface diagram of Kafka message service configuration according to an embodiment of the present application.
- FIG. 19 is a visual configuration interface diagram of ETL task mapping according to an embodiment of the present application.
- FIG. 20 is a diagram of a service-driven management interface according to an embodiment of the present application.
- ETL Extract-Transform-Load
- Figure 1 is an existing ETL system. Structure, the user extracts the required data from distributed and heterogeneous data sources, transforms or cleans the extracted data according to the pre-designed rules, and finally uses the pre-defined data warehouse model to convert the processed data Load it into the data warehouse.
- different heterogeneous data sources do not have planned and unified target data.
- the core of ETL is the conversion process. Extraction and loading can be used as the input and output of the conversion.
- ETL task scheduling is mostly performed manually or by setting execution strategies. For example, tasks are started at a fixed time according to a set script, but when the task is completed and the execution result cannot be notified in time to third-party business systems, it can only be performed manually on a regular basis. Check whether the data extraction, conversion, and loading are completed, which cannot be effectively combined with actual business.
- the embodiments of the present application provide a data sending method, processing method, receiving method, terminal equipment, front-end equipment, data exchange center and its computer-readable storage medium, which realizes effective control of data processing tasks and improves The efficiency of data interaction improves the versatility and integration degree of docking different business platforms.
- Figure 2 is a system schematic diagram of a data management system provided by an embodiment of the present application.
- the system may include, but is not limited to, a first terminal device, a first front-end device, a data switching center, and a second front-end device.
- Equipment and second terminal equipment The first terminal device and the second terminal device may be various electronic devices, such as computers, mobile terminals, servers, or other electronic devices with processor and data storage functions, such as external processing modules, distributed devices, and so on.
- the first terminal device and the second terminal device may be on different service platforms.
- the task data of the first terminal device cannot be directly transmitted to the second terminal device.
- the data needs to be extracted, converted, and loaded to the second terminal device through the ETL tool.
- the second terminal device for example, the data exchange center shown in FIG. 2 includes a server of an ETL tool, through which task data can be extracted, converted, and loaded.
- the first front-end device is set between the first terminal device and the data switching center for coordinating the communication process between the first terminal device and the data switching center
- the second front-end device is set between the second terminal device and the data switching center for use To coordinate the communication process between the second terminal device and the data exchange center.
- the first front-end device and the second front-end device may be front-end devices.
- the front-end devices have the function of isolating the host, ensuring that external applications cannot directly access core services, such as banks’ various services. Class external interface (telecommunications agency charging, bank-securities pass).
- the front-end computer provides a bridge between business channels and the host of core services. It generally plays the role of managing and scheduling transactions initiated by business channels, and can reduce the burden of the core background server through the call of the front-end processor.
- the business systems at both ends of the internal and external networks of government and enterprises require data exchange, and front-end computers are arranged in front of their respective business systems to realize data exchange.
- the first front-end device and the second front-end device are equipped with intermediate libraries, such as the first intermediate library of the first device and the second intermediate library of the second device.
- the intermediate library functions as a transfer and storage task data. Function, for security and isolation, ETL tools cannot directly extract task data from each platform, but need to store task data in the first intermediate library, and then extract it by ETL tools. Similarly, ETL tools cannot directly extract task data. To write to the memory or database of the platform, the task data needs to be written to the second intermediate library first, and then the task data is extracted from the intermediate library from the terminal device receiving the data. As shown in Figure 2, the first terminal device, the first intermediate library, the ETL tool, the second intermediate library, and the second terminal device are sequentially connected to establish a transmission channel for task data.
- the message middleware mechanism control is used in the embodiment of this application.
- the process of task data processing such as controlling the execution process of ETL tools.
- the first front-end device is provided with a first message middleware
- the second front-end device is provided with a second message middleware
- the first terminal device and the second terminal device are configured
- a message middleware interface so that the task information can be transmitted through the message middleware mechanism.
- the above-mentioned message middleware includes any form of components that can improve reliable and efficient data transmission services for distributed systems, or other forms of software tools.
- the data exchange center is also provided with a message proxy module, and the ETL tool communicates with the message proxy module through a message proxy interface.
- the message middleware mechanism is suitable for accessing the application program interface (API) of the message system independent of the manufacturer. It provides an interface for applications to create, send, receive and read messages, such as JMS message middleware or Kafka in the Java Message Service Specification
- Message middleware is a commonly used communication mechanism for message middleware.
- the first middleware and the second middleware can be implemented by JMS or Kafka on the Java platform, and can also be message-oriented middleware adapters for non-Java platforms.
- the message middleware communication mechanism includes message producers, consumers and message middleware.
- the producer publishes the message, the message middleware forwards the message from the producer to the consumer, and the consumer receives and processes the message.
- the first terminal device is the producer of the message
- the second terminal device is the consumer of the message
- the data exchange center is the consumer of the first terminal device and the producer of the second terminal device.
- the data exchange center obtains the task request message from the first terminal device through the message middleware, and the data exchange center triggers the data processing task in response to the task request message, and extracts the corresponding data from the first intermediate library of the first front-end device.
- Task data after processing the data, write it to the second intermediate library of the second front-end device to complete the ETL task, and then the data exchange center acts as the message producer and sends the data to the second message middleware of the second front-end device.
- the second terminal device sends a task notification message to notify the second terminal device that the task data can be extracted from the second intermediate library.
- the first terminal device, the first message middleware, the message proxy module, the second message middleware, and the second terminal device are connected in sequence to establish a transmission channel for notification messages.
- the notification messages of the first terminal device, the data exchange center, and the second terminal device are transmitted through the message middleware mechanism, they belong to the asynchronous communication mode.
- the first terminal device sends the task request message to the first terminal device.
- Message middleware has queue and topic modes.
- the queue mode can also be called point-to-point mode, which is generally pulled by consumers actively, and messages can be deleted after confirmation. Even if there are multiple subscribers, the message in the queue can only be consumed by one consumer.
- system A sends a message to the queue, and the message middleware finds that the destination queue pointed to by the queue is actually located in system B. It puts the information in A special local queue-Transmission Queue.
- Establish a message channel from system A to system B the message channel agent will read the message from the transmission queue, and pass this information to system B, and then wait for confirmation. Only after the message middleware receives the confirmation that the system B has successfully received the message, it will actually delete the message from the transmission queue.
- the topic mode is also known as the publish/subscribe mode.
- the publish/subscribe function enables the distribution of messages to break through the geographical direction of the destination queue, and make the messages distributed according to a specific topic or even content. Users or applications can receive all messages according to the topic or content. Message needed.
- the publish/subscribe function makes the coupling relationship between the sender and the receiver looser.
- the sender does not need to care about the destination address of the receiver, and the receiver does not need to care about the sending address of the message, but only according to the subject of the message. Of sending and receiving.
- task data of the first terminal device needs to be sent to the second terminal device. Because the first terminal device and the second terminal device are on different platforms, the data cannot be directly interoperable. , The task data needs to be extracted, converted, and loaded to the second terminal device through the ETL tool.
- the first terminal device, the data exchange center, and the second terminal device are configured with interfaces and/or plug-ins for communicating with the message middleware.
- the first terminal device obtains the task data that needs to be processed and needs to instruct the ETL tool how to process the task data Task content.
- the first terminal device obtains the task identifier, which may be automatically generated by the system or input or configured by the user. For example, keywords may be extracted from the task data to automatically generate the task identifier, or a visual interface may be provided to the user for input or configuration by the user. Configuration.
- the task identifier is associated with task data, that is, the data exchange center can process related task data according to the task identifier.
- the association between the task identifier and the task data can be pre-appointed with the data exchange center and the second terminal device.
- the relationship between the data, or the connection between the task ID and the task data is established by mapping, or the information of the task data can be extracted and associated with the task ID. For example, the database name or the name of the data table of the task data is used as the task ID, then the task ID is automatically established The association of task ID and task data.
- the task identifier can be agreed to be various message types, such as the aforementioned database name or data table name, etc.
- the first terminal device generates a task request message according to the above-mentioned task identifier and the configured message middleware interface information, that is, the task request message includes two parts of content, one part is used to indicate the message sending object, and the other part is used to indicate ETL How the tool performs the task, for example, in one embodiment, the task identifier is used to indicate the processing data object of the ETL tool, which is the name of the data table of the task data, and the task trigger of the ETL tool triggers the extraction of corresponding task data through the task content message.
- the task identifier is used to instruct the ETL tool to process the data object, and also to instruct the ETL tool to perform the corresponding task.
- the data exchange center needs to agree or set the task identifier and the data processing task.
- the first terminal device only needs to send the task identifier to the data exchange center to instruct the ETL tool to execute the specified ETL task.
- the first terminal device first sends the task data to be processed to the first intermediate library of the first front-end device, which can be sent in a serial or parallel manner, and the sending method of the task data is not repeated here.
- the first terminal device sends the task request message to the data interaction center through the first message middleware of the first front-end device. As described above, it can be sent in a queue or topic mode.
- the first terminal device When the topic mode is adopted, the first terminal device needs to set first message topic information.
- the first message topic information includes a first message topic for classifying messages, and the data exchange center needs to subscribe to the first message topic in advance.
- the task request message sent by the first terminal device to the first front-end device includes the first message subject information and the task identifier, when the first message middleware of the first front-end device receives the task request message from the first terminal device , Save the task request message under the first message topic. Since the data exchange center subscribes to the first message topic, the first message middleware will send the task request message to the data exchange center to achieve Sending of task request messages.
- a first terminal device and a second terminal device are given.
- multiple terminal devices can also be set and the front-end devices can be configured accordingly.
- the data exchange center can subscribe to multiple message topics of multiple terminal devices. This embodiment is suitable for data sending tasks to multiple objects. For example, the task content of task request information is to send current task data to multiple third-party platforms.
- the first terminal device needs to set the first queue information, the first queue information includes the first queue name, and the data exchange center needs to subscribe to the first queue name in advance; the first front-end device sends the first queue name to the first queue name.
- the task request message sent by the front-end device includes the first queue information and the task identifier.
- the first message middleware of the first front-end device receives the task request message from the first terminal device, it saves the task request message to Under the first queue name, since the data exchange center has subscribed to the first queue name, the first message middleware will send the task request message to the data exchange center to realize the sending of the task request message.
- the queue mode there is only one consumer, that is, the task request message can only be sent to one data exchange center.
- the data exchange center is provided with a message agent module, which is used to realize the receiving, sending and triggering of data processing tasks of message middleware messages.
- the data exchange center can also provide a visual interface for users to configure, for example, through the platform of the data interaction center to configure the business system configuration middleware notification message interface, configuration task identification and data processing task association mapping.
- the above-mentioned configuration can be performed locally in the data exchange center, or can be configured by remotely accessing the data interaction center, for example, through a visual operation interface provided by a browser or a software program.
- the message broker module realizes the reception of message middleware messages by subscribing to middleware messages.
- the message broker module can adopt topic mode or queue mode to realize message subscription and reception.
- topic mode adopted, the message broker module is set to subscribe to the first message topic.
- the first message middleware receives the task request information including the first message subject message, it will send the task request information to the message agent module.
- queue mode adopted, the message agent module subscribes to the first queue name, and after the first message middleware receives task request information including the first queue name, the task request information is sent to the message agent module.
- the message agent module After the message agent module receives the task request message, it obtains the task ID. Since the data exchange center has established a mapping between the task ID and the data processing task, the task ID can trigger the ETL tool to execute the corresponding data processing task. According to the data processing task mapped by the task identifier, the task data corresponding to the task identifier is obtained from the first intermediate library of the first front-end device, and the task data is processed and then written to the second intermediate library of the second front-end device. Another embodiment is that for platform data interactions with common data formats, the ETL tool may not process the task data, and directly load the task data from the task data in the first intermediate library to the second intermediate library. in.
- the ETL tool After the ETL tool completes the data processing task, it needs to notify the second terminal device to receive the task data. At this time, the ETL tool sends the notification information to the message broker module through the message middleware component. After the message broker module receives the notification information, it sends the notification information to the message broker through the message middleware mechanism.
- the second terminal device sends a task notification message, where the task notification message includes a task identifier associated with the task data.
- the message agent module sends a task notification message to the second middleware of the second front-end device, where the task notification message includes the task identifier associated with the task data, and the second middleware sends the task notification message according to the task notification message.
- the task notification message is sent to the second terminal device.
- the task notification message includes the second message topic information, the second message topic information includes the second message topic, and the second terminal device has subscribed to the second message topic, so the second middleware will The task notification message is sent to the second terminal device.
- the task notification message includes second queue information, the second queue information includes the second queue name, and the second terminal device subscribes to the second queue name, so the second middleware notifies the task The message is sent to the second terminal device.
- the second terminal device When the second terminal device receives the task notification message, it knows that the processed task data has been stored in the second front-end device, and the second terminal device responds to the task notification message from the second intermediate library of the second front-end device. Extract the task data corresponding to the task identifier.
- the active control of ETL tasks is realized through the message middleware mechanism, without manual execution or by setting execution strategies, the processing process of ETL tasks can be controlled according to business needs and execution conditions, which can be effective with business It can be combined with a wide range of applications.
- the message middleware mechanism can realize the decoupling of the platform and the application system, reduce the difficulty of development and maintenance, and has good versatility.
- the terminal device described in the embodiment of the present application may be various electronic devices, such as a computer, a mobile terminal, a server, or Other electronic devices with a processor and data storage function, such as external processing modules, distributed devices, etc., the method includes but not limited to the following steps:
- Step 101 Obtain task data, and send the task data to a first front-end device
- Step 102 Send a task request message to a first message middleware of the first front-end device, where the task request message includes a task identifier associated with the task data.
- the terminal device sends the task data to the first front-end device, it sends a task request message to the first message middleware of the first front-end device for passing through the message middleware of the first message middleware.
- the software mechanism sends the task request message to the data exchange center to trigger or control the execution of the data processing task.
- the task request message includes the task identifier associated with the task data, so the data exchange center can identify the task identifier and execute the data processing task corresponding to the task identifier.
- the task request message containing the task identifier can be sent to the first message middleware to realize the control of the data processing task processing.
- control information of the task is sent using the message middleware mechanism, on the one hand, the control of the data processing task can be realized more conveniently, and it is easy to be combined with the business. On the other hand, it can realize the decoupling of the platform and the application system, reducing the development and The difficulty of maintenance has good versatility.
- the task request message conforms to a message middleware communication specification, such as a JMS message conforming to the JMS specification or a Kafka message conforming to the Kafka specification.
- the message middleware specification includes a topic mode and a queue mode.
- the task request message When the task request message is sent in the topic mode, the task request message includes the first message topic message; when the task request message is sent in the queue mode, the task request message includes the first message.
- the first message subject message or the first queue message is generated by the system according to an agreement or set by the user according to an agreement, for example, it may be input by the user through a visual interface.
- the first terminal device may search for connection factory objects and sending target objects through JNDI (Java Naming and Directory Interface, Java Naming and Directory Service Interface).
- JNDI is a standard Java naming system interface provided by SUN.
- JNDI provides a unified client API.
- the manager maps the JNDI API to a specific naming service and directory system. , So that Java applications can interact with these naming services and directory services.
- JNDI implements high-reliability JNDI.
- JNDI's load balancing and error recovery are ensured.
- an application server in the cluster guarantees the independence of the local JNDI tree and has a global JNDI tree.
- Each application server binds the deployed service object to its own local JNDI tree, and at the same time it binds to a shared global JNDI tree to realize the connection between the global JNDI and its own JNDI.
- a data processing method provided by an embodiment of the present application is applied to a front-end device.
- the front-end device described in the embodiment of the present application refers to an intermediate device used in the field.
- ATM, POS, smart card, UnionPay gold card, telephone banking, bond-yintong, silver tax, instant payment, provident fund management system, electronic remittance and intra-city clearing systems are used in the fields of finance, government and enterprise.
- the front-end processor may be an external hardware device, a hardware device installed in a computer, or a front-end system simulated by a virtual machine, including an intermediate library and message middleware for storing task data.
- the method includes but is not limited to the following steps:
- Step 201 Receive task data from a first terminal device
- Step 202 Receive a task request message from a first terminal device, where the task request message includes a task identifier, and the task identifier is associated with the task data.
- Step 203 Send the task request message to the data exchange center
- Step 204 Receive a data extraction request from the data exchange center, and send the task data to the data exchange center.
- the front-end device is responsible for the transfer of task data and the processing of task request information. After receiving the task data from the first terminal device, the task data is stored in the intermediate library of the front-end device, and the message middleware After receiving the task request message from the first terminal device, determine the sender of the task request message, and send the task request message to the corresponding data exchange center.
- the communication mode of the message middleware includes a topic mode and a queue mode.
- the task request message is a topic mode
- the task request message includes the first message topic information
- the message middleware saves the task request message in the first message topic information Corresponding to the first message topic, and send the task request message to consumers who have subscribed to the first message topic.
- the message middleware if the data exchange center subscribes to the first message topic, the message middleware The task request message will be sent to the data exchange center to realize the sending of the task request message.
- the task request message When the task request message is in the queue mode, the task request message includes the first queue information, the message middleware saves the task request message under the first queue name corresponding to the first queue information, and the message middleware saves the task The request message is sent to the data exchange center corresponding to the name of the first queue to realize the sending of the task request message.
- a data processing method provided by an embodiment of this application is applied to a data exchange center.
- the data exchange center described in this embodiment of the application may be a server, a computer device, a terminal device, or an intermediate device.
- a local server, a local area network server, or a cloud server can be used, or a virtual host that can build a server can be selected.
- the method includes:
- Step 301 Receive a task request message from a first front-end device, where the task request message includes a task identifier;
- Step 302 Trigger a data processing task according to the task request message, extract task data associated with the task identifier in the first intermediate library of the first front-end device, and write the extracted task data to the second front-end device The second intermediate library.
- the data exchange center mainly implements task data processing. Unlike manual or preset execution strategies in some cases, the data exchange center in this embodiment executes the data processing task in response to the task request message. After receiving the task request message from the first front-end device, the data exchange center extracts the corresponding task ID from the task request message, and executes the data processing task corresponding to the task ID, that is, from the first front-end device The task data associated with the task identifier is extracted from the first intermediate library, and the extracted task data is written into the second intermediate library of the second front-end device. For example, after extracting the task data, the task data is processed and then written into the second intermediate library of the second front-end device, so as to adapt to data specifications between different platforms.
- step 301 further includes the following steps:
- Step 3011 monitor the subject information of the first message
- Step 3012 Receive a task request message corresponding to the subject information of the first message from the first front-end device, where the task request message includes a task identifier.
- the data exchange center communicates in the topic mode of the message middleware mechanism.
- the data exchange center subscribes to the first message topic.
- the first front-end device receives the task request message from the first terminal device, and The task request message includes the first message subject information.
- the first front-end device saves the task request message under the first message subject.
- the first front-end device After the data exchange center monitors the first message subject message, the first front-end device will The task request message is sent to the data exchange center.
- step 301 includes the following steps:
- Step 3013 monitor the first queue information
- Step 3014 Receive a task request message corresponding to the first queue information from the first front-end device, where the task request message includes a task identifier.
- the data exchange center communicates in the queue mode of the message middleware.
- the data exchange center monitors the first queue information.
- the first front-end device receives the task request message from the first terminal device, and the task If the request message includes the first queue information, the first front-end device will send the task request message to the data exchange center.
- the data exchange center includes an ETL tool and a message proxy module.
- the ETL tool is responsible for performing data processing tasks
- the message proxy module is responsible for receiving and sending messages that control the data processing.
- the communication interface of the data exchange center needs to be configured.
- the visual interface of the interface of the data exchange center Taking the Jms message as an example, the user chooses to call the Jms notification message interface, and enters the access information of the first front-end device through the visual interface, such as IP address, port Wait.
- the Jms notification message interface needs to be customized according to the requirements of the service platform.
- the Jms interface in the above embodiment and its interface meaning are as follows:
- the user After configuring the first front-end device notification message interface, the user configures the message service that needs to be monitored through the message middleware service configuration interface.
- the message middleware service configuration interface Refer to Figure 17, taking the Jms message specification as an example, and select the corresponding Jms interface and the corresponding Jms specification
- the data exchange center monitors the subscribed message topic, it can obtain the jms message corresponding to the subscribed message topic through the first message middleware of the first front-end device.
- the data exchange center and the first terminal device The agreed message topic is the first message topic, that is, the data exchange center subscribes to the first message topic, and the task request message sent by the first terminal device also includes the first topic information.
- the task request information sent by the first terminal device can be passed through the message middleware. It is sent to the data exchange center, and the corresponding task identifier can be obtained through the above-mentioned Jms message interface.
- the task identifier in Table 1 is the table name and the primary key value.
- Kafka notification interface is selected.
- Kafka notification interface is also customized according to the requirements of the business platform.
- Kafka interface and its interface in this embodiment The meaning is as follows:
- the user configures the message service that needs to be monitored through the message middleware service configuration interface, selects the corresponding Kafka interface and the message processing plug-in corresponding to the Kafka specification, and configures the message topic (Topic) that needs to be subscribed.
- the data exchange center monitors the subscribed message topic, it can obtain the Kafka message corresponding to the subscribed message topic through the first message middleware of the first front-end device.
- the data exchange center and the first terminal device The agreed message topic is the first message topic, that is, the data exchange center subscribes to the first message topic, and the task request message sent by the first terminal device also includes the first topic information. Therefore, the task request information sent by the first terminal device can be passed through the message middleware. It is sent to the data exchange center, and the corresponding task identifier can be obtained through the Kafka message interface mentioned above.
- the task identifiers in Table 2 above are the database name and the table name.
- the data exchange center needs to pre-configure the mapping relationship between the agreed task identifier and the data processing task.
- the user configures the task mapping through the ETL task mapping interface, and the user enters more than one task identifier in the keyword column , Select the corresponding ETL task in the ETL task name column, so that the mapping relationship between the task identifier and the data processing task is established.
- users can create, delete, start, modify, and filter services on the service-driven management interface.
- One-to-one mapping relationship between multiple task identifications and multiple data processing tasks can be set, and the mapping relationship between one task identification and multiple data processing tasks can also be set, multiple data processing corresponding to one task identification Tasks can be executed in the form of task sets.
- the data exchange center After the data exchange center obtains the task identifier, it triggers the ETL tool to execute the corresponding data processing task or task set according to the pre-configured mapping relationship between the task identifier and the data processing task.
- the ETL tool extracts the task data corresponding to the task identifier from the first intermediate library of the first intermediate device, processes the task data and writes it into the second intermediate library of the second intermediate device.
- a data processing method is provided for an embodiment of this application, which is applied to a data exchange center, and includes the following steps:
- Step 301 Receive a task request message from a first front-end device, where the task request message includes a task identifier;
- Step 302 Trigger a data processing task according to the task request message, extract task data associated with the task identifier in the first intermediate library of the first front-end device, and write the extracted task data to the second front-end device The second intermediate library.
- Step 303 Send a task notification message to the second message middleware of the second front-end device, where the task notification message includes a task identifier associated with the task data.
- the data processing center sends a task notification message to the second front end processor of the second terminal device.
- the task notification message is also sent through the message middleware mechanism, and the task notification message is sent to the message middleware of the second front-end device, wherein the task notification message includes the task identifier corresponding to the processed task data
- the same task identifier as the task request message is used, for example, the table name and primary key value of the data table.
- different task IDs can also be set as required.
- the message broker module is notified through the message middleware output component to send a task notification message to the user of the message.
- the message agent module is the Jms agent.
- the sent task request message In order to adapt to the message middleware mechanism, the sent task request message must conform to the corresponding format. If the topic mode is adopted, the sent task request message includes the second message subject information, and the second message subject information includes the second subject, The second topic needs to be agreed with the second terminal device, that is, the second terminal device subscribes to the second topic. If the queue mode is adopted, the sent task request message includes the second queue information, and similarly, the second terminal device needs to subscribe to the second queue information.
- the task request message can adopt the JMS message format or the Kafka message format.
- the data exchange center can search for connection factory objects and sending target objects through JNDI (Java Naming and Directory Interface, Java Naming and Directory Service Interface).
- JNDI Java Naming and Directory Interface, Java Naming and Directory Service Interface
- an embodiment of the present application provides a data processing method, which is applied to a front-end device.
- the front-end device in the embodiment of the present application refers to an intermediate device used in the field.
- ATM, POS, smart card, UnionPay gold card, telephone banking, bond-yintong, silver tax, instant payment, provident fund management system, electronic remittance and intra-city clearing systems are used in the fields of finance, government and enterprise.
- the front-end processor may be an external hardware device, a hardware device installed in a computer, or a front-end system simulated by a virtual machine, including an intermediate library and message middleware for storing task data.
- the method includes but is not limited to the following steps:
- Step 401 receiving task data from the data exchange center
- Step 402 Receive a task notification message from the data exchange center, where the task notification message includes a task identifier, and the task identifier is associated with the task data.
- Step 403 Send the task notification message to the second terminal device
- Step 404 Receive a data extraction request from a second terminal device, and send the task data to the second terminal device.
- the front-end device is responsible for the transfer of task data and the processing of task request information.
- the task data is stored in the intermediate library of the front-end device, and the message middleware After receiving the task request message from the data exchange center, determine the sender of the task request message, and send the task request message to the corresponding second terminal device.
- the communication mode of the message middleware includes a topic mode and a queue mode.
- the task notification message includes the second message topic information
- the message middleware saves the task notification message to the second message topic information Corresponding to the second message topic, and send the task notification message to consumers who have subscribed to the second message topic.
- the message will be The software sends the task notification message to the second terminal device to realize the sending of the task notification message.
- the task notification message When the task notification message is in the queue mode, the task notification message includes the second queue information, the message middleware saves the task notification message under the second queue name corresponding to the second queue information, and the message middleware saves the task The notification message is sent to the second terminal device corresponding to the second queue name to realize the sending of the task notification message.
- an embodiment of the application provides a data receiving method, which is applied to a terminal device, and is applied to a terminal device.
- the terminal device described in the embodiment of the application may be various electronic devices, such as computers and mobile terminals.
- Server or other electronic equipment with processor and data storage function, such as external processing module, distributed equipment, etc., the method includes but not limited to the following steps:
- Step 501 Receive a task notification message from a second front-end device, where the task notification message includes a task identifier.
- Step 502 Extract the task data associated with the task identifier in the second intermediate library of the second front-end device according to the task notification message.
- the terminal device is the user of the task data.
- the terminal device receives the task notification message through the second front-end device, it learns that the task data has been stored in the database of the second front-end device. Extract the task data associated with the task identifier in the second intermediate library of the second front-end device according to the task identifier in the task notification message. Since the second terminal device only needs to perform the data extraction operation in response to the task notification message, there is no need to perform data extraction manually or by setting an execution strategy, and can cooperate to control the transmission and transmission of data tasks according to business needs and execution conditions.
- the processing process can be effectively combined with the business and has a wide range of applications.
- the message middleware mechanism can realize the decoupling of the platform and the application system, reduce the difficulty of development and maintenance, and has good versatility.
- step 501 further includes the following steps:
- Step 5011 monitor the second topic information
- Step 5012 Receive a task notification message corresponding to the second message subject information from the second front-end device, where the task notification message includes a task identifier.
- the second terminal device communicates in the topic mode of the message middleware, and the second terminal device subscribes to the second message topic.
- the second front-end device receives the task request message from the data exchange center, and The task request message includes the second message subject information, and the second front-end device saves the task request message under the second message subject.
- the second front-end device After the second terminal device monitors the second message subject message, the second front-end device will The task request message is sent to the second terminal device.
- step 501 includes the following steps:
- Step 5013 monitor the second queue information
- Step 5014 Receive a task notification message corresponding to the second queue information from the second front-end device, where the task request message includes a task identifier;
- the second terminal device communicates in the queue mode of the message middleware.
- the second terminal device monitors the second queue information.
- the second front-end device receives the task notification message from the data exchange center, the If the task notification message includes the second queue information, the second front-end device will send the task notification message to the second terminal device.
- the terminal device 100 may be any type of various electronic devices, such as a computer, a mobile terminal, a server, or other devices with a processor and data storage function.
- Electronic equipment such as external processing modules, distributed equipment, etc.
- the terminal device 100 includes: a memory 101, a processor 102, and a computer program (not shown in the figure) that is stored on the memory 101 and can run on the processor 102.
- the processor 102 and the memory 101 can pass through a bus. Or connect in other ways. In Fig. 13, connection through a bus is taken as an example.
- the non-transitory software programs and instructions required to implement the data sending method or data receiving method applied to the terminal device in the above embodiment are stored in the memory 101, and when executed by the processor 102, the data of the terminal device in the above embodiment is executed.
- the sending method or the data receiving method for example, execute the method steps 101 to 102 in FIG. 3, the method steps 501 to 502 in FIG. 10, the method steps 5011 to 5012 in FIG. 11, and the method step 5013 in FIG. 12 described above. To 5014.
- the terminal front-end device 200 can be any type of various electronic devices, such as a computer, a mobile terminal, a server, or a processor and storage data. Functional other electronic equipment, such as external processing modules, distributed equipment, etc.
- the front-end device 200 includes: a memory 201, a processor 202, and a computer program (not shown in the figure) that is stored on the memory 201 and can run on the processor 202, and the processor 202 and the memory 201 can pass through
- the bus or other means are connected.
- the bus connection is taken as an example.
- the non-transitory software programs and instructions required to implement the data processing method applied to the front-end device in the foregoing embodiment are stored in the memory 201, and when executed by the processor 202, the data processing method of the front-end device in the foregoing embodiment is executed For example, the method steps 201 to 204 in FIG. 4 and the method steps 401 to 404 in FIG. 9 described above are executed.
- FIG. 15 shows, an embodiment of the present application provides a data exchange center 300, the data exchange center 300, the data exchange center 300 can be any type of various electronic equipment, such as computers, mobile terminals, servers or Processors and other electronic devices that store data functions, such as external processing modules, distributed devices, etc.
- various electronic equipment such as computers, mobile terminals, servers or Processors and other electronic devices that store data functions, such as external processing modules, distributed devices, etc.
- the data exchange center 300 includes: a memory 301, a processor 302, and a computer program (not shown in the figure) that is stored on the memory 301 and can run on the processor 302.
- the processor 302 and the memory 301 can be It is connected through a bus or other means. In FIG. 15, the connection through a bus is taken as an example.
- the non-transitory software programs and instructions required to implement the data processing method applied to the data exchange center 300 in the foregoing embodiment are stored in the memory 301, and when executed by the processor 302, the data processing of the front-end device in the foregoing embodiment is executed
- the method for example, executes the method steps 301 to 302 in FIG. 5, the method steps 3011 to 3012 in FIG. 6, the method steps 3013 to 3014 in FIG. 7, and the method steps 301 to 303 in FIG. 8 described above.
- an embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by a processor or a controller, for example, as shown in FIG.
- the execution of one of the processors 102 in 13 can make the above-mentioned processor 102 execute the data sending method of the terminal device in the above-mentioned embodiment, for example, execute the above-described method steps 101 to 102 in FIG. 3.
- being executed by a processor 102 in FIG. 13 can cause the processor 102 to execute the data receiving method of the terminal device in the foregoing embodiment. For example, to execute the method steps 501 to 502 in FIG. 10 described above, and the steps in FIG. 11 Method steps 5011 to 5012, method steps 5013 to 5014 in FIG. 12.
- being executed by a processor 202 in FIG. 14 can cause the processor 202 to execute the data processing method of the front-end device in the foregoing embodiment, for example, to execute the method steps 201 to 204 in FIG. 4 and FIG. 9 described above. Steps 401 to 404 in the method.
- execution by a processor 302 in FIG. 15 can cause the processor 302 to execute the data processing method of the data exchange center in the foregoing embodiment, for example, to execute the method steps 301 to 302 in FIG. 5 and FIG. 6 described above.
- the device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
- the embodiment of the application includes: acquiring task data, sending the task data to a first front-end device, and sending a task request message to the first message middleware of the first front-end device.
- the task identifier associated with the task data receiving task data from a first terminal device, receiving a task request message from the first terminal device, the task request message including a task identifier, the task identifier is associated with the task data,
- the task request message is sent to the data exchange center, the data extraction request from the data exchange center is received, and the task data is sent to the data exchange center; the task request message is received from the first front-end device, the task request
- the message includes a task identifier; a data processing task is triggered according to the task request message, task data associated with the task identifier in the first intermediate library of the first front-end device is extracted, and the extracted task data is written into the second front-end device
- the second intermediate library of the device receives the task data from the data exchange center; receives the task notification message from the data exchange
- the task identifier is associated with the task data, and the task data and the task request message are transmitted separately to realize the effective control of the data processing task, which improves the efficiency of data interaction.
- the message middleware communication mechanism can be used. Improve the versatility of docking different services.
- the active control of data tasks is realized through the message middleware mechanism, without manual execution or by setting execution strategies, the processing process of data tasks can be controlled according to business needs and execution conditions, and it can be effectively carried out with business. Combined, the scope of application is wide.
- the message middleware mechanism can realize the decoupling of the platform and the application system, reduce the difficulty of development and maintenance, and has good versatility.
- computer storage medium includes volatile and non-volatile data implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data).
- Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or Any other medium used to store desired information and that can be accessed by a computer.
- communication media usually contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery media. .
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Claims (18)
- 一种数据发送方法,应用于终端设备,包括:获取任务数据,将所述任务数据发送至第一前置设备;向所述第一前置设备的第一消息中间件发送任务请求消息,所述任务请求消息包括与所述任务数据关联的任务标识。
- 根据权利要求1所述的一种数据发送方法,其中,所述任务请求消息还包括用于消息中间件通信的第一消息主题信息或第一队列信息。
- 根据权利要求1所述的一种数据发送方法,其中,所述任务请求消息为JMS消息或Kafka消息。
- 一种数据处理方法,应用于前置设备,包括:接收来自第一终端设备的任务数据;接收来自第一终端设备的任务请求消息,所述任务请求消息包括任务标识,所述任务标识与所述任务数据关联;将所述任务请求消息发送至数据交换中心;接收来自数据交换中心的数据抽取请求,将所述任务数据发送至所述数据交换中心。
- 根据权利要求4所述的一种数据处理方法,其中,所述将所述任务请求消息发送至数据交换中心,包括以下之一的步骤:所述任务请求消息包括第一消息主题信息,将所述任务请求消息发送至订阅所述第一消息主题信息的数据交换中心;所述任务请求消息包括第一队列信息,将所述任务请求消息发送至对应所述第一队列信息的数据交换中心。
- 一种数据处理方法,应用于数据交换中心,包括:接收来自第一前置设备的任务请求消息,所述任务请求消息包括任务标识;根据所述任务请求消息触发数据处理任务,抽取第一前置设备第一中间库中与所述任务标识关联的任务数据,并将所抽取的任务数据写入第二前置设备的第二中间库。
- 根据权利要求6所述的一种数据处理方法,其中,所述接收来自第一前置设备的任务请求消息包括以下之一的步骤:监听第一消息主题信息,接收来自第一前置设备与所述第一消息主题信息对应的任务请求消息;监听第一队列信息,接收来自第一前置设备与所述第一队列信息对应的任务请求消息。
- 根据权利要求6所述的一种数据处理方法,还包括以下步骤:向所述第二前置设备的第二消息中间件发送任务通知消息,所述任务通知消息包括与所述任务数据关联的任务标识。
- 根据权利要求8所述的一种数据处理方法,其中,所述任务通知消息包括用于消息中间件通信的第二消息主题信息或第二队列信息。
- 根据权利要求8所述的一种数据处理方法,其中,所述任务通知消息为JMS消息或Kafka消息。
- 一种数据处理方法,应用于前置设备,包括:接收来自数据交换中心的任务数据;接收来自数据交换中心的任务通知消息,所述任务通知消息包括任务标识,所述任务标识与所述任务数据关联;将所述任务通知消息发送至第二终端设备;接收来自第二终端设备的数据抽取请求,将所述任务数据发送至所述第二终端设备。
- 根据权利要求11所述的一种数据处理方法,其中,所述将所述任务通知消息发送 至第二终端设备,包括以下之一的步骤:所述任务通知消息包括第二消息主题信息,将所述任务通知消息发送至订阅所述第二消息主题信息的第二终端设备;所述任务通知消息包括第二队列信息,将所述任务通知消息发送至对应所述第二队列信息的第二终端设备。
- 一种数据接收方法,应用于终端设备,包括:接收来自第二前置设备的任务通知消息,所述任务通知消息包括任务标识;根据所述任务通知消息,抽取所述第二前置设备第二中间库中与所述任务标识关联的任务数据。
- 根据权利要求13所述的一种数据接收方法,其中,所述接收来自第二前置设备的任务通知消息,包括以下之一的步骤:监听第二消息主题信息,接收来自第二前置设备与所述第二消息主题信息对应的任务通知消息;监听第二队列信息,接收来自第二前置设备与所述第二队列信息对应的任务通知消息。
- 一种终端设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,所述处理器执行所述计算机程序时实现如权利要求1至3中任意一项所述的数据发送方法,或者,实现如权利要求13至14中任意一项所述的数据接收方法。
- 一种前置设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,所述处理器执行所述计算机程序时实现如权利要求4至5中任意一项所述的数据处理方法,或者,实现如权利要求11至12中任意一项所述的数据处理方法。
- 一种数据交换中心,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,所述处理器执行所述程序时实现如权利要求6至10中任意一项所述的数据处理方法。
- 一种计算机可读存储介质,存储有计算机可执行指令,其中,所述计算机可执行指令用于执行权利要求1至3中任意一项所述的数据发送方法,或者,用于执行权利要求4至5中任意一项所述的数据处理方法,或者,用于执行权利要求6至10中任意一项所述的数据处理方法,或者,用于执行权利要求11至12中任意一项所述的数据处理方法,或者,用于执行权利要求13至14中任意一项所述的数据接收方法。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911080915.7 | 2019-11-07 | ||
CN201911080915.7A CN112788074B (zh) | 2019-11-07 | 数据发送方法、处理方法、接收方法及其设备、存储介质 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021088641A1 true WO2021088641A1 (zh) | 2021-05-14 |
Family
ID=75748207
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/122254 WO2021088641A1 (zh) | 2019-11-07 | 2020-10-20 | 数据发送方法、处理方法、接收方法及其设备、存储介质 |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2021088641A1 (zh) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113487340A (zh) * | 2021-05-24 | 2021-10-08 | 康键信息技术(深圳)有限公司 | 业务解耦处理方法、装置、设备及存储介质 |
CN113626211A (zh) * | 2021-06-29 | 2021-11-09 | 欧电云信息科技(江苏)有限公司 | 消息队列的切换方法、切换系统、电子设备及存储介质 |
CN115150466A (zh) * | 2022-06-29 | 2022-10-04 | 北京百度网讯科技有限公司 | 一种数据分发的实现方法、装置、电子设备及存储介质 |
CN115499435A (zh) * | 2022-08-08 | 2022-12-20 | 中亿(深圳)信息科技有限公司 | 任务调度方法、系统、电子设备及计算机可读存储介质 |
CN115529288A (zh) * | 2022-09-21 | 2022-12-27 | 上海浦东发展银行股份有限公司 | 一种消息推送的方法、装置、计算机设备 |
CN116545706A (zh) * | 2023-05-15 | 2023-08-04 | 合芯科技(苏州)有限公司 | 一种数据安全传输控制系统、方法、装置及电子设备 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101557551A (zh) * | 2009-05-11 | 2009-10-14 | 成都市华为赛门铁克科技有限公司 | 一种移动终端访问云服务的方法、装置和通信系统 |
CN101562774A (zh) * | 2009-05-22 | 2009-10-21 | 北京立通无限科技有限公司 | 信息管理的方法及系统 |
CN102693297A (zh) * | 2012-05-16 | 2012-09-26 | 华为技术有限公司 | 数据处理方法、节点和提取、转换和加载etl系统 |
US20130325788A1 (en) * | 2012-05-31 | 2013-12-05 | Cellco Partnership D/B/A Verizon Wireless | Etl data transit method and system |
-
2020
- 2020-10-20 WO PCT/CN2020/122254 patent/WO2021088641A1/zh active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101557551A (zh) * | 2009-05-11 | 2009-10-14 | 成都市华为赛门铁克科技有限公司 | 一种移动终端访问云服务的方法、装置和通信系统 |
CN101562774A (zh) * | 2009-05-22 | 2009-10-21 | 北京立通无限科技有限公司 | 信息管理的方法及系统 |
CN102693297A (zh) * | 2012-05-16 | 2012-09-26 | 华为技术有限公司 | 数据处理方法、节点和提取、转换和加载etl系统 |
US20130325788A1 (en) * | 2012-05-31 | 2013-12-05 | Cellco Partnership D/B/A Verizon Wireless | Etl data transit method and system |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113487340A (zh) * | 2021-05-24 | 2021-10-08 | 康键信息技术(深圳)有限公司 | 业务解耦处理方法、装置、设备及存储介质 |
CN113626211A (zh) * | 2021-06-29 | 2021-11-09 | 欧电云信息科技(江苏)有限公司 | 消息队列的切换方法、切换系统、电子设备及存储介质 |
CN115150466A (zh) * | 2022-06-29 | 2022-10-04 | 北京百度网讯科技有限公司 | 一种数据分发的实现方法、装置、电子设备及存储介质 |
CN115150466B (zh) * | 2022-06-29 | 2023-08-15 | 北京百度网讯科技有限公司 | 一种数据分发的实现方法、装置、电子设备及存储介质 |
CN115499435A (zh) * | 2022-08-08 | 2022-12-20 | 中亿(深圳)信息科技有限公司 | 任务调度方法、系统、电子设备及计算机可读存储介质 |
CN115499435B (zh) * | 2022-08-08 | 2023-08-11 | 中亿(深圳)信息科技有限公司 | 任务调度方法、系统、电子设备及计算机可读存储介质 |
CN115529288A (zh) * | 2022-09-21 | 2022-12-27 | 上海浦东发展银行股份有限公司 | 一种消息推送的方法、装置、计算机设备 |
CN115529288B (zh) * | 2022-09-21 | 2024-04-19 | 上海浦东发展银行股份有限公司 | 一种消息推送的方法、装置、计算机设备 |
CN116545706A (zh) * | 2023-05-15 | 2023-08-04 | 合芯科技(苏州)有限公司 | 一种数据安全传输控制系统、方法、装置及电子设备 |
CN116545706B (zh) * | 2023-05-15 | 2024-01-23 | 合芯科技(苏州)有限公司 | 一种数据安全传输控制系统、方法、装置及电子设备 |
Also Published As
Publication number | Publication date |
---|---|
CN112788074A (zh) | 2021-05-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021088641A1 (zh) | 数据发送方法、处理方法、接收方法及其设备、存储介质 | |
CN107729139B (zh) | 一种并发获取资源的方法和装置 | |
US8984535B2 (en) | System and method for facilitating the exchange of information among applications | |
US20190132276A1 (en) | Unified event processing for data/event exchanges with existing systems | |
US20050278294A1 (en) | Systems and methods for a collaboration presence framework | |
US10326720B2 (en) | Messaging queue service API optimization system | |
US20050273714A1 (en) | Systems and methods for an embedded collaboration client | |
US8484281B2 (en) | System and method for callbacks based on web service addressing | |
AU2005246375A1 (en) | Systems and methods for enterprise collaboration | |
US11784959B2 (en) | Message transfer agent architecture for email delivery systems | |
CN113391979A (zh) | 监控数据展示的处理方法、设备、系统及存储介质 | |
CN112256246A (zh) | 一种用于电力系统中支持跨语言调用的微服务集成架构 | |
CN110476154A (zh) | 用于数据收集的代理服务器设备和方法 | |
CN112527523A (zh) | 面向高性能计算多云的分布式消息传递方法及系统 | |
CN108259605B (zh) | 一种基于多数据中心的数据调用系统及方法 | |
CN113220432A (zh) | 多云互联方法、装置、设备、存储介质及产品 | |
CN112788074B (zh) | 数据发送方法、处理方法、接收方法及其设备、存储介质 | |
CN109298956A (zh) | 文件传输方法、装置及终端设备 | |
CN115334155A (zh) | 一种消息队列代理方法和装置 | |
CN112511636B (zh) | 数据传输系统、方法、装置、计算机设备及存储介质 | |
CN115250276A (zh) | 分布式系统及数据处理的方法和装置 | |
CN113760487A (zh) | 一种业务处理方法和装置 | |
CN111258775A (zh) | 消息处理方法、装置、设备和存储介质 | |
CN103856359A (zh) | 获取信息的方法和系统 | |
US11824941B2 (en) | Accessing representational state transfer application programming interfaces using simple mail transfer protocol |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20884469 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20884469 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 20/02/2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20884469 Country of ref document: EP Kind code of ref document: A1 |