CN110401592B - Method and equipment for data transfer in message channel - Google Patents

Method and equipment for data transfer in message channel Download PDF

Info

Publication number
CN110401592B
CN110401592B CN201910694949.9A CN201910694949A CN110401592B CN 110401592 B CN110401592 B CN 110401592B CN 201910694949 A CN201910694949 A CN 201910694949A CN 110401592 B CN110401592 B CN 110401592B
Authority
CN
China
Prior art keywords
message
messages
connection
module
terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910694949.9A
Other languages
Chinese (zh)
Other versions
CN110401592A (en
Inventor
王浩
曹剑
孙强
邢晓訸
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Three Body Cloud Intelligent Technology Co ltd
Original Assignee
Three Body Cloud Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Three Body Cloud Intelligent Technology Co ltd filed Critical Three Body Cloud Intelligent Technology Co ltd
Priority to CN201910694949.9A priority Critical patent/CN110401592B/en
Publication of CN110401592A publication Critical patent/CN110401592A/en
Application granted granted Critical
Publication of CN110401592B publication Critical patent/CN110401592B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/21Monitoring or handling of messages
    • H04L51/214Monitoring or handling of messages using selective forwarding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/146Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/562Brokering proxy services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The purpose of the application is to provide a method and equipment for data circulation in a message channel, wherein identification information of connection is generated according to a received connection notification between a terminal and a server; delivering the message to the corresponding message queue subject according to the connected identification information; subscribing the messages in the message queue theme according to the types of the messages, and processing the messages, wherein the types of the messages comprise uplink messages and downlink messages; and routing the processed message to different modules in the message channel for consumption according to the routing mode corresponding to the message type. Therefore, the message is accurately issued, the connection between the terminal and the server and the relation between the terminal and the connection are positioned, and meanwhile, the data transmission pressure is reduced and all modules in the message channel are fully decoupled.

Description

Method and equipment for data transfer in message channel
Technical Field
The application relates to the field of internet of things, in particular to a method and equipment for data transfer in a message channel.
Background
With the continuous popularization of the internet of things and the rise of the nationwide fitness era, the fitness industry also enters the intelligent era. The traditional operation mode cannot effectively monitor the state of the accessed intelligent hardware in real time and remotely control the intelligent hardware to perform differentiation processing; meanwhile, information sharing cannot be performed among the devices. At present, the problems can be solved by constructing a message channel of intelligent hardware, in the message channel, the performance of a message channel system is influenced by a data flow mode, and the connection between a positioning terminal and a server in some current data flow modes is not accurate enough, the data transmission pressure is large, and modules involved in data flow cannot be decoupled sufficiently.
Disclosure of Invention
An object of the present application is to provide a method and an apparatus for data transfer in a message channel, which solve the problems in the prior art that the connection between a positioning terminal and a server is not accurate enough, the data transmission pressure is large, and the modules involved in data transfer cannot be decoupled sufficiently.
According to an aspect of the present application, there is provided a method for data flow in a message channel, the method comprising:
generating identification information of the connection according to the received connection notification between the terminal and the server;
delivering the message to the corresponding message queue subject according to the connected identification information;
subscribing the messages in the message queue theme according to the types of the messages, and processing the messages, wherein the types of the messages comprise uplink messages and downlink messages;
and routing the processed message to different modules in the message channel for consumption according to the routing mode corresponding to the message type.
Further, after generating the identification information of the connection according to the received connection notification between the terminal and the server, the method includes:
and generating a first tuple relationship according to the identification information of the connection and the identification information of the terminal, storing the first tuple relationship in an application memory after a notification of successful connection of the terminal is received, and storing a second tuple relationship in a cache database, wherein the second tuple relationship comprises the identification information of the terminal with the connection relationship and the address information of the server.
Further, the method comprises:
connecting the terminal with a TCP gateway through a connection module in the message channel;
serializing or deserializing the message received through the TCP gateway through a message packet processing module in the message channel, and performing encryption and decryption processing;
collecting heartbeat packets and message receiving numbers of the terminal through a data collecting module in the message channel, carrying out flow statistics and carrying out asynchronous batch insertion processing on messages received through the TCP gateway;
and performing routing distribution data on all third parties through a service aggregation module in the message channel.
Further, subscribing the message in the message queue topic according to the type of the message, and processing the message, including:
when the type of the message is an uplink message, the message packet processing module subscribes all message topics produced by all modules in the message channel, and takes out the message from all message topics to perform deserialization, packet disassembly and decryption processing;
and when the type of the message is a downlink message, the message packet processing module subscribes the exclusive message queue theme of the message packet processing module, and takes out the message from the exclusive message queue theme for encryption, packaging and serialization processing.
Further, routing the processed message to different modules in the message channel for consumption according to the routing mode corresponding to the message type, including:
and when the type of the message is an uplink message, delivering the message subjected to deserialization, packet disassembly and decryption to a message theme consumed by the data collection module and the service aggregation module.
Further, routing the processed message to different modules in the message channel for consumption according to the routing mode corresponding to the message type, including:
when the type of the message is a downlink message, the message packet processing module searches the address information of the corresponding service end from the cache database according to the identification information of the terminal, and delivers the message after encryption, package and serialization processing to the connection module according to the address information of the service end;
the connection module searches corresponding connection identification information according to the connection tuple relation;
and pushing the message to the terminal according to the searched identification information of the corresponding connection.
Further, subscribing the message in the message queue topic according to the type of the message, and processing the message, including:
the data collection module subscribes to the exclusive message theme of the data collection module, consumes messages from the exclusive message theme and processes business logic according to the instruction words of the messages.
Further, subscribing the message in the message queue topic according to the type of the message, and processing the message, including:
the service aggregation module subscribes the exclusive message queue theme of the service aggregation module and takes out the message from the exclusive message queue theme for processing;
wherein, the message after being processed is routed to different modules in the message channel for consumption according to the routing mode corresponding to the message type, which comprises:
determining corresponding routing information according to the identification information field of the application program of the processed message;
routing the processed message to different third parties according to the routing information so that the third parties push the processed message to the terminal;
and the service aggregation module assembles the received processed message according to a preset format and then delivers the assembled message to the message packet processing module, and the message packet processing module consumes and distributes the message to the data collection module.
According to another aspect of the present application, there is also provided a computer readable medium having computer readable instructions stored thereon, the computer readable instructions being executable by a processor to implement the method as described above.
According to another aspect of the present application, there is also provided an apparatus for data flow in a message channel, the apparatus including:
one or more processors; and
a memory storing computer readable instructions that, when executed, cause the processor to perform the operations of the aforementioned method.
Compared with the prior art, the method and the device have the advantages that the identification information of the connection is generated according to the received connection notification between the terminal and the server; delivering the message to the corresponding message queue subject according to the connected identification information; subscribing the messages in the message queue theme according to the types of the messages, and processing the messages, wherein the types of the messages comprise uplink messages and downlink messages; and routing the processed message to different modules in the message channel for consumption according to the routing mode corresponding to the message type. Therefore, the message is accurately issued, the connection between the terminal and the server and the relation between the terminal and the connection are positioned, and meanwhile, the data transmission pressure is reduced and all modules in the message channel are fully decoupled.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 illustrates a flow diagram of a method for data flow in a message channel provided in accordance with an aspect of the subject application;
fig. 2 is a schematic diagram illustrating a data flow manner of a message channel in an embodiment of the present application.
The same or similar reference numbers in the drawings identify the same or similar elements.
Detailed Description
The present application is described in further detail below with reference to the attached figures.
In a typical configuration of the present application, the terminal, the device serving the network, and the trusted party each include one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and SLB carriers.
Fig. 1 is a flowchart illustrating a method for data flow in a message channel according to an aspect of the present application, where the method includes: step S11 to step S14,
in step S11, generating identification information of the connection according to the received connection notification between the terminal and the server; when the connection is established between the terminal and the server, the connection established by the terminal reaches the general TCP gateway, and the TCP gateway generates the identification information (Client ID) of the connection according to the received connection notification, so that the connection is positioned through the Client ID in the accurate issuing of the subsequent messages.
In step S12, delivering the message to the corresponding message queue topic according to the identification information of the connection; here, the identification information of different connections corresponds to different message topics (Topic), and different instances are delivered to their corresponding message queues Topic according to the identification information of the corresponding connections.
In an embodiment of the present application, after step S11, a first tuple relationship is generated according to the identification information of the connection and the identification information of the terminal, and after a notification of successful connection of the terminal is received, the first tuple relationship is stored in an application memory, and a second tuple relationship is stored in a cache database, where the second tuple relationship includes the identification information of the terminal having the connection relationship and the address information of the server. When the terminal is connected, the first tuple relation consists of the generated identification information of the connection and the globally unique identification information of the terminal, the second tuple relation consists of the address information of the server side having the connection relation with the terminal and the identification information of the terminal, and after the terminal is connected, the connection module stores the first tuple relation in the application memory and stores the second tuple relation in the cache database.
In an embodiment of the present application, after load balancing (SLB) is performed on various terminals or servers, a TCP connection is established with a general TCP gateway of a message channel to perform data interactive communication. The message channel is responsible for maintaining and managing equipment connection and butting each service system, and carrying out unified management and control on equipment management, service management and message transmission to form an internal communication closed loop. The message channel comprises a connection module, a message packet processing module, a data collection module and a service aggregation module, when the connection established by the equipment reaches the connection module of the general TCP gateway, identification information (Client ID) of the connection is generated, the subsequent accurate issuing is carried out for positioning connection through the Client ID, and meanwhile, each terminal equipment has globally unique equipment identification information (Device ID); after the terminal is connected, the connection module stores the [ Device ID, Client ID ] tuple relation in the application memory, simultaneously stores the [ Device ID, IP ] tuple relation between the equipment terminal ID and the server IP in a cache database (Redis), positions the relation between the terminal equipment and the connection according to the [ Device ID, Client ID ] tuple relation, and positions the relation between the terminal equipment and the server according to the [ Device ID, IP ] tuple relation. Meanwhile, a server IP carrying a connection module is used in the message queue to establish a Topic, different connection module instances deliver messages to the message queue Topic corresponding to the connection module, and the Topic corresponding to the connection module is named by the IP of the server, for example [ Topic: connection: IP ].
In step S13, subscribing to the message in the message queue topic according to the type of the message, and processing the message, where the type of the message includes an uplink message and a downlink message; here, the uplink information is a message sent by the terminal to the server, and the downlink message is a message sent by the server to the terminal device. Different types of messages take out the messages from the message queue topics in different manners, and the messages in the message queue topics can be subscribed according to the types of the messages received by different modules in the message channel, so that the messages are processed, and in step S14, the processed messages are routed to different modules in the message channel for consumption according to the routing manner corresponding to the message type. And routing the message to each module in the message channel for consumption according to the routing modes corresponding to different message types, for example, determining the routing mode according to the message type in the message packet processing module, and routing the message to the data collection module and the service aggregation module for consumption.
In an embodiment of the present application, the method includes: connecting the terminal with a TCP gateway through a connection module in the message channel; serializing or deserializing the message received through the TCP gateway through a message packet processing module in the message channel, and performing encryption and decryption processing; collecting heartbeat packets and message receiving numbers of the terminal through a data collecting module in the message channel, carrying out flow statistics and carrying out asynchronous batch insertion processing on messages received through the TCP gateway; and performing routing distribution data on all third parties through a service aggregation module in the message channel. Here, the message channel is split into four modules: the system comprises a connection module (Connect), a message packet processing module (Logic), a data collection module (Collector) and a service aggregation module (Broker). The connector module is responsible for being connected with a terminal TCP, the Logic module is responsible for serialization or deserialization and data encryption and decryption, the Collector module is responsible for collecting functions of equipment heartbeat packet reporting, message receiving number reporting, traffic statistics, asynchronous batch insertion and the like, and the breaker module is responsible for carrying out routing and data distribution on all third parties. After the modules are split, the functions of all modules in the message channel are decoupled, the message processing capacity of the message channel is improved, and meanwhile all modules monitor a distributed system (such as an Etcd) in a unified mode to obtain configuration updating in real time.
In an embodiment of the present application, a data flow manner of each module in a message channel is as shown in fig. 2, in a message package processing module (Logic), when the type of the message is an uplink message, the message package processing module subscribes all message topics produced by all modules in the message channel, and takes out the message from all message topics to perform deserialization, unpacking and decryption processing; and when the type of the message is a downlink message, the message packet processing module subscribes the exclusive message queue theme of the message packet processing module, and takes out the message from the exclusive message queue theme for encryption, packaging and serialization processing. Here, when the message is an uplink message, the Logic module subscribes message topics (Topic) produced by all the connection modules, and takes out the message from the Topic to perform deserialization, unpacking and decryption operations; when the message is a downlink message, the Logic module subscribes to the dedicated message queue Topic of the module, which is named as [ Topic: Logic ], and the service aggregation module and the data collection module may deliver the message to the dedicated message queue Topic.
Continuing to the above embodiment, when the type of the message is an uplink message, the message subjected to deserialization, packet disassembly and decryption is delivered to the message topic consumed by the data collection module and the service aggregation module. When the type of the message is a downlink message, the message packet processing module searches the address information of the corresponding service end from the cache database according to the identification information of the terminal, and delivers the message after encryption, package and serialization processing to the connection module according to the address information of the service end; the connection module searches corresponding connection identification information according to the connection tuple relation; and pushing the message to the terminal according to the searched identification information of the corresponding connection. Here, when the message is an uplink message, the message subjected to the deserialization, unpacking and deciphering operations is delivered into a message Topic (Topic) for consumption by the data collection module and the service aggregation module, which is named as Topic: Collector and Topic: Broker. When the message is a downlink message, each message summary has identification information (Device ID) of the terminal, the message packet processing module finds the corresponding server IP from the cache database (Redis) according to the identification information of the terminal when the message is consumed from the [ Topic: Logic ], encrypts, packages and serializes the message, and then routes and delivers the message to the corresponding [ Topic: Connect: IP ] of the connection module, and the connection module finds the corresponding connection Client ID according to the [ Device ID, Client ID ] and pushes the message to the terminal Device. The decryption operation and the encryption operation can adopt SHA1 Hash, AES and other encryption check algorithms, so that the safety of the message in the transmission process is ensured. Meanwhile, the message is serialized, so that the size of the data can be compressed as much as possible, and the bandwidth is saved. The message packet processing module routes the uplink and downlink messages to different Topic for consumption of corresponding consumers, so that the modules are fully decoupled and do not interfere with each other.
With continued reference to fig. 2, the data collection module subscribes to the proprietary message topic of the data collection module, consumes messages from the proprietary message topic, and processes business logic according to instruction words of the messages. In this case, the data collection module subscribes to its own Topic, named [ Topic: Collector ], from which it consumes messages and processes the different business logics according to the instruction word of the message. Wherein, the instruction word is, for example, Scmd in the following data communication interaction protocol, and when the Scmd is a heartbeat instruction word, the last heartbeat sending time of the terminal device corresponding to the message is updated; for example, the message packet processing module sends and receives a message and simultaneously delivers a message copy to the [ Topic: Collector ], and the data collection module calculates the size of the message copy according to the message copy, so that the total number of the sent messages and the flow size can be counted.
Referring to fig. 2, the service aggregation module subscribes to the dedicated message queue topic of the service aggregation module, and takes out a message from the dedicated message queue topic for processing; in step S14, determining corresponding routing information according to the identification information field of the application program of the processed message; routing the processed message to different third parties according to the routing information so that the third parties push the processed message to the terminal; and the service aggregation module assembles the received processed message according to a preset format and then delivers the assembled message to the message packet processing module, and the message packet processing module consumes and distributes the message to the data collection module. The service aggregation module subscribes an exclusive message queue Topic [ Topic: Broker ] of the service aggregation module, determines a corresponding receiver according to an identification information (APP ID) field of an application program in the message, and routes the message to different third parties according to the corresponding receiver, wherein the third parties can generate corresponding APP IDs when accessing, and set corresponding callback addresses, consumption quotas and the like according to an Open API (Open API). When a third party actively pushes a message to a terminal through an Open API, a service aggregation module receives the message, assembles the message according to a preset format, directly delivers the message to a [ Topic: Logic ], and is consumed by a message packet processing module and distributed to a data collection module. It should be noted that after the platform is checked and passed, the third party to be accessed may register whether a service callback is needed and a corresponding service callback address through the Open API, and when consuming the uplink service message, the service aggregation module routes to the service callback address set by the access party according to the APP ID in the message, so as to allow the third party to perform further service judgment.
Furthermore, the embodiment of the present application also provides a computer readable medium, on which computer readable instructions are stored, the computer readable instructions being executable by a processor to implement the aforementioned method.
In an embodiment of the present application, according to yet another aspect of the present application, there is provided an apparatus for data flow in a message channel, the apparatus including:
one or more processors; and
a memory storing computer readable instructions that, when executed, cause the processor to perform the operations of the aforementioned method.
For example, the computer readable instructions, when executed, cause the one or more processors to:
generating identification information of the connection according to the received connection notification between the terminal and the server;
delivering the message to the corresponding message queue subject according to the connected identification information;
subscribing the messages in the message queue theme according to the types of the messages, and processing the messages, wherein the types of the messages comprise uplink messages and downlink messages;
and routing the processed message to different modules in the message channel for consumption according to the routing mode corresponding to the message type.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
It should be noted that the present application may be implemented in software and/or a combination of software and hardware, for example, implemented using Application Specific Integrated Circuits (ASICs), general purpose computers or any other similar hardware devices. In one embodiment, the software programs of the present application may be executed by a processor to implement the steps or functions described above. Likewise, the software programs (including associated data structures) of the present application may be stored in a computer readable recording medium, such as RAM memory, magnetic or optical drive or diskette and the like. Additionally, some of the steps or functions of the present application may be implemented in hardware, for example, as circuitry that cooperates with the processor to perform various steps or functions.
In addition, some of the present application may be implemented as a computer program product, such as computer program instructions, which when executed by a computer, may invoke or provide methods and/or techniques in accordance with the present application through the operation of the computer. Program instructions which invoke the methods of the present application may be stored on a fixed or removable recording medium and/or transmitted via a data stream on a broadcast or other signal-bearing medium and/or stored within a working memory of a computer device operating in accordance with the program instructions. An embodiment according to the present application comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the apparatus to perform a method and/or a solution according to the aforementioned embodiments of the present application.
It will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. The terms first, second, etc. are used to denote names, but not any particular order.

Claims (9)

1. A method of data flow in a message channel, wherein the method comprises:
generating identification information of the connection according to the received connection notification between the terminal and the server;
delivering the message to the corresponding message queue subject according to the connected identification information;
subscribing the messages in the message queue theme according to the types of the messages, and processing the messages, wherein the types of the messages comprise uplink messages and downlink messages;
routing the processed message to different modules in a message channel for consumption according to a routing mode corresponding to the message type;
connecting the terminal with a TCP gateway through a connection module in the message channel;
serializing or deserializing the message received through the TCP gateway through a message packet processing module in the message channel, and performing encryption and decryption processing;
collecting heartbeat packets and message receiving numbers of the terminal through a data collecting module in the message channel, carrying out flow statistics and carrying out asynchronous batch insertion processing on messages received through the TCP gateway;
and performing routing distribution data on all third parties through a service aggregation module in the message channel.
2. The method of claim 1, wherein after generating the identification information of the connection according to the received connection notification between the terminal and the server, the method comprises:
and generating a first tuple relationship according to the identification information of the connection and the identification information of the terminal, storing the first tuple relationship in an application memory after a notification of successful connection of the terminal is received, and storing a second tuple relationship in a cache database, wherein the second tuple relationship comprises the identification information of the terminal with the connection relationship and the address information of the server.
3. The method of claim 2, wherein subscribing to messages in the message queue topic according to their type, processing the messages comprises:
when the type of the message is an uplink message, the message packet processing module subscribes all message topics produced by all modules in the message channel, and takes out the message from all message topics to perform deserialization, packet disassembly and decryption processing;
and when the type of the message is a downlink message, the message packet processing module subscribes the exclusive message queue theme of the message packet processing module, and takes out the message from the exclusive message queue theme for encryption, packaging and serialization processing.
4. The method of claim 3, wherein routing the processed message to different modules in a message channel for consumption in a routing manner corresponding to the message type comprises:
and when the type of the message is an uplink message, delivering the message subjected to deserialization, packet disassembly and decryption to a message theme consumed by the data collection module and the service aggregation module.
5. The method of claim 3, wherein routing the processed message to different modules in a message channel for consumption in a routing manner corresponding to the message type comprises:
when the type of the message is a downlink message, the message packet processing module searches the address information of the corresponding service end from the cache database according to the identification information of the terminal, and delivers the message after encryption, package and serialization processing to the connection module according to the address information of the service end;
the connection module searches corresponding connection identification information according to the connection tuple relation;
and pushing the message to the terminal according to the searched identification information of the corresponding connection.
6. The method of claim 2, wherein subscribing to messages in the message queue topic according to their type, processing the messages comprises:
the data collection module subscribes to the exclusive message theme of the data collection module, consumes messages from the exclusive message theme and processes business logic according to the instruction words of the messages.
7. The method of claim 2, wherein subscribing to messages in the message queue topic according to their type, processing the messages comprises:
the service aggregation module subscribes the exclusive message queue theme of the service aggregation module and takes out the message from the exclusive message queue theme for processing;
wherein, the message after being processed is routed to different modules in the message channel for consumption according to the routing mode corresponding to the message type, which comprises:
determining corresponding routing information according to the identification information field of the application program of the processed message;
routing the processed message to different third parties according to the routing information so that the third parties push the processed message to the terminal;
and the service aggregation module assembles the received processed message according to a preset format and then delivers the assembled message to the message packet processing module, and the message packet processing module consumes and distributes the message to the data collection module.
8. A computer readable medium having computer readable instructions stored thereon which are executable by a processor to implement the method of any one of claims 1 to 7.
9. An apparatus for data flow in a message channel, wherein the apparatus comprises:
one or more processors; and
a memory storing computer readable instructions that, when executed, cause the processor to perform the operations of the method of any of claims 1 to 7.
CN201910694949.9A 2019-07-30 2019-07-30 Method and equipment for data transfer in message channel Active CN110401592B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910694949.9A CN110401592B (en) 2019-07-30 2019-07-30 Method and equipment for data transfer in message channel

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910694949.9A CN110401592B (en) 2019-07-30 2019-07-30 Method and equipment for data transfer in message channel

Publications (2)

Publication Number Publication Date
CN110401592A CN110401592A (en) 2019-11-01
CN110401592B true CN110401592B (en) 2022-03-04

Family

ID=68326557

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910694949.9A Active CN110401592B (en) 2019-07-30 2019-07-30 Method and equipment for data transfer in message channel

Country Status (1)

Country Link
CN (1) CN110401592B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111209071A (en) * 2020-01-06 2020-05-29 广州虎牙科技有限公司 Information configuration method, device, server and storage medium
CN112070645A (en) * 2020-07-28 2020-12-11 智维云图(上海)智能科技有限公司 Method and system for deploying fire-fighting project through modular assembly
CN111901437B (en) * 2020-08-04 2022-12-20 北京一起教育信息咨询有限责任公司 Message transmission method, device and system
CN111970195B (en) * 2020-08-13 2022-04-19 上海哔哩哔哩科技有限公司 Data transmission method and streaming data transmission system
CN112039896B (en) * 2020-08-29 2022-07-08 中国平安财产保险股份有限公司 Data processing method, equipment, server and storage medium
CN113127232A (en) * 2021-04-19 2021-07-16 北京京东振世信息技术有限公司 Message processing method, device, equipment and storage medium
CN114051055B (en) * 2022-01-12 2022-05-13 江苏银承网络科技股份有限公司 Data transmission method and device in different systems
CN114938388B (en) * 2022-07-22 2022-11-11 浙江中控技术股份有限公司 Distributed data transmission method, device, system and storage medium

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7793140B2 (en) * 2007-10-15 2010-09-07 International Business Machines Corporation Method and system for handling failover in a distributed environment that uses session affinity
CN104092767B (en) * 2014-07-21 2017-06-13 北京邮电大学 A kind of publish/subscribe system and its method of work for increasing message queue model
CN105577736B (en) * 2014-11-07 2018-07-13 华为技术有限公司 A kind of electric line carrier communication terminal control mechanism, system and method
CN108965355B (en) * 2017-05-18 2021-05-25 北京京东尚科信息技术有限公司 Method, apparatus and computer readable storage medium for data transmission
US10817196B2 (en) * 2017-07-07 2020-10-27 Sap Se Page list based crash recovery
CN109391500B (en) * 2017-08-11 2021-08-31 华为技术有限公司 Configuration management method, device and equipment
CN108494815A (en) * 2018-02-06 2018-09-04 北京极智感科技有限公司 A kind of method and system of transmission message
CN109614245A (en) * 2018-10-11 2019-04-12 阿里巴巴集团控股有限公司 Message delivery method, device, electronic equipment and the storage medium of message-oriented middleware
CN109040326A (en) * 2018-11-02 2018-12-18 北京京东金融科技控股有限公司 The method and apparatus of PUSH message
CN109995873A (en) * 2019-04-10 2019-07-09 阿里巴巴集团控股有限公司 A kind of management client, equipment monitoring system and method

Also Published As

Publication number Publication date
CN110401592A (en) 2019-11-01

Similar Documents

Publication Publication Date Title
CN110401592B (en) Method and equipment for data transfer in message channel
US10645181B2 (en) Meta broker for publish-subscribe-based messaging
US8146095B2 (en) Method, apparatus and computer program product for managing persistence in a messaging network
US20170187782A1 (en) Telemetry response system
US20120311067A1 (en) Data Communication Efficiency
US11386061B2 (en) Telemetry request system
US20100058451A1 (en) Load balancing for services
TW202038581A (en) Management client, and device monitoring system and method
CN107517227B (en) Session implementation method and device for distributed consistency system
CN110417782B (en) System, method and readable medium for intelligent hardware message transmission
US9736103B2 (en) Dynamic granular messaging persistence
CN113867958A (en) Method, device and equipment for pushing task corner mark and readable medium
US11323368B1 (en) System and method for web service atomic transaction (WS-AT) affinity routing
CN111131219B (en) Efficient data transmission method for Internet of things based on FlatBuffers
CN113965628A (en) Message scheduling method, server and storage medium
CN116842090A (en) Accounting system, method, equipment and storage medium
CN112363946B (en) Message forwarding method and device based on service system
CN112910546B (en) Satellite data acquisition system and method
Surkov Model and method of chunk processing of payload for HTTP authorization protocols
US8005923B2 (en) System and method of obfuscating queue management
CN107547601B (en) Method for sending message, routing equipment, server and system
CN113992352A (en) Message pushing method and device, electronic equipment and storage medium
CN113055493A (en) Data packet processing method, device, system, scheduling device and storage medium
CN112565326B (en) RDMA communication address exchange method for distributed file system
CN118075059B (en) Gateway execution method, device and equipment based on MySQL protocol

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant