CN117499506A - Message processing method, computer equipment and storage medium - Google Patents

Abstract

The application relates to a message processing method, a computer device and a storage medium, which are applied to a first service end, wherein the first service end is bridged with a second service end to construct an Internet of things gateway, and the method comprises the following steps: responding to triggering a first data receiving event, and receiving first message data transmitted by an Internet of things terminal; a netty communication framework configured by a preset rule is adopted, a first processing flow is executed on first message data to obtain first message body data, a second message body object generated after a second processing flow is executed on second message body data sent by an internet of things platform by a second server is received, a third processing flow is executed on the second message body object to obtain second message data, and the second message body data is generated by the internet of things platform according to the first message body data; and transmitting the second message data to the terminal of the Internet of things. The Internet of things gateway can be designed by using the netty communication framework by adopting the method, so that development and maintenance cost is simplified, and data transmission efficiency and safety are improved.

Description

Message processing method, computer equipment and storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a message processing method, a computer device, and a storage medium.

Background

The existing gateway of the Internet of things is customized by adopting an open source communication protocol (HTTP, MQTT), the open source communication protocol is often complex in design, high in use difficulty and capable of meeting the customization requirements of a large number of different business products of the Internet of things, and the compatibility problem is considered, so that the gateway cannot be expanded without limit. And some data adopts plaintext transmission, some data have too much redundant data, network transmission performance has loss, security can not be ensured, and the method is not suitable for high-efficiency communication of large-scale equipment.

Therefore, the general internet of things communication protocol lacks pertinence, and is difficult to meet the communication requirements of different devices, so that the interoperability among the devices is poor; the method is difficult to adapt to the change of the requirements of different devices, so that the expandability of a communication protocol is poor, and the method is difficult to adapt to the future service development requirements; because the protocol is public, the security is low, and the protocol is easy to hack, so that the security of the equipment and the data is threatened; the realization is complex, the efficiency is lower, and the communication requirement of large-scale equipment is difficult to meet.

Disclosure of Invention

Based on the above, it is necessary to provide a message processing method, a computer device and a storage medium, which can solve the problems of poor universality, poor expandability, poor safety and low efficiency of the existing internet of things communication protocol, and adopt the internet of things gateway designed by the preset rule to meet the communication requirements of access, data reporting, instruction interaction and the like of devices corresponding to different service products of the internet of things, and has higher compatibility, expandability and safety.

In a first aspect, the present application provides a message processing method, which is applied to a first service end, where the first service end is bridged with a second service end, so as to construct an internet of things gateway; the method comprises the following steps:

responding to triggering a first data receiving event, and receiving first message data transmitted by an Internet of things terminal;

a netty communication framework configured by a preset rule is adopted, a first processing flow is executed on first message data to obtain first message body data, a second message body object generated after a second processing flow is executed on second message body data sent by an internet of things platform by a second server is received, and a third processing flow is executed on the second message body object to obtain second message data, wherein the second message body data is generated by the internet of things platform according to the first message body data;

and transmitting the second message data to the terminal of the Internet of things.

In one embodiment, the steps of the first process flow are performed on the first message data, including:

the method comprises the steps of transferring first message data on a plurality of processing nodes preconfigured in a first processing flow by utilizing a netty chained calling rule to execute the first processing flow including log collection, connection statistics, state detection, current limiting control, decoding processing, authentication processing, data statistics and anomaly detection.

In one embodiment, the step of performing a first process flow on the first message data to obtain first message body data includes:

based on TCP protocol specifications configured by preset rules, performing first decoding processing on the first message data by utilizing a serialization algorithm, and converting the first message data of binary data into a first message object so as to acquire a first message body object in the first message object;

and performing first coding processing on the first message body object by using an anti-serialization algorithm based on a preset persistent storage configuration so as to convert the first message body object into first message body data, thereby acquiring the first message body data.

In one embodiment, the first service end is in communication connection with a cache center which can be queried by the internet of things platform, and the cache center adopts a distributed cache Redis to cache access information; the step of executing the first process flow on the first message data further comprises:

based on TCP protocol specifications configured by preset rules, performing first decoding processing on the first message data by utilizing a serialization algorithm to convert the first message data of binary data into a first message object so as to acquire a first message header object in the first message object, and acquiring current access information of the terminal of the Internet of things from the first message header object;

And carrying out authentication processing on the terminal of the Internet of things by utilizing the historical access information and the current access information in the distributed cache Redis, and caching the current access information to a buffer center.

In one embodiment, after the step of performing a first process flow on the first message data to obtain the first message body data, the method includes:

and forwarding the first message body data to receive the first message body data by utilizing the message middleware, analyzing the first message body data by utilizing an analysis algorithm, and storing the analysis result in a data storage center which can be queried by the Internet of things platform in a lasting mode after obtaining the analysis result.

In one embodiment, before the step of receiving the first message data transmitted by the terminal of the internet of things, the method includes:

and carrying out TCP long connection between the first service end and the terminal of the Internet of things through the domain name information or the address information.

In a second aspect, the present application provides a message processing method, applied to a second service end, where the second service end is bridged with a first service end to construct an internet of things gateway; the method comprises the following steps:

responding to triggering a second data receiving event, and receiving second message body data transmitted by the Internet of things platform;

a netty communication framework configured by preset rules is adopted, and a second processing flow is executed on the second message body data so as to generate a second message body object;

And transmitting the second message body object to a first service end, so that the first service end executes a third processing flow on the second message body object and then transmits the second message body object to the terminal of the Internet of things.

In one embodiment, the step of performing a second process flow on the second message body data to generate a second message body object includes:

and carrying out second decoding processing on the second message body data by utilizing a serialization algorithm based on TCP protocol specifications configured by a preset rule so as to convert the second message body data of the binary data into a second message body object, thereby acquiring the second message body object.

In one embodiment, the step of performing a second process flow on the second message body data to generate a second message body object further comprises:

and executing a second processing flow including log collection and anomaly detection on the second message body data.

In a third aspect, the present application provides a computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:

responding to triggering a first data receiving event, and receiving first message data transmitted by an Internet of things terminal;

A netty communication framework configured by a preset rule is adopted, a first processing flow is executed on the first message data to obtain first message body data, a second message body object generated after the second processing flow is executed is received on second message body data sent by a second service end to an Internet of things platform, and a third processing flow is executed on the second message body object to obtain second message data, wherein the second message body data is generated by the Internet of things platform according to the first message body data;

transmitting the second message data to the internet of things terminal;

alternatively, the processor when executing the computer program performs the steps of:

responding to triggering a second data receiving event, and receiving second message body data transmitted by the Internet of things platform;

a netty communication framework configured by preset rules is adopted, and a second processing flow is executed on the second message body data so as to generate a second message body object;

and transmitting the second message body object to a first service end, so that the first service end executes a third processing flow on the second message body object and then transmits the second message body object to the terminal of the Internet of things.

In a fourth aspect, the present application provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:

Responding to triggering a first data receiving event, and receiving first message data transmitted by an Internet of things terminal;

a netty communication framework configured by a preset rule is adopted, a first processing flow is executed on the first message data to obtain first message body data, a second message body object generated after the second processing flow is executed is received on second message body data sent by a second service end to an Internet of things platform, and a third processing flow is executed on the second message body object to obtain second message data, wherein the second message body data is generated by the Internet of things platform according to the first message body data;

transmitting the second message data to the internet of things terminal;

alternatively, the computer program when executed by a processor performs the steps of:

responding to triggering a second data receiving event, and receiving second message body data transmitted by the Internet of things platform;

a netty communication framework configured by preset rules is adopted, and a second processing flow is executed on the second message body data so as to generate a second message body object;

and transmitting the second message body object to a first service end, so that the first service end executes a third processing flow on the second message body object and then transmits the second message body object to the terminal of the Internet of things.

The message processing method, the computer equipment and the storage medium have the following technical effects:

(1) Because the netty communication framework configured by adopting the preset rule is adopted, a first processing flow is executed on the first message data to acquire the first message body data, so that the internet of things platform generates second message body data according to the first message body data, a second processing flow is executed on the second message body data to generate a second message body object, and a third processing flow is executed on the second message body object to acquire the second message data. It can be seen that, based on the TCP protocol specification configured by the preset rule and the netty communication framework configured by the preset rule, the data transmission efficiency is higher and safer.

(2) The netty communication framework configured by the preset rules adopts the netty chained calling rules, and completes the first processing flow including log collection, connection statistics, state detection, current limiting control, decoding processing, authentication processing, data statistics and anomaly detection, so that the gateway of the Internet of things has higher stability and reliability, supports various network anomaly conditions such as disconnection reconnection, timeout retransmission and the like, and further ensures the stability and reliability of network communication.

(3) The TCP protocol specification configured by the preset rule can be compressed extremely, the data length is reduced greatly, the communication efficiency is improved, the service requirement of an attacker can be met better, and as a private communication protocol, the attacker can break holes after breaking the content, so that the TCP protocol specification configured by the preset rule can improve the safety of data transmission to a certain extent.

Drawings

Fig. 1 is an application environment diagram of a message processing method in embodiment 1;

fig. 2 is a flow chart of a message processing method applied to a first server in embodiment 2;

fig. 3 is a flow chart of a data processing method of an internet of things gateway in embodiment 2;

fig. 4 is a flow chart of a message processing method applied to a second server in embodiment 3;

FIG. 5 is a flow diagram of a message processing system in embodiment 4;

fig. 6 is a schematic structural diagram of an internet of things gateway in embodiment 5;

fig. 7 is a block diagram showing the structure of a message processing apparatus in embodiment 6;

fig. 8 is a block diagram showing the structure of another message processing apparatus in embodiment 7;

fig. 9 is an internal structural diagram of a computer device in embodiment 8.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the element defined by the phrase "comprising one … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element, and furthermore, elements having the same name in different embodiments of the present application may have the same meaning or may have different meanings, a particular meaning of which is to be determined by its interpretation in this particular embodiment or by further combining the context of this particular embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context. Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes," and/or "including" specify the presence of stated features, steps, operations, elements, components, items, categories, and/or groups, but do not preclude the presence, presence or addition of one or more other features, steps, operations, elements, components, items, categories, and/or groups. The terms "or," "and/or," "including at least one of," and the like, as used herein, may be construed as inclusive, or meaning any one or any combination. For example, "including at least one of: A. b, C "means" any one of the following: a, A is as follows; b, a step of preparing a composite material; c, performing operation; a and B; a and C; b and C; a and B and C ", again as examples," A, B or C "or" A, B and/or C "means" any of the following: a, A is as follows; b, a step of preparing a composite material; c, performing operation; a and B; a and C; b and C; a and B and C). An exception to this definition will occur only when a combination of elements, functions, steps or operations are in some way inherently mutually exclusive.

It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.

The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrase "if determined" or "if detected (stated condition or event)" may be interpreted as "when determined" or "in response to determination" or "when detected (stated condition or event)" or "in response to detection (stated condition or event), depending on the context.

It should be noted that, in this document, step numbers such as S10 and S20 are adopted, and the purpose of the present invention is to more clearly and briefly describe the corresponding content, and not to constitute a substantial limitation on the sequence, and those skilled in the art may execute S20 first and then execute S10 when implementing the present invention, which is within the scope of protection of the present application.

Prior to the description of the specific embodiments, the background art is further expanded. With the development of the internet of things technology, more and more business products related to the internet of things technology are expanded. The internet of things products of different types need to be customized and developed for self business, the reported data are exponentially increased at present, and the data transmission efficiency is difficult to meet the existing requirements. In addition, since the open source communication protocol has some loopholes, the data security can not be ensured, and new challenges are brought to network communication. Common open source communication protocols include: HTTP, HTTPS, JSON-RPC, FTP, IMAP, protobuf, MQTT, besides the limitations of the open source communication protocol, compatibility factors are considered, performance is lost, and different service products have difficulty in custom expansion communication, are not beneficial to service expansion, and different protocols require customized communication gateways, are not beneficial to equipment debugging, data acquisition and service communication of the Internet of things.

Aiming at each Internet of things application, it is necessary to develop a custom communication protocol applied to the Internet of things and a matched Internet of things gateway so as to meet the communication requirements of different Internet of things devices, so that the technical problems of poor generality, poor expandability, poor safety, low efficiency and the like of the existing Internet of things communication protocol are solved, the communication efficiency and the safety are further improved, and the development requirements of future Internet of things services can be met.

It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application. In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.

Example 1

The message processing method provided by the application can be applied to an application environment shown in fig. 1, wherein the application environment comprises an internet of things gateway 10, an internet of things terminal 20, an internet of things platform 30, a data processing center 40, a cache center 50 and a data storage center 60. The internet of things terminal 20 may be understood as a control terminal of an internet of things device, and the internet of things terminal 20 is not limited to a control terminal of an internet of things device, and the embodiment is not limited herein, and may be capable of implementing services such as message transmission, message reporting, instruction receiving, message receiving, and the like. The internet of things gateway 10 in this embodiment adopts a netty communication framework configured by a preset rule, and is used for processing and receiving a report message transmitted by the internet of things terminal 20 and an instruction message issued by the internet of things platform. The Netty communication framework is an asynchronous event-driven network application framework, is an asynchronous communication framework based on a JAVA NIO class library, and has the characteristics of asynchronous non-blocking, event-driven based, high performance, high reliability, high customization and the like. The embodiment adopts the Netty communication framework, does not need to write complex logic codes to realize communication, does not need to consider performance problems, does not need to consider coding problems, half-packet read-write and other problems, and rapidly develops a network application protocol.

Further stated, the gateway of the internet of things comprises a first service end and a second service end, bridging communication is carried out between the first service end and the second service end, and the netty communication framework with preset rules is built through the first service end and the second service end. The first service end is used for equipment access service and mainly provides service for the public network, and is connected with an Internet of things terminal of the public network in a TCP long mode through domain name information or address information (the address information comprises an IP address and a port) and used for receiving message data reported by the Internet of things terminal, and then after a first processing flow is executed, message body data in the message data are obtained and then forwarded. The second server side is used for instruction interaction service, mainly provides service for an intranet, is connected with an Internet of things platform of the intranet, and is used for receiving instruction data sent by the Internet of things platform and sending instruction replies to the Internet of things platform.

Further, in one embodiment, the cache center uses a distributed cache redis to cache access information, where the access information includes a connection address (IP address and port) of the terminal of the internet of things and a terminal ID. In this embodiment, distributed cache Redis is adopted to cache access information, when a first server side/internet of things platform applies for data, a request is sent to the Redis in priority, if the data exists in the request, the request is directly returned, otherwise, the Redis sends the request to a cache center, the cache center directly returns the query result to the first server side/internet of things platform, meanwhile, the data is updated to Redis storage, when the data in the cache center changes, the Redis clears corresponding key value pairs, and when the next request arrives, the corresponding data is queried in the cache center and updated to the Redis, so that consistency of the Redis and the data stored in the cache center is ensured. The cache center is connected with the first service end and is used for the first service end to inquire the cached historical access information and cache the access information of the current first service end; the caching center is connected with the internet of things platform and used for the internet of things platform to inquire cached historical access information and cache current information to be accessed.

Further, in an embodiment, the data storage center stores the message body data forwarded by the first server side in a persistent storage mode, and provides a data query service for the internet of things platform so as to feed back updated data to the internet of things platform, and in addition, the data storage center can store instruction data sent by the internet of things platform in a persistent storage mode.

Further, in one embodiment, the data processing center is disposed between the first service end and the data storage center, and the message middleware kafka is used to receive the message body data forwarded by the first service end, then parse the message body data through a real-time parsing algorithm, and store the parsing result to the data storage center in a lasting manner.

The embodiment is designed with the emphasis on the gateway of the internet of things by utilizing the netty communication framework, so that the data transmission efficiency is improved, the stability of the gateway of the internet of things is improved, and the difficulty of development and maintenance is simplified.

Example 2

In one embodiment, as shown in fig. 2, a flow chart of a message processing method is provided, where the message processing method is applied to a first service end, and the first service end is bridged with a second service end, so as to construct an internet of things gateway. The message processing method comprises the following steps:

Step 110, receiving first message data transmitted by the terminal of the internet of things in response to triggering a first data receiving event;

step 120, executing a first processing flow on the first message data by adopting a netty communication framework configured by a preset rule to obtain first message body data, receiving a second message body object generated after a second processing flow is executed on second message body data sent by the internet of things platform by a second server, and executing a third processing flow on the second message body object to obtain second message data, wherein the second message body data is generated by the internet of things platform according to the first message body data;

and 130, transmitting the second message data to the terminal of the Internet of things.

For further explanation of the preset rule configuration of the gateway of the internet of things, in this embodiment, the gateway of the internet of things is divided into two parts, the first part is applied to a first service end for accessing services to devices of the public network, and the second part is applied to a second service end for instruction interaction services to the intranet.

In one embodiment, referring to fig. 3, fig. 3 provides a flow chart of a data processing method of an internet of things gateway. In step S120, the step of acquiring the second message data further includes:

Step S121, a first processing flow is executed on the first message data through the first service end to acquire first message body data, so that the Internet of things platform generates second message body data according to the first message body data;

step S122, a second processing flow is executed on the second message body data through the second service end so as to generate a second message body object, and the second message body object is packaged and sent to the first service end;

in step S123, a third process is performed on the second message body object by the first service end to obtain the second message data.

In one embodiment, step S110, before the step of receiving the first message data transmitted by the terminal of the internet of things, includes: and performing TCP long connection between the first service end and the Internet of things terminal through the domain name information or the address information so as to receive the first message data reported by the Internet of things terminal and send the second message data to the Internet of things terminal. Further, by adopting TCP protocol long connection communication, more efficient data transmission can be realized, so that the processing capacity and efficiency of the gateway are improved. The TCP long connection can save more TCP establishment and closing operations, reduce waste and save time. For clients frequently requesting resources, long connection is suitable, if the connection between clients and servers is not closed all the time, a problem exists, and as the connection of clients is increased, when servers are not on hold in the morning and evening, the servers need to take some strategies at the moment, for example, the connections which do not have read-write events for a long time are closed, so that the service damage of the servers caused by some malicious connections can be avoided; if the condition is allowed again, the client machine can be taken as granularity, the maximum connection number of each client is limited, and the influence of some clients on the back-end service can be avoided. Therefore, the TCP long connection can provide data transmission efficiency and improve the stability and other performances of the gateway of the Internet of things.

In one embodiment, step S120, performing the steps of the first process flow on the first message data, includes: the method comprises the steps of transferring first message data on a plurality of processing nodes preconfigured in a first processing flow by utilizing a netty chained calling rule to execute the first processing flow including log collection, connection statistics, state detection, current limiting control, decoding processing, authentication processing, data statistics and anomaly detection. The present embodiment is further described in the following embodiments with respect to processing nodes. The first service end in the embodiment executes the netty chained call rule by adopting the netty communication framework, so as to further realize a preset first processing flow.

In one embodiment, step S120, a first processing procedure is performed on the first message data to obtain first message body data, including:

based on TCP protocol specifications configured by preset rules, performing first decoding processing on the first message data by utilizing a serialization algorithm, and converting the first message data of binary data into a first message object, thereby acquiring a first message body object in the first message object;

and performing first coding processing on the first message body object by using an anti-serialization algorithm based on a preset persistent storage configuration so as to convert the first message body object into first message body data, thereby acquiring the first message body data.

The serialization algorithm is a process of converting the state information of an object into a form capable of being stored or transmitted, during serialization, the object writes the current state of the object into a temporary or persistent storage area, then the state of the object can be read from the storage area or be inversely serialized, the object is recreated, the serialization enables other codes to be checked or modified, and object instance data which cannot be accessed without serialization can be obtained.

Further describing the TCP protocol specification configured by the preset rule, in this embodiment, considering factors such as compatibility, expandability, safety and the like of the protocol, a TCP communication protocol applied to the gateway of the Internet of things is designed, and the TCP protocol specification configured by the preset rule encapsulates the transmitted data packet. As shown in table 1, in one embodiment, the data structure of the first message data of the TCP protocol specification configured by the preset rule includes a message header, a message body, and a check code.

TABLE 1

Message header

Message body

Check code

The message header of the data structure in this embodiment is used to agree on the format, length, source and destination address of the protocol, and the like, so that the message content cannot be resolved without the message header, and invalid information cannot be filtered. The length of the message body is variable, and a message body serialization algorithm is adopted to convert the object into binary stream transmission. The check code is configured as 1 byte, and exclusive or check is adopted to detect whether the transmission data is wrong.

As shown in table 2, the data structure of the message header of the first message data of the TCP protocol specification configured by the preset rule includes: magic number, protocol version number, message ID, serial number, message body length, message body serialization algorithm, terminal ID number, and reserved field.

TABLE 2

In one embodiment, the magic number is configured to be 2 bytes, and is an initiator negotiated by both communication parties, and is used for comparing the correctness of the received data, if the initial character of the message is not matched with the magic number in the protocol, the message is considered as illegal data, and the connection can be disconnected or other measures can be taken to enhance the security of data transmission. The protocol version number is configured to be 1 byte and is used for coping with the change of the service requirement so as to change the structure or the field of the preset rule protocol. The message ID is configured to be 1 byte, representing the message type, for example: working conditions and positions. The serial number is configured to be 2 bytes for tracing back data quality problems. The message body length is configured to 4 bytes for representing the total length of the message body data. The message body serialization algorithm is configured to be 1 byte for indicating the manner in which data is converted into a binary stream. The terminal ID number is configured to be 8 bytes and used for representing a unique identifier of the terminal device, and is set by a factory. The reserved field is configured to 4 bytes for use by a communication protocol upgrade.

In one embodiment, the first service end is in communication connection with a cache center which can be queried by the internet of things platform, and the cache center adopts a distributed cache Redis to cache access information. The access information may include a connection address and a terminal ID number of the internet of things terminal. The connection address may include an IP address of the access gateway and its port number. The terminal ID number may be represented as a unique identifier identifying the terminal of the internet of things, and set by the manufacturer. Further, in step S121, the step of executing, by the first service end, the first processing flow on the first message data further includes:

based on TCP protocol specifications configured by preset rules, performing first decoding processing on the first message data by utilizing a serialization algorithm to convert the first message data of binary data into a first message object so as to acquire a first message header object in the first message object, and acquiring current access information of the terminal of the Internet of things from the first message header object;

and carrying out authentication processing on the terminal of the Internet of things by utilizing the historical access information and the current access information in the distributed cache Redis, and caching the current access information to a buffer center.

In one embodiment, step S120, after the step of performing the first processing procedure on the first message data to obtain the first message body data, includes:

And forwarding the first message body data, namely after receiving the first message body data by utilizing the message middleware, analyzing the first message body data by utilizing an analysis algorithm, and after obtaining an analysis result, storing the analysis result in a data storage center which can be queried by the Internet of things platform in a lasting mode.

Example 3

In one embodiment, as shown in fig. 4, a flow diagram of a message processing method is provided, where the message processing method is applied to a second service end, and the second service end is bridged with a first service end, so as to construct an internet of things gateway; the message processing method comprises the following steps:

step S201, receiving second message body data transmitted by the Internet of things platform in response to triggering a second data receiving event;

step S202, a netty communication framework configured by preset rules is adopted, and a second processing flow is executed on second message body data so as to generate a second message body object;

step S203, the second message body object is transmitted to the first service end, so that the first service end performs a third processing procedure on the second message body object and then transmits the third processing procedure to the terminal of the internet of things.

In step S201, it may be understood that, after the first service end triggers the first data receiving event, the first service end receives the first message data transmitted by the internet of things terminal, and after executing the first processing flow, outputs the first message body data, so that the internet of things platform generates the second message body data according to the first message body data output by the first service end, and further receives the second message body data transmitted by the internet of things platform. In one embodiment, step S202, a second process flow is performed on the second message body data to generate a second message body object, including:

And carrying out second decoding processing on the second message body data by utilizing a serialization algorithm based on TCP protocol specifications configured by a preset rule so as to convert the second message body data of the binary data into a second message body object, thereby acquiring the second message body object.

Further illustratively, in step S202, the step of performing a second process flow on the second message body data to generate a second message body object further includes: and executing a second processing flow including log collection and anomaly detection on the second message body data.

Example 4

In one embodiment, as shown in FIG. 5, FIG. 5 provides a flow diagram of a message processing system for implementing a message processing method in embodiments 2-3. The message processing system comprises an internet of things terminal 20, a first service end 11, a cache center 50, a data processing center 40, a data storage center 60, an internet of things platform 30 and a second service end 12. Wherein,

the first server 11 performs TCP long connection with the Internet of things terminal by using domain name information or address information to receive first message data transmitted by the Internet of things terminal; and executing a first processing flow on the first message data by using a first netty communication framework constructed by using preset rules and using netty chained calling rules so as to acquire access information of the terminal of the Internet of things and the first message body data. The first netty communication framework is for providing device access services to a public network.

The cache center 50 is configured to receive the access information, and cache the access information by using a distributed cache redis, and provide the access information for querying by the internet of things platform.

The data processing center 40 is configured to receive the first message body data using message middleware, such as kafka, and parse the first message body data using a parsing algorithm.

The data storage center 60 is configured to persist the parsed data of the first message body data for querying by the internet of things platform.

The internet of things platform 30 generates and outputs second message body data according to the update dynamics of the data storage center, the analysis data of the query message body object and the access information updated by the query cache center.

The second server 12 receives the second message body data output by the internet of things platform, uses the second netty communication frame constructed by the preset rule, uses the netty chain call rule to execute the second processing flow on the second message body data to obtain the second message body object, encapsulates the second message body object and sends the second message body object to the first server, so that the first server 11 uses the first netty communication frame constructed by the preset rule, uses the netty chain call rule to execute the third processing flow on the second message body object to obtain the second message data corresponding to the first message data. The second netty communication framework is used for providing instruction interaction services for the intranet.

Example 5

As shown in fig. 6, a schematic structural diagram of an internet of things gateway is provided to implement the message processing method in embodiments 2-3. The gateway of the internet of things in this embodiment includes a first service end 11 and a second service end 12.

The first service end with the device access service in this embodiment includes: a first log processor 111, a connection statistics processor 112, a state detection processor 113, an upstream current limit circuit breaker 114, a first decoder 115, a log-in processor 116, a traffic statistics processor 117, an upstream interaction processor 118, a first exception processor, and a first encoder 120.

A first log processor (logsinghandler) 111 is configured to print out an internet of things gateway log. A connection statistics processor (connectionstatics handler) 112 is used to count gateway connections and process offline events. A state detection processor (IdleStateHandler) 113 is used to detect the state and automatically break the line when a timeout condition occurs. An upstream current limiting breaker (gateway upstream breaker) 114 is used for active current limiting when triggering a peak of the flow, and plays a role of protecting the gateway. The first Decoder (Decoder) 115 is configured to parse uplink data (e.g., first message data, third message data) of the binary data into a message object using a protocol specification configured by a preset rule. Serializing the storage object data requires converting the data into binary, and accordingly, deserializing converts the binary data into a java object. The login processor (loginfandler) 116 is configured to perform authentication processing, login current limiting processing, and cache access information of the internet of things terminal. The service statistics processor (message statistics handler) 117 is used for recording the internet of things terminals of different products and counting service data. An uplink interaction processor (inboundsandler) 118 is configured to forward an uplink message (first message body data) to the message middleware kafka, reply to the internet of things terminal, and perform instruction response to the internet of things terminal. A first exception handler (exception handler) is configured to handle messages for upstream and downstream exceptions, including a first upstream exception handler 1191 and a first downstream exception handler 1192. The first Encoder (Encoder) 120 is configured to convert the message object into binary data and return the binary data to the internet of things terminal.

The second server 12 with the instruction interaction service in this embodiment includes: a second log processor 121, a second decoder 122, a second encoder 125, an instruction processor 123, and a second exception processor, wherein the second log processor 121 is configured to print out a log. The second decoder 122 is used to convert the instruction binary data into instruction message objects. The second encoder 125 is used to convert the message object into binary data. The instruction processor 123 is used for packaging and transmitting instructions. The second exception handler is configured to handle exception messages, and includes a second upstream exception handler 1241 and a second downstream exception handler 1242.

In summary, in the message processing method provided by the present application, due to the adoption of the netty communication framework configured by adopting the preset rule, a first processing flow is performed on the first message data to obtain the first message body data, so that the internet of things platform generates the second message body data according to the first message body data, and a second processing flow is performed on the second message body data to generate the second message body object, and a third processing flow is performed on the second message body object to obtain the second message data. It can be seen that, based on the TCP protocol specification configured by the preset rule and the netty communication framework configured by the preset rule, the data transmission efficiency is higher and safer.

The netty communication framework configured by the preset rules adopts the netty chained calling rules, and completes the first processing flow including log collection, connection statistics, state detection, current limiting control, decoding processing, authentication processing, data statistics and anomaly detection, so that the gateway of the Internet of things has higher stability and reliability, supports various network anomaly conditions such as disconnection reconnection, timeout retransmission and the like, and further ensures the stability and reliability of network communication.

The TCP protocol specification configured by the preset rule can be compressed extremely, the data length is reduced greatly, the communication efficiency is improved, the service requirement of an attacker can be met better, and as a private communication protocol, the attacker can break holes after the attacker needs to break the content, so that the TCP protocol specification configured by the preset rule can improve the security of data transmission to a certain extent.

Because the Internet of things gateway is designed by adopting the netty communication framework, the netty communication protocol is an asynchronous event driven network application program framework, and the gateway has the advantages of rapid development and maintainability of high-performance protocol servers and clients, capability of supporting mass concurrency based on NIO communication, high performance, active community and convenience in development and maintenance.

Because the Internet of things gateway is designed by adopting the netty communication framework configured by the preset rules, and the communication protocol configured by the preset rules is configured to be decoupled with specific services, the gateway is only responsible for data access authentication verification, data forwarding, instruction interaction and some gateway security mechanism processing, only analyzes the message header of data, and the message body data containing specific service information is forwarded to kafka, so that service real-time analysis is realized in other systems, and high performance and high throughput of the gateway are ensured.

It should be understood that, although the steps in the flowcharts of fig. 2-7 are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in fig. 2-7 may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor does the order in which the sub-steps or stages are performed necessarily occur in sequence, but may be performed alternately or alternately with at least a portion of the sub-steps or stages of other steps or other steps.

Example 6

In one embodiment, as shown in fig. 7, there is provided a message processing apparatus including: a first message receiving module 410, a first message processing module 420, and a first message sending module 430, wherein:

a first message receiving module 410, configured to receive first message data transmitted by the terminal of the internet of things in response to triggering a first data receiving event;

the first message processing module 420 is configured to perform a first processing procedure on the first message data by using a netty communication framework configured by a preset rule, so as to obtain first message body data, receive a second message body object generated after a second processing procedure is performed on second message body data sent by the internet of things platform by the second server, and perform a third processing procedure on the second message body object, so as to obtain second message data, where the second message body data is generated by the internet of things platform according to the first message body data;

the first message sending module 430 is configured to transmit the second message data to the terminal of the internet of things.

Example 7

In one embodiment, as shown in fig. 8, there is provided a message processing apparatus including: a second message receiving module 510, a second message processing module 520, and a second message sending module 530, wherein:

A second message receiving module 510, configured to receive, in response to triggering a second data receiving event, second message body data transmitted by the internet of things platform;

a second message processing module 520, configured to execute a second processing procedure on the second message body data using a netty communication framework configured by a preset rule, so as to generate a second message body object;

the second message sending module 530 is configured to transmit the second message body object to the first service end, so that the first service end performs a third processing procedure on the second message body object and then transmits the third processing procedure to the terminal of the internet of things.

For specific limitations of the message processing apparatus, reference may be made to the above limitations of the message processing method, and no further description is given here. The respective modules in the above-described message processing apparatus may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

Example 8

In one embodiment, a computer device is provided, which may be a server, and the internal structure of which may be as shown in fig. 9. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is for storing message processing data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a message processing method.

It will be appreciated by those skilled in the art that the structure shown in fig. 9 is merely a block diagram of a portion of the structure associated with the present application and is not limiting of the computer device to which the present application applies, and that a particular computer device may include more or fewer components than shown, or may combine some of the components, or have a different arrangement of components.

In one embodiment, a computer device is provided comprising a memory and a processor, the memory having stored therein a computer program, the processor when executing the computer program performing the steps of:

responding to triggering a first data receiving event, and receiving first message data transmitted by an Internet of things terminal; a netty communication framework configured by a preset rule is adopted, a first processing flow is executed on the first message data to obtain first message body data, second message body data sent by a second server side to an Internet of things platform is received, a second message body object generated after the second processing flow is executed, and a third processing flow is executed on the second message body object to obtain second message data, wherein the second message body data is generated by the Internet of things platform according to the first message body data; transmitting the second message data to the terminal of the Internet of things;

Alternatively, the processor when executing the computer program performs the steps of:

responding to triggering a second data receiving event, and receiving second message body data transmitted by the Internet of things platform; a netty communication framework configured by preset rules is adopted, and a second processing flow is executed on the second message body data so as to generate a second message body object; and transmitting the second message body object to the first service end, so that the first service end executes a third processing flow on the second message body object and then transmits the second message body object to the terminal of the Internet of things.

In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of:

responding to triggering a first data receiving event, and receiving first message data transmitted by an Internet of things terminal; a netty communication framework configured by a preset rule is adopted, a first processing flow is executed on the first message data to obtain first message body data, second message body data sent by a second server side to an Internet of things platform is received, a second message body object generated after the second processing flow is executed, and a third processing flow is executed on the second message body object to obtain second message data, wherein the second message body data is generated by the Internet of things platform according to the first message body data; transmitting the second message data to the terminal of the Internet of things;

Alternatively, the computer program when executed by a processor performs the steps of:

responding to triggering a second data receiving event, and receiving second message body data transmitted by the Internet of things platform; a netty communication framework configured by preset rules is adopted, and a second processing flow is executed on the second message body data so as to generate a second message body object; and transmitting the second message body object to the first service end, so that the first service end executes a third processing flow on the second message body object and then transmits the second message body object to the terminal of the Internet of things.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.

Claims (11)

1. The message processing method is applied to a first service end and is characterized in that the first service end and a second service end are bridged to construct an Internet of things gateway; the method comprises the following steps:

responding to triggering a first data receiving event, and receiving first message data transmitted by an Internet of things terminal;

a netty communication framework configured by a preset rule is adopted, a first processing flow is executed on the first message data to obtain first message body data, a second message body object generated after the second processing flow is executed is received on second message body data sent by a second service end to an Internet of things platform, and a third processing flow is executed on the second message body object to obtain second message data, wherein the second message body data is generated by the Internet of things platform according to the first message body data;

And transmitting the second message data to the terminal of the Internet of things.

2. The message processing method according to claim 1, wherein the step of performing a first process flow on the first message data includes:

and transmitting the first message data on a plurality of processing nodes preconfigured in the first processing flow by utilizing a netty chained calling rule so as to execute the first processing flow including log collection, connection statistics, state detection, current limiting control, decoding processing, authentication processing, data statistics and anomaly detection.

3. The message processing method as claimed in claim 1, wherein the step of performing a first process flow on the first message data to obtain the first message body data comprises:

based on TCP protocol specifications configured by preset rules, performing first decoding processing on the first message data by using a serialization algorithm, and converting the first message data of binary data into a first message object so as to acquire a first message body object in the first message object;

and performing first coding processing on the first message body object by using an anti-serialization algorithm based on a preset persistent storage configuration so as to convert the first message body object into first message body data, thereby acquiring the first message body data.

4. The message processing method according to claim 1, wherein the first server is communicatively connected to a cache center that can be queried by an internet of things platform, and the cache center adopts a distributed cache Redis to cache access information;

the step of executing the first processing flow on the first message data further includes:

based on TCP protocol specifications configured by preset rules, performing first decoding processing on first message data by using a serialization algorithm so as to convert the first message data of binary data into first message objects, so as to acquire first message header objects in the first message objects, and acquiring current access information of an Internet of things terminal from the first message header objects;

and carrying out authentication processing on the terminal of the Internet of things by utilizing the historical access information and the current access information in the distributed cache Redis, and caching the current access information to the buffer center.

5. The message processing method according to claim 1, wherein after the step of performing a first process flow on the first message data to obtain the first message body data, comprising:

and forwarding the first message body data to receive the first message body data by utilizing message middleware, analyzing the first message body data by utilizing an analysis algorithm, and storing the analysis result in a data storage center which can be queried by the Internet of things platform in a lasting mode after the analysis result is obtained.

6. The message processing method according to claim 1, wherein before the step of receiving the first message data transmitted by the terminal of the internet of things, the method comprises:

and carrying out TCP long connection between the first server and the terminal of the Internet of things through domain name information or address information.

7. The message processing method is applied to a second service end and is characterized in that the second service end is bridged with the first service end to construct an Internet of things gateway; the method comprises the following steps:

responding to triggering a second data receiving event, and receiving second message body data transmitted by the Internet of things platform;

a netty communication framework configured by preset rules is adopted, and a second processing flow is executed on the second message body data so as to generate a second message body object;

and transmitting the second message body object to a first service end, so that the first service end executes a third processing flow on the second message body object and then transmits the second message body object to the terminal of the Internet of things.

8. The message processing method as recited in claim 7, wherein the step of performing a second process flow on the second message body data to generate a second message body object comprises:

and carrying out second decoding processing on the second message body data by utilizing a serialization algorithm based on TCP protocol specifications configured by preset rules so as to convert the second message body data of binary data into a second message body object, thereby acquiring the second message body object.

9. The message processing method as recited in claim 7, wherein the step of performing a second process flow on the second message body data to generate a second message body object further comprises:

and executing a second processing flow including log collection and anomaly detection on the second message body data.

10. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any one of claims 1 to 9 when the computer program is executed.

11. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method according to any one of claims 1 to 9.