CN113079087B - Interconnected data gateway, and data processing system and method based on interconnected data gateway - Google Patents
Interconnected data gateway, and data processing system and method based on interconnected data gateway Download PDFInfo
- Publication number
- CN113079087B CN113079087B CN202110349753.3A CN202110349753A CN113079087B CN 113079087 B CN113079087 B CN 113079087B CN 202110349753 A CN202110349753 A CN 202110349753A CN 113079087 B CN113079087 B CN 113079087B
- Authority
- CN
- China
- Prior art keywords
- data
- interconnected
- network
- subscription
- interconnected data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/18—Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides an interconnected data gateway, comprising: an acquisition processor: decoding the interconnected data by using an acquisition processor, printing a subscription label for the session according to the subscription matching condition, and filtering; an index memory: the interconnection data filtered by the acquisition processor is stored according to indexes by an indexer; a subscriber: the stored interconnected data provides a data subscription and pulling interface for an external service system through a subscriber; the cluster manager: a plurality of interconnected data gateways form a cluster to support high availability. The invention also provides a data processing system and method based on the interconnected data gateway. The invention solves the technical problems of complex arrangement, difficult adaptation to change and difficult maintenance of the whole assembly line in the traditional scheme, decouples the interconnected data source system and the service processing system through the bypass light splitting technology, greatly reduces the complexity of the system, is easy to expand and maintain, and can quickly adapt to change.
Description
Technical Field
The invention relates to the technical field of interconnected data communication, in particular to an interconnected data gateway, and a data processing system and method based on the interconnected data gateway.
Background
In the interconnected data service system, real transaction data containing service values are analyzed by decoding network flow, and the interconnected data service system is characterized by real-time performance, service performance and authenticity, so that the interconnected data service system has extremely high commercial values and can be widely applied to the fields of service monitoring, service performance analysis, service value mining, big data analysis, safety analysis and the like.
In a conventional interconnection data processing flow, interconnection data is generally cleaned and filtered by a high-performance data processing engine, and is converted into a business data structure and stored in a database. The whole assembly line is complex to deploy, and when the service changes, the change of the whole assembly line program is involved, so that the time is consumed, and errors are easy to occur; a mechanism to decouple the interconnected data source system and the business processing system is lacking.
In addition, because the interconnection data has the characteristics of large throughput and complex message structure, the traditional message gateway is difficult to meet the performance requirement.
Through search, patent document CN110719228a discloses a method and an apparatus for transmitting big data packets based on real-time data distribution service, where the method includes: constructing a small data packet publishing and subscribing library, and initializing; the publisher publishes a big data packet theme, and the subscriber subscribes the big data packet theme; when data is sent, dividing a big data packet into a plurality of small data packets, filling related data information into the small data packets, storing the small data packets into a sending queue, and sending data sub-packets through an asynchronous sending thread; when a subscriber receives a first data sub-packet, a cache region corresponding to the size of a large data packet is created, and the received data sub-packets are copied to the corresponding region according to numbers; when the subscriber receives the last data sub-package, the integrity of the data is checked and fed back to the publisher; and if the publisher receives the packet loss feedback information, retransmitting the lost data sub-packets until all the subscribers receive all the data sub-packets. The prior art is used for establishing a communication mechanism between two points of a publisher and a subscriber and realizing the efficient transmission of a big data packet through a mechanism of splitting the big data packet, but does not solve the technical problem that the subscriber acquires the communication between other network objects.
Patent document CN112541101a discloses a method, an apparatus, an electronic device, and a computer storage medium for pushing subscription data, where a subscription period is obtained, and the subscription period includes a start time and an end time, where data whose generation time is within the subscription period is used as subscription data; pushing a task processing time and the starting time, or determining whether the subscription data comprises future data according to the pushing task processing time, the starting time and the terminating time; when the subscription data comprises the future data, reading the future data contained in the subscription data from the cache and pushing the future data from the earliest generation moment of the future data contained in the subscription data; the future data is data of which the data generation time is later than the push task processing time, and the future data is written into the cache in real time after being generated. The prior art is a system and method for optimizing subscription data transmission, which reduces the frequency of reading the historical data storage unit by setting up a cache in the data push service, and has the disadvantages of being independent of a system outside a database and having no description about what data is processed.
Patent document CN105357302a discloses a method and device for breakpoint continuous transmission of network data packets, where the prior art specifically includes: 1. the network server stores the network data packets in sequence according to the packet capturing time; 2. the network server reads the data packet of the corresponding timestamp according to the downloading time period; 3. after receiving the network data packet, the download request initiating end stores the timestamp and the last 46 bytes of the last network data packet transmitted each time, and after reconnection, the download request initiating end sends the timestamp and the last 46 bytes of the last recorded data packet to the network server, and the network server reads the data packets under the timestamp in sequence until the last N bytes of a certain data packet and the last N bytes of the last transmitted data packet are completely consistent, so that the next data packet is used as the first data packet to be sent again. The disadvantage of this prior art is that the time stamp or data packet needs to be saved at the client, which causes the data processing to be cumbersome.
Therefore, it is desirable to develop a system and method for handling high throughput and complex message structure.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide an interconnected data gateway, a data processing system and a method based on the interconnected data gateway so as to meet the characteristics of large interconnected data throughput and complex message structure and further meet the performance requirements required by the gateway.
According to the present invention, there is provided an interconnected data gateway comprising:
an acquisition processor: decoding the interconnected data by using an acquisition processor, printing a subscription label for the session according to the subscription matching condition, and filtering;
an index memory: the interconnection data filtered by the acquisition processor is stored according to indexes by an indexer;
a subscriber: the stored interconnected data provides a data subscription and pulling interface for an external service system through a subscriber;
the cluster manager: a plurality of interconnected data gateways form a cluster to support high availability.
Preferably, the acquisition processor receives the network data packet captured by the network adapter, decodes the network data packet according to the network protocol specification, analyzes the quintuple information structure, and filters and screens the tag matching rule; the input of the acquisition processor is a network adapter receiving buffer area; the output of the acquisition processor is a decoded and screened stream of network data packets.
Preferably, the index memory is used for writing the network data packet information stream into the index file and the data file according to the port, the time, the label and the session index; the input of the index memory is a network data packet information flow from the acquisition processor; the output of the index memory is an index file and a data file.
Preferably, the subscriber is used for providing interconnection data subscription and data pull services for the service system; the input of the subscriber is a service system interconnection data subscription request; the output of the subscriber is the subscription record and the interconnection data.
Preferably, the cluster manager is configured to synchronize subscription records stored by a plurality of interconnected data gateways, so as to implement high availability and horizontal expansion; the input of the cluster manager is an interconnection data gateway data synchronization signal; the output of the cluster manager is an interconnected data gateway availability detection recovery mechanism.
Preferably, the acquisition processor comprises:
a network card collector: the network data packet capturing module is used for receiving the network data packet captured by the network adapter;
the protocol decoder: decoding the captured network data packet according to the network protocol specification;
a filter: and matching the decoded network data packet aiming at quintuple, ethernet protocol, IP protocol, vlan and Vxlan information contained in the network data packet according to a matching rule, and printing label information, wherein a matching rule control signal is from a subscriber.
Preferably, the index memory comprises:
a data file writer: writing the network data packet into a disk according to an index rule;
an index calculator: calculating and assembling an index structure through port, time, session and label information in a network data packet;
a data reader: and the data reader is connected with the subscriber and is used for reading the corresponding data file according to the time, the port and the label required by the subscription record.
Preferably, the subscriber comprises:
a subscription registrar: the system is used for registering a service system to request an interconnection data subscription record;
a Web server: the data subscription service system is used for providing the interconnection data subscription service for the business system.
The data processing system based on the interconnected data gateway comprises a network end, a plurality of interconnected data gateway ends and a service system, wherein the network end is connected with the interconnected data gateway ends, and the plurality of interconnected data gateway ends form a cluster through a cluster manager in each interconnected data gateway end, so that high availability is supported; and sending the data to a service system after the data are subscribed and matched with the interface by each interconnected data gateway terminal.
According to the data processing method based on the interconnected data gateway, the data processing system based on the interconnected data gateway is adopted for data processing, interconnected data are decoded by an acquisition processor of the interconnected data gateway end in an interconnected data gateway end, a subscription label is marked for a session according to a subscription matching condition, filtering is carried out, the interconnected data are stored according to indexes through an indexer of the interconnected data gateway end, the subscriber of the interconnected data gateway end provides an interconnected data subscription and pulling interface for an external service system, and a cluster manager of the interconnected data gateway end enables a plurality of interconnected data gateway ends to form a cluster so as to support high availability.
Compared with the prior art, the invention has the following beneficial effects:
1. the invention solves the problems of complex whole assembly line deployment, difficult adaptation to change and difficult maintenance of the traditional scheme, decouples the interconnected data source system and the service processing system by the bypass light splitting technology, greatly reduces the complexity of the system, is easy to expand and maintain, and can quickly adapt to change.
2. The invention solves the problems that the interconnected data has the characteristics of large throughput and complex message structure and the transmission gateway is difficult to meet the performance requirement, and the DPDK technology is utilized to bypass the data processing loss of the kernel of the operating system, so that the gateway can reach the enterprise-level performance requirement.
3. The invention combines the high available message queue subscription mechanism, makes the service system flexible to acquire the interconnected data, can flexibly modify the service system program according to the service requirement without influencing the interconnected data source system, and forms a gateway which is convenient for the user to acquire the interconnected data.
4. The invention introduces the indexer and the index structure, further improves the performance, meets the enterprise-level performance requirement, and is especially suitable for the large data volume real-time forwarding scene.
5. The invention combines the cluster management mechanism, so that the gateway can be horizontally expanded, the performance is further improved, and the high availability requirement is met.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is an overall block diagram of an interconnected data gateway-based data processing system according to the present invention;
FIG. 2 is a frame diagram of collector processing in the interconnected data gateway of the present invention;
FIG. 3 is a block diagram of an index store in an interconnected data gateway of the present invention;
FIG. 4 is a block diagram of an index structure of an index store in an interconnected data gateway according to the present invention;
FIG. 5 is a block diagram of a subscriber in an interconnected data gateway of the present invention;
fig. 6 is a diagram of a cluster manager framework in an interconnected data gateway of the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that it would be obvious to those skilled in the art that various changes and modifications can be made without departing from the spirit of the invention. All falling within the scope of the invention.
As shown in fig. 1, the present invention provides a data processing system based on interconnected data gateways, which includes a network end, a plurality of interconnected data gateway ends and a service system, wherein the network end is connected to the interconnected data gateway ends, and the plurality of interconnected data gateway ends form a cluster through a cluster manager in each interconnected data gateway end, so as to support high availability; and sending the data to a service system after the data are subscribed and matched with the interface by each interconnected data gateway terminal.
The invention also provides an interconnected data gateway, comprising:
an acquisition processor: decoding the interconnected data by using an acquisition processor, printing a subscription label for the session according to the subscription matching condition, and filtering; the acquisition processor receives the network data packet captured by the network adapter, decodes the network data packet according to the network protocol specification, analyzes the quintuple information structure, and filters and screens the tag matching rule; the input of the acquisition processor is a network adapter receiving buffer area; the output of the acquisition processor is a decoded and screened stream of network data packets.
An index memory: the interconnection data filtered by the acquisition processor is stored according to indexes by an indexer; the index memory is used for writing the network data packet information flow into an index file and a data file according to the port, the time, the label and the session index; the input of the index memory is a network data packet information flow from the acquisition processor; the output of the index storage is an index file and a data file.
A subscriber: the stored interconnected data provides a data subscription and pulling interface for an external service system through a subscriber; the subscriber is used for providing interconnection data subscription and data pulling service for the service system; the input of the subscriber is a service system interconnection data subscription request; the output of the subscriber is the subscription record and the interconnection data.
The cluster manager: a plurality of interconnected data gateways form a cluster to support high availability. The cluster manager is used for synchronizing subscription records stored by a plurality of interconnected data gateways to realize high availability and horizontal expansion; the input of the cluster manager is an interconnection data gateway data synchronization signal; the output of the cluster manager is an interconnected data gateway availability detection recovery mechanism.
Further, as shown in fig. 2, the acquisition processor includes the following components:
a network card collector: the network data packet capturing module is used for receiving the network data packet captured by the network adapter; its input is a network adapter read buffer; the output is the basic frame structure data stream of the network data packet.
The protocol decoder: decoding the captured network data packet according to the network protocol specification; the input of the network data packet is a basic frame structure data stream of the network data packet; the output is a decoded network packet stream.
A filter: and matching the decoded network data packet aiming at quintuple, ethernet protocol, IP protocol, vlan and Vxlan information contained in the network data packet according to a matching rule, and marking tag information, wherein a matching rule control signal is from a subscriber. The input is network data packet information flow and filtering matching rules; the output is the filtered network data packet information flow.
As shown in fig. 3, the index memory includes:
a data file writer: writing the network data packet into a disk according to an index rule; the input is network data packet information flow; the output of which is a data file. The format of the data file is (without limitation) the original data of the network data packet divided into fixed-size blocks and added with meta-information headers.
An index calculator: calculating and assembling an index structure through information such as ports, time, sessions, labels and the like in the network data packet; the input is network data packet information flow; the output of which is an index file.
A data reader: and the data reader is connected with the subscriber and is used for reading the corresponding data file according to the time, the port and the label required by the subscription record. The input is subscription record information; the output of which is a network packet data stream.
As shown in fig. 4, the index file of the index calculator includes the following structure:
and the time index structure is used for storing the file position or the file offset position of the network data file stored according to time.
And the label index structure is used for storing the file position or the file offset position of the network data file stored according to the label.
And the session index structure is used for storing the file position or the file offset position of the network data file stored according to the session five-tuple.
As shown in fig. 5, the subscriber includes:
a subscription registrar: the system is used for registering a business system to request an interconnection data subscription record; the subscriber has two directions to process the stream. The input of one processing flow is connected with the indexer, the input is a subscription record, the subscription record is processed by the data reader, the subscribed data is retrieved and read according to the index, the subscribed data is output to the Web server, and the subscribed data is output as the interconnected data. The other processing flow is input from the Web server, the input is a service system subscription request, the service system subscription request is processed by analyzing the tag matching rule, the output of the processing flow is connected with the acquisition processor, and the output is an updating tag matching rule control signal.
A Web server: the method is used for providing the interconnected data subscription service for the business system. The Web server also has a subscriber that has two directions to handle the flow. One of the processing flows is an interconnection data retrieval result from the subscription register, is processed by a data reader in an index memory, is output to a service system, and is output as interconnection data. And the other processing flow inputs an interconnection data subscription request from the business system, and outputs an interconnection data registration request after message conversion processing.
As shown in fig. 6, the specific implementation mechanism of the cluster manager is: and the availability of other gateways is detected among the interconnected data gateways through a timing heartbeat mechanism. And the synchronization of the subscription registration information is realized by regularly transmitting the subscription registration record information stored by each interconnected data gateway. When the service system pulls the internet data, if the request is overtime, the service system can turn to another internet data gateway to continue pulling. Since the subscription registration information is synchronized, seamless handover can be achieved.
The invention uses the light splitting technology to realize the decoupling of the interconnected data source and the service system; and data processing loss of the operating system kernel is bypassed by using the DPDK technology; meanwhile, a high-availability message queue subscription mechanism can be combined to provide flexibility; then, introducing a data index structure to improve the processing performance; and finally, combining cluster management to realize horizontal expansion and high availability.
It is well within the knowledge of a person skilled in the art to implement the system and its various devices, modules, units provided by the present invention in a purely computer readable program code means that the same functionality can be implemented by logically programming method steps in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Therefore, the system and various devices, modules and units thereof provided by the present invention can be regarded as a hardware component, and the devices, modules and units included therein for implementing various functions can also be regarded as structures within the hardware component; means, modules, units for realizing various functions can also be regarded as structures in both software modules and hardware components for realizing the methods.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.
Claims (9)
1. An interconnected data gateway, comprising:
an acquisition processor: decoding the interconnected data by using an acquisition processor, printing a subscription label for the session according to the subscription matching condition, and filtering;
an index memory: the interconnection data filtered by the acquisition processor is stored according to indexes by an indexer;
a subscriber: the stored interconnected data provides a data subscription and pulling interface for an external service system through a subscriber;
the cluster manager: a plurality of interconnected data gateways form a cluster to support high availability;
the index memory is used for writing the network data packet information flow into an index file and a data file according to a port, time, a label and a session index;
the input of the index memory is a network data packet information flow from the acquisition processor; the output of the index memory is an index file and a data file.
2. The interconnected data gateway of claim 1, wherein the collection processor receives network packets captured by the network adapter, decodes the network packets according to the network protocol specification, analyzes the quintuple information structure, and filters and screens the tag matching rules;
the input of the acquisition processor is a network adapter receiving buffer area; the output of the acquisition processor is a decoded and screened network data packet information stream.
3. The interconnected data gateway of claim 1, wherein the subscriber is configured to provide interconnected data subscription and data pull services for a business system;
the input of the subscriber is a service system interconnection data subscription request; the output of the subscriber is subscription record and interconnection data.
4. The interconnected data gateway of claim 1, wherein the cluster manager is configured to synchronize subscription records stored by a plurality of interconnected data gateways to achieve high availability and horizontal expansion;
the input of the cluster manager is an interconnection data gateway data synchronization signal; the output of the cluster manager is an interconnected data gateway availability detection recovery mechanism.
5. The interconnected data gateway of claim 2, wherein the acquisition processor comprises:
a network card collector: the network data packet capturing module is used for receiving the network data packet captured by the network adapter;
the protocol decoder: decoding the captured network data packet according to the network protocol specification;
a filter: and matching the decoded network data packet aiming at quintuple, ethernet protocol, IP protocol, vlan and Vxlan information contained in the network data packet according to a matching rule, and marking tag information, wherein a matching rule control signal is from a subscriber.
6. The interconnected data gateway of claim 1, wherein the index store comprises:
a data file writer: writing the network data packet into a disk according to an index rule;
an index calculator: calculating and assembling an index structure through port, time, session and label information in a network data packet;
a data reader: and the data reader is connected with the subscriber and is used for reading the corresponding data file according to the time, the port and the label required by the subscription record.
7. The interconnected data gateway of claim 3, wherein the subscriber comprises:
a subscription registrar: the system is used for registering a business system to request an interconnection data subscription record;
a Web server: the data subscription service system is used for providing the interconnection data subscription service for the business system.
8. A data processing system based on an interconnected data gateway, which is characterized by comprising a network terminal, a plurality of interconnected data gateway terminals and a service system, wherein the interconnected data gateway terminals comprise the interconnected data gateway of claim 1;
the network end is connected with the interconnected data gateway ends, and the plurality of interconnected data gateway ends form a cluster through a cluster manager in each interconnected data gateway end to support high availability;
and sending the data to the service system after the data are subscribed and matched with the interface through each interconnected data gateway terminal.
9. A data processing method based on the interconnected data gateway is characterized in that the data processing system based on the interconnected data gateway is adopted for data processing, interconnected data are decoded by an acquisition processor of the interconnected data gateway end in the interconnected data gateway end, a subscription label is marked for a session according to subscription matching conditions, filtering is carried out, the interconnected data are stored according to indexes through an indexer of the interconnected data gateway end, the subscriber of the interconnected data gateway end provides an interconnected data subscription and pulling interface for an external service system, and a cluster manager of the interconnected data gateway end enables a plurality of interconnected data gateway ends to form a cluster so as to support high availability.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110349753.3A CN113079087B (en) | 2021-03-31 | 2021-03-31 | Interconnected data gateway, and data processing system and method based on interconnected data gateway |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110349753.3A CN113079087B (en) | 2021-03-31 | 2021-03-31 | Interconnected data gateway, and data processing system and method based on interconnected data gateway |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113079087A CN113079087A (en) | 2021-07-06 |
| CN113079087B true CN113079087B (en) | 2022-11-22 |
Family
ID=76614693
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110349753.3A Active CN113079087B (en) | 2021-03-31 | 2021-03-31 | Interconnected data gateway, and data processing system and method based on interconnected data gateway |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113079087B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102932195A (en) * | 2011-08-09 | 2013-02-13 | 上海天旦网络科技发展有限公司 | Networking protocol analysis-based business analysis monitoring method and system |
| CN103944924A (en) * | 2014-05-15 | 2014-07-23 | 重庆邮电大学 | Ubiquitous network publish-subscribe middleware model based on RESTful |
| CN106953901A (en) * | 2017-03-10 | 2017-07-14 | 重庆邮电大学 | A kind of trunked communication system and its method for improving message transmission performance |
| CN107229639A (en) * | 2016-03-24 | 2017-10-03 | 上海宝信软件股份有限公司 | The storage system of distributing real-time data bank |
| CN108769048A (en) * | 2018-06-08 | 2018-11-06 | 武汉思普崚技术有限公司 | A kind of secure visualization and Situation Awareness plateform system |
| CN111866072A (en) * | 2020-06-10 | 2020-10-30 | 烽火通信科技股份有限公司 | Message filter expansion method, application system and application method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019041115A1 (en) * | 2017-08-29 | 2019-03-07 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and device for subscribing social network service |
| CN108183931A (en) * | 2017-12-04 | 2018-06-19 | 中国电子科技集团公司第三十研究所 | A kind of distribution subscription matching process based on demand management tree shape model |
| CN109547529B (en) * | 2018-10-16 | 2021-08-06 | 中国船舶重工集团公司第七一九研究所 | DDS-based distributed industrial data distribution method |
| CN112134915B (en) * | 2020-06-29 | 2022-10-14 | 上海金融期货信息技术有限公司 | Application layer protocol decoupling universal network processing system |
-
2021
- 2021-03-31 CN CN202110349753.3A patent/CN113079087B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102932195A (en) * | 2011-08-09 | 2013-02-13 | 上海天旦网络科技发展有限公司 | Networking protocol analysis-based business analysis monitoring method and system |
| CN103944924A (en) * | 2014-05-15 | 2014-07-23 | 重庆邮电大学 | Ubiquitous network publish-subscribe middleware model based on RESTful |
| CN107229639A (en) * | 2016-03-24 | 2017-10-03 | 上海宝信软件股份有限公司 | The storage system of distributing real-time data bank |
| CN106953901A (en) * | 2017-03-10 | 2017-07-14 | 重庆邮电大学 | A kind of trunked communication system and its method for improving message transmission performance |
| CN108769048A (en) * | 2018-06-08 | 2018-11-06 | 武汉思普崚技术有限公司 | A kind of secure visualization and Situation Awareness plateform system |
| CN111866072A (en) * | 2020-06-10 | 2020-10-30 | 烽火通信科技股份有限公司 | Message filter expansion method, application system and application method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113079087A (en) | 2021-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109284334B (en) | Real-time database synchronization method and device, electronic equipment and storage medium | |
| CN110300056B (en) | Real-time response type API gateway and request processing method thereof | |
| EP1471428B1 (en) | Event Mediation | |
| US6359656B1 (en) | In-band synchronization of data streams with audio/video streams | |
| CN106162235A (en) | Method and apparatus for Switch Video stream | |
| CN113553310B (en) | Data acquisition method and device, storage medium and electronic equipment | |
| JP2005532748A (en) | Caching including packet inspection for payload inspection, alert service, digital content delivery, and quality of service management, and selective multicasting in publish-subscribe networks | |
| CN101094389B (en) | Method for downloading video, video server, and monitoring center system | |
| CN106027414A (en) | HDFS-oriented parallel network message reading method | |
| US7206831B1 (en) | On card programmable filtering and searching for captured network data | |
| EP3101843B1 (en) | Capturing network data to provide to a data analyser | |
| CN113079087B (en) | Interconnected data gateway, and data processing system and method based on interconnected data gateway | |
| US8230002B2 (en) | Method and system for automatic setup in web-based applications | |
| KR102423039B1 (en) | Real-time packet data storing method and apparatus for mass network monitoring | |
| CN110417892B (en) | Message analysis-based data replication link optimization method and device | |
| CN107124586A (en) | Camera intelligent screening system | |
| CN107181701B (en) | The collection method and device of common gateway interface data | |
| US8819107B2 (en) | Relay apparatus, recording medium storing a relay program, and a relay method | |
| CN114531372A (en) | Data acquisition and monitoring system | |
| US7250797B1 (en) | Event edge synchronization system and method of operation thereof | |
| CN110381022B (en) | Data acquisition method and system applied to video network | |
| CN108200481B (en) | RTP-PS stream processing method, device, equipment and storage medium | |
| CN110691214B (en) | Data processing method and device for business object | |
| CN110730086B (en) | Method and device for outputting log information | |
| CN111193619A (en) | Method and device for collecting log files |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |