CN115134421A - Multi-source heterogeneous data cross-system cooperative management system and method - Google Patents
Multi-source heterogeneous data cross-system cooperative management system and method Download PDFInfo
- Publication number
- CN115134421A CN115134421A CN202210507966.9A CN202210507966A CN115134421A CN 115134421 A CN115134421 A CN 115134421A CN 202210507966 A CN202210507966 A CN 202210507966A CN 115134421 A CN115134421 A CN 115134421A
- Authority
- CN
- China
- Prior art keywords
- data
- layer
- type
- task
- source heterogeneous
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000004458 analytical method Methods 0.000 claims abstract description 29
- 238000007726 management method Methods 0.000 claims description 42
- 230000005540 biological transmission Effects 0.000 claims description 27
- 238000004590 computer program Methods 0.000 claims description 4
- 238000004806 packaging method and process Methods 0.000 claims 1
- 238000013480 data collection Methods 0.000 abstract description 5
- 238000004891 communication Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 4
- 238000013523 data management Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000002955 isolation Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000035484 reaction time Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 231100000279 safety data Toxicity 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
In the multi-source heterogeneous data cross-system collaborative management system, method and storage medium provided by the application, the system comprises a data access layer, a data bus layer and a data subscription layer. The data subscription layer is used for acquiring the data demand tasks and the types of the data demand tasks, analyzing the acquired data demand tasks, and subscribing the data of the data bus layer according to the analysis result of the data request and the types of the data demand tasks; the data bus layer is used for sending the analysis result of the data subscription layer, the data requirement task and the type of the data requirement task to the data access layer; and the data access layer is used for sending the data demand tasks and the types of the data demand tasks to the corresponding data source systems according to the analysis result of the data bus layer. According to the method and the device, the data collection and updating time is effectively shortened, the multi-subject coordination management of the multi-center heterogeneous online system is realized, and the problems of coordination management and low intensive service efficiency are solved.
Description
Technical Field
The application relates to the technical field of computer application, in particular to a multi-source heterogeneous data cross-system cooperative management system, method and storage medium.
Background
With the rapid development of remote sensing and network technologies, multi-source heterogeneous data such as satellite and aerial images, ground cross-space-time videos, network data, electromagnetic information and geographic information and the like are integrated and utilized, cross-space-time, multi-scale and multi-granularity convergence of the multi-source heterogeneous data of the sky and the space is realized, reliable, credible and expandable data support can be provided for intelligent perception and understanding of public safety events, and the method has important significance for improving the public safety event-oriented big data sharing service level, expanding a sharing service channel and enhancing the sharing service capability.
However, in the related art, the provided information interaction mode is single, only several types of data in the service system are converged and managed, and multi-source heterogeneous data of the multi-online system cannot be converged safely through a whole set of system, so that multi-subject coordination management of the multi-center heterogeneous online system is realized, and the problems of cooperative management and low intensive service efficiency exist.
Disclosure of Invention
The application provides a cross-system collaborative management system and a cross-system collaborative management method for multi-source heterogeneous data, which are used for managing cross-security-level interaction of the multi-source heterogeneous data.
An embodiment of a first aspect of the present application provides a multi-source heterogeneous data cross-system collaborative management system, including:
the data subscription layer is used for acquiring a data requirement task and the type of the data requirement task, analyzing the acquired data requirement task, and subscribing the data of the data bus layer according to the analysis result of the data request and the type of the data requirement task;
the data bus layer is used for sending the analysis result of the data subscription layer, the data requirement task and the type of the data requirement task to a data access layer;
and the data access layer is used for sending the data demand task and the type of the data demand task to a corresponding data source system according to the analysis result of the data bus layer.
An embodiment of a second aspect of the present application provides a multi-source heterogeneous data cross-system collaborative management method, including:
acquiring a data requirement task and the type of the data requirement task;
analyzing the data demand task, and sending the data demand to a corresponding data source system based on an analysis result and the type of the data demand task;
receiving data corresponding to the data demand task sent by the data source system;
and determining a corresponding transmission mode based on the type of the received data and outputting the corresponding transmission mode.
A non-transitory computer-readable storage medium as set forth in an embodiment of the third aspect of the present application, wherein the non-transitory computer-readable storage medium stores a computer program; which when executed by a processor implements the method as shown in the second aspect above.
The technical scheme provided by the embodiment of the application at least has the following beneficial effects:
in the multi-source heterogeneous data cross-system collaborative management system, method and storage medium provided by the application, the system comprises a data access layer, a data bus layer and a data subscription layer. The data subscription layer is used for acquiring the data demand tasks and the types of the data demand tasks, analyzing the acquired data demand tasks, and subscribing the data of the data bus layer according to the analysis result of the data request and the types of the data demand tasks; the data bus layer is used for sending the analysis result of the data subscription layer, the data requirement task and the type of the data requirement task to the data access layer; and the data access layer is used for sending the data demand tasks and the types of the data demand tasks to the corresponding data source systems according to the analysis result of the data bus layer. The method and the device have the advantages that standardized and intelligent targeted multisource heterogeneous data scheduling and updating strategies are provided, data collection and updating time is effectively shortened, multi-subject coordination management of a multi-center heterogeneous online system is achieved, the on-demand collection requirements of upper-layer application on multisource heterogeneous data are met, limited transmission channel resources are always used for transmitting data products which are needed by a collection user most urgently, and the problems of cooperative management and low intensive service efficiency are solved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic structural diagram of a multi-source heterogeneous data cross-system collaborative management system according to an embodiment of the present application;
FIG. 2 is a flow chart illustrating data transmission in an entity relationship in a data service bus according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a multi-source heterogeneous data cross-system collaborative management method according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
The multi-source heterogeneous data cross-system collaborative management system and method according to the embodiment of the application are described below with reference to the accompanying drawings.
Example one
Fig. 1 is a schematic structural diagram of a multi-source heterogeneous data cross-system collaborative management system according to an embodiment of the present application, and as shown in fig. 1, the multi-source heterogeneous data cross-system collaborative management system may include:
the data subscription layer is used for acquiring the data demand tasks and the types of the data demand tasks, analyzing the acquired data demand tasks, and subscribing the data of the data bus layer according to the analysis result of the data request and the types of the data demand tasks;
the data bus layer is used for sending the analysis result of the data subscription layer, the data requirement task and the type of the data requirement task to the data access layer;
the data access layer is used for sending the data demand tasks and the types of the data demand tasks to the corresponding data source systems according to the analysis result of the data bus layer;
the data access layer is also used for carrying out safe access on multi-source heterogeneous data from different data source systems;
the data bus layer is also used for receiving the multi-source heterogeneous data collected by the data access layer, defining different data domains according to different data sources of the multi-source heterogeneous data, defining different subjects under different data domains according to different data types under different data domains, and publishing the data in different data domains;
and the data subscription layer is also used for receiving the published data in the data bus layer, determining the type of the received data, and determining a corresponding transmission mode for transmission based on the type of the received data.
In the embodiment of the present invention, the data subscription layer may obtain the data requirement task and the type of the data requirement task from the data management platform. And the data management platform can manage and analyze the multi-source heterogeneous data.
And in the embodiment of the invention, the types of the data requirement tasks acquired in the data subscription layer comprise a conventional service mode requirement, an emergency service mode requirement and a special service mode requirement. The requirements for data calls and data updates vary among different types of requirements.
Specifically, in the embodiment of the present invention, the conventional service mode requirement is a user requirement under daily work or in response to a general degree of urgency; the emergency service mode requirement is a user requirement that data needs to be acquired quickly or all available and effective resources need to be mobilized in the shortest time; the special service mode requirement is a user requirement for continuously tracking a certain region or a certain time under the condition of taking special task input as a core or by task driving.
And, in embodiments of the invention, regular service pattern requirements may include regular or 7 x 24 hour real-time data update requirements; emergency service mode requirements may include data requirements for specific resource types, product grades, and time, regions, etc.; the special service mode requirements may include time period, frequency, region, image data load requirements for a clear task, and video, business data and intelligent analysis result data thereof.
Further, in the embodiment of the present invention, the analyzing, by the data subscription layer, the acquired data request includes analyzing a data requirement task to obtain a data source system number related to the data requirement task.
And in the embodiment of the invention, the data access layer can send the data demand task to the corresponding data source system according to the data source system number related to the data demand task analyzed by the data subscription layer.
It should be noted that, in the embodiment of the present invention, the multi-source heterogeneous data may include satellite remote sensing data, aerial photography remote sensing data, ground video data, network information data, geographic information data, and business information data.
In the embodiment of the invention, when the data in the multi-source heterogeneous data is different, the system where the corresponding data is located is also different. In an embodiment of the present invention, table 1 shows a corresponding relationship between a data type in multi-source heterogeneous data and a system/network where the data is located.
TABLE 1
Further, in the embodiment of the present invention, after the data source system receives the data demand task, the data corresponding to the data demand task may be sent to the cross-system collaborative management system for the multi-source heterogeneous data according to the type of the data demand task.
Specifically, in the embodiment of the present invention, when the type of the data demand task is a conventional service mode demand, if the data type is file data, the data source system periodically and actively pushes corresponding regional cataloging information, and the data transmission agent service in the data access layer monitors changes in the cataloging information and periodically sends the changes to the multi-source heterogeneous data cross-system collaborative management system; if the data type is video/service data, the data source system can acquire, update and converge the data to the multi-source heterogeneous data cross-system cooperative management system in real time; if the data type is data source data under different network system environments, cross-network data transmission and information interaction with a data bus layer in a data access layer are required.
And in the embodiment of the invention, when the type of the data demand task is the demand of the emergency service mode, if the data type is the space remote sensing data, after the data source system receives the definite entity data demand emergency task, on one hand, the priority authority can be improved through system configuration, on the other hand, conflict resolution with other tasks is completed, the satellite orbit or the attitude is adjusted in time to arrange a shooting task, data/information service is obtained in time, and the corresponding processing flow is simplified. Meanwhile, according to specific resource types, product grades, time and regional requirements, automatic distribution service is achieved through data source system background configuration and sent to a multi-source heterogeneous data cross-system collaborative management system; if the data type is unmanned aerial vehicle data, the data source system submits an air flight application after receiving an emergency task, completes the downloading processing of the flight task and the data, and transmits the flight task and the data to the data management platform through the multi-source heterogeneous data cross-system cooperative management system; if the data types are video and business data, after the data source system receives an emergency task, all video acquisition equipment in the location range of the emergency needs to be mobilized, the angle and the focal length of video acquisition are adjusted according to requirements, the event is monitored in an all-around mode, meanwhile, intelligent analysis resources are mobilized, relevant people, vehicles and objects are analyzed in real time according to the nature of the event, the event is traced, analyzed and developed and predicted, and an analysis result is transmitted to a multi-source heterogeneous data cross-system collaborative management system.
Further, in the embodiment of the present invention, when the type of the data demand task is a requirement of a special service mode, if the data type is remote sensing data, the data source system obtains the catalog information or entity data of corresponding data according to the time period, frequency, area and load requirement that the task is clear, and pushes the catalog information or entity data to the multi-source heterogeneous data cross-system collaborative management system; and if the data type is video and business data, the data source system acquires the video, the business data and an intelligent analysis result of the video and the business data in a specific time period and pushes the video, the business data and the intelligent analysis result to the multi-source heterogeneous data cross-system collaborative management system.
And in the embodiment of the invention, the data source category sent by the data source system to the multi-source heterogeneous data cross-system cooperative management system may include file data, streaming media data and short message data. In the embodiment of the invention, the file data comprises catalogue information data and entity data, and the numbers of the catalogue information data and the entity data are consistent. And the entity data capacity is large, the transmission time is long, the abnormal conditions such as network interruption or service pause can occur in the middle, and the protection mechanisms such as breakpoint continuous transmission and the like are supported in the transmission and exchange service design; the streaming media data can comprise video and sound media data, and the key performances of delay, jitter and bit error rate must be strictly controlled in the transmission process; the short message data can comprise a target message, a flight message, a WiFi message and the like, has small capacity and high frequency, and can be directly transmitted.
Further, in the embodiment of the present invention, the data access layer may perform secure access on the multi-source heterogeneous data from different system sources through the access gateway respectively. The access gateway may include an external network convergence unit, an external network proxy service unit, an isolated communication unit, an internal network convergence unit, and an internal network proxy service unit.
Specifically, in the embodiment of the invention, for satellite remote sensing image data, unmanned aerial vehicle data and ground monitoring video data, the data are collected into corresponding collecting units through an outer network collecting unit, then the data are transmitted to corresponding outer network proxy service units through different networks, the outer network service units feed back to isolation communication units of different levels through data types for differential isolation processing, after the data are processed by the isolation units, the data are sent to an inner network proxy service unit, data crossing from an outer network to an inner network is completed, and the inner network proxy service unit sends isolated safety data to the inner network collecting unit. Based on the method, the multi-source heterogeneous data is safely sent from the outer network to the inner network for further data processing through the cooperative processing of the units.
And, in embodiments of the present invention, the communication between the data bus layer and the data subscription layer is accomplished using a distributed data services bus. Wherein a domain represents a logically isolated communication network. Specifically, multiple interactions running on the same group of hosts or on the same group of hosts are isolated from each other in different domains, and data writers and data readers of different domains do not exchange data.
Specifically, in the embodiment of the present invention, the data bus layer and the data subscription layer communicate through data-centric publish/subscribe to deliver data from a publisher to interested subscribers. And, prior to communication, an establishment entity is required to establish publish/subscribe communication with each other. The distributed data service bus may include domains, data writers, publishers, data readers, subscribers, and master entities.
In the embodiment of the invention, the data bus layer can be used as a publisher, and the data subscription layer can be used as a subscriber. And, in the embodiment of the present invention, the data bus layer may define data of different sources as different domains, thereby effectively isolating the data. Within a data domain, different topics may be defined according to data type, so that data may be identified by topic. And, in embodiments of the invention, the topic is a specific domain segment, the topic having a unique topic name, data type, and a set of QOS policies. Multiple topics may be published for the same data type, and each topic may be associated with only one data type.
And, in the embodiment of the present invention, a theme can be defined for the data of the sub-type under each big data type, and the data type and QOS policy of the theme are defined according to the information to be communicated, so as to prepare for the subsequent data communication.
Further, in embodiments of the present invention, the distributed data services bus is comprised of a plurality of data domains, each domain containing a set of publishers and subscribers, and when a given data is published within a domain, it will not be received by subscribers of any other domain.
Fig. 2 is a schematic flow chart of data transmission in an entity relationship in a data service bus according to an embodiment of the present invention.
As shown in FIG. 2, in embodiments of the present invention, data writers may be used to send data, the data writers being associated with separate topics, and a particular topic may have multiple corresponding data writers. The data writer is responsible for arranging the data and transmitting the data to the publisher for transmission.
Further, in the embodiment of the present invention, the publisher is responsible for acquiring the published data and publishing the data to all relevant subscribers in the domain, and the publisher owns and manages the data writer. One data writer can only be owned by a single publisher, and one publisher can correspond to multiple data writers, based on which the same publisher can send data for multiple different topics of different data types.
Further, in embodiments of the present invention, where data readers access data received on the data service bus, a data reader is associated with a single topic, and a particular topic may correspond to more than one data reader.
Further, in the embodiment of the present invention, the subscriber is responsible for publishing data actually received by the data, the subscriber owns and manages the data reader, the association between the data reader and the subscriber is a subscription, one data reader can only own one single subscriber, and one subscriber can correspond to multiple data readers. Based on this, the same subscriber can receive data for many different topics of different data types.
Further, in the embodiment of the present invention, the multi-source heterogeneous data is sent and received in the corresponding data domain, the publisher and the subscriber are respectively used to manage a single or multiple data writers and data readers, and one data reader and one data writer must be associated with the same topic, based on which the data published by the data writer can be received by the subscribed data reader.
In embodiments of the present invention, the publish/subscribe mode reduces the consumption of sending data over the network compared to a client/server architecture, with occasional subscription requests at low bandwidth replacing a large number of high bandwidth client requests. At the same time, publish/subscribe is more efficient than client/server-side in terms of reaction time and bandwidth for periodic data exchange.
And, in an embodiment of the present disclosure, the data subscription layer corresponds to a subscriber, the subscriber in the data subscription layer receives data from the publisher, transmits it to any data reader connected thereto, and then the data reader acquires the data from the subscriber and de-compiles it as an appropriate type for the topic.
And, in the embodiment of the invention, the message subscription/publishing interface may only need to subscribe the concerned data, and when data arrives, the data may be automatically sent to the subscriber, and the data transmission is encapsulated by JSON format, which may support higher concurrency than the http interface, and the data delay is better than the http interface.
Further, in the embodiment of the present invention, the data types in the data subscription layer may include file data, video and service data, and streaming media data.
And, in the embodiment of the present invention, determining, by the data subscription layer, a corresponding transmission mode for transmission based on the type of the received data may include:
if the type of the received data is file data, the received data is transmitted after being packaged according to the file type, the file size and the file address of the file data;
if the type of the received data is streaming media, transmitting the streaming media data in real time;
and if the type of the received data is video and service data, periodically transmitting the video and the service data.
In the multi-source heterogeneous data cross-system collaborative management system provided by the application, the system comprises a data access layer, a data bus layer and a data subscription layer. The data subscription layer is used for acquiring the data demand tasks and the types of the data demand tasks, analyzing the acquired data demand tasks, and subscribing the data of the data bus layer according to the analysis result of the data request and the types of the data demand tasks; the data bus layer is used for sending the analysis result of the data subscription layer, the data requirement task and the type of the data requirement task to the data access layer; and the data access layer is used for sending the data demand tasks and the types of the data demand tasks to the corresponding data source systems according to the analysis result of the data bus layer. The method and the device have the advantages that standardized and intelligent targeted multisource heterogeneous data scheduling and updating strategies are provided, data collection and updating time is effectively shortened, multi-subject coordination management of a multi-center heterogeneous online system is achieved, the on-demand collection requirements of upper-layer application on multisource heterogeneous data are met, limited transmission channel resources are always used for transmitting data products which are needed by a collection user most urgently, and the problems of cooperative management and low intensive service efficiency are solved.
Fig. 3 is a schematic flowchart of a multi-source heterogeneous data cross-system collaborative management method according to an embodiment of the present application, and as shown in fig. 3, the method may include:
And 302, analyzing the data demand task, and sending the data demand to a corresponding data source system based on the analysis result and the type of the data demand task.
And 303, receiving data corresponding to the data demand task sent by the data source system.
And step 304, determining a corresponding transmission mode based on the type of the received data and outputting the corresponding transmission mode.
To implement the above embodiments, the present disclosure also proposes a non-transitory computer-readable storage medium.
A non-transitory computer-readable storage medium provided by an embodiment of the present disclosure stores a computer program; when being executed by a processor, the computer program can realize the multi-source heterogeneous data cross-system collaborative management system shown in FIG. 3.
In the multi-source heterogeneous data cross-system collaborative management system, method and storage medium provided by the application, the system comprises a data access layer, a data bus layer and a data subscription layer. The data subscription layer is used for acquiring the data demand tasks and the types of the data demand tasks, analyzing the acquired data demand tasks, and subscribing the data of the data bus layer according to the analysis result of the data request and the types of the data demand tasks; the data bus layer is used for sending the analysis result of the data subscription layer, the data requirement task and the type of the data requirement task to the data access layer; and the data access layer is used for sending the data demand tasks and the types of the data demand tasks to the corresponding data source systems according to the analysis result of the data bus layer. The method and the device have the advantages that standardized and intelligent targeted multisource heterogeneous data scheduling and updating strategies are provided, data collection and updating time is effectively shortened, multi-agent coordination management of a multi-center heterogeneous online system is achieved, the requirement of upper-layer application on multi-source heterogeneous data collection on demand is met, limited transmission channel resources are always used for transmitting data products which are needed most urgently by a collection user, and the problems of cooperative management and low intensive service efficiency are solved.
In the description of the present specification, reference to the description of "one embodiment," "some embodiments," "an example," "a specific example," or "some examples" or the like means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (10)
1. A multi-source heterogeneous data cross-system collaborative management system, the system comprising:
the data subscription layer is used for acquiring a data demand task and the type of the data demand task, analyzing the acquired data demand task, and subscribing the data of the data bus layer according to the analysis result of the data request and the type of the data demand task;
the data bus layer is used for sending the analysis result of the data subscription layer, the data requirement task and the type of the data requirement task to a data access layer;
and the data access layer is used for sending the data demand task and the type of the data demand task to a corresponding data source system according to the analysis result of the data bus layer.
2. The multi-source heterogeneous data cross-system collaborative management system according to claim 1,
the data access layer is also used for carrying out safe access on multi-source heterogeneous data from different data source systems;
the data bus layer is also used for receiving multi-source heterogeneous data collected by the data access layer, defining different data domains according to different data sources of the multi-source heterogeneous data, defining different subjects under the different data domains according to different data types under the different data domains, and publishing the data in the different data domains;
the data subscription layer is further configured to receive the published data in the data bus layer, determine a type of the received data, and determine a corresponding transmission mode for transmission based on the type of the received data.
3. The multi-source heterogeneous data cross-system collaborative management system according to claim 1, wherein the types of data requirement tasks obtained in the data subscription layer include regular service mode requirements, emergency service mode requirements, and special service mode requirements.
4. The system for collaborative management across systems of multi-source heterogeneous data according to claim 3, wherein the data subscription layer is further configured to parse the data requirement task to obtain a data source system number to which the data requirement task relates.
5. The multi-source heterogeneous data cross-system collaborative management system of claim 2, wherein the data bus layer configures a topic name, a data type, and a set of QOS policies for each topic.
6. The multi-source heterogeneous data cross-system collaborative management system according to claim 2, wherein the data access layer is further configured to securely access multi-source heterogeneous data from different system sources through access gateways, respectively.
7. The multi-source heterogeneous data cross-system collaborative management system of claim 2, wherein the data types in the data subscription layer include: file data, video and service data, streaming media data.
8. The multi-source heterogeneous data cross-system collaborative management system according to claim 7, wherein the data subscription layer determines a corresponding transmission mode for transmission based on the type of the received data, and the data subscription layer includes:
if the type of the received data is file data, packaging the file data according to the file type, the file size and the file address of the file data and then transmitting the file data;
if the type of the received data is streaming media, transmitting the streaming media data in real time;
and if the type of the received data is video and service data, periodically transmitting the video and the service data.
9. A multi-source heterogeneous data cross-system cooperative management method is characterized by comprising the following steps:
acquiring a data demand task and the type of the data demand task;
analyzing the data demand task, and sending the data demand to a corresponding data source system based on an analysis result and the type of the data demand task;
receiving data corresponding to the data demand task sent by the data source system;
and determining a corresponding transmission mode based on the type of the received data and outputting the corresponding transmission mode.
10. A non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method as claimed in claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210507966.9A CN115134421B (en) | 2022-05-10 | 2022-05-10 | Multi-source heterogeneous data cross-system collaborative management system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210507966.9A CN115134421B (en) | 2022-05-10 | 2022-05-10 | Multi-source heterogeneous data cross-system collaborative management system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115134421A true CN115134421A (en) | 2022-09-30 |
| CN115134421B CN115134421B (en) | 2024-02-20 |
Family
ID=83376529
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210507966.9A Active CN115134421B (en) | 2022-05-10 | 2022-05-10 | Multi-source heterogeneous data cross-system collaborative management system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115134421B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116980449A (en) * | 2023-09-14 | 2023-10-31 | 哈尔滨工程大学三亚南海创新发展基地 | Collaborative management method, system, computer equipment and medium for data resource main body |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103944955A (en) * | 2014-01-21 | 2014-07-23 | 中国科学院遥感与数字地球研究所 | Handset space information service method based on wireless network |
| CN104639496A (en) * | 2013-11-06 | 2015-05-20 | 北京航天长峰科技工业集团有限公司 | Internet of things perception information acquisition method |
| CN106570081A (en) * | 2016-10-18 | 2017-04-19 | 同济大学 | Semantic net based large scale offline data analysis framework |
| CN107819824A (en) * | 2017-10-09 | 2018-03-20 | 中国电子科技集团公司第二十八研究所 | A kind of Urban Data opens and information service system and method for servicing |
| CN108737161A (en) * | 2018-04-20 | 2018-11-02 | 中国人民解放军国防科技大学 | Real-time data bus management method and system for intelligent agent cooperation system |
| CN109460952A (en) * | 2018-10-25 | 2019-03-12 | 北京卫星信息工程研究所 | Heterogeneous network converged communication device and communication means for Emergency Logistics |
| CN109992672A (en) * | 2019-04-11 | 2019-07-09 | 华北科技学院 | Knowledge mapping construction method based on disaster scene |
| CN110532493A (en) * | 2019-08-29 | 2019-12-03 | 北京明略软件系统有限公司 | Processing method and processing device, storage medium and the electronic device of data |
| US20200050586A1 (en) * | 2017-07-31 | 2020-02-13 | Splunk Inc. | Query execution at a remote heterogeneous data store of a data fabric service |
| WO2021222384A1 (en) * | 2020-04-28 | 2021-11-04 | Strong Force Intellectual Capital, Llc | Digital twin systems and methods for transportation systems |
| US20220027417A1 (en) * | 2020-07-17 | 2022-01-27 | Rapidsos, Inc. | Modular application programming interface system |
| CN114153920A (en) * | 2021-11-19 | 2022-03-08 | 国家电投集团新疆能源化工有限责任公司 | Big data edge platform and method |
| CN114398442A (en) * | 2022-01-25 | 2022-04-26 | 中国电子科技集团公司第十研究所 | Data-driven information processing system |
-
2022
- 2022-05-10 CN CN202210507966.9A patent/CN115134421B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104639496A (en) * | 2013-11-06 | 2015-05-20 | 北京航天长峰科技工业集团有限公司 | Internet of things perception information acquisition method |
| CN103944955A (en) * | 2014-01-21 | 2014-07-23 | 中国科学院遥感与数字地球研究所 | Handset space information service method based on wireless network |
| CN106570081A (en) * | 2016-10-18 | 2017-04-19 | 同济大学 | Semantic net based large scale offline data analysis framework |
| US20200050586A1 (en) * | 2017-07-31 | 2020-02-13 | Splunk Inc. | Query execution at a remote heterogeneous data store of a data fabric service |
| CN107819824A (en) * | 2017-10-09 | 2018-03-20 | 中国电子科技集团公司第二十八研究所 | A kind of Urban Data opens and information service system and method for servicing |
| CN108737161A (en) * | 2018-04-20 | 2018-11-02 | 中国人民解放军国防科技大学 | Real-time data bus management method and system for intelligent agent cooperation system |
| CN109460952A (en) * | 2018-10-25 | 2019-03-12 | 北京卫星信息工程研究所 | Heterogeneous network converged communication device and communication means for Emergency Logistics |
| CN109992672A (en) * | 2019-04-11 | 2019-07-09 | 华北科技学院 | Knowledge mapping construction method based on disaster scene |
| CN110532493A (en) * | 2019-08-29 | 2019-12-03 | 北京明略软件系统有限公司 | Processing method and processing device, storage medium and the electronic device of data |
| WO2021222384A1 (en) * | 2020-04-28 | 2021-11-04 | Strong Force Intellectual Capital, Llc | Digital twin systems and methods for transportation systems |
| US20220027417A1 (en) * | 2020-07-17 | 2022-01-27 | Rapidsos, Inc. | Modular application programming interface system |
| CN114153920A (en) * | 2021-11-19 | 2022-03-08 | 国家电投集团新疆能源化工有限责任公司 | Big data edge platform and method |
| CN114398442A (en) * | 2022-01-25 | 2022-04-26 | 中国电子科技集团公司第十研究所 | Data-driven information processing system |
Non-Patent Citations (2)
| Title |
|---|
| XIAOLI MENG: "esearch on multi-data sources data center architecture at UOIT", 《IEEE XPLORE》 * |
| 仇林遥: "面向自然灾害应急任务的时空数据智能聚合方法", 《CNKI中国知网》, pages 1 - 2 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116980449A (en) * | 2023-09-14 | 2023-10-31 | 哈尔滨工程大学三亚南海创新发展基地 | Collaborative management method, system, computer equipment and medium for data resource main body |
| CN116980449B (en) * | 2023-09-14 | 2023-12-19 | 哈尔滨工程大学三亚南海创新发展基地 | Collaborative management method, system, computer equipment and medium for data resource main body |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115134421B (en) | 2024-02-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11637872B2 (en) | Systems and methods for allocating and managing resources in an internet of things environment using location based focus of attention | |
| US9503308B2 (en) | Method, device and system for processing content | |
| US6665262B1 (en) | Distributed fault management architecture | |
| EP2632115B1 (en) | A gateway for communication in a tactical network | |
| JP2022191446A (en) | Satellite antenna ground station service and storage medium | |
| US8819080B2 (en) | System and method for collection, retrieval, and distribution of data | |
| CA2267478C (en) | Publish & subscribe data processing apparatus, method and computer program product with use of a stream to distribute local information between neighbors in a broker structure | |
| US7676812B2 (en) | Large scale event notification system | |
| CN107493191B (en) | Cluster node and self-scheduling container cluster system | |
| US11070639B2 (en) | Network infrastructure system and method for data processing and data sharing using the same | |
| EP1872527B1 (en) | System and method for enabling group subscription for asynchronous push-based applications on a wireless device | |
| CN114328618A (en) | Cache data synchronization method, device, equipment and storage medium | |
| KR101663883B1 (en) | Image processing system and device of meteorological and environmental satellite, and method using the same | |
| CN115134421A (en) | Multi-source heterogeneous data cross-system cooperative management system and method | |
| CN112737980B (en) | Time-based network slice resource dynamic partitioning method and device | |
| WO2023001083A1 (en) | Service providing method and system, gateway, device, and storage medium | |
| CN113572859B (en) | Task cloud computing method and device in space dynamic network and storage medium | |
| US20060179342A1 (en) | Service aggregation in cluster monitoring system with content-based event routing | |
| KR102435830B1 (en) | Method and architecture of Network Infrastructure for Optimal Application Service Processing and Data Sharing among Application domains | |
| US11698874B2 (en) | Systems and methods for generic assurance framework | |
| CN116112560B (en) | Data uplink and proxy method and system based on Reactive mechanism | |
| CN114257487B (en) | System and method for managing a set of network nodes | |
| Lee et al. | Pub/sub-sum: A content summarization pub/sub protocol for information-centric networks | |
| CN111865746B (en) | System development method and device based on loop bus | |
| Gifre et al. | Interfaces for Monitoring and Data Analytics Systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |