CN113094614A - Data distribution method, system and device - Google Patents
Data distribution method, system and device Download PDFInfo
- Publication number
- CN113094614A CN113094614A CN201911335369.7A CN201911335369A CN113094614A CN 113094614 A CN113094614 A CN 113094614A CN 201911335369 A CN201911335369 A CN 201911335369A CN 113094614 A CN113094614 A CN 113094614A
- Authority
- CN
- China
- Prior art keywords
- data
- subscriber
- configuration file
- attribute information
- distribution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000013507 mapping Methods 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 12
- 238000004891 communication Methods 0.000 abstract description 4
- 238000013500 data storage Methods 0.000 abstract description 4
- 230000000694 effects Effects 0.000 description 21
- 230000008569 process Effects 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- TVZRAEYQIKYCPH-UHFFFAOYSA-N 3-(trimethylsilyl)propane-1-sulfonic acid Chemical compound C[Si](C)(C)CCCS(O)(=O)=O TVZRAEYQIKYCPH-UHFFFAOYSA-N 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000003999 initiator Substances 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a data distribution method, a system and a device, and belongs to the technical field of communication. In the data distribution method, a plurality of data storage areas are not needed to be arranged so as to facilitate corresponding data subscribers to read data, but topics and configuration files published by publishers are directly received, attribute information in the configuration files is analyzed, when the attribute information is matched with the existing attribute information of the subscribers, the topics are analyzed when the topics are subscribed by the subscribers, otherwise, if the attribute information is not matched, the topics received by the subscribers are not subscribed by the subscribers, the topics are abandoned. Therefore, in the data distribution method, a data point storage area does not need to be arranged for each subscriber or each equipment interface file, and the phenomenon that data in the database explodes and grows along with the increase of the number of themes is avoided.
Description
Technical Field
The present invention relates to the field of communications, and in particular, to a method, a system, and an apparatus for data distribution.
Background
A Data Distribution Service (DDS) can implement a publish and subscribe Service for Data. In general, data transmitted in a network is defined as a Topic (Topic), and generation and reception objects of the data are respectively defined as a Publisher (Publisher) and a Subscriber (Subscriber), thereby constituting a publish/subscribe transmission model of the data.
In the prior art, a DSS-based distributed industrial data distribution method (CN201811203990) is available. Specifically, an equipment interface file is created for each abstract device, mapping relations between data subscribers and data publishers and between data subscribers and DDS topics in the abstract device are established, a real-time database is created, and the real-time database is divided into a plurality of data point storage areas corresponding to the equipment interface files one to one. Associating the data point storage area with the equipment interfaces of the data publisher and the data subscriber according to the subscription and release relation mapping table, publishing the interface data of the data publisher to a network by a DDS theme after collecting the interface data of the data publisher, decoding the interface data of the theme according to a DDS protocol, writing the decoded data into the corresponding data point storage area, reversely inquiring the data subscriber corresponding to the theme according to the subscription and release relation mapping table, and calling the equipment interface of the data subscriber to inform the data subscriber to read the theme data. The abstract device comprises a hardware device and a software device which generate data and consume data in the system.
Because the data point storage areas correspond to the device interface files one to one, the corresponding data point storage area on each device interface file is larger and larger with the continuous increase of themes, and due to numerous abstract devices, the data stored in the real-time database is increased in a multiple manner, so that the query and subsequent maintenance of the real-time database are inconvenient.
Disclosure of Invention
In order to solve the problem that the data quantity stored in a database is increased explosively with the increase of the number of themes in a data distribution method, the invention provides a data distribution method, a data distribution system and a data distribution device.
In a first aspect, in the data distribution method provided by the present invention, a subscriber receives topic data published by a publisher, where the subscriber includes existing attribute information; the method comprises the following steps:
receiving topic data and a corresponding configuration file issued by a publisher;
analyzing the configuration file, wherein attribute information is stored in the configuration file;
and when the attribute information in the configuration file is matched with the existing attribute information, analyzing the theme data.
In the above data distribution method, the existing attribute information includes: existing region information and/or an existing privilege level;
when the attribute information in the configuration file is matched with the existing attribute information, analyzing the theme data comprises:
and when the area information in the configuration file is matched with the existing area information and/or the permission level in the configuration file is matched with the existing permission level, analyzing the theme data corresponding to the configuration file.
In the above data distribution method, the sender and the subscriber of the data distribution are in a tree hierarchy structure, and the tree hierarchy structure includes: the system comprises a root node and at least one layer of subtrees, wherein each layer of subtrees comprises at least one subtree;
the receiving of the topic data and the corresponding configuration file issued by the publisher includes:
receiving subject data and corresponding configuration files which are issued to all subtrees by a publisher; or
Receiving topic data and a corresponding configuration file transmitted by a subscriber of the previous level; or
And receiving topic data and a corresponding configuration file delivered by the same-layer subscriber.
The data distribution method described above, the method further comprising:
and when the attribute information in the configuration file is not matched with the existing attribute information, abandoning to analyze the theme data.
In a second aspect, the present invention provides a data distribution method, including:
obtaining theme data written by a user and generating a configuration file corresponding to the theme data;
setting the configuration file, and storing attribute information of a subscriber corresponding to the theme data;
and sending the theme data and the corresponding configuration file to a subscriber so as to analyze the theme data in the subscriber with matched attribute information.
In the above data distribution method, the attribute information includes: the subscriber's zone information and/or permission level;
setting the configuration file, and storing the attribute information of the subscriber corresponding to the theme data, wherein the attribute information comprises the following steps:
acquiring a subscriber identifier corresponding to the topic data based on the mapping relation between the topic and the subscriber identifier;
acquiring the area information and/or the authority level of the subscriber identification based on the mapping relation between the subscriber identification and the area information and/or based on the mapping relation between the subscriber identification and the authority level;
and storing the area information and/or the authority level of the subscriber into the configuration file.
In the above data distribution method, the sender and the subscriber of the data distribution are in a tree hierarchy structure, and the tree hierarchy structure includes: the system comprises a root node and at least one layer of subtrees, wherein each layer of subtrees comprises at least one subtree;
the attribute information further includes distribution type information including: at least one of global distribution, hierarchical distribution, and cross-domain distribution;
sending the topic data and the corresponding configuration file to a subscriber comprises the following steps:
when the distribution type information comprises global distribution, the theme data and the corresponding configuration file are sent to all lower-layer subscribers;
when the distribution type information comprises hierarchical distribution, the theme data and the corresponding configuration file are sent to a subscriber layer by layer;
and when the distribution type information comprises cross-domain distribution, distributing the topic data and the corresponding configuration file to the subscriber in a same layer in a cross-domain manner.
In a third aspect, the present invention provides a data distribution system comprising a memory and a processor;
the memory stores existing attribute information;
the processor is used for determining whether the attribute information in the received configuration file is matched with the existing attribute information so as to determine whether to analyze the theme data.
In a fourth aspect, the present invention provides an apparatus comprising: memory, a processor and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the method as claimed in any one of the above.
In a fifth aspect, the invention provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method as claimed in any one of the above.
Compared with the prior art, a data point storage area is arranged for each equipment interface, and corresponding data is written into the data point storage area corresponding to each equipment interface file during data distribution so that a data subscriber can read subject data from the data storage area. In the data distribution method, a plurality of data storage areas are not needed to be arranged so as to facilitate corresponding data subscribers to read data, but topics and configuration files published by publishers are directly received, attribute information in the configuration files is analyzed, when the attribute information is matched with the existing attribute information of the subscribers, the topics are analyzed when the topics are subscribed by the subscribers, otherwise, if the attribute information is not matched, the topics received by the subscribers are not subscribed by the subscribers, the topics are abandoned. It can be seen that in the data distribution method of the present invention, it is not necessary to set a data point storage area for each subscriber or each device interface file, and the phenomenon of explosive growth of data in the database caused by the increase of the number of topics is avoided.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic diagram of a publish/subscribe messaging model;
FIG. 2 is a flow chart of a data distribution method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a subscription tree in accordance with an embodiment of the present invention;
FIG. 4 is a flowchart of a data distribution method according to a second embodiment of the present invention;
fig. 5 is a flowchart of a data distribution method according to a third embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the specific embodiments of the present invention and the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
For the convenience of understanding of those skilled in the art, the embodiments of the present invention will be briefly described in terms of basic terms designed in the embodiments of the present application.
DDS is a communication model based on a publish/subscribe transmission mode. Publish/subscribe middleware provides a simple, intuitive way to distribute data, separating the software that creates and sends data (publishers) from the software that receives and uses data (subscribers). The publisher declares its sending intent and publishes the data, the subscriber declares its receiving intent, and the middleware automatically transfers the data.
Referring to fig. 1, the main entity objects to be established in the publish/subscribe schema include: domain (Domain), Domain participant (DomainParticipant), data writer (DataWriter), Publisher (Publisher), data reader (DataReader), Subscriber (Subscriber), and Topic (Topic).
The substrate structure in the DDS is a domain, and the domain binds the applications together for communication, and any two entities in the DDS need to communicate in the same domain. The domain participants are entry points of the DDS for creating, deleting, and managing services, such as creating, deleting, and managing publishers, subscribers, topics, and the like. The publisher is an object responsible for the actual data transmission, and owns and manages at least one data writer. The subscriber is an object responsible for publishing the actual reception of data, and the subscriber owns and manages at least one data reader. The data reader is used for accessing the received data. When data is sent to an application, it is first processed by a subscriber, and the data sample is then stored in an appropriate data reader for presentation to the user.
Themes are objects that are agreed upon when data writers and data readers communicate identically, and each data writer and data reader must be bound to one theme. The data writer and the publisher belong to a publishing terminal, the data reader and the subscriber term a subscribing terminal, and the topic is a bridge between the publishing terminal and the subscribing terminal.
In the embodiment of the present invention, the publishing terminal may also be used as a subscribing terminal, and at this time, the subscribing terminal is used as the publishing terminal correspondingly.
Example one
Fig. 2 is a flowchart of a data distribution method in an exemplary embodiment of the present invention, where an execution subject in the first embodiment of the present invention is a subscriber, a subscriber of the subscriber receives topic data published by a publisher, the subscriber includes existing attribute information, and a data distribution process includes the following steps.
And S020, receiving the theme data and the corresponding configuration file issued by the publisher.
S040: and analyzing the configuration file, wherein the attribute information is stored in the configuration file. The attribute information includes at least one of region information and authority information about a subscriber of the topic data.
S060: and when the attribute information in the configuration file is matched with the existing attribute information, analyzing the theme data. Specifically, when the area information in the configuration file is matched with the existing area information and the permission level in the configuration file is matched with the existing permission level, the theme data corresponding to the configuration file is analyzed. Of course, it may also be that only when the area information in the configuration file matches the existing area information, the theme data corresponding to the configuration file is analyzed; or only when the permission level in the configuration file is matched with the existing permission level, the theme data corresponding to the configuration file is analyzed. Specifically, the matching of the existing region information and the region information means that the existing region information and the region information are the same or meet a preset matching relationship, and the matching of the existing permission level and the permission level means that the existing permission level and the permission level are the same or meet the preset matching relationship.
Actually, there is a corresponding relationship between the region information and the authority level, for example, if the region information is a business department, the corresponding authority level is level 4, and if the region information is a city, the corresponding authority level is level 2, and so on. In the embodiment of the invention, the attribute information comprises the area information and the authority level, so that the accuracy of the attribute information is improved.
Therefore, in the embodiment of the present invention, after receiving the theme data, the subscriber determines whether to parse the theme data according to the attribute information in the configuration file, instead of parsing the theme data directly after obtaining the main data from the data storage area as in the prior art.
In the embodiment of the present invention, S081: and when the attribute information in the configuration file is not matched with the existing attribute information, abandoning to analyze the theme data.
Specifically, S081 may also be followed by S082: and acquiring the distribution type in the attribute information, and determining whether to publish the theme data and the corresponding configuration file to a subscriber of a next level or the same level according to the distribution type. If the distribution type is global distribution, the theme data and the corresponding configuration file are abandoned; if the distribution type is hierarchical distribution, the topic data and the corresponding configuration file are published to a subscriber of the next hierarchy; and if the distribution type is cross-domain distribution, the topic data and the corresponding configuration file are published to the subscribers with the same upper layer and the same level.
In the embodiment of the present invention, S090: and reading the parsed subject data. Specifically, the data reader of the subscriber reads the parsed topic data and displays the topic data to the user of the subscriber.
In addition, in the embodiments of the present invention, the execution subject in S020, S040, and S060 is specifically a subscriber of the subscription end, and the execution subject in S090 is a data reader of the subscription end.
In the data distribution of the embodiment of the invention, the publisher and the subscriber are in a tree hierarchy structure, the tree hierarchy structure comprises a root node and at least one layer of sub-tree, and each layer of sub-tree comprises at least one sub-tree. As shown in fig. 3, the root node is a province, and city is a first-level sub-tree of the root node, which is shown in fig. 3; the sub-tree at the next level of the city is a district and is a sub-tree at the first level in the image xx; and so on. In the publish-subscribe mode, the previous layer can publish the topic data and the configuration files to all the hierarchies lower than the previous layer, or publish the topic data and the configuration files to the same layer, while the next layer cannot publish the topic data and the configuration files to the previous layer. Specifically, as shown in fig. 3, a city can distribute topic data to subtrees at all levels of prefecture, department of business, and below, but cannot distribute topic data to provinces.
When attribute information is set for each topic data, the attribute information further includes distribution type information, and the distribution type information includes: at least one of global distribution, hierarchical distribution, and cross-domain distribution. And distributing the theme data to the subscribing terminal according to different rules according to the distribution type.
Specifically, S020 includes S021 and/or S022 and/or S023.
S021, receiving the theme data and the corresponding configuration files which are published to all the subtrees by the publisher. I.e. global distribution. The publisher sends all the theme data and the corresponding configuration files to all the subtrees, in other words, the root node of the highest level sends the theme data and the corresponding configuration files to all the nodes in the city and below, all the nodes in the city and below automatically analyze the configuration files, determine whether an existing authority level matched with the authority level in the configuration files exists or not, determine whether the theme data is analyzed or not after determining whether existing matching information matched with the area information in the configuration files exists or not, and prepare for a data reader to read the theme data.
S022: and receiving topic data and a corresponding configuration file delivered by a subscriber of the previous level, namely hierarchical distribution. Specifically, the publisher publishes the topic data and the corresponding configuration file to the next-layer subscriber, and the topic data and the corresponding configuration file are redistributed to the next-layer subscriber by the next-layer subscriber. And each layer of subscribers packages the topic data and the configuration file and then releases the topic data and the configuration file to the next layer of subscribers. For example, in fig. 3, the province publishes the topic data and the corresponding configuration file, wherein one of the prefectures is the final subscriber, and the subscription prefectures receives the topic data and the corresponding configuration file published by the province and delivered through the city.
S023: and receiving topic data and a corresponding configuration file delivered by the same-layer subscriber, namely cross-domain distribution. Specifically, the topic data and the corresponding configuration file delivered by the same-layer subscriber with the same upper layer may be received. For example, in fig. 3, if the business office 1 is a publisher and the business office 2 is a subscriber, the business office 2 can receive the theme data and the corresponding profile published by the business office 1. In specific application, data transmitted by the same-layer subscribers on the same upper layer are received, nodes on the same layer can be compared, the difference of subscribed themes between the nodes on the same layer is analyzed, and theme data are improved. Taking an actual business as an example, the business department 1 has a sales promotion activity 1, the business department 2 has a sales promotion activity 2, and the profit of the sales promotion activity 1 is larger than the profit of the sales promotion activity 2, so that the sales promotion activity 1 of the business department 1 can be transmitted to the business department 2, the sales promotion activity is developed in the business department 2, the profit effect is analyzed, the reason why the profits of the sales promotion activity 1 and the sales promotion activity 2 are different is found, and the arrangement of the sales promotion activity is improved.
In S023, the initiator of the process is the previous node, that is, the business department 1 initiated by prefecture 1 issues the subject data of the sales promotion 1 to the business department 2.
Of course, all the received topic data and corresponding configuration files in S021, S022, and S023 need to be matched with the existing attribute information of the subscriber before the topic data is parsed.
In addition, in S020, in order to reduce the transmission pressure between the publishing end and the subscribing end, the subscribing end receives the data packet in a package compressed state, and the data packet includes the theme data and the corresponding configuration file. Therefore, S020 may include S024 and S025.
S024: and receiving a data packet in a packaging compression state, wherein the data packet is issued by a publisher and contains theme data and a corresponding configuration file. And the data packet encrypts the theme data and the corresponding configuration file.
S025: and decompressing the data packet to obtain the theme data and the corresponding configuration file. And respectively decrypting the theme data and the corresponding configuration file. Through data packet transmission, the transmission pressure between the publisher and the subscriber can be relieved.
In addition, in the data distribution method of the embodiment of the invention, the HDFS distributed file system can be used for storage based on a Hadoop distributed system architecture. Of course, in practical application, other system architectures may also be adopted, and are not described in detail.
Example two
Fig. 4 is a flowchart of a data distribution method in an exemplary embodiment of the present invention, where an execution main body in a second embodiment of the present invention is a distribution end, and a flow of data distribution includes the following steps.
S130, obtaining the theme data written by the user and generating a configuration file corresponding to the theme data.
S150, setting the configuration file and storing the attribute information of the subscriber corresponding to the theme data. The attribute information includes: at least one of regional information or a privilege level of the subscriber.
S170: and sending the theme data and the corresponding configuration file to a subscriber so as to analyze the theme data in the subscriber with matched attribute information.
In the embodiment of the invention, the publisher directly sends the theme data and the configuration file to the subscribers, the configuration file stores the attribute information of the subscribers corresponding to the theme data, and each subscriber determines whether to analyze the theme data according to the attribute information after receiving the theme data. Wherein the execution body of S130 is a data writer of the issuing end, and the execution bodies of S150 and S170 are issuers of the issuing end.
Specifically, S150 includes S151, S152, and S153.
S151: and acquiring the subscriber identification corresponding to the topic data based on the mapping relation between the topic and the subscriber identification. The mapping of topics to subscriber identities is generated or updated upon updating topics or upon receiving a subscription request from a subscriber and may be stored in a database. And inquiring the mapping relation between the topic and the subscriber identification to obtain the subscriber identification corresponding to the topic data.
S152: acquiring the area information of the subscriber identification based on the mapping relation between the subscriber identification and the area information, and acquiring the authority level of the subscriber identification based on the mapping relation between the subscriber identification and the authority level. Of course, the area information of the subscriber identity may be obtained only based on the mapping relationship between the subscriber identity and the area information, or the authority level of the subscriber identity may be obtained only based on the mapping relationship between the subscriber identity and the authority level. The mapping relationship between the subscriber identity and the permission level and the mapping relationship between the subscriber identity and the area information are also generated or updated when the subject is updated or when a subscription request of the subscriber is received, and can be stored in the database.
S153: and storing the area information and the authority level of the subscriber into the configuration file. Of course, if only the area information is acquired, only the area information is stored in the configuration file; and if only the permission level is acquired, only the permission level is stored in the configuration file.
S170: and sending the theme data and the corresponding configuration file to a subscriber so as to analyze the theme data in the subscriber with matched attribute information. The publisher maps the subject data and corresponding configuration files
The sender and the subscriber of the data distribution of the embodiment of the invention are in a tree hierarchy structure, and the tree hierarchy structure comprises: the system comprises a root node and at least one layer of subtrees, wherein each layer of subtrees comprises at least one subtree. The attribute information corresponding to the subject data also comprises distribution type information, the distribution type information comprises at least one of global distribution, layered distribution and cross-domain distribution, and the distribution rules of the subject data are different according to different distribution types. Therefore, S171, S172, and S173 are included in S170.
S171: and when the distribution type information comprises global distribution, sending the theme data and the corresponding configuration file to all the lower-layer subscribers. For example, in FIG. 3, City 1 is a publisher that publishes topic data and corresponding configuration files to all levels below City 1, including prefecture 1 and prefecture 2, i.e., all nodes below.
S172: and when the distribution type information comprises hierarchical distribution, the theme data and the corresponding configuration file are sent to the subscriber layer by layer. For example, in fig. 3, city 1 is a publisher that publishes topic data to prefecture 1, then prefecture 1 publishes topic data to business 1, and so on.
S173: and when the distribution type information comprises cross-domain distribution, distributing the topic data and the corresponding configuration file to the subscriber in a same layer in a cross-domain manner. For example, in fig. 3, if the business office 1 is a publisher and the business office 2 is a subscriber, the business office 2 can receive the theme data and the corresponding profile published by the business office 1. Taking an actual business as an example, the business department 1 has a sales promotion activity 1, the business department 2 has a sales promotion activity 2, and the profit of the sales promotion activity 1 is larger than the profit of the sales promotion activity 2, so that the sales promotion activity 1 of the business department 1 can be transmitted to the business department 2, the sales promotion activity is developed in the business department 2, the profit effect is analyzed, the reason why the profits of the sales promotion activity 1 and the sales promotion activity 2 are different is found, and the arrangement of the sales promotion activity is improved.
S174 and S175 are also included in S170.
S174: and packaging and compressing the theme data and the corresponding configuration file to obtain a data packet in a packaged and compressed state. Specifically, the data packet may be obtained by encrypting the theme data and the corresponding configuration file, respectively.
S175: and sending the data packet in the encapsulated compressed state to a subscriber.
EXAMPLE III
The third embodiment of the invention provides a specific data distribution process. For example, the city 1 in fig. 2 issues a piece of theme data and profile, the attribute information of which is that the regional information is the business department, the authority level is 4 levels, and the distribution type is hierarchical distribution. The topic data and the profile are sent from city 1 to prefecture 1 and prefecture 2, prefecture 1 and prefecture 2 analyze the profile, look up tables 1 and 2, determine the subscriber representation (user I D) and the distribution type (for example, hierarchical distribution) corresponding to the topic data, and look up and determine the authority level and the regional information in tables 3 and 4 according to the user ID, for example, determine the regional information as the business department and the authority level as the 4 level, thereby determining the attribute information of the topic information. Since the attribute information does not match the existing attribute information (existing regional information and existing permission level) of the prefecture 1 and prefecture 2 themselves, the prefecture 1 and prefecture 2 do not analyze the subject information, and the subject data and the configuration file are distributed to the next hierarchy, that is, the business division 1, the business division 2, and the business division 3, according to the distribution type in the attribute information. The business department 1, the business department 2 and the business department 3 respectively receive the configuration file, look up tables 1-4, determine that the regional information in the configuration file is the business department, the authority level is 4 grade, and the regional information and the authority level are matched with the existing regional information and the existing authority level, analyze the subject data, and read the analyzed subject data by the data reader.
In the data distribution process of the embodiment of the present invention, referring to fig. 5, after a topic is generated, topic data is written in a data writer, and a configuration file is generated (step (r)). The data writer formats the subject data and sends it to the publisher (step two). And the publisher inquires the table 1, the table 2, the table 3 and the table 4 to generate attribute information corresponding to the theme data, and stores the attribute information in a configuration file. Thereafter, the publisher publishes the topic data and the corresponding configuration file to the subscriber (step c). The subscriber analyzes the configuration file, and if the configuration file is matched with the configuration file, the analyzed theme data is sent to the data reader (step four). The data reader receives the analyzed theme data, continues formatting processing to obtain corresponding data, and displays the data to the user (step (c)).
TABLE 1
TABLE 2
TABLE 3
TABLE 4
Example four
The embodiment of the invention provides a data distribution system, a device and a computer readable storage medium.
The embodiment of the invention provides a data distribution system, which comprises a memory and a processor. The memory stores existing attribute information and the processor is configured to determine whether attribute information in the received configuration file matches the existing attribute information to determine whether to parse the subject data.
The data distribution system provided in the embodiment of the present invention may further execute the method executed by the filtering system of the data packet in fig. 2, and implement the functions of the data distribution system in the embodiment shown in fig. 2, which are not described herein again.
An apparatus provided in an embodiment of the present invention includes: a memory, a processor and a computer program stored on said memory and executable on said processor, the computer program realizing the steps of the above-mentioned data distribution method when executed by said processor.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the data distribution method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A data distribution method is characterized in that a subscriber receives topic data published by a publisher, wherein the subscriber comprises existing attribute information; the method comprises the following steps:
receiving topic data and a corresponding configuration file issued by a publisher;
analyzing the configuration file, wherein attribute information is stored in the configuration file;
and when the attribute information in the configuration file is matched with the existing attribute information, analyzing the theme data.
2. The data distribution method according to claim 1, wherein the existing attribute information includes: existing region information and/or an existing privilege level;
when the attribute information in the configuration file is matched with the existing attribute information, analyzing the theme data comprises:
and when the area information in the configuration file is matched with the existing area information and/or the permission level in the configuration file is matched with the existing permission level, analyzing the theme data corresponding to the configuration file.
3. The data distribution method according to claim 1, wherein the sender and the subscriber of the data distribution are a tree hierarchy, the tree hierarchy comprising: the system comprises a root node and at least one layer of subtrees, wherein each layer of subtrees comprises at least one subtree;
the receiving of the topic data and the corresponding configuration file issued by the publisher includes:
receiving subject data and corresponding configuration files which are issued to all subtrees by a publisher; or
Receiving topic data and a corresponding configuration file transmitted by a subscriber of the previous level; or
And receiving topic data and a corresponding configuration file delivered by the same-layer subscriber.
4. The data distribution method of claim 1, wherein the method further comprises:
and when the attribute information in the configuration file is not matched with the existing attribute information, abandoning to analyze the theme data.
5. A method for data distribution, comprising:
obtaining theme data written by a user and generating a configuration file corresponding to the theme data;
setting the configuration file, and storing attribute information of a subscriber corresponding to the theme data;
and sending the theme data and the corresponding configuration file to a subscriber so as to analyze the theme data in the subscriber with matched attribute information.
6. The data distribution method according to claim 5, wherein the attribute information includes: the subscriber's zone information and/or permission level;
setting the configuration file, and storing the attribute information of the subscriber corresponding to the theme data, wherein the attribute information comprises the following steps:
acquiring a subscriber identifier corresponding to the topic data based on the mapping relation between the topic and the subscriber identifier;
acquiring the area information and/or the authority level of the subscriber identification based on the mapping relation between the subscriber identification and the area information and/or based on the mapping relation between the subscriber identification and the authority level;
and storing the area information and/or the authority level of the subscriber into the configuration file.
7. The data distribution method according to claim 5, wherein the sender and the subscriber of the data distribution are a tree hierarchy, the tree hierarchy comprising: the system comprises a root node and at least one layer of subtrees, wherein each layer of subtrees comprises at least one subtree;
the attribute information further includes distribution type information including: at least one of global distribution, hierarchical distribution, and cross-domain distribution;
sending the topic data and the corresponding configuration file to a subscriber comprises the following steps:
when the distribution type information comprises global distribution, the theme data and the corresponding configuration file are sent to all lower-layer subscribers;
when the distribution type information comprises hierarchical distribution, the theme data and the corresponding configuration file are sent to a subscriber layer by layer;
and when the distribution type information comprises cross-domain distribution, distributing the topic data and the corresponding configuration file to the subscriber in a same layer in a cross-domain manner.
8. A data distribution system comprising a memory and a processor;
the memory stores existing attribute information;
the processor is used for determining whether the attribute information in the received configuration file is matched with the existing attribute information so as to determine whether to analyze the theme data.
9. An apparatus, comprising: memory, processor and computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, carries out the steps of the method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911335369.7A CN113094614A (en) | 2019-12-23 | 2019-12-23 | Data distribution method, system and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911335369.7A CN113094614A (en) | 2019-12-23 | 2019-12-23 | Data distribution method, system and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113094614A true CN113094614A (en) | 2021-07-09 |
Family
ID=76663845
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911335369.7A Pending CN113094614A (en) | 2019-12-23 | 2019-12-23 | Data distribution method, system and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113094614A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114553657A (en) * | 2022-02-09 | 2022-05-27 | 北京润科通用技术有限公司 | Data management method and device |
| CN115277886A (en) * | 2022-07-30 | 2022-11-01 | 重庆长安汽车股份有限公司 | Vehicle data acquisition method based on data distribution service |
| CN115550439A (en) * | 2022-11-29 | 2022-12-30 | 杭州涂鸦信息技术有限公司 | Event management system and method |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102789491A (en) * | 2012-07-03 | 2012-11-21 | 河海大学 | Configurable data subscribing and publishing system and method thereof |
| US20170208140A1 (en) * | 2016-01-14 | 2017-07-20 | The Industry & Academic Cooperation In Chungnam National University (Iac) | System and method for endpoint discovery based on data distribution service |
| CN107888499A (en) * | 2017-11-17 | 2018-04-06 | 北京邮电大学 | A kind of distribution subscription system and message forwarding method based on SDN |
| CN108183931A (en) * | 2017-12-04 | 2018-06-19 | 中国电子科技集团公司第三十研究所 | A kind of distribution subscription matching process based on demand management tree shape model |
| CN109428922A (en) * | 2017-08-29 | 2019-03-05 | 华为技术有限公司 | A kind of subscription dissemination method and server |
| CN109547529A (en) * | 2018-10-16 | 2019-03-29 | 中国船舶重工集团公司第七〇九研究所 | A kind of distributed industrial data distributing method based on DDS |
| CN109861741A (en) * | 2019-01-29 | 2019-06-07 | 深圳市赛为智能股份有限公司 | It is tethered at Unmanned Aerial Vehicle Data distribution method, device, computer equipment and storage medium |
| CN109905481A (en) * | 2019-03-08 | 2019-06-18 | 电子科技大学 | A kind of building of the Qos model based on RTI-DDS and the runnability prediction technique of Qos strategy protocol |
-
2019
- 2019-12-23 CN CN201911335369.7A patent/CN113094614A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102789491A (en) * | 2012-07-03 | 2012-11-21 | 河海大学 | Configurable data subscribing and publishing system and method thereof |
| US20170208140A1 (en) * | 2016-01-14 | 2017-07-20 | The Industry & Academic Cooperation In Chungnam National University (Iac) | System and method for endpoint discovery based on data distribution service |
| CN109428922A (en) * | 2017-08-29 | 2019-03-05 | 华为技术有限公司 | A kind of subscription dissemination method and server |
| CN107888499A (en) * | 2017-11-17 | 2018-04-06 | 北京邮电大学 | A kind of distribution subscription system and message forwarding method based on SDN |
| CN108183931A (en) * | 2017-12-04 | 2018-06-19 | 中国电子科技集团公司第三十研究所 | A kind of distribution subscription matching process based on demand management tree shape model |
| CN109547529A (en) * | 2018-10-16 | 2019-03-29 | 中国船舶重工集团公司第七〇九研究所 | A kind of distributed industrial data distributing method based on DDS |
| CN109861741A (en) * | 2019-01-29 | 2019-06-07 | 深圳市赛为智能股份有限公司 | It is tethered at Unmanned Aerial Vehicle Data distribution method, device, computer equipment and storage medium |
| CN109905481A (en) * | 2019-03-08 | 2019-06-18 | 电子科技大学 | A kind of building of the Qos model based on RTI-DDS and the runnability prediction technique of Qos strategy protocol |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114553657A (en) * | 2022-02-09 | 2022-05-27 | 北京润科通用技术有限公司 | Data management method and device |
| CN114553657B (en) * | 2022-02-09 | 2024-01-30 | 北京润科通用技术有限公司 | Data management method and device |
| CN115277886A (en) * | 2022-07-30 | 2022-11-01 | 重庆长安汽车股份有限公司 | Vehicle data acquisition method based on data distribution service |
| CN115550439A (en) * | 2022-11-29 | 2022-12-30 | 杭州涂鸦信息技术有限公司 | Event management system and method |
| CN115550439B (en) * | 2022-11-29 | 2023-04-11 | 杭州涂鸦信息技术有限公司 | Event management system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200327546A1 (en) | Systems, devices, and methods for dlt-based data management platforms and data products | |
| CN105138592B (en) | A kind of daily record data storage and search method based on distributed structure/architecture | |
| US9489445B2 (en) | System and method for distributed categorization | |
| CN113094614A (en) | Data distribution method, system and device | |
| US8560610B2 (en) | Unified collection and distribution of data | |
| US9396448B2 (en) | Distributed and open schema interactions management system and method | |
| US20170031874A1 (en) | Blockchain and deep links for mobile apps | |
| US8024291B2 (en) | Message generator | |
| US7437373B2 (en) | Method and system for correlating information | |
| CN113972986A (en) | Block chain-based industrial internet identification information analysis method and related device | |
| US10169117B2 (en) | Interfacing between a caller application and a service module | |
| CN102571720A (en) | Method and device for processing heterogeneous information contents | |
| CN109688047B (en) | Message adaptation method, device and storage medium based on XML | |
| CN103368921A (en) | Distributed user modeling system and method for intelligent device | |
| CN110414259B (en) | Method and equipment for constructing data category and realizing data sharing | |
| CN110110005A (en) | The management-control method of key message basic data assets based on block chain | |
| CN113094334B (en) | Digital service method, device, equipment and storage medium based on distributed storage | |
| EP2738980A1 (en) | Third-party communications to social networking system users using descriptors | |
| CN110245014B (en) | Data processing method and device | |
| US11977837B2 (en) | Consent to content template mapping | |
| US9058348B2 (en) | Method for building and maintaining trusted supplier records | |
| CN110888695A (en) | Method and device for generating page based on permission | |
| US20180144150A1 (en) | Unified instance authorization based on attributes and hierarchy assignment | |
| US10652341B2 (en) | Restful interface system for an application | |
| CN112597105A (en) | Processing method of file associated object, server side equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210709 |