CN110784545A - Real-time data distribution system - Google Patents
Real-time data distribution system Download PDFInfo
- Publication number
- CN110784545A CN110784545A CN201911053968.XA CN201911053968A CN110784545A CN 110784545 A CN110784545 A CN 110784545A CN 201911053968 A CN201911053968 A CN 201911053968A CN 110784545 A CN110784545 A CN 110784545A
- Authority
- CN
- China
- Prior art keywords
- module
- real
- data
- time
- manager
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a real-time data distribution system which comprises a real-time kernel module, an IOMAP module, an RPC service module, a data recording module and a data excitation module, wherein the real-time kernel module comprises a manager and a model task, the IOMAP module is interconnected with the model task of the real-time kernel module, the data excitation module is connected to the manager of the real-time kernel module, the manager of the real-time kernel module is connected to the data recording module, the RPC service module is connected to the managers of the data excitation module, the data recording module and the real-time kernel module, and the RPC service module is interconnected with an external RDTS controller. The invention removes information isolated islands, directly inputs the information of the current state into the data server, and can call each other; service isolation, namely decoupling the bottom layer processing from the upper layer service through an IOMAP module; the flexible multiplexing is realized, so that the equipment and software are not limited by a hardware environment, an operating system and an interactive interface any more, and the universality is high.
Description
Technical Field
The present invention relates to data processing systems, and more particularly, to a real-time data distribution system.
Background
With the rapid development of control, communication, computer and other technologies, the architecture of various application systems shows a network-centric trend, which puts higher demands on the real-time performance, dynamic performance and flexibility of the communication network. Modern electronic systems are complex system engineering with multi-disciplinary fusion, the related knowledge is of various types, and often, business personnel are required to work from the bottom layer to the upper layer, so that the work difficulty is increased, unnecessary learning tasks are too heavy, and the professional construction and accumulation of the business personnel cannot be concentrated. In the life cycle of an electronic system (or equipment), different departments respectively complete the life cycle by combining a plurality of processes; each department and process have input data and output results of respective stages, but input and output links among a plurality of departments and processes are not smooth, manual transmission is needed, errors are easy to occur, efficiency is low, and information is lost. In prototype design, simulation modeling and development verification work of a complex hardware cross-linking application system, factors such as a hardware environment, an operating system or an interactive interface are limited, a data processing system which is suitable for targeted design is required to meet different requirements during real-time data acquisition, mapping, calculation and distribution, and the data processing system is not universal. There is therefore a need for a highly versatile real-time data distribution system to address the above-mentioned problems.
Disclosure of Invention
The invention aims to provide a real-time data distribution system, which is a software and hardware set with high real-time data acquisition, mapping, calculation and distribution functions, can quickly complete prototype design, simulation modeling and development verification work of a complex hardware cross-linking system, provides software systems based on real-time data distribution, such as automatic testing, data analysis, human-computer interaction, virtual scenes and the like, and helps to improve the efficiency and accuracy of development and testing.
The technical solution adopted by the present invention to solve the above technical problems is to provide a real-time data distribution system, which includes a real-time kernel module, an IOMAP module, an RPC service module, a data recording module, and a data excitation module, where the real-time kernel module includes a manager and a model task, the IOMAP module is interconnected with the model task of the real-time kernel module, the data excitation module is connected to the manager of the real-time kernel module, the manager of the real-time kernel module is connected to the data recording module, and the RPC service module is connected to the managers of the data excitation module, the data recording module, and the real-time kernel module.
Furthermore, the real-time kernel module is provided with a variable pool, and the manager is responsible for maintaining all variables of the variable pool; the manager is interconnected with a plurality of model tasks, the model tasks are interconnected with external models or application software, and the manager schedules all the model tasks.
Furthermore, the RPC service module and an external RDTS controller are interconnected to form a cluster, all real-time kernel modules in the cluster adopt uniform time, the time is divided into pieces according to frames, each piece is a frame, and the minimum frame time of the real-time kernel modules is 2 ms; and the real-time kernel module finishes the data synchronous scheduling of all model tasks in each frame in sequence and informs the IOMAP module of carrying out transceiving operation through the model tasks.
Furthermore, the IOMAP module is provided with a host manager, the host manager is connected with a plurality of network working devices, the network working devices are connected with external communication board cards, and the host manager manages and controls all the communication board cards through the network working devices; the IOMAP module analyzes a defined board card IO mapping file and organizes the receiving and sending operation of the communication board card data according to the board card IO mapping file; and the IOMAP module dynamically updates the sent content according to the value of the variable managed in the real-time kernel module and stores the received data.
Furthermore, the RPC service module is provided with a TCP service interface, and the RDTS controller is connected with the RPC service module through the TCP service interface; the RDTS controller realizes remote process call through an RPC service module, and performs node management, variable management, model control and node information maintenance; the node management operation comprises the steps of controlling starting and stopping, managing the number of models loaded by the current node, managing the number of current variables and updating the current cluster information.
Further, the data recording module is used for collecting data, storing the data and managing a recording task; the data recording module is connected with the RPC service module, acquires task information from the RDTS controller, acquires and records values and timestamp data of variables in the real-time kernel variable pool through connection with a manager of the real-time kernel module according to task requirements, and asynchronously stores the data in a file system of a local disk.
Furthermore, the data excitation module comprises a data excitation unit, a data generation model unit and an excitation task management unit, wherein the excitation task management unit is connected with the RPC service module and acquires task information from the RDTS controller; the data excitation unit is connected with a manager of the real-time kernel module and excites or modifies variables in a variable pool of the real-time kernel module; the data incentive module modifies the value of the specified variable with specified content at specified times according to the requirements of the RDTS controller.
Compared with the prior art, the invention has the following beneficial effects: the real-time data distribution system provided by the invention has the following advantages: 1. the information island is removed, and the information of the current state can be directly uploaded and recorded into the data server, so that mutual calling among all departments is facilitated; 2. service isolation, and professional attention is paid; through the IOMAP module, the bottom layer processing and the upper layer service can be decoupled, so that service personnel can concentrate on the development processing of the service; 3. flexible multiplexing is realized, and the method is not limited to a hardware structure; through the model task, various devices and software formed in each stage can be simulated, such as a monitor, an exciter, a simulator and the like, so that the devices and the software are not limited by a hardware environment, an operating system and an interactive interface any more, and the universality is high.
Drawings
FIG. 1 is a schematic structural diagram of a real-time data distribution system according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a real-time kernel module according to an embodiment of the present invention;
FIG. 3 is a block diagram of an IOMAP module according to an embodiment of the invention;
FIG. 4 is a schematic structural diagram of an RPC service module according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a data recording module according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a data excitation module in an embodiment of the present invention.
Detailed Description
The invention is further described below with reference to the figures and examples.
Fig. 1 is a schematic structural diagram of a real-time data distribution system in an embodiment of the present invention.
Referring to fig. 1, the real-time data distribution system provided by the present invention includes a real-time kernel module, an IOMAP module, an RPC service module, a data recording module, and a data excitation module, wherein the real-time kernel module includes a manager and a model task, the IOMAP module is interconnected with the model task of the real-time kernel module, the data excitation module is connected to the manager of the real-time kernel module, the manager of the real-time kernel module is connected to the data recording module, the RPC service module is connected to the managers of the data excitation module, the data recording module, and the real-time kernel module, and the RPC service module is interconnected with an external RDTS controller to form a cluster.
Referring to fig. 2, in the real-time data distribution system provided by the present invention, the real-time kernel module is provided with a variable pool, and the manager is responsible for maintaining all variables of the variable pool; the manager is interconnected with a plurality of model tasks, the model tasks are interconnected with external models or application software, and the manager schedules all the model tasks. All real-time kernel modules in the cluster adopt uniform time, the time is divided into pieces according to frames, each piece is a frame, and the minimum frame time of the real-time kernel modules is 2 ms; and the real-time kernel module finishes the data synchronous scheduling of all model tasks in each frame in sequence and informs the IOMAP module of carrying out transceiving operation through the model tasks.
Referring to fig. 3, in the real-time data distribution system provided by the present invention, the IOMAP module is provided with a host manager, the host manager is connected with a plurality of network workers, the network workers are connected with external communication boards, and the host manager manages and controls all the communication boards through the network workers; the IOMAP module analyzes a defined IOMAP file (board IO mapping file) and organizes the receiving and sending operation of the communication board data according to the IOMAP file; and the IOMAP module dynamically updates the sent content according to the value of the variable managed in the real-time kernel module and stores the received data.
Referring to fig. 4, in the real-time data distribution system provided by the present invention, the RPC service module is provided with a TCP service interface, and the RDTS controller is connected to the RPC service module through the TCP service interface; the RDTS controller realizes remote process call through an RPC service module, and performs node management, variable management, model control and node information maintenance; the node management operation comprises the steps of controlling starting and stopping, managing the number of models loaded by the current node, managing the number of current variables and updating the current cluster information.
Referring to fig. 5, in the real-time data distribution system provided by the present invention, the data recording module performs data acquisition, data storage and recording task management; the data recording module is connected with the RPC service module, acquires task information from the RDTS controller, acquires and records values and timestamp data of variables in the real-time kernel variable pool through connection with a manager of the real-time kernel module according to task requirements, and asynchronously stores the data in a file system of a local disk.
Referring to fig. 6, in the real-time data distribution system provided by the present invention, the data excitation module includes a data excitation unit, a data generation model unit and an excitation task management unit, and the excitation task management unit is connected to the RPC service module and acquires task information from the RDTS controller; the data excitation unit is connected with a manager of the real-time kernel module and excites or modifies variables in a variable pool of the real-time kernel module; the data incentive module modifies the value of the specified variable with specified content at specified times according to the requirements of the RDTS controller.
The real-time data distribution system provided by the invention provides services in prototype design, simulation modeling, development and verification work, and comprises the following steps: prototype design: a system-level global physical quantity definition function is provided, and data in a global range are guaranteed to be consistent; providing an interface design function of a target equipment prototype and supporting various types of data; the target equipment model algorithm design writing function is provided, and c + +, python and c # languages are supported for writing. Simulation modeling: providing various computing hardware configurations and system selections for building a distributed simulation system; providing system-level full-equipment simulation, establishing a simulation unit for each equipment, and simulating the logic and communication of the equipment; providing logic operation time sequence simulation of real environment equipment, and ensuring that the model operation time, frequency and sequence of each simulation equipment are consistent with the actual situation; providing real environment equipment communication simulation, and simulating the real communication process of each equipment, including simulation of a communication interface, a communication protocol and communication contents; providing system-level equipment access network simulation, including 1553, 429, 422 and other bus networks; providing a board management function, and supporting the board to automatically receive and transmit synchronous data, wherein the synchronous data comprises protocol boards such as 1553, 429, 422, DIO, AD, FC, AFDX and the like; and a user-defined model operating environment is provided, and the model can be loaded, scheduled and controlled. Development and verification: providing a model algorithm development framework of each device, wherein the model algorithm development framework comprises various languages such as c + +, c #, python and the like; providing an API interface which can be used for independent third-party program development; providing an automatic code generation function, and automatically generating an interface header file; peripheral tools such as data recording, data playback, system control, and the like are provided.
In summary, the real-time data distribution system provided by the invention has the following advantages: 1. the information island is removed, and the information of the current state can be directly uploaded and recorded into the data server, so that mutual calling among all departments is facilitated; 2. service isolation, and professional attention is paid; through the IOMAP module, the bottom layer processing and the upper layer service can be decoupled, so that service personnel can concentrate on the development processing of the service; 3. flexible multiplexing is realized, and the method is not limited to a hardware structure; through the model task, various devices and software formed in each stage can be simulated, such as a monitor, an exciter, a simulator and the like, so that the devices and the software are not limited by a hardware environment, an operating system and an interactive interface any more, and the universality is high.
Although the present invention has been described with respect to the preferred embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (7)
1. The utility model provides a real-time data distribution system, its characterized in that includes real-time kernel module, IOMAP module, RPC service module, data record module and data excitation module, real-time kernel module includes manager and model task, the IOMAP module is interconnected with the model task of real-time kernel module, data excitation module is connected to the manager of real-time kernel module, the manager of real-time kernel module is connected to the data record module, RPC service module is connected to the manager of data excitation module, data record module and real-time kernel module.
2. The real-time data distribution system of claim 1, wherein the real-time kernel module is provided with a variable pool, and the manager is responsible for maintaining all variables of the variable pool; the manager is interconnected with a plurality of model tasks, the model tasks are interconnected with external models or application software, and the manager schedules all the model tasks.
3. The real-time data distribution system of claim 2, wherein the RPC service module is interconnected with an external RDTS controller to form a cluster, all real-time kernel modules in the cluster adopt uniform time and divide the time into pieces according to frames, each piece is a frame, and the minimum frame time of the real-time kernel modules is 2 ms; and the real-time kernel module finishes the data synchronous scheduling of all model tasks in each frame in sequence and informs the IOMAP module of carrying out transceiving operation through the model tasks.
4. The real-time data distribution system according to claim 1, wherein the IOMAP module is provided with a host manager, the host manager is connected with a plurality of network workers, the network workers are connected with external communication boards, and the host manager manages and controls all the communication boards through the network workers; the IOMAP module analyzes a defined board card IO mapping file and organizes the receiving and sending operation of the communication board card data according to the board card IO mapping file; and the IOMAP module dynamically updates the sent content according to the value of the variable managed in the real-time kernel module and stores the received data.
5. The real-time data distribution system of claim 1, wherein the RPC service module is provided with a TCP service interface, and the RDTS controller is connected with the RPC service module through the TCP service interface; the RDTS controller realizes remote process call through an RPC service module, and performs node management, variable management, model control and node information maintenance; the node management operation comprises the steps of controlling starting and stopping, managing the number of models loaded by the current node, managing the number of current variables and updating the current cluster information.
6. The real-time data distribution system of claim 1, wherein the data recording module performs data collection, data storage, and recording task management; the data recording module is connected with the RPC service module, acquires task information from the RDTS controller, acquires and records values and timestamp data of variables in the real-time kernel variable pool through connection with a manager of the real-time kernel module according to task requirements, and asynchronously stores the data in a file system of a local disk.
7. The real-time data distribution system of claim 1, wherein the data excitation module comprises a data excitation unit, a data generation model unit and an excitation task management unit, the excitation task management unit is connected with the RPC service module and acquires task information from the RDTS controller; the data excitation unit is connected with a manager of the real-time kernel module and excites or modifies variables in a variable pool of the real-time kernel module; the data incentive module modifies the value of the specified variable with specified content at specified times according to the requirements of the RDTS controller.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911053968.XA CN110784545B (en) | 2019-10-31 | 2019-10-31 | Real-time data distribution system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911053968.XA CN110784545B (en) | 2019-10-31 | 2019-10-31 | Real-time data distribution system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110784545A true CN110784545A (en) | 2020-02-11 |
| CN110784545B CN110784545B (en) | 2022-02-11 |
Family
ID=69388240
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911053968.XA Active CN110784545B (en) | 2019-10-31 | 2019-10-31 | Real-time data distribution system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110784545B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115904738A (en) * | 2023-01-05 | 2023-04-04 | 摩尔线程智能科技(北京)有限责任公司 | Management system and control method for data processing device cluster |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050132041A1 (en) * | 2003-12-10 | 2005-06-16 | Ashish Kundu | Systems, methods and computer programs for monitoring distributed resources in a data processing environment |
| CN101364289A (en) * | 2008-09-24 | 2009-02-11 | 中国移动通信集团福建有限公司 | Generalized flowsheet platform for corporation |
| CN101901150A (en) * | 2010-07-08 | 2010-12-01 | 北京航空航天大学 | Universal distributed airborne equipment health management simulation platform and implementation method thereof |
| CN102929158A (en) * | 2012-10-30 | 2013-02-13 | 北京华力创通科技股份有限公司 | Multi-core multi-model parallel distributed type real-time simulation system |
| CN104050332A (en) * | 2014-06-30 | 2014-09-17 | 北京索为高科系统技术有限公司 | Distributed-type real-time comprehensive simulation method of avionics system |
| CN105652752A (en) * | 2016-03-14 | 2016-06-08 | 成都爆米花信息技术有限公司 | Data acquisition system |
| CN105809352A (en) * | 2016-03-11 | 2016-07-27 | 上海埃威航空电子有限公司 | General aviation business comprehensive management and control system |
| US20170139684A1 (en) * | 2014-06-25 | 2017-05-18 | Chengdu Puzhong Software Limiteed Company | General modeling method to construct system models based on a system meta model |
| CN108897608A (en) * | 2018-05-31 | 2018-11-27 | 中国科学院软件研究所 | A kind of intelligent universal task scheduling system that data-driven is expansible |
| US20190317791A1 (en) * | 2016-10-20 | 2019-10-17 | Nr Electric Co., Ltd | Running method for embedded type virtual device and system |
-
2019
- 2019-10-31 CN CN201911053968.XA patent/CN110784545B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050132041A1 (en) * | 2003-12-10 | 2005-06-16 | Ashish Kundu | Systems, methods and computer programs for monitoring distributed resources in a data processing environment |
| CN101364289A (en) * | 2008-09-24 | 2009-02-11 | 中国移动通信集团福建有限公司 | Generalized flowsheet platform for corporation |
| CN101901150A (en) * | 2010-07-08 | 2010-12-01 | 北京航空航天大学 | Universal distributed airborne equipment health management simulation platform and implementation method thereof |
| CN102929158A (en) * | 2012-10-30 | 2013-02-13 | 北京华力创通科技股份有限公司 | Multi-core multi-model parallel distributed type real-time simulation system |
| US20170139684A1 (en) * | 2014-06-25 | 2017-05-18 | Chengdu Puzhong Software Limiteed Company | General modeling method to construct system models based on a system meta model |
| CN104050332A (en) * | 2014-06-30 | 2014-09-17 | 北京索为高科系统技术有限公司 | Distributed-type real-time comprehensive simulation method of avionics system |
| CN105809352A (en) * | 2016-03-11 | 2016-07-27 | 上海埃威航空电子有限公司 | General aviation business comprehensive management and control system |
| CN105652752A (en) * | 2016-03-14 | 2016-06-08 | 成都爆米花信息技术有限公司 | Data acquisition system |
| US20190317791A1 (en) * | 2016-10-20 | 2019-10-17 | Nr Electric Co., Ltd | Running method for embedded type virtual device and system |
| CN108897608A (en) * | 2018-05-31 | 2018-11-27 | 中国科学院软件研究所 | A kind of intelligent universal task scheduling system that data-driven is expansible |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115904738A (en) * | 2023-01-05 | 2023-04-04 | 摩尔线程智能科技(北京)有限责任公司 | Management system and control method for data processing device cluster |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110784545B (en) | 2022-02-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102880532B (en) | Cloud technology-based test system and method | |
| CN102880503A (en) | Data analysis system and data analysis method | |
| CN110689223B (en) | Robot batch management system based on RPA control | |
| CN100589422C (en) | A simulated single board and its simulation method | |
| CN105897805A (en) | Method and device for cross-layer scheduling of resources of data center with multi-layer architecture | |
| CN104486255A (en) | Service resource dispatching method and device | |
| CN102708232B (en) | Processing method and device for distributed simulation data | |
| CN109376011A (en) | The method and apparatus of resource are managed in virtualization system | |
| CN107678752A (en) | A kind of task processing method and device towards isomeric group | |
| CN108536964A (en) | Storage medium, satellite constellation covering performance simulating analysis and its system | |
| CN113822585A (en) | Intelligent smelting factory informatization management system | |
| CN110650174A (en) | MES system of distributed architecture and interaction method of client and server thereof | |
| CN113051040A (en) | Remote distributed joint simulation method in different places | |
| CN108416657A (en) | A kind of order generation method and equipment based on counseling services | |
| CN110784545B (en) | Real-time data distribution system | |
| CN113658351B (en) | Method and device for producing product, electronic equipment and storage medium | |
| CN111324460A (en) | Power monitoring control system and method based on cloud computing platform | |
| US20220067659A1 (en) | Research and development system and method | |
| CN113835830A (en) | AI-based RPA cluster management method, device and storage medium | |
| CN112633850A (en) | Method for realizing service flow automation by managing, calling and monitoring RPA robot | |
| CN105933136B (en) | A kind of resource regulating method and system | |
| WO2021220616A1 (en) | Information processing device and information processing method, computer program, and distributed training system | |
| CN102542103A (en) | Simulation comprehensive integration system capable of supporting multiple tasks on basis of WEB | |
| Li et al. | Design and Research of Aviation Test System based on Real-time Data Distribution Service | |
| CN110427260A (en) | Host job scheduling method, apparatus and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |