CN117633079A - Multi-source data operation and maintenance management system and method - Google Patents
Multi-source data operation and maintenance management system and method Download PDFInfo
- Publication number
- CN117633079A CN117633079A CN202311626487.XA CN202311626487A CN117633079A CN 117633079 A CN117633079 A CN 117633079A CN 202311626487 A CN202311626487 A CN 202311626487A CN 117633079 A CN117633079 A CN 117633079A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- vehicle
- maintenance management
- source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012423 maintenance Methods 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000007726 management method Methods 0.000 claims abstract description 69
- 238000004519 manufacturing process Methods 0.000 claims abstract description 46
- 238000000605 extraction Methods 0.000 claims description 19
- 238000003860 storage Methods 0.000 claims description 15
- 238000013500 data storage Methods 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 9
- 230000004927 fusion Effects 0.000 claims description 9
- 230000003993 interaction Effects 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 7
- 238000004140 cleaning Methods 0.000 claims description 4
- 239000000284 extract Substances 0.000 claims description 4
- 230000001360 synchronised effect Effects 0.000 claims description 4
- 230000008676 import Effects 0.000 claims description 3
- 238000004458 analytical method Methods 0.000 abstract description 5
- 230000008569 process Effects 0.000 abstract description 5
- 238000013523 data management Methods 0.000 abstract description 2
- 238000004891 communication Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 238000013439 planning Methods 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013075 data extraction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004134 energy conservation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to the technical field of data management, and provides a multi-source data operation and maintenance management system and a method, wherein the system can acquire data related to vehicles in a vehicle-mounted data acquisition system, acquire required data from an associated service system, process the acquired data, construct an asset catalog corresponding to the data and store the asset catalog, acquire the data according to a preset rule, update the corresponding data in the system, realize the integrated utilization of the data of each service system and eliminate data islands; the method is based on the system, annual production plan data and actual production operation completion data of each line can be obtained, the difference between the actual production operation completion data and the annual production plan data is judged, and early warning is sent and a comparison analysis report is constructed under the condition that the difference exceeds a preset threshold value, so that supervision of production operation conditions of each line is realized.
Description
Technical Field
The present invention relates to the field of data management technologies, and in particular, to a system and a method for managing operation and maintenance of multi-source data.
Background
With the acceleration of urban progress and the vigorous development of economy in China, urban congestion has become one of the problems to be solved in the life of residents. The rail transit has the characteristics of large traffic volume, high speed, energy conservation, environmental protection, safety, convenience, and the like, can effectively relieve urban traffic jams and enlarge urban scale, and becomes a main carrier of urban traffic. Meanwhile, higher requirements are provided for the operation safety and reliability of the rail transit vehicles, and the operation and maintenance service guarantee of the urban rail transit vehicles faces serious challenges.
At present, running information, maintenance information, production operation information and the like related to rail vehicles are usually stored in different service systems, the total data sources of the different service systems are multiple and the types of the data sources are complex, and the data information in each service system is difficult to realize the mutual combination and utilization due to the lack of a unified management center among each service system, so that a 'data island' is generated, and the requirements of intelligent operation and maintenance services of the rail vehicles cannot be met.
Disclosure of Invention
The invention provides a multisource data operation and maintenance management system and a multisource data operation and maintenance management method, which are used for solving the defect that the mutual combination and utilization of data information in each service system are difficult to realize due to the lack of a unified management center among each service system in the prior art, realizing the acquisition of the data information in each service system and providing a foundation for intelligent operation and maintenance service of a railway vehicle.
The invention provides a multisource data operation and maintenance management system, which comprises:
the vehicle-mounted data receiving module is used for acquiring data related to a vehicle in the vehicle-mounted data acquisition system;
the service system access module is used for acquiring required data from the associated service system;
the multi-source data fusion module is used for processing the acquired data;
the data storage module is used for constructing an asset catalog corresponding to the data and selecting a corresponding storage form for data storage according to different application scenes;
the data synchronization module is used for controlling the vehicle-mounted data receiving module and the service system access module to acquire the data according to preset rules and updating the corresponding data in the system.
The invention provides a multisource data operation and maintenance management system, wherein a vehicle-mounted data receiving module comprises a real-time data receiving sub-module and an offline data receiving sub-module;
the real-time data receiving sub-module is used for acquiring a data stream sequence constructed after a preset message system arranges data streams, wherein the data streams are obtained by acquiring vehicle-mounted data in real time by the vehicle-mounted data acquisition system, transmitting the vehicle-mounted data to a ground network platform through a wireless network and then transmitting the vehicle-mounted data to the message system by the ground network platform in a socket data stream mode;
the off-line data receiving sub-module is used for obtaining off-line data of the ground network platform, the off-line data are obtained by the ground network platform through a preset transmission protocol to obtain vehicle original state data, and the vehicle original state data are converted to obtain the off-line data.
The invention provides a multisource data operation and maintenance management system, which further comprises a data comparison module, wherein the data comparison module is used for comparing offline data stored in the system with the original state data of the vehicle and judging whether the offline data are wrong or not.
The invention provides a multisource data operation and maintenance management system, wherein the service system access module acquires required data from an associated service system in the following manner:
and the service system access module extracts the required data from the relational database of the associated service system through a preset data interaction tool.
According to the present invention, a multi-source data operation and maintenance management system is provided, wherein the data synchronization module controls the vehicle-mounted data receiving module and the service system access module to acquire the data according to a preset rule, and the system comprises:
under the condition that the system receives a synchronous instruction, the data synchronization module controls the data synchronization module to control the vehicle-mounted data receiving module and the service system access module to acquire data from at least one data source in a full extraction or incremental extraction mode;
and/or the data synchronization module controls the data synchronization module to control the vehicle-mounted data receiving module and the service system access module to acquire data from at least one data source in a full extraction or incremental extraction mode according to a preset period.
According to the multi-source data operation and maintenance management system provided by the invention, the processing of the acquired data by the multi-source data fusion module comprises stream processing, batch processing, data cleaning, import and export of the data and the like.
The invention provides a multisource data operation and maintenance management system, which further comprises a right management module, wherein the right management module is used for distributing and managing the user right of the system.
The invention also provides a multi-source data operation and maintenance management method which is applied to any multi-source data operation and maintenance management system, wherein the multi-source data operation and maintenance management system comprises a data comparison module, and the method comprises the following steps:
acquiring annual production plan data of each line through a service system access module;
updating the actual production operation completion data of each line through a data synchronization module;
and judging the difference between the actual production operation completion data and the annual production plan data through the data comparison module, and sending out early warning when the difference exceeds a preset threshold value.
The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the multi-source data operation and maintenance management method are realized when the processor executes the program.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the multi-source data operation and maintenance management method as described above.
The multi-source data operation and maintenance management system provided by the invention is characterized in that the vehicle-mounted data receiving module is used for acquiring the data related to the vehicle in the vehicle-mounted data acquisition system, the service system access module is used for acquiring the required data from the related service system, the multi-source data fusion module is used for processing the acquired data, the data storage module is used for constructing an asset catalog corresponding to the data, the data storage module is used for selecting the corresponding storage form according to different application scenes to store the data, the data synchronous module is used for controlling the vehicle-mounted data receiving module and the service system access module to acquire the data according to the preset rule, and the corresponding data in the system is updated, so that the integrated utilization of the data of each service system is realized, and the data island is eliminated. The multisource data operation and maintenance management method provided by the invention can acquire annual production planning data and actual production operation completion data of each line based on the management system, judge the difference between the actual production operation completion data and the annual production planning data, send out early warning and construct comparison analysis report under the condition that the difference exceeds a preset threshold value, and realize supervision of production operation conditions of each line.
Drawings
In order to more clearly illustrate the invention or the technical solutions of the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a multi-source data operation and maintenance management system provided by the present invention;
FIG. 2 is a schematic diagram of exemplary data acquisition in an embodiment of the invention;
FIG. 3 is a flow chart of a multi-source data operation and maintenance management method provided by the invention;
fig. 4 is a schematic structural diagram of an electronic device provided by the present invention.
Reference numerals:
1. a vehicle-mounted data receiving module; 2. a service system access module; 3. a multi-source data fusion module; 4. a data storage module; 5. and a data synchronization module.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The multi-source data operation and maintenance management system of the present invention is described below with reference to fig. 1.
As shown in FIG. 1, the multi-source data operation and maintenance management system provided by the invention comprises a vehicle-mounted data receiving module, a service system access module, a multi-source data fusion module, a data storage module and a data synchronization module. The multi-source data operation and maintenance management system supports high-performance computing workload, can expand computing and storage resources, and meets the high-concurrency and high-throughput requirements of data analysis. It should be understood that the multi-source data operation and maintenance management system in the invention adopts an open platform architecture, is not limited to the above functional modules, and can be customized and expanded according to actual service requirements, thereby improving the system expansibility.
The vehicle-mounted data receiving module is used for acquiring data related to a vehicle in the vehicle-mounted data acquisition system. The vehicle-mounted data acquisition system can access vehicle-mounted data to the ground network platform at 100-500 milliseconds acquisition frequency with high concurrency, or synchronize the vehicle-mounted data to the ground network platform in an interface docking mode, so that intelligent operation and maintenance data of vehicles in each line are monitored in real time, and the refinement level of operation and maintenance is improved.
In an alternative embodiment of the invention, the in-vehicle data receiving module includes a real-time data receiving sub-module and an offline data receiving sub-module.
The real-time data receiving sub-module is used for acquiring a data stream sequence constructed after a preset message system is used for organizing data streams, the data streams are obtained by acquiring vehicle-mounted data in real time by the vehicle-mounted data acquisition system, transmitting the vehicle-mounted data to the ground network platform through a wireless network and transmitting the vehicle-mounted data to the message system through the ground network platform in a data stream mode. Preferably, the message system in the present invention may employ a Kafka system, which is a high-throughput distributed publish-subscribe message system; the data stream sent to the message system by the ground network platform is a socket data stream. Specifically, after the vehicle-mounted data acquisition system acquires real-time vehicle-mounted data, the socket is used as a bottom data transmission protocol, the ground network platform provides information such as an IP address, a port, a user name, a password and the like corresponding to the server, and after the vehicle-mounted data acquisition system and the ground network platform determine an authentication strategy and the password, the server of the ground network platform receives the vehicle-mounted data sent by the vehicle-mounted data acquisition system in real time. After receiving the vehicle-mounted data, the server of the ground network platform sends Kafka in a socket data stream mode, and the Kafka sorts the data stream into a data stream sequence and orderly provides the data stream sequence for the multi-source data operation and maintenance management system to process.
The off-line data receiving sub-module is used for obtaining off-line data of the ground network platform, the off-line data are obtained by the ground network platform through a preset transmission protocol to obtain vehicle original state data, and the vehicle original state data are converted, and preferably, the transmission protocol in the invention can adopt FTP (File Transfer Protocol) protocol. Specifically, after the rail vehicle returns to the warehouse, the staff manually packs the original state data, uploads the data to the server of the ground network platform in an FTP protocol mode, and sends the data to the multi-source data operation and maintenance management system after conversion. The FTP can collect unstructured files such as videos and pictures, store the unstructured files under a designated directory, and make unified standards such as directory names, access rights, file naming modes and the like by a multi-source data operation and maintenance management system. The data access types supported by the multi-source data operation and maintenance management system are obtained after the original state data of the vehicle are converted, and include, but are not limited to, the data types in table 1:
table 1 data access type table supported by multisource data operation and maintenance management system
In an optional embodiment of the present invention, the multi-source data operation and maintenance management system further includes a data comparison module, configured to compare the offline data stored in the system with the original state data of the vehicle, and determine whether the offline data is incorrect. Specifically, after receiving the offline data, comparing the offline data with the data in the corresponding target database in the multi-source data operation and maintenance management system, and finding and solving (e.g. updating the data of the error part) the error generated in the acquisition process. Preferably, the vehicle-mounted data receiving module can record the data transmission log in the whole course of the data transmission process, including but not limited to the number of data records, the starting time, the finishing time, the error information and the like.
And the service system access module is used for acquiring the required data from the associated service system. As shown in fig. 2, the service systems associated with the multi-source data operation and maintenance management system in the present invention include, but are not limited to, IFS (Industrial and Financial Systems) systems, office automation (Office Automation, OA) systems, internet of vehicles (IOR) and integrated beside rail detection Systems (SMIT), etc., and the data required by the multi-source data operation and maintenance management system originates from the relational database of the associated service systems. Specifically, the multi-source data operation and maintenance management system provides a preset data interaction tool special for data interaction with the relational database, and preferably, the data interaction tool can adopt an ETL (Extract-Transform-Load) data interaction tool. The service system access module can extract required data from a relational database of an associated service system through the ETL data interaction tool periodically through SQL sentences. In an alternative embodiment of the invention, data interaction tools may also be used to synchronize data into the vehicle intelligent operation and maintenance platform.
Preferably, the vehicle-mounted data receiving module and the service system access module both support multi-source data access, including but not limited to time sequence data, relation data, non-relation data and the like.
The multi-source data fusion module is used for processing the acquired data, and specifically comprises, but is not limited to, data stream processing, batch processing, data cleaning, import and export and the like. The functions of task scheduling, monitoring management and the like can be provided.
And the data storage module is used for constructing an asset catalog corresponding to the data and selecting a corresponding storage form according to different application scenes to store the data. Specifically, the data storage module can form an asset catalog according to the data accessed by the vehicle-mounted data receiving module and the service system access module, and select different storage forms for data storage according to the accessed multi-source data and different application scenes.
The data synchronization module is used for controlling the vehicle-mounted data receiving module and the service system access module to acquire data according to preset rules and updating the corresponding data in the system. The data synchronization module can control the vehicle-mounted data receiving module and the service system access module to carry out data extraction operation of specified rules from different data sources (ORACLE, DB2, hadoop, FTP files, messages and the like) so as to realize unified integration of data of each domain.
The data storage in the data synchronization process supports two major categories of floor and non-floor, and the extracted data can be input into a data cleaning link or can be directly processed or loaded. From the aspect of extraction support, the method mainly comprises two modes of full extraction and increment extraction, wherein the full extraction can complete one-time extraction of all historical data; the single extraction is carried out according to the preset rule requirement. Multiple types of relational database management systems (RDBMS), MPP, distributed system infrastructure (HADOOP), etc. are supported on the extraction data source class.
Specifically, the data synchronization module updates the corresponding data in the system in at least one of the following two manners:
(1) Under the condition that the system receives a synchronous instruction, the data synchronization module controls the data synchronization module to control the vehicle-mounted data receiving module and the service system access module to acquire data from at least one data source in a full extraction or incremental extraction mode;
(2) The data synchronization module controls the vehicle-mounted data receiving module and the service system access module to acquire data from at least one data source in a full extraction or incremental extraction mode according to a preset period.
In an optional embodiment of the present invention, the multi-source data operation and maintenance management system further includes a rights management module, configured to allocate and manage user rights of the system.
In particular, users can be classified into a system administrator and a system operation and maintenance administrator. The system manager has the authority of the common user and the system management authority of the application platform, and has the user management, authorization management, log management and function configuration management authority. The system operation and maintenance manager has the highest level of ordinary user authority and is used for testing the system function operation and maintenance and the authority of the system response abnormality analysis function in the system operation and maintenance module.
In summary, according to the multi-source data operation and maintenance management system provided by the invention, the vehicle-mounted data receiving module is used for obtaining the data related to the vehicle in the vehicle-mounted data acquisition system, the service system access module is used for obtaining the required data from the related service system, the multi-source data fusion module is used for processing the obtained data, the data storage module is used for constructing an asset catalog corresponding to the data, the corresponding storage form is selected for data storage according to different application scenes, the data synchronization module is used for controlling the vehicle-mounted data receiving module and the service system access module to obtain the data according to the preset rule, and the corresponding data in the system is updated, so that the efficient aggregation of multi-source heterogeneous data is realized, the data island is broken through, and the data resource sharing is realized.
Based on the same inventive concept, the invention also provides a multi-source data operation and maintenance management method which is applied to any multi-source data operation and maintenance management system, wherein the multi-source data operation and maintenance management system comprises a data comparison module. Specifically, as shown in fig. 3, the method includes the steps of:
s1, annual production plan data of each line are obtained through a service system access module.
S2, updating actual production operation completion data of each line through a data synchronization module.
And S3, judging the difference between the actual production operation completion data and the annual production plan data through the data comparison module, and sending out early warning when the difference exceeds a preset threshold value.
Specifically, the operation and maintenance personnel compile annual production plans of each line according to historical data, vehicle conditions and the like, and the plan content comprises the number of periodic maintenance tasks, the number of system updating and transformation tasks, material demands and the like. After the production center receives the annual production plans of each line, a plan model is built in the multi-source data operation and maintenance management system, and the service system of each line is accessed through the service system access module. Along with the time, the actual production operation completion condition of each line can be synchronously updated into the system of the production center through the data synchronization module, and the data comprise specific maintenance work order completion conditions, material consumption conditions and the like. The multi-source data operation and maintenance management system can extract the actually completed production operation data, and compare the actually completed production operation data with the planning model through the data comparison module, wherein the comparison is mainly performed around the planned key nodes, such as the periodic maintenance number which should be completed in a month/quarter, the update and reconstruction number of a specific system, the material consumption data and the like. If the difference between the actual completion condition and the plan exceeds a preset threshold, the multi-source data operation and maintenance management system can generate progress tracking early warning to prompt relevant responsible personnel to follow up, and the production center can generate comparison analysis reports which are fed back to each line and operation and maintenance management department and used for adjusting the completion progress of the production plan.
In summary, by applying the method, the real-time monitoring of each production task and material consumption of the production center can be realized, the transparency of the production process is improved, production planning and progress supervision are assisted by personnel, and the production management process is closed-loop. The working efficiency is improved, comprehensive analysis and comparison with the data of multiple lines are supported, and multi-dimensional production supervision is realized.
Fig. 4 illustrates a physical schematic diagram of an electronic device, as shown in fig. 4, which may include: processor 410, communication interface (Communications Interface) 420, memory 430 and communication bus 440, wherein processor 410, communication interface 420 and memory 430 communicate with each other via communication bus 440. Processor 410 may invoke logic instructions in memory 430 to perform a multi-source data operation and maintenance management method comprising:
annual production plan data of each line is obtained through a service system access module.
And updating the actual production operation completion data of each line through a data synchronization module.
And judging the difference between the actual production operation completion data and the annual production plan data through the data comparison module, and sending out early warning when the difference exceeds a preset threshold value.
Further, the logic instructions in the memory 430 described above may be implemented in the form of software functional units and may be stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the multi-source data operation and maintenance management method provided by the above methods, the method comprising:
annual production plan data of each line is obtained through a service system access module.
And updating the actual production operation completion data of each line through a data synchronization module.
And judging the difference between the actual production operation completion data and the annual production plan data through the data comparison module, and sending out early warning when the difference exceeds a preset threshold value.
In yet another aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, is implemented to perform the above-provided multi-source data operation and maintenance management method, the method comprising:
annual production plan data of each line is obtained through a service system access module.
And updating the actual production operation completion data of each line through a data synchronization module.
And judging the difference between the actual production operation completion data and the annual production plan data through the data comparison module, and sending out early warning when the difference exceeds a preset threshold value.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A multi-source data operation and maintenance management system, comprising:
the vehicle-mounted data receiving module is used for acquiring data related to a vehicle in the vehicle-mounted data acquisition system;
the service system access module is used for acquiring required data from the associated service system;
the multi-source data fusion module is used for processing the acquired data;
the data storage module is used for constructing an asset catalog corresponding to the data and selecting a corresponding storage form for data storage according to different application scenes;
the data synchronization module is used for controlling the vehicle-mounted data receiving module and the service system access module to acquire the data according to preset rules and updating the corresponding data in the system.
2. The multi-source data operation and maintenance management system according to claim 1, wherein the vehicle-mounted data receiving module comprises a real-time data receiving sub-module and an offline data receiving sub-module;
the real-time data receiving sub-module is used for acquiring a data stream sequence constructed after a preset message system arranges data streams, wherein the data streams are obtained by acquiring vehicle-mounted data in real time by the vehicle-mounted data acquisition system, transmitting the vehicle-mounted data to a ground network platform through a wireless network and transmitting the vehicle-mounted data to the message system in a data stream form by the ground network platform;
the off-line data receiving sub-module is used for obtaining off-line data of the ground network platform, the off-line data are obtained by the ground network platform through a preset transmission protocol to obtain vehicle original state data, and the vehicle original state data are converted to obtain the off-line data.
3. The multi-source data operation and maintenance management system according to claim 2, further comprising a data comparison module for comparing the offline data stored in the system with the vehicle original state data to determine whether the offline data is erroneous.
4. The multi-source data operation and maintenance management system according to claim 1, wherein the service system access module obtains the required data from the associated service system by the following manner:
and the service system access module extracts the required data from the relational database of the associated service system through a preset data interaction tool.
5. The multi-source data operation and maintenance management system according to claim 1, wherein the data synchronization module controls the vehicle-mounted data receiving module and the service system access module to acquire the data according to a preset rule, and the method comprises the following steps:
under the condition that the system receives a synchronous instruction, the data synchronization module controls the data synchronization module to control the vehicle-mounted data receiving module and the service system access module to acquire the data from at least one data source in a full extraction or incremental extraction mode;
and/or the data synchronization module controls the data synchronization module to control the vehicle-mounted data receiving module and the service system access module to acquire the data from at least one data source in a full extraction or incremental extraction mode according to a preset period.
6. The multi-source data operation and maintenance management system according to any one of claims 1-5, wherein the processing of the acquired data by the multi-source data fusion module includes streaming, batch processing, data cleaning, import and export of the data, and the like.
7. The multi-source data operation and maintenance management system according to any one of claims 1-5, further comprising a rights management module for assigning and managing user rights to the system.
8. A multi-source data operation and maintenance management method applied to the multi-source data operation and maintenance management system according to any one of claims 1-7, wherein the multi-source data operation and maintenance management system comprises a data comparison module, and is characterized by comprising:
acquiring annual production plan data of each line through a service system access module;
updating the actual production operation completion data of each line through a data synchronization module;
and judging the difference between the actual production operation completion data and the annual production plan data through the data comparison module, and sending out early warning when the difference exceeds a preset threshold value.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the multi-source data operation and maintenance management method of claim 8 when the program is executed by the processor.
10. A non-transitory computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the steps of the multi-source data operation and maintenance management method of claim 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311626487.XA CN117633079A (en) | 2023-11-29 | 2023-11-29 | Multi-source data operation and maintenance management system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311626487.XA CN117633079A (en) | 2023-11-29 | 2023-11-29 | Multi-source data operation and maintenance management system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117633079A true CN117633079A (en) | 2024-03-01 |
Family
ID=90015946
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311626487.XA Pending CN117633079A (en) | 2023-11-29 | 2023-11-29 | Multi-source data operation and maintenance management system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117633079A (en) |
-
2023
- 2023-11-29 CN CN202311626487.XA patent/CN117633079A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105404701A (en) | Peer-to-peer network-based heterogeneous database synchronization method | |
| CN111327681A (en) | Cloud computing data platform construction method based on Kubernetes | |
| CN112600891B (en) | Information physical fusion-based edge cloud cooperative system and working method | |
| CN109933631A (en) | Distributed parallel database system and data processing method based on Infiniband network | |
| CN105138661A (en) | Hadoop-based k-means clustering analysis system and method of network security log | |
| CN103049482B (en) | The implementation method that in a kind of distributed heterogeneous system, data fusion stores | |
| US20230219605A1 (en) | Cloud platform-based comprehensive line network monitoring method and system | |
| CN107330580A (en) | Power marketing Base data platform construction method | |
| CN109361576A (en) | A kind of PIM monitoring data processing method and system | |
| CN111538720B (en) | Method and system for cleaning basic data of power industry | |
| CN105095496A (en) | Method for monitoring MYSQL table space through ZABBIX | |
| CN106056322A (en) | Smart grid scheduling system based on cloud computing | |
| CN115934856A (en) | Method and system for constructing comprehensive energy data assets | |
| CN111913933A (en) | Power grid historical data management method and system based on unified support platform | |
| CN107403227A (en) | A kind of equipment O＆M Synergistic method, apparatus and system across enterprise | |
| CN105335900A (en) | Integrated data processing method based on power equipment state monitoring system | |
| CN114706994A (en) | Operation and maintenance management system and method based on knowledge base | |
| CN111077851A (en) | Chemical process fault diagnosis system based on gas chromatography fog calculation framework | |
| CN113392154A (en) | Data system based on SOA framework and distributed deployment database | |
| Li et al. | Hadoop-Based University Ideological and Political Big Data Platform Design and Behavior Pattern Mining | |
| CN106709016A (en) | Service bus-based data exchange method | |
| CN117633079A (en) | Multi-source data operation and maintenance management system and method | |
| CN113706101B (en) | Intelligent system architecture and method for power grid project management | |
| CN111105202A (en) | Equipment management system | |
| CN112101894A (en) | Coal dressing intelligent system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |