CN111427939A - Data distribution method, device and system for intelligent ship - Google Patents

Data distribution method, device and system for intelligent ship Download PDF

Info

Publication number
CN111427939A
CN111427939A CN202010206181.9A CN202010206181A CN111427939A CN 111427939 A CN111427939 A CN 111427939A CN 202010206181 A CN202010206181 A CN 202010206181A CN 111427939 A CN111427939 A CN 111427939A
Authority
CN
China
Prior art keywords
data
ship
intelligent
module
platform
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010206181.9A
Other languages
Chinese (zh)
Inventor
华先亮
张亮亮
顾一清
李鑫
吴振华
孙赛
黄建涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Merchant Ship Design and Research Institute of CSSC No 604 Research Institute
Original Assignee
Shanghai Merchant Ship Design and Research Institute of CSSC No 604 Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Merchant Ship Design and Research Institute of CSSC No 604 Research Institute filed Critical Shanghai Merchant Ship Design and Research Institute of CSSC No 604 Research Institute
Priority to CN202010206181.9A priority Critical patent/CN111427939A/en
Publication of CN111427939A publication Critical patent/CN111427939A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/258Data format conversion from or to a database
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/04Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/565Conversion or adaptation of application format or content
    • H04L67/5651Reducing the amount or size of exchanged application data

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Computer Hardware Design (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Quality & Reliability (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention provides a data distribution method, a device and a system of an intelligent ship, and relates to the technical field of intelligent ships.A data distribution method of the intelligent ship is applied to an intelligent ship integration platform, and data requirements of various intelligent applications are summarized by acquiring data requirement information of different intelligent applications; receiving ship state data sent by a ship acquisition device; processing the ship state data; and distributing the processed ship state data to different intelligent applications according to the data demand information. Therefore, data can be acquired by each intelligent application, repeated construction of a signal acquisition system is avoided, cost is saved, and the requirement that a plurality of intelligent applications acquire data simultaneously can be met.

Description

Data distribution method, device and system for intelligent ship
Technical Field
The invention relates to the technical field of intelligent ships, in particular to a data distribution method, device and system of an intelligent ship.
Background
At present, the intellectualization of ships becomes a great trend of global shipping industry, and related intelligent applications (such as intelligent navigation, an intelligent ship body, an intelligent engine room, intelligent energy efficiency and the like) are carried through the overall design of an intelligent ship, so that the functions of assistant decision, remote control, unmanned autonomous and the like of the ship are realized. The normal operating of above-mentioned intelligent application all needs the corresponding state data of boats and ships, and these state data gather through marine sensor on the boats and ships, and each intelligent application needs gather marine sensor's data by oneself through signal acquisition system, and this can cause a large amount of repeated construction of signal acquisition system to marine sensor most can only single-pass output, can't satisfy the demand that a plurality of intelligence were used and are gathered simultaneously.
Disclosure of Invention
The invention aims to provide a data distribution method and device of an intelligent ship and an intelligent ship integration platform, so as to relieve the technical problems that each intelligent application of the intelligent ship acquires data by itself, a large amount of repeated construction of a signal acquisition system is caused, and the requirement of simultaneous acquisition of a plurality of intelligent applications cannot be met.
In a first aspect, a data distribution method for a smart ship, provided in an embodiment of the present invention, is applied to a smart ship integration platform, and the method includes:
acquiring data demand information of different intelligent applications;
receiving ship state data sent by a ship acquisition device;
processing the ship state data;
and distributing the processed ship state data to different intelligent applications according to the data demand information.
Further, the method further comprises:
receiving ship data sent by different intelligent applications;
compressing and encrypting the ship data, and sending the compressed and encrypted ship data to a shore-based system;
receiving response data sent by the shore-based system for the ship data;
and sending the response data to different intelligent applications.
Further, the step of processing the ship state data includes:
and carrying out format conversion and cleaning on the ship state data.
In a second aspect, the data distribution apparatus for a smart ship provided in an embodiment of the present invention is applied to a smart ship integration platform, and the apparatus includes:
the first receiving module is used for acquiring data demand information of different intelligent applications;
the second receiving module is used for receiving the ship state data sent by the ship acquisition equipment;
the processing module is used for processing the ship state data;
and the distribution module is used for distributing the processed ship state data to different intelligent applications according to the data demand information.
Further, the method also comprises the following steps:
the third receiving module is used for receiving ship data sent by different intelligent applications;
the first sending module is used for compressing and encrypting the ship data and sending the compressed and encrypted ship data to a shore-based system;
the fourth receiving module is used for receiving response data which is sent by the shore-based system and aims at the ship data;
and the second sending module is used for sending the response data to different intelligent applications.
In a third aspect, an embodiment of the present invention provides a data distribution system for a smart ship, including:
the ship acquisition equipment is used for acquiring ship state data and sending the ship state data to the intelligent ship integration platform;
the intelligent ship integration platform is used for acquiring data demand information of different intelligent applications, receiving the ship state data sent by the ship acquisition equipment, processing the ship state data, and distributing the processed ship state data to different intelligent applications according to the data demand information;
and the intelligent application is used for receiving the processed ship state data sent by the intelligent ship integration platform.
Further, the smart ship integration platform comprises:
the gateway module is used for being connected with different intelligent applications and different ship acquisition equipment respectively;
the data platform module is based on an Apache NiFi platform and used for receiving ship state data sent by the ship acquisition equipment through the gateway module, processing the ship state data and distributing the processed streaming data to different intelligent applications through the gateway module according to the data demand information;
the management platform module is used for carrying out visual configuration on data acquisition, data processing and data distribution of the data platform module;
and the application platform module is used for integrating different pages of the intelligent application and carrying out state alarm on the ship state data.
Further, the gateway module is also used for connecting with a shore-based system;
the data platform module is further configured to receive, through the gateway module, ship data sent by different intelligent applications, send the ship data to the shore-based system, receive response data, which is sent by the shore-based system and is specific to the ship data, and send the response data to different intelligent applications.
Further, the data platform module comprises:
the stream computing layer is used for acquiring, processing and distributing the ship state data based on the Apache NiFi platform through the configuration of the management platform module;
and the database is used for storing the ship state data and the data required by the management platform module.
And the unified service interface is used for being connected with the management platform module, the application platform module or the intelligent application.
Further, the gateway module supports at least the following communication protocols:
DDS protocol, TCP protocol, MODBUS TCP protocol, FTP protocol, SFTP protocol.
The embodiment of the invention provides a data distribution method and a data distribution device for an intelligent ship, which are applied to an intelligent ship integration platform, and summarize data requirements of various intelligent applications by acquiring data requirement information of different intelligent applications; receiving ship state data sent by a ship acquisition device; processing the ship state data; and distributing the processed ship state data to different intelligent applications according to the data demand information. Therefore, data can be acquired by each intelligent application, repeated construction of a signal acquisition system is avoided, cost is saved, and the requirement that a plurality of intelligent applications acquire data simultaneously can be met.
According to the data distribution system of the intelligent ship, provided by the embodiment of the invention, ship state data are sent to the intelligent ship integrated platform through the ship acquisition equipment; the intelligent ship integration platform acquires data demand information of different intelligent applications, receives ship state data sent by the ship acquisition equipment, processes the ship state data, and distributes the processed ship state data to different intelligent applications according to the data demand information. Therefore, data can be acquired by each intelligent application, repeated construction of a signal acquisition system is avoided, cost is saved, and the requirement that a plurality of intelligent applications acquire data simultaneously can be met.
In addition, the intelligent ship integration platform adopts an Apache NiFi stream processing framework, so that the modular configuration of an acquisition end and the visual configuration of data processing and distribution processes are realized, the learning difficulty of a user is reduced, and the system reusability is improved. Meanwhile, a visual configuration module is designed aiming at the ship differentiated scene, so that the dynamic configuration of the system is realized, and the compatibility of the system is improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart of a data distribution method for an intelligent ship according to an embodiment of the present invention;
fig. 2 is a flowchart of a data distribution method for another smart ship according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a data distribution device of a smart ship according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a data distribution device of another smart ship according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a data distribution system of a smart ship according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a logic architecture of an intelligent ship integration platform according to an embodiment of the present invention;
fig. 7 is a data processing flowchart of the smart ship integration platform according to the embodiment of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the following embodiments, and it should be understood that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
At present, the normal operating of the intelligent application that intelligent ship carried on all needs the corresponding state data of boats and ships, and these state data gather through marine sensor on the boats and ships, and each intelligent application needs to gather marine sensor's data by oneself through signal acquisition system, and this can cause signal acquisition system's a large amount of repeated construction to marine sensor most can only single output, can't satisfy the demand that a plurality of intelligence were used and are gathered simultaneously. Based on this, the data distribution method, the device and the system for the intelligent ship provided by the embodiment of the invention do not need each intelligent application to automatically acquire data, avoid repeated construction of a signal acquisition system, save cost and meet the requirement that a plurality of intelligent applications acquire data simultaneously.
To facilitate understanding of the embodiment, first, a detailed description is given below of a data distribution method for an intelligent ship disclosed in the embodiment of the present invention.
Referring to fig. 1, a data distribution method for a smart ship provided in an embodiment of the present invention is applied to a smart ship integration platform, and the method includes the following steps:
step S101, acquiring data demand information of different intelligent applications;
step S102, receiving ship state data sent by a ship acquisition device;
step S103, processing ship state data;
and step S104, distributing the processed ship state data to different intelligent applications according to the data demand information.
Specifically, the intelligent application may be a software system in a server or a computer in a local area network in which the intelligent ship integration platform is located, such as an intelligent navigation, an intelligent ship body, an intelligent engine room, an intelligent energy efficiency, and the like, and the normal operation of the intelligent application requires corresponding state data of the ship, such as current bow draft, stern draft, roll angle, speed, heading, rudder angle, or host power of the ship, and the state data is acquired by a ship acquisition device, such as various ship sensors.
The required state data of different intelligent applications are different, and the server sends the data demand of each intelligent application to intelligent ship integration platform, and this platform gathers all data demands, and what ship state data need be gathered to every intelligent application promptly. Meanwhile, the intelligent ship integration platform can collect ship state data collected by each ship collection device, namely data collection can be uniformly carried out, then the ship state data are processed, and corresponding ship state data are distributed to the intelligent ship integration platform according to data requirements of each intelligent application.
According to the data distribution method of the intelligent ship, the data requirements of all intelligent applications can be summarized, data are collected and processed in a unified mode, corresponding ship state data are distributed to the intelligent applications according to the summarized data requirements, the intelligent applications do not need to collect data by themselves, repeated construction of a signal collection system is avoided, cost is saved, and the requirement that a plurality of intelligent applications collect data simultaneously can be met.
The above-mentioned intelligent ship integration platform of this embodiment can adopt Apache NiFi stream processing frame, builds integration platform through this frame and reads the configuration with database configuration and NiFi procedure, and the automatic file distribution task that accomplishes utilizes a series of logics to filter the analysis show with the result of file distribution simultaneously, does not rely on traditional programming to realize, reinforcing scalability and self-adaptability that can be very big.
In practical application, the operation of the intelligent ship needs shore-based support, and the shipowner company needs to supervise the real-time state of the ship, so the intelligent application needs to perform data interaction with a shore-based center. At present, each intelligent application is respectively communicated with a shore-based center, various algorithms can be generated in the data compression and encryption processes, and the shore-based center also needs to deploy corresponding decompression and decryption algorithms, so that on one hand, extra overhead of hardware resources can be generated, on the other hand, repeated transmission of data can be generated, and satellite broadband flow is wasted.
In view of the above problem, as shown in fig. 2, the smart ship integration platform of this embodiment may further perform the following steps:
step S201, receiving ship data sent by different intelligent applications;
step S202, ship data are compressed and encrypted, and the compressed and encrypted ship data are sent to a shore-based system;
step S203, receiving response data aiming at ship data sent by a shore-based system;
and step S204, sending response data to different intelligent applications.
Specifically, above-mentioned boats and ships data can be the real-time status of boats and ships, and intelligent ship integration platform does not need intelligent application to go to bank base system transmission data by oneself through the boats and ships data transmission that can be with each intelligent application to can adopt unified bank transmission algorithm, including compression, encryption algorithm etc. and can receive bank base system's relevant data simultaneously, realize the bank passback. Therefore, in the embodiment, the shore-based center does not need to deploy various decompression and decryption algorithms for each intelligent application, and only needs to deploy the algorithms for the data transmitted by the intelligent ship integrated platform, so that the waste of hardware resources is avoided, the repeated transmission of the data can also be avoided, and the satellite broadband flow is saved.
In the above embodiment, the ship collecting device may be various ship sensors, and formats of data transmitted to the smart ship integration platform are different, and therefore, in this embodiment, the step S103 includes: and carrying out format conversion and cleaning on the ship state data. The data with different formats are subjected to standardized conversion and then cleaned, and the data which do not meet the normal data condition are filtered so as to be distributed to each intelligent application.
The embodiment of the invention provides a data distribution method of an intelligent ship, wherein an intelligent ship integration platform acquires data demand information of different intelligent applications and summarizes data demands of the intelligent applications; receiving ship state data sent by a ship acquisition device; processing the ship state data; and distributing the processed ship state data to different intelligent applications according to the data demand information. Therefore, data can be acquired by each intelligent application, repeated construction of a signal acquisition system is avoided, cost is saved, and the requirement that a plurality of intelligent applications acquire data simultaneously can be met.
Referring to fig. 3, a data distribution apparatus for a smart ship according to an embodiment of the present invention is applied to a smart ship integration platform, and the apparatus includes:
the first receiving module 31 is configured to obtain data requirement information of different intelligent applications;
the second receiving module 32 is configured to receive ship state data sent by the ship acquisition device;
the processing module 33 is used for processing the ship state data;
and the distribution module 34 is configured to distribute the processed ship state data to different intelligent applications according to the data demand information.
In an alternative embodiment, as shown in fig. 4, the apparatus further comprises:
a third receiving module 41, configured to receive ship data sent by different intelligent applications;
the first sending module 42 is configured to compress and encrypt the ship data, and send the compressed and encrypted ship data to a shore-based system;
a fourth receiving module 43, configured to receive response data for the ship data sent by the shore-based system;
a second sending module 44, configured to send the response data to a different smart application.
In an alternative embodiment, the processing module 33 is specifically configured to:
and carrying out format conversion and cleaning on the ship state data.
It is clear to those skilled in the art that, for convenience and brevity of description, specific implementation procedures of the foregoing method embodiments may be referred to for specific working procedures of the foregoing apparatus embodiments, and are not described herein again.
Referring to fig. 5, an embodiment of the present invention provides a data distribution system for a smart ship, including:
the ship acquisition equipment 52 is used for acquiring ship state data and sending the ship state data to the intelligent ship integration platform;
the intelligent ship integration platform 53 is used for acquiring data demand information of different intelligent applications, receiving ship state data sent by the ship acquisition equipment, processing the ship state data, and distributing the processed ship state data to different intelligent applications according to the data demand information;
and the intelligent application 51 is used for receiving the processed ship state data sent by the intelligent ship integration platform.
In this embodiment, the integrated platform of intelligent boats and ships specifically includes:
the gateway module is used for being connected with different intelligent applications and ship acquisition equipment respectively;
the data platform module is based on an Apache NiFi platform and used for receiving ship state data sent by the ship acquisition equipment through the gateway module, processing the ship state data and distributing the processed ship state data to different intelligent applications through the gateway module according to data demand information.
The Apache NiFi platform is an easy-to-use, powerful and reliable data processing and distributing system. Based on a Web graphical interface, programming based on a flow is completed through dragging, connecting and configuring, and functions such as data acquisition are realized.
And the management platform module is used for carrying out visual configuration on data acquisition, data processing and data distribution of the data platform module.
And the application platform module is used for integrating different intelligent application pages and performing state alarm on ship state data.
Specifically, the application platform module comprises application integration and alarm integration. The application integration comprises the steps of providing unified user management, login, function menus and an integrated interface, and the user can simultaneously display the interfaces of all intelligent applications only by logging in once. The alarm integration comprises automatic early warning reminding, current early warning inquiry, historical early warning inquiry, early warning elimination and the like of ship state data of all intelligent applications.
In this embodiment, the application platform module may be based on an Angular framework and a JSON Form component, where Angular is a front JS framework, and a JSON Form is an abstract component based on fact, and may convert a Form described in a JSON data format into a Form in a project, and may generate a Form quickly with a few short lines of code. The application platform module is not limited to the above implementation, and other front end frames, components, and the like may be used.
In an alternative embodiment, the gateway module is further configured to interface with a shore-based system;
the data platform module is also used for receiving ship data sent by different intelligent applications through the gateway module, sending the ship data to the shore-based system, receiving response data aiming at the ship data sent by the shore-based system, and sending the response data to different intelligent applications.
In an alternative embodiment, the data platform module comprises:
the stream computing layer is based on an Apache NiFi platform and used for acquiring, processing and distributing ship state data through the configuration of a management platform module;
and the database is used for storing ship state data and data required by the management platform module.
And the unified service interface is used for being connected with the management platform module, the application platform module or the intelligent application.
Specifically, the unified service Interface may be an application programming Interface (RESTful API) based on a Spring Boot framework, where the Spring framework is an open-source application framework on a Java platform and provides a container with a control reversal characteristic, the Spring Boot is a completely new open-source lightweight framework, and is designed based on Spring4.0, and not only inherits the original excellent characteristics of the Spring framework, but also further simplifies the whole building and development process of the Spring application by simplifying configuration, RESTFU L is a design style and development mode of a network application, and is based on HTTP, and may use XM L format definition or JSON format definition.
In an alternative embodiment, the gateway module supports at least the following communication protocols:
distributed real-time Data Distribution Service (DDS), Transmission Control Protocol (TCP), MODBUS (serial communication Protocol) TCP, File Transfer Protocol (FTP), and Secure File Transfer Protocol (SFTP).
According to the data distribution system of the intelligent ship, provided by the embodiment of the invention, ship state data are sent to the intelligent ship integrated platform through the ship acquisition equipment; the intelligent ship integration platform acquires data demand information of different intelligent applications, receives ship state data sent by the ship acquisition equipment, processes the ship state data, and distributes the processed ship state data to different intelligent applications according to the data demand information. Therefore, data can be acquired by each intelligent application, repeated construction of a signal acquisition system is avoided, cost is saved, and the requirement that a plurality of intelligent applications acquire data simultaneously can be met.
In addition, the intelligent ship integration platform adopts an Apache NiFi stream processing framework, so that the modular configuration of an acquisition end and the visual configuration of data processing and distribution processes are realized, the learning difficulty of a user is reduced, and the system reusability is improved. Meanwhile, a visual configuration module is designed aiming at the ship differentiated scene, so that the dynamic configuration of the system is realized, and the compatibility of the system is improved.
The intelligent ship integration platform of this embodiment is based on Apache Nifi real-time data stream processing framework, has realized the analysis to boats and ships mainstream communication protocol (including Modbus TCP, TCP/IP, DDS, FTP, SFTP etc.), and carry out conventional data washing, the warning (including empty value warning, the alarm of overrange, data loss warning, communication link interruption warning, collection interruption warning), distribution, storage, the ship bank passback to the real-time data stream after the analysis, reduced each intelligent application to data acquisition, analysis, the demand of ship bank communication, make it concentrate on the realization of business itself.
Fig. 6 shows a schematic logical architecture diagram of the smart ship integration platform provided by the embodiment of the present invention.
Referring to fig. 6, the smart ship integration platform is a hub-type platform for collecting, storing, managing, converting, encrypting, forwarding (including ship-shore transmission), controlling and processing distribution processes, and applying stream data. This platform specifically includes based on Apache NiFi frame: the system comprises a collection end/push end gateway module, a data platform (namely a data platform module), a management platform (namely a management platform module) and an application platform (namely an application platform module).
The intelligent ship integration platform starts from multiple aspects of data acquisition, storage, calculation, forwarding, application, management, safety, privacy protection and the like. And designing and planning a total logic architecture, a frame and components according to the specific requirement condition of the intelligent ship integration platform. The platform is firm and stable, the problems and requirements of the ship industry at present can be effectively solved by landing implementation, and the continuous expansion and evolution of the requirements of the internet of things and streaming data can be continuously realized. The core of the platform is a streaming data platform which is used for collecting, storing, calculating and distributing streaming data.
And the data platform designs a data architecture according to the logic architecture. A stable and sustainable-expansion streaming data integration platform is formed, data acquisition, processing, distribution and flow control methods and functions are realized, and the requirements of various applications on data are met.
The application platform is based on a logic architecture and a data architecture, and designs and plans a complete data application system, and comprises the following steps: data visualization, data mining and data service (interface) functions are uniformly considered for the integration of a data management system, and the data application changes which are continuously expanded and are different in future can be realized.
The management platform and the integration platform are built, and main data assets on the ship and related processing, distribution and data application are centralized. Through the design of data management, from the perspective of data asset quality, data security, data service quality, the purpose of managing data well, reasonable/legal data is achieved. Meanwhile, in order to simplify the operation and maintenance operations of the IT (Internet Technology ) on the ship and improve the usability, a special operation and maintenance management platform is required to simplify the main operation and maintenance operations of the IT, so that one-key and visual operation and maintenance are realized.
The following is a detailed description of the main part of the smart ship integration platform.
The method is characterized in that the method comprises the steps of collecting, storing, calculating, distributing and the like, wherein the data are processed by recording or sequentially processing according to a sliding time window, and can be used for multiple analyses including association, aggregation, screening and sampling.
1) Gateway module-acquisition end/push end (abbreviation: gateway module)
The gateway is a module for collecting and releasing stream data, and realizes bidirectional interaction of the stream data. It is a link connecting a sensing network (internet of things) with a traditional communication network (computing network). The gateway is mainly responsible for wide device/system access and interaction capacity, provides comprehensive support for different protocol access, and currently supports DDS protocol devices, TCP protocol devices/shore-based, MODBUS TCP protocol devices, FTP protocols and the like. And meanwhile, the system also has the capability of expanding the capability of meeting more protocols which are continuously accessed in the future, such as: MQTT (Message Queuing Telemetry Transport) Protocol, video Protocol-RTP (Real-time Transport Protocol)/RTCP (Real-time Transport control Protocol), and the like. In addition, a specific communication link may be selected, such as: satellite communication, 3G/4G/5G network, local area network, etc. to reach maximum cost effect.
When the system works, the management of nodes (systems, equipment and the like) in the subnet is realized through the configuration of a background management platform and a gateway, and the method comprises the following steps: and acquiring the set equipment identification, state, attribute, state and the like.
Specifically, the gateway module in this embodiment may adopt a NiFi sub-module: MiNiFi, it can be through the unified management gateway of NiFi, flow, seamless data transmission. And based on MiNiFi, different protocols can be expanded, and connection of various protocols, equipment and ports is realized.
2) Data platform (abbreviation: stream module)
The data platform is a central pivot of the logic architecture of the whole intelligent ship integration platform and is mainly responsible for ship stream data related processing, storage and the like. The logic of the data platform module part mainly comprises three parts:
a stream computation layer: by means of an Apache NiFi platform and through a self-defined configuration table of a management platform, the configurable and automatic characteristic functions of acquisition, conversion, storage, cleaning, distribution and alarming of stream data are achieved.
And data storage, namely uniformly storing all stream data by relying on a MySQ L database, and simultaneously storing data required by a management platform.
Unified service interface: the method is characterized in that customization development is carried out by depending on a Spring Boot framework to form a RESTful API, and unified flow data corresponding service and management service are provided for a management platform module, an application platform module and even future third-party applications (including the intelligent applications). And the separation of the foreground and the background is realized, and the unified service is realized at the same time.
The main functions of the data platform design are acquisition, conversion, storage, cleaning, encryption, compression and release of various types of stream data. In the design process of the data platform of the embodiment, the data model and the data platform are mainly subjected to key design.
Designing a data model: modeling design is carried out on the requirements of collection, conversion, storage, cleaning, encryption, compression, distribution and the like of the flow data, wherein the requirements comprise the design of a flow data configuration model and a flow data storage model, the characteristics of the functional requirements are extracted in the design of the flow data configuration model, and standardized modeling is carried out to meet the high availability of the system under the ship type difference. The stream data storage model is mainly used for carrying out standardized modeling on the database according to the characteristics of the database and the specific characteristics of stream data, so that the optimal IO (Input Output) performance of stream data storage is met, and the requirements of collecting and storing a large amount of point data, such as 20000 point data, and storing half-year historical data are met.
Designing a data platform: and a complete processing flow and function are designed by relying on a table structure around the flow data integration. As shown in fig. 7, the design of the data platform (the whole data platform collects, stores, warns and issues) can be summarized as the following process:
(1) data acquisition and data standardization conversion:
reading data according to the flow configuration (data flow rule configuration table); data are transmitted through different protocols (including DDS protocol, TCP protocol, MODBUS TCP protocol and the like), and data are automatically acquired from a system (intelligent application on a server), equipment or a shore base according to acquisition packets; for the shore-based data, decryption and decompression are needed; converting the data into a standard format; the collected data and intermediate processes are written into separate event log files.
(2) Merging, storing and distributing data:
merging the data according to the distribution group or the same table data according to the flow configuration (data flow rule configuration table); if the first writing is found, the current day partition needs to be automatically established; the saved data is written into a separate event log file.
(3) Checking and cleaning data:
and according to the flow configuration (data flow rule configuration table), filtering and cleaning the data which do not accord with the normal data condition.
(4) Early warning calculation:
alarming in an out-of-range mode: and according to the configuration (a data flow rule configuration table), the data in the alarm condition are collected in a sliding mode according to a time window. If the number exceeds a certain number, generating early warning events;
and (4) null value alarm: for data that is null, the summary is sliding in time windows. If the number exceeds a certain number, generating early warning events;
and (3) data loss alarm: generating an early warning event for data updating failure or storage failure;
and (3) alarming on a shore-based communication link: if a 3G/4G/5G network is adopted, when the 3G/4G/5G network is unstable, a satellite communication network (such as VAST) is adopted, and if the satellite communication network is unstable and finally the local area network (such as FBB network) switching fails, the ship communication fails and an early warning event is generated;
data issuing and alarming: if the designated release address fails to be sent, generating an early warning event;
forming an alarm flow by the alarm event finally generated by the rule; filtering events repeatedly generated within a certain time according to a sliding time window aiming at the alarm flow; writing the event into an alarm table; for information needing to be alarmed in time, calling alarm information to RESTful API of unified service, and actively pushing the information to a user who logs in and has a viewing right through a WebSocket protocol by a back end; the generated alarms are all written into a separate event log file.
(5) Release to other systems (smart applications mentioned above, etc.):
after the data which passes the verification and the cleaning are used and the grouped data are merged and distributed according to the configuration (a data flow rule configuration table), the data are sent to a designated port through a designated protocol; if the transmission fails, the event is forwarded to early warning; and writing the successful and failed transmission into a single event log file.
(6) Release to shore based systems:
after the data of the distribution group is combined according to the flow configuration (a data flow rule configuration table), the data are packed according to the distribution frequency; carrying out pipeline encryption and data compression on the transmitted data; selecting a communication link according to a rule and sending the communication link; if the link and the transmission fail, the event is forwarded to early warning; and writing the successful and failed transmission into a single event log file.
3) Application platforms (abbreviation: app module)
The application platform can be customized based on an Angular framework and a self-written JSON form component in a configuration mode. The method specifically comprises the following steps:
an application integration platform: providing unified user management, login, function menu and integrated interface;
unify early warning platform: providing automatic early warning reminding, current early warning inquiry, historical early warning inquiry and early warning elimination functions;
the specific background business logic can be uniformly realized through RESTful API published by the integration platform; a future application building foundation is provided, and applications can be built quickly through configuration; more specifically, the application platform part mainly comprises an alarm integration part and an application integration part.
The alarm integrated part comprises:
(1) real-time alarm
Once the alarm occurs, the system automatically pops the window and displays the alarm information pushed by the background through WebSocket.
And providing a real-time alarm picture and displaying the current alarm event.
Providing selection: false alarms are resolved/eliminated, thereby eliminating alarm events.
(2) History alarm
View alarm events that have been resolved historically, and the person, time, equipment, reason for the alarm being disarmed at that time.
(3) Shielding alarm
Setting conditions, and shielding alarms generated by certain alarm sources and data items; and may disable/enable masking rules; for the alarm rule set to be non-maskable, the rule is not allowed to be set.
The application integration part comprises:
(1) unified user, user role, rights management
Providing users, roles and corresponding permission settings of the roles; providing locking and unlocking functions for users; providing a password resetting function; providing a function of self-modifying the password by the user; automatic locking by a user is not used for a long time.
(2) User login
Providing a user login, and a JWT (Json web token) -based session; and (4) automatically locking the user by inputting errors for multiple times.
(3) Menu
And displaying the menu function which the user has the right to access according to the authority. And calling the related webpage after clicking the menu function.
4) A management platform (abbreviation: mgt module)
The front end of the management platform can be based on an Angular frame, the rear end can be based on a Spring Boot frame, and the management platform mainly comprises two functions: and integrating configuration management and operation and maintenance management. The method comprises the following specific steps:
integrated configuration management: carrying out uniform ship acquisition equipment and system (intelligent application) relevant point and acquisition data configuration; a unified data check/cleaning/filtering configuration; data publishing configuration; data early warning configuration; data security (encryption) configuration; ship-shore communication management (channel configuration, use condition query);
operation and maintenance management: providing automatic downloading of software; automatically updating the integrated platform; system is keyed on/off; automated/one-touch backup; automated/one-touch clean up; one-key recovery; collecting and monitoring (ensuring normal collection and storage of data); the system is unified for time service.
(1) Unified time service
And comparing the GPS time and the network time. If the difference is within the error range, taking the GPS as a standard, and if the difference is large, automatically generating alarm information; and performing unified Time service on other servers in the cluster through linux ntp (Network Time Protocol).
(2) Remote update
Update packages are automatically downloaded from shore based (it may be set that only certain links are available). And automatically updating the system at regular time and restarting the system.
(3) One-key start-stop
And a small tool is provided, and each platform is started and stopped by one key.
(4) One-key backup/restore
Providing a small tool, a one-key incremental/full backup system and data; and if needed, restoring the system and the data from the backup by one key.
(5) Automatic cleaning
And a small tool is provided, and data, files, logs and the like outside a certain period are cleaned automatically and regularly. And if the system space is insufficient, automatically sending an alarm.
The embodiment adopts an Apache NiFi stream processing framework, realizes the modular configuration of an acquisition end and the visual configuration of data processing and distribution processes, reduces the learning difficulty of a user, and improves the reusability of the system. Meanwhile, a visual configuration module is designed aiming at the ship differentiated scene, so that the dynamic configuration of the system is realized, and the compatibility of the system is improved.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A data distribution method of a smart ship is applied to a smart ship integration platform, and comprises the following steps:
acquiring data demand information of different intelligent applications;
receiving ship state data sent by a ship acquisition device;
processing the ship state data;
and distributing the processed ship state data to different intelligent applications according to the data demand information.
2. The method of claim 1, further comprising:
receiving ship data sent by different intelligent applications;
compressing and encrypting the ship data, and sending the compressed and encrypted ship data to a shore-based system;
receiving response data sent by the shore-based system for the ship data;
and sending the response data to different intelligent applications.
3. The method of claim 1, wherein the step of processing the vessel state data comprises:
and carrying out format conversion and cleaning on the ship state data.
4. The utility model provides a data distribution device of intelligent ship, characterized in that, is applied to intelligent ship integration platform, the device includes:
the first receiving module is used for acquiring data demand information of different intelligent applications;
the second receiving module is used for receiving the ship state data sent by the ship acquisition equipment;
the processing module is used for processing the ship state data;
and the distribution module is used for distributing the processed ship state data to different intelligent applications according to the data demand information.
5. The apparatus of claim 4, further comprising:
the third receiving module is used for receiving ship data sent by different intelligent applications;
the first sending module is used for compressing and encrypting the ship data and sending the compressed and encrypted ship data to a shore-based system;
the fourth receiving module is used for receiving response data which is sent by the shore-based system and aims at the ship data;
and the second sending module is used for sending the response data to different intelligent applications.
6. A data distribution system of a smart ship, comprising:
the ship acquisition equipment is used for acquiring ship state data and sending the ship state data to the intelligent ship integration platform;
the intelligent ship integration platform is used for acquiring data demand information of different intelligent applications, receiving the ship state data sent by the ship acquisition equipment, processing the ship state data, and distributing the processed ship state data to different intelligent applications according to the data demand information;
and the intelligent application is used for receiving the processed ship state data sent by the intelligent ship integration platform.
7. The system of claim 6, wherein the smart marine integration platform comprises:
the gateway module is used for being connected with different intelligent applications and different ship acquisition equipment respectively;
the data platform module is based on an Apache NiFi platform and used for receiving ship state data sent by the ship acquisition equipment through the gateway module, processing the ship state data and distributing the processed ship state data to different intelligent applications through the gateway module according to the data demand information;
the management platform module is used for carrying out visual configuration on data acquisition, data processing and data distribution of the data platform module;
and the application platform module is used for integrating different pages of the intelligent application and carrying out state alarm on the ship state data.
8. The system of claim 7, wherein the gateway module is further configured to interface with a shore-based system;
the data platform module is further configured to receive, through the gateway module, ship data sent by different intelligent applications, send the ship data to the shore-based system, receive response data, which is sent by the shore-based system and is specific to the ship data, and send the response data to different intelligent applications.
9. The system of claim 7 or 8, wherein the data platform module comprises:
the stream computing layer is based on an Apache NiFi platform and used for acquiring, processing and distributing the ship state data through the configuration of the management platform module;
the database is used for storing the ship state data and the data required by the management platform module;
and the unified service interface is used for being connected with the management platform module, the application platform module or the intelligent application.
10. The system of claim 7, wherein the gateway module supports at least the following communication protocols:
DDS protocol, TCP protocol, MODBUS TCP protocol, FTP protocol, SFTP protocol.
CN202010206181.9A 2020-03-23 2020-03-23 Data distribution method, device and system for intelligent ship Pending CN111427939A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010206181.9A CN111427939A (en) 2020-03-23 2020-03-23 Data distribution method, device and system for intelligent ship

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010206181.9A CN111427939A (en) 2020-03-23 2020-03-23 Data distribution method, device and system for intelligent ship

Publications (1)

Publication Number Publication Date
CN111427939A true CN111427939A (en) 2020-07-17

Family

ID=71548568

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010206181.9A Pending CN111427939A (en) 2020-03-23 2020-03-23 Data distribution method, device and system for intelligent ship

Country Status (1)

Country Link
CN (1) CN111427939A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112125083A (en) * 2020-09-08 2020-12-25 猫岐智能科技(上海)有限公司 Terminal operation and maintenance system for elevator terminal equipment interface statistics
CN112214866A (en) * 2020-08-25 2021-01-12 武汉船用机械有限责任公司 Health condition judgment method and device for marine equipment and computer equipment
CN113311809A (en) * 2021-05-28 2021-08-27 苗叶 Industrial control system-based safe operation and maintenance instruction blocking device and method
CN113347012A (en) * 2021-05-20 2021-09-03 湖南湘船重工有限公司 Data distribution method and system for intelligent ship
CN114911512A (en) * 2021-02-07 2022-08-16 中国移动通信有限公司研究院 Data configuration method, device and equipment of intelligent application and readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104503414A (en) * 2014-12-29 2015-04-08 广州文冲船厂有限责任公司 Intelligent ship information monitoring system
US20180141618A1 (en) * 2015-05-28 2018-05-24 Hyundai Heavy Industries Co., Ltd. Ship data consolidated management method and device
CN109165250A (en) * 2018-08-29 2019-01-08 中远海运科技股份有限公司 Intelligent integrated plateform system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104503414A (en) * 2014-12-29 2015-04-08 广州文冲船厂有限责任公司 Intelligent ship information monitoring system
US20180141618A1 (en) * 2015-05-28 2018-05-24 Hyundai Heavy Industries Co., Ltd. Ship data consolidated management method and device
CN109165250A (en) * 2018-08-29 2019-01-08 中远海运科技股份有限公司 Intelligent integrated plateform system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
吴军等: "基于OpenADR规范的智能船舶数据采集与传输系统", 《船舶》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112214866A (en) * 2020-08-25 2021-01-12 武汉船用机械有限责任公司 Health condition judgment method and device for marine equipment and computer equipment
CN112214866B (en) * 2020-08-25 2023-11-17 武汉船用机械有限责任公司 Marine equipment health condition judging method and device and computer equipment
CN112125083A (en) * 2020-09-08 2020-12-25 猫岐智能科技(上海)有限公司 Terminal operation and maintenance system for elevator terminal equipment interface statistics
CN114911512A (en) * 2021-02-07 2022-08-16 中国移动通信有限公司研究院 Data configuration method, device and equipment of intelligent application and readable storage medium
CN113347012A (en) * 2021-05-20 2021-09-03 湖南湘船重工有限公司 Data distribution method and system for intelligent ship
CN113311809A (en) * 2021-05-28 2021-08-27 苗叶 Industrial control system-based safe operation and maintenance instruction blocking device and method

Similar Documents

Publication Publication Date Title
CN111427939A (en) Data distribution method, device and system for intelligent ship
US20200067789A1 (en) Systems and methods for distributed systemic anticipatory industrial asset intelligence
US20220300502A1 (en) Centralized Knowledge Repository and Data Mining System
CN111752795A (en) Full-process monitoring alarm platform and method thereof
WO2018234741A1 (en) Systems and methods for distributed systemic anticipatory industrial asset intelligence
CN103761309A (en) Operation data processing method and system
US20200233650A1 (en) Systems and methods for collecting, monitoring, and analyzing vehicle data from a plurality of vehicles using edge computing
CN112162829B (en) Resource monitoring data preprocessing system under edge computing scene
CN110995859A (en) Intelligent transformer substation supporting platform system based on ubiquitous Internet of things
CN109274756A (en) A kind of intelligent environment protection monitoring management system
CN114169579B (en) Nuclear Power Industry Internet Comprehensive Intelligent Platform System
CN113112038B (en) Intelligent monitoring and diagnostic analysis system, device, electronic equipment and storage medium
CN112269690B (en) Data backup method and device
CN107800722A (en) Isolate the method and device of industrial control equipment and external network server
CN110196780B (en) Method, device, storage medium and electronic device for determining server state
Geldenhuys et al. Dependable iot data stream processing for monitoring and control of urban infrastructures
CN110532312A (en) A kind of industry interconnection cloud platform system based on big data
US10554625B2 (en) Integrated PCS functional competency assessment
CN117234673A (en) Data processing method, system and electronic equipment
CN110798660B (en) Integrated operation and maintenance system based on cloud federal audio and video fusion platform
CN117194562A (en) Data synchronization method and device, electronic equipment and computer readable medium
CN115333967B (en) Data reporting method, system, device and storage medium
WO2018083710A2 (en) An improved management and internetworking of devices to collect and exchange data without requiring interaction
CN115065577A (en) Edge computing gateway system applied to secondary water supply Internet of things
Hadar BIDCEP: A Vision of Big Data Complex Event Processing for Near Real Time Data Streaming.

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200717