CN113722806A - Ship lock control method and device based on digital twin system and electronic equipment - Google Patents
Ship lock control method and device based on digital twin system and electronic equipment Download PDFInfo
- Publication number
- CN113722806A CN113722806A CN202111050577.XA CN202111050577A CN113722806A CN 113722806 A CN113722806 A CN 113722806A CN 202111050577 A CN202111050577 A CN 202111050577A CN 113722806 A CN113722806 A CN 113722806A
- Authority
- CN
- China
- Prior art keywords
- ship lock
- ship
- digital twin
- lock
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 80
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims abstract description 29
- 230000002093 peripheral effect Effects 0.000 claims abstract description 23
- 238000011144 upstream manufacturing Methods 0.000 claims abstract description 19
- 238000005259 measurement Methods 0.000 claims abstract description 5
- 238000012544 monitoring process Methods 0.000 claims description 32
- 230000002159 abnormal effect Effects 0.000 claims description 28
- 230000004927 fusion Effects 0.000 claims description 14
- 238000013461 design Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 9
- 230000005856 abnormality Effects 0.000 claims description 7
- 238000005516 engineering process Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000004088 simulation Methods 0.000 abstract description 7
- 230000008569 process Effects 0.000 description 39
- 238000010586 diagram Methods 0.000 description 16
- 238000004891 communication Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000012423 maintenance Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000013507 mapping Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000013079 data visualisation Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 238000007619 statistical method Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 229910052792 caesium Inorganic materials 0.000 description 1
- TVFDJXOCXUVLDH-UHFFFAOYSA-N caesium atom Chemical compound [Cs] TVFDJXOCXUVLDH-UHFFFAOYSA-N 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
- G06F30/13—Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- Mathematical Analysis (AREA)
- Civil Engineering (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Structural Engineering (AREA)
- Computational Mathematics (AREA)
- Architecture (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Traffic Control Systems (AREA)
Abstract
The application provides a ship lock control method, a ship lock control device and electronic equipment based on a digital twin system, and relates to the technical field of ship lock operation management, wherein the method comprises the following steps: acquiring ship lock operation data, wherein the ship lock operation data comprises at least one of water levels of upstream and downstream navigation channels of a ship lock, a gate switch operation state, a lock indoor water level, ship lock valve opening and closing measurement and ship position and speed of passing through the lock; transmitting the ship lock operation data to a constructed digital twin system, wherein the digital twin system comprises a ship lock peripheral scene model, a ship lock body model and a ship model; receiving an operation control signal to simulate the operation state of the ship lock based on the acquired ship lock operation data in the digital twin system; controlling the ship lock based on the digital twin system. The problem that at present, high-precision simulation of ship lock operation cannot be achieved, and high-precision control of the ship lock cannot be achieved can be solved.
Description
Technical Field
The application relates to the technical field of ship lock operation management, in particular to a ship lock control method and device based on a digital twin system and electronic equipment.
Background
The ship lock is a navigation building, and a concentrated water surface drop is formed by a stepped longitudinal section due to the regulation of flow rate and canalization navigation in a natural river and the limitation of terrain conditions and water surface gradient on a canal. The vessel must be moved directly through the drop by means of a special navigable building. The ship lock consists of upstream and downstream navigation channels and upstream and downstream lock head-connected lock chambers. The lock chamber is a box-shaped chamber for berthing the ship, and the water level in the lock chamber is adjusted by filling water or draining water in the lock chamber, so that the ship vertically ascends and descends between the upstream water level and the downstream water level, and the water level drop of the concentrated channel is passed. When the ship runs from downstream to upstream, the indoor water level is reduced to be flush with the downstream water level, then the gate of the downstream gate head is opened, the ship enters the gate chamber, the gate is closed, water is filled, after the water level is increased to be flush with the upstream water level, the upstream gate head gate is opened, and the ship can exit the gate and run to the upstream through the upstream approach channel. When the ship runs from upstream to downstream, the brake-passing operation procedure is opposite to the brake-passing operation procedure.
In order to ensure the safety of ship lockage, the ship lock needs to be accurately controlled, various ship lock management technologies and various ship lock management system software exist at present, but the problems that the ship lock cannot be operated in high-precision simulation, the ship lock cannot be accurately controlled and the like exist, and accidents are easily caused when the ship is lockage.
Disclosure of Invention
An object of the embodiments of the present application is to provide a ship lock control method and apparatus based on a digital twin system, and an electronic device, so as to solve the problems that at present, high-precision simulation cannot be performed on a ship lock, and high-precision control cannot be performed on the ship lock.
In a first aspect, an embodiment of the present application provides a ship lock control method based on a digital twin system, including:
acquiring ship lock operation data, wherein the ship lock operation data comprises at least one of water levels of upstream and downstream navigation channels of a ship lock, a gate switch operation state, a lock indoor water level, ship lock valve opening and closing measurement and ship position and speed of passing through the lock;
transmitting the ship lock operation data to a constructed digital twin system, wherein the digital twin system comprises a ship lock peripheral scene model, a ship lock body model and a ship model;
receiving an operation control signal to simulate the operation state of the ship lock based on the acquired ship lock operation data in the digital twin system;
controlling the ship lock based on the digital twin system.
In the implementation process, a physical model is constructed in a digital twin mode, a ship lock in a physical space is mapped in a virtual space, and a control signal of the ship lock is accessed into the ship lock physical model of the ship lock in a digital twin system so as to complete mapping in the virtual space and reflect the real operation process and the operation state of the ship lock. The ship lock physical model is driven based on the control signal, the operation process and the operation state of the ship lock can be displayed in real time, and the accuracy of ship lock control is improved, so that the ship lock can be conveniently detected and managed.
Optionally, before the acquiring the ship lock operation data, the method may further include:
constructing a digital twin basic system based on open-source digital twin engine software;
constructing the ship lock peripheral scene model in the digital twin basic system based on a topographic map;
constructing the ship lock body model in the digital twin foundation system based on a ship lock design drawing and a ship lock building information model;
constructing the ship model in the digital twin foundation system based on a ship design drawing and a ship appearance photo;
integrating the ship lock peripheral scene model, the ship lock body model and the ship model in the digital twin basic system to obtain the digital twin system corresponding to the physical world.
In the implementation process, the ship lock peripheral scene model, the ship lock body model and the ship model are integrated to obtain the digital twin system corresponding to the physical world, so that ship lock buildings and the dynamic process of ship lock operation can be simulated with high fidelity, the precision of ship lock control is improved, and the safety of ship lockage is improved.
Optionally, the acquiring the ship lock operation data may include:
based on a wired network or a wireless network, connecting ubiquitous sensing equipment for detecting the operation of the ship lock;
periodically obtaining the ship lock operation data from the ubiquitous sensing device.
In the implementation process, the ubiquitous sensing equipment is arranged, the ship lock operation data are periodically acquired, the operation state of the ship lock body model can be updated in time, the simulation process of the model is more real-time, dynamic real-time reduction of the ship lock operation process is achieved, and the ship lock control accuracy is improved.
Optionally, after the operation control signal is switched in to simulate the operation state of the ship lock based on the acquired ship lock operation data in the digital twin system, the method may include:
acquiring a ship lock monitoring image;
fusing the ship lock monitoring image and the ship lock body model based on a video fusion technology to generate a ship lock monitoring model so as to play the ship lock monitoring image in the digital twin system.
In the implementation process, the ship lock monitoring image and the ship lock body model are fused, and the dynamic video of the ship lock monitoring is played in a digital twin scene through virtual and real combination, so that ship lock management personnel can know the running state of each part of the ship lock conveniently, and the efficiency of managing the running state of the ship lock is improved.
Optionally, the method may further include:
generating statistical data of the ship lock operation data;
and transmitting at least one of the acquired ship lock operation data, the operation control signal data and the statistical data to a display device.
In the implementation process, through the implementation step of displaying the ship lock operation data, statistical analysis can be performed on data collected by ubiquitous sensing equipment, ship lock mechanical operation data and electromechanical operation control data, the data are displayed to ship lock management personnel in real time, data visualization is achieved, the management personnel can know the operation state of the ship lock, and the efficiency of managing the ship lock can be improved.
Optionally, the method may further include:
and when detecting that the ship lock operation data or the control signal is abnormal, sending out warning information.
In the implementation process, when abnormal operation data or control signals of the ship lock are detected, warning information is sent to inform managers in time, and the safety of system operation and ship lockage is improved.
Optionally, the method may further include:
and when detecting that the ship lock operation data or the control signal is abnormal, determining a positioning position where the abnormality occurs, and displaying an abnormal record at the positioning position in the digital twin system.
In the implementation process, when the abnormal operation data of the ship lock or the abnormal control signal is detected, the abnormal record is displayed at the abnormal positioning position in the digital twin system, so that maintenance personnel can conveniently make a maintenance scheme in the system, and the safety of the system is improved.
In a second aspect, an embodiment of the present application provides a ship lock control device based on a digital twin system, including:
the acquisition module is used for acquiring ship lock operation data, wherein the ship lock operation data comprises at least one of water levels of upstream and downstream pilot channels of a ship lock, a gate switch operation state, a water level in a lock chamber, opening and closing measurement of a ship lock valve and positions and speeds of ship passing through the lock;
the transmission module is used for transmitting the ship lock operation data to a constructed digital twin system, and the digital twin system comprises a ship lock peripheral scene model, a ship lock body model and a ship model;
and the receiving module is used for receiving an operation control signal so as to simulate the operation state of the ship lock based on the acquired ship lock operation data in the digital twin system.
A control module to control the ship lock based on the digital twin system.
In the implementation process, a physical model is constructed in a digital twin mode, a ship lock in a physical space is mapped in a virtual space, and a control signal of the ship lock is accessed into the ship lock physical model of the ship lock in a digital twin system so as to complete mapping in the virtual space and reflect the real operation process and the operation state of the ship lock. The ship lock physical model is driven based on the control signal, the operation process and the operation state of the ship lock can be displayed in real time, and the accuracy of ship lock control is improved, so that the ship lock can be conveniently detected and managed.
Optionally, the ship lock control device may further include a system building module, and the system building module may be specifically configured to:
before acquiring the ship lock operation data, constructing a digital twin basic system based on open-source digital twin engine software;
constructing the ship lock peripheral scene model in the digital twin basic system based on a topographic map;
constructing the ship lock body model in the digital twin foundation system based on a ship lock design drawing and a ship lock building information model;
constructing the ship model in the digital twin foundation system based on a ship design drawing and a ship appearance photo;
integrating the ship lock peripheral scene model, the ship lock body model and the ship model in the digital twin basic system to obtain the digital twin system corresponding to the physical world.
In the implementation process, the ship lock peripheral scene model, the ship lock body model and the ship model are integrated to obtain the digital twin system corresponding to the physical world, so that ship lock buildings and the dynamic process of ship lock operation can be simulated with high fidelity, the precision of ship lock control is improved, and the safety of ship lockage is improved.
Optionally, the obtaining module may be specifically configured to:
based on a wired network or a wireless network, connecting ubiquitous sensing equipment for detecting the operation of the ship lock;
periodically obtaining the ship lock operation data from the ubiquitous sensing device.
In the implementation process, the ubiquitous sensing equipment is arranged, the ship lock operation data are periodically acquired, the operation state of the ship lock body model can be updated in time, the simulation process of the model is more real-time, dynamic real-time reduction of the ship lock operation process is achieved, and the ship lock control accuracy is improved.
Optionally, the ship lock control device may further include a surveillance video fusion module, and the surveillance video module may be configured to:
acquiring a ship lock monitoring image;
fusing the ship lock monitoring image and the ship lock body model based on a video fusion technology to generate a ship lock monitoring model so as to play the ship lock monitoring image in the digital twin system.
In the implementation process, the ship lock monitoring image and the ship lock body model are fused, and the dynamic video of the ship lock monitoring is played in a digital twin scene through virtual and real combination, so that ship lock management personnel can know the running state of each part of the ship lock conveniently, and the efficiency of managing the running state of the ship lock is improved.
Optionally, the ship lock control device may further include a display module, and the display module may be configured to:
generating statistical data of the ship lock operation data;
and transmitting at least one of the acquired ship lock operation data, the operation control signal data and the statistical data to a display device.
In the implementation process, through the implementation step of displaying the ship lock operation data, statistical analysis can be performed on data collected by ubiquitous sensing equipment, ship lock mechanical operation data and electromechanical operation control data, the data are displayed to ship lock management personnel in real time, data visualization is achieved, the management personnel can know the operation state of the ship lock, and the efficiency of managing the ship lock can be improved.
Optionally, the ship lock control device may further include a warning module, where the warning module may be configured to send warning information when detecting that the ship lock operation data or the control signal is abnormal.
In the implementation process, when abnormal operation data or control signals of the ship lock are detected, warning information is sent to inform managers in time, and the safety of system operation and ship lockage is improved.
Optionally, the warning module may be further configured to determine a location where an abnormality occurs when detecting that the ship lock operation data or the control signal is abnormal, and display an abnormality record at the location in the digital twin system.
In the implementation process, when the abnormal operation data of the ship lock or the abnormal control signal is detected, the abnormal record is displayed at the abnormal positioning position in the digital twin system, so that maintenance personnel can conveniently make a maintenance scheme in the system, and the safety of the system is improved.
In a third aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes a memory and a processor, where the memory stores program instructions, and the processor executes the steps in any one of the foregoing implementation manners when reading and executing the program instructions.
In a fourth aspect, an embodiment of the present application further provides a storage medium, where the readable storage medium stores computer program instructions, and the computer program instructions are read by a processor and executed to perform the steps in any of the foregoing implementation manners.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic step diagram of a ship lock control method based on a digital twin system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of steps for constructing a digital twinning system according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram illustrating a step of acquiring the operation of a ship lock according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram illustrating a step of playing a ship lock monitoring image according to an embodiment of the present application;
FIG. 5 is a schematic diagram illustrating steps for displaying ship lock operation data according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of a ship lock control device based on a digital twin system according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. For example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. In addition, the functional modules in the embodiments of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The applicant found in the course of the study: the prototype of a real ship lock building cannot be restored through digitalization in ship lock management software, and real-time acquisition and analysis management of various operation parameters of a ship lock are realized, so that detailed characteristics of ship lock operation safety cannot be found in time and specific treatment measures cannot be taken.
The digital twin is a simulation process integrating multiple physical quantities, multiple scales and multiple probabilities by fully utilizing data such as a physical model, sensor updating, operation history and the like, and mapping is completed in a virtual space, so that the full life cycle process of corresponding entity equipment is reflected. The above characteristics of the digital twin technology are very suitable for constructing the ship lock intelligent management system.
The digital twin ship lock system can restore ship lock buildings and dynamic ship lock operation processes with high fidelity, can access real-time data of ship lock ubiquitous sensing equipment, dynamically express real-time states by using data to drive digital twin scene elements, can realize dynamic real-time restoration of ship lock operation processes and control flows, and can integrate a floor ship lock management service function.
Based on this, an embodiment of the present application provides a ship lock control method based on a digital twin system, please refer to fig. 1, where fig. 1 is a schematic diagram of steps of the ship lock control method based on the digital twin system according to the embodiment of the present application, and the method may include the following steps:
in step S12, ship lock operation data including at least one of water levels of the approach channels upstream and downstream of the ship lock, a gate switch operation state, a water level in the lock chamber, a degree of opening and closing of a valve of the ship lock, and a position and a speed of the ship passing through the lock are acquired.
In step S13, the ship lock operation data is transmitted to a constructed digital twin system, which includes a ship lock peripheral scene model, a ship lock body model and a ship model.
Wherein, the digital twin system is constructed before the step S12 is started, and the specific construction process is described later. The built digital twin system is used for driving and displaying a ship lock peripheral scene, a ship lock body model and a ship model, and the digital twin system can also provide functions of scene browsing, target model query and positioning, scene weather effect display and the like in a three-dimensional digital environment.
Illustratively, the built digital twin system may be run on a terminal, which may be a networking enabled electronic device, which may be a configurator of an engineering device, a computer, a personal digital assistant, or the like.
In step S14, an operation control signal is received to simulate an operation state of the ship lock based on the acquired ship lock operation data in the digital twin system.
The ship lock control system comprises a ship lock mechanical control signal receiving module, a control signal through a control signal cable, wherein the control signal receiving module, and the specific control signal through the control signal cable, the control signal through the control signal receiving the control signal through the ship lock mechanical control signal receiving module, the control signal receiving the ship lock mechanical control signal through the control signal receiving module, the control signal through the ship lock mechanical control signal through the ship lock mechanical control signal through the ship lock.
In step S15, the ship lock is controlled based on the digital twin system.
Therefore, in the embodiment of the application, a physical model is constructed in a digital twin mode, a ship lock in a physical space is mapped in a virtual space, and a control signal of the ship lock is connected to the ship lock physical model of the ship lock in a digital twin system so as to complete mapping in the virtual space and reflect the real operation process and the operation state of the ship lock. The ship lock physical model is driven based on the control signal, the operation process and the operation state of the ship lock can be displayed in real time, and the accuracy of ship lock control is improved, so that the ship lock can be conveniently detected and managed.
Optionally, the present embodiment provides an implementation manner of constructing a digital twin system, please refer to fig. 2, fig. 2 is a schematic diagram of steps of constructing a digital twin system provided by the present embodiment, before step S12, the steps may include the following steps:
in step S111, a digital twin base system is constructed based on the open-source digital twin engine software.
The open-source digital twin engine software may be Unity 3D, UE4, Cesium, etc., and the embodiment of the present application is not particularly limited.
In step S112, the ship lock peripheral scene model is constructed in the digital twin basic system based on a topographic map.
For example, the topographic map adopted by the embodiment of the application is a large-scale topographic map with a scale of 1: 500-1: 10 ten thousand, and a ship lock and a peripheral digital twin topographic feature scene can be constructed on the basis of the topographic map. The ship lock peripheral scene can be specifically a scene model of the ship lock connected with the upstream and downstream navigation channels and a scene model of the ship lock upstream and downstream navigation channels.
In step S113, the ship lock ontology model is constructed in the digital twin foundation system based on a ship lock design drawing and a ship lock building information model.
Illustratively, a main body structure of a ship lock is constructed through a ship lock design drawing and a ship lock Building Information (BIM) model, wherein the ship lock body model comprises a ship lock head, a lock chamber, ship lock machinery, electromechanical equipment and electromechanical equipment, and the electromechanical equipment can be specifically a gate, an opening and closing machine, a motor, a console and the like.
In step S114, the ship model is constructed in the digital twin foundation system based on a ship design drawing and a ship appearance photograph.
For example, a ship digital twin can be constructed in proportion to a ship design drawing, a ship appearance photo and the like, a ship can comprise different ship types such as a bulk carrier, a container carrier, a grocery carrier and a passenger carrier, and the ship state can also be different states such as full load or no load.
In step S115, the ship lock peripheral scene model, the ship lock body model and the ship model are integrated in the digital twin basic system to obtain the digital twin system corresponding to the physical world.
Therefore, in the embodiment of the application, the ship lock peripheral scene model, the ship lock body model and the ship model are integrated to obtain the digital twin system corresponding to the physical world, so that ship lock buildings and the dynamic process of ship lock operation can be simulated with high fidelity, the precision of ship lock control is improved, and the safety of ship lockage is improved.
In an alternative embodiment, regarding step S12, an implementation step of acquiring ship lock operation data is provided in the embodiment of the present application, please refer to fig. 3, where fig. 3 is a schematic diagram of the step of acquiring ship lock operation provided in the embodiment of the present application, and the step may include the following steps:
in step S121, a ubiquitous sensing device that detects the operation of the ship lock is connected based on a wired network or a wireless network.
In step S122, the ship lock operation data is periodically acquired from the ubiquitous sensing device.
The ubiquitous sensor network can be formed based on ubiquitous sensing equipment, and can be divided into 5 levels from bottom to top, such as a bottom sensor network, an access network, a basic backbone network, middleware, an application platform and the like. The bottom sensor network consists of various information devices such as a sensor, an actuator, Radio Frequency Identification (RFID) and the like and is responsible for sensing and feeding back to the physical world; the access network realizes the connection between the bottom sensor network and the upper basic backbone network and consists of a gateway, a sink node and the like; the basic backbone Network is constructed based on the Internet and a Next Generation Network (NGN); the middleware processes and stores the sensing data and provides access to various sensing data in a service form; the application platform realizes various sensor network applications.
Specifically, in the above embodiment, the wired network may be an optical fiber network, and the ship lock operation data obtained by the ubiquitous sensing device may include the water levels of the upstream and downstream navigation channels of the ship lock, the operation state of the gate switch, the water level in the lock chamber, the opening and closing degree of the valve of the ship lock, the position of the ship passing through the lock, the speed of the ship passing through the lock, and the like.
The data acquisition period can be set, and the ubiquitous sensing equipment is controlled to acquire the ship lock operation data once at preset time intervals.
Therefore, by arranging the ubiquitous sensing equipment, the ship lock operation data are periodically acquired, the operation state of the ship lock body model can be timely updated, the simulation process of the model is more real-time, dynamic real-time reduction of the ship lock operation process is realized, and the ship lock control accuracy is improved.
Optionally, after step S14, an implementation step of playing the ship lock monitoring image is further provided in the embodiment of the present application, please refer to fig. 4, where fig. 4 is a schematic diagram of the step of playing the ship lock monitoring image provided in the embodiment of the present application, and the step may include the following steps:
in step S41, a lock monitoring image is acquired.
In step S42, fusing the ship lock monitoring image and the ship lock body model based on a video fusion technique to generate a ship lock monitoring model, so as to play the ship lock monitoring image in the digital twin system.
Specifically, the acquired monitoring image may be preprocessed, and the preprocessing may include geometric correction, noise elimination, brightness adjustment, registration, and the like of the image data. The image registration refers to finding the maximum correlation between the monitoring image and the ship lock body model so as to eliminate the information difference of the image in the ship lock body model in the directions of space, phase, resolution and the like, so that the fusion is more real and the information is more accurate.
The preprocessed monitoring image can be fused at a pixel level, a feature level and a decision level. The pixel level fusion refers to splicing and fusing based on image pixels, and fusing images into a whole. The characteristic level fusion carries out image splicing and fusion based on the obvious characteristics of the images, such as ship lock design lines, ship lock characteristics and the like. And in the decision level, probability decision is carried out by using mathematical algorithms such as a Bayes method, a D-S evidence method and the like in a fusion manner, and video or image fusion is carried out accordingly.
Therefore, the ship lock monitoring image and the ship lock body model are fused, and the dynamic video of the ship lock monitoring is played in a digital twin scene through the virtual-real combination, so that ship lock management personnel can know the running states of all parts of the ship lock conveniently, and the efficiency of managing the running states of the ship lock is improved.
In addition, when the operation state of the ship lock is simulated, the operation data of the ship lock may be displayed in real time to assist relevant personnel (such as managers, supervisors, ship drivers, and the like) to perform management control, so that the embodiment of the present application further provides an implementation step for displaying the operation data of the ship lock, please refer to fig. 5, where fig. 5 is a schematic diagram of the step for displaying the operation data of the ship lock provided by the embodiment of the present application, and the step may include the following steps:
in step S51, statistical data of the ship lock operation data is generated.
In step S52, at least one of the acquired lock operation data, the operation control signal data, and the table data is transmitted to a display device.
The statistical data may be a line graph, a bar graph, a waveform graph, or the like, and the statistical data is not limited in the embodiment of the present application.
Illustratively, the display device may be a display of a terminal device, or may be a digital panel in a digital twinning system.
Therefore, through the implementation steps for displaying the ship lock operation data, statistical analysis can be conducted on the data collected by the ubiquitous sensing equipment, the ship lock mechanical operation data and the electromechanical operation control data, the data are displayed to ship lock management personnel in real time, data visualization is achieved, the management personnel can know the operation state of the ship lock, and the ship lock management efficiency can be improved.
In an optional embodiment, the ship lock control method of the digital twin system provided in the embodiment of the present application may further include: and when detecting that the ship lock operation data or the control signal is abnormal, sending out warning information.
The warning information can be a popup prompt sent by a display panel, can be buzzing sent by controlling a signal lamp to flicker or a warning device to buzz, and can also be warning information directly sent to a terminal of a manager.
Therefore, when abnormal operation data or control signals of the ship lock are detected, warning information is sent out to inform managers in time, and the safety of system operation and ship lockage is improved.
Optionally, the ship lock control method of the digital twin system provided in the embodiment of the present application may further include:
and when detecting that the ship lock operation data or the control signal is abnormal, determining a positioning position where the abnormality occurs, and displaying an abnormal record at the positioning position in the digital twin system.
The maintenance APP can be used for on-site inspection of the ship lock, the mobile phone is used for positioning and acquiring on-site photos when problems are found, the photos are submitted and transmitted to the digital twin system, and problem records and photos can be displayed at positions corresponding to scenes and models of the digital twin ship lock.
Therefore, when the abnormal operation data of the ship lock or the abnormal control signal are detected, the abnormal record is displayed at the abnormal positioning position in the digital twin system, so that maintenance personnel can conveniently make a maintenance scheme in the system, and the safety of the system is improved.
Based on the same inventive concept, the embodiment of the present application further provides a ship lock control device 60 based on a digital twin system, please refer to fig. 6, where fig. 6 is a schematic diagram of a ship lock control device based on a digital twin system according to the embodiment of the present application, and the device may include:
the acquiring module 61 is configured to acquire ship lock operation data, where the ship lock operation data includes at least one of water levels of upstream and downstream navigation channels of a ship lock, a gate switch operation state, a water level in a lock chamber, a ship lock valve opening and closing degree, and a ship position and speed passing through the lock;
the transmission module 62 is configured to transmit the ship lock operation data to a constructed digital twin system, where the digital twin system includes a ship lock peripheral scene model, a ship lock body model, and a ship model;
a receiving module 63, configured to receive an operation control signal to simulate, in the digital twin system, an operation state of the ship lock based on the acquired ship lock operation data;
a control module 64 for controlling the ship lock based on the digital twin system.
Optionally, the ship lock control device 60 may further include a system building module, and the system building module may be specifically configured to:
before acquiring the ship lock operation data, constructing a digital twin basic system based on open-source digital twin engine software;
constructing the ship lock peripheral scene model in the digital twin basic system based on a topographic map;
constructing the ship lock body model in the digital twin foundation system based on a ship lock design drawing and a ship lock building information model;
constructing the ship model in the digital twin foundation system based on a ship design drawing and a ship appearance photo;
integrating the ship lock peripheral scene model, the ship lock body model and the ship model in the digital twin basic system to obtain the digital twin system corresponding to the physical world.
Optionally, the obtaining module 61 may be specifically configured to:
based on a wired network or a wireless network, connecting ubiquitous sensing equipment for detecting the operation of the ship lock;
periodically obtaining the ship lock operation data from the ubiquitous sensing device.
Optionally, the ship lock control device 60 may further include a surveillance video fusion module, and the surveillance video fusion module may be configured to:
acquiring a ship lock monitoring image;
fusing the ship lock monitoring image and the ship lock body model based on a video fusion technology to generate a ship lock monitoring model so as to play the ship lock monitoring image in the digital twin system.
Optionally, the ship lock control device 60 may further include a display module, and the display module may be configured to:
generating statistical data of the ship lock operation data;
and transmitting at least one of the acquired ship lock operation data, the operation control signal data and the statistical data to a display device.
Optionally, the ship lock control device 60 may further include a warning module, where the warning module may be configured to send warning information when detecting that the ship lock operation data or the control signal is abnormal.
Optionally, the warning module may be further configured to determine a location where an abnormality occurs when detecting that the ship lock operation data or the control signal is abnormal, and display an abnormality record at the location in the digital twin system.
Based on the same inventive concept, an embodiment of the present application further provides an electronic device, where the electronic device includes a memory and a processor, where the memory stores program instructions, and the processor executes the steps in any one of the above implementation manners when reading and executing the program instructions.
The electronic equipment provided by the invention can be used for executing the ship lock control method based on the digital twin system. The electronic device may be a Personal Computer (PC), a tablet PC, a Personal Digital Assistant (PDA), a Mobile Internet Device (MID), or the like.
In this embodiment, the electronic device may include a processing unit, a communication unit, a storage unit, and a ship lock control device 60, which are electrically connected directly or indirectly between the respective elements of the processing unit, the communication unit, the storage unit, and the ship lock control device 60, so as to realize data transmission or interaction. For example, the components may be electrically connected to each other via one or more communication buses or signal lines.
The processing unit may be a processor. For example, the processor may be a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed.
The communication unit is used for establishing communication connection between the electronic equipment and the motion sensing device through a network, and receiving and sending data through the network, wherein the network can be a wired network, a wireless network and the like.
In this embodiment, the storage unit may be configured to store motion data when the preset object makes the preset motion. The storage unit may be further configured to store a program, and the processing unit executes the program after receiving the execution instruction.
Further, the ship lock control device 60 includes at least one software function module which can be stored in the storage unit in the form of software or firmware (firmware) or is solidified in the Operating System (OS) of the electronic device. The processing unit is used for executing executable modules stored in the storage unit, such as software functional modules and computer programs included in the ship lock control device 60.
It is to be understood that the embodiments of the present application provide only one configuration of an electronic device, and the electronic device may further include more or less components. The components may be implemented in hardware, software, or a combination thereof.
Based on the same inventive concept, an embodiment of the present application further provides a storage medium, where the readable storage medium stores computer program instructions, and the computer program instructions are read by a processor and executed to perform the steps in any of the above implementation manners.
The storage medium may be a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Read Only Memory (EPROM), an electrically Erasable Read Only Memory (EEPROM), or other media capable of storing program codes. The storage medium is used for storing a program, and the processor executes the program after receiving an execution instruction.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
Alternatively, all or part of the implementation may be in software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part.
The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.).
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A ship lock control method based on a digital twin system is characterized by comprising the following steps:
acquiring ship lock operation data, wherein the ship lock operation data comprises at least one of water levels of upstream and downstream navigation channels of a ship lock, a gate switch operation state, a lock indoor water level, ship lock valve opening and closing measurement and ship position and speed of passing through the lock;
transmitting the ship lock operation data to a constructed digital twin system, wherein the digital twin system comprises a ship lock peripheral scene model, a ship lock body model and a ship model;
receiving an operation control signal to simulate the operation state of the ship lock based on the acquired ship lock operation data in the digital twin system;
controlling the ship lock based on the digital twin system.
2. The method of claim 1, wherein prior to said obtaining ship lock operational data, the method further comprises:
constructing a digital twin basic system based on open-source digital twin engine software;
constructing the ship lock peripheral scene model in the digital twin basic system based on a topographic map;
constructing the ship lock body model in the digital twin foundation system based on a ship lock design drawing and a ship lock building information model;
constructing the ship model in the digital twin foundation system based on a ship design drawing and a ship appearance photo;
integrating the ship lock peripheral scene model, the ship lock body model and the ship model in the digital twin basic system to obtain the digital twin system corresponding to the physical world.
3. The method of claim 1, wherein the obtaining ship lock operational data comprises:
based on a wired network or a wireless network, connecting ubiquitous sensing equipment for detecting the operation of the ship lock;
periodically obtaining the ship lock operation data from the ubiquitous sensing device.
4. The method of claim 1, wherein after the operation control signal is accessed to simulate the operational state of the ship lock based on the acquired ship lock operational data in the digital twin system, the method comprises:
acquiring a ship lock monitoring image;
fusing the ship lock monitoring image and the ship lock body model based on a video fusion technology to generate a ship lock monitoring model so as to play the ship lock monitoring image in the digital twin system.
5. The method of claim 1, further comprising:
generating statistical data of the ship lock operation data;
and transmitting at least one of the acquired ship lock operation data, the operation control signal data and the statistical data to a display device.
6. The method of claim 1, further comprising:
and when detecting that the ship lock operation data or the control signal is abnormal, sending out warning information.
7. The method of claim 6, further comprising:
and when detecting that the ship lock operation data or the control signal is abnormal, determining a positioning position where the abnormality occurs, and displaying an abnormal record at the positioning position in the digital twin system.
8. A ship lock control device based on a digital twin system is characterized by comprising:
the acquisition module is used for acquiring ship lock operation data, wherein the ship lock operation data comprises at least one of water levels of upstream and downstream pilot channels of a ship lock, a gate switch operation state, a water level in a lock chamber, opening and closing measurement of a ship lock valve and positions and speeds of ship passing through the lock;
the transmission module is used for transmitting the ship lock operation data to a constructed digital twin system, and the digital twin system comprises a ship lock peripheral scene model, a ship lock body model and a ship model;
the receiving module is used for receiving an operation control signal so as to simulate the operation state of the ship lock based on the acquired ship lock operation data in the digital twin system;
a control module to control the ship lock based on the digital twin system.
9. An electronic device comprising a memory having stored therein program instructions and a processor that, when executed, performs the steps of the method of any of claims 1-7.
10. A storage medium having stored thereon computer program instructions for executing the steps of the method according to any one of claims 1 to 7 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111050577.XA CN113722806A (en) | 2021-09-08 | 2021-09-08 | Ship lock control method and device based on digital twin system and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111050577.XA CN113722806A (en) | 2021-09-08 | 2021-09-08 | Ship lock control method and device based on digital twin system and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113722806A true CN113722806A (en) | 2021-11-30 |
Family
ID=78682615
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111050577.XA Pending CN113722806A (en) | 2021-09-08 | 2021-09-08 | Ship lock control method and device based on digital twin system and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113722806A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115341524A (en) * | 2022-08-15 | 2022-11-15 | 浙江数智交院科技股份有限公司 | Tidal surge river section ship lock control system and method based on digital twin technology |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113223162A (en) * | 2021-04-13 | 2021-08-06 | 交通运输部科学研究院 | Method and device for constructing digital twin scene of inland waterway |
| CN113268804A (en) * | 2021-06-17 | 2021-08-17 | 江南造船(集团)有限责任公司 | Ship building method, system, medium and terminal based on digital twinning |
-
2021
- 2021-09-08 CN CN202111050577.XA patent/CN113722806A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113223162A (en) * | 2021-04-13 | 2021-08-06 | 交通运输部科学研究院 | Method and device for constructing digital twin scene of inland waterway |
| CN113268804A (en) * | 2021-06-17 | 2021-08-17 | 江南造船(集团)有限责任公司 | Ship building method, system, medium and terminal based on digital twinning |
Non-Patent Citations (3)
| Title |
|---|
| 李明伟等: "基于数字孪生的船闸安全智慧管理方法", 《水运工程》, no. 6, 3 June 2021 (2021-06-03), pages 212 - 217 * |
| 李明伟等: "基于数字孪生的船闸安全智慧管理方法", 《水运工程》, no. 6, pages 212 - 217 * |
| 杜军平: "多源运动图像的跨尺度融合研究", 30 June 2018, 北京邮电大学出版社, pages: 1 - 17 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115341524A (en) * | 2022-08-15 | 2022-11-15 | 浙江数智交院科技股份有限公司 | Tidal surge river section ship lock control system and method based on digital twin technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11693901B2 (en) | Systems and methods for geolocation prediction | |
| Figueiredo et al. | Three decades of statistical pattern recognition paradigm for SHM of bridges | |
| US20180053093A1 (en) | Integrative Cognition of Driver Behavior | |
| US20200082622A1 (en) | Method and System for Virtual Sensor Data Generation with Depth Ground Truth Annotation | |
| CN110070572A (en) | The method and system of range image is generated using sparse depth data | |
| CN108304861A (en) | Generate the training data of automotive vehicle leak detection | |
| CN111081017B (en) | Vehicle information management system, method, computer device, and storage medium | |
| US20200074175A1 (en) | Object cognitive identification solution | |
| WO2019197434A1 (en) | Method and system for managing a technical installation | |
| Tichý et al. | Analysis of predictive maintenance for tunnel systems | |
| CN113722806A (en) | Ship lock control method and device based on digital twin system and electronic equipment | |
| CN112613995A (en) | Abnormality diagnosis method and apparatus | |
| CN103824307B (en) | A kind of method and apparatus determining lost motion object pixel | |
| Samadi | The convergence of AI, IoT, and big data for advancing flood analytics research | |
| Saku et al. | Spatio-temporal prediction of soil deformation in bucket excavation using machine learning | |
| CN113869427A (en) | Scene analysis method and device, electronic equipment and storage medium | |
| JP2023042922A (en) | Learning system, device and method | |
| CN112040433B (en) | Data processing method and device | |
| KR102323228B1 (en) | Safety inspection maintenance method and system for structure using drone | |
| Edwards et al. | Digital twin development through auto-linking to manage legacy assets in nuclear power plants | |
| CN117010197A (en) | Equipment detection method and device based on digital twin | |
| CN116030223A (en) | Vehicle image generation method, device, computer equipment and storage medium | |
| CN113551677B (en) | Method for repositioning robot and related product | |
| KR20190101275A (en) | Method and system for preventing damage of port facilities when docking ships based on internet of things | |
| JP2019149081A (en) | Information collection device, information collection method, information collection program, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |