CN116068967A

CN116068967A - Three-dimensional digital visual monitoring system and method based on digital twin

Info

Publication number: CN116068967A
Application number: CN202211433346.1A
Authority: CN
Inventors: 施军; 张祖兴; 王祥; 何晓龙; 张鹏; 李茹意
Original assignee: Kunming Dingcheng Technology Co ltd
Current assignee: Kunming Dingcheng Technology Co ltd
Priority date: 2022-11-16
Filing date: 2022-11-16
Publication date: 2023-05-05

Abstract

The invention discloses a three-dimensional digital visual monitoring system and method based on digital twinning, and relates to the technical field of tobacco processing. Comprising the following steps: the system comprises a data acquisition module, a three-dimensional visualization system platform and a Personal Computer (PC) terminal, wherein: the data acquisition module is used for acquiring data information, converting the format of the data information and transmitting the converted data information to the three-dimensional visualization system platform; the three-dimensional visualization system platform is used for constructing digital twin models of a plurality of devices according to the converted data information; and the PC terminal is used for bearing the three-dimensional visual system platform and providing a display interface for the three-dimensional visual system platform. Compared with the existing two-dimensional monitoring system, the real-time dynamic simulation monitoring system enriches the dimension of data, increases the real-time position information of the material tray and the control instruction of the on-site PLC, and improves the workshop production integrated management level.

Description

Three-dimensional digital visual monitoring system and method based on digital twin

Technical Field

The invention relates to the technical field of tobacco processing, in particular to a three-dimensional digital visual monitoring system and method based on digital twinning.

Background

In the tobacco logistics industry, a filter stick forming workshop starts to put filter sticks produced by a forming machine into a material tray by a tray loader, then the material tray is assembled in a warehouse-in station, after the number of the material tray reaches the design requirement, the material tray is sent into a three-dimensional warehouse by a stacker for storage and solidification, after a certain solidification time is reached, the material tray is sent into a warehouse-out station by the stacker, the material tray is sent into a tray unloader after being separated by the warehouse-out station, and the filter sticks are discharged by the tray unloader and sent into a transmitter to be sent to a cigarette machine.

The operation management of the automatic filter rod warehouse needs to rely on WCS (Warehouse Control System ), WMS (Warehouse Management System, warehouse management system), the filter rod warehouse monitoring system of the existing filter rod workshop is still in a two-dimensional stage, the existing system cannot clearly show the position relation among a forming machine, a loading and unloading disc machine, an in-out warehouse platform, a filter rod warehouse and a stacker in the filter rod workshop, the real-time position of the filter rod disc in the in-out warehouse platform and the distribution state and information of the filter rod disc in a three-dimensional warehouse, and meanwhile, the control on the in-situ in-out warehouse platform is lacked, so that a plurality of inconveniences are brought to workshop management staff.

In order to make up for the defects of the two-dimensional management system, a three-dimensional visual monitoring system of the filter rod library based on digital twinning needs to be developed.

Disclosure of Invention

The invention provides the system for the problem that the existing two-dimensional management system cannot clearly display the position relation among a forming machine, a loading and unloading disc machine, a warehouse-in platform, a filter rod warehouse and a stacker in a filter rod workshop, the real-time position of a filter rod disc in the warehouse-in platform and the distribution state and information of the filter rod disc in a three-dimensional warehouse, and meanwhile, the control of the site warehouse-in platform is lacking.

In order to solve the technical problems, the invention provides the following technical scheme:

in one aspect, the invention provides a digital twinning-based three-dimensional digital visual monitoring system, which comprises a data acquisition module, a three-dimensional visual system platform and a Personal Computer (PC) terminal, wherein:

the data acquisition module is used for acquiring data information, converting the format of the data information and transmitting the converted data information to the three-dimensional visualization system platform; and transmitting the related instruction issued by the three-dimensional visualization platform to equipment connected with the data acquisition module, so as to control the equipment.

And the three-dimensional visualization system platform is used for constructing digital twin models of a plurality of devices according to the converted data information.

And the PC terminal is used for bearing the three-dimensional visual system platform and providing a display interface for the three-dimensional visual system platform.

Optionally, the data acquisition module is further configured to:

the data acquisition module is connected with a plurality of Programmable Logic Controllers (PLCs) through Siemens S7 protocol or OPC UA protocol and is used for acquiring data information in the PLCs; wherein, a plurality of PLCs include at least warehouse entry platform PLC and stacker PLC.

The data acquisition module is connected with the database of the two-dimensional monitoring system through an API interface and is used for acquiring data information in the WCS database of the two-dimensional monitoring system and the WMS of the two-dimensional warehouse management system.

Optionally, the three-dimensional visualization system platform comprises:

the interactive three-dimensional model module is used for storing a pre-established three-dimensional model of the filter rod workshop and carrying out rotation, scaling, translation, view switching and display adjustment on the three-dimensional model of the filter rod workshop according to a received user instruction; wherein, the three-dimensional model of filter rod workshop includes the three-dimensional model of macroscopic scene in filter rod storehouse workshop and the three-dimensional model of a plurality of equipment in the filter rod workshop, and the three-dimensional model of a plurality of equipment includes: the system comprises a forming machine three-dimensional model, a tray loader three-dimensional model, a transmitter three-dimensional model, a warehouse-in platform three-dimensional model, a filter rod three-dimensional library three-dimensional model, a stacker three-dimensional model and a tray unloader three-dimensional model.

Optionally, the three-dimensional visualization system platform further comprises: a digital twinning module; the digital twin module comprises a tray digital twin model, a stacker digital twin model, an in-out warehouse station digital twin model and a filter rod warehouse digital twin model.

Wherein the material tray digital twin model is used for acquiring a plurality of material tray position information in the converted data information provided by the data acquisition module, and constructing the real-time position of the virtual material tray in the three-dimensional model of the warehouse-in and warehouse-out platform according to the position information of the material trays.

The stacker digital twin model is used for acquiring the PLC signals driven by a plurality of stackers in real time in the converted data information provided by the data acquisition module, and constructing the real-time motion state of the stacker three-dimensional model in the macroscopic scene three-dimensional model of the filter rod library workshop according to the PLC signals driven by the stackers in real time.

The in-out platform digital twin model is used for acquiring the PLC signals of the in-out platform in the converted data information provided by the data acquisition module, and enabling the virtual display state of the three-dimensional model of the in-out platform to be consistent with the real-time state of the actual in-out platform according to the PLC signals of the in-out platform.

The digital twin model of the filter rod library is used for constructing a virtual tray group in the three-dimensional model of the filter rod library according to the goods space inventory information in the two-dimensional warehouse management system WMS in the converted data information provided by the data acquisition module so as to enable the virtual tray group inventory on the goods space in the three-dimensional model of the filter rod library to be consistent with the inventory in the actual three-dimensional filter rod library.

Optionally, the goods space inventory information at least comprises position information of each goods space in the actual filter stick three-dimensional warehouse, the specification of goods loaded by the trays on the goods space, the warehouse-in time and warehouse-in platform of the trays on the goods space, and the number of trays contained in the tray group on the goods space.

Optionally, the three-dimensional visualization system platform further comprises:

the system comprises a data acquisition module, an input/output platform management module, a target input/output platform management module and a target output/output platform management module, wherein the input/output platform management module is used for responding to a target input/output platform management instruction triggered by clicking a target input/output platform three-dimensional model, acquiring input/output platform PLC signals in converted data information provided by the data acquisition module and providing a platform management window of a target input/output platform.

The platform management window of the target in-out and in-out platform is used for providing a digital twin model of the target in-out and in-out platform, real-time production information and operation parameters of the target in-out and in-out platform, a human-machine interface (HMI), a fault log and an operation log; the HMI interface is used for receiving a target access platform control instruction triggered by clicking an equipment control button provided in the HMI interface, and sending the target access platform control instruction to a target access platform on site through the data acquisition module so as to control the operation of the target access platform.

Optionally, the three-dimensional visualization system platform further comprises: the fault alarm module is used for acquiring the equipment warning information and the fault information in the converted data information provided by the data acquisition module, and displaying the currently acquired equipment warning information and the currently acquired fault information in a preset equipment fault window.

The equipment warning information comprises a warehouse-in platform PLC warning information and a stacker PLC warning information; the equipment fault information comprises the PLC fault information of the warehouse-in platform, the task abnormality information of the stacker and the request abnormality information of the warehouse-in platform.

Optionally, the fault alarm module is specifically configured to automatically pop up a device fault window when the device warning information and the fault information are acquired, and display a device warning information list and/or a fault information list in the device fault window; the device is also used for clearing corresponding information in a corresponding list after the warning/fault information in the device warning/fault information list in the device fault window is processed; and the device fault window is also used for automatically folding the device fault window when no device warning information and no fault information exist in the device fault window.

and the filter rod library management module is used for responding to a filter rod library management instruction triggered by clicking the three-dimensional model of the filter rod library, acquiring goods space inventory information in the two-dimensional warehouse management system WMS in the converted data information provided by the data acquisition module, and providing a two-dimensional filter rod library management window and a three-dimensional filter rod library management window.

The two-dimensional filter rod library management window provides goods space inquiry options, generates goods space inquiry conditions according to the currently selected goods space inquiry options, presents target goods spaces corresponding to the goods space inquiry conditions, the distribution state of the trays on the target goods spaces and the storage information of the target goods spaces in a 2D view mode, and provides relevant information of the trays on the target goods spaces.

The three-dimensional filter rod library management window provides a digital twin model of the filter rod library, related information of a virtual tray on the selected goods space and a tray query option; the three-dimensional filter rod library management window is also used for generating a material disc query condition according to the currently selected material disc query option, acquiring a query result corresponding to the material disc query condition according to the material disc library storage information on the goods space in the two-dimensional warehouse management system WMS, and displaying the query result in the three-dimensional filter rod library management window.

the stacker management module is used for responding to a target stacker management instruction triggered by clicking the three-dimensional stacker model, acquiring a PLC signal driven by the target stacker in real time in the converted data information provided by the data acquisition module, and providing an equipment information display window, an operation state information real-time monitoring window, a manual scheduling window, a task management query window, an operation log management window and a fault log management window of the target stacker.

And the equipment information display page of the target stacker is also provided with a digital twin model of the target stacker.

the equipment management module provides an equipment account information management window, a spare part information management window, an equipment maintenance information management window and a random data management window of the filter rod workshop.

The equipment standing book information management window is used for providing a filter rod workshop three-dimensional model display sub-window and an equipment information list.

The spare part information management window provides a spare part information list of equipment in the filter rod workshop, a spare part three-dimensional model display sub-window and a spare part installation position display sub-window; the spare part information management window responds to the selected target spare part in the spare part information list, displays a three-dimensional model of the target spare part in the spare part three-dimensional model display sub-window, and simultaneously displays a mounting position schematic diagram of the target spare part in the spare part mounting position display sub-window.

The equipment maintenance information management window provides a maintenance record list, a maintenance method resource list and a maintenance method resource display window of equipment in the filter rod workshop; the maintenance method resource display window is used for displaying the selected maintenance method resource in the current maintenance method resource list.

The random data management window provides random data of equipment in the filter rod workshop in a list mode.

On the other hand, the invention provides a three-dimensional digital visual monitoring method based on digital twinning, which is realized by a three-dimensional digital visual monitoring system based on digital twinning, and the system comprises a data acquisition module, a three-dimensional visual system platform and a Personal Computer (PC) terminal, and comprises the following steps:

the data acquisition module acquires data information, performs format conversion on the data information and sends the converted data information to the three-dimensional visualization system platform; transmitting an instruction issued by the three-dimensional visualization platform to equipment connected with the data acquisition module, so as to control the equipment.

And the three-dimensional visualization system platform constructs digital twin models of a plurality of devices according to the converted data information.

The PC terminal bears the three-dimensional visual system platform and provides a display interface for the three-dimensional visual system platform.

Optionally, the data acquisition module is further configured to:

Optionally, the three-dimensional visualization system platform comprises:

The technical scheme provided by the embodiment of the invention has the beneficial effects that at least:

in the scheme, the real-time dynamic simulation monitoring of the filter rod production process of the filter rod production workshop is realized by establishing the filter rod library digital twin system consisting of the data acquisition module, the three-dimensional interaction module, the fault alarm module, the equipment management module, the system setting module, the log management module, the filter rod library management module, the warehouse entry platform management module and the stacker management module, compared with the conventional WCS and WMS two-dimensional system, the dimension of data is enriched in a three-dimensional visualization mode, the real-time position information of a material tray and the control instruction of the field PLC are increased, and the workshop production integrated management level is improved.

According to the invention, the digital model of the filter rod library is constructed in the three-dimensional digital visual monitoring system by collecting the filter rod stock inventory information in the WMS warehouse management system, so that production staff can conveniently search the filter rods in the three-dimensional library through the three-dimensional model, and the working efficiency is improved.

According to the method, the three-dimensional model of all production equipment of the filter rod workshop is built, so that a user can quickly find the equipment position in a three-dimensional visual scene, and meanwhile, the user can conveniently check the three-dimensional scene of the whole filter rod workshop.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a block diagram of a digital twinning-based three-dimensional digital visual monitoring system provided by an embodiment of the present invention;

FIG. 2 is a layout of a filter rod forming shop according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a warehouse entry and exit platform management module according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of device information provided by an embodiment of the present invention;

FIG. 5 is a schematic view of a channel plane number according to an embodiment of the present invention;

fig. 6 is a schematic diagram of a list of station requests provided in an embodiment of the present invention;

FIG. 7 is a schematic diagram of a device log provided by an embodiment of the present invention;

FIG. 8 is a schematic diagram of an equipment fault log provided by an embodiment of the present invention;

FIG. 9 is a schematic diagram of a stacker provided by an embodiment of the present invention;

FIG. 10 is a schematic diagram of a main interface module according to an embodiment of the present invention;

FIG. 11 is a schematic diagram of the number of platform trays according to an embodiment of the present invention;

fig. 12 is a schematic diagram of filter rod library management in 2D mode according to an embodiment of the present invention;

fig. 13 is a schematic diagram of filter rod library management in 3D mode according to an embodiment of the present invention;

FIG. 14 is a schematic diagram of a 3D cargo space information display according to an embodiment of the present invention;

FIG. 15 is a schematic diagram of a stacker management module according to an embodiment of the present invention;

FIG. 16 is a schematic diagram of a task management interface provided by an embodiment of the present invention;

FIG. 17 is a schematic diagram of an equipment ledger provided by an embodiment of the present invention;

FIG. 18 is a schematic diagram of an apparatus description provided by an embodiment of the present invention;

FIG. 19 is a schematic diagram of a device spare part provided by an embodiment of the present invention;

FIG. 20 is a schematic diagram of equipment maintenance provided by an embodiment of the present invention;

FIG. 21 is a diagram of a random data provided by an embodiment of the present invention;

fig. 22 is a flowchart of a three-dimensional digital visual monitoring method based on digital twinning according to an embodiment of the present invention.

Detailed Description

In order to make the technical problems, technical solutions and advantages to be solved more apparent, the following detailed description will be given with reference to the accompanying drawings and specific embodiments.

As shown in fig. 1, the embodiment of the invention provides a three-dimensional digital visual monitoring system based on digital twinning, which is used for realizing a three-dimensional digital visual monitoring method based on digital twinning. The system comprises a data acquisition module, a three-dimensional visualization system platform and a Personal Computer (PC) terminal, wherein:

Optionally, the data acquisition module is further configured to:

In a possible embodiment, as shown in the layout of the rod making shop in fig. 2, the workflow of the rod making shop may be: the filter sticks produced by the forming machine 1 are loaded into the material trays by the tray loading machine 2, then are assembled in the warehouse-in platform 3, when the number of the trays meets the design requirement, the material tray groups are sent into the three-dimensional warehouse 4 by the stacking machine 8 for storage and solidification, after a certain solidification time is reached, the material tray groups are sent into the warehouse-out platform 5 by the stacking machine 8, the material tray groups are sent into the tray unloading machine 6 after being separated by the warehouse-out platform, and the filter sticks are sent into the transmitter 7 to be sent to the cigarette making machine after being unloaded by the tray unloading machine.

Further, the data acquisition module is connected with the on-site warehouse entry platform and the stacker PLC through Siemens S7 protocol or OPC UA (Object Linking and Embedding for Process Control Unified Architecture) protocol for object linking and embedding of process control, and is connected with the on-site two-dimensional monitoring system WCS/WMS database through an API (Application Programming Interface ) for acquiring task information of the warehouse entry platform and the stacker, equipment operation information of the stacker, platform LED screen information, filter rod inventory information in a three-dimensional library, filter rod production information and the like. And storing, processing and converting the acquired data into a data format required by the three-dimensional visualization system platform.

In a possible implementation manner, the three-dimensional visualization system platform can be developed based on Unity3d and is used for constructing digital twin models of the warehouse-in and warehouse-out platform, the stacker, the material tray and the filter rod library, and the digital twin models of the warehouse-in and warehouse-out platform, the stacker and the filter rod library which are modeled in advance are driven according to actual data acquired by the data acquisition module through a digital twin technology, so that all parts of the digital models and the warehouse-in and warehouse-out platform, the stacker and the filter rod library in the real world are kept in the same real-time state.

In a possible embodiment, the three-dimensional visualization system platform includes the following functional modules in table 1:

TABLE 1

The interactive three-dimensional model module is used for storing a pre-established three-dimensional model of the filter rod workshop and carrying out rotation, scaling, translation, view switching and display adjustment on the three-dimensional model of the filter rod workshop according to a received user instruction.

Wherein, the three-dimensional model of filter rod workshop includes the three-dimensional model of macroscopic scene in filter rod storehouse workshop and the three-dimensional model of a plurality of equipment in the filter rod workshop, and the three-dimensional model of a plurality of equipment includes: the system comprises a forming machine three-dimensional model, a tray loader three-dimensional model, a transmitter three-dimensional model, a warehouse-in platform three-dimensional model, a filter rod three-dimensional library three-dimensional model, a stacker three-dimensional model and a tray unloader three-dimensional model.

In a possible implementation, a user can rotate, zoom, translate, etc. the three-dimensional scene of the filter rod shop through the mouse of the PC terminal, and by monitoring the try button and the top view button, the three-dimensional scene view can be quickly switched.

The visual three-dimensional model of the filter rod library mainly comprises the following components: macro scene of filter rod warehouse workshop, forming machine, loading and unloading disc machine, warehouse-in and warehouse-out platform, filter rod warehouse, transmitter, etc.

Further, a three-dimensional model of the filter rod library is established in advance through 3d Max and other software, and the three-dimensional model is converted into an FBX format model and then is imported and stored. The interactive three-dimensional model module receives a mouse action instruction in the three-dimensional scene, and performs actions such as rotation, scaling and translation on the three-dimensional model of the filter rod library according to a preset corresponding relation between the mouse action instruction in the three-dimensional scene and the action of the three-dimensional model of the filter rod library.

In a possible implementation, the interface of the access platform management module is shown in fig. 3, and the access platform management module can be accessed by double clicking the access platform in the three-dimensional scene with a mouse.

Further, the in-out platform management module may include an HMI interface, a device information interface, a channel plane number, a platform request list, a device log module, and a real-time running status.

The left side of the management module of the in-out and in-out platform displays a three-dimensional model of the in-out and in-out equipment, the three-dimensional model can be rotated and scaled, the number of trays in the platform can be displayed in real time, the right side is a control and display panel of the equipment, the site platform can be controlled through related functions, and related information in the platform can be read.

HMI (Human Machine Interface, man-machine interface) functions are described as follows:

(1) The equipment control function can communicate with the on-site warehouse-in and warehouse-out platform PLC through the data acquisition module, and control the operation of the on-site warehouse-in and warehouse-out platform.

(2) And the material disc information is read from the RFID (Radio Frequency Identification ) coding information in the platform PLC through the data acquisition module and displayed in the three-dimensional visualization system, so that the information is convenient for a manager to check.

(3) LED information in the WCS system is read through the data acquisition module and displayed in the three-dimensional visualization system, so that the management personnel can check the information conveniently.

The equipment information interface is shown in fig. 4, and related information in the PLC is collected through the data collection module and displayed in the three-dimensional visualization system, wherein the display information can comprise the equipment state of the current platform, the plan number, the task number, the current number of plates, the number of channel plates and the warehouse-in and warehouse-out request of filter rods in the channel.

The channel plane number is shown in fig. 5, and the number of each channel is mainly displayed, so that a manager can conveniently check the channel information.

The request list is shown in fig. 6, and the data acquisition module acquires the request information sent by the access platform to the WCS system, wherein the related information comprises a request type, a request stage, a request time, a task type, associated equipment, a source address type, a source address fork type, a target address fork type, a completion time and the like. The inquiry of the related task information can be carried out by inputting any condition combination of the device name, the request phase, the request time and the completion time.

For tasks of the platform, the platform can be activated and abandoned in a three-dimensional visualization system, and instructions are transmitted to the WCS system for operation.

The equipment log mainly comprises an operation log and a fault log of the equipment, and relevant data in the platform PLC are collected through the data collection module and are displayed as shown in figures 7 and 8.

The operation log and the fault log of the platform are stored in a database at the rear end after data are acquired through the data acquisition module, and relevant content is displayed according to the query conditions. The equipment operation log mainly displays the on-off time of equipment, and the equipment fault log mainly displays the fault occurrence time and the fault content of the equipment.

Optionally, the digital twin module comprises a tray digital twin model, a stacker digital twin model, an in-out platform digital twin model and a filter rod library digital twin model.

In a possible implementation manner, in the digital twin model of the tray, the PLC signals driven in real time by the tray mainly include the signals shown in the following table 2:

TABLE 2

Further, by collecting the signals in the table 2, the material tray can be driven to move in real time in the three-dimensional visual system, so that the real-time position of the material tray is monitored through the three-dimensional visual system, and the real-time position of the material tray is consistent with the virtual scene.

In a possible embodiment, as shown in fig. 9, in digital twinning of the stacker, at least PLC signals for real-time driving of the stacker are: the stacker is provided with a start-stop signal 1 for moving along the column direction, a start-stop signal 3 for lifting a stacker-mounted cargo platform along the layer direction, a stacker fork telescopic start-stop signal 2, real-time speed information and stacker picking completion information and stacker discharging completion information in three directions.

In a possible implementation mode, in the digital twin model of the in-out platform, the three-dimensional visualization system can send instructions to the field platform through the data acquisition module to control the operation of the field device. The instructions that can be sent are: silencing all stations in the warehouse area, clearing the number of production trays of the stations, standing the upper layer and the lower layer of the warehouse-in station, planning to clear the warehouse-in station, prohibiting the warehouse-in and warehouse-out request of the warehouse-in station, and the like.

In a feasible implementation mode, the digital twin model of the filter rod library collects filter rod inventory information in the WMS system through the data collection module, and the filter rod library in the three-dimensional visual scene is consistent with the actual filter rod library in display. At least the filter rod inventory information in the WMS system is collected: the specifications of the filter sticks, the warehousing time of the filter sticks, the warehousing platform of the filter sticks, and the warehousing position information of the filter sticks, such as rows, layers and columns.

Optionally, the three-dimensional visualization system platform may further comprise a main interface module, which is the core of the YF175 rod library three-dimensional visualization system, through which individual sub-modules of the system may be accessed. The main interface module is shown in fig. 10.

Further, the main interface module may include the following:

(1) System name: YF175 filter rod library three-dimensional digital visual monitoring system (name can be changed according to user's requirements).

(2) System time: the time of the current computer is displayed.

(3) A user account: the user account which is logged in currently is displayed, the current user can log out through a log-off button in the drop-down dish, the login interface is returned, and other users are logged in again. The exit button may shut down the system and exit to the Windows interface.

(4) And a fault alarm module: the device warning information and the fault information in the converted data information provided by the data acquisition module are acquired, and the currently acquired device warning information and fault information are displayed in a preset device fault window.

In a possible implementation, the fault list of the fault alarm module includes the fault of the platform PLC, stacker task abnormality information and in-out platform abnormality information. The device is in a folding state under the default condition, when a fault occurs, the icon turns red, the number of faults is displayed, meanwhile, a fault frame of the device is automatically popped up, and when a mouse clicks a fault list, the device can be automatically positioned to the position of the device in a three-dimensional scene, and the fault reason and the solution are displayed;

(5) Navigation bar: the navigation bar panel is mainly used for placing interactive buttons, such as user management, warehouse entry and exit logs of filter sticks, equipment management, number of trays, help and the like.

(6) Cargo space use condition: the number of used cargo spaces, the number of forbidden cargo spaces, the number of empty cargo spaces and the number of remaining cargo spaces are displayed in the form of instrument panels.

(7) Filter stick production information: the stored information of the filter sticks in the vertical warehouse and the flat warehouse and the number of the filter sticks coming in and going out of the warehouse on the same day are displayed through the list, and when the mouse clicks the list, the equipment producing the filter sticks in the three-dimensional scene can be highlighted.

(8) Operation of the three-dimensional model: the three-dimensional scene can be rotated and zoomed through the mouse, and the angle of the scene can be adjusted through the view switching button.

(9) Search box function: by inputting the equipment number, the scene can be rapidly switched to the equipment, 1-1 represents a warehouse-in side No. 1 station, and 2-1 represents a warehouse-out side No. 1 station.

(10) Setting state display: and displaying real-time running states of the equipment through red lights, yellow lights and green lights in the three-dimensional scene, wherein the red lights indicate equipment faults or shutdown, the green lights indicate normal running of the equipment, and the yellow lights indicate warning information of the equipment.

(11) Highlighting of the model: when the mouse is hovered over the device, the lighting within the device is highlighted, indicating the current device selected state.

(12) Shortcut key operation: r: rapidly switching the view angle to the warehouse-in side; c, rapidly switching the view angle to the warehouse-out side; f: rapidly switching the view angle to a top view; s: quickly moving the cursor into the search box; h: rapidly opening filter rod warehouse goods space management; p: rapidly overview the number of discs at all stations, as shown in fig. 11; m: ending the roaming function; esc: and exiting the system.

(13) Label meaning in view: grey arrows indicate no request by the station, green arrows indicate a request by the station, arrow up indicates upper lanes, arrow down indicates lower lanes. The numbers below the arrows indicate the number of all discs in the current channel, the lower layer only has the number of real discs on the warehouse-in side, and the upper layer and the lower layer on the warehouse-out side have the count.

Optionally, the filter rod library management module is used for responding to a filter rod library management instruction triggered by clicking the three-dimensional model of the filter rod library, acquiring goods space inventory information in the two-dimensional warehouse management system WMS in the converted data information provided by the data acquisition module, and providing a two-dimensional filter rod library management window and a three-dimensional filter rod library management window.

The two-dimensional filter rod library management window provides cargo space inquiry options, generates cargo space inquiry conditions according to the currently selected cargo space inquiry options, presents target cargo spaces corresponding to the cargo space inquiry conditions, the distribution state of trays on the target cargo spaces and storage information of the target cargo spaces in a 2D view mode, and provides related information of the trays on the target cargo spaces; the cargo space inquiry options can comprise cargo space arrangement number, cargo space type and the like.

The three-dimensional filter rod library management window provides a digital twin model of the filter rod library, related information of a virtual tray on the selected goods space and a tray query option; the three-dimensional filter rod library management window is also used for generating a material disc query condition according to the currently selected material disc query option, acquiring a query result corresponding to the material disc query condition according to the material disc library storage information on the goods space in the two-dimensional warehouse management system WMS, and displaying the query result in the three-dimensional filter rod library management window. The tray query options may include tray type, filter rod gauge, cure time, etc., among others.

In a feasible implementation mode, the filter rod library management module displays the distribution state of the filter rod trays in the three-dimensional library in a two-dimensional and three-dimensional mode by means of the WMS cargo space information acquired by the data acquisition module, and when a mouse moves onto the tray, the storage time, the storage platform, the curing time and the like of the discharge tray can be displayed. Through inquiry, the filter rod stock discs meeting the conditions can be brushed and selected and displayed in the three-dimensional warehouse.

And (5) a filter stick library or a shortcut key H in the three-dimensional scene is double-clicked by a mouse to enter a filter stick library management module.

Wherein, the filter rod library management in the 2D mode is shown in fig. 12.

Further, the 2D filter rod library management function is as follows:

(1) The filter rod library goods position display can be switched through the selection of the goods position row number.

(2) The tray types are divided into full tray, empty tray and all, and the corresponding tray can be displayed on the goods space by selecting the tray type.

(3) The total number of trays and the number of occupied goods space can be combined and inquired through selecting the specification of the filter stick and the solidifying time, and the total number of trays and the number of occupied goods space are displayed in the goods space area.

(4) When the mouse is suspended on the material tray, the specification, the position information, the warehousing time, the warehousing platform, the number of the material trays and the like of the filter stick can be displayed.

The filter rod library management in 3D mode is shown in fig. 13.

Further, the 3D filter rod library management function is as follows:

(1) The three-dimensional model can be rotated to facilitate viewing of the cargo on the stereoscopic warehouse, as shown in fig. 14.

(2) The relevant information of the filter stick disc can be displayed after the goods are clicked by the mouse, and meanwhile, the tray group is highlighted.

(3) And displaying the goods meeting the conditions in the list box through the query button.

Optionally, the stacker management module is configured to obtain a PLC signal driven in real time by the target stacker in the converted data information provided by the data acquisition module in response to a target stacker management instruction triggered by clicking the three-dimensional stacker model, and provide an equipment information display window, an operation state information real-time monitoring window, a manual scheduling window, a task management query window, an operation log management window and a fault log management window of the target stacker.

The stacker in the three-dimensional scene can be accessed to the stacker management module by double clicking the mouse, as shown in fig. 15.

The display data in the stacker management module is read from the WCS system through the data acquisition module, and the data is accessed in an API interface mode.

The equipment information may include equipment operational status, deployment location, current location, task status, task number, task category, source address, destination address, production materials, forks.

And the related instructions are transferred to the WCS system by manual scheduling, and the WCS system controls the stacker to operate.

The task management interface is shown in fig. 16.

The task management information includes an execution object, a task number, a task type, a source address name, a target address name, an execution state, a request time, a start time, and an end time. The query is performed by any combination of execution object, start time, end time, task type, source address, destination address.

The task of the stacker can be manually finished, canceled and edited, and related instructions are issued to the WCS system by the three-dimensional visualization system for execution.

The equipment log mainly comprises an operation log and a fault log of the equipment, and relevant data in the WCS system are collected through a data collection module and are displayed as shown in figures 7 and 8.

Optionally, the equipment management module is used for providing an equipment account information management window, a spare part information management window, an equipment maintenance information management window and a random data management window of the filter rod workshop.

In a possible implementation manner, the equipment management module comprises equipment account information, spare part information, spare maintenance information, random data and the like of the filter rod workshop.

The device ledger is shown in fig. 17. The left side of the equipment standing book management window is a filter rod workshop three-dimensional model display sub-window, the right side is equipment information, the equipment information comprises equipment names, asset numbers, the number of faults of equipment, equipment running time, equipment running states and manufacturers, and when a mouse is suspended on a right side list, corresponding equipment in a left three-dimensional scene can be highlighted.

The failure times and the running time of the equipment in the list are collected by the data collection module, processed and transmitted to the interface.

The maintenance method resources displayed in the maintenance method resource display window can be resources for performing maintenance introduction on the equipment in a text and video mode, as shown in fig. 18.

The spare parts show the information of the spare parts through list information, a three-dimensional model and installation positions, as shown in fig. 19.

The three-dimensional model can be rotated and scaled, so that a user can conveniently check the appearance shape of spare parts.

The maintenance method for displaying the warehouse entry platform is shown in a video mode, and is shown in fig. 20.

The left side frame is a maintenance method (video) of the equipment, the right side is a maintenance record, and after the equipment maintenance is carried out, a user can add maintenance information of the equipment into the system by adding a button.

The random data contains factory data of the equipment, and in addition, a user can upload and download the file and store the file into the system. As shown in fig. 21.

Optionally, the three-dimensional visualization system platform further comprises a system setting module, a log management module and a help module.

The system setting module comprises user management settings and three-dimensional model implicit setting.

In a possible implementation, the user management settings may include an added user, a user permission setting, a user role setting.

The newly added user can add to the user.

The user permission setting can set a menu operable to a currently logged-in user.

The three-dimensional scene model is set in a revealing mode, and revealing operation can be carried out on all devices in the three-dimensional scene.

The log management module comprises operation log management, filter rod warehouse entry log management, equipment fault log management and equipment operation log management.

In a possible implementation, the operation log includes a user name, an operation record, and a time, wherein the operation record mainly records the login time of the system user, an instruction issued to the field device, addition, deletion, modification, uploading and downloading of data to the user, and entry of maintenance information of the device.

The equipment fault log comprises equipment names, fault names and sending time, and mainly comes from PLC faults, stacker faults and WCS system faults acquired by the data acquisition system.

The filter rod in-out warehouse log comprises filter rod specifications, filter rod in-out warehouse time, filter rod in-out warehouse platform and filter rod solidifying time, and the information of the log comes from the WCS and WMS systems and is collected and stored by the data collection system.

The equipment running state log comprises equipment names, station starting time, station stopping time and station running total time; the information of the log comes from a warehouse-in platform PLC and is collected and stored by a data collection system.

In the embodiment of the invention, by establishing the digital twin system of the filter rod library, which is composed of the data acquisition module, the three-dimensional interaction module, the fault alarm module, the equipment management module, the system setting module, the log management module, the filter rod library management module, the warehouse entry and exit platform management module and the stacker management module, the real-time dynamic simulation monitoring of the filter rod production process of the filter rod production workshop is realized, compared with the existing WCS and WMS two-dimensional systems, the dimension of data is enriched in a three-dimensional visualization mode, the real-time position information of a material tray and the control instruction of a field PLC are increased, and the workshop production integrated management level is improved.

As shown in fig. 22, the embodiment of the invention provides a three-dimensional digital visual monitoring method based on digital twinning, which is realized by a three-dimensional digital visual monitoring system based on digital twinning, wherein the system comprises a data acquisition module, a three-dimensional visual system platform and a Personal Computer (PC) terminal; the process flow of the method can comprise the following steps:

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The foregoing description of the preferred embodiments of the invention is not intended to limit the invention to the precise form disclosed, and any such modifications, equivalents, and alternatives falling within the spirit and scope of the invention are intended to be included within the scope of the invention.

Claims

1. The three-dimensional digital visual monitoring system based on digital twinning is characterized by comprising a data acquisition module, a three-dimensional visual system platform and a Personal Computer (PC) terminal, wherein:

the data acquisition module is used for acquiring data information, converting the format of the data information and transmitting the converted data information to the three-dimensional visualization system platform; transmitting related instructions issued by the three-dimensional visualization platform to equipment connected with the data acquisition module, so as to control the equipment;

the three-dimensional visualization system platform is used for constructing digital twin models of a plurality of devices according to the converted data information;

The PC terminal is used for bearing the three-dimensional visual system platform and providing a display interface for the three-dimensional visual system platform.

2. The system of claim 1, wherein the data acquisition module is further configured to:

the data acquisition module is connected with a plurality of Programmable Logic Controllers (PLCs) through Siemens S7 protocol or OPC UA protocol and is used for acquiring data information in the PLCs; wherein, the plurality of PLCs at least comprise a warehouse entry platform PLC and a stacker PLC;

3. The system of claim 1, wherein the three-dimensional visualization system platform comprises:

the interactive three-dimensional model module is used for storing a pre-established three-dimensional model of the filter rod workshop and carrying out rotation, scaling, translation, view switching and display adjustment on the three-dimensional model of the filter rod workshop according to a received user instruction; the three-dimensional model of the filter rod workshop comprises a macroscopic scene three-dimensional model of the filter rod library workshop and three-dimensional models of a plurality of devices in the filter rod workshop, and the three-dimensional models of the devices comprise: the system comprises a forming machine three-dimensional model, a tray loader three-dimensional model, a transmitter three-dimensional model, a warehouse-in platform three-dimensional model, a filter rod three-dimensional library three-dimensional model, a stacker three-dimensional model and a tray unloader three-dimensional model.

4. The system of claim 3, wherein the three-dimensional visualization system platform further comprises: a digital twinning module; the digital twin module comprises a tray digital twin model, a stacker digital twin model, an in-out platform digital twin model and a filter rod library digital twin model;

wherein the tray digital twin model is used for acquiring a plurality of tray position information in the converted data information provided by the data acquisition module, according to the position information of the plurality of trays, constructing real-time positions of virtual trays in the three-dimensional model of the warehouse-in and warehouse-out platform;

the stacker digital twin model is used for acquiring the PLC signals driven by a plurality of stackers in real time in the converted data information provided by the data acquisition module, and constructing the real-time motion state of the stacker three-dimensional model in the macroscopic scene three-dimensional model of the filter rod library workshop according to the PLC signals driven by the stackers in real time;

the digital twin model of the access platform is used for acquiring the PLC signals of the access platform in the converted data information provided by the data acquisition module, and enabling the virtual display state of the three-dimensional model of the access platform to be consistent with the real-time state of the actual access platform according to the PLC signals of the access platform;

The digital twin model of the filter rod library is used for constructing a virtual tray group in the three-dimensional model of the filter rod library according to the goods space inventory information in the two-dimensional warehouse management system WMS in the converted data information provided by the data acquisition module so that the virtual tray group inventory on the goods space in the three-dimensional model of the filter rod library is consistent with the inventory in the actual three-dimensional filter rod library.

5. The system of claim 4, wherein the inventory information of the cargo space includes at least information of the position of each cargo space in the actual filter rod stereo warehouse, the specification of the cargo carried by the trays in the cargo space, the time and the platform for warehousing the trays in the cargo space, and the number of trays contained in the tray group in the cargo space.

6. The system of claim 4, wherein the three-dimensional visualization system platform further comprises:

the system comprises a data acquisition module, an input/output platform management module, a target input/output platform management module and a platform management window, wherein the input/output platform management module is used for responding to a target input/output platform management instruction triggered by clicking a target input/output platform three-dimensional model, acquiring input/output platform PLC signals in converted data information provided by the data acquisition module and providing a platform management window of a target input/output platform;

The platform management window of the target access platform is used for providing a digital twin model of the target access platform, real-time production information and operation parameters of the target access platform, a human-machine interface (HMI), a fault log and an operation log; the HMI interface is used for receiving a target access platform control instruction triggered by clicking an equipment control button provided in the HMI interface, and sending the target access platform control instruction to a target access platform on site through the data acquisition module so as to control the operation of the target access platform.

7. The system of claim 3, wherein the three-dimensional visualization system platform further comprises: the fault alarm module is used for acquiring the equipment warning information and the fault information in the converted data information provided by the data acquisition module, and displaying the currently acquired equipment warning information and the currently acquired fault information in a preset equipment fault window;

the equipment warning information comprises a warehouse-in platform PLC warning information and a stacker PLC warning information; the equipment fault information comprises PLC fault information of the warehouse-in platform, stacker task abnormality information and warehouse-in platform request abnormality information.

8. The system according to claim 7, wherein the fault alarm module is specifically configured to automatically pop up the equipment fault window when equipment warning information and fault information are acquired, and display an equipment warning information list and/or a fault information list in the equipment fault window; the device is also used for clearing corresponding information in a corresponding list after the warning/fault information in the device warning/fault information list in the device fault window is processed; and the device fault window is also used for automatically folding the device fault window when no device warning information and no fault information exist in the device fault window.

9. The system of claim 4, wherein the three-dimensional visualization system platform further comprises:

the filter rod library management module is used for responding to a filter rod library management instruction triggered by clicking the three-dimensional filter rod library model, acquiring goods space inventory information in a two-dimensional warehouse management system WMS in the converted data information provided by the data acquisition module, and providing a two-dimensional filter rod library management window and a three-dimensional filter rod library management window;

the two-dimensional filter rod library management window provides a cargo space inquiry option, generates cargo space inquiry conditions according to the currently selected cargo space inquiry option, presents a target cargo space corresponding to the cargo space inquiry conditions, a distribution state of a material tray on the target cargo space and storage information of the target cargo space in a 2D view mode, and provides material tray related information on the target cargo space;

The three-dimensional filter rod library management window provides the digital twin model of the filter rod library, related information of the virtual material tray on the selected goods space and material tray inquiry options; the three-dimensional filter rod library management window is also used for generating a material query condition according to the material query option selected currently, acquiring a query result corresponding to the material query condition according to the material disc library storage information on the goods space in the two-dimensional warehouse management system WMS, and displaying the query result in the three-dimensional filter rod library management window.

10. The system of claim 4, wherein the three-dimensional visualization system platform further comprises:

the stacker management module is used for responding to a target stacker management instruction triggered by clicking the three-dimensional stacker model, acquiring a PLC signal driven by the target stacker in real time in the converted data information provided by the data acquisition module, and providing an equipment information display window, an operation state information real-time monitoring window, a manual scheduling window, a task management query window, an operation log management window and a fault log management window of the target stacker;

11. The system of claim 4, wherein the three-dimensional visualization system platform further comprises:

the equipment management module is used for providing an equipment account information management window, a spare part information management window, an equipment maintenance information management window and a random data management window of the filter rod workshop;

the equipment standing book information management window is used for providing a filter rod workshop three-dimensional model display sub-window and an equipment information list;

the spare part information management window provides a spare part information list of equipment in the filter rod workshop, a spare part three-dimensional model display sub-window and a spare part installation position display sub-window; the spare part information management window responds to the selected target spare part in the spare part information list, a three-dimensional model of the target spare part is displayed in the spare part three-dimensional model display sub-window, and meanwhile, a mounting position schematic diagram of the target spare part is displayed in the spare part mounting position display sub-window;

the equipment maintenance information management window provides a maintenance record list, a maintenance method resource list and a maintenance method resource display window of equipment in the filter rod workshop; the maintenance method resource display window is used for displaying the selected maintenance method resource in the current maintenance method resource list;

12. A digital twinning-based three-dimensional digital visual monitoring method, characterized in that the method is implemented by a digital twinning-based three-dimensional digital visual monitoring system according to any one of claims 1-11, the method comprising:

the data acquisition module acquires data information, performs format conversion on the data information and sends the converted data information to the three-dimensional visualization system platform; transmitting an instruction issued by the three-dimensional visualization platform to equipment connected with the data acquisition module, so as to control the equipment;

the three-dimensional visualization system platform constructs digital twin models of a plurality of devices according to the converted data information;