CN117058349A

CN117058349A - Container display method, device, equipment and storage medium of digital twin system

Info

Publication number: CN117058349A
Application number: CN202311013702.9A
Authority: CN
Inventors: 卢宇洁
Original assignee: Beijing Jingwei Hirain Tech Co Ltd
Current assignee: Beijing Jingwei Hirain Tech Co Ltd
Priority date: 2023-08-11
Filing date: 2023-08-11
Publication date: 2023-11-14

Abstract

The application discloses a container display method, device and equipment of a digital twin system and a storage medium, and relates to the technical field of communication. The method comprises the following steps: under the condition that a plurality of containers are arranged in a target area, generating a plurality of container models of each container in a digital twin system according to target characteristic parameter information of each container, wherein different container models are configured with different display quality information; acquiring the display duty ratio of each container in a digital twin interface of a digital twin system; determining a target container model in a plurality of container models of the containers according to the display duty ratio of each container in a digital twin interface of a digital twin system, wherein the display quality information of the target container model corresponds to the display duty ratio; the target container model for each container is displayed on a digital twin interface. According to the embodiment of the application, the smooth operation of the digital twin system can be ensured, and the display effect is good.

Description

Container display method, device, equipment and storage medium of digital twin system

Technical Field

The application belongs to the technical field of communication, and particularly relates to a container display method, device and equipment of a digital twin system and a storage medium.

Background

At present, all ports at home and abroad start to build a port digital twin platform so as to enhance situation awareness capability for port business and ship business. In a digital twin system of a port, management of containers (such as generation, destruction and dynamic update of a container model) in a three-dimensional scene is an important component, and in order to ensure smooth operation of the system, the existing scheme generally adopts to reduce the display quality of the container model to realize the management of large-scale containers, but the digital twin system of the port has poor display effect, is not lifelike and lacks information, so that the direct perception of 'what you see is what you get' cannot be achieved.

Disclosure of Invention

The embodiment of the application provides a container display method, device and equipment of a digital twin system and a storage medium, which not only can ensure smooth operation of the digital twin system, but also have good display effect.

In a first aspect, an embodiment of the present application provides a container display method of a digital twin system, including:

under the condition that a plurality of containers are arranged in a target area, generating a plurality of container models of the containers in a digital twin system according to target characteristic parameter information of the containers, wherein different container models are configured with different display quality information;

Acquiring the display duty ratio of each container in a digital twin interface of the digital twin system;

determining a target container model from a plurality of container models of the containers according to the display duty ratio of each container in a digital twin interface of the digital twin system, wherein the display quality information of the target container model corresponds to the display duty ratio;

and displaying the target container model of each container on the digital twin interface.

In a second aspect, an embodiment of the present application provides a container display device of a digital twin system, the device including:

the generation module is used for generating a plurality of container models of the containers in the digital twin system according to the target characteristic parameter information of the containers when the plurality of containers are arranged in the target area, wherein different container models are configured with different display quality information;

the first acquisition module is used for acquiring the display duty ratio of each container in a digital twin interface of the digital twin system;

a first determining module, configured to determine a target container model from a plurality of container models of the containers according to a display duty ratio of each container in a digital twin interface of the digital twin system, where display quality information of the target container model corresponds to the display duty ratio;

And the display module is used for displaying the target container model of each container on the digital twin interface.

In a third aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory storing computer program instructions; the processor, when executing the computer program instructions, implements the container display method of the digital twin system as described in any one of the above.

In a fourth aspect, embodiments of the present application provide a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement a container display method of a digital twin system as defined in any one of the above.

According to the container display method, device, equipment and storage medium of the digital twin system, under the condition that a plurality of containers are arranged in a target area, a plurality of container models of the containers are generated in the digital twin system according to target characteristic parameter information of the containers, different container models are configured with different display quality information, according to the display proportion of the containers in a digital twin interface of the digital twin system, the target container model is determined in the plurality of container models of the containers, the display quality information of the target container model corresponds to the display proportion, and finally the target container model of the containers is displayed on the digital twin interface. In this way, according to the display ratio of each container in the digital twin interface of the digital twin system, each container can be displayed according to the target container model corresponding to the display ratio of each container, the container model with small display ratio displays fewer display characteristics, and the container model with large display ratio displays more display characteristics, so that the smooth operation of the digital twin system is ensured, and the display effect is good.

Drawings

In order to more clearly illustrate the technical solution of the embodiments of the present application, the drawings that are needed to be used in the embodiments of the present application will be briefly described, and it is possible for a person skilled in the art to obtain other drawings according to these drawings without inventive effort.

FIG. 1 is a flow chart of a method for displaying a container of a digital twin system according to an embodiment of the present application;

FIG. 2 is a diagram of a display effect of a container according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a container display device of a digital twin system according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Features and exemplary embodiments of various aspects of the present application will be described in detail below, and in order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail below with reference to the accompanying drawings and the detailed embodiments. It should be understood that the particular embodiments described herein are meant to be illustrative of the application only and not limiting. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the application by showing examples of the application.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.

In order to solve the problems in the prior art, the embodiment of the application provides a container display method, device and equipment of a digital twin system and a storage medium. The container display method of the digital twin system provided by the embodiment of the application is first described below.

Fig. 1 is a flow chart of a container display method of a digital twin system according to an embodiment of the present application. As shown in fig. 1, a container display method of a digital twin system may include the following steps S101 to S104.

S101, when a plurality of containers are arranged in a target area, a plurality of container models of the containers are generated in a digital twin system according to target characteristic parameter information of the containers, and different container models are configured with different display quality information.

S102, acquiring the display duty ratio of each container in a digital twin interface of the digital twin system.

S103, determining a target container model from a plurality of container models of the containers according to the display duty ratio of each container in a digital twin interface of the digital twin system, wherein the display quality information of the target container model corresponds to the display duty ratio.

S104, displaying the target container model of each container on the digital twin interface.

According to the container display method of the digital twin system, under the condition that a plurality of containers are arranged in a target area, a plurality of container models of the containers are generated in the digital twin system according to target characteristic parameter information of the containers, different container models are configured with different display quality information, according to the display proportion of the containers in a digital twin interface of the digital twin system, the target container model is determined in the plurality of container models of the containers, the display quality information of the target container model corresponds to the display proportion, and finally the target container model of the containers is displayed on the digital twin interface. In this way, according to the display ratio of each container in the digital twin interface of the digital twin system, each container can be displayed according to the target container model corresponding to the display ratio of each container, the container model with small display ratio displays fewer display characteristics, and the container model with large display ratio displays more display characteristics, so that the smooth operation of the digital twin system is ensured, and the display effect is good.

In S101, the target area may be, for example, an area in which containers are stored, such as a port, a dock yard, or a warehouse. In this embodiment, the method is mainly aimed at a port area with mass-scale containers.

The characteristic parameter information may be parameter information characterizing a characteristic of the container, and may include a container identification number (Identity Document, ID), a container type parameter value, position information, rotation information, container main information, and the like.

The target parameter characteristic information can be characteristic information parameters of each container at the current moment; or, when the change result corresponding to at least one container indicates that the characteristic parameter information at the mth moment and the characteristic parameter information at the mth-1 moment are changed, the characteristic parameter information of each container at the mth moment may be a positive integer.

The above display quality information may, for example, represent the display accuracy of the container model in the digital twin interface of the digital twin system, wherein the display accuracy may be a degree of accuracy representing the display of the container on the display device, such as a container model with high definition, or a cuboid with low definition, and the display information granularity may be a degree of thickness representing the display of the container paint, such as a container model with container paint and a container model with only color. Different container models are configured with different display quality information.

In some embodiments, the generating a plurality of container models of each container in the digital twin system according to the target characteristic parameter information of each container may specifically include:

generating a first container model of each container in a digital twin system according to the target characteristic parameter information of each container;

generating a second container model of each container according to the first container model of each container by simplifying processing so that the display characteristics contained in the second container model are lower than those of the first container model;

wherein the plurality of container models for each container includes a first container model and a second container model.

The plurality of container models of each container may include a first container model and a second container model, and of course, the present application is not limited to this, and a third container model of each container may be generated by simplifying processing according to the first container model of each container so that display characteristics included in the third container are lower than those of the second container model. Illustratively, the first container model may be represented by a LOD0 high-precision container model, the second container model may be represented by a precision container model in LOD1, and the third container model may be represented by a low-precision container model in LOD 2.

The first container model of each container is generated in the digital twin system according to the target characteristic parameter information of each container, and the first container model of each container can be constructed in a three-dimensional scene of the digital twin system based on the illusion engine.

The simplification process may be a process of making the display characteristics included in the second container model lower than the display characteristics of the first container model, for example, reducing the model display accuracy or reducing the granularity of the model display information.

The display features may include a feature of display accuracy and a feature of granularity of display information, and may be, for example, a model structure feature, a texture feature, a box mark feature, and the like.

The second container model of each container is generated by simplifying the process according to the first container model of each container, and the second container model of each container is generated by simplifying the process according to the first container model of each container in a three-dimensional scene of a digital twin system based on the illusion engine.

In this embodiment, a container model including different display features may be set for each container according to a user requirement, so as to satisfy a display quality requirement of a plurality of levels of users.

In some embodiments, the generating the first container model of each container in the digital twin system according to the target feature parameter information of each container may specifically include:

generating model structures of a first container model of each container in a digital twin system according to target box type parameter values of each container, wherein different box type parameter values correspond to different model structures;

determining the container coating of each first container model according to the target container main information of each container, wherein different container main information corresponds to different container coatings;

determining the position of each first container model in the digital twin system according to the target position information of each container;

determining the rotation angle of each first container model placed in the digital twin system according to the target rotation information of each container;

the target characteristic parameter information comprises a target box type parameter value, target position information, target rotation information and target box main information.

The target characteristic parameter information may include a target box type parameter value, target position information, target rotation information, and target box main information, and may further include a container ID of each container.

The target bin type parameter values may be information representing actual sizes of the containers, such as sizes of 20-gauge bins, 40-gauge bins and 40-gauge height bins.

The model structure may include the size of the container model and the number of constituent panels of the container model. The model structure of the container model is constructed according to the standard structure and the size of the container, and the model structure of the first container model is exemplified by 20-ruler boxes which are composed of ten thousands of triangle patches, and 40-ruler boxes and 40-ruler high boxes which are composed of ten thousands of seven thousands of triangle patches.

The generating the model structure of the first container model of each container in the digital twin system according to the target box type parameter value of each container may be generating the model structure of the first container model of each container in the digital twin system according to the target box type parameter value of each container in a preset model structure library, where the model structure library includes model structures corresponding to different box type parameter values. In addition, the preset model structure library may further include a model structure of the second container model (for example, model structures of 20-rule case, 40-rule case and 40-rule high case are each formed by one thousand of six hundred triangular patches) and a model structure of the third container model (for example, model structures of 20-rule case, 40-rule case and 40-rule high case are each formed by forty of triangular patches), which is not limited in this embodiment, the number of triangular patches of the model structure can be set according to the user's needs by oneself, and is not limited in this embodiment.

The target box main information may be information representing the owner identity of each container. Different box main information corresponds to different box painting.

The above-mentioned determining the container coating of each first container model according to the target container main information of each container may be determining the container coating of each first container model according to the target container main information of each container in a preset container main coating table.

The target location information may be location information indicating the placement of each container in a port.

The target rotation information may be angle information indicating the rotational placement of each container in the port.

The above-mentioned determination of the position of each first container model in the digital twin system according to the target position information of each container, and the above-mentioned determination of the rotation angle of each first container model placed in the digital twin system according to the target rotation information of each container, may be, for example, that each container ID, position, rotation information to be updated from the data service end is received and parsed through a user datagram protocol (User Datagram Protocol, UDP), the received data format is a lightweight data exchange format (JavaScript Object Notation, JSON) based on JavaScript language, for example, { "ID": "Containers1", "location" { "x": "100": "y":10 ": z":0}, rotation ":0}, and then the specific value of the ID, position and rotation required to be updated is extracted based on two modules of JSON and jsonUlities in the phantom engine.

In this embodiment, according to the target characteristic parameters of each container, including the target container type parameter value, the target position information, the target rotation information and the target container main information, the first container model of each container is generated, so that the display details of each container can be accurately restored, and the high fidelity of each container is ensured.

In some embodiments, the target bin main information may include a target bin main name and a target bin mark, and determining the bin painting of each first container model according to the target bin main information of each container may specifically include:

determining target box texture of each container in a preset box texture library according to the target box main name of each container, wherein the box texture library comprises different box texture;

determining the box mark codes of the containers according to the target box marks of the containers;

the bin coating includes a target bin texture and a bin mark code.

The target box main name is used for representing the box main name of each container.

The target box mark is used for representing the box mark of each container, can be used for identifying and managing the container in circulation and use, and is convenient for document compilation and information transmission to compile the common name of the container code number and the sign.

The above-mentioned target container texture of each container is determined in a preset container texture library according to the target container name of each container, and may be exemplified by that the surface texture coating of the container is different for different container companies, and the coating of the same container type of the same container company is consistent, so that it is necessary to establish a texture set indexed by the container name to match the corresponding texture when the container is generated. In this embodiment, the material set includes six dictionaries, where the keys in the dictionaries are known box main names or color names in advance, and the values are container materials collected and manufactured by the corresponding box main or pure color materials of the corresponding colors, and the material values in the six dictionaries are respectively matched with six materials on the surfaces of LOD0, LOD1 and LOD2 in the container model.

Judging whether the box main information is a known box main or not according to the box main information. If the case owner is known, the case owner name is used as an index to search the corresponding materials in the six dictionaries, and accordingly a static grid model of the container is created by assigning the dynamic material instance to the container. Because the preset box material contains the box main information, the box main code surface does not need to be displayed, and the full transparent material is used for hiding. The resulting container texture remains substantially the same as the actual container appearance.

If the box main information does not exist in the set of preset box names, the corresponding solid-color materials in the six dictionaries are searched by taking the different color names as indexes according to the initial division of the box main information, and accordingly, a static grid model of the container, which is assigned with the dynamic material examples, is created. The case main code surface creates a corresponding dynamic material example according to the letter number of the case main character string of 3 or 4, splits the character string to obtain each letter value, and transmits letter texture parameters corresponding to letter textures to the case main code surface material, so that the case main code can be displayed at the center of the left side surface and the right side surface of the case at equal intervals to represent the case company to which the case belongs. And storing the new container main code material into a dictionary for later use in the process of generating the same container main container. The container paint generated is system custom.

When the main information of the container is empty or the input contains non-letter characters or the number of letters is not 3 or 4, gray grid materials are given to the container object, and the abnormal situation of production managers is warned in a scene to be processed.

The container label code of each container may be, for example, a character string of the target container label of each container, and may be composed of a digital english symbol.

In the digital twin system, a box marking code is marked on the side surface of the container model according to the target box marking, specifically, a canvas rendering target is firstly created, a box marking character string is drawn on the canvas for text, the canvas is used as a texture parameter value of a box marking surface to be input, and the box marking code can be displayed on the box marking surface.

In this embodiment, according to the main name of the target container of each container, the texture of the target container of each container is determined in a preset texture library of container materials, so that the processing of information can be reduced in the process of constructing a container model, and the modeling efficiency is improved.

In some embodiments, the generating the second container model of each container according to the first container model of each container by simplifying processing may specifically include:

generating a second container model for each container from the first container model for each container by a simplification process comprising at least one of: model structure simplification processing, texture simplification processing, and box-marking hiding processing.

The model structure simplifies the processing, mainly reduces the number of the surface sheets by using a plane to replace the wavy/convex groove-shaped plate surface and reducing the number of chamfer angles, further simplifies the box body model into a basic cuboid, only retains the main information surface and the marking surface of the box, and has no detail structure components. For example, the 20-ruler box is composed of more than ten thousands of triangular patches, the 40-ruler box and the 40-ruler high box are composed of more than ten thousands of seven thousands of triangular patches, three boxes are simplified to be composed of more than one thousand of six hundred triangular patches, and further three boxes are simplified to be composed of 40 triangular patches.

The texture simplification process described above, which may be exemplified by using five texture textures for three types of boxes, may include a door handle texture, a container left and right main surface texture, four side texture for the front, rear, top and bottom of the container, a box logo texture (the box texture is all opaque, including base color, metal, roughness, normal and ambient light map, the map size is 1024 x 1024, wherein the metal, roughness and ambient light map are combined into one map, and each texture is represented by using R, G, B channels, respectively). Four texture materials (including the combined materials of the door handle, the front, the rear, the top, the bottom and the four sides, the left and the right main surface materials of the container, the main information surface materials of the container and the marking surface materials of the container) are used for simplifying the three types of the container, the color of the texture of the container only keeps the main color, the size of the texture map is 512 multiplied by 512, the marking surface of the container uses the full transparent texture map to hide the container mark so as to reduce the flickering phenomenon and the rendering cost, and the rest is similar to LOD 0.

The texture simplification process can, for example, bake the LOD0 model detail onto the texture of LOD1 during the map baking process, so that LOD1 has concave-convex and wavy pattern textures, and a visual stereoscopic impression is produced by combining with a normal line, thereby making up the concave-convex simplification on the model, and the left and right main surfaces are not subjected to texture streaming so as to ensure display definition, and further, the box texture color can only be kept as a main color, and the size of the material map is 512×512.

The above-described box-marking hiding process may be, for example, a box marking surface using a full transparent texture map to hide the box marking.

In this embodiment, according to the first container model of each container, the second container model of each container is generated by means of model structure simplification, material simplification, texture simplification, and container mark hiding, and the like, and multiple simplification processing means can make the display effect of the simplified container model diversified, so as to meet different demands of users.

As an implementation manner of the present application, in order to save consumption of computing resources, before S101, the method may further include:

acquiring characteristic parameter information of each container at the Mth moment;

Determining the change results of the characteristic parameter information of each container at the Mth moment and the characteristic information parameter at the Mth moment, wherein the change results are used for indicating whether the characteristic parameter information at the Mth moment and the characteristic information parameter at the Mth moment are changed or not;

and under the condition that the change result corresponding to at least one container indicates that the characteristic parameter information at the Mth moment and the characteristic parameter information at the M-1 th moment are changed, determining the characteristic parameter information of each container at the Mth moment as target characteristic parameter information.

The characteristic parameter information at the Mth time may be characteristic parameter information at the Mth frame, and similarly, the characteristic parameter information at the Mth-1 time may be characteristic parameter information at the Mth-1 frame.

For example, the collection interval of the characteristic parameter information may be 0.1s, but the frame rate of refreshing the display may be 60 frames per second, if the container data is updated directly according to the data transmission frequency, there is a click feeling on the display, and thus the smooth value updated for each frame needs to be processed.

In the smooth interpolation stage, a corresponding container instance object can be found in the dictionary according to the container ID, and then the current coordinate and the updated coordinate (the value obtained by converting the position vector and the Z-axis rotation value in the updated data into the coordinate system) of the object are subjected to interpolation operation. The interpolation operation needs to interpolate the position of the two coordinates and the rotation vector in each frame. The operation starts each time data is received and ends when the object reaches the update coordinates or again receives data. If the updated data is received again, the object does not reach the updated coordinates of the previous data, the current coordinates are directly set to the updated coordinates of the previous data, and then interpolation operation is started again. The interpolation operation formula (1) is as follows:

Wherein,for the interpolated position/rotation vector value, and (2)>For the position/rotation vector of the current coordinate, +.>To update the position/rotation vector of the coordinates, t is the time interval of the current frame time relative to the time interval when interpolation was started, and 0.1 is the average time interval of the received data.

The position and rotation values of the container objects in the scene are then set to the operational values after each frame operation, so that the container can be smoothly displayed in motion in the scene.

In addition, when a container is transported out of the yard, the container needs to be deleted. This process receives and parses the container ID array to be deleted via TCP. The received data format is also JSON, for example { "Class": "Containers", "ObjsID": [ "Containers 1", "Containers2", "Containers 3" ] } the parsing mode is also consistent with the data parsing method when the container is driven in real time above. After extracting the container ID array to be deleted, searching the container instance object to be deleted by traversing the mapping relation of the IDs in the array in the dictionary, destroying the object, and removing the IDs and the object from the dictionary, thus completing the corresponding container deleting operation.

In this embodiment, only if the change result corresponding to at least one container indicates that the feature parameter information at the mth moment and the feature parameter information at the mth-1 moment change, the feature parameter information of each container at the mth moment is determined as the target feature parameter information, so as to update the digital twin interface in the digital twin system, thereby reducing unnecessary refreshing of the digital twin interface and saving consumption of computing resources.

In S102, the display duty ratio of each container in the digital twin interface of the digital twin system may be an occupied screen ratio characterizing each container in the digital twin interface of the digital twin system.

The obtaining the display duty ratio of each container in the digital twin interface of the digital twin system may be based on a ghost engine, and the obtaining the display duty ratio of each container in the digital twin interface of the digital twin system may be based on a ghost engine.

In S103, the above-described target container model is determined among the plurality of container models of the container based on the display ratio of each container in the digital twin interface of the digital twin system, and for example, it may be that 20-gauge and 40-gauge display LOD0 when the container object occupation screen ratio is 30% or more, 40-gauge and 40-gauge display LOD1 when the container object occupation screen ratio is 8% to 30%, 40-gauge and 40-gauge display LOD1 when 10% to 30%, 40-gauge and high-gauge display LOD1 when 10% to 35%, and 20-gauge and 40-gauge and high-gauge display LOD2 when the container object occupation screen ratio is 8% or less, and the threshold value for each size container judgment is not limited to a certain fixed value but may be set according to the user' S demand.

In some embodiments, the target container model is determined not only according to the display duty ratio of each container in the digital twin interface of the digital twin system, but also according to the depth of field of each container in the digital twin interface of the digital twin system, and the display quality information of the target container model corresponds to the depth of field.

In some embodiments, S103 may specifically include:

determining target display quality information of each container according to the display duty ratio of each container in a digital twin interface of a digital twin system, wherein the target display quality information corresponds to the display duty ratio;

and determining a target container model from a plurality of container models of the containers according to the target display quality information of each container, wherein the display quality information of the target container is target display quality information.

In this embodiment, the target display quality information of each container is determined according to the display duty ratio of each container, and then the target container model of each container is determined according to the target display quality information of each container, so that the information processing is reduced and the determination efficiency of the target container model of each container is improved by the corresponding relationship.

In S104, the interface displayed by the digital twin system in the display device is rendered based on the target feature parameters of each container by the virtual engine, so as to display the target container model.

In order to facilitate understanding of the container display method of the digital twin system in the embodiment of the present application, a development process of the container display method of the digital twin system is described herein, and specifically as follows:

the method of the application manages the container in the three-dimensional scene of the digital twin system based on the illusion engine, and comprises the steps of generating, destroying and dynamically updating the container model, and the development and realization process mainly comprises four stages of container modeling, parameterizing to generate the container, driving the container in real time and deleting the container.

1. Container modeling

In the construction stage of the container model, firstly, three general containers, namely 20-ruler containers (20 GP), 40-ruler containers (40 GP) and 40-ruler high containers (40 HC), are constructed according to the international standard of the container, 10 materials (listed in the following table 1) are used for each container model of each size to construct containers with three levels of different precision, namely LOD0, LOD1 and LOD2, and multiple levels of detail (LOD) are used for the Level Details of container display at different distances in the same model so as to perform reasonable and efficient rendering operation under the condition of ensuring the display precision. The specific modeling parameters of the container are as follows:

(1) LOD0 is a high-precision container model.

Display ratio: the 20-ruler box and the 40-ruler box display LOD0 when the screen occupation proportion of the container object is more than 30%, and the 40-ruler high box displays LOD0 when the screen occupation proportion is more than 35%.

Model structure: the 20-ruler box is composed of more than ten thousands of triangle patches, and the 40-ruler box and the 40-ruler high box are composed of more than ten thousands of seven thousands of triangle patches. The box body model is constructed according to the standard structure and the size of the container, and the surface coating consists of a box main information surface and a box marking surface. The main information surface of the box is two 3m multiplied by 1m planes, which are respectively positioned at the center positions of the left surface and the right surface of the box body. The box marking surface is four planes of 1.5m multiplied by 0.2m which are respectively positioned at the left upper corners of the front, the back, the left and the right sides of the box body.

Surface texture: all five texture materials are used for three types of boxes, including a box door handle material, a container left and right main surface material, a container front and back top and bottom four side surface materials, a box main code surface material and a box mark surface material. The box material is opaque material, including basic colour, metaliness, roughness, normal and ambient light map, the map size is 1024 x 1024, and wherein metaliness, roughness and ambient light map merge into a map, use R, G, B passageway to represent respectively. The main box code surface uses a mask material, 3-bit or 4-bit English letters displayed as transparent base colors are calculated through letter texture parameters and mask mapping, and corresponding materials are used and corresponding texture parameters are input according to letter digits after the main box parameters are input in the follow-up parameterization generation process. The box marking surface also uses a mask material, and the box marking character string is displayed as transparent ground color according to texture parameters, and the texture parameters are dynamically rendered and input in the subsequent parameterization generating process. The materials of the box main code surface and the box mark surface do not cast shadows, do not participate in ray tracing calculation, are closer to the actual coating effect, and reduce the performance cost.

Collision body: and a simple box body.

(2) LOD1 is a medium precision container model.

Display ratio: the 20-ruler box and the 40-ruler box display LOD1 when the screen ratio occupied by the container object is 8% -30%, the 40-ruler box displays LOD1 when the screen ratio is 10% -30%, and the 40-ruler high box displays LOD1 when the screen ratio is 10% -35%.

Model structure: the three boxes are composed of more than one thousand triangular dough pieces. The box body model is mainly simplified on six-sided box boards of the box body, the number of the surface pieces is reduced mainly by using a mode that a plane replaces a wavy/convex groove-shaped board surface and the number of chamfer angles is reduced, and the structure of LOD0 is reserved for all the basic structure components.

Surface texture: four texture materials are used for the three box types, and the texture materials comprise a box door handle, a combination material of four sides of a front top and a rear top, a main surface material of a container, a main information surface material of the container and a marking surface material of the container. The box material is similar to LOD0, but will LOD0 model detail toast the texture of LOD1 when the map toasts, make LOD1 possess unsmooth, wave pattern texture, combine the normal to produce visual third dimension, and then compensate unsmooth simplification on the model, and control the main surface and do not carry out the texture and flow and guarantee to show the definition. The material of the box main code surface and the box mark surface is the same as LOD0.

Collision body: and a simple box body.

(3) LOD2 is a low-precision container model.

Display ratio: the 20-gauge box displays LOD2 when the container object occupies less than 8% of the screen, and the 40-gauge box and the 40-gauge high box display LOD2 when the container object occupies less than 10%.

Model structure: all three boxes are composed of 40 triangular face sheets. The box body model is a basic cuboid, a box main information surface and a box marking surface, and has no detail structure component.

Surface texture: four texture materials are used for the three box types, and the texture materials comprise a box door handle, a combination material of four sides of a front top and a rear top, a main surface material of a container, a main information surface material of the container and a marking surface material of the container. The box texture color only remains the dominant color, the material map size is 512 x 512, the box mark surface uses the full transparent material map to hide the box mark, so as to reduce the flicker phenomenon and the rendering cost, and the rest is similar to LOD 0.

Collision body: and a simple box body.

After the model is built, the container class is built in the illusion engine, the container class is used as a father class, and the commonalities of various containers are integrated. And establishing subclasses of three container types, namely 20-ruler box types, 40-ruler box types and 40-ruler high box types, and then taking container models corresponding to the three box types as static grid body components respectively.

2. Parameterized container generation

When the program starts to run, the parameter information of the container to be generated is received and analyzed through a transmission control protocol (Transmission Control Protocol, TCP), and the container is generated according to the parameters, and the method comprises the following three steps: firstly, generating a container with a corresponding size according to a box type parameter, and determining the position and the rotation value of the container; then, carrying out corresponding coating on the container according to the container main information, and processing the situation that the container main textures are not preset in the material set; finally, marking codes are marked on the side face of the container according to the box marking information, and the display effect is as shown in figure 2.

(1) Generating containers of corresponding sizes according to the box type parameters and determining the position and rotation values thereof

The container type parameter values of the container comprise Jzx GP, jzx40GP and Jzx40HC, and respectively correspond to 20 ruler boxes, 40 ruler boxes and 40 ruler high boxes, and default is Jzx GP. And generating a container sub-class object by judging the correspondence of the parameter values, converting the coordinate system of the position vector and the Z-axis rotation value in the parameter, and then giving the container sub-class object. And adds the container ID and the corresponding generated container object as keys and values, respectively, to a dictionary (a data structure) for subsequent container updating and destruction.

(2) The container is correspondingly coated according to the main information of the container, and the case that the main texture of the container is not preset in the material set is processed

The surface texture painting of the container is different for different container owners, and the painting of the same container is consistent for the same container owner, so that a material set indexed by the container owner name needs to be established to match the corresponding texture when the container is generated. The material set in the method comprises six dictionaries, keys in the dictionaries are known box main names or color names in advance, the values are container materials collected and manufactured by corresponding box main groups or pure-color materials with corresponding colors, and the material values in the six dictionaries are respectively matched with six materials on the surfaces of LOD0, LOD1 and LOD2 in the container model.

If the box main information does not exist in the set of preset box main names, the corresponding solid-color materials in the six dictionaries are searched by dividing different color names according to the initial letters of the box main information as indexes, and accordingly a static grid model of the container, wherein the static grid model is formed by assigning dynamic material instances to the container. The case main code surface creates a corresponding dynamic material example according to the letter number of the case main character string of 3 or 4, splits the character string to obtain each letter value, and transmits letter texture parameters corresponding to letter textures to the case main code surface material, so that the case main code can be displayed at the center of the left side surface and the right side surface of the case at equal intervals to represent the case company to which the case belongs. And storing the new container main code material into a dictionary for later use in the process of generating the same container main container. The container paint generated is system custom.

(3) Marking code on side of container according to box mark information

Firstly, creating a canvas rendering target, carrying out text drawing on the box marking character string on the canvas, and inputting the canvas as a texture parameter value of the box marking surface, so that the box marking code can be displayed on the box marking surface.

3. Real-time driving container

In driving the container in real time, only the position and Z-axis rotation value of the container need be changed. The method mainly comprises the following 2 steps of firstly receiving analysis data and then carrying out smooth interpolation conversion, wherein the data transmission interval is 0.1s, but the frame refreshing rate of picture display is 60 frames per second, and the container data is directly updated according to the data transmission frequency, so that the display has a click feeling, and a smooth value updated for each frame needs to be processed.

The data receiving and analyzing stage receives and analyzes the container ID, the position and the rotation information to be updated from the data server through a user datagram protocol (User Datagram Protocol, UDP). The received data format is a JavaScript language based lightweight data interchange format (JavaScript Object Notation, JSON), such as { "iD": "Containers1", "location": { "x":100, "y":10, "z":0}, "rotation": { "x":0, "y":0, "z":90}, and then the string is read out in anti-sequence based on both JSON and JSON documents in the illusion engine, extracting the specific values of container iD, location and rotation that need to be updated.

In the smooth interpolation stage, a corresponding container instance object is found in the dictionary according to the ID, and then interpolation operation is carried out on the current coordinate and the updated coordinate (the value obtained by carrying out coordinate system conversion on the position vector and the Z-axis rotation value in the updated data) of the object. The interpolation operation needs to interpolate the position of the two coordinates and the rotation vector in each frame. The operation starts each time data is received and ends when the object reaches the update coordinates or again receives data. If the updated data is received again, the object does not reach the updated coordinates of the previous data, the current coordinates are directly set to the updated coordinates of the previous data, and then interpolation operation is started again. The interpolation operation formula is as follows:

4. Deleting container

When a container is transported out of the yard, the container needs to be deleted. This process receives and parses the container ID array to be deleted via TCP. The received data format is also JSON, for example { "Class": "Containers", "ObjsID": [ "Containers 1", "Containers2", "Containers 3" ] } the parsing mode is also consistent with the data parsing method when the container is driven in real time above. After extracting the container ID array to be deleted, searching the container instance object to be deleted by traversing the mapping relation of the IDs in the array in the dictionary, destroying the object, and removing the IDs and the object from the dictionary, thus completing the corresponding container deleting operation.

Table 1: container material list

Material numbering	Famous mesh of material
		0	LOD 0-door handle material
1	LOD 0-front, rear, top and bottom four side materials
		2	LOD 0-left and right main surface materials
3	LOD 1-left and right main surface materials
		4	LOD 1-door handle and front, rear top and bottom surface materials
5	LOD 2-left and right main surface materials
		6	LOD 2-door handle and front, rear top and bottom surface materials
7	Box main information surface material
		8	Box mark surface material
9	Transparent material

The method of the application realizes the management of the containers in the three-dimensional scene of the digital twin system, comprises the generation, destruction and dynamic update of the container model, and can generate tens of thousands of high-precision containers according to multiple parameters in an open yard and realize smooth dynamic circulation.

The application reduces the performance cost as much as possible under the condition of ensuring high precision and full information, and ensures smooth running of pictures and user-friendly interaction. The problem of conflict between high precision and high performance of the digital twin system of the port container terminal is solved effectively by LOD technology, and the high precision of display is guaranteed when the digital twin system is in a local view angle, and the operation smoothness is guaranteed when the digital twin system is in a panoramic view angle. According to the application, the LOD0 model of the container is modeled according to the standard structure and the size of the container, so that the high fidelity of the container is ensured; according to the actual display effect of the container model in the three-dimensional scene, switching nodes of different layers are adjusted to be assisted with a texture baking technology, so that natural transition and no obvious difference are ensured during switching; the high-definition display of the detail of the main surface is ensured by combining the left main surface, the right main surface and the side surface materials separately and disabling the texture layering method; the restoration degree and the display detail of the container are greatly ensured by updating the methods of coating, displaying the box mark codes, closing the box code surface, casting shadows on the mark surface and the like. In the method, the rendering cost is greatly reduced when the display is performed under the panoramic remote viewing angle by simplifying the model in the containers LOD1 and LOD2, using a mask to replace transparent materials and the like; memory streaming is reduced by combining materials, multi-map combining, reducing the size of maps and the like; the information processing is reduced by presetting information surface texture parameters and a dictionary storage box main code material method; flicker caused by rendering conflicts is eliminated by simplifying texture details, LOD2 hidden box mark planes, and the like.

The application supports three common container types, and performs coating adaptation treatment on containers of unknown container owners, ensures consistent coating of the same container owner company, ensures diversified scene display effects and high information granularity, and improves the expandability of the digital twin system.

Based on the container display method of the digital twin system provided by the embodiment, correspondingly, the application further provides a specific implementation mode of the container display device of the digital twin system. Please refer to the following examples.

As shown in fig. 3, the container display device 00 of the digital twin system provided by the embodiment of the present application may include the following modules: a generating module 301, a first obtaining module 302, a first determining module 303 and a display module 304.

The generating module 301 is configured to generate, in a digital twin system, a plurality of container models of each container according to target feature parameter information of each container when a plurality of containers are disposed in a target area, where different container models are configured with different display quality information.

A first obtaining module 302 is configured to obtain a display duty ratio of each container in a digital twin interface of the digital twin system.

The first determining module 303 is configured to determine a target container model from a plurality of container models of the containers according to a display duty ratio of each container in a digital twin interface of the digital twin system, where display quality information of the target container model corresponds to the display duty ratio.

And the display module 304 is used for displaying the target container model of each container on the digital twin interface.

According to the container display device of the digital twin system, under the condition that a plurality of containers are arranged in a target area, a plurality of container models of the containers are generated in the digital twin system according to target characteristic parameter information of the containers, different container models are configured with different display quality information, the target container model is determined in the plurality of container models of the containers according to the display proportion of the containers in a digital twin interface of the digital twin system, the display quality information of the target container model corresponds to the display proportion, and finally the target container model of the containers is displayed on the digital twin interface. In this way, according to the display ratio of each container in the digital twin interface of the digital twin system, each container can be displayed according to the target container model corresponding to the display ratio of each container, the container model with small display ratio displays fewer display characteristics, and the container model with large display ratio displays more display characteristics, so that the smooth operation of the digital twin system is ensured, and the display effect is good.

In some embodiments, the generating module 301 may specifically include:

the first generation submodule is used for generating a first container model of each container in the digital twin system according to the target characteristic parameter information of each container;

the second generation submodule is used for generating a second container model of each container according to the first container model of each container through simplified processing so that the display characteristics contained in the second container model are lower than those of the first container model;

In some embodiments, the first generating sub-module may specifically include:

the generating unit is used for generating a model structure of a first container model of each container in the digital twin system according to the target box type parameter value of each container, and different box type parameter values correspond to different model structures;

the first determining unit is used for determining the container coating of each first container model according to the target container main information of each container, and different container main information corresponds to different container coatings;

the second determining unit is used for determining the position of each first container model in the digital twin system according to the target position information of each container;

The third determining unit is used for determining the rotation angle of each first container model placed in the digital twin system according to the target rotation information of each container;

In some embodiments, the target box master information includes a target box master name and a target box label;

the first determining unit may specifically include:

the first determining subunit is used for determining the target box texture of each container in a preset box texture library according to the target box main name of each container, wherein the box texture library comprises different box texture;

a second determining subunit, configured to determine a box label code of each container according to the target box label of each container;

the bin coating includes a target bin texture and a bin mark code.

In some embodiments, the second generating submodule may be specifically configured to generate the second container model of each container according to the first container model of each container, where the simplifying process includes at least one of the following manners: model structure simplification processing, texture simplification processing, and box-marking hiding processing.

As an implementation manner of the present application, in order to save consumption of computing resources, the apparatus 300 may further include:

the second acquisition module is used for acquiring characteristic parameter information of each container at the Mth moment;

the second determining module is used for determining the change results of the characteristic parameter information of each container at the Mth moment and the characteristic information parameter at the M-1 moment, and the change results are used for indicating whether the characteristic parameter information at the Mth moment and the characteristic information parameter at the M-1 moment are changed or not;

and the third determining module is used for determining the characteristic information parameters of each container at the Mth moment as target characteristic parameter information under the condition that the corresponding change result of at least one container indicates that the characteristic parameter information at the Mth moment and the characteristic information parameters at the Mth-1 moment are changed.

In some embodiments, the first determining module 303 may specifically include:

the first determining submodule is used for determining target display quality information of each container according to the display duty ratio of each container in a digital twin interface of the digital twin system, wherein the target display quality information corresponds to the display duty ratio;

And the second determining submodule is used for determining a target container model in a plurality of container models of the containers according to the target display quality information of each container, wherein the display quality information of the target container is target display quality information.

Fig. 4 shows a schematic hardware structure of an electronic device according to an embodiment of the present application.

A processor 401 may be included in an electronic device as well as a memory 402 in which computer program instructions are stored.

In particular, the processor 401 described above may include a Central Processing Unit (CPU), or an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or may be configured as one or more integrated circuits implementing embodiments of the present application.

Memory 402 may include mass storage for data or instructions. By way of example, and not limitation, memory 402 may comprise a Hard Disk Drive (HDD), floppy Disk Drive, flash memory, optical Disk, magneto-optical Disk, magnetic tape, or universal serial bus (Universal Serial Bus, USB) Drive, or a combination of two or more of the foregoing. Memory 402 may include removable or non-removable (or fixed) media, where appropriate. Memory 402 may be internal or external to the integrated gateway disaster recovery device, where appropriate. In a particular embodiment, the memory 402 is a non-volatile solid state memory.

In particular embodiments, memory 402 may include Read Only Memory (ROM), random Access Memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical/tangible memory storage devices. Thus, in general, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software comprising computer-executable instructions and when the software is executed (e.g., by one or more processors) it is operable to perform the operations described with reference to methods in accordance with aspects of the present disclosure.

The processor 401 reads and executes the computer program instructions stored in the memory 402 to implement the container display method of the digital twin system of any of the above embodiments.

In one example, the electronic device may also include a communication interface 403 and a bus 410. As shown in fig. 4, the processor 401, the memory 402, and the communication interface 403 are connected by a bus 410 and perform communication with each other.

The communication interface 403 is mainly used to implement communication between each module, device, unit and/or apparatus in the embodiment of the present application.

Bus 410 includes hardware, software, or both, coupling components of the electronic device to one another. By way of example, and not limitation, the buses may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a micro channel architecture (MCa) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus, or a combination of two or more of the above. Bus 410 may include one or more buses, where appropriate. Although embodiments of the application have been described and illustrated with respect to a particular bus, the application contemplates any suitable bus or interconnect.

The electronic device can execute the container display method of the digital twin system in the embodiment of the application, thereby realizing the container display method and the device of the digital twin system described in connection with fig. 1 and 3.

In addition, in combination with the container display method of the digital twin system in the above embodiment, the embodiment of the present application may be implemented by providing a computer readable storage medium. The computer readable storage medium has stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement a container display method for a digital twin system in any of the above embodiments.

It should be understood that the application is not limited to the particular arrangements and instrumentality described above and shown in the drawings. For the sake of brevity, a detailed description of known methods is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present application are not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between steps, after appreciating the spirit of the present application.

The functional blocks shown in the above-described structural block diagrams may be implemented in hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, the elements of the application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine readable medium or transmitted over transmission media or communication links by a data signal carried in a carrier wave. A "machine-readable medium" may include any medium that can store or transfer information. Examples of machine-readable media include electronic circuitry, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio Frequency (RF) links, and the like. The code segments may be downloaded via computer networks such as the internet, intranets, etc.

It should also be noted that the exemplary embodiments mentioned in this disclosure describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, or may be performed in a different order from the order in the embodiments, or several steps may be performed simultaneously.

Aspects of the present disclosure are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks. Such a processor may be, but is not limited to being, a general purpose processor, a special purpose processor, an application specific processor, or a field programmable logic circuit. It will also be understood that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware which performs the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In the foregoing, only the specific embodiments of the present application are described, and it will be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the systems, modules and units described above may refer to the corresponding processes in the foregoing method embodiments, which are not repeated herein. It should be understood that the scope of the present application is not limited thereto, and any equivalent modifications or substitutions can be easily made by those skilled in the art within the technical scope of the present application, and they should be included in the scope of the present application.

Claims

1. A container display method of a digital twin system, comprising:

2. The method of claim 1, wherein generating a plurality of container models for each of the containers in a digital twinning system based on the target characteristic parameter information for each of the containers comprises:

wherein the plurality of container models for each of the containers includes the first container model and the second container model.

3. The method of claim 2, wherein generating a first container model for each of the containers in a digital twinning system based on the target characteristic parameter information for each of the containers comprises:

generating a model structure of a first container model of each container in a digital twin system according to the target box type parameter value of each container, wherein different box type parameter values correspond to different model structures;

determining a rotation angle of each first container model placed in the digital twin system according to target rotation information of each container;

the target characteristic parameter information comprises the target box type parameter value, the target position information, the target rotation information and the target box main information.

4. A method according to claim 3, wherein the target bin master information comprises a target bin master name and a target bin label;

determining the container coating of each first container model according to the main information of the target container of each container, comprising:

determining the target box texture of each container in a preset box texture library according to the target box main name of each container, wherein the box texture library comprises different box texture;

determining the box mark code of each container according to the target box mark of each container;

The bin coating includes the target bin texture and bin mark coding.

5. The method of claim 2, wherein the simplifying process to generate a second container model for each of the containers based on the first container model for each of the containers comprises:

generating a second container model for each of the containers from a first container model for each of the containers, the simplifying including at least one of: model structure simplification processing, texture simplification processing, and box-marking hiding processing.

6. The method of claim 1, further comprising, prior to said generating a plurality of container models for each of said containers in a digital twinning system based on said target characteristic parameter information for each of said containers:

determining the change result of the characteristic parameter information of each container at the Mth moment and the characteristic information parameter at the Mth-1 moment, wherein the change result is used for indicating whether the characteristic parameter information at the Mth moment and the characteristic information parameter at the Mth-1 moment are changed or not;

And determining the characteristic information parameter of each container at the Mth moment as the target characteristic parameter information under the condition that the corresponding change result of at least one container indicates that the characteristic parameter information at the Mth moment and the characteristic information parameter at the Mth-1 moment are changed.

7. The method of claim 1, wherein determining a target container model from among a plurality of container models of the containers based on a display duty cycle of each of the containers in a digital twinning interface of the digital twinning system comprises:

determining target display quality information of each container according to the display duty ratio of each container in a digital twin interface of the digital twin system, wherein the target display quality information corresponds to the display duty ratio;

and determining a target container model from a plurality of container models of the containers according to the target display quality information of each container, wherein the display quality information of the target container is the target display quality information.

8. A container display device of a digital twinning system, the device comprising:

9. An electronic device, the device comprising: a processor and a memory storing computer program instructions; the processor, when executing the computer program instructions, implements a container display method of a digital twin system as defined in any one of claims 1-7.

10. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon computer program instructions, which when executed by a processor, implement a container display method of a digital twin system according to any of claims 1-7.