CN116310148B - Digital twin three-dimensional scene construction method, device, equipment and medium - Google Patents
Digital twin three-dimensional scene construction method, device, equipment and medium Download PDFInfo
- Publication number
- CN116310148B CN116310148B CN202310552308.6A CN202310552308A CN116310148B CN 116310148 B CN116310148 B CN 116310148B CN 202310552308 A CN202310552308 A CN 202310552308A CN 116310148 B CN116310148 B CN 116310148B
- Authority
- CN
- China
- Prior art keywords
- dimensional
- digital twin
- dimensional scene
- scene
- key information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation or dialogue systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Library & Information Science (AREA)
- Geometry (AREA)
- Artificial Intelligence (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computational Linguistics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application discloses a method, a device, equipment and a medium for constructing a digital twin three-dimensional scene, which are applied to the technical field of digital twin and comprise the following steps: acquiring a natural language text input by a user, wherein the natural language text describes the construction requirement of a data twin three-dimensional scene; extracting key information of the natural language text by using a pre-training language model; retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the key information; a digital twin three-dimensional scene is generated based on the three-dimensional model. Therefore, a user can generate a digital twin three-dimensional scene by inputting language text according to the user's own requirements, the construction efficiency of the digital twin three-dimensional scene can be improved while the user's requirements are met, the construction complexity is reduced, and therefore the user experience is improved.
Description
Technical Field
The application relates to the technical field of digital twinning, in particular to a digital twinning three-dimensional scene construction method, a device, equipment and a medium.
Background
Digital twinning is a technique that utilizes data and models of the physical world to create dynamic digital copies of physical entities in virtual space. The digital twin three-dimensional scene is a technology for combining digital twin data with a three-dimensional model to realize visualization and interaction of a physical environment. The digital twin three-dimensional scene can provide more visual and efficient management, monitoring, diagnosis and decision support for various industries.
At present, the construction of a digital twin three-dimensional scene mainly depends on professional three-dimensional modeling software and tools, higher professional knowledge and labor cost are required, and the user experience is poor.
Disclosure of Invention
In view of the above, the present application aims to provide a method, an apparatus, a device, and a medium for constructing a digital twin three-dimensional scene, which can improve the efficiency of constructing the digital twin three-dimensional scene, reduce the complexity of construction, and thereby improve the user experience. The specific scheme is as follows:
in a first aspect, the application discloses a digital twin three-dimensional scene construction method, which comprises the following steps:
acquiring a natural language text input by a user, wherein the natural language text describes the construction requirement of a data twin three-dimensional scene;
extracting key information of the natural language text by using a pre-training language model;
retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the key information;
a digital twin three-dimensional scene is generated based on the three-dimensional model.
Optionally, the key information includes scene type, scene element, element attribute, element relation.
Optionally, the retrieving, based on the key information, a three-dimensional model matched with the key information from a preset three-dimensional model library includes:
and retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the scene type and the scene element.
Optionally, the generating the digital twin three-dimensional scene based on the three-dimensional model includes:
and adjusting and combining the three-dimensional model based on the element attributes and the element relations to generate a data twin three-dimensional scene.
Optionally, the method further comprises:
acquiring a three-dimensional scene adjustment information text input by a user;
extracting operation information in the three-dimensional scene adjustment information text by using a pre-training language model; the operation information comprises insertion information and/or deletion information and/or attribute modification information corresponding to the scene element.
And adjusting the digital twin three-dimensional scene based on the operation information.
Optionally, after the generating the digital twin three-dimensional scene based on the three-dimensional model, the method further includes:
and correlating the digital twin three-dimensional scene with the digital twin data to display real-time data corresponding to the physical environment in the digital twin three-dimensional scene.
Optionally, the method further comprises:
acquiring control data input by a user, controlling equipment in the physical environment based on the control data, and displaying a corresponding feedback result in the digital twin three-dimensional scene; wherein the user control data comprises instructions and/or clicking operations;
and acquiring preset operation data input by a user, and displaying specified data in the digital twin three-dimensional scene based on the preset operation data.
In a second aspect, the present application discloses a digital twin three-dimensional scene construction device, comprising:
the language text acquisition module is used for acquiring a natural language text input by a user, wherein the natural language text describes the construction requirement of the data twin three-dimensional scene;
the key information extraction module is used for extracting key information of the natural language text by utilizing a pre-training language model;
the three-dimensional model retrieval module is used for retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the key information;
and the three-dimensional scene generation module is used for generating a digital twin three-dimensional scene based on the three-dimensional model.
In a third aspect, the application discloses an electronic device comprising a memory and a processor, wherein:
the memory is used for storing a computer program;
the processor is configured to execute the computer program to implement the aforementioned digital twin three-dimensional scene construction method.
In a fourth aspect, the present application discloses a computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the aforementioned digital twin three-dimensional scene construction method.
Therefore, the method and the device acquire the natural language text input by the user, the natural language text describes the construction requirement of the data twin three-dimensional scene, then the key information of the natural language text is extracted by utilizing the pre-training language model, the three-dimensional model matched with the key information is retrieved from the preset three-dimensional model library based on the key information, and finally the digital twin three-dimensional scene is generated based on the three-dimensional model. The method comprises the steps of extracting key information of a natural language text input by a user by utilizing a pre-training language model, retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library, and generating a digital twin three-dimensional scene based on the retrieved three-dimensional model.
The method has the advantages that a user can generate the digital twin three-dimensional scene only by inputting language text according to the user's own requirements, the construction efficiency of the digital twin three-dimensional scene can be improved while the user's requirements are met, the construction complexity is reduced, and therefore the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for constructing a digital twin three-dimensional scene;
FIG. 2 is a flow chart of a specific digital twin three-dimensional scene construction method disclosed by the application;
FIG. 3 is a schematic diagram of a digital twin three-dimensional scene building device according to the present disclosure;
fig. 4 is a block diagram of an electronic device according to the present disclosure.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
At present, the construction of a digital twin three-dimensional scene mainly depends on professional three-dimensional modeling software and tools, higher professional knowledge and labor cost are required, and the user experience is poor. Therefore, the application provides a digital twin three-dimensional scene construction scheme, which can improve the efficiency of digital twin three-dimensional scene construction, reduce the construction complexity and further improve the user experience.
Referring to fig. 1, the embodiment of the application discloses a digital twin three-dimensional scene construction method, which comprises the following steps:
step S11: and acquiring a natural language text input by a user, wherein the natural language text describes the construction requirement of the data twin three-dimensional scene.
In one embodiment, the natural language text input by the user can be obtained through a user interface, that is, the user can edit and input the content and the requirements of the digital twin three-dimensional scene which the user desires to construct in the user interface to form the natural language text.
Step S12: and extracting key information of the natural language text by using a pre-training language model.
The pre-training language model is a general language representation model obtained by training large-scale text data in an unsupervised or self-supervised mode. The pre-training language model can capture the grammar, the semantic, the logic, the common sense and other information of the language, and provide powerful characteristic representation and migration capability for natural language processing tasks. The embodiment of the application can analyze the natural language text input by the user by utilizing the pre-training language model and extract the key information.
Step S13: and retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the key information.
In particular embodiments, the key information includes, but is not limited to, scene type, scene element, element attribute, element relationship. And the preset three-dimensional model library comprises three-dimensional models of each scene type and each scene element under each scene type.
Step S14: a digital twin three-dimensional scene is generated based on the three-dimensional model.
The embodiment of the application can search the three-dimensional model matched with the key information from the preset three-dimensional model library based on the scene type and the scene element. And adjusting and combining the three-dimensional model based on the element attributes and the element relations to generate a data twin three-dimensional scene.
Furthermore, the embodiment of the application can also acquire the three-dimensional scene adjustment information text input by the user; extracting operation information in the three-dimensional scene adjustment information text by using a pre-training language model; the operation information comprises insertion information and/or deletion information and/or attribute modification information corresponding to the scene element. And adjusting the digital twin three-dimensional scene based on the operation information. That is, a certain scene element is inserted in the digital twin three-dimensional scene based on the operation information, or a certain element is deleted, or an attribute of a certain element is modified.
In another embodiment, a three-dimensional scene adjustment information text input by a user can be obtained and combined with a natural language text corresponding to the current digital twin three-dimensional scene to obtain a combined text, key information of the combined text is extracted by using a pre-training language model, a three-dimensional model matched with the key information is retrieved from a preset three-dimensional model library based on the key information, and the digital twin three-dimensional scene is generated based on the three-dimensional model.
In another embodiment, the three-dimensional scene adjustment information text is user complete demand information, and can be compared with a natural language text corresponding to the current digital twin three-dimensional scene to obtain difference information, and the digital twin three-dimensional scene is adjusted based on the difference information, wherein the comparison process can be that a pre-training language model is input first, key information is extracted, and then the key information is compared to obtain the difference information.
It is understood that the key information of the present application may also include operation information. Moreover, it should be pointed out that, compared with the existing scheme relying on professional three-dimensional modeling software and tools, the method and the device can dynamically generate and adjust the three-dimensional scene according to the needs and intentions of users, do not need professional three-dimensional modeling knowledge and tools, are quick and simple, and have higher flexibility and intelligence.
Furthermore, the embodiment of the application can correlate the digital twin three-dimensional scene with the digital twin data so as to display the real-time data corresponding to the physical environment in the digital twin three-dimensional scene.
Moreover, the control data input by the user can be acquired, the equipment in the physical environment is controlled based on the control data, and the corresponding feedback result is displayed in the digital twin three-dimensional scene; wherein the user control data comprises instructions and/or clicking operations; and acquiring preset operation data input by a user, and displaying specified data in the digital twin three-dimensional scene based on the preset operation data. For example, the specified data can be a security index, the efficiency and stability of the cooperation of the elements, and the like
In this way, the generated digital twin three-dimensional scene is associated with the digital twin data, and real-time reflection and interaction of the physical environment can be realized.
It can be seen that, in the embodiment of the present application, a natural language text input by a user is first obtained, the natural language text describes a requirement for constructing a data twin three-dimensional scene, then key information of the natural language text is extracted by using a pre-training language model, a three-dimensional model matched with the key information is retrieved from a preset three-dimensional model library based on the key information, and finally a digital twin three-dimensional scene is generated based on the three-dimensional model. That is, the embodiment of the application extracts the key information of the natural language text input by the user by utilizing the pre-training language model, then searches the three-dimensional model matched with the key information from the preset three-dimensional model library, and finally generates the digital twin three-dimensional scene based on the searched three-dimensional model. Therefore, a user can generate a digital twin three-dimensional scene by inputting language text according to the user's own requirements, the construction efficiency of the digital twin three-dimensional scene can be improved while the user's requirements are met, the construction complexity is reduced, and therefore the user experience is improved.
The digital twin three-dimensional scene construction scheme of the present application is further described below by taking the construction of an intelligent factory as an example. For example, referring to fig. 2, fig. 2 is a flowchart of a specific digital twin three-dimensional scene construction method disclosed in an embodiment of the present application, which specifically includes the following steps:
first, natural language text input by a user is received, the text describing the content and requirements of a digital twin three-dimensional scene that the user desires to construct. For example, the user inputs "I want to build a digital twin three-dimensional scene of an intelligent plant, including plant, equipment, staff, materials, etc., and the positional and status relationships between them. I also want to see the operating parameters and fault information of the equipment, as well as the staff's work efficiency and safety metrics. ";
and then analyzing the natural language text input by the user by utilizing the pre-training language model, and extracting key information in the natural language text, wherein the key information comprises scene types, scene elements, element attributes, element relations and the like. The pre-trained language model may be any model with strong language understanding and knowledge representation capabilities, such as BERT, GPT-3, etc. In the embodiment of the application, the following key information is obtained after analysis by using a pre-training language model:
scene type: an intelligent factory; scene element: workshops, equipment, personnel, materials; element attributes: the workshops have the properties of numbering, area, layout and the like; the equipment has the attributes of type, number, position, operation parameters, fault information and the like; the staff has the attributes of name, position, working efficiency, safety index and the like; the materials have the attributes of type, quantity, position and the like; element relationship: the workshop comprises a plurality of devices and staff; the devices are connected or dependent; the staff have cooperation or management relationship; the materials have a flowing or consumption relation; the equipment and staff have operation or monitoring relation; the equipment and the materials have a processing or using relation.
Further, according to the extracted key information, a three-dimensional model matched with the scene type and the scene element is retrieved from a preset three-dimensional model library, and the retrieved three-dimensional model is adjusted and combined according to the element attribute and the element relation to generate the digital twin three-dimensional scene. The preset three-dimensional model library may be any database containing three-dimensional models of various types and styles. In the embodiment of the application, the following three-dimensional model is retrieved from a preset three-dimensional model library:
workshop: a rectangular hall with a plurality of partitions and channels inside; the device comprises: machines of various types and specifications, such as numerically controlled machine tools, robotic arms, conveyor belts, etc.; staff: people of various sexes and ages wear work clothes with different colors and styles; and (3) material: parts or products of various shapes and sizes, such as screws, gears, automobile parts, etc.
And adjusting and combining the retrieved three-dimensional model according to the element attribute and the element relation to generate the digital twin three-dimensional scene. For example, devices are placed in a workshop according to a specified layout, and connection or dependency between the devices is set; staff are distributed in a workshop according to the designated position, and cooperation or management relation among the staff is set; placing materials in a workshop according to a designated position, and setting a flow or consumption relation between the materials; setting an operation or monitoring relation between the equipment and staff; a processing or usage relationship is set between the equipment and the material. Thus, a digital twin three-dimensional scene of the intelligent factory meeting the requirements and intentions of users is generated.
Further, the generated digital twin three-dimensional scene is associated with the digital twin data, so that real-time reflection and interaction of the physical environment are realized. The digital twin data may be any data containing status and behavioral information of the physical entity, such as sensor data, video data, log data, and the like. In the embodiment of the application, the generated digital twin three-dimensional scene is associated and interacted by using the digital twin data as follows:
according to the sensor data, updating the operation parameters and fault information of the equipment in real time, and displaying the operation parameters and fault information in different colors or icons in a three-dimensional scene; updating the position and the action of the staff in real time according to the video data, and displaying the staff in a three-dimensional scene in an animation mode; and updating the quantity and the position of the materials in real time according to the log data, and displaying the materials in a three-dimensional scene in the form of numbers or arrows.
In addition, the embodiment of the application can also control the switching or the adjustment of the equipment in real time according to the instruction input by the user or the clicking operation, and feed back the result in a three-dimensional scene; according to inquiry or selection operation input by a user, the working efficiency and the safety index of staff are displayed in real time, and are displayed in a three-dimensional scene in a chart or a text mode; according to analysis or optimization operation input by a user, evaluation indexes such as the synergy, efficiency, stability and the like among all elements in a workshop are calculated and provided in real time, and are displayed in a three-dimensional scene in a color or shape change mode.
Therefore, real-time reflection and interaction of the physical environment are realized, so that the user can observe and control the state and behavior of the physical entity in the virtual space, acquire more information and insight, and optimize the decision process.
It can be appreciated that the application can improve the efficiency and quality of digital twin three-dimensional scene construction. The complex three-dimensional modeling operation is avoided, time and cost are saved, and meanwhile, the generated three-dimensional scene is ensured to meet the requirements and intentions of users. The relevance and interactivity of the digital twin three-dimensional scene and the digital twin data are enhanced. The user can observe and control the state and the behavior of the physical entity in the virtual space, acquire more information and insights and optimize the decision process. The application range and innovation space of the digital twin three-dimensional scene construction are expanded. And more possibilities and flexibility are provided for users, and the users are motivated to perform more exploration and innovation in the digital twin technical field.
Referring to fig. 3, an embodiment of the present application discloses a digital twin three-dimensional scene construction device, including:
the language text acquisition module 11 is used for acquiring a natural language text input by a user, wherein the natural language text describes the construction requirement of the data twin three-dimensional scene;
a key information extracting module 12, configured to extract key information of the natural language text by using a pre-training language model;
a three-dimensional model retrieving module 13, configured to retrieve, from a preset three-dimensional model library, a three-dimensional model matching the key information based on the key information;
a three-dimensional scene generation module 14 for generating a digital twin three-dimensional scene based on the three-dimensional model.
It can be seen that, in the embodiment of the present application, a natural language text input by a user is first obtained, the natural language text describes a requirement for constructing a data twin three-dimensional scene, then key information of the natural language text is extracted by using a pre-training language model, a three-dimensional model matched with the key information is retrieved from a preset three-dimensional model library based on the key information, and finally a digital twin three-dimensional scene is generated based on the three-dimensional model. That is, the embodiment of the application extracts the key information of the natural language text input by the user by utilizing the pre-training language model, then searches the three-dimensional model matched with the key information from the preset three-dimensional model library, and finally generates the digital twin three-dimensional scene based on the searched three-dimensional model. Therefore, a user can generate a digital twin three-dimensional scene by inputting language text according to the user's own requirements, the construction efficiency of the digital twin three-dimensional scene can be improved while the user's requirements are met, the construction complexity is reduced, and therefore the user experience is improved.
The key information comprises scene types, scene elements, element attributes and element relations.
Correspondingly, the three-dimensional model retrieval module 13 is specifically configured to:
and retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the scene type and the scene element.
Further, the three-dimensional scene generating module 14 is specifically configured to:
and adjusting and combining the three-dimensional model based on the element attributes and the element relations to generate a data twin three-dimensional scene.
In addition, the device further comprises:
the three-dimensional scene adjustment information text acquisition module is used for acquiring a three-dimensional scene adjustment information text input by a user;
correspondingly, the key information extraction module 12 is further configured to extract operation information in the three-dimensional scene adjustment information text by using a pre-training language model; the operation information comprises insertion information and/or deletion information and/or attribute modification information corresponding to the scene element.
And the digital twin three-dimensional scene adjustment module is used for adjusting the digital twin three-dimensional scene based on the operation information.
Further, the device also comprises a digital twin data association module, which is used for associating the digital twin three-dimensional scene with the digital twin data so as to display real-time data corresponding to the physical environment in the digital twin three-dimensional scene.
In addition, the device further comprises:
the equipment control module is used for acquiring control data input by a user and controlling equipment in the physical environment based on the control data;
the data display module is used for displaying corresponding feedback results in the digital twin three-dimensional scene; wherein the user control data comprises instructions and/or clicking operations;
the operation data acquisition module is used for acquiring preset operation data input by a user;
correspondingly, the data display module is used for displaying the specified data in the digital twin three-dimensional scene based on the preset operation data.
Referring to fig. 4, an embodiment of the present application discloses an electronic device 20 comprising a processor 21 and a memory 22; wherein the memory 22 is used for storing a computer program; the processor 21 is configured to execute the computer program, and the digital twin three-dimensional scene construction method disclosed in the foregoing embodiment is disclosed.
For the specific process of the digital twin three-dimensional scene construction method, reference may be made to the corresponding content disclosed in the foregoing embodiment, and no further description is given here.
The memory 22 may be a carrier for storing resources, such as a read-only memory, a random access memory, a magnetic disk or an optical disk, and the storage mode may be transient storage or permanent storage.
In addition, the electronic device 20 further includes a power supply 23, a communication interface 24, an input-output interface 25, and a communication bus 26; wherein the power supply 23 is configured to provide an operating voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and an external device, and the communication protocol to be followed is any communication protocol applicable to the technical solution of the present application, which is not specifically limited herein; the input/output interface 25 is used for acquiring external input data or outputting external output data, and the specific interface type thereof may be selected according to the specific application requirement, which is not limited herein.
Further, the embodiment of the application also discloses a computer readable storage medium for storing a computer program, wherein the computer program is executed by a processor to realize the digital twin three-dimensional scene construction method disclosed in the previous embodiment.
For the specific process of the digital twin three-dimensional scene construction method, reference may be made to the corresponding content disclosed in the foregoing embodiment, and no further description is given here.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, so that the same or similar parts between the embodiments are referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software modules may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above detailed description of the method, the device, the equipment and the medium for constructing the digital twin three-dimensional scene provided by the application applies specific examples to illustrate the principle and the implementation of the application, and the description of the above examples is only used for helping to understand the method and the core idea of the application; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.
Claims (7)
1. A digital twin three-dimensional scene construction method, comprising:
acquiring a natural language text input by a user, wherein the natural language text describes the construction requirement of a data twin three-dimensional scene;
extracting key information of the natural language text by using a pre-training language model; the key information comprises scene types, scene elements, element attributes and element relationships; the scene type is an intelligent factory; the scene elements comprise workshops, equipment, staff and materials; the element attributes of the workshops comprise numbers, areas and layouts; the element attributes of the equipment comprise types, numbers, positions, operation parameters and fault information; the element attributes of the staff include name, position, working efficiency and safety index; the element attributes of the materials comprise types, numbers and positions; the element relationships include: the workshops comprise a plurality of devices and staff, connection or dependency relationships among the devices, cooperation or management relationships among the staff, flow or consumption relationships among materials, operation or monitoring relationships among the devices and the staff, and processing or use relationships among the devices and the materials;
retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the key information;
generating a digital twin three-dimensional scene based on the three-dimensional model;
the generating a digital twin three-dimensional scene based on the three-dimensional model includes: placing equipment in a workshop according to a specified layout, and setting connection or dependency relationship between the equipment; staff is distributed in a workshop according to the designated position, and cooperation or management relations among the staff are set; placing materials in a workshop according to a designated position, and setting a flow or consumption relation between the materials; setting an operation or monitoring relation between the equipment and staff; a processing or using relation is set between the equipment and the materials;
wherein the method further comprises: and acquiring a three-dimensional scene adjustment information text input by a user, combining the three-dimensional scene adjustment information text with a natural language text corresponding to the current digital twin three-dimensional scene to obtain a combined text, extracting key information of the combined text by using a pre-training language model, retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the key information, and generating the digital twin three-dimensional scene based on the three-dimensional model.
2. The method for constructing a digital twin three-dimensional scene according to claim 1, wherein the retrieving, based on the key information, a three-dimensional model matching the key information from a preset three-dimensional model library includes:
and retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the scene type and the scene element.
3. The digital twin three-dimensional scene constructing method according to any of claims 1 to 2, further comprising, after the generating a digital twin three-dimensional scene based on the three-dimensional model:
and correlating the digital twin three-dimensional scene with the digital twin data to display real-time data corresponding to the physical environment in the digital twin three-dimensional scene.
4. A digital twin three-dimensional scene constructing method as defined in claim 3, further comprising:
acquiring control data input by a user, controlling equipment in the physical environment based on the control data, and displaying a corresponding feedback result in the digital twin three-dimensional scene; wherein the control data comprises instructions and/or clicking operations;
and acquiring preset operation data input by a user, and displaying specified data in the digital twin three-dimensional scene based on the preset operation data.
5. A digital twin three-dimensional scene building apparatus, comprising:
the language text acquisition module is used for acquiring a natural language text input by a user, wherein the natural language text describes the construction requirement of the data twin three-dimensional scene;
the key information extraction module is used for extracting key information of the natural language text by utilizing a pre-training language model; the key information comprises scene types, scene elements, element attributes and element relationships; the scene type is an intelligent factory; the scene elements comprise workshops, equipment, staff and materials; the element attributes of the workshops comprise numbers, areas and layouts; the element attributes of the equipment comprise types, numbers, positions, operation parameters and fault information; the element attributes of the staff include name, position, working efficiency and safety index; the element attributes of the materials comprise types, numbers and positions; the element relationships include: the workshops comprise a plurality of devices and staff, connection or dependency relationships among the devices, cooperation or management relationships among the staff, flow or consumption relationships among materials, operation or monitoring relationships among the devices and the staff, and processing or use relationships among the devices and the materials;
the three-dimensional model retrieval module is used for retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the key information;
the three-dimensional scene generation module is used for generating a digital twin three-dimensional scene based on the three-dimensional model;
the three-dimensional scene generation module is specifically used for placing equipment in a workshop according to a specified layout and setting connection or dependency relationship between the equipment; staff is distributed in a workshop according to the designated position, and cooperation or management relations among the staff are set; placing materials in a workshop according to a designated position, and setting a flow or consumption relation between the materials; setting an operation or monitoring relation between the equipment and staff; a processing or using relation is set between the equipment and the materials;
wherein the device is further for: and acquiring a three-dimensional scene adjustment information text input by a user, combining the three-dimensional scene adjustment information text with a natural language text corresponding to the current digital twin three-dimensional scene to obtain a combined text, extracting key information of the combined text by using a pre-training language model, retrieving a three-dimensional model matched with the key information from a preset three-dimensional model library based on the key information, and generating the digital twin three-dimensional scene based on the three-dimensional model.
6. An electronic device comprising a memory and a processor, wherein:
the memory is used for storing a computer program;
the processor is configured to execute the computer program to implement the digital twin three-dimensional scene construction method as claimed in any one of claims 1 to 4.
7. A computer readable storage medium for storing a computer program, wherein the computer program when executed by a processor implements the digital twin three-dimensional scene construction method according to any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310552308.6A CN116310148B (en) | 2023-05-17 | 2023-05-17 | Digital twin three-dimensional scene construction method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310552308.6A CN116310148B (en) | 2023-05-17 | 2023-05-17 | Digital twin three-dimensional scene construction method, device, equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116310148A CN116310148A (en) | 2023-06-23 |
| CN116310148B true CN116310148B (en) | 2023-09-12 |
Family
ID=86798120
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310552308.6A Active CN116310148B (en) | 2023-05-17 | 2023-05-17 | Digital twin three-dimensional scene construction method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116310148B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116912430B (en) * | 2023-09-14 | 2023-12-15 | 北京唯迈医疗设备有限公司 | Device for constructing three-dimensional digital twin system of remote intervention operating room |
| CN117033719B (en) * | 2023-10-08 | 2024-02-20 | 中科航迈数控软件(深圳)有限公司 | Method, device, equipment and medium for acquiring machine tool digital twin system information |
| CN117251896B (en) * | 2023-10-11 | 2024-02-27 | 北京师范大学 | Context information-based digital twin learning scene reconstruction method and system |
| CN117078867B (en) * | 2023-10-16 | 2023-12-12 | 北京渲光科技有限公司 | Three-dimensional reconstruction method, three-dimensional reconstruction device, storage medium and electronic equipment |
| CN117726778A (en) * | 2023-10-27 | 2024-03-19 | 神力视界(深圳)文化科技有限公司 | Three-dimensional ancient architecture model generation method, device, equipment and storage medium |
| CN117473105B (en) * | 2023-12-28 | 2024-04-05 | 浪潮电子信息产业股份有限公司 | Three-dimensional content generation method based on multi-mode pre-training model and related components |
| CN117593498B (en) * | 2024-01-19 | 2024-04-26 | 北京云庐科技有限公司 | Digital twin scene configuration method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110599592A (en) * | 2019-09-12 | 2019-12-20 | 北京工商大学 | Three-dimensional indoor scene reconstruction method based on text |
| CN112288872A (en) * | 2020-10-28 | 2021-01-29 | 中国能源建设集团江苏省电力设计院有限公司 | Remote three-dimensional display method and device for operation data of substation cubicle and storage medium |
| CN113658325A (en) * | 2021-08-05 | 2021-11-16 | 郑州轻工业大学 | Intelligent identification and early warning method for uncertain objects of production line in digital twin environment |
| CN113887016A (en) * | 2021-09-07 | 2022-01-04 | 中船智能科技(上海)有限公司 | Ship digital workshop simulation method and system based on digital twinning |
| CN114565265A (en) * | 2022-02-25 | 2022-05-31 | 中用科技有限公司 | Intelligent factory management system based on digital twin technology |
| CN116051729A (en) * | 2022-12-15 | 2023-05-02 | 北京百度网讯科技有限公司 | Three-dimensional content generation method and device and electronic equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10853398B2 (en) * | 2018-11-13 | 2020-12-01 | Adobe Inc. | Generating three-dimensional digital content from natural language requests |
-
2023
- 2023-05-17 CN CN202310552308.6A patent/CN116310148B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110599592A (en) * | 2019-09-12 | 2019-12-20 | 北京工商大学 | Three-dimensional indoor scene reconstruction method based on text |
| CN112288872A (en) * | 2020-10-28 | 2021-01-29 | 中国能源建设集团江苏省电力设计院有限公司 | Remote three-dimensional display method and device for operation data of substation cubicle and storage medium |
| CN113658325A (en) * | 2021-08-05 | 2021-11-16 | 郑州轻工业大学 | Intelligent identification and early warning method for uncertain objects of production line in digital twin environment |
| CN113887016A (en) * | 2021-09-07 | 2022-01-04 | 中船智能科技(上海)有限公司 | Ship digital workshop simulation method and system based on digital twinning |
| CN114565265A (en) * | 2022-02-25 | 2022-05-31 | 中用科技有限公司 | Intelligent factory management system based on digital twin technology |
| CN116051729A (en) * | 2022-12-15 | 2023-05-02 | 北京百度网讯科技有限公司 | Three-dimensional content generation method and device and electronic equipment |
Non-Patent Citations (1)
| Title |
|---|
| 数字孪生与AI技术的融合应用;冯升华;《人工智能》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116310148A (en) | 2023-06-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116310148B (en) | Digital twin three-dimensional scene construction method, device, equipment and medium | |
| Mattoso et al. | Towards supporting the life cycle of large scale scientific experiments | |
| US8522151B2 (en) | Wizard for selecting visualization | |
| CN109933311A (en) | A kind of information system creation method and relevant apparatus | |
| CN105159754A (en) | On-line simulation method and device based on intelligent business cloud platform | |
| CN105808244A (en) | Dynamic data visualized analysis tool based on workflows | |
| CN110442620A (en) | A kind of big data is explored and cognitive approach, device, equipment and computer storage medium | |
| CN112364106A (en) | Data association visualization method and system for automatically generating service topological graph | |
| CN108039080A (en) | A kind of immersion remote training system based on virtual reality | |
| CN111723426A (en) | Building design method and system based on BIM | |
| Schindler et al. | Multiverse data-flow control | |
| CN114064028A (en) | Spatial analysis modeling method based on online visual editing | |
| JP2002063033A (en) | Knowledge control system provided with ontology | |
| CN111475602B (en) | Multi-version knowledge graph storage method and device, storage medium and electronic equipment | |
| CN102929636A (en) | Method and device for creating human-computer interaction interface | |
| CN115146341A (en) | Three-dimensional intelligent parameterized BIM model establishing software | |
| CN117522185A (en) | Flexibly configurable evaluation method, system and terminal | |
| CN111784192A (en) | Industrial park emergency plan executable system based on dynamic evolution | |
| Bako et al. | Streamlining Visualization Authoring in D3 Through User-Driven Templates | |
| CN112202861B (en) | BIM-based hydropower engineering method management application system | |
| CN114238072A (en) | HIL requirement design method, HIL requirement design device, computer equipment and storage medium | |
| CN112650486A (en) | Data visualization processing method and device | |
| CN113888726A (en) | 3D space model parameter correction editor based on webGL frame | |
| Flotynski et al. | Semantic Representation of Domain Knowledge for Professional VR Training. | |
| CN115826937B (en) | Digital twin industrial software platform makeTain |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |