CN115375855A - Visualization method and device for engineering project, electronic equipment and readable medium - Google Patents
Visualization method and device for engineering project, electronic equipment and readable medium Download PDFInfo
- Publication number
- CN115375855A CN115375855A CN202211308993.XA CN202211308993A CN115375855A CN 115375855 A CN115375855 A CN 115375855A CN 202211308993 A CN202211308993 A CN 202211308993A CN 115375855 A CN115375855 A CN 115375855A
- Authority
- CN
- China
- Prior art keywords
- generate
- dimensional model
- engineering project
- target
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the disclosure discloses a visualization method and device for an engineering project, electronic equipment and a readable medium. One embodiment of the method comprises: acquiring images of a region corresponding to a target engineering project through target acquisition equipment to generate a region image group set, wherein the region image group comprises a plurality of images acquired by the target acquisition equipment at a plurality of angles at the same time; according to the regional image group set, performing three-dimensional reconstruction on a region corresponding to the target engineering project to generate a three-dimensional model corresponding to the target engineering project; carrying out consistency check on the three-dimensional model according to the engineering project diagram corresponding to the three-dimensional model; in response to failing to pass the consistency check, generating an abnormal component information set; performing model adjustment on the three-dimensional model according to the abnormal component information set to generate an adjusted three-dimensional model; and carrying out three-dimensional visual display on the adjusted three-dimensional model. The implementation mode ensures the construction safety of engineering projects.
Description
Technical Field
The embodiment of the disclosure relates to the technical field of computers, in particular to a visualization method and device for an engineering project, electronic equipment and a readable medium.
Background
The visualization of the engineering project refers to a technology for three-dimensionally displaying the engineering project in a visualization mode. At present, when engineering project visualization is performed, the commonly adopted mode is as follows: and carrying out three-dimensional visualization based on the two-dimensional construction drawing corresponding to the engineering project. However, the inventors have found that when the above-described manner is adopted, there are often technical problems as follows:
firstly, three-dimensional visualization is carried out on a two-dimensional construction drawing, so that abnormal components in an actual engineering project cannot be effectively detected, and the construction safety of the engineering project cannot be ensured; second, when the construction project includes many components, the detection efficiency is low by detecting the abnormal components manually.
The above information disclosed in this background section is only for enhancement of understanding of the background of the inventive concept and, therefore, it may contain information that does not form the prior art that is already known to a person of ordinary skill in the art.
Disclosure of Invention
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
Some embodiments of the present disclosure propose a visualization method, apparatus, electronic device and readable medium for engineering projects to solve one or more of the technical problems mentioned in the background section above.
In a first aspect, some embodiments of the present disclosure provide a method of visualizing an engineering project, the method comprising: acquiring images of a region corresponding to a target engineering project through target acquisition equipment to generate a region image group set, wherein the region image group comprises a plurality of images acquired by the target acquisition equipment at a plurality of angles at the same time; according to the region image group set, performing three-dimensional reconstruction on a region corresponding to the target engineering project to generate a three-dimensional model corresponding to the target engineering project; according to the engineering project drawing corresponding to the three-dimensional model, carrying out consistency check on the three-dimensional model; in response to failing to pass the consistency check, generating an abnormal component information set; performing model adjustment on the three-dimensional model according to the abnormal component information set to generate an adjusted three-dimensional model; and carrying out three-dimensional visual display on the adjusted three-dimensional model.
In a second aspect, some embodiments of the present disclosure provide an apparatus for visualization of an engineering project, the apparatus comprising: the system comprises an image acquisition unit, a target acquisition device and a display unit, wherein the image acquisition unit is configured to acquire an image of a region corresponding to a target engineering project through the target acquisition device so as to generate a region image group set, and the region image group comprises a plurality of images acquired by the target acquisition device at a plurality of angles at the same time; a three-dimensional reconstruction unit configured to perform three-dimensional reconstruction on a region corresponding to the target engineering project according to the region image group set to generate a three-dimensional model corresponding to the target engineering project; the consistency checking unit is configured to carry out consistency checking on the three-dimensional model according to an engineering project diagram corresponding to the three-dimensional model; a generating unit configured to generate an abnormal component information set in response to failing to pass the consistency check; a model adjusting unit configured to perform model adjustment on the three-dimensional model according to the abnormal component information set to generate an adjusted three-dimensional model; and the display unit is configured to perform three-dimensional visual display on the adjusted three-dimensional model.
In a third aspect, some embodiments of the present disclosure provide an electronic device, comprising: one or more processors; a storage device having one or more programs stored thereon, which when executed by one or more processors, cause the one or more processors to implement the method described in any of the implementations of the first aspect.
In a fourth aspect, some embodiments of the disclosure provide a computer readable medium on which a computer program is stored, wherein the program when executed by a processor implements the method described in any implementation of the first aspect.
In a fifth aspect, some embodiments of the present disclosure provide a computer program product comprising a computer program that, when executed by a processor, implements the method described in any of the implementations of the first aspect above.
The above embodiments of the present disclosure have the following advantages: the construction safety of the engineering project is guaranteed through the visualization method of the engineering project of some embodiments of the disclosure. Specifically, the reason why the construction safety is low is that: three-dimensional visualization is carried out on the two-dimensional construction drawing, and abnormal components in actual construction projects cannot be effectively detected, so that the construction safety of engineering projects cannot be guaranteed. Based on this, according to the visualization method for the engineering project of some embodiments of the present disclosure, first, a target acquisition device acquires an image of a region corresponding to a target engineering project to generate a region image group set, where the region image group includes a plurality of images acquired by the target acquisition device at a plurality of angles at the same time. And acquiring actual construction images under multiple angles corresponding to the engineering project in an image acquisition mode. And then, according to the regional image group set, performing three-dimensional reconstruction on the region corresponding to the target engineering project to generate a three-dimensional model corresponding to the target engineering project. And generating an actual three-dimensional model corresponding to the target engineering project through three-dimensional reconstruction. And further, according to the engineering project diagram corresponding to the three-dimensional model, carrying out consistency check on the three-dimensional model. Thereby determining whether the actual engineering project corresponds to the corresponding engineering project map. Next, in response to failing the consistency check, an abnormal component information set is generated. When not consistent, the existence of an abnormal component is determined. Further, model adjustment is performed on the three-dimensional model based on the abnormal component information set to generate an adjusted three-dimensional model. And finally, carrying out three-dimensional visual display on the adjusted three-dimensional model. By the method, the abnormal component in the actual engineering project is effectively monitored, and the construction safety of the engineering project is ensured. Meanwhile, the three-dimensional model is displayed in a three-dimensional visualization mode, so that the current progress of the engineering project can be visually displayed, and the usability of the model is further improved.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.
FIG. 1 is a flow diagram of some embodiments of a method of visualization of an engineering project according to the present disclosure;
FIG. 2 is a schematic structural diagram of some embodiments of a visualization device for an engineering project, according to the present disclosure;
FIG. 3 is a schematic block diagram of an electronic device suitable for use in implementing some embodiments of the present disclosure.
The structural schematic diagram of the visualization apparatus 200 for engineering projects shown in fig. 2 includes: the system comprises an image acquisition unit 201, a three-dimensional reconstruction unit 202, a consistency check unit 203, a generation unit 204, a model adjustment unit 205 and a presentation unit 206.
The structural schematic diagram of the electronic device shown in fig. 3 includes: processing device 301, read only memory 302, random access memory 303, bus 304, input/output interface 305, input device 306, output device 307, storage device 308, and communication device 309.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the disclosure are shown in the drawings, it is to be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be noted that, for convenience of description, only the portions related to the present invention are shown in the drawings. The embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a" or "an" in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will appreciate that references to "one or more" are intended to be exemplary and not limiting unless the context clearly indicates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Referring to fig. 1, a flow 100 of some embodiments of a method of visualization of an engineering project according to the present disclosure is shown. The visualization method of the engineering project comprises the following steps:
step 101, acquiring an image of an area corresponding to a target engineering project through target acquisition equipment to generate an area image group set.
In some embodiments, an executing subject (e.g., a computing device) of the visualization method for the engineering project may perform image acquisition on a region corresponding to the target engineering project through a target acquisition device to generate a region image group set. The target acquisition device may be a device having an image acquisition function. For example, the target acquisition device may be a synthetic aperture radar. The target engineering project can be an engineering project to be displayed in a three-dimensional visualization mode. For example, the target engineering project may be "bridge engineering project a". The regional image group comprises a plurality of images acquired by the target acquisition equipment at a plurality of angles at the same time.
Optionally, the target collecting device may be a target drone. The above-mentioned target unmanned aerial vehicle can include: a main camera and at least one side camera. Wherein a side camera of the at least one side camera is disposed around the main camera. The main camera and the at least one side camera shoot simultaneously.
In some optional implementation manners of some embodiments, the executing main body performs image acquisition on an area corresponding to the target engineering project through the target acquisition device to generate an area image group set, including:
and controlling the target acquisition equipment to move on a pre-planned flight track and controlling the main camera and the at least one side camera to carry out unmanned aerial vehicle oblique photography so as to obtain the regional image group set.
Wherein, the flight path can be generated by the following steps:
firstly, performing airspace level division on a region corresponding to the target engineering project to obtain a scanning layer set.
As an example, scanning the set of layers may include: a first scanning layer, a second scanning layer, and a third scanning layer. Wherein the altitude of the first scanning layer may be 10 meters. The elevation of the second scan layer may be 20 meters. The altitude of the third scanning layer may be 30 meters. The number of scanning layers in the scanning layer set can be designed according to the practical requirement. And is not limited thereto.
In a second step, for each of the scanning layer sets, the following processing steps are performed:
the first sub-step, when there is no obstacle in the scanning layer, the flying track is generated by means of bow-shaped scanning.
And a second substep of determining the flight trajectory by using an ant colony algorithm when the scanning layer has an obstacle.
The computing device may be hardware or software. When the computing device is hardware, it may be implemented as a distributed cluster composed of multiple servers or terminal devices, or may be implemented as a single server or a single terminal device. When the computing device is embodied as software, it may be installed in the hardware devices enumerated above. It may be implemented, for example, as multiple software or software modules to provide distributed services, or as a single software or software module. And is not particularly limited herein. It should be understood that the number of computing devices may have any number of computing devices, as desired for an implementation.
And 102, performing three-dimensional reconstruction on the region corresponding to the target engineering project according to the region image group set to generate a three-dimensional model corresponding to the target engineering project.
In some embodiments, the execution subject may perform three-dimensional reconstruction on the region corresponding to the target engineering project according to the region image group set to generate a three-dimensional model corresponding to the target engineering project.
As an example, the execution subject may perform BIM (Building Information Modeling) model construction on the area corresponding to the target engineering project according to the area image group set, so as to generate a three-dimensional model corresponding to the target engineering project.
Optionally, the execution main body may further perform BIM model construction on the area corresponding to the target engineering project according to the engineering project diagram corresponding to the target engineering project, so as to generate a three-dimensional model corresponding to the target engineering project.
And generating a three-dimensional model by adopting the engineering project diagram, wherein the generated three-dimensional model comprises each component corresponding to the target engineering project. The three-dimensional model can be associated with the items in a pre-constructed standard item library to generate a theoretical material plan corresponding to the target engineering project. Wherein the theoretical material plan represents theoretical material consumption of the target engineering project.
As an example, first, the constructor may display the three-dimensional model by opening a construction log. Then, the constructor can click on the member included in the three-dimensional model or click on a certain part of the member, input the completion ratio corresponding to the member or the certain part of the member, and automatically generate the material consumption corresponding to the member or the certain part of the member.
Through the method, firstly, the theoretical material plan corresponding to the engineering project can be automatically generated, and compared with a manual method, the theoretical material plan is generated according to the engineering project diagram, and the generation efficiency and accuracy of the theoretical material plan are greatly improved. In addition, the corresponding current material consumption can be automatically calculated in real time according to the three-dimensional model and the construction proportion corresponding to the member or a certain part of the member input by the constructor.
Optionally, the execution body may determine, according to the three-dimensional model, a construction amount corresponding to each of the constructions included in the three-dimensional model.
By the method, the engineering quantity can be quickly determined without consuming manpower.
In some optional implementation manners of some embodiments, the performing, by the execution main body, three-dimensionally reconstructing the region corresponding to the target engineering project according to the region image group set to generate the three-dimensional model corresponding to the target engineering project may include the following steps:
the method comprises the following steps of firstly, executing the following abnormal image removing steps for each region image group in the region image group set:
the first substep, carry on the unusual image detection to each regional picture in the above-mentioned regional picture group, in order to produce the image detection result.
The image detection result can represent whether the area image is abnormal or not. In practice, the image detection result may include: an anomaly identification value and an anomaly class. The abnormal identification value may represent whether the area image is abnormal. For example, when the region image is not abnormal, it may be characterized by an abnormal identification value of "0". When the area image is abnormal, it can be characterized by an abnormal identification value of "1". The anomaly class may characterize a particular anomaly class of the region image. In practice, the exception categories may include: out-of-focus, missing and repeating image content. The execution subject can perform abnormal image detection on the region image through a pre-trained convolutional neural network with multiple classification layers to generate an image detection result.
A second substep, in response to determining that there is a target region image in the region image group, eliminating the target region image from the region image group to generate a candidate region image group.
The target area image is an area image of which the corresponding image detection result represents image abnormality.
And secondly, performing image preprocessing on each candidate region image in the obtained candidate region image group set to generate a preprocessed image, so as to obtain a preprocessed image group set.
First, the execution subject may perform noise reduction processing on the candidate region image to generate a candidate region image after the noise reduction processing. Then, the executing body may perform sharpening processing on the candidate region image after noise reduction to generate a preprocessed image.
And thirdly, performing regional three-dimensional reconstruction according to the preprocessed image group set to generate the three-dimensional model.
And 103, carrying out consistency check on the three-dimensional model according to the engineering project diagram corresponding to the three-dimensional model.
In some embodiments, the execution subject may perform consistency check on the three-dimensional model according to an engineering project diagram corresponding to the three-dimensional model.
As an example, for each component in the three-dimensional model, the execution body may determine whether the current component parameter of the component satisfies a preset parameter corresponding to the component in the engineering project diagram. And when each component in the three-dimensional model meets the corresponding preset parameter, the three-dimensional model passes consistency check.
In some optional implementation manners of some embodiments, the performing, by the execution main body, consistency check on the three-dimensional model according to the engineering project drawing corresponding to the three-dimensional model may include the following steps:
for each component in the three-dimensional model described above, the following consistency check steps are performed:
firstly, extracting model surface feature points of a sub three-dimensional model corresponding to the member in the three-dimensional model to generate first feature point information, and obtaining a first feature point information set.
And the first characteristic point information in the first characteristic point information set represents the characteristic points of the surface of the sub three-dimensional model corresponding to the member. The executing body can perform model surface feature point extraction on the sub three-dimensional model corresponding to the component through the feature pyramid model to generate first feature point information.
And secondly, performing three-dimensional reconstruction on the component according to the component parameters of the component corresponding to the engineering project drawing to generate a three-dimensional simulation component.
And thirdly, extracting surface characteristic points of the three-dimensional simulation component to generate a second characteristic point information set.
The execution body may perform surface feature point extraction on the three-dimensional simulation component through the feature pyramid model to generate a second feature point information set.
And fourthly, determining the corresponding position of the component in the three-dimensional model to generate first position information.
Wherein the first location information comprises coordinates of at least one keypoint on the component in the three-dimensional model.
And fifthly, determining the corresponding position of the component in the engineering project drawing to generate second position information.
Wherein the second position information includes coordinates of at least one key point on the component in the engineering project drawing.
And sixthly, constructing a characteristic point vector for the first characteristic point information set to generate a first characteristic point vector.
The execution body may concatenate the first feature point information sets to generate the first feature point vector.
And seventhly, constructing a feature point vector for the second feature point information set to generate a second feature point vector.
The executing body may splice each second feature point information in the second feature point information set to generate the second feature vector.
And step eight, splicing the first characteristic point vector and the first position information to generate a first spliced vector.
And ninthly, splicing the second feature point vector and the second position information to generate a second spliced vector.
And step ten, determining the vector similarity of the first splicing vector and the second splicing vector to generate a sub-verification result.
The execution body may calculate cosine similarity between the first stitching vector and the second stitching vector as vector similarity. And when the vector similarity is greater than a preset threshold value, generating a sub-verification result for representing the normality of the component. And when the vector similarity is less than or equal to a preset threshold value, generating a sub-verification result representing the component abnormity.
The first step to the tenth step, which are an inventive point of the present disclosure, solve the second technical problem mentioned in the background art, that is, "when the engineering project includes many components, the detection efficiency is low because the abnormal component is detected manually". In actual conditions, larger engineering projects often contain more components, and the detection of abnormal construction is performed one by one in a manual mode, so that the detection efficiency is low, and the result of abnormal detection is influenced due to certain subjectivity of manual detection. Based on this, first, the present disclosure performs model surface feature point extraction on a sub three-dimensional model corresponding to a member to generate first feature point information. Then, surface feature point extraction is performed on the three-dimensional simulation component to generate a second feature point information set. In practical situations, the sub three-dimensional model and the three-dimensional simulation component are directly compared, when the construction is complex, the data quantity to be compared is large, and the detection efficiency is low. The subsequent data processing amount is reduced. Then, the corresponding positions of the components in the three-dimensional model are determined to generate first position information. Then, the corresponding position of the component in the engineering project drawing is determined to generate second position information. In practical situations, when a corresponding sub-three-dimensional model is constructed, problems such as mold penetration may exist, so that the position of a component is deviated, or the component is not constructed according to a corresponding engineering project diagram in a construction stage, so that the constructed position is deviated. Based on the method, the positions of the components in the three-dimensional model and the engineering project drawing are determined, so that whether the components have the problems of die penetration or construction which is not carried out according to the engineering project drawing is determined. Further, the first feature point vector and the first position information are spliced to generate a first spliced vector. And splicing the second characteristic point vector and the second position information to generate a second spliced vector. And finally, determining the vector similarity of the first splicing vector and the second splicing vector to generate a sub-verification result, and determining whether the member is consistent with the corresponding engineering project drawing or not in a similarity determination mode. By the method, manual participation is reduced, and the detection efficiency of abnormal construction is improved on the premise of reducing data processing amount.
And step 104, responding to the failure of consistency check, and generating an abnormal component information set.
In some embodiments, the execution principal may generate an exception component information set in response to failing the consistency check. The abnormal component information in the abnormal component information set is the component information corresponding to the component of which the corresponding vector similarity is greater than a preset threshold value.
As an example, when the obtained sub-verification result set has a sub-verification result representing the abnormal construction, the component information corresponding to the sub-verification result representing the abnormal construction is determined as abnormal component information, and an abnormal component information set is obtained.
And 105, performing model adjustment on the three-dimensional model according to the abnormal component information set to generate an adjusted three-dimensional model.
In some embodiments, the execution subject may perform model adjustment on the three-dimensional model according to the abnormal component information set to generate an adjusted three-dimensional model.
As an example, first, the execution main body may transmit the abnormal component information set to the information receiving end. The information receiving end can be a terminal for a model adjuster to adjust the three-dimensional model. Then, the model adjuster can inspect and adjust the component corresponding to the abnormal component information in the abnormal component information set to generate an adjusted three-dimensional model.
And 106, performing three-dimensional visual display on the adjusted three-dimensional model.
In some embodiments, the execution subject may perform three-dimensional visualization presentation on the adjusted three-dimensional model.
As an example, the execution subject may display the adjusted three-dimensional model in a three-dimensional visualization form in real time on an engineering project monitoring interface.
Optionally, the executing body may further execute the following processing steps:
firstly, carrying out equipment connection with target wearable equipment.
Wherein, above-mentioned target wearing equipment includes: virtual reality display device and virtual reality controlgear.
For example, the execution main body may be in device connection with the target wearable device by a wired manner, or may be in device connection with the target wearable device by any one of bluetooth, 3G/4G/5G, and a local area network.
And a second step of executing the following node marking processing steps in response to successful connection with the target wearable device:
the first substep is to obtain the control signal sent by the virtual reality control device.
The control signal may be a signal for adjusting a virtual picture displayed in the virtual reality display device.
And a second substep of adjusting the virtual image displayed in the virtual reality display device according to the control signal to realize the inspection of the adjusted three-dimensional model.
And a third substep, in response to receiving a marking signal sent by the virtual reality control device, marking nodes corresponding to the marking signal included in the adjusted three-dimensional model.
Optionally, in response to turning on the virtual driving mode, performing the following driving simulation processing steps:
the method comprises the steps of firstly, acquiring a virtual vehicle control signal sent by the virtual reality control equipment.
The virtual driving mode is a mode simulating a driving environment in the virtual reality display device. The virtual vehicle control signal may be a signal for controlling the virtual vehicle to adjust movement of the virtual vehicle within the virtual reality display device. The virtual vehicle control signal is a signal for controlling the virtual vehicle to move within the adjusted three-dimensional model.
And secondly, controlling the virtual vehicle in the virtual reality display equipment to move according to the virtual vehicle control signal, and adjusting the virtual picture displayed in the main view.
Firstly, through the target wearing equipment, simulation detection can be carried out on each construction contained in the engineering project through different angles. Aiming at the components with detection difficulty, the detection difficulty can be reduced. Furthermore, by adding a virtual driving pattern, it is possible to realize a simulated detection of an area such as a road surface at a driving angle. Compared with the method that the detection is carried out by directly entering the corresponding area of the engineering project, the detection efficiency is greatly improved.
The above embodiments of the present disclosure have the following beneficial effects: the construction safety of the engineering project is ensured through the visualization method of the engineering project of some embodiments of the disclosure. Specifically, the reason why the construction safety is low is that: three-dimensional visualization is carried out on the two-dimensional construction drawing, and abnormal components in actual construction projects cannot be effectively detected, so that the construction safety of engineering projects cannot be guaranteed. Based on this, according to the visualization method for the engineering project of some embodiments of the present disclosure, first, a target acquisition device acquires an image of a region corresponding to a target engineering project to generate a region image group set, where the region image group includes a plurality of images acquired by the target acquisition device at a plurality of angles at the same time. And acquiring actual construction images under a plurality of angles corresponding to the engineering project in an image acquisition mode. And then, according to the regional image group set, performing three-dimensional reconstruction on the region corresponding to the target engineering project to generate a three-dimensional model corresponding to the target engineering project. And generating an actual three-dimensional model corresponding to the target engineering project through three-dimensional reconstruction. And further, according to the engineering project diagram corresponding to the three-dimensional model, carrying out consistency check on the three-dimensional model. Thereby determining whether the actual engineering project corresponds to the corresponding engineering project map. Next, in response to failing the consistency check, an abnormal component information set is generated. When there is no agreement, the existence of an abnormal component is determined. Further, model adjustment is performed on the three-dimensional model based on the abnormal component information set to generate an adjusted three-dimensional model. And finally, carrying out three-dimensional visual display on the adjusted three-dimensional model. By the method, the abnormal components in the actual engineering project are effectively monitored, and the construction safety of the engineering project is ensured. Meanwhile, the three-dimensional model is displayed in a three-dimensional visualization mode, so that the current progress of the engineering project can be visually displayed, and the usability of the model is further improved.
With further reference to fig. 2, as an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of a visualization apparatus of an engineering project, which correspond to those of the method embodiments shown in fig. 1, and which may be applied in various electronic devices in particular.
As shown in fig. 2, a visualization device 200 of an engineering project of some embodiments includes: the system comprises an image acquisition unit 201, a three-dimensional reconstruction unit 202, a consistency check unit 203, a generation unit 204, a model adjustment unit 205 and a presentation unit 206. The image acquisition unit 201 is configured to acquire an image of an area corresponding to a target engineering project through a target acquisition device to generate an area image group set, where the area image group includes a plurality of images acquired by the target acquisition device at a plurality of angles at the same time; a three-dimensional reconstruction unit 202 configured to perform three-dimensional reconstruction on a region corresponding to the target engineering project according to the region image group set to generate a three-dimensional model corresponding to the target engineering project; a consistency checking unit 203 configured to perform consistency checking on the three-dimensional model according to the engineering project diagram corresponding to the three-dimensional model; a generating unit 204 configured to generate an abnormal component information set in response to failing to pass the consistency check; a model adjusting unit 205 configured to perform model adjustment on the three-dimensional model according to the abnormal component information set to generate an adjusted three-dimensional model; and a display unit 206 configured to perform three-dimensional visual display on the adjusted three-dimensional model.
It will be appreciated that the units described in the visualization means 200 of the engineering project correspond to the various steps in the method described with reference to fig. 1. Thus, the operations, features and advantages of the method described above are also applicable to the visualization apparatus 200 for engineering projects and the units included therein, and are not described herein again.
Referring now to FIG. 3, shown is a schematic block diagram of an electronic device 300 (e.g., a computing device) suitable for use in implementing some embodiments of the present disclosure. The electronic device shown in fig. 3 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 3, the electronic device 300 may include a processing means 301 (e.g., a central processing unit, a graphics processor, etc.) that may perform various appropriate actions and processes in accordance with a program stored in a read only memory 302 (ROM) or a program loaded from a storage means 308 into a random access memory 303 (RAM). In the random access memory 303, various programs and data necessary for the operation of the electronic apparatus 300 are also stored. The processing device 301, the read only memory 302 and the random access memory 303 are connected to each other via a bus 304. An input/output interface 305 is also connected to the bus 304.
Generally, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 307 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage devices 308 including, for example, magnetic tape, hard disk, etc.; and a communication device 309. The communication means 309 may allow the electronic device 300 to communicate wirelessly or by wire with other devices to exchange data. While fig. 3 illustrates an electronic device 300 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may be alternatively implemented or provided. Each block shown in fig. 3 may represent one device or may represent multiple devices, as desired.
In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flow diagrams may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program comprising program code for performing the method illustrated by the flow chart. In some such embodiments, the computer program may be downloaded and installed from a network through the communication device 309, or installed from the storage device 308, or installed from the read-only memory 302. The computer program, when executed by the processing apparatus 301, performs the above-described functions defined in the methods of some embodiments of the present disclosure.
It should be noted that the computer readable medium described in some embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (Hyper Text Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring images of a region corresponding to a target engineering project through target acquisition equipment to generate a region image group set, wherein the region image group comprises a plurality of images acquired by the target acquisition equipment at a plurality of angles at the same time; according to the regional image group set, performing three-dimensional reconstruction on a region corresponding to the target engineering project to generate a three-dimensional model corresponding to the target engineering project; carrying out consistency check on the three-dimensional model according to the engineering project diagram corresponding to the three-dimensional model; in response to failing to pass the consistency check, generating an abnormal component information set; performing model adjustment on the three-dimensional model according to the abnormal component information set to generate an adjusted three-dimensional model; and carrying out three-dimensional visual display on the adjusted three-dimensional model.
Computer program code for carrying out operations for embodiments of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in some embodiments of the present disclosure may be implemented by software, and may also be implemented by hardware. The described units may also be provided in a processor, and may be described as: a processor comprises an image acquisition unit, a three-dimensional reconstruction unit, a consistency check unit, a generation unit, a model adjustment unit and a display unit. The names of these units do not limit the unit itself in some cases, and for example, the three-dimensional reconstruction unit may also be described as "a unit that performs three-dimensional reconstruction on the region corresponding to the target engineering project according to the region image group set to generate a three-dimensional model corresponding to the target engineering project".
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), complex Programmable Logic Devices (CPLDs), and the like.
Some embodiments of the present disclosure also provide a computer program product comprising a computer program which, when executed by a processor, implements a method of visualizing any of the engineering projects described above.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention in the embodiments of the present disclosure is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is made without departing from the inventive concept as defined above. For example, the above features and (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure are mutually replaced to form the technical solution.
Claims (7)
1. A method for visualizing an engineering project, comprising: acquiring images of an area corresponding to a target engineering project through target acquisition equipment to generate an area image group set, wherein the area image group comprises a plurality of images acquired by the target acquisition equipment at a plurality of angles at the same time; according to the region image group set, performing three-dimensional reconstruction on a region corresponding to the target engineering project to generate a three-dimensional model corresponding to the target engineering project; according to the engineering project diagram corresponding to the three-dimensional model, carrying out consistency check on the three-dimensional model; in response to failing to pass the consistency check, generating an abnormal component information set; performing model adjustment on the three-dimensional model according to the abnormal component information set to generate an adjusted three-dimensional model; and carrying out three-dimensional visual display on the adjusted three-dimensional model.
2. The method of claim 1, wherein the target acquisition device is a target drone, the target drone comprising: a main camera and at least one side camera; and the image acquisition is carried out on the area corresponding to the target engineering project through the target acquisition equipment to generate an area image group set, and the method comprises the following steps: and controlling the target acquisition equipment to move on a pre-planned flight track, and controlling the main camera and the at least one side camera to carry out unmanned aerial vehicle oblique photography to obtain the regional image group set.
3. The method according to claim 2, wherein the three-dimensional reconstruction of the region corresponding to the target engineering project according to the set of region image groups to generate a three-dimensional model corresponding to the target engineering project comprises:
executing the following abnormal image eliminating steps for each region image group in the region image group set:
performing abnormal image detection on each region image in the region image group to generate an image detection result;
in response to determining that a target area image exists in the area image group, eliminating the target area image from the area image group to generate a candidate area image group, wherein the target area image is an area image of which the corresponding image detection result represents image abnormity; performing image preprocessing on each candidate region image in the obtained candidate region image group set to generate a preprocessed image, so as to obtain a preprocessed image group set; and performing regional three-dimensional reconstruction according to the preprocessed image group set to generate the three-dimensional model.
4. The method according to claim 3, wherein the performing consistency check on the three-dimensional model according to the engineering project drawing corresponding to the three-dimensional model comprises: for each member in the three-dimensional model, performing the following consistency-checking steps: extracting model surface feature points of a sub-three-dimensional model corresponding to the component in the three-dimensional model to generate first feature point information to obtain a first feature point information set; performing three-dimensional reconstruction on the component according to the component parameters corresponding to the component in the engineering project drawing to generate a three-dimensional simulation component; extracting surface feature points of the three-dimensional simulation component to generate a second feature point information set; determining a corresponding position of the member in the three-dimensional model to generate first position information; determining the corresponding position of the component in the engineering project drawing to generate second position information; constructing a characteristic point vector for the first characteristic point information set to generate a first characteristic point vector; constructing a feature point vector for the second feature point information set to generate a second feature point vector; splicing the first feature point vector and the first position information to generate a first spliced vector; splicing the second feature point vector and the second position information to generate a second spliced vector; and determining the vector similarity of the first splicing vector and the second splicing vector to generate a sub-verification result.
5. The method according to claim 3, wherein the performing consistency check on the three-dimensional model according to the engineering project drawing corresponding to the three-dimensional model comprises: for each member in the three-dimensional model, performing the following consistency-checking steps: extracting model surface feature points of a sub-three-dimensional model corresponding to the component in the three-dimensional model to generate first feature point information to obtain a first feature point information set; performing three-dimensional reconstruction on the component according to the component parameters corresponding to the component in the engineering project drawing to generate a three-dimensional simulation component; extracting surface feature points of the three-dimensional simulation component to generate a second feature point information set; determining a corresponding position of the member in the three-dimensional model to generate first position information; determining the corresponding position of the component in the engineering project drawing to generate second position information; constructing a feature point vector for the first feature point information set to generate a first feature point vector; constructing a feature point vector for the second feature point information set to generate a second feature point vector; splicing the first feature point vector and the first position information to generate a first spliced vector; splicing the second feature point vector and the second position information to generate a second spliced vector; and determining the vector similarity of the first splicing vector and the second splicing vector to generate a sub-verification result.
6. An electronic device, comprising: one or more processors; a storage device having one or more programs stored thereon; the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method recited in any of claims 1-4.
7. A computer-readable medium, on which a computer program is stored, wherein the program, when executed by a processor, implements the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211308993.XA CN115375855B (en) | 2022-10-25 | 2022-10-25 | Engineering project visualization method and device, electronic equipment and readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211308993.XA CN115375855B (en) | 2022-10-25 | 2022-10-25 | Engineering project visualization method and device, electronic equipment and readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115375855A true CN115375855A (en) | 2022-11-22 |
| CN115375855B CN115375855B (en) | 2023-01-10 |
Family
ID=84073632
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211308993.XA Active CN115375855B (en) | 2022-10-25 | 2022-10-25 | Engineering project visualization method and device, electronic equipment and readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115375855B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117575985A (en) * | 2024-01-19 | 2024-02-20 | 大连亚明汽车部件股份有限公司 | Method, device, equipment and medium for supervising casting of automobile parts |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107590444A (en) * | 2017-08-23 | 2018-01-16 | 深圳市易成自动驾驶技术有限公司 | Detection method, device and the storage medium of static-obstacle thing |
| CN111415388A (en) * | 2020-03-17 | 2020-07-14 | Oppo广东移动通信有限公司 | Visual positioning method and terminal |
| CN111598379A (en) * | 2020-03-31 | 2020-08-28 | 中铁建华南建设有限公司 | Project management method, platform, device, computer equipment and storage medium |
| CN112506900A (en) * | 2020-11-27 | 2021-03-16 | 中广核工程有限公司 | Method, device and equipment for checking three-dimensional data of ventilation pipe of nuclear power plant and storage medium |
| CN113033529A (en) * | 2021-05-27 | 2021-06-25 | 北京德风新征程科技有限公司 | Early warning method and device based on image recognition, electronic equipment and medium |
| CN113570704A (en) * | 2021-07-27 | 2021-10-29 | 江苏图创医疗科技有限公司 | Neural navigation auxiliary system based on 3D printing and visualization algorithm |
| CN113724391A (en) * | 2020-11-09 | 2021-11-30 | 北京沃东天骏信息技术有限公司 | Three-dimensional model construction method and device, electronic equipment and computer readable medium |
| CN114404039A (en) * | 2021-12-30 | 2022-04-29 | 华科精准（北京）医疗科技有限公司 | Tissue drift correction method and device for three-dimensional model, electronic equipment and storage medium |
| CN114913277A (en) * | 2022-05-30 | 2022-08-16 | 浙江浩瀚能源科技有限公司 | Method, device, equipment and medium for three-dimensional interactive display of object |
| CN115035250A (en) * | 2022-06-15 | 2022-09-09 | 薛志强医疗科技(上海)工作室 | Modeling graphic data information interaction processing method and system |
-
2022
- 2022-10-25 CN CN202211308993.XA patent/CN115375855B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107590444A (en) * | 2017-08-23 | 2018-01-16 | 深圳市易成自动驾驶技术有限公司 | Detection method, device and the storage medium of static-obstacle thing |
| CN111415388A (en) * | 2020-03-17 | 2020-07-14 | Oppo广东移动通信有限公司 | Visual positioning method and terminal |
| CN111598379A (en) * | 2020-03-31 | 2020-08-28 | 中铁建华南建设有限公司 | Project management method, platform, device, computer equipment and storage medium |
| CN113724391A (en) * | 2020-11-09 | 2021-11-30 | 北京沃东天骏信息技术有限公司 | Three-dimensional model construction method and device, electronic equipment and computer readable medium |
| CN112506900A (en) * | 2020-11-27 | 2021-03-16 | 中广核工程有限公司 | Method, device and equipment for checking three-dimensional data of ventilation pipe of nuclear power plant and storage medium |
| CN113033529A (en) * | 2021-05-27 | 2021-06-25 | 北京德风新征程科技有限公司 | Early warning method and device based on image recognition, electronic equipment and medium |
| CN113570704A (en) * | 2021-07-27 | 2021-10-29 | 江苏图创医疗科技有限公司 | Neural navigation auxiliary system based on 3D printing and visualization algorithm |
| CN114404039A (en) * | 2021-12-30 | 2022-04-29 | 华科精准（北京）医疗科技有限公司 | Tissue drift correction method and device for three-dimensional model, electronic equipment and storage medium |
| CN114913277A (en) * | 2022-05-30 | 2022-08-16 | 浙江浩瀚能源科技有限公司 | Method, device, equipment and medium for three-dimensional interactive display of object |
| CN115035250A (en) * | 2022-06-15 | 2022-09-09 | 薛志强医疗科技(上海)工作室 | Modeling graphic data information interaction processing method and system |
Non-Patent Citations (2)
| Title |
|---|
| 李涛: "宽幅钢箱梁顶推施工技术控制措施", 《四川水泥》 * |
| 高璇: "关于三维可视化技术在基建维修中的应用", 《信息系统工程》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117575985A (en) * | 2024-01-19 | 2024-02-20 | 大连亚明汽车部件股份有限公司 | Method, device, equipment and medium for supervising casting of automobile parts |
| CN117575985B (en) * | 2024-01-19 | 2024-06-04 | 大连亚明汽车部件股份有限公司 | Method, device, equipment and medium for supervising casting of automobile parts |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115375855B (en) | 2023-01-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111079619B (en) | Method and apparatus for detecting target object in image | |
| CN111598164B (en) | Method, device, electronic equipment and storage medium for identifying attribute of target object | |
| CN111414879B (en) | Face shielding degree identification method and device, electronic equipment and readable storage medium | |
| Agarwal | Review on application of augmented reality in civil engineering | |
| CN115631418A (en) | Image processing method, training method of nerve radiation field and neural network | |
| CN111578951B (en) | Method and device for generating information in automatic driving | |
| CN115375855B (en) | Engineering project visualization method and device, electronic equipment and readable medium | |
| CN115616937B (en) | Automatic driving simulation test method, device, equipment and computer readable medium | |
| CN112733820A (en) | Obstacle information generation method and device, electronic equipment and computer readable medium | |
| CN113408662A (en) | Image recognition method and device, and training method and device of image recognition model | |
| CN112699765A (en) | Method and device for evaluating visual positioning algorithm, electronic equipment and storage medium | |
| CN115082813A (en) | Detection method, unmanned aerial vehicle, detection system and medium | |
| CN111340015A (en) | Positioning method and device | |
| CN116738867B (en) | Unmanned aerial vehicle defense simulation method and system based on machine learning | |
| CN115620264B (en) | Vehicle positioning method and device, electronic equipment and computer readable medium | |
| CN111586295A (en) | Image generation method and device and electronic equipment | |
| EP4086853A2 (en) | Method and apparatus for generating object model, electronic device and storage medium | |
| CN115357500A (en) | Test method, device, equipment and medium for automatic driving system | |
| CN113438318B (en) | Performance test system and method of cloud control platform, electronic equipment and storage medium | |
| CN115575931A (en) | Calibration method, calibration device, electronic equipment and storage medium | |
| CN115578432A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| Wei et al. | [Retracted] Adoption of Convolutional Neural Network Algorithm Combined with Augmented Reality in Building Data Visualization and Intelligent Detection | |
| CN117726145B (en) | Cable inspection processing method and device, electronic equipment and computer readable medium | |
| CN110119721B (en) | Method and apparatus for processing information | |
| CN112580773A (en) | Method and apparatus for compressing deep learning models |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |