CN114972642A

CN114972642A - Method, apparatus, device and storage medium for three-dimensional modeling

Info

Publication number: CN114972642A
Application number: CN202210577206.5A
Authority: CN
Inventors: 方凯能
Original assignee: Beijing Youzhuju Network Technology Co Ltd
Current assignee: Beijing Youzhuju Network Technology Co Ltd
Priority date: 2022-05-25
Filing date: 2022-05-25
Publication date: 2022-08-30

Abstract

Embodiments in accordance with the present disclosure provide methods, apparatuses, devices, and storage media for three-dimensional modeling. The method described herein comprises: receiving an indication from the remote device that the three-dimensional model is not acceptable; based on the indication, obtaining update data for locally updating the three-dimensional model; and sending the update data and an indication of a modeling operation to be applied to the update data to a remote device for updating the three-dimensional model. In this way, local update or global update can be selectively performed on the three-dimensional model, and uploading of full data under the condition of local update is avoided, so that data transmission efficiency can be improved, and the model auditing process can be accelerated.

Description

Method, apparatus, device and storage medium for three-dimensional modeling

Technical Field

Example embodiments of the present disclosure relate generally to the field of computers and, more particularly, to methods, apparatuses, devices and computer-readable storage media for three-dimensional modeling.

Background

A panoramic model with spatial sense and depth sense can be constructed through technologies such as Virtual Reality (VR) and three-dimensional modeling. Such a model can bring an immersive experience and a sense of scene imminence to the user. The three-dimensional model manufacturing process may involve many links such as picture shooting, panoramic image splicing, feature estimation, semantic understanding, point cloud fusion, mapping and the like. After the production is finished and even the panoramic model product is on-line, problems of original data error, poor visual effect, or loss of characteristic tool marks and the like are sometimes encountered. This may require modification of the three-dimensional model.

Disclosure of Invention

In a first aspect of the disclosure, a method for three-dimensional modeling is provided. The method comprises the following steps: receiving an indication from the remote device that the three-dimensional model is not acceptable; based on the indication, obtaining update data for locally updating the three-dimensional model; and transmitting the update data and an indication of a modeling operation to be applied to the update data to a remote device for updating the three-dimensional model.

In a second aspect of the present disclosure, a method for three-dimensional modeling is provided. The method comprises the following steps: receiving, from a terminal device, update data for updating a three-dimensional model and an indication of a modeling operation to be applied to the update data; obtaining an updated portion of the three-dimensional model by applying the modeling operation to the update data; and updating the three-dimensional model by combining the updated portion with an original portion of the three-dimensional model that does not need to be updated.

In a third aspect of the present disclosure, an apparatus for three-dimensional modeling is provided. The device includes: an indication receiving module configured to receive an indication from a remote device that the three-dimensional model is ineligible; an obtaining module configured to obtain update data for locally updating the three-dimensional model based on the indication; and a transmitting module configured to transmit the update data and an indication of a modeling operation to be applied to the update data to a remote device for updating the three-dimensional model.

In a fourth aspect of the present disclosure, an apparatus for three-dimensional modeling is provided. The device includes: a data receiving module configured to receive, from a terminal device, update data for updating a three-dimensional model and an indication of a modeling operation to be applied to the update data; a modeling operation application module configured to obtain an updated portion of the three-dimensional model by applying a modeling operation to the update data; and a model update module configured to update the three-dimensional model by combining the updated portion with an original portion of the three-dimensional model that does not need to be updated.

In a fifth aspect of the present disclosure, an electronic device is provided. The apparatus comprises at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the electronic device to perform the method of the first aspect or the second aspect.

In a sixth aspect of the disclosure, a computer-readable storage medium is provided. The medium has stored thereon a computer program which, when executed by a processor, implements the method of the first or second aspect.

It should be understood that the statements herein set forth in this summary are not intended to limit the essential or critical features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like or similar reference characters designate like or similar elements, and wherein:

FIG. 1 illustrates a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

FIG. 2 illustrates an interaction diagram of a three-dimensional modeling process in accordance with some embodiments of the present disclosure;

FIGS. 3A and 3B illustrate schematic diagrams of user interfaces for three-dimensional modeling according to some embodiments of the present disclosure;

FIG. 4 illustrates a flow diagram of a process for three-dimensional modeling according to some embodiments of the present disclosure;

FIG. 5 illustrates a flow diagram of a process for three-dimensional modeling according to some embodiments of the present disclosure;

FIG. 6 illustrates a block diagram of an apparatus for three-dimensional modeling according to some embodiments of the present disclosure;

FIG. 7 illustrates a block diagram of an apparatus for three-dimensional modeling according to some embodiments of the present disclosure; and

fig. 8 illustrates a block diagram of a device capable of implementing various embodiments of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are illustrated in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

In describing embodiments of the present disclosure, the terms "include" and its derivatives should be interpreted as being inclusive, i.e., "including but not limited to. The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions are also possible below.

It will be appreciated that the data referred to in this disclosure, including but not limited to the data itself, the acquisition or use of the data, should comply with the requirements of the applicable laws and regulations and related regulations.

In the description of the embodiments of the present disclosure, the terms "first", "second", and the like are used merely for distinguishing between different elements, objects, targets, units, and do not imply an order or difference in time, space, priority of the elements, objects, targets, units.

It is understood that before the technical solutions disclosed in the embodiments of the present disclosure are used, the user should be informed of the type, the use range, the use scene, etc. of the personal information related to the present disclosure and obtain the authorization of the user through an appropriate manner according to the relevant laws and regulations.

For example, in response to receiving an active request from a user, a prompt message is sent to the user to explicitly prompt the user that the requested operation to be performed would require the acquisition and use of personal information to the user. Thus, the user can autonomously select whether to provide personal information to software or hardware such as an electronic device, an application program, a server, or a storage medium that performs the operations of the disclosed technical solution, according to the prompt information.

As an optional but non-limiting implementation manner, in response to receiving an active request of the user, the prompt information is sent to the user, for example, a pop-up window manner may be used, and the prompt information may be presented in a text manner in the pop-up window. In addition, a selection control for providing personal information to the electronic device by the user's selection of "agree" or "disagree" can be carried in the popup.

It is understood that the above notification and user authorization process is only illustrative and not limiting, and other ways of satisfying relevant laws and regulations may be applied to the implementation of the present disclosure.

Three-dimensional modeling is a technique widely used in real life, for example, in the medical industry for making precise models of organs or tissues, and in the movie and animation industry for creating avatars and scenes. Three-dimensional panoramic models can be constructed by combining three-dimensional modeling with VR technology. For example, in an application scenario of VR house watching, a user can obtain an experience similar to that of visiting a house by browsing a house panoramic model displayed on a line, and can further know the house type, layout structure, space utilization and the like.

The production of three-dimensional models usually involves numerous links and a large amount of computing resources, and after the production is completed, the three-dimensional models need to be audited to be formally on-line for users to use. In the traditional three-dimensional model modeling process, if the model is found to have defects or have poor presentation effect after being audited, a manufacturer needs to upload the full data of the model again to manufacture the model again until the audit is passed. However, in general, a defect in the model may only involve partial data in the full amount of data. For example, in the case of poor model roaming experience due to missing model point locations, the defect can be overcome by only supplementing or uploading pictures of part of point locations in a house for reproducing a part of the three-dimensional model. In this case, a large amount of redundant data must exist in the uploaded full amount of data. Due to the fact that the three-dimensional model is large in material and large in data volume, a large amount of time cost is generated when the full data are uploaded, and waste of storage resources is caused.

The embodiment of the disclosure provides a three-dimensional modeling scheme. According to the scheme, partial model data can be selectively uploaded according to problems existing in the three-dimensional model and related modeling steps. Furthermore, the approach also supports local updates of the three-dimensional model. In this way, wasted storage space due to repeated uploading of the full amount of data, and unnecessary time costs, can be avoided. In this way, the three-dimensional modeling efficiency can be improved, and the model auditing process can be accelerated.

Embodiments of the present disclosure will be described below in connection with a house modeling scenario. However, it should be understood that this application scenario is merely exemplary, and embodiments of the present disclosure are equally applicable to other scenarios, such as medical modeling scenarios or animation modeling scenarios, among others. Accordingly, the scope of embodiments of the present disclosure is not so limited.

FIG. 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. The example environment 100 includes

terminal devices

110 and 130 and a remote device 120. The terminal device 110 has an application 112 installed therein, and the user 102 can transmit data for producing or for updating the three-dimensional model to the remote device 120 through the application 112. The data used to make or update the three-dimensional model may include live-action images, three-dimensional modeling images, or composite images stitched from multiple live-action and/or modeling images, etc., and may be in any suitable format. In some embodiments, the image may be captured by terminal device 110 and provided to application 112. In other embodiments, the image may be from any other data source. Embodiments of the present disclosure are not limited in this respect.

Remote device 120 may be used to extend the storage and processing capabilities of

terminal devices

110 and 130.

Terminal devices

110 and 130 may communicate with remote device 120 to enable the generation and storage of three-dimensional models and the updating of model data. The remote device 120 may be various types of computing systems or servers capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in a cloud environment, and so forth. In the example environment 100 shown in fig. 1, the remote device 130 may be located in the cloud environment 122.

In some embodiments, remote device 120 may generate a three-dimensional model by applying at least one modeling operation based on model data uploaded by terminal device 110. Modeling operations may include, but are not limited to, panorama stitching, feature point extraction, semantic understanding, point cloud fusion, charting, and the like.

In some embodiments, remote device 120 may update at least a portion of the three-dimensional model based on the indication of terminal device 110. For example, the indication may indicate a modeling operation to be applied to the update data. The updating mode of the three-dimensional model can comprise global updating and local updating.

In some embodiments, the remote device 120 may store model data for one or more three-dimensional models and utilize a model identification (e.g., VRID) to identify model data for different three-dimensional models. Additionally or alternatively, in some embodiments, the remote device 120 may store multiple versions of the same three-dimensional model of model data, e.g., one or more historical versions and a current version of the model data.

The remote device 120 may transmit the finished or updated three-dimensional model to the terminal device 130. The terminal device 130 is provided with an auditing system 132 for auditing the three-dimensional model, so that an auditor can audit the three-dimensional model uploaded by the terminal device 110, and an auditing result is returned to the terminal device 110 via the remote device 120. In some embodiments, the auditor may use the auditing system 132 to mark the defects existing in the three-dimensional model that make the three-dimensional model unable to pass the audit, and return the results of the audit to the terminal device 110. In embodiments of the present disclosure, the indicia may take various forms, including, but not limited to, text, speech, and the like.

Accordingly, after receiving the unqualified audit result, the terminal device 110 may obtain the update data of the three-dimensional model based on the marked defect. As previously described, the terminal device 110 may transmit the update data and the indication of the modeling operation to the remote device 120 to update at least a portion of the three-dimensional model, as will be discussed in detail below.

It should be understood that the description of the structure and function of environment 100 is for exemplary purposes only and does not imply any limitation as to the scope of the disclosure.

Embodiments will be described in the following description with reference to several example states of a User Interface (UI). It should be understood that these UIs and interactions are merely illustrative and that a variety of interface designs and interaction styles may exist in practice. Additionally, the controls included in these UIs may be implemented using any currently known or later developed UI elements and techniques. Further, the type, form, manner of operation, layout, arrangement in the UI, etc. of these controls are illustrative and not intended to limit the scope of the present disclosure in any way.

FIG. 2 illustrates an interaction diagram of a three-dimensional modeling process 200 according to some embodiments of the present disclosure. Process 200 may involve terminal device 110, remote device 120, and terminal device 130 shown in fig. 1. Of course, process 200 may involve any other suitable device. For ease of discussion, the process 200 will be described with reference to the environment 100 of fig. 1 in conjunction with fig. 3A and 3B.

In process 200, terminal device 110 may send (202) model data for fabricating a three-dimensional model to remote device 120. The model data of the three-dimensional model may be identified by a model identification, such as a VRID. Remote device 120 may generate (204) a three-dimensional model based on the model data and send (206) to terminal device 130. In some embodiments, model data for the three-dimensional model may be stored in the remote device 120.

The terminal device 130 may perform an audit (208) on the three-dimensional model. If the three-dimensional model is not found to have defects or problems after the examination, the terminal device 130 returns an indication that the three-dimensional model is qualified. Conversely, if a defect is found in the three-dimensional model or the rendering is not effective, the terminal device 130 may send (210) an indication that the three-dimensional model is not acceptable to the remote device 120. By way of example, defects or problems in the three-dimensional model of the house may include, but are not limited to, missing features such as double mirrors, glass doors, etc., un-cropping of excess portions of the model, missing model point locations, misalignment due to point location data, height setting errors between floors, stair point location attribution errors, etc.

In some embodiments, the remote device 120 may store the indication in association with model data of the three-dimensional model.

After receiving the review result from the terminal device 130, the remote device 120 sends (212) an indication to the terminal device 110 that the three-dimensional model is not acceptable. In some embodiments, the indication may contain information relating to at least one of: the registration of the three-dimensional model is not aligned, the point location of the three-dimensional model is missing, the height of the three-dimensional model is set wrongly, the feature data of the three-dimensional model is omitted, the quality of the generated image of the three-dimensional model is poor, and the like.

Based on the indication, terminal device 110 may obtain (214) update data for locally updating the three-dimensional model. In the context of the present disclosure, global updating refers to regenerating a three-dimensional model by applying all modeling operations to the full amount of data of the three-dimensional model. Local updating refers to applying at least one modeling operation to a portion of data of a three-dimensional model to obtain an updated portion of the three-dimensional model. In the case of a local update, the remote device 120 further updates the three-dimensional model by combining the updated portion with the original portion of the three-dimensional model that does not need to be updated.

In some embodiments, the terminal device 110 may obtain the update data by taking at least one image required to locally update the three-dimensional model. Additionally or alternatively, in other embodiments, the update data may also come from any other data source.

As an example implementation of act 208, terminal device 110 may present an indication received from remote device 120 that the three-dimensional model is ineligible. Accordingly, in response to receiving a user input to locally update the three-dimensional model, terminal device 110 may obtain update data for the local update.

Fig. 3A illustrates a schematic diagram of a user interface 300 for three-dimensional modeling, according to some embodiments of the present disclosure. By way of example, user interface 300 may be a user interface in which application 112 presents an indication to user 102 that the three-dimensional model is disqualified. As shown in FIG. 3A, user interface 300 includes regions 310-330 and controls 340 and 342. Area 310 is used to present the model name "A House" and the model identification "VRID: 301" of the three-dimensional model. Region 320 is used to present information about model audits, such as the time of submission of the three-dimensional model, the results of the audit, and job progress, among others.

The area 330 is used for presenting the reason for the failure of the three-dimensional model, i.e. an indication that the three-dimensional model is not acceptable, and includes a model thumbnail 331 with a graphic mark and a text mark 332. It should be understood that the indication shown in fig. 3A is merely exemplary, and in other embodiments the indication may also include a voice tag or any other form of tag.

Control 340 is illustrated as a "re-upload" control that may be activated for uploading updated data of the three-dimensional model. Control 342 is shown as an "exit" control that can be activated for exiting from a current interface and, optionally, for returning to a previous interface.

In some embodiments, the user 102 may determine whether a global update or a local update to the three-dimensional model is needed based on the indication. In the example of fig. 3A, user 102 determines that the deficiencies indicated by

indications

331 and 332 can be ameliorated by retaking and uploading bedroom and living room pictures and applying a modeling step, such as feature tool addition, based on these pictures. In this case, the user 102 may activate the control 340 to upload the updated data of the three-dimensional model.

In response to control 340 being activated, terminal device 110 switches user interface 300 to user interface 400 as shown in FIG. 3B. As shown in FIG. 3B, in the user interface 400, a region 410 is used to present the model name "A House" and the model identification "VRID: 301" of the three-dimensional model. Region 420 includes a set of radio controls 421 for receiving user input for the manner in which the model is updated. As previously described, since in the example of FIG. 3A, the three-dimensional model is flawed by being locally updated, user 102 activates radio control 421 "local update".

Additionally or alternatively, in some embodiments, terminal device 110 may determine whether a global update or a local update to the three-dimensional model is needed based on an indication received from remote device 120. In other words, in such embodiments, terminal device 110 may determine the model update mode without user input.

For example, the indication sent by the remote device 120 indicates that there is a defect in the three-dimensional model that a stair location attribution error exists, which is typically caused by a wrong allocation of a stair belonging to a low floor to a high floor. In this case, terminal device 110 may determine, based on the indication, that applying only a local update to the stair point location data of the three-dimensional model may ameliorate the defect. As another example, the indication sent by the remote device 120 indicates that there are defects in the three-dimensional model where specular features are missing, resulting in poor rendering. In this case, the terminal device 110 may determine to add a feature tool for the specular feature data based on the indication, and re-perform a modeling operation such as point cloud fusion to ameliorate the defect.

Thus, in practice, the model update mode may be selected by the user 102 or determined directly by the terminal device 110, depending on the indicated type of defect, the number of defects and/or the presettings.

Referring back to FIG. 3B, user 102 can upload update data for locally updating the three-dimensional model by activating

controls

431 and 434. In the example of fig. 3B, the update data includes a bedroom picture 430 and a living room picture 433. In some embodiments, the user 102 may also delete the uploaded update data by activating

controls

432 and 435.

In some embodiments, user 102 can select, via control 442, a modeling operation to be applied to the corresponding update data for an indication that the three-dimensional model shown in area 440 is not acceptable.

User interface 400 also includes

controls

450 and 452. Control 450 is shown as an "upload" control that can be activated for sending updated data and indications of modeling operations to remote device 120. Control 452 is shown as a "back" control that can be activated for exiting from a current interface and returning to a previous interface.

As shown in fig. 3B, by triggering control 450, terminal device 110 sends (216) the update data and an indication of the modeling operation to be applied to the update data to remote device 120 for updating the three-dimensional model. Additionally, in some embodiments, terminal device 110 may send an identification for the three-dimensional model to be updated to remote device 120. Based on the identification of the three-dimensional model, the remote device 120 may distinguish model data of the plurality of three-dimensional models and enable updating of the plurality of three-dimensional models. An example format for the update data and the indication of the modeling operation is shown below, although other formats are possible, and the scope of the present disclosure is not limited in this respect.

Upon receiving the update data and the indication of the modeling operation, the remote device 120 obtains (218) an updated portion of the three-dimensional model by applying the modeling operation to the update data. For example, in the example of fig. 3A and 3B, the remote device 120 may add a feature tool to the bedroom picture 430 and the living room picture 433 to obtain an updated portion of the three-dimensional model.

The remote device 120 updates (220) the three-dimensional model by combining the updated portion with the original portion of the three-dimensional model that does not need to be updated. As previously described, the remote device 120 has model data for the three-dimensional model stored therein. Accordingly, in some embodiments, the remote device 120 may determine the original portions of the three-dimensional model that do not need to be updated based on the update data and the indication of the modeling operation.

In some embodiments, the remote device 120 may send (222) the updated three-dimensional model to the terminal device 130 for further review. If the presence of defects in the three-dimensional model is found to have improved after the audit, the terminal device 130 may return an indication that the three-dimensional model is qualified. Conversely, if a defect or poor rendering is found to still exist in the three-dimensional model, actions similar to actions 210 through 222 may be performed until the audit is passed.

It should be appreciated that the acts indicated in dashed lines in process 200 may be optional acts, and that process 200 may include other acts not shown in fig. 2. Moreover, the order of execution of the actions in process 200 is merely exemplary. In practical applications, different execution orders may be adopted according to the interaction order of the user and the application, the interface design and the control function, and the scope of the present disclosure is not limited in this respect.

According to the embodiment of the disclosure, the three-dimensional model can be selectively updated locally or globally according to the indication that the three-dimensional model is unqualified, and the uploading of the full amount of data under the condition of local updating is avoided. Therefore, the data uploading efficiency can be improved, the system storage space is saved, and the model auditing process is accelerated.

FIG. 4 illustrates a flow diagram of a process 400 for three-dimensional modeling according to some embodiments of the present disclosure. Process 400 may be implemented at terminal device 110 or any suitable device. For ease of discussion, process 400 will be described with reference to environment 100 of fig. 1.

In block 410, the terminal device 110 receives an indication from the remote device 120 that the three-dimensional model is not acceptable.

In some embodiments, the indication that the three-dimensional model is unacceptable comprises information relating to at least one of: the registration of the three-dimensional model is not aligned, the point location of the three-dimensional model is missing, the height setting of the three-dimensional model is wrong, the characteristic data of the three-dimensional model is missing, the image quality for generating the three-dimensional model is poor, and the like.

In block 420, terminal device 110 obtains update data for locally updating the three-dimensional model based on the indication. In some embodiments, terminal device 110 may take at least one image needed to locally update the three-dimensional model. In other embodiments, terminal device 110 may obtain at least one image needed to update the three-dimensional model from other sources.

In some embodiments, terminal device 110 may present an indication received from remote device 120 that the three-dimensional model is ineligible. Accordingly, the user 102 may determine whether a local update or a global update is needed based on the indication. In such embodiments, terminal device 110 may obtain update data for the local update in response to receiving user input to locally update the three-dimensional model.

In block 430, the terminal device 110 sends the update data and an indication of the modeling operation to be applied to the update data to the remote device 120 for updating the three-dimensional model.

In some embodiments, terminal device 110 may send an identification for the three-dimensional model to be updated to remote device 120. Based on the identification of the three-dimensional model, the remote device 120 may distinguish and process model data of different three-dimensional models.

In some embodiments, the modeling operation may include one or more of: panorama stitching, feature point extraction, feature tool addition, semantic understanding, point cloud fusion, mapping and the like. Of course, the modeling operations may also include other suitable operations. Embodiments of the present disclosure are not limited in this respect.

According to the embodiment of the disclosure, the updating data can be selectively uploaded and the model can be locally updated according to the reason causing the three-dimensional model to be unqualified. Therefore, redundant data can be prevented from being repeatedly uploaded, the uploading efficiency is improved, and the storage space is saved. In addition, the model auditing process can be accelerated, and the model manufacturing cost can be reduced.

Fig. 5 illustrates a flow diagram of a process 500 for three-dimensional modeling according to some embodiments of the present disclosure. Process 500 may be implemented at remote device 120 or any suitable device. For ease of discussion, the process 500 will be described with reference to the environment 100 of fig. 1.

In block 510, the remote device 120 receives from the terminal device 110 update data for updating the three-dimensional model and an indication of a modeling operation to be applied to the update data.

In some embodiments, remote device 120 may receive an identification for a three-dimensional model to be updated from terminal device 110. Based on the identification of the three-dimensional model, the remote device 120 may distinguish and process model data of different three-dimensional models.

In some embodiments, updating the data may include updating at least one image required by the three-dimensional model.

In block 520, the remote device 120 obtains an updated portion of the three-dimensional model by applying the modeling operation to the update data.

In some embodiments, the modeling operation may include one or more of: panorama stitching, feature point extraction, feature tool addition, semantic understanding, point cloud fusion, mapping and the like.

In block 530, the remote device 120 updates the three-dimensional model by combining the updated portion with the original portion of the three-dimensional model that does not require updating.

In some embodiments, the remote device 120 has model data for the three-dimensional model stored therein. In such embodiments, the remote device 120 may determine the original portions of the model that do not need to be updated based on the updated data of the three-dimensional model and the indication of the modeling operation.

In some embodiments, the remote device 120 may send the updated three-dimensional model to the terminal device 130 for review.

According to the embodiment of the present disclosure, the model can be locally updated with the update data according to the defects existing in the three-dimensional model. Therefore, the storage space can be saved, and the model making process is simplified. In addition, the model auditing process can be accelerated, and the model manufacturing cost can be reduced.

FIG. 6 illustrates a schematic block diagram of an apparatus 600 for three-dimensional modeling, in accordance with certain embodiments of the present disclosure. Apparatus 600 may be implemented as or included in terminal device 110. The various modules/components in apparatus 600 may be implemented by hardware, software, firmware, or any combination thereof.

As shown, the apparatus 600 includes: an indication receiving module 610 configured to receive an indication from a remote device that the three-dimensional model is ineligible; an obtaining module 620 configured to obtain, based on the indication, update data for locally updating the three-dimensional model; and a sending module 630 configured to send the update data and an indication of a modeling operation to be applied to the update data to a remote device for updating the three-dimensional model.

In some embodiments, the obtaining module 620 further comprises: an indication presentation module configured to present an indication received from a remote device that the three-dimensional model is ineligible; and an update data acquisition module configured to acquire update data for a local update of the three-dimensional model in response to receiving a user input to locally update the three-dimensional model.

In some embodiments, the indication that the three-dimensional model is unacceptable comprises information relating to at least one of: the registration of the three-dimensional model is not aligned, the point position of the three-dimensional model is lost, the height of the three-dimensional model is set wrongly, the characteristic data of the three-dimensional model is omitted, and the image quality for generating the three-dimensional model is poor.

In some embodiments, the apparatus 600 further comprises: an identity sending module configured to send an identity for the three-dimensional model to be updated to a remote device.

In some embodiments, the obtaining module 620 includes: an image capturing module configured to capture at least one image required to locally update the three-dimensional model.

In some embodiments, the modeling operation includes one or more of: panorama stitching, feature point extraction, feature tool addition, semantic understanding, point cloud fusion and mapping.

FIG. 7 illustrates a schematic block diagram of an apparatus 700 for three-dimensional modeling, in accordance with certain embodiments of the present disclosure. The apparatus 700 may be embodied as or included in a remote device 120. The various modules/components in the apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

As shown, the apparatus 700 includes: a data receiving module 710 configured to receive, from a terminal device, update data for updating a three-dimensional model and an indication of a modeling operation to be applied to the update data; a modeling operation application module 720 configured to obtain an updated portion of the three-dimensional model by applying a modeling operation to the update data; and a model update module 730 configured to update the three-dimensional model by combining the updated portion with an original portion of the three-dimensional model that does not need to be updated.

In some embodiments, the apparatus 700 further comprises: an identity receiving module configured to receive an identity for a three-dimensional model to be updated from a terminal device.

In some embodiments, the model update module 730 is configured to update at least one image required for the three-dimensional model.

In some embodiments, the user marks a feature indicating the region or is associated with a problem or defect that renders the image non-auditable.

FIG. 800 illustrates a block diagram that shows a computing device 800 in which one or more embodiments of the disclosure may be implemented. It should be understood that the computing device 800 illustrated in FIG. 8 is merely exemplary and should not be construed as limiting in any way the functionality and scope of the embodiments described herein. Computing device 800 shown in fig. 8 may be used to implement terminal device 110 or remote device 120 of fig. 1.

As shown in fig. 8, computing device 800 is in the form of a general purpose computing device. Components of computing device 800 may include, but are not limited to, one or more processors or processing units 810, memory 820, storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. The processing unit 810 may be a real or virtual processor and can perform various processes according to programs stored in the memory 820. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capabilities of computing device 800.

Computing device 800 typically includes a number of computer storage media. Such media may be any available media that is accessible by computing device 800 and includes, but is not limited to, volatile and non-volatile media, removable and non-removable media. The memory 820 may be volatile memory (e.g., registers, cache, Random Access Memory (RAM)), non-volatile memory (e.g., Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory), or some combination thereof. Storage device 830 may be a removable or non-removable medium and may include a machine-readable medium, such as a flash drive, a magnetic disk, or any other medium that may be capable of being used to store information and/or data (e.g., training data for training) and that may be accessed within computing device 800.

The computing device 800 may further include additional removable/non-removable, volatile/nonvolatile storage media. Although not shown in FIG. 8, a magnetic disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. Memory 820 may include a computer program product 825 having one or more program modules configured to perform the various methods or acts of the various embodiments of the disclosure.

Communication unit 840 enables communication with other computing devices over a communication medium. Additionally, the functionality of the components of computing device 800 may be implemented in a single computing cluster or multiple computing machines, which are capable of communicating over a communications connection. Thus, computing device 800 may operate in a networked environment using logical connections to one or more other servers, network Personal Computers (PCs), or another network node.

Input device 850 may be one or more input devices such as a mouse, keyboard, trackball, or the like. The output device(s) 860 may be one or more output devices such as a display, speakers, printer, or the like. Computing device 800 can also communicate with one or more external devices (not shown), such as storage devices, display devices, etc., communication with one or more devices that enable a user to interact with computing device 800, or communication with any devices (e.g., network cards, modems, etc.) that enable computing device 800 to communicate with one or more other computing devices, as desired, via communication unit 840. Such communication may be performed via input/output (I/O) interfaces (not shown).

According to an exemplary implementation of the present disclosure, a computer-readable storage medium having stored thereon computer-executable instructions is provided, wherein the computer-executable instructions are executed by a processor to implement the above-described method. According to an exemplary implementation of the present disclosure, there is also provided a computer program product, tangibly stored on a non-transitory computer-readable medium and comprising computer-executable instructions, which are executed by a processor to implement the method described above.

Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus, devices and computer program products implemented in accordance with the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

These computer-readable program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various implementations of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The foregoing has described implementations of the present disclosure, and the above description is illustrative, not exhaustive, and not limited to the implementations disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The terminology used herein was chosen in order to best explain the principles of various implementations, the practical application, or improvements to the technology in the marketplace, or to enable others of ordinary skill in the art to understand various implementations disclosed herein.

Claims

1. A method for three-dimensional modeling, comprising:

receiving an indication from the remote device that the three-dimensional model is not acceptable;

based on the indication, obtaining update data for locally updating the three-dimensional model; and

sending the update data and an indication of a modeling operation to be applied to the update data to the remote device for updating the three-dimensional model.

2. The method of claim 1, wherein obtaining update data for locally updating the three-dimensional model based on the indication comprises:

presenting the indication received from the remote device that the three-dimensional model is not acceptable; and

in response to receiving user input to perform the local update to the three-dimensional model, obtaining the update data for the local update.

3. The method of claim 1, wherein the indication that the three-dimensional model fails comprises information relating to at least one of:

the registration of the three-dimensional model is not aligned,

the point locations of the three-dimensional model are missing,

the height of the three-dimensional model is set incorrectly,

the characteristic data of the three-dimensional model is missing,

the image quality used to generate the three-dimensional model is poor.

4. The method of claim 1, further comprising:

sending an identification for the three-dimensional model to be updated to the remote device.

5. The method of claim 1, wherein obtaining the update data comprises:

at least one image is taken that is needed to locally update the three-dimensional model.

6. The method of claim 1, wherein the modeling operation comprises one or more of: panorama stitching, feature point extraction, feature tool addition, semantic understanding, point cloud fusion and mapping.

7. A method for three-dimensional modeling, comprising:

receiving, from a terminal device, update data for updating a three-dimensional model and an indication of a modeling operation to be applied to the update data;

obtaining an updated portion of the three-dimensional model by applying the modeling operation to the update data; and

updating the three-dimensional model by combining the updated portion with an original portion of the three-dimensional model that does not need to be updated.

8. The method of claim 7, further comprising:

receiving, from the terminal device, an identification for the three-dimensional model to be updated.

9. The method of claim 7, wherein the update data comprises at least one image required to update the three-dimensional model.

10. The method of claim 7, wherein the modeling operation comprises one or more of: panorama stitching, feature point extraction, feature tool addition, semantic understanding, point cloud fusion and mapping.

11. An apparatus for three-dimensional modeling, comprising:

an indication receiving module configured to receive an indication from a remote device that the three-dimensional model is ineligible;

an obtaining module configured to obtain update data for locally updating the three-dimensional model based on the indication; and

a sending module configured to send the update data and an indication of a modeling operation to be applied to the update data to the remote device for updating the three-dimensional model.

12. The apparatus of claim 11, wherein the obtaining module further comprises:

an indication presentation module configured to present the indication received from the remote device indicating that the three-dimensional model is ineligible; and

an update data acquisition module configured to acquire the update data for the local update of the three-dimensional model in response to receiving a user input to perform the local update on the three-dimensional model.

13. The apparatus of claim 11, wherein the indication that the three-dimensional model is disqualified comprises information relating to at least one of:

the registration of the three-dimensional model is not aligned,

the point locations of the three-dimensional model are missing,

the height of the three-dimensional model is set incorrectly,

the characteristic data of the three-dimensional model is missing,

the image quality used to generate the three-dimensional model is poor.

14. The apparatus of claim 11, wherein the apparatus further comprises:

an identification sending module configured to send an identification for the three-dimensional model to be updated to the remote device.

15. An apparatus for three-dimensional modeling, comprising:

a data receiving module configured to receive, from a terminal device, update data for updating a three-dimensional model and an indication of a modeling operation to be applied to the update data;

a modeling operation application module configured to obtain an updated portion of the three-dimensional model by applying the modeling operation to the update data; and

a model update module configured to update the three-dimensional model by combining the updated portion with an original portion of the three-dimensional model that does not need to be updated.

16. The apparatus of claim 15, wherein the apparatus further comprises:

an identity receiving module configured to receive from the terminal device an identity for the three-dimensional model to be updated.

17. The apparatus of claim 15, wherein the update data comprises at least one image required to update the three-dimensional model.

18. The apparatus of claim 15, wherein the modeling operation comprises one or more of: panorama stitching, feature point extraction, feature tool addition, semantic understanding, point cloud fusion and mapping.

19. An electronic device, comprising:

at least one processing unit; and

at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions when executed by the at least one processing unit causing the electronic device to perform the method of any of claims 1-6 or claims 7-10.

20. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 6 or 7 to 10.