CN116597099B

CN116597099B - Three-dimensional model reconstruction method and system based on video stream

Info

Publication number: CN116597099B
Application number: CN202310869545.5A
Authority: CN
Inventors: 林钦松; 徐俊; 陈兰
Original assignee: Xinzhi Technology Jiangsu Co ltd
Current assignee: Xinzhi Technology Jiangsu Co ltd
Priority date: 2023-07-17
Filing date: 2023-07-17
Publication date: 2023-09-22
Anticipated expiration: 2043-07-17
Also published as: CN116597099A

Abstract

The invention provides a three-dimensional model reconstruction method and a system based on video streaming, which are used for acquiring a floor sub-node sequence corresponding to each floor modeling end and generating a first serial number corresponding to each floor sub-node sequence based on floor information; acquiring assembly sub-node sequences corresponding to all assembly modeling ends, and generating second sequence numbers corresponding to all assembly sub-node sequences based on the corresponding first sequence numbers; sequencing the floor sub-node sequence and the assembly sub-node sequence based on a sequence sequencing strategy, a first sequence number and a second sequence number to obtain a modeling total sequence of the corresponding target three-dimensional model; and receiving an elimination node of the target three-dimensional model by a user based on an elimination strategy, updating the target three-dimensional model according to the elimination node to obtain an elimination three-dimensional model, calling a corresponding construction node based on an elimination node sequence, and reconstructing the elimination three-dimensional model based on the construction node to obtain a reconstructed three-dimensional model and a video stream corresponding to the reconstructed three-dimensional model.

Description

Three-dimensional model reconstruction method and system based on video stream

Technical Field

The present invention relates to data processing technologies, and in particular, to a method and system for reconstructing a three-dimensional model based on a video stream.

Background

With the development of modern technology, three-dimensional model reconstruction technology is widely applied in a plurality of fields such as smart cities, buildings, industrial measurement and the like, wherein floor buildings are used as a part of people in a life-related manner, three-dimensional modeling technology of the floor buildings is paid attention to, and how to model floor building three-dimensional models with complex forms is a popular problem of current people research.

At present, when modeling a complex three-dimensional model of a floor building, a plurality of scattered units are often obtained by collaborative modeling of a plurality of people, and then the plurality of scattered units are spliced to form the complex three-dimensional model of the floor building. In the prior art, when a user has a requirement of reproducing and modeling a three-dimensional model, the modeling sequence among multiple persons is disordered due to the modeling of multiple persons, so that ordered reproduction cannot be realized, and the requirement of the user cannot be met.

Therefore, how to sequentially reconstruct and display the corresponding reproduction model in combination with the reproduction demand data of the user becomes a problem to be solved in the present day.

Disclosure of Invention

The embodiment of the invention provides a three-dimensional model reconstruction method and a three-dimensional model reconstruction system based on video streams, which can be used for orderly reconstructing and displaying corresponding reproduction models by combining reproduction demand data of users.

In a first aspect of an embodiment of the present invention, a method for reconstructing a three-dimensional model based on a video stream is provided, including:

splitting model planning data according to floor information to obtain a plurality of sub-planning data corresponding to the floor information, determining a floor modeling end corresponding to each sub-planning data, receiving a plurality of construction nodes input by each floor modeling end, sequencing the construction nodes based on construction time to generate a floor sub-node sequence, and generating a first serial number corresponding to each floor sub-node sequence based on the floor information;

responding to the completion information of the floor modeling end corresponding to the adjacent floor information, generating assembly planning data, determining an assembly modeling end corresponding to the assembly planning data, receiving a plurality of construction nodes input by each assembly modeling end, sequencing the construction nodes based on construction time to generate an assembly sub-node sequence, and generating a second sequence corresponding to each assembly sub-node sequence based on the corresponding first sequence;

generating a target three-dimensional model according to the building nodes corresponding to the floor sub-node sequences and the assembly sub-node sequences, and sorting the floor sub-node sequences and the assembly sub-node sequences based on a sequence sorting strategy, a first sequence and a second sequence to obtain a modeling total sequence corresponding to the target three-dimensional model;

Receiving elimination data of a user on the target three-dimensional model based on an elimination strategy, updating the target three-dimensional model according to the elimination data to obtain an elimination three-dimensional model, acquiring construction nodes corresponding to the elimination data to generate an elimination node set, and sorting the elimination node set based on the modeling total sequence to obtain an elimination node sequence;

and calling a corresponding construction node based on the elimination node sequence, and reconstructing the elimination three-dimensional model based on the construction node to obtain a reconstructed three-dimensional model and a video stream corresponding to the reconstructed three-dimensional model.

Optionally, in one possible implementation manner of the first aspect, receiving a plurality of building nodes input by each floor modeling end, sorting the plurality of building nodes based on building time to generate a floor sub-node sequence, and generating, based on the floor information, a first serial number corresponding to each floor sub-node sequence, including:

receiving a plurality of construction nodes input by each floor modeling end, and sequencing the plurality of construction nodes based on the sequence of the construction time to generate a floor sub-node sequence;

and constructing a first numbered slot for each floor sub-node sequence, and filling corresponding floor serial numbers in the first numbered slot corresponding to each floor sub-node sequence according to the floor information to obtain the first serial numbers corresponding to each floor sub-node sequence.

Optionally, in one possible implementation manner of the first aspect, receiving a plurality of construction nodes input by each assembly modeling end, sorting the plurality of construction nodes based on construction time to generate an assembly sub-node sequence, and generating a second sequence number corresponding to each assembly sub-node sequence based on the corresponding first sequence number, including:

receiving a plurality of construction nodes input by each assembly modeling end, and sequencing the plurality of construction nodes based on the sequence of the construction time to generate an assembly sub-node sequence;

and constructing two second numbered slots for each assembly sub-node sequence, acquiring first serial numbers of two adjacent floor sub-node sequences corresponding to each assembly sub-node sequence, filling the first serial numbers into the two second numbered slots corresponding to the corresponding assembly sub-node sequence, and acquiring second serial numbers corresponding to each assembly sub-node sequence.

Optionally, in one possible implementation manner of the first aspect, the sorting processing is performed on the floor sub-node sequence and the assembly sub-node sequence based on a sequence number sorting policy, a first sequence number and a second sequence number, so as to obtain a modeling total sequence corresponding to the target three-dimensional model, including:

Sequencing a plurality of first sequence numbers according to the sequence from small to large to obtain a first sequencing sequence;

obtaining two first serial numbers corresponding to the second serial numbers, and inserting the second serial numbers behind the corresponding two first serial numbers to obtain a second ordering sequence;

and sequencing the floor sub-node sequence and the assembly sub-node sequence based on the second sequencing sequence to obtain a modeling total sequence corresponding to the target three-dimensional model.

Optionally, in one possible implementation manner of the first aspect, the method includes receiving cancellation data of the target three-dimensional model by a user based on a cancellation policy, updating the target three-dimensional model according to the cancellation data to obtain a cancellation three-dimensional model, obtaining a construction node corresponding to the cancellation data to generate a cancellation node set, and sorting the cancellation node set based on the modeling total sequence to obtain a cancellation node sequence, including:

performing coordinated processing on the target three-dimensional model, receiving central coordinate information input by a user to generate a model central point of the target three-dimensional model, generating a three-dimensional coordinate axis corresponding to the target three-dimensional model based on the model central point, and performing bidirectional extension processing on three coordinate axes of the three-dimensional coordinate axis to obtain a six-dimensional elimination axis;

Acquiring one coordinate axis selected by a user on the six-dimensional elimination axis as an elimination axis, calling a preset elimination surface perpendicular to the elimination axis, and receiving area adjustment information of the preset elimination surface by the user to obtain an adjustment elimination surface;

receiving movement information of a user on the adjustment elimination surface, controlling the adjustment elimination surface to move based on the elimination shaft based on the movement information, and acquiring a space through which the adjustment elimination surface moves as an elimination space;

determining elimination nodes according to the construction nodes covered by the elimination space, eliminating and updating the elimination nodes in the target three-dimensional model to obtain an elimination three-dimensional model, generating an elimination node set based on the elimination nodes, and sorting the elimination node set based on the modeling total sequence to obtain an elimination node sequence.

Optionally, in a possible implementation manner of the first aspect, receiving movement information of the adjustment elimination surface by a user, controlling the adjustment elimination surface to move based on the movement information and obtaining a space through which the adjustment elimination surface moves as an elimination space, including:

Receiving a starting point three-dimensional coordinate point and an ending point three-dimensional coordinate point which are input by a user, acquiring a positioning center point of the adjustment eliminating surface, and placing the adjustment eliminating surface at the starting point three-dimensional coordinate point based on the positioning center point;

and controlling the adjustment elimination surface to move from the starting point three-dimensional coordinate point to the end point three-dimensional coordinate point based on the elimination axis, and acquiring a space through which the adjustment elimination surface moves as an elimination space.

Optionally, in one possible implementation manner of the first aspect, determining an cancellation node according to the construction node of the cancellation space coverage, performing cancellation update on the cancellation node in the target three-dimensional model to obtain a cancellation three-dimensional model, generating a cancellation node set based on the cancellation node, and performing sorting processing on the cancellation node set based on the modeling total sequence to obtain a cancellation node sequence, including:

acquiring construction nodes covered by the elimination space as nodes to be determined, and acquiring the coverage duty ratio of each node to be determined according to the three-dimensional coordinate points corresponding to each node to be determined;

if the coverage duty ratio is larger than or equal to a preset coverage duty ratio, acquiring a corresponding node to be determined as an elimination node, and if the coverage duty ratio is smaller than the preset coverage duty ratio, acquiring the corresponding node to be determined as an interference node;

And eliminating and updating the eliminating nodes in the target three-dimensional model to obtain an eliminating three-dimensional model, generating an eliminating node set based on the eliminating nodes, and sorting the eliminating node set based on the modeling total sequence to obtain an eliminating node sequence.

Optionally, in one possible implementation manner of the first aspect, acquiring a construction node covered by the cancellation space as a node to be determined, and obtaining a coverage duty ratio of each node to be determined according to a three-dimensional coordinate point corresponding to each node to be determined includes:

counting the number of all three-dimensional coordinate points corresponding to each node to be determined to obtain the number of total coordinate points corresponding to each node to be determined;

acquiring three-dimensional coordinate points of the nodes to be determined in the elimination space as coverage coordinate points, and counting the number of all the coverage coordinate points corresponding to the nodes to be determined to obtain the number of the coverage coordinate points corresponding to the nodes to be determined;

and obtaining the coverage duty ratio corresponding to the corresponding node to be determined according to the ratio of the number of the coverage coordinate points to the number of the total coordinate points.

Optionally, in one possible implementation manner of the first aspect, the method further includes:

Counting the deleted nodes of each floor modeling end and each assembly modeling end to obtain the deleted node quantity corresponding to each floor modeling end and each assembly modeling end;

obtaining an adjustment coefficient according to the ratio of the preset deleted node quantity to the deleted node quantity, and obtaining a proficiency evaluation coefficient corresponding to each floor modeling end and each assembly modeling end based on the product of a reference evaluation coefficient and the adjustment coefficient;

and acquiring a floor modeling end and/or an assembly modeling end with a proficiency evaluation coefficient smaller than a preset proficiency evaluation coefficient as a training modeling end, and sending the training modeling end to a training end for training.

In a second aspect of the embodiment of the present invention, a three-dimensional model reconstruction system based on a video stream is provided, including:

the planning node is used for splitting model planning data according to floor information to obtain a plurality of sub-planning data corresponding to the floor information, determining a floor modeling end corresponding to each sub-planning data, receiving a plurality of construction nodes input by each floor modeling end, sequencing the construction nodes based on construction time to generate a floor sub-node sequence, and generating a first serial number corresponding to each floor sub-node sequence based on the floor information;

The assembly nodes are used for responding to the completion information of the floor modeling end corresponding to the adjacent floor information, generating assembly planning data, determining an assembly modeling end corresponding to the assembly planning data, receiving a plurality of construction nodes input by each assembly modeling end, sequencing the construction nodes based on construction time to generate an assembly sub-node sequence, and generating a second sequence corresponding to each assembly sub-node sequence based on the corresponding first sequence;

the sequence node is used for generating a target three-dimensional model according to the building nodes corresponding to the floor sub-node sequence and the assembly sub-node sequence, and sequencing the floor sub-node sequence and the assembly sub-node sequence based on a sequence sequencing strategy, a first sequence and a second sequence to obtain a modeling total sequence corresponding to the target three-dimensional model;

the elimination node is used for receiving elimination data of the target three-dimensional model from a user based on an elimination strategy, updating the target three-dimensional model according to the elimination data to obtain an elimination three-dimensional model, acquiring construction nodes corresponding to the elimination data to generate an elimination node set, and sorting the elimination node set based on the modeling total sequence to obtain an elimination node sequence;

And the reconstruction node is used for calling a corresponding construction node based on the elimination node sequence, and reconstructing the elimination three-dimensional model based on the construction node to obtain a reconstruction three-dimensional model and a video stream corresponding to the reconstruction three-dimensional model.

The beneficial effects of the invention are as follows:

1. the invention combines the reproduction demand data of the user to orderly reconstruct and display the corresponding reproduction model. When the floor model is constructed, the sub-planning data corresponding to each floor information in the floor model is distributed to a plurality of floor modeling terminals for construction, so that the efficiency of constructing the floor model can be improved. When modeling data corresponding to corresponding floor information is constructed by each floor modeling terminal, the invention acquires a plurality of construction nodes corresponding to the corresponding floor information, and sequences the construction nodes according to construction time to obtain a floor sub-node sequence, so that the construction sequence among the construction nodes in the corresponding floor information can be obtained according to the floor sub-node sequence. When the floor modeling end completes modeling data of corresponding floor information, the invention also assembles a plurality of constructed floor nodes so as to obtain a target three-dimensional model corresponding to the whole floor building, and simultaneously obtains a modeling total sequence corresponding to the target three-dimensional model, and the modeling total sequence can be used for knowing the front-back sequence among all construction nodes when the target three-dimensional model is constructed from one floor to the top floor. When a user wants to check the construction process of a certain area in the target three-dimensional model, the method acquires the corresponding elimination space in the target three-dimensional model according to the elimination data selected by the user, then eliminates nodes through the elimination space, eliminates the elimination nodes from the target three-dimensional model to obtain an elimination three-dimensional model, then sorts the elimination node set according to the modeling total sequence to obtain an elimination node sequence, and rebuilds and displays the construction process of elimination node+ in the elimination area in the elimination three-dimensional model through the elimination node sequence, so that the corresponding area in the floor model can be rebuilt and displayed orderly in combination with the regional rebuilding requirement of the user.

2. When the modeling total sequence of the target three-dimensional model is obtained, first serial numbers are added for each floor sub-node sequence according to floor information, then assembly sub-node sequences between adjacent floors are obtained, second serial numbers are added for each assembly sub-node sequence according to the first serial numbers corresponding to each assembly sub-node sequence, wherein the second serial numbers consist of the first serial numbers corresponding to each assembly sub-node sequence, so that the floor information corresponding to each floor sub-node sequence can be distinguished according to the first serial numbers, and which two adjacent floors are assembled by each assembly sub-node sequence can be distinguished according to the second serial numbers. After the first sequence number and the second sequence number are obtained, the invention firstly sequences each first sequence number according to the sequence from small to large to obtain a first sequence, then inserts the second sequence number into two corresponding first sequence numbers to obtain a second sequence, and sequences the floor sub-node sequence and the assembly sub-node sequence through the second sequence to obtain a modeling total sequence corresponding to the target three-dimensional model, so that the corresponding modeling total sequence can be obtained according to the floor sequence and the assembly sequence, and the front and back sequences among all construction nodes when the target three-dimensional model is constructed from the first floor to the top floor can be combed.

3. When the corresponding elimination space in the target three-dimensional model is acquired according to the elimination data selected by the user, a six-dimensional elimination axis is constructed based on the center point of the model selected by the user, so that the elimination space selected by the user in the target three-dimensional model can be acquired according to the six-dimensional elimination axis. Specifically, the method and the device can firstly acquire the selected elimination axis of the six-dimensional elimination axis of the user, then call the preset elimination surface to display for the user to adjust, obtain the adjusted elimination surface, then control the movement of the adjusted elimination surface through the elimination direction corresponding to the elimination axis, and then acquire the elimination space through the space moved by the adjusted elimination surface, so that the corresponding elimination space in the target three-dimensional model can be acquired according to the requirement of the user, and orderly reconstruction display can be carried out on the elimination nodes in the elimination space. When the elimination nodes in the elimination space are obtained, the coverage duty ratio corresponding to each elimination node in the elimination space is obtained, and the construction nodes with the coverage duty ratio meeting the coverage condition are taken as the elimination nodes, so that interference caused by the construction nodes which do not meet the coverage condition in the elimination space can be eliminated, and the accuracy in obtaining the elimination nodes is improved.

Drawings

Fig. 1 is a schematic flow chart of a three-dimensional model reconstruction method based on video stream according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a six-position elimination shaft according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of a three-dimensional model reconstruction system based on video streaming according to an embodiment of the present application;

fig. 4 is a schematic hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

Referring to fig. 1, a flow diagram of a three-dimensional model reconstruction method based on a video stream according to an embodiment of the present application is shown, and an execution subject of the method shown in fig. 1 may be a software and/or hardware device. The execution body of the present application may include, but is not limited to, at least one of: user equipment, network equipment, etc. The user equipment may include, but is not limited to, computers, smart phones, personal digital assistants (Personal Digital Assistant, abbreviated as PDA), and the above-mentioned electronic devices. The network device may include, but is not limited to, a single network server, a server group of multiple network servers, or a cloud of a large number of computers or network servers based on cloud computing, where cloud computing is one of distributed computing, and a super virtual computer consisting of a group of loosely coupled computers. This embodiment is not limited thereto. The method comprises the steps S1 to S5, and specifically comprises the following steps:

S1, splitting model planning data according to floor information to obtain a plurality of sub-planning data corresponding to the floor information, determining a floor modeling end corresponding to each sub-planning data, receiving a plurality of construction nodes input by each floor modeling end, sorting the construction nodes based on construction time to generate a floor sub-node sequence, and generating a first serial number corresponding to each floor sub-node sequence based on the floor information.

The model planning data refers to planning data of an overall floor model, for example, the planning data of a floor model with 6 floors may be used, and the sub-planning data may correspond to the planning data of each floor, for example, if the floor model has six floors, the sub-planning data may have 6 sub-planning data, which respectively correspond to the planning data corresponding to each floor.

In practical application, since the floor model may correspond to a plurality of sub-planning data, in order to save time during modeling, the sub-planning data may be distributed to a plurality of floor modeling terminals, the floor modeling terminal corresponding to each sub-planning data is determined, and then three-dimensional modeling of the floor model is completed through each floor modeling terminal.

After the plurality of sub-planning data are distributed to the corresponding floor modeling terminals, the floor modeling terminals can construct a plurality of data nodes when constructing modeling data corresponding to each floor, such as nodes corresponding to data of floors, doors, windows and the like, so that a plurality of construction nodes input when the floor modeling terminals are constructed, namely nodes corresponding to each data are acquired, the construction nodes are ordered according to construction time, a floor sub-node sequence is obtained, and the sequence of the floor sub-nodes can be used for knowing the sequence of each construction node constructed by the floor modeling terminals.

And because there may be more than one floor sub-node sequence, in order to distinguish the floor information of each floor sub-node sequence, the first serial number corresponding to each floor sub-node sequence can be generated by the floor information.

In some embodiments, the manner in step S1 may be achieved by:

s11, receiving a plurality of construction nodes input by each floor modeling end, and sequencing the plurality of construction nodes based on the sequence of the construction time to generate a floor sub-node sequence.

In practical application, after receiving the construction node input by the floor modeling end, the input time of the floor modeling end can be recorded, so that the construction time of each construction node is obtained, and then the construction nodes are sequenced to generate a corresponding floor sub-node sequence according to the sequence of the construction time.

S12, constructing a first number slot for each floor sub-node sequence, and filling corresponding floor serial numbers into the first number slot corresponding to each floor sub-node sequence according to the floor information to obtain the first serial numbers corresponding to each floor sub-node sequence.

It will be appreciated that in order to distinguish the floor information corresponding to each of the floor sub-node sequences, a first numbered slot may be constructed for each of the floor sub-node sequences, and then the corresponding floor information may be filled into the first numbered slot. For example, if the floor information corresponding to a certain floor sub-node sequence is first floor, the number 1 may be filled in the corresponding first number slot as the first serial number corresponding to the floor sub-node sequence.

By the method, the sequence of each construction node constructed by the floor modeling terminal can be known, and the floor information corresponding to the floor sub-node sequence formed by a plurality of construction nodes can be known.

S2, generating assembly planning data in response to the completion information of the floor modeling end corresponding to the adjacent floor information, determining an assembly modeling end corresponding to the assembly planning data, receiving a plurality of construction nodes input by each assembly modeling end, sorting the construction nodes based on construction time to generate an assembly sub-node sequence, and generating a second sequence corresponding to each assembly sub-node sequence based on the corresponding first sequence.

In practical application, after modeling of each floor is completed, a plurality of floors are required to be assembled, so that modeling of the whole floor is completed, therefore, after the completion information of the floor modeling end corresponding to the floor information is responded, the scheme also generates assembly planning data, the assembly modeling end corresponding to each assembly planning data is determined, and assembly among all floors is completed through each assembly modeling end.

The assembly planning data refers to planning data corresponding to adjacent floors when the adjacent floors are assembled, for example, planning data corresponding to a first floor and a second floor.

When the assembly modeling end assembles adjacent floor data, construction nodes during assembly can be constructed, so after receiving the construction nodes input by each assembly modeling end, the assembly modeling end can sort the construction nodes input by the assembly modeling end according to construction time to generate an assembly sub-node sequence, and the sequence of the assembly modeling end in constructing each construction node can be known through the assembly sub-node sequence.

Similarly, since there may be less than one assembly sub-node sequence, in order to distinguish the assembly floors corresponding to each assembly sub-node sequence, the second sequence numbers corresponding to each assembly sub-node sequence may be generated by the first sequence numbers.

In some embodiments, the manner in step S2 may be achieved by:

s21, receiving a plurality of construction nodes input by each assembly modeling end, and sequencing the plurality of construction nodes based on the sequence of the construction time to generate an assembly sub-node sequence.

In practical application, after receiving the construction nodes input by the assembly modeling end, the input time of the assembly modeling end can be recorded, so that the construction time of each construction node is obtained, and then the construction nodes are sequenced to generate corresponding assembly sub-node sequences according to the sequence of the construction time.

S22, constructing two second numbered slots for each assembly sub-node sequence, acquiring first serial numbers of two adjacent floor sub-node sequences corresponding to each assembly sub-node sequence, filling the first serial numbers into the two second numbered slots corresponding to the corresponding assembly sub-node sequence, and acquiring second serial numbers corresponding to each assembly sub-node sequence.

It can be understood that, because the assembly sub-node sequence is a node sequence when adjacent floors are assembled, when a slot is constructed for the assembly sub-node sequence, two second numbered slots can be constructed, and then the first serial numbers of the adjacent two floor sub-node sequences corresponding to the assembly sub-node sequence are filled into the two second numbered slots, so as to obtain the second serial numbers corresponding to the assembly sub-node sequences.

For example, if a certain assembly sub-node sequence corresponds to a first-floor and second-floor sub-node sequence, the number 1 and the number 2 may be respectively filled in two corresponding second number slots as the second serial numbers corresponding to the assembly sub-node sequence.

And S3, generating a target three-dimensional model according to the building nodes corresponding to the floor sub-node sequences and the assembly sub-node sequences, and sequencing the floor sub-node sequences and the assembly sub-node sequences based on a sequence sequencing strategy, a first sequence and a second sequence to obtain a modeling total sequence corresponding to the target three-dimensional model.

After the floor sub-node sequence and the assembly sub-node sequence are obtained, a target three-dimensional model corresponding to the whole floor building can be generated according to the floor sub-node sequence and the assembly sub-node sequence. In addition, in order to obtain the front-back sequence of each construction node when the target three-dimensional model is constructed from one floor to the top floor, the method further carries out sequencing processing on the floor sub-node sequence and the assembly sub-node sequence according to a sequence sequencing strategy, a first sequence and a second sequence, so that a modeling total sequence corresponding to the target three-dimensional model is obtained, and the corresponding modeling total sequence can be obtained according to the floor sequence and the assembly sequence, so that the front-back sequence of each construction node when the target three-dimensional model is constructed from one floor to the top floor can be combed.

Based on the above embodiment, in step S3, "the ranking process is performed on the floor sub-node sequence and the assembly sub-node sequence based on the sequence ranking policy, the first sequence and the second sequence, so as to obtain the modeling total sequence corresponding to the target three-dimensional model" may be implemented in the following manner:

s31, sorting the plurality of first sequence numbers according to the order from small to large to obtain a first sorting sequence.

It will be appreciated that when building floors, it is usually built layer by layer, for example, building first floor, building second floor, and so on, and the first serial number corresponds to the floor information of each floor, so when sorting the first serial number, sorting it in order from small to large to obtain the first sorting sequence.

S32, obtaining two first serial numbers corresponding to the second serial numbers, and inserting the second serial numbers behind the corresponding two first serial numbers to obtain a second ordering sequence.

It can be understood that when assembling adjacent floors, each floor may be constructed by a different floor modeling end, so when assembling the adjacent floors, the constructed adjacent floors are acquired first and then assembled, so the assembled sub-node sequences should be arranged after the adjacent floor sub-node sequences corresponding to the adjacent floors, when inserting the second serial numbers, two first serial numbers corresponding to the second serial numbers can be acquired first, and then the corresponding second serial numbers are inserted behind the corresponding two first serial numbers, so as to obtain the second ordered sequences.

And S33, sorting the floor sub-node sequences and the assembly sub-node sequences based on the second sorting sequences to obtain modeling total sequences corresponding to the target three-dimensional model.

After the second sorting sequence is obtained, sorting processing can be carried out on the corresponding floor sub-node sequence and the corresponding assembly sub-node sequence according to the second sorting sequence, and a modeling total sequence corresponding to the target three-dimensional model is obtained.

Through the mode, the target three-dimensional model corresponding to the target floor can be obtained, and the front-back sequence among all construction nodes can be combed when the target three-dimensional model is constructed from the first floor to the top floor.

And S4, receiving elimination data of the target three-dimensional model by a user based on an elimination strategy, updating the target three-dimensional model according to the elimination data to obtain an elimination three-dimensional model, acquiring construction nodes corresponding to the elimination data to generate an elimination node set, and sorting the elimination node set based on the modeling total sequence to obtain an elimination node sequence.

In practical application, when a user views a target three-dimensional model, the user may want to view the construction process of a certain area in the target three-dimensional model, in this case, the scheme may acquire the elimination data selected by the user in the corresponding area in the three-dimensional model, and then perform elimination processing on the corresponding data in the target three-dimensional model through the elimination data to obtain the elimination three-dimensional model.

For example, if the user wants to see how a certain region in the target three-dimensional model is configured, the user may interact with the target three-dimensional model to obtain data corresponding to the required region for elimination, and finally obtain an eliminated three-dimensional model after elimination processing. It can be understood that after the elimination three-dimensional model is obtained, in order to reconstruct and display the elimination data selected by the user, so that the user can learn the construction process of the elimination data, the scheme can obtain the elimination space corresponding to the elimination data, then generate an elimination node set according to the construction nodes in the elimination space, and sort the elimination node set based on the modeling total sequence to obtain an elimination node sequence, and reconstruct and display the construction process of the construction nodes in the elimination space in the follow-up elimination space through the elimination node sequence.

It can be further understood that, because there is more than one construction node corresponding to the elimination space, each construction node may have a sequence in construction, after the elimination node set is obtained, the elimination nodes may be ordered according to the modeling total sequence, so that the construction process of each eliminated construction node may be sequentially reconstructed and displayed.

In some embodiments, the specific implementation manner of step S4 may be:

and S41, carrying out coordinated processing on the target three-dimensional model, receiving central coordinate information input by a user to generate a model central point of the target three-dimensional model, generating a three-dimensional coordinate axis corresponding to the target three-dimensional model based on the model central point, and carrying out bidirectional extension processing on three coordinate axes of the three-dimensional coordinate axis to obtain a six-dimensional elimination axis.

Referring to fig. 2, a schematic diagram of a six-bit canceling shaft is provided according to an embodiment of the present invention. In practical application, after a model center point is obtained according to center coordinate information input by a user, a three-dimensional coordinate axis can be constructed through the model center point, and then the three-dimensional coordinate axis is extended bidirectionally to obtain a six-dimensional elimination axis, so that the six-dimensional elimination axis after extension can penetrate through a target three-dimensional model, and further elimination nodes selected by the user in the target three-dimensional model can be obtained according to the six-dimensional elimination axis. It is worth mentioning that the six-dimensional elimination axis does not represent six dimensions, but six directions.

S42, acquiring one coordinate axis selected by a user on the six-dimensional elimination axis as an elimination axis, calling a preset elimination surface perpendicular to the elimination axis, and receiving area adjustment information of the preset elimination surface by the user to obtain an adjustment elimination surface.

It can be understood that when the eliminating space is obtained by the six eliminating axes, the eliminating plane is controlled to move based on the eliminating direction corresponding to the eliminating axes, and then the eliminating space is obtained by adjusting the space through which the eliminating plane moves, so before the preset eliminating plane is called, a user is required to select a corresponding eliminating axis from the six eliminating axes, and then the preset eliminating plane perpendicular to the eliminating axis is called.

It is further understood that, since the area and shape of the preset eliminating surface are preset, but in practical application, the areas that the user wants to eliminate may be different, after the preset eliminating surface is called, the user may correspondingly adjust the preset eliminating surface according to the eliminating requirement, so as to obtain the adjusted eliminating surface.

For example, when the user adjusts the preset eliminating surface, the user may adjust the area by scaling the preset eliminating surface, or may input a shape desired by the user on the preset eliminating surface, so that the preset eliminating surface is adjusted to a shape desired by the user.

S43, receiving movement information of the user on the adjustment elimination surface, controlling the adjustment elimination surface to move based on the elimination shaft based on the movement information, and acquiring a space through which the adjustment elimination surface moves as an elimination space.

After the elimination axis and the adjustment elimination surface are acquired, the adjustment elimination surface can be moved according to movement information input by a user, so that a space through which the adjustment elimination surface moves can be acquired as an elimination space.

Specifically, in some embodiments, the above-described cancellation space may be obtained by:

s431, receiving a starting point three-dimensional coordinate point and an ending point three-dimensional coordinate point input by a user, acquiring a positioning center point of the adjustment eliminating surface, and placing the adjustment eliminating surface at the starting point three-dimensional coordinate point based on the positioning center point.

In practical application, when the positioning center point of the adjustment eliminating surface is obtained, the maximum x coordinate value, the minimum x coordinate value, the maximum y coordinate value, the minimum y coordinate value, the maximum z coordinate value and the minimum z coordinate value in all three-dimensional coordinates corresponding to the adjustment eliminating surface can be obtained, then the intermediate x coordinate value is obtained through the intermediate value of the difference value between the maximum x coordinate value and the minimum x coordinate value, the intermediate y coordinate value is obtained through the intermediate value of the difference value between the maximum y coordinate value and the minimum y coordinate value, the intermediate z coordinate value is obtained through the intermediate value of the difference value between the maximum z coordinate value and the minimum z coordinate value, and finally the positioning center point corresponding to the adjustment eliminating surface is obtained through the intermediate x coordinate value, the intermediate y coordinate value and the intermediate z coordinate value.

After the positioning center point of the adjustment eliminating surface, the starting point three-dimensional coordinate point and the ending point three-dimensional coordinate point input by the user are obtained, the positioning center point of the adjustment eliminating surface can be placed at the starting point three-dimensional coordinate point, so that the starting position of the adjustment eliminating surface when moving can be obtained.

S432, controlling the adjustment elimination surface to move from the starting point three-dimensional coordinate point to the end point three-dimensional coordinate point based on the elimination axis, and acquiring a space through which the adjustment elimination surface moves as an elimination space.

When the adjustment eliminating surface is moved, the adjustment eliminating surface can be moved from the starting point three-dimensional coordinate point to the ending point three-dimensional coordinate point in the eliminating direction corresponding to the eliminating axis, and the space through which the adjustment eliminating surface is moved can be obtained to obtain the eliminating space.

S44, determining elimination nodes according to the construction nodes covered by the elimination space, eliminating and updating the elimination nodes in the target three-dimensional model to obtain an elimination three-dimensional model, generating an elimination node set based on the elimination nodes, and sorting the elimination node set based on the modeling total sequence to obtain an elimination node sequence.

After the elimination space is obtained, elimination nodes in the elimination space can be updated, so that reconstruction display can be carried out on the elimination nodes in the elimination space in the follow-up elimination.

Specifically, step S44 includes steps S441 to S443, specifically as follows:

s441, obtaining construction nodes covered by the elimination space as nodes to be determined, and obtaining the coverage duty ratio of each node to be determined according to the three-dimensional coordinate points corresponding to each node to be determined.

It will be appreciated that after the user selects the cancellation space, the cancellation space may or may not completely cover one of the construction nodes, and when the cancellation space does not completely cover one of the construction nodes, the scheme determines whether the corresponding construction node is the cancellation node according to the coverage ratio of the corresponding construction node.

In some embodiments, the coverage ratio of each node to be determined may be calculated by:

and S4411, counting the number of all three-dimensional coordinate points corresponding to each node to be determined, and obtaining the total coordinate point number corresponding to each node to be determined.

In practical application, the three-dimensional object corresponding to the node to be determined corresponds to a plurality of three-dimensional coordinates, so that when the coverage duty ratio corresponding to each node to be determined is determined, the coverage duty ratio corresponding to each node to be determined can be obtained by the ratio of the number of covered coordinate points to the number of total coordinate points.

Specifically, the number of total coordinate points corresponding to each node to be determined may be counted first.

And S4412, acquiring three-dimensional coordinate points of the nodes to be determined in the elimination space as coverage coordinate points, and counting the number of all the coverage coordinate points corresponding to the nodes to be determined to obtain the number of the coverage coordinate points corresponding to the nodes to be determined.

After the total coordinate point number corresponding to each node to be determined is counted, the coverage coordinate point number covered by the elimination space of each node to be determined can be counted.

And S4413, obtaining the coverage duty ratio corresponding to the corresponding node to be determined according to the ratio of the number of the coverage coordinate points to the number of the total coordinate points.

And obtaining the number of the coverage coordinate points and the number of the total coordinate points corresponding to each node to be determined, and obtaining the coverage duty ratio corresponding to each node to be determined according to the ratio of the number of the coverage coordinate points and the number of the total coordinate points.

S442, if the coverage duty ratio is greater than or equal to a preset coverage duty ratio, acquiring a corresponding node to be determined as an elimination node, and if the coverage duty ratio is smaller than the preset coverage duty ratio, acquiring the corresponding node to be determined as an interference node.

If the coverage ratio is greater than or equal to the preset coverage ratio, indicating that most areas of the corresponding nodes to be determined are in the elimination space, the corresponding nodes to be determined can be taken as elimination nodes.

If the coverage ratio is smaller than the preset coverage ratio, it is indicated that only a small area of the corresponding node to be determined may be in the cancellation space, so that the node to be determined may be used as an interference node, and interference caused when the cancellation node is selected may be eliminated.

S443, eliminating and updating the eliminating nodes in the target three-dimensional model to obtain an eliminating three-dimensional model, generating an eliminating node set based on the eliminating nodes, and sorting the eliminating node set based on the modeling total sequence to obtain an eliminating node sequence.

After the elimination nodes are obtained, the elimination nodes in the elimination space can be eliminated and updated to obtain an elimination three-dimensional model, then the elimination nodes are ordered through the modeling total sequence to obtain an elimination node sequence, and reconstruction display is carried out on the construction process of each elimination node in the elimination space through the elimination node sequence.

By the method, the elimination space selected by the user in the target three-dimensional model can be obtained according to the regional reconstruction requirement of the user, so that the elimination nodes in the elimination space can be reconstructed and displayed later.

In other embodiments, the specific implementation manner of step S4 may be further:

Receiving a construction node selected by a user in the target three-dimensional model as an elimination node, eliminating and updating the elimination node in the target three-dimensional model to obtain an elimination three-dimensional model, generating an elimination node set according to the elimination node, and sorting the elimination node set based on the modeling total sequence to obtain an elimination node sequence.

In practical application, when acquiring elimination data selected by a user in a target three-dimensional model, a plurality of construction nodes can be displayed to the user, then the construction nodes selected by the user are directly used as elimination nodes, elimination processing is performed on elimination nodes obtained in the target three-dimensional model to obtain an elimination three-dimensional model, and then an elimination node sequence is obtained according to the elimination nodes.

By the method, the elimination node selected by the user in the target three-dimensional model can be obtained according to the requirement of the user, so that the elimination node can be reconstructed and displayed later.

S5, corresponding construction nodes are called based on the elimination node sequences, reconstruction is conducted on the elimination three-dimensional model based on the construction nodes, and a reconstructed three-dimensional model and a video stream corresponding to the reconstructed three-dimensional model are obtained.

When the reconstruction display is carried out through the elimination node sequence, the construction nodes corresponding to all the elimination nodes in the modeling total sequence can be called, then the elimination three-dimensional model is reconstructed according to the construction nodes, the reconstruction three-dimensional model is obtained, and in the reconstruction process of the elimination three-dimensional model, the reconstruction three-dimensional model can be recorded, so that the video stream corresponding to the reconstruction three-dimensional model is obtained.

By the method, orderly reconstruction display can be performed on the construction nodes in the corresponding area in the cancellation three-dimensional model.

In addition, on the basis of the above embodiment, the present solution further includes the following embodiments:

a1, counting the deleted nodes of each floor modeling end and each assembly modeling end to obtain the deleted node quantity corresponding to each floor modeling end and each assembly modeling end.

In practical application, when the floor modeling end and the assembly modeling end construct node data, the construction nodes can be deleted and rebuilt for many times, which may be caused by the fact that the floor modeling end and the assembly modeling end are not skilled or wrong enough in modeling, so in this case, the floor modeling end and the assembly modeling end can be evaluated according to the number of deleted nodes corresponding to the floor modeling end and the assembly modeling end, and the floor modeling end and the assembly modeling end which are not skilled in modeling or easy to have errors can be retrained.

It should be noted that, the deleted node refers to a node that is reconstructed after deletion, not to a node that is only deleted, and if the corresponding constructed node is not constructed again after deletion, the node is not deleted. The deleted node may be determined by name comparison, for example, after the user completes construction of the node a, the user then reconstructs the node a again in the subsequent modeling, and at this time, the present scheme takes the node a as the deleted node.

A2, obtaining an adjustment coefficient according to the ratio of the preset deleted node quantity to the deleted node quantity, and obtaining a proficiency evaluation coefficient corresponding to each floor modeling end and each assembly modeling end based on the product of the reference evaluation coefficient and the adjustment coefficient.

It can be appreciated that the more the number of deleted nodes, the more the corresponding building nodes the floor modeling end and/or the assembly modeling end delete and reconstruct when building the node data, the lower the familiarity of the modeling, and the lower the corresponding proficiency assessment coefficient.

A3, acquiring a floor modeling end and/or an assembly modeling end with a proficiency evaluation coefficient smaller than a preset proficiency evaluation coefficient as a training modeling end, and sending the training modeling end to a training end for training.

It will be appreciated that when the proficiency assessment factor is less than the preset proficiency assessment factor, it is stated that the corresponding floor modeling end and/or assembly modeling end is likely to be less proficient at modeling and therefore may be sent as a training modeling end to the training end for training.

By the method, the floor modeling end and/or the assembly modeling end with less proficiency in modeling can be retrained, and the modeling capacity of the corresponding floor modeling end and/or assembly modeling end is improved.

Referring to fig. 3, a schematic structural diagram of a three-dimensional model reconstruction system based on a video stream according to an embodiment of the present invention includes:

The apparatus of the embodiment shown in fig. 3 may be correspondingly used to perform the steps in the embodiment of the method shown in fig. 1, and the implementation principle and technical effects are similar, and are not repeated here.

Referring to fig. 4, a schematic hardware structure of an electronic device according to an embodiment of the present invention is shown, where the electronic device 40 includes: a processor 41, a memory 42 and a computer program; wherein the method comprises the steps of

A memory 42 for storing the computer program, which may also be a flash memory (flash). Such as application programs, functional modules, etc. implementing the methods described above.

A processor 41 for executing the computer program stored in the memory to implement the steps executed by the apparatus in the above method. Reference may be made in particular to the description of the embodiments of the method described above.

Alternatively, the memory 42 may be separate or integrated with the processor 41.

When the memory 42 is a device separate from the processor 41, the apparatus may further include:

a bus 43 for connecting the memory 42 and the processor 41.

The present invention also provides a readable storage medium having stored therein a computer program for implementing the methods provided by the various embodiments described above when executed by a processor.

The readable storage medium may be a computer storage medium or a communication medium. Communication media includes any medium that facilitates transfer of a computer program from one place to another. Computer storage media can be any available media that can be accessed by a general purpose or special purpose computer. For example, a readable storage medium is coupled to the processor such that the processor can read information from, and write information to, the readable storage medium. In the alternative, the readable storage medium may be integral to the processor. The processor and the readable storage medium may reside in an application specific integrated circuit (Application Specific Integrated Circuits, ASIC for short). In addition, the ASIC may reside in a user device. The processor and the readable storage medium may reside as discrete components in a communication device. The readable storage medium may be read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tape, floppy disk, optical data storage device, etc.

The present invention also provides a program product comprising execution instructions stored in a readable storage medium. The at least one processor of the device may read the execution instructions from the readable storage medium, the execution instructions being executed by the at least one processor to cause the device to implement the methods provided by the various embodiments described above.

In the above embodiment of the apparatus, it should be understood that the processor may be a central processing unit (english: central Processing Unit, abbreviated as CPU), or may be other general purpose processors, digital signal processors (english: digital Signal Processor, abbreviated as DSP), application specific integrated circuits (english: application Specific Integrated Circuit, abbreviated as ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor for execution, or in a combination of hardware and software modules in a processor for execution.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the invention.

Claims

1. A three-dimensional model reconstruction method based on video streaming, comprising:

based on the eliminating node sequence, corresponding construction nodes are called, and based on the construction nodes, the eliminating three-dimensional model is reconstructed, so that a reconstructed three-dimensional model and a video stream corresponding to the reconstructed three-dimensional model are obtained;

receiving a plurality of construction nodes input by each floor modeling end, sequencing the construction nodes based on construction time to generate a floor sub-node sequence, and generating a first serial number corresponding to each floor sub-node sequence based on the floor information, wherein the method comprises the following steps:

constructing a first numbered slot for each floor sub-node sequence, filling corresponding floor serial numbers in the first numbered slot corresponding to each floor sub-node sequence according to the floor information, and obtaining the first serial numbers corresponding to each floor sub-node sequence;

Receiving a plurality of construction nodes input by each assembly modeling end, sequencing the construction nodes based on construction time to generate an assembly sub-node sequence, and generating a second sequence corresponding to each assembly sub-node sequence based on the corresponding first sequence, wherein the method comprises the following steps:

constructing two second numbered slots for each assembly sub-node sequence, acquiring first serial numbers of two adjacent floor sub-node sequences corresponding to each assembly sub-node sequence, filling the first serial numbers into the two second numbered slots corresponding to the corresponding assembly sub-node sequence, and acquiring second serial numbers corresponding to each assembly sub-node sequence;

sequencing the floor sub-node sequence and the assembly sub-node sequence based on a sequence sequencing strategy, a first sequence number and a second sequence number to obtain a modeling total sequence corresponding to the target three-dimensional model, wherein the method comprises the following steps:

sequencing the floor sub-node sequence and the assembly sub-node sequence based on the second sequencing sequence to obtain a modeling total sequence corresponding to the target three-dimensional model;

receiving elimination data of a user on the target three-dimensional model based on an elimination strategy, updating the target three-dimensional model according to the elimination data to obtain an elimination three-dimensional model, obtaining a construction node corresponding to the elimination data to generate an elimination node set, and sorting the elimination node set based on the modeling total sequence to obtain an elimination node sequence, wherein the method comprises the following steps:

2. The method of claim 1, wherein the step of determining the position of the substrate comprises,

receiving movement information of a user on the adjustment elimination surface, controlling the adjustment elimination surface to move based on the movement information and obtaining a space through which the adjustment elimination surface moves as an elimination space, wherein the movement information comprises the following steps:

3. The method of claim 2, wherein the step of determining the position of the substrate comprises,

determining elimination nodes according to the construction nodes covered by the elimination space, eliminating and updating the elimination nodes in the target three-dimensional model to obtain an elimination three-dimensional model, generating an elimination node set based on the elimination nodes, and sorting the elimination node set based on the modeling total sequence to obtain an elimination node sequence, wherein the method comprises the following steps:

4. The method of claim 3, wherein the step of,

the method for obtaining the coverage duty ratio of each node to be determined according to the three-dimensional coordinate points corresponding to each node to be determined comprises the following steps:

5. The method as recited in claim 4, further comprising:

6. A video stream based three-dimensional model reconstruction system, comprising:

the reconstruction node is used for calling a corresponding construction node based on the elimination node sequence, reconstructing the elimination three-dimensional model based on the construction node, and obtaining a reconstruction three-dimensional model and a video stream corresponding to the reconstruction three-dimensional model;