CN111080799A - Scene roaming method, system, device and storage medium based on three-dimensional modeling - Google Patents
Scene roaming method, system, device and storage medium based on three-dimensional modeling Download PDFInfo
- Publication number
- CN111080799A CN111080799A CN201911228157.9A CN201911228157A CN111080799A CN 111080799 A CN111080799 A CN 111080799A CN 201911228157 A CN201911228157 A CN 201911228157A CN 111080799 A CN111080799 A CN 111080799A
- Authority
- CN
- China
- Prior art keywords
- dimensional
- scene
- roaming
- server
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
- G06Q30/0643—Graphical representation of items or shoppers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2016—Rotation, translation, scaling
Abstract
The invention discloses a scene roaming method, a system, a device and a storage medium based on three-dimensional modeling, wherein the method comprises the following steps: scanning to obtain three-dimensional data of a scene, and uploading the three-dimensional data to a server; generating a three-dimensional model of a scene and point cloud data of the scene by a server through an artificial intelligence algorithm according to the three-dimensional data; generating a two-dimensional indoor graph of the scene by a server through an artificial intelligence algorithm according to the point cloud data; and roaming the scene according to the three-dimensional model, and displaying the two-dimensional house type graph. According to the invention, the server adopts an artificial intelligence algorithm to realize automatic construction of the three-dimensional model and automatic generation of the two-dimensional house type graph, so that the method is beneficial to application in the real estate industry; the three-dimensional model can provide 360-degree dead-angle-free immersive roaming experience through three-dimensional roaming in the three-dimensional model, can display the two-dimensional house type diagram generated automatically, facilitates the user to recognize and understand the displayed house type, and can be widely applied to the field of three-dimensional modeling application.
Description
Technical Field
The invention relates to the field of three-dimensional modeling application, in particular to a scene roaming method, a scene roaming system, a scene roaming device and a storage medium based on three-dimensional modeling.
Background
With the development of computer technology, the application of computer graphics in various industries is rapidly popularized and deepened. At present, computer graphics has entered the three-dimensional era, and three-dimensional graphics are ubiquitous in human life. The three-dimensional graph virtualization and display method has the advantages of being strong in intuition, high in display degree, good in experience sense and the like. Modeling techniques are one of the most important technical fields of three-dimensional graphics. The modeling technology is one of the hottest directions in computer graphics at present, and plays an important role in various industries, such as building, carving, military, entertainment, real estate and the like.
In the real estate industry today, people select the appropriate house type primarily through two-dimensional house type maps provided by developers when buying a house. Currently, the display of the house layout is mainly a two-dimensional house layout mainly based on paper media. The two-dimensional household graph mainly has the advantages of low cost, simple display medium, easiness in modeling and the like, but has the defects of being not visual enough, low in display degree and the like compared with a three-dimensional graph. Three-dimensional modeling requires professional engineering and technical personnel due to complex technology, has low modeling efficiency, and is not widely applied to the real estate industry. However, in the real estate refinement development today, three-dimensional modeling and display of house types is a trend, and is also the development place of new industries.
Disclosure of Invention
To solve one of the above technical problems, the present invention aims to: a scene roaming method, system, apparatus and storage medium based on three-dimensional modeling are provided.
The first technical scheme adopted by the embodiment of the invention is as follows:
the scene roaming method based on three-dimensional modeling comprises the following steps:
scanning to obtain three-dimensional data of a scene, and uploading the three-dimensional data to a server, wherein the three-dimensional data comprises a two-dimensional picture and depth information;
generating a three-dimensional model of a scene and point cloud data of the scene by a server through an artificial intelligence algorithm according to the three-dimensional data;
generating a two-dimensional indoor graph of the scene by a server through an artificial intelligence algorithm according to the point cloud data;
and roaming the scene according to the three-dimensional model, and displaying the two-dimensional house type graph.
Further, the method also comprises the following steps:
acquiring a real-time video stream in a scene and uploading the real-time video stream to a server;
and splicing and fusing the three-dimensional model of the scene and the real-time video stream into a three-dimensional real scene by adopting a texture mapping technology through a server.
Further, the step of generating a two-dimensional house type graph of a scene by a server through an artificial intelligence algorithm according to the point cloud data specifically includes:
segmenting the point cloud data to obtain point clouds of all objects in the scene;
intelligently identifying the point cloud of each object in the scene by adopting an artificial intelligence algorithm through a server to obtain the type of each object in the scene;
and generating a two-dimensional indoor type graph of the scene according to the intelligent identification result.
Further, the step of roaming the scene according to the three-dimensional model and displaying the two-dimensional house type graph specifically includes:
acquiring a first input signal, and displaying a two-dimensional floor plan of a scene according to the first input signal;
and acquiring a second input signal, and performing three-dimensional roaming in the three-dimensional model according to the second input signal, wherein the second input signal comprises at least one of a visual angle or picture switching signal, an amplification or reduction control signal, an angle rotation control signal and a roaming mode selection signal.
Further, the second input signal further includes a click signal of a preset tag in the three-dimensional model, and the step of performing three-dimensional roaming in the three-dimensional model according to the second input signal specifically includes:
and when the click signal is detected, displaying the preset label in the three-dimensional model in a pop-up window mode, wherein the preset label comprises at least one of a video, a picture, a character and a model.
Further, the step of roaming the scene according to the three-dimensional model specifically includes:
and acquiring a third input signal, and performing three-dimensional roaming in the three-dimensional live-action scene according to the third input signal, wherein the third input signal comprises a roaming mode selection signal, a visual angle switching signal, an amplification or reduction control signal and an angle rotation control signal.
Further, the step of performing three-dimensional roaming in the three-dimensional live-action scene according to a third input signal specifically includes:
and when the three-dimensional roaming is carried out to the position or the area where the real-time video stream is located, automatically playing or displaying the real-time video stream.
The second technical scheme adopted by the embodiment of the invention is as follows:
the scene roaming system based on three-dimensional modeling comprises:
the scanning and data uploading module is used for scanning and acquiring three-dimensional data of a scene and uploading the three-dimensional data to a server, wherein the three-dimensional data comprises a two-dimensional picture and depth information;
the automatic modeling module is used for generating a three-dimensional model of a scene and point cloud data of the scene by adopting an artificial intelligence algorithm through a server according to the three-dimensional data;
the two-dimensional house-type graph generation module is used for generating a two-dimensional house-type graph of a scene by adopting an artificial intelligence algorithm through a server according to the point cloud data;
and the roaming module is used for roaming scenes according to the three-dimensional model and displaying the two-dimensional house type graph.
The third technical scheme adopted by the embodiment of the invention is as follows:
scene roaming device based on three-dimensional modeling includes:
at least one processor;
at least one memory for storing at least one program;
when executed by the at least one processor, cause the at least one processor to implement the three-dimensional modeling based scene roaming method as described above.
The fourth technical scheme adopted by the embodiment of the invention is as follows:
a storage medium having stored therein processor-executable instructions for performing the three-dimensional modeling based scene roaming method as described above when executed by a processor.
One or more of the above technical solutions have at least the following advantages: after the three-dimensional data of the scene is acquired, the server adopts an artificial intelligence algorithm to realize the automatic construction of a three-dimensional model and the automatic generation of a two-dimensional house type diagram, the modeling speed is high, the efficiency is high, the requirement on modeling personnel is not high, and the application in the real estate industry is facilitated; the scene is roamed according to the three-dimensional model, 360-degree dead-angle-free immersive roaming experience can be provided for the user through three-dimensional roaming in the three-dimensional model, the service of displaying the automatically generated two-dimensional house type diagram can be provided while roaming, and the user can conveniently identify and know the displayed house type.
Drawings
FIG. 1 is a diagram of a hardware architecture of a modeling and scene roaming system employed in an embodiment of the present invention;
fig. 2 is a flowchart of a scene roaming method based on three-dimensional modeling according to an embodiment of the present invention;
fig. 3 is a block diagram of a scene roaming system based on three-dimensional modeling according to an embodiment of the present invention;
fig. 4 is a block diagram of a scene roaming apparatus based on three-dimensional modeling according to an embodiment of the present invention.
Detailed Description
The invention will be further explained and explained with reference to the drawings and the embodiments in the specification. The step numbers in the following embodiments are provided only for convenience of illustration, the order between the steps is not limited at all, and the execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art.
This example illustrates a hardware structure of a modeling and scene roaming system used in various embodiments of the present invention. As shown in fig. 1, the system mainly includes a scanning device, a server, and a roaming module.
The scanning device is used for scanning objects in indoor or outdoor scenes such as industrial parks, cities, museums, factories and the like and uploading scanned data to the server. The object may be a symmetric object, an asymmetric object with an uneven surface, but also an environment or a person. The scanning device may be an aerial scanning device, an indoor scanning device, or an outdoor scanning device. The aerial photography scanning device can be aerial photography equipment such as an aerial photography airplane and the like and is used for scanning three-dimensional data of an area range (such as a whole house) in a scene. An indoor scanning device for scanning three-dimensional data of an indoor environment (e.g., a room in a house). The indoor scanning device can be a handheld scanning device (such as a camera with a support frame) or other automatic scanning device (such as an automatic scanning robot). The outdoor scanning device is used for scanning three-dimensional data of an outdoor environment (such as a road beside a certain house). The outdoor scanning device can be a handheld scanning device (such as a camera with a support frame) or other automatic scanning devices (such as an automatic scanning robot). The three-dimensional data includes data such as two-dimensional pictures and depth information.
And the server is used for performing three-dimensional reconstruction by adopting an artificial intelligence algorithm according to the data uploaded by the scanning equipment so as to generate a three-dimensional model of the scene. The three-dimensional reconstruction content comprises model repairing, clipping, cutting, face reducing, model reducing, compressing, material processing, mapping processing and lamplight processing. Preferably, the server is also used to generate links (e.g., URL links, etc.) to the three-dimensional model of the scene so that any browser-enabled computing device (including smartphones, tablets, laptops, smartwatches, smart televisions, computers, etc.) can access the three-dimensional model through the links. The server can be a background server, a cloud server and the like which can communicate with the scanning device in a wired or wireless mode. The three-dimensional model of the scene is composed of a plurality of point clouds (sets of points), so the server may also provide corresponding point cloud data after generating the three-dimensional model of the scene.
In some embodiments, the server is further configured to generate a two-dimensional house type map according to the point cloud data of the scene, so that a user can recognize and understand a house type corresponding to the three-dimensional model. Specifically, the server can divide the point cloud of each object in the scene from the point cloud data according to the relation between the point in the point cloud data and the adjacent point, and then perform intelligent identification by combining an artificial intelligence algorithm, so as to obtain the type of each object; and finally, generating a corresponding two-dimensional house type graph according to the intelligent identification result.
And the roaming module is used for performing three-dimensional roaming on the scene according to the three-dimensional model and displaying the corresponding two-dimensional house type graph. The two-dimensional user-type graph can be displayed while roaming, can be displayed before roaming or after roaming is finished, and can be flexibly selected according to the needs of users. The roaming module may be a device with data entry (for human-computer interaction) and presentation capabilities. Specifically, the display module may be implemented by any one of an AR display device, a VR display device, a mobile terminal, a tablet computer terminal, a PC computer terminal, an air screen, an LED display screen, an LCD display screen, an OLED display screen, an array display screen, and the like.
Based on the above hardware structure of fig. 1, various embodiments of the scenario roaming scheme of the present application are proposed.
Referring to fig. 2, fig. 2 is a flowchart of a scene roaming method based on three-dimensional modeling according to an embodiment of the present application. The scene roaming method includes but is not limited to the following steps:
s100, scanning to obtain three-dimensional data of a scene, and uploading the three-dimensional data to a server, wherein the three-dimensional data comprises two-dimensional pictures and depth information;
s101, generating a three-dimensional model of a scene and point cloud data of the scene by a server through an artificial intelligence algorithm according to the three-dimensional data;
s102, generating a two-dimensional indoor graph of a scene by a server through an artificial intelligence algorithm according to the point cloud data;
s103, roaming the scene according to the three-dimensional model, and displaying the two-dimensional house type graph.
Specifically, step S100 may be performed by the scanning device of fig. 1, steps S101 and S102 may be performed by the server of fig. 1, and step S103 may be performed by the roaming module of fig. 1.
The traditional two-dimensional house-type graph needs to be drawn by professional drawing personnel, and the requirement on the drawing personnel is high. Therefore, the two-dimensional house-type graph generation method based on the point cloud data is newly provided in the embodiment, the point cloud data which can be directly obtained through server modeling is combined with an artificial intelligence algorithm, the corresponding two-dimensional house-type graph is automatically generated for the user, the process of manual drawing is omitted, great convenience is brought to the user, and the requirements for the user are reduced.
Step S103 may be performed directly in a space formed by the three-dimensional model when the scene is roamed, and the user may perform any browsing or viewing (for example, switching viewing angles and viewing pictures) in the space during roaming, so as to obtain an immersive 360-degree blind-corner-free immersive viewing experience. In the process of roaming, the embodiment can also directly show which house type in the two-dimensional house type diagram the current roaming position or area belongs to, so that the user can conveniently know where in the two-dimensional house type diagram the current roaming is, and the user can avoid 'getting lost' in the space of the three-dimensional model.
In some embodiments, the scene roaming method may further include the steps of:
s104, acquiring a real-time video stream in a scene and uploading the real-time video stream to a server;
and S105, splicing and fusing the three-dimensional model of the scene and the real-time video stream into a three-dimensional real scene by adopting a texture mapping technology through the server.
Specifically, the real-time video stream in the scene may be a real-time video of any point, line, plane, or area in the scene, and the real-time video may be acquired in real time by a video acquisition device such as a CCTV closed-circuit television monitoring system.
In this embodiment, the Video Texture mapping technique may be used to fuse the real-time Video stream into the three-dimensional model, so as to obtain a three-dimensional real scene. The three-dimensional real scene can be displayed in the form of three-dimensional animation and the like. The three-dimensional live-action can dynamically display the 3D video stream of the scene in the three-dimensional model, overcomes the defect that the 3D model obtained by the traditional 3D scanning modeling technology is static, and really realizes the 3D live-action of the scene. The user can access the three-dimensional model of the scene and the 3D video stream dynamically played or displayed in the three-dimensional model through the link corresponding to the three-dimensional model. The embodiment truly realizes the seamless fusion of the 3D model and the real-time video stream by using the texture mapping technology, is not influenced by the change of scenes and the change of angles, and can still watch the real-time video stream in the 3D model after the scenes or the angles are changed.
In some embodiments, the step S102 of generating, by a server, a two-dimensional user-type map of a scene by using an artificial intelligence algorithm according to the point cloud data specifically includes:
s1021, segmenting the point cloud data to obtain point clouds of all objects in the scene;
s1022, intelligently identifying the point cloud of each object in the scene by the server through an artificial intelligence algorithm to obtain the type of each object in the scene;
and S1023, generating a two-dimensional indoor graph of the scene according to the intelligent identification result.
Specifically, after the point cloud data of the scene is acquired in step S1021, the point cloud data may be segmented according to the relationship (such as color, pixel, size, dimension, distance, and the like) between points and neighboring points, so as to generate a point cloud of each object in the scene according to the point cloud data.
In step S1021, the server may adopt an artificial intelligence algorithm to pre-train a model for identifying a point cloud type in combination with the input sample and the tag (for identifying a type of point cloud data in the sample). In this way, after the point clouds of the objects in the scene are obtained by segmentation, the point clouds can be identified by using the model even if the type of the point cloud of each object is unknown. In addition, the input sample can be point cloud data of a preset object, and can also be point cloud data of an object newly generated after training or recognition, so that the precision and the accuracy of the point cloud recognition model can be improved through continuous self-learning and updating during training.
Taking a scene as an example of a certain house, the type of each object in the scene may include a balcony, a kitchen, a dining room, a toilet, a living room, a study, a corridor, a living room, a main bed, a secondary bed, a cloakroom and the like; after the types of the point clouds are identified through the pre-trained point cloud identification model, the server can generate a two-dimensional house type picture containing a balcony, a kitchen, a dining room, a toilet, a living room, a study room, a corridor, a living room, a main-lying room, a secondary-lying room, a cloakroom and the like according to the identification result to serve as the two-dimensional house type picture of the house.
In some embodiments, the step S103 of navigating the scene according to the three-dimensional model and displaying the two-dimensional house type graph specifically includes:
s1031, acquiring the first input signal, and displaying a two-dimensional house type graph of a scene according to the first input signal;
s1032, acquiring a second input signal, and performing three-dimensional roaming in the three-dimensional model according to the second input signal, wherein the second input signal comprises at least one of a view angle or picture switching signal, an enlargement or reduction control signal, an angle rotation control signal and a roaming mode selection signal.
Specifically, in step S1031 or S1032, the selection or operation of the user in the three-dimensional model may be obtained as the input signal by a human-computer interaction device (such as a keyboard, a mouse, etc.) or a virtual button. When the roaming module acquires a first input signal for starting the display of the two-dimensional house type diagram, the two-dimensional house type diagram of the scene can be displayed on a screen or a display interface, and a user can conveniently and roughly know the scene and the house type of the scene. The roaming mode selection signal is used for selecting a roaming mode, the roaming mode comprises a manual roaming mode and an automatic roaming mode, the manual roaming mode requires a user to browse and watch in a space of the three-dimensional model through modes of manual clicking, touch control, dragging and the like, and the automatic roaming mode automatically displays the roaming according to a preset browsing sequence. The three-dimensional model can enter a space formed by the three-dimensional model by clicking a link and the like, and when a visual angle or picture switching signal, an amplification or reduction control signal and an angle rotation control signal are obtained, the operations of visual angle or picture switching, amplification or reduction, angle rotation and the like can be carried out on the three-dimensional model or any object in the three-dimensional model, so that a user can carry out 360-degree dead-angle-free immersive roaming watching in the space of the three-dimensional model.
In some embodiments, the second input signal further includes a click signal for a preset tag in the three-dimensional model, and the step S1032 of performing three-dimensional roaming in the three-dimensional model according to the second input signal specifically includes:
and when the click signal is detected, displaying the preset label in the three-dimensional model in a pop-up window mode, wherein the preset label comprises at least one of a video, a picture, a character and a model.
Specifically, in this embodiment, a tag may be added at any position or area of the three-dimensional model in advance, so that after the user selects the tag by clicking or the like, the tag may be automatically displayed in the form of video, picture, text, model or the like by means of a pop-up window, so as to facilitate operations such as introduction of an object in the three-dimensional model, and enhance the interactive experience.
In some embodiments, the step of navigating the scene according to the three-dimensional model specifically includes:
and acquiring a third input signal, and performing three-dimensional roaming in the three-dimensional live-action scene according to the third input signal, wherein the third input signal comprises a roaming mode selection signal, a visual angle switching signal, an amplification or reduction control signal and an angle rotation control signal.
Specifically, the embodiment may acquire, as an input signal, a selection or an operation of a user in a three-dimensional scene through a human-computer interaction device (such as a keyboard, a mouse, and the like) or a virtual button. The roaming mode selection signal is used for selecting a roaming mode, the roaming mode comprises a manual roaming mode and an automatic roaming mode, the manual roaming mode requires a user to browse and watch in the three-dimensional live-action scene in a manual clicking mode, a touch mode, a dragging mode and the like, and the automatic roaming mode automatically displays the roaming mode according to a preset browsing sequence. The three-dimensional real scene can be entered by clicking a link and the like, and when a visual angle or picture switching signal, an amplification or reduction control signal and an angle rotation control signal are obtained, the operations of visual angle or picture switching, amplification or reduction, angle rotation and the like can be carried out on the three-dimensional real scene or any object in the three-dimensional real scene, so that a user can carry out 360-degree dead-angle-free immersive roaming watching in the three-dimensional real scene.
In some embodiments, the step of performing three-dimensional roaming in the three-dimensional real scene according to the third input signal includes:
and when the three-dimensional roaming is carried out to the position or the area where the real-time video stream is located, automatically playing or displaying the real-time video stream.
Specifically, when the three-dimensional navigation is performed to the position or the area where the real-time video stream is located, the present embodiment may display the live real-time video of the position or the area for the user in a manner of automatically playing or displaying the corresponding real-time video stream, so that the user can obtain the live real-time viewing experience, and the 3D live-action video viewing is really realized.
Referring to fig. 3, an embodiment of the present invention further provides a scene roaming system based on three-dimensional modeling, including:
the scanning and data uploading module 200 is configured to scan and acquire three-dimensional data of a scene, and upload the three-dimensional data to a server, where the three-dimensional data includes a two-dimensional picture and depth information;
the automatic modeling module 201 is used for generating a three-dimensional model of a scene and point cloud data of the scene by a server through an artificial intelligence algorithm according to the three-dimensional data;
a two-dimensional house type graph generating module 202, configured to generate a two-dimensional house type graph of a scene by using an artificial intelligence algorithm through a server according to the point cloud data;
and the roaming module 203 is configured to roam the scene according to the three-dimensional model, and display the two-dimensional house figure.
Referring to fig. 4, an embodiment of the present invention further provides a scene roaming device based on three-dimensional modeling, including:
at least one processor 301;
at least one memory 302 for storing at least one program;
when executed by the at least one processor 301, causes the at least one processor to implement the three-dimensional modeling based scene roaming method as described above.
Embodiments of the present invention also provide a storage medium having stored therein processor-executable instructions, which when executed by a processor, are configured to perform the method for scene roaming based on three-dimensional modeling as described above.
The contents in the above method embodiments are all applicable to the present system, apparatus and storage medium embodiments, the functions specifically implemented by the present system, apparatus and storage medium embodiments are the same as those in the above method embodiments, and the advantageous effects achieved by the present system, apparatus and storage medium embodiments are also the same as those achieved by the above method embodiments.
While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. The scene roaming method based on three-dimensional modeling is characterized in that: the method comprises the following steps:
scanning to obtain three-dimensional data of a scene, and uploading the three-dimensional data to a server, wherein the three-dimensional data comprises a two-dimensional picture and depth information;
generating a three-dimensional model of a scene and point cloud data of the scene by a server through an artificial intelligence algorithm according to the three-dimensional data;
generating a two-dimensional indoor graph of the scene by a server through an artificial intelligence algorithm according to the point cloud data;
and roaming the scene according to the three-dimensional model, and displaying the two-dimensional house type graph.
2. The method of claim 1, wherein: further comprising the steps of:
acquiring a real-time video stream in a scene and uploading the real-time video stream to a server;
and splicing and fusing the three-dimensional model of the scene and the real-time video stream into a three-dimensional real scene by adopting a texture mapping technology through a server.
3. The method of claim 1, wherein: the step of generating a two-dimensional house type graph of a scene by a server through an artificial intelligence algorithm according to the point cloud data specifically comprises the following steps:
segmenting the point cloud data to obtain point clouds of all objects in the scene;
intelligently identifying the point cloud of each object in the scene by adopting an artificial intelligence algorithm through a server to obtain the type of each object in the scene;
and generating a two-dimensional indoor type graph of the scene according to the intelligent identification result.
4. The method of claim 1, wherein: the step of roaming the scene according to the three-dimensional model and displaying the two-dimensional house type graph specifically includes:
acquiring a first input signal, and displaying a two-dimensional floor plan of a scene according to the first input signal;
and acquiring a second input signal, and performing three-dimensional roaming in the three-dimensional model according to the second input signal, wherein the second input signal comprises at least one of a visual angle or picture switching signal, an amplification or reduction control signal, an angle rotation control signal and a roaming mode selection signal.
5. The method of claim 4, wherein: the second input signal further includes a click signal of a preset tag in the three-dimensional model, and the step of performing three-dimensional roaming in the three-dimensional model according to the second input signal specifically includes:
and when the click signal is detected, displaying the preset label in the three-dimensional model in a pop-up window mode, wherein the preset label comprises at least one of a video, a picture, a character and a model.
6. The method of claim 2, wherein: the step of roaming the scene according to the three-dimensional model specifically includes:
and acquiring a third input signal, and performing three-dimensional roaming in the three-dimensional live-action scene according to the third input signal, wherein the third input signal comprises at least one of a roaming mode selection signal, a visual angle switching signal, an enlargement or reduction control signal and an angle rotation control signal.
7. The method of claim 6, wherein: the step of performing three-dimensional roaming in the three-dimensional live-action scene according to the third input signal specifically includes:
and when the three-dimensional roaming is carried out to the position or the area where the real-time video stream is located, automatically playing or displaying the real-time video stream.
8. The scene roaming system based on three-dimensional modeling is characterized in that: the method comprises the following steps:
the scanning and data uploading module is used for scanning and acquiring three-dimensional data of a scene and uploading the three-dimensional data to a server, wherein the three-dimensional data comprises a two-dimensional picture and depth information;
the automatic modeling module is used for generating a three-dimensional model of a scene and point cloud data of the scene by adopting an artificial intelligence algorithm through a server according to the three-dimensional data;
the two-dimensional house-type graph generation module is used for generating a two-dimensional house-type graph of a scene by adopting an artificial intelligence algorithm through a server according to the point cloud data;
and the roaming module is used for roaming scenes according to the three-dimensional model and displaying the two-dimensional house type graph.
9. Scene roaming device based on three-dimensional modeling, its characterized in that: the method comprises the following steps:
at least one processor;
at least one memory for storing at least one program;
when executed by the at least one processor, cause the at least one processor to implement the method of scene roaming based on three-dimensional modeling according to any of claims 1-7.
10. Storage medium having stored therein processor-executable instructions for performing the method of scene roaming based on three-dimensional modeling according to any of claims 1-7 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911228157.9A CN111080799A (en) | 2019-12-04 | 2019-12-04 | Scene roaming method, system, device and storage medium based on three-dimensional modeling |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911228157.9A CN111080799A (en) | 2019-12-04 | 2019-12-04 | Scene roaming method, system, device and storage medium based on three-dimensional modeling |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111080799A true CN111080799A (en) | 2020-04-28 |
Family
ID=70312725
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911228157.9A Pending CN111080799A (en) | 2019-12-04 | 2019-12-04 | Scene roaming method, system, device and storage medium based on three-dimensional modeling |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111080799A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111583403A (en) * | 2020-04-28 | 2020-08-25 | 浙江科澜信息技术有限公司 | Three-dimensional roaming mode creating method, device, equipment and medium |
| CN111680402A (en) * | 2020-05-19 | 2020-09-18 | 广东交通职业技术学院 | Shield door fault visualization method, system, device and storage medium |
| CN111695424A (en) * | 2020-05-07 | 2020-09-22 | 广东康云科技有限公司 | Crime scene restoration method, crime scene restoration system and storage medium based on three-dimensional real scene |
| CN111695425A (en) * | 2020-05-07 | 2020-09-22 | 广东康云科技有限公司 | Crime scene marking method, system and storage medium based on three-dimensional real scene |
| CN111696193A (en) * | 2020-05-06 | 2020-09-22 | 广东康云科技有限公司 | Internet of things control method, system and device based on three-dimensional scene and storage medium |
| CN111696194A (en) * | 2020-05-07 | 2020-09-22 | 广东康云科技有限公司 | Three-dimensional visualization implementation method and system based on field investigation and storage medium |
| CN112102471A (en) * | 2020-08-25 | 2020-12-18 | 中国电建集团西北勘测设计研究院有限公司 | Method for manufacturing three-dimensional roaming |
| CN112462723A (en) * | 2020-12-07 | 2021-03-09 | 北京达美盛软件股份有限公司 | System for real-time control and visualization of digital factory under augmented reality environment |
| CN112634433A (en) * | 2020-12-07 | 2021-04-09 | 北京达美盛软件股份有限公司 | Real-time control and visualization system of digital factory |
| CN112764651A (en) * | 2021-02-01 | 2021-05-07 | 飞燕航空遥感技术有限公司 | Method and system for drawing three-dimensional point cloud profile of browser |
| WO2022121911A1 (en) * | 2020-12-07 | 2022-06-16 | 北京达美盛软件股份有限公司 | Virtual inspection system and visualized factory system in augmented reality environment |
| CN114900742A (en) * | 2022-04-28 | 2022-08-12 | 中德（珠海）人工智能研究院有限公司 | Scene rotation transition method and system based on video plug flow |
| CN114898076A (en) * | 2022-03-29 | 2022-08-12 | 北京城市网邻信息技术有限公司 | Model label adding method and device, electronic equipment and storage medium |
| CN114900743A (en) * | 2022-04-28 | 2022-08-12 | 中德（珠海）人工智能研究院有限公司 | Scene rendering transition method and system based on video plug flow |
| WO2022227293A1 (en) * | 2021-04-28 | 2022-11-03 | 广东三维家信息科技有限公司 | Texture mapping method, apparatus, electronic device, and storage medium |
| CN117576280A (en) * | 2023-07-12 | 2024-02-20 | 杭州雪爪文化科技有限公司 | Intelligent terminal cloud integrated generation method and system based on 3D digital person |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106548516A (en) * | 2015-09-23 | 2017-03-29 | 腾讯科技（深圳）有限公司 | Three-dimensional range method and apparatus |
| CN106683197A (en) * | 2017-01-11 | 2017-05-17 | 福建佳视数码文化发展有限公司 | VR (virtual reality) and AR (augmented reality) technology fused building exhibition system and VR and AR technology fused building exhibition method |
| CN108320334A (en) * | 2018-01-30 | 2018-07-24 | 公安部物证鉴定中心 | The method for building up of three-dimensional scenic roaming system based on cloud |
| CN108961152A (en) * | 2018-05-30 | 2018-12-07 | 链家网（北京）科技有限公司 | Plane house type drawing generating method and device |
| CN109918005A (en) * | 2019-01-21 | 2019-06-21 | 广东康云科技有限公司 | A kind of displaying control system and method based on mobile terminal |
| CN110223297A (en) * | 2019-04-16 | 2019-09-10 | 广东康云科技有限公司 | Segmentation and recognition methods, system and storage medium based on scanning point cloud data |
| CN110310306A (en) * | 2019-05-14 | 2019-10-08 | 广东康云科技有限公司 | Method for tracking target, system and medium based on outdoor scene modeling and intelligent recognition |
-
2019
- 2019-12-04 CN CN201911228157.9A patent/CN111080799A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106548516A (en) * | 2015-09-23 | 2017-03-29 | 腾讯科技（深圳）有限公司 | Three-dimensional range method and apparatus |
| CN106683197A (en) * | 2017-01-11 | 2017-05-17 | 福建佳视数码文化发展有限公司 | VR (virtual reality) and AR (augmented reality) technology fused building exhibition system and VR and AR technology fused building exhibition method |
| CN108320334A (en) * | 2018-01-30 | 2018-07-24 | 公安部物证鉴定中心 | The method for building up of three-dimensional scenic roaming system based on cloud |
| CN108961152A (en) * | 2018-05-30 | 2018-12-07 | 链家网（北京）科技有限公司 | Plane house type drawing generating method and device |
| CN109918005A (en) * | 2019-01-21 | 2019-06-21 | 广东康云科技有限公司 | A kind of displaying control system and method based on mobile terminal |
| CN110223297A (en) * | 2019-04-16 | 2019-09-10 | 广东康云科技有限公司 | Segmentation and recognition methods, system and storage medium based on scanning point cloud data |
| CN110310306A (en) * | 2019-05-14 | 2019-10-08 | 广东康云科技有限公司 | Method for tracking target, system and medium based on outdoor scene modeling and intelligent recognition |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111583403A (en) * | 2020-04-28 | 2020-08-25 | 浙江科澜信息技术有限公司 | Three-dimensional roaming mode creating method, device, equipment and medium |
| CN111696193A (en) * | 2020-05-06 | 2020-09-22 | 广东康云科技有限公司 | Internet of things control method, system and device based on three-dimensional scene and storage medium |
| CN111696193B (en) * | 2020-05-06 | 2023-08-25 | 广东康云科技有限公司 | Internet of things control method, system and device based on three-dimensional scene and storage medium |
| CN111695424A (en) * | 2020-05-07 | 2020-09-22 | 广东康云科技有限公司 | Crime scene restoration method, crime scene restoration system and storage medium based on three-dimensional real scene |
| CN111695425A (en) * | 2020-05-07 | 2020-09-22 | 广东康云科技有限公司 | Crime scene marking method, system and storage medium based on three-dimensional real scene |
| CN111696194A (en) * | 2020-05-07 | 2020-09-22 | 广东康云科技有限公司 | Three-dimensional visualization implementation method and system based on field investigation and storage medium |
| CN111680402A (en) * | 2020-05-19 | 2020-09-18 | 广东交通职业技术学院 | Shield door fault visualization method, system, device and storage medium |
| CN112102471A (en) * | 2020-08-25 | 2020-12-18 | 中国电建集团西北勘测设计研究院有限公司 | Method for manufacturing three-dimensional roaming |
| CN112634433A (en) * | 2020-12-07 | 2021-04-09 | 北京达美盛软件股份有限公司 | Real-time control and visualization system of digital factory |
| WO2022121911A1 (en) * | 2020-12-07 | 2022-06-16 | 北京达美盛软件股份有限公司 | Virtual inspection system and visualized factory system in augmented reality environment |
| CN112462723A (en) * | 2020-12-07 | 2021-03-09 | 北京达美盛软件股份有限公司 | System for real-time control and visualization of digital factory under augmented reality environment |
| CN112764651A (en) * | 2021-02-01 | 2021-05-07 | 飞燕航空遥感技术有限公司 | Method and system for drawing three-dimensional point cloud profile of browser |
| WO2022227293A1 (en) * | 2021-04-28 | 2022-11-03 | 广东三维家信息科技有限公司 | Texture mapping method, apparatus, electronic device, and storage medium |
| CN114898076A (en) * | 2022-03-29 | 2022-08-12 | 北京城市网邻信息技术有限公司 | Model label adding method and device, electronic equipment and storage medium |
| CN114900742A (en) * | 2022-04-28 | 2022-08-12 | 中德（珠海）人工智能研究院有限公司 | Scene rotation transition method and system based on video plug flow |
| CN114900743A (en) * | 2022-04-28 | 2022-08-12 | 中德（珠海）人工智能研究院有限公司 | Scene rendering transition method and system based on video plug flow |
| CN117576280A (en) * | 2023-07-12 | 2024-02-20 | 杭州雪爪文化科技有限公司 | Intelligent terminal cloud integrated generation method and system based on 3D digital person |
| CN117576280B (en) * | 2023-07-12 | 2024-04-19 | 杭州雪爪文化科技有限公司 | Intelligent terminal cloud integrated generation method and system based on 3D digital person |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111080799A (en) | Scene roaming method, system, device and storage medium based on three-dimensional modeling | |
| US11405549B2 (en) | Automated generation on mobile devices of panorama images for building locations and subsequent use | |
| KR20170105445A (en) | Configuration and operation of display devices including device management | |
| US10049490B2 (en) | Generating virtual shadows for displayable elements | |
| US10740870B2 (en) | Creating a floor plan from images in spherical format | |
| CN111448568B (en) | Environment-based application presentation | |
| US10735708B2 (en) | Transforming locations in a spherical image viewer | |
| US20150093029A1 (en) | Image layers navigation | |
| WO2023246189A1 (en) | Image information display method and device | |
| WO2023197780A1 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| WO2020214583A1 (en) | Augmented reality image retrieval systems and methods | |
| CN109743566A (en) | A kind of method and apparatus of the video format of VR for identification | |
| CN111696193B (en) | Internet of things control method, system and device based on three-dimensional scene and storage medium | |
| US20230043683A1 (en) | Determining a change in position of displayed digital content in subsequent frames via graphics processing circuitry | |
| US20220084299A1 (en) | Mobile device and mobile device control method | |
| CN112734905A (en) | Data management system suitable for interactive display of virtual venue | |
| Trapp et al. | Communication of digital cultural heritage in public spaces by the example of roman cologne | |
| US20230351706A1 (en) | Scanning interface systems and methods for building a virtual representation of a location | |
| RU2783218C1 (en) | Method and system for controlling display of virtual tours in multi-user mode | |
| US20240020910A1 (en) | Video playing method and apparatus, electronic device, medium, and program product | |
| US20230334791A1 (en) | Interactive reality computing experience using multi-layer projections to create an illusion of depth | |
| US20230334790A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation | |
| US20230334792A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation | |
| US20230326095A1 (en) | Overlaying displayed digital content with regional transparency and regional lossless compression transmitted over a communication network via processing circuitry | |
| Yasue et al. | Developing a Meta-AR Space Construction System and Mapping Coverage Visualization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |