TWI588685B - System for building a virtual reality and an augmented reality and method thereof - Google Patents

Description

Virtual reality and augmented reality construction system and method thereof

The invention relates to a virtual reality and augmented reality construction system and a method thereof, in particular to a virtual reality and augmented reality construction system and method thereof, which can select different style modes.

Traditionally, whether the owner or the designer is measuring the internal structure of the house, it is necessary to use the ruler and through the actual measurement method to draw the internal structure of the house object. When the owner or designer wants to change the style of the interior of the house object, such as painting, re-decorating, and furniture, it is necessary to change the color and style after drawing the internal pattern of the house object. The choice and configuration of the style and the design and placement of the upholstered furniture are cumbersome and lengthy, and costly.

The prior art does not provide any effective and organized way for the homeowner or designer to map out the internal structure of the house object, nor can it actually understand the lighting pattern of the internal structure of the house object. The master or designer cannot understand the proper style of the house object in time.

The present invention is in view of the fact that the prior art does not provide any effective and organized means for the homeowner or designer to draw the internal pattern of the house object. This paper proposes a virtual reality and augmented reality construction system and its method, which can effectively and quickly obtain the internal pattern of house objects and lighting illumination, so that the owner or designer can provide immediacy when selecting multiple style modes. The layout of the house allows the owner or designer to choose the appropriate style of the internal structure with appropriate basis, avoiding the cumbersome and lengthy process and waste of money. In addition, according to the virtual reality and augmented reality construction system and method thereof according to the present invention, a virtual reality and an augmented reality viewing angle can be constructed, whether it is a homeowner, a designer, or a seller. Or the buyers can get the internal layout, lighting and style of the objects in time through the virtual reality and the augmented reality viewing angle, so as to facilitate the understanding of suitable and appropriate furniture placement. In addition, according to the virtual reality and augmented reality construction system and method proposed by the present invention, a data processing virtualization database can be built, and the data and diversity of the house object and the style pattern are Variability makes the style pattern database grow with time.

According to one of the embodiments described in the disclosure, a method for establishing a virtual reality and an augmented reality is provided, comprising: S101: obtaining a plurality of 3-dimensional environmental feature information generated by scanning a real space from a terminal device; S103: Create a 3-dimensional model according to the 3D environment feature information; S105: Select a 3-dimensional style and at least one 3-dimensional object; and S107: Set the 3-dimensional style and the at least one 3-dimensional object to the 3D Models are used to form a Virtual Reality (VR) or Augmented Reality (AR) scenario.

According to one of the embodiments described in the disclosure, a virtual reality and augmented reality building system is provided, including: a 3-dimensional database and a virtual reality rendering module. The 3-dimensional database is used for obtaining a plurality of 3-dimensional environmental feature information generated by scanning a real space from a terminal device, and providing a plurality of 3-dimensional styles and at least one 3-dimensional object for selecting the terminal device, the 3-dimensional database. The database includes a graphics processing module for establishing a 3-dimensional model based on the 3D environment feature information. The virtual reality rendering module includes a graphics computing module for setting one of the three-dimensional styles and the at least one three-dimensional object to the three-dimensional model to form a virtual reality or augmented reality scene.

The scanning, by the terminal device, the three-dimensional environment feature information generated by the real space includes: the terminal device generates a first image information and a first light source information by scanning a panoramic view at a central point of the real space.

The scanning, by the terminal device, the three-dimensional environment feature information generated by the real space includes: S301: selecting any plane in the real space; S303: scanning the plane to obtain a first depth information and a first angle Information; S305: establishing a first neighbor relationship information of all points on the plane; S307: selecting any plane adjacent to the plane and establishing a first 3-dimensional relationship information between the plane and the selected adjacent plane; S309: S303, S305 and S307 are repeated until all the planes in the real space are selected.

The scanning, by the terminal device, the three-dimensional environment feature information generated by the real space includes: S501: scanning a top surface of the real space and a ground; and S503: obtaining a second depth information of the top surface and the ground And a second angle information; S505: establishing a second neighbor relationship information of the top surface and all points on the ground; S507: selecting any wall surface in the real space; S509: selecting a feature point of the wall surface to Obtaining a third depth information and a third angle information of the wall surface; S511: establishing a third phase of all points on the wall surface according to the second adjacent relationship information, the third depth information, and the third angle information Neighbor relationship information; S513: selecting any wall adjacent to the wall surface and establishing a third 3-dimensional relationship information of the wall surface and the selected adjacent wall surface; S515: repeating S509, S511, and S513 until all in the real space The wall is chosen.

In order to further understand the technology, method and effect of the present invention in order to achieve the intended purpose, reference should be made to the detailed description and drawings of the present invention. The drawings and the annexed drawings are intended to be illustrative and not to limit the invention.

1, 1’‧‧ Real space

11‧‧‧ Terminal devices

13‧‧‧Network

15‧‧‧3 dimensional database

17‧‧‧Virtual Reality Rendering Module

21-26, 31-38‧‧‧ turning point

151‧‧‧Graphic Processing Module

171‧‧‧Graphics computing module

B, B’‧‧‧ After the wall

C‧‧‧ center point

C’‧‧‧ top

F, F’‧‧‧ front wall

G, G’‧‧‧ ground

L, L’‧‧‧ left wall

R, R’‧‧‧right wall

S101, S103, S105, S107, S301, S303, S305, S307, S309, S501, S503, S505, S507, S509, S511, S513, S515‧‧

1 is a schematic diagram showing an embodiment of a virtual reality and augmented reality building system of the present invention; FIG. 2 is a schematic diagram showing a method for scanning a plurality of environmental information generated by a terminal device according to the present invention; An embodiment of the method for scanning a plurality of environmental information generated by a real space in a terminal device of the present invention; FIG. 4 is another schematic diagram showing a method for scanning a plurality of environmental information generated by a real device in a real space according to the present invention; Another embodiment of a method for inventing a plurality of environmental information generated by a terminal device to scan a real space; the flow shown in FIG. 6 describes an embodiment of a method for constructing a virtual reality and an augmented reality of the present invention.

Various illustrative embodiments are described more fully hereinafter with reference to the accompanying drawings. However, the inventive concept may be embodied in many different forms and should not be construed as being limited to the illustrative embodiments set forth herein. Rather, these exemplary embodiments are provided so that this invention will be in the In the drawings, the size and relative sizes of layers and regions may be exaggerated for clarity. Similar numbers always indicate similar components.

It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements or signals and the like, such elements or signals are not limited by the terms. These terms are used to distinguish one element from another, or a signal and another. In addition, as used herein, the term "or" may include all combinations of any one or more of the associated listed items.

1 is a schematic diagram showing an embodiment of a virtual reality and augmented reality building system of the present invention. The virtual reality and augmented reality building system of the present invention includes a 3-dimensional resource The library 15 and a virtual reality rendering module 17. The 3-dimensional database 15 includes a graphics processing module 151. One of the terminal devices 11 accesses the cloud server 15 through a network 13. The 3D database 15 can obtain a plurality of 3-dimensional environment feature information generated by the terminal device 11 scanning a real space, and provide a plurality of 3-dimensional styles and at least one 3-dimensional object to select the terminal device 11, and The graphics processing module 151 can create a 3-dimensional model according to the three-dimensional environment feature information. The virtual reality rendering module 17 includes a graphics operation module 171 for setting one of the three-dimensional styles and the at least one three-dimensional object to the three-dimensional model to form a virtual reality or augmented reality. Scenes.

FIG. 2 is a schematic diagram showing a method for scanning a plurality of environmental information generated by a terminal device of the present invention by scanning a real space. As shown in Fig. 2, the plane of the internal pattern of the object has a front wall F, a rear wall B, a right wall R, a left wall L, a top surface (not shown), and a ground G, wherein the front wall F The rear wall B, the right wall R, and the left wall L may include windows, doors, wall lamps and ornaments, and the top surface may include lamps and ornaments, and the furniture and ornaments on the ground G may be provided. The house object includes various furniture and ornaments, and the plurality of environmental information methods generated by the terminal device of the present invention scan the real space can directly scan the internal pattern of the house object under the condition of furniture and decoration, so as to obtain only the house object. The interior layout does not include all kinds of furniture and ornaments. In order to clearly describe a plurality of environmental information methods generated by the terminal device of the present invention for scanning real space, windows, doors, ornaments, furniture, and the like are not shown. When the user holds the terminal device 11 and selects to scan the internal space of the real space 1 such as a house object, the terminal device 11 includes a 3-dimensional camera function and a sensing and maintaining direction function to perform depth in any plane in the space. And the angle measurement, the terminal device 11 may be a 3-dimensional camera including a gyroscope, or other electronic device having the same function or function. Referring to the flow shown in FIG. 3, an embodiment of the method for scanning a plurality of environmental information generated by the terminal device in the real space is described. The method for scanning the plurality of environmental information generated by the terminal device in the real space includes the following steps. S301: Select any plane in the real space 1, for example, the user handheld terminal device 11 first selects to face the front wall F for scanning. Description. S303: Scan the plane to obtain a first depth information and a first angle information. For example, the user performs the depth and angle of the turning points 21, 22, 23, and 24 of all the points on the front wall F including the edges thereof through the terminal device 11. measuring. S305: Establish a first neighbor relationship information of all points on the plane, for example, the user establishes the correlation of all points on the front wall F through the terminal device 11 and the Simultaneous localization and mapping (SLAM) The positioning points sequentially align the turning points 21, 22, 23 and 24 of the edge of the front wall F to obtain the point coordinates to establish the adjacent relationship information. S307: Select any plane adjacent to the plane and establish a first 3-dimensional relationship information between the plane and the selected adjacent plane. When the front wall F is scanned, the user may select an adjacent front wall. The right wall R of the face F is used to establish the 3-dimensional relationship information of the adjacent two walls. S309: Repeat S303, S305 and S307 until all the planes in the real space 1 are selected. For example, the user selects the right wall R to scan, that is, measures the depth and angle information of the right wall R including the turning points 23, 24, 25 and 26 of its edge, and then the user establishes the correlation of all points on the right wall R. And the synchronous positioning and the mapped positioning points are sequentially aligned with the turning points 23, 24, 25 and 26 of the right wall R edge respectively to obtain the point coordinates to establish the adjacent relationship information. After the measurement of the right wall R is completed, the user can select the plane connected to the right wall R to scan, such as the back wall B, the ceiling and the ground G to establish the 3-dimensional relationship information of the adjacent two walls. Repeat until all the planes are selected and the scan is complete.

In addition, as shown in FIG. 2, the method for scanning a plurality of environmental information generated by the terminal device of the present invention further includes: the terminal device 11 generates a first image by scanning a panoramic view at a center point C of the real space 1. Information and a first source of information. The user handheld terminal device 11 stands at the center point C of the internal pattern of the house object to perform horizontal counterclockwise or clockwise and vertical counterclockwise or clockwise scanning of the panoramic view to obtain panoramic 720 degree image information and when the window is transparent. Or the light source information when the light is on.

FIG. 4 is another schematic diagram showing a method for scanning a plurality of environmental information generated by a terminal device of the present invention in a real space. As shown in Figure 4, the plane of the internal pattern of the house object There are front wall F', rear wall B', right wall R', left wall L', top surface C' and ground G', of which front wall F', rear wall B', right wall R', left wall L' may include windows, doors, wall lamps and ornaments, etc. The top surface C' may include lamps and ornaments, etc. The furniture and ornaments may be placed on the ground G', and the actual housing items include Various types of furniture and ornaments, and the plurality of environmental information methods generated by the terminal device of the present invention scanning the real space can directly scan the internal pattern of the house object under the condition of furniture and decoration, so as to obtain only the internal pattern of the house object. Does not include all kinds of furniture and ornaments. In order to clearly describe a plurality of environmental information methods generated by the terminal device of the present invention for scanning real space, windows, doors, ornaments, furniture, and the like are not shown. When the user holds the terminal device 11 and selects to scan the real space 1', such as the internal pattern of a house object, wherein the user is not limited to scanning at a certain point in the real space 1', the terminal device 11 includes a 3-dimensional camera. The function and the sensing and maintaining direction function to perform depth and angle measurement of any plane in the space, the terminal device 11 may be a 3-dimensional camera including a gyroscope, or other electronic device having the same function or function. Another embodiment of the method for scanning a plurality of environmental information generated by the terminal device of the present invention by scanning the real space will be described with reference to the flow shown in FIG. The method for scanning a plurality of environmental information generated by a terminal device of the present invention in a real space includes the following steps. S501: Scanning a top surface and a ground of the real space, the user handheld terminal device 11 first scans the top surface C' and the ground surface G'. S503: Obtain a second depth information and a second angle information of the top surface and the ground, and obtain depth and angle information of the top surface C' and the ground surface G as the foregoing step S303. S505: Establish a second adjacent relationship information of the top surface and all points on the ground, and obtain the correlation of all points on the top surface C' and the point coordinates of the turning points 31, 32, 33, and 34 of the edge as in the foregoing step S305. And the correlation of all points on the ground G' and the point coordinates of the turning points 35, 36, 37 and 38 on the edge to establish the adjacent relationship information respectively. S507: Select any wall in the real space, such as the user holding the terminal device 11 to select the front wall F'. S509: Select a feature point of the wall surface to obtain a third depth information and a third angle information of the wall surface. For example, the user selects a feature point in the front wall surface F', such as a turning point 31, on the terminal device 11. , You can get the depth and angle information of all points on the front wall F'. S511: According to the second neighbor relationship information, the third depth information, and the third angle information, establish a third neighbor relationship information of all points on the wall, such as according to the top surface C' and the ground G' phase Neighbor relationship information and depth and angle information of the front wall F' can find the relationship between the correlation of all points on the front wall F' and the adjacent relationship between the turning points 31, 32, 35, 36 of the edge. S513: Select any wall surface adjacent to the wall surface and establish a third 3-dimensional relationship information between the wall surface and the selected adjacent wall surface. After completing the information search of the front wall surface F, if the user selects the adjacent front wall The right wall R' of the face F' is used to establish the 3-dimensional relationship information of the adjacent two walls. S515: S509, S511, and S513 are repeated until all the walls in the real space are selected. For example, the user selects the right wall R' to scan, that is, finds the depth and angle information and the adjacent relationship information of all the points on the right wall R' and the turning points 32, 33, 36 and 37 of the edges. After the measurement of the right wall R' is completed, the user can select the plane connected to the right wall R' to scan, for example, the rear wall B' to establish the 3-dimensional relationship information of the adjacent two walls, and thus repeat until All walls are selected and scanned.

The flow shown in Fig. 6 describes an embodiment of the virtual reality and augmented reality construction method of the present invention. Referring to FIG. 1 simultaneously, step S101: obtaining a plurality of 3-dimensional environment feature information generated by scanning a real space 1 from a terminal device 11 , wherein the 3D database 15 obtains 3D environment feature information from the terminal device 11 Including depth information, angle information, neighbor relationship information, 3D relationship information, panoramic 720 degree image information, light source information when the window is transparent or internal lighting is on, and other points cloud and synchronization positioning Information with mapping (SLAM). Step S103: Create a 3-dimensional model according to the three-dimensional environment feature information, wherein the graphics processing module 151 calculates information about the four-point coordinate-related constituent surface of each plane and all the point coordinates are associated with the information of the 3-dimensional environment to generate A 3D model image, such as an AutoCad file, a Splidworks file, or an image that supports existing 3D software. Step S105: Select a 3-dimensional style and at least one 3-dimensional object, wherein the 3-dimensional database 15 provides a plurality of 3-dimensional styles and at least one 3-dimensional object to the terminal device 11 for the user to select. The user selects one of the three-dimensional styles and the at least one three-dimensional object through the terminal device 11. Step S107: The 3D style and the at least one 3D object are set to the 3D model to form a virtual reality or an augmented reality scene, wherein the virtual reality rendering module 17 can invoke the 3D database. The user selects the 3D style and the at least one 3D object in 15 to perform image rendering of the 3D model, and the graphic operation module 171 directly performs physical simulation to set one of the 3D styles and the At least one 3-dimensional object to the 3-dimensional model to complete a virtual reality or augmented reality scene.

In summary, the virtual reality and augmented reality construction system and method thereof can effectively and quickly obtain the internal pattern of the house object and the lighting illumination, so that the owner or the designer selects multiple style modes. It can provide immediate layout, so that the owner or designer can choose the appropriate style of the internal structure with appropriate basis, or obtain the internal pattern of the house object through the virtual reality and the augmented reality viewing angle. Lighting, lighting styles, styles, etc., to facilitate the understanding of the appropriate and appropriate furniture placement, but also to create a database of virtualization of graphics processing, with the data, diversity and variability of housing objects and style patterns, Make the style pattern database grow with time.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent variations and modifications of the scope of the invention are intended to be within the scope of the invention.

S101, S103, S105, S107‧‧‧ steps

Claims (12)

A virtual reality and augmented reality construction method, comprising: S101: obtaining a plurality of 3-dimensional environment feature information generated by scanning a real space from a terminal device; S103: establishing a third-dimensional environment feature information according to the information a 3D model; S105: selecting a 3D style and at least a 3D object; and S107: arranging the 3D style and the at least one 3D object to the 3D model to form a virtual reality or augmented reality Scenes. The method for constructing a virtual reality and an augmented reality according to claim 1, wherein the real space is an internal pattern of a house object. The method for constructing a virtual reality and an augmented reality according to claim 1, wherein the scanning, by the terminal device, the three-dimensional environment feature information generated by the real space includes: S301: selecting any one of the real spaces a plane; S303: scanning the plane to obtain a first depth information and a first angle information; S305: establishing a first neighbor relationship information of all points on the plane; S307: selecting any plane adjacent to the plane and Establishing a first 3-dimensional relationship information of the plane and the selected adjacent plane; S309: repeating S303, S305, and S307 until all planes in the real space are selected. The method for constructing a virtual reality and an augmented reality according to claim 3, wherein the scanning, by the terminal device, the three-dimensional environmental feature information generated by the real space further comprises: at a central point of the real space The method of scanning the panorama generates a first image information and a first light source information. A virtual reality and augmented reality construction method as claimed in claim 1, wherein the final And scanning, by the end device, the three-dimensional environment feature information generated by the real space, comprising: S501: scanning a top surface of the real space and a ground; and S503: obtaining a second depth information of the top surface and the ground and a first Two angle information; S505: establishing a second adjacent relationship information of the top surface and all points on the ground; S507: selecting any wall surface in the real space; S509: selecting a feature point of the wall surface to obtain the wall surface a third depth information and a third angle information; S511: establishing a third neighbor relationship information of all points on the wall according to the second neighbor relationship information, the third depth information, and the third angle information S513: selecting any wall adjacent to the wall surface and establishing a third 3-dimensional relationship information between the wall surface and the selected adjacent wall surface; S515: repeating S509, S511, and S513 until all the walls in the real space are selected . The virtual reality and augmented reality construction method according to claim 1, wherein the terminal device includes a 3-dimensional camera function and a sensing and maintaining direction function. A virtual reality and augmented reality building system includes: a 3-dimensional database for obtaining a plurality of 3-dimensional environmental feature information generated by scanning a real space from a terminal device, and providing a plurality of 3-dimensional data The style and the at least one 3-dimensional object are selected for the terminal device, the 3-dimensional database includes: a graphics processing module, configured to establish a 3-dimensional model according to the 3-dimensional environment feature information; and a virtual reality rendering module The group includes: a graphics operation module, configured to set one of the three-dimensional styles and the at least one 3-dimensional object to the three-dimensional model to form a virtual reality or augmented reality scene. The virtual reality and augmented reality building system according to claim 7, wherein the terminal device includes a 3-dimensional camera function and a sensing and maintaining direction function. The virtual reality and augmented reality setting system according to claim 7, wherein the scanning of the real-space from the terminal device to generate the three-dimensional environment feature information includes: S301: selecting any of the real space a plane; S303: scanning the plane to obtain a first depth information and a first angle information; S305: establishing a first neighbor relationship information of all points on the plane; S307: selecting any plane adjacent to the plane And establishing a first 3-dimensional relationship information of the plane and the selected adjacent plane; S309: repeating S303, S305, and S307 until all planes in the real space are selected. The virtual reality and augmented reality setting system according to claim 9, wherein the scanning of the real-space space generated by the terminal device further includes: the terminal device in the real space A center point generates a first image information and a first source information in a manner of scanning a panorama. The virtual reality and augmented reality setting system according to claim 7, wherein the scanning of the real-space from the terminal device to generate the three-dimensional environment feature information includes: S501: scanning a top of the real space a surface and a ground; S503: obtaining a second depth information and a second angle information of the top surface and the ground; S505: establishing a second adjacent relationship information of the top surface and all points on the ground; S507: Selecting any wall in the real space; S509: selecting a feature point of the wall surface to obtain a third depth information and a third angle information of the wall surface; S511: Establish a third neighbor relationship information of all points on the wall according to the second neighbor relationship information, the third depth information, and the third angle information; S513: select any wall adjacent to the wall surface and Establishing a third 3-dimensional relationship information of the wall and the selected adjacent wall surface; S515: repeating S509, S511, and S513 until all the walls in the real space are selected. The virtual reality and augmented reality building system as claimed in claim 7, wherein the real space is an internal pattern of a house object.