TW201812531A - System for building a virtual reality and an augmented reality and method thereof - Google Patents

Abstract

The invention relates to a system for building a virtual reality and an augmented reality and method thereof. The system comprises a 3-dimensional (3D) database and a virtual reality (VR) rendering module. The 3D database obtains a plurality of environment features information generated by a terminal device scanning a real space and provides a plurality of 3D styles and at least one 3D element to the terminal device for choosing. A graphics processing module of the 3D database builds a 3D model according to the plurality of environment features information. A graphics operating unit of the VR rendering module arranges one of the plurality of 3D styles and the at least one 3D element onto the 3D model to form a VR or augmented reality (AR) scene.

Description

   System and method for constructing virtual reality and augmented reality   

The invention relates to a system and a method for constructing a virtual reality and an augmented reality, in particular to a system and a method for constructing a virtual reality and an augmented reality that can select different style modes.

Traditionally, whether the homeowner or designer is measuring the internal structure of the house, they need to use a ruler and use actual measurements to draw the internal structure of the house objects. When the owner or designer wants to change the style of the interior structure of the house object, such as painting, re-decorating, and furnishing, etc., the color and style of the house object can only be changed after the interior structure is drawn. The choice and configuration of styles and the design and placement of upholstered furniture are cumbersome and tedious, and costly.

The conventional technology does not provide any effective and organized way for the homeowner or designer to draw the system and method of the internal structure of the house objects. It is also impossible to actually understand the lighting of the internal structure of the house objects. The owner or designer cannot know the proper style of the house objects in time.

In view of the fact that the conventional technology does not provide any effective and organized way for the homeowner or designer to map the internal structure of the house objects and methods, the present invention proposes a virtual reality and augmented reality construction. The installation system and method can effectively and quickly obtain the internal structure and lighting of the house objects, so that the homeowner or designer can provide real-time layout conditions when selecting multiple style modes, so that the homeowner or designer can Choose the appropriate style of the internal structure with proper basis to avoid tedious and lengthy processes and waste of money. In addition, according to the virtual reality and augmented reality construction system and method proposed by the present invention, it is possible to build a virtual reality and augmented reality viewing perspective, whether it is a homeowner, a designer, a house seller Or buyers can obtain the internal structure, lighting and style of the house objects in a timely manner through the viewing perspective of virtual reality and augmented reality, so as to facilitate understanding of suitable and appropriate furniture placement. In addition, according to the virtual reality and augmented reality construction system and method proposed by the present invention, a database for graphic processing virtualization can be built, with the dataization, diversification, and integration of house objects and style models. The variability makes the database of style patterns grow with time.

According to one of the embodiments described in the disclosure, a method for constructing a virtual reality and an augmented reality is provided, including: S101: obtaining a plurality of three-dimensional environmental feature information generated by scanning a real space from a terminal device; S103: Create a 3D model based on the 3D environmental feature information; S105: Select a 3D style and at least one 3D object; and S107: Set the 3D style and the at least one 3D object to the 3D The model composes a Virtual Reality (VR) or Augmented Reality (AR) scene.

According to one of the embodiments described in the disclosure, a system for constructing virtual reality and augmented reality is provided, which includes: a 3D database and a virtual reality rendering module. The 3D database is used to obtain multiple 3D environmental feature information generated by scanning a real space from a terminal device, and to provide multiple 3D styles and at least one 3D object to the terminal device for selection, the 3D The database includes a graphics processing module for establishing a 3D model based on the 3D environmental feature information. The virtual reality rendering module includes a graphics computing module for setting one of the three-dimensional styles and the at least one three-dimensional object to the three-dimensional model to form a virtual reality or augmented reality scene.

The three-dimensional environmental feature information generated by the terminal device scanning the real space includes: the terminal device generates a first image information and a first light source information by scanning the panorama at a central point of the real space.

The three-dimensional environmental feature information generated by the terminal device scanning the real space includes: S301: selecting any plane in the real space; S303: scanning the plane to obtain a first depth information and a first angle Information; S305: establishing a first adjacent relationship information of all points on the plane; S307: selecting any plane adjacent to the plane and establishing a first 3D relationship information between the plane and the selected adjacent plane; S309: Repeat S303, S305, and S307 until all planes in the real space are selected.

The 3D environmental feature information generated by the terminal device scanning the real space includes: S501: scanning a top surface and a ground surface of the real space; S503: obtaining a second depth information of the top surface and the ground surface And a second angle information; S505: establishing a second adjacent relationship information of the top surface and all points on the ground; S507: selecting any wall surface in the real space; S509: selecting a characteristic point of the wall surface to Obtaining a third depth information and a third angle information of the wall surface; S511: establishing a third phase of all points on the wall surface according to the second adjacent relationship information, the third depth information and the third angle information Neighbor relationship information; S513: Select any wall surface adjacent to the wall surface and establish a third 3-dimensional relationship information between the wall surface and the selected adjacent wall surface; S515: Repeat S509, S511, and S513 until all of the real space The wall surface is selected.

In order to further understand the technology, methods and effects adopted by the present invention to achieve the intended purpose, please refer to the following detailed description and drawings of the present invention. It is believed that the purpose, features and characteristics of the present invention can be deepened and specific It is understood, however, that the drawings and attachments are provided for reference and description only, and are not intended to limit the present invention.

1, 1’‧‧‧ real space

11‧‧‧Terminal device

13‧‧‧Internet

15‧‧‧3D database

17‧‧‧Virtual Reality Rendering Module

21-26, 31-38 ‧ ‧ ‧ turning point

151‧‧‧Graphics Processing Module

171‧‧‧Graphics Computing Module

B, B’‧‧‧ rear wall

C‧‧‧center

C’‧‧‧Top

F, F’‧‧‧ front wall

G, G’‧‧‧ ground

L, L’ ‧‧‧ left wall

R, R’‧‧‧ right wall

S101, S103, S105, S107, S301, S303, S305, S307, S309, S501, S503, S505, S507, S509, S511, S513, S515

FIG. 1 is a schematic diagram of an embodiment of a virtual reality and augmented reality construction system according to the present invention; FIG. 2 is a schematic diagram of multiple environmental information methods generated by a terminal device of the present invention scanning real space; FIG. 3 is a flow description An embodiment of a method for scanning multiple environmental information generated by a terminal device of the present invention to scan real space; FIG. 4 shows another schematic diagram of a method for scanning multiple environmental information generated by a terminal device of the present invention to scan real space; FIG. Another embodiment of the method for inventing a terminal device to scan multiple environmental information generated by a real space; the flow shown in FIG. 6 describes an embodiment of a method for constructing a virtual reality and an augmented reality according to the present invention.

Various exemplary embodiments will be described more fully hereinafter with reference to the accompanying drawings, in which some exemplary embodiments are shown. However, the inventive concept may be embodied in many different forms and should not be construed as limited to the exemplary embodiments set forth herein. Rather, these exemplary embodiments are provided so that this invention will be thorough and complete, and will fully convey the scope of the inventive concept to those skilled in the art. In the drawings, the sizes and relative sizes of layers and regions may be exaggerated for clarity. Similar numbers always indicate similar components.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various elements or signals, etc., these elements or signals should not be limited by these terms. These terms are used to distinguish one element from another, or a signal from another signal. In addition, as used herein, the term "or" may include, as appropriate, all combinations of any one or more of the associated listed items.

FIG. 1 is a schematic diagram of an embodiment of a virtual reality and augmented reality implementation system according to the present invention. The system for constructing virtual reality and augmented reality of the present invention includes a 3-dimensional database 15 and a virtual reality rendering module 17. The 3D database 15 includes a graphics processing module 151. One of the terminal devices 11 accesses the cloud server 15 through a network 13. The 3D database 15 can obtain multiple 3D environmental feature information generated by scanning a real space from the terminal device 11, and provide multiple 3D styles and at least one 3D object to the terminal device 11 for selection, and The graphics processing module 151 can establish a 3D model based on the 3D environmental feature information. The virtual reality rendering module 17 includes a graphics operation module 171 for setting one of the three-dimensional styles and the at least one three-dimensional object to the three-dimensional model to form a virtual reality or augmented reality. Scenes.

FIG. 2 is a schematic diagram showing a method for scanning multiple environmental information generated by a terminal device according to the present invention. As shown in Figure 2, the plane of the internal pattern of the house object includes front wall surface F, rear wall surface B, right wall surface R, left wall surface L, top surface (not shown), and ground G, among which the front wall surface F The rear wall surface B, the right wall surface R, and the left wall surface L may include windows, doors, wall lamps, and pendants. The top surface may include lamps and pendants. Furniture and ornaments may be placed on the ground G. The actual The house objects include various types of furniture and decorations, and the method for scanning multiple environmental information generated by the terminal device of the present invention to scan real space can directly scan the internal structure of the house objects when there are furniture and decorations, so as to obtain only the house objects The interior layout does not include all kinds of furniture and decorations. In order to clearly describe the multiple environmental information methods generated by the terminal device scanning the real space of the present invention, windows, doors, decorations, furniture, etc. are not shown. When the user holds the terminal device 11 and selects to scan the internal structure of the real space 1 such as a house object, the terminal device 11 includes a 3D camera function and a function of sensing and maintaining orientation to perform the depth of any plane in the space For angle measurement, the terminal device 11 may be a 3D camera including a gyroscope, or other electronic devices having the same functions or functions. Please refer to the flowchart shown in FIG. 3 at the same time to describe an embodiment of a method for scanning multiple pieces of environmental information generated by the terminal device of the present invention to scan real space. S301: Select any plane in the real space 1. For example, if the user holds the terminal device 11 first, he or she will face the front wall F for scanning. S303: Scan the plane to obtain a first depth information and a first angle information. For example, if the user performs the depth and angle of all points on the front wall F including the turning points 21, 22, 23, and 24 through the terminal device 11 measuring. S305: Establishing a first neighboring relationship information of all points on the plane, such as the user establishing the correlation of all points on the front wall F through the terminal device 11, and the simultaneous positioning and mapping (Simultaneous localization and mapping, SLAM) The positioning points are sequentially aligned with the turning points 21, 22, 23, and 24 on the edge of the front wall F to obtain point coordinates to establish adjacent relationship information. S307: Select any plane adjacent to the plane and establish a first three-dimensional relationship between the plane and the selected adjacent plane. After the scanning of the front wall F is completed, if the user can select the adjacent front wall The right wall surface R of the surface F is used to establish the three-dimensional relationship information of two adjacent wall surfaces. S309: Repeat S303, S305, and S307 until all planes in the real space 1 are selected. For example, the user selects the right wall R for scanning, that is, measures the depth and angle information of the right wall R including the turning points 23, 24, 25, and 26 of its edges, and then the user establishes the correlation of all points on the right wall R And the synchronous positioning and mapped positioning points are sequentially aligned with the turning points 23, 24, 25, and 26 on the edge of the right wall R, respectively, to obtain point coordinates to establish adjacent relationship information. After the measurement of the right wall R is completed, the user can then select the plane connected to the right wall R for scanning, such as the rear wall B, the ceiling, and the ground G to establish the 3D relationship information between the two adjacent walls. Repeat until all planes are selected and scanned.

In addition, as shown in FIG. 2, the method for scanning a plurality of environmental information generated by the terminal device of the present invention according to the present invention further includes: the terminal device 11 generates a first image by scanning the panorama at a center point C of the real space 1. Information and a first light source information. The user holds the terminal device 11 standing at the center point C of the internal pattern of the house object, and scans the panorama horizontally counterclockwise or clockwise and vertically counterclockwise or clockwise to obtain panoramic 720 degree image information and when the window is transparent Or light source information when lighting is on.

FIG. 4 shows another schematic diagram of a method for scanning a plurality of environmental information generated by a terminal device according to the present invention. As shown in FIG. 4, the plane of the internal pattern of the house object includes front wall F ', rear wall B', right wall R ', left wall L', top C ', and ground G', among which the front wall The surface F ', the rear wall B', the right wall R ', and the left wall L' may include windows, doors, wall lamps and pendants, etc. The top surface C 'may include lamps and pendants, etc., and the floor G' may Furnishings and furnishings, etc. The actual house objects include all kinds of furniture and furnishings, and the multiple environmental information methods generated by the terminal device scanning real space of the present invention can directly scan the house objects when there are furniture and furnishings The internal structure of the house achieves only the internal structure of the house objects without including all kinds of furniture and decorations. In order to clearly describe the multiple environmental information methods generated by the terminal device scanning the real space of the present invention, windows, doors, decorations, furniture, etc. are not shown. When the user holds the terminal device 11 and selects to scan the internal structure of the real space 1 ', such as a house object, the user is not limited to scanning at a certain point in the real space 1'. The terminal device 11 includes a 3D camera Function and the function of sensing and maintaining orientation to measure the depth and angle of any plane in space, the terminal device 11 may be a 3D camera including a gyroscope, or other electronic devices with the same function or efficacy. Please refer to the flowchart shown in FIG. 5 at the same time to describe another embodiment of the method for scanning multiple environmental information generated by the terminal device of the present invention in real space. The method for scanning multiple environmental information generated by the terminal device of the present invention to scan real space includes the following steps. S501: Scan a top surface and a ground of the real space. The user first scans the top surface C 'and the ground G' by holding the terminal device 11 first. S503: Obtain a second depth information and a second angle information of the top surface and the ground, as in the foregoing step S303, obtain the depth and angle information of the top surface C 'and the ground G'. S505: Establishing a second adjacent relationship information of the top surface and all points on the ground, as in the foregoing step S305, obtaining the correlation of all the points on the top surface C 'with the point coordinates of the turning points 31, 32, 33, and 34 on the edges thereof And the correlation of all points on the ground G 'and the point coordinates of the turning points 35, 36, 37, and 38 of its edges to establish adjacent relationship information, respectively. S507: Select any wall surface in the real space. For example, if the user holds the terminal device 11 and chooses to face the front wall surface F '. S509: Select a feature point of the wall surface to obtain a third depth information and a third angle information of the wall surface. For example, if the user clicks a feature point in the front wall surface F 'such as the turning point 31 on the terminal device 11 To get the depth and angle information of all points on the front wall F '. S511: Establish a third neighbor relationship information of all points on the wall according to the second neighbor relationship information, the third depth information, and the third angle information, such as according to the phases of the top surface C 'and the ground G'. The neighbor relationship information and the depth and angle information of the front wall surface F 'can find the neighbor relationship information between the correlation of all points on the front wall surface F' and the turning points 31, 32, 35, 36 of its edges. S513: Select any wall surface adjacent to the wall surface and establish a third 3-dimensional relationship between the wall surface and the selected adjacent wall surface. After the information of the front wall surface F is searched, if the user selects the adjacent front wall, The right wall surface R 'of the surface F' is used to establish the 3D relationship information of two adjacent wall surfaces. S515: Repeat S509, S511, and S513 until all the walls in the real space are selected. For example, the user selects the right wall surface R 'to scan, that is, finds the depth and angle information of all points on the right wall surface R' and the turning points 32, 33, 36, and 37 of the edges and the adjacent relationship information. After the measurement of the right wall R 'is completed, the user can select the plane connected to the right wall R' for scanning, such as the back wall B 'to establish the 3D relationship information between the two adjacent walls, and repeat this until All walls are selected and scanned.

The flowchart shown in FIG. 6 describes an embodiment of a method for constructing a virtual reality and an augmented reality of the present invention. Referring to FIG. 1 at the same time, step S101: obtaining a plurality of three-dimensional environmental feature information generated by scanning a real space 1 from a terminal device 11, wherein the three-dimensional database 15 obtains three-dimensional environmental feature information from the terminal device 11. Including depth information, angle information, neighbor relationship information, 3D relationship information, panoramic 720-degree image information, light source information when the window is transparent or internal lighting is turned on, and other points cloud and synchronous positioning can be formed And mapping (SLAM) information. Step S103: Establish a 3D model based on the 3D environmental feature information, wherein the graphics processing module 151 calculates the information of the four point coordinates associated with each plane and the information of all the point coordinates to form the 3D environment to generate A 3D model drawing file, such as an AutoCad drawing file, a Splitworks drawing file, or a drawing file that supports existing 3D software. Step S105: Select a 3-dimensional style and at least one 3-dimensional object. The 3-dimensional database 15 provides multiple 3-dimensional styles and at least one 3-dimensional object to the terminal device 11 for the user to select. The device 11 selects one of the three-dimensional styles and the at least one three-dimensional object. Step S107: Set the 3D style and the at least one 3D object to the 3D model to form a virtual reality or augmented reality scene, wherein the virtual reality rendering module 17 can call the 3D database The 3D style and at least one 3D object selected by the user in 15 are used for image rendering of the 3D model, and the graphic operation module 171 directly performs physical simulation to set one of the 3D styles and the At least one 3-dimensional object to the 3-dimensional model to complete a virtual reality or augmented reality scene.

In summary, the virtual reality and augmented reality construction system and method of the present invention can effectively and quickly obtain the internal structure and lighting of the house objects, so that the homeowner or designer can choose multiple style modes It can provide real-time layout conditions, so that the homeowner or designer can choose the appropriate style of the internal layout with appropriate basis, and can also obtain the internal layout of the house objects in time through the viewing perspective of virtual reality and augmented reality. , Lighting, and styles, etc., in order to facilitate the understanding of suitable and appropriate furniture placement, and at the same time can build a database of graphic processing virtualization, with the data, diversity and variability of house objects and style models, The library of style patterns has grown over time.

The above descriptions are only the preferred and feasible embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent changes and modifications made in accordance with the scope of patent application of the present invention shall fall within the scope of the present invention.

Claims (12)

    A method for constructing virtual reality and augmented reality includes: S101: obtaining a plurality of 3D environmental feature information generated by scanning a real space from a terminal device; S103: establishing a 3D environmental feature information based on the 3D environmental feature information 3D model; S105: Select a 3D style and at least one 3D object; and S107: Set the 3D style and the at least one 3D object to the 3D model to form a virtual reality or augmented reality Scenes.         The method for constructing the virtual reality and the augmented reality according to claim 1, wherein the real space is an internal pattern of a house object.         The method for constructing a virtual reality and an augmented reality according to claim 1, wherein the three-dimensional environmental feature information generated by the terminal device scanning the real space includes: S301: selecting any one of the real space Plane; S303: scan the plane to obtain a first depth information and a first angle information; S305: establish a first neighboring relationship information of all points on the plane; S307: select any plane adjacent to the plane and Establish a first three-dimensional relationship between the plane and the selected adjacent plane; S309: Repeat S303, S305, and S307 until all planes in the real space are selected.         The method for constructing a virtual reality and an augmented reality according to claim 3, wherein the 3D environmental feature information generated by the terminal device scanning the real space further includes: The method of scanning the panorama generates a first image information and a first light source information.         The method for constructing virtual reality and augmented reality according to claim 1, wherein the three-dimensional environmental feature information generated by the terminal device scanning the real space includes: S501: scanning a top surface of the real space And a ground; S503: obtain a second depth information and a second angle information of the top surface and the ground; S505: establish a second adjacent relationship information of the top surface and all points on the ground; S507: select Any wall surface in the real space; S509: Select a feature point of the wall surface to obtain a third depth information and a third angle information of the wall surface; S511: According to the second neighbor relationship information and the third depth Information and the third angle information to establish a third adjacent relationship information of all points on the wall surface; S513: Select any wall surface adjacent to the wall surface and establish a third 3 between the wall surface and the selected adjacent wall surface. Dimensional relationship information; S515: Repeat S509, S511, and S513 until all the walls in the real space are selected.         The method for constructing the virtual reality and the augmented reality according to claim 1, wherein the terminal device includes a 3D camera function and a sensing and maintaining direction function.         A system for constructing virtual reality and augmented reality includes: a 3D database for obtaining multiple 3D environmental feature information generated by scanning a real space from a terminal device, and providing multiple 3D The terminal device is selected by a style and at least one 3-dimensional object. The 3-dimensional database includes: a graphics processing module for establishing a 3-dimensional model based on the 3-dimensional environmental characteristic information; and a virtual reality rendering model. The group includes a graphic operation module for setting one of the three-dimensional styles and the at least one three-dimensional object to the three-dimensional model to form a virtual reality or augmented reality scene.         The virtual reality and augmented reality construction system according to claim 7, wherein the terminal device includes a 3D camera function and a sensing and maintaining direction function.         The virtual reality and augmented reality construction system according to claim 7, wherein the three-dimensional environmental feature information generated from the terminal device scanning the real space includes: S301: selecting any of the real space A plane; S303: scan the plane to obtain a first depth information and a first angle information; S305: establish a first neighbor relationship information of all points on the plane; S307: select any plane adjacent to the plane A first three-dimensional relationship between the plane and the selected adjacent plane is established; S309: S303, S305, and S307 are repeated until all planes in the real space are selected.         The virtual reality and augmented reality construction system according to claim 9, wherein the three-dimensional environmental feature information generated by the terminal device scanning the real space further includes: the terminal device in the real space A center point generates a first image information and a first light source information by scanning the panorama.         The virtual reality and augmented reality construction system according to claim 7, wherein the three-dimensional environmental feature information generated by the terminal device scanning the real space includes: S501: scanning a top of the real space Surface and a ground; S503: obtaining a second depth information and a second angle information of the top surface and the ground; S505: establishing a second adjacent relationship information of the top surface and all points on the ground; S507: Select any wall surface in the real space; S509: Select a feature point of the wall surface to obtain a third depth information and a third angle information of the wall surface; S511: According to the second neighbor relationship information, the third Depth information and the third angle information, establish a third adjacent relationship information of all points on the wall surface; S513: Select any wall surface adjacent to the wall surface and establish a third surface wall and a selected adjacent wall surface. 3D relationship information; S515: Repeat S509, S511, and S513 until all walls in the real space are selected.         The virtual reality and augmented reality construction system according to claim 7, wherein the real space is an internal pattern of a house object.