AU2021101356A4

AU2021101356A4 - Method and system for virtual reality simulation of a structure

Info

Publication number: AU2021101356A4
Application number: AU2021101356A
Authority: AU
Inventors: Paul Condon; Greg Lane
Original assignee: Situ Systems Pty Ltd
Current assignee: Situ Systems Pty Ltd
Priority date: 2020-03-16
Filing date: 2021-03-16
Publication date: 2021-05-13
Anticipated expiration: 2029-03-16

Abstract

A machine-implemented method for a virtual reality simulation of a structure having various options. The method includes collecting structural plan data for the structure and storing same in a first database stored in at least one computer, the structural plan data comprising a 5 plurality of structural configurations. Then passing the structural plan data to a simulation model stored in the at least one computer, wherein at least a portion of the structural plan data is converted to a standardised set of data for generating a virtual reality simulation of the internal surfaces of the structure. The virtual reality simulation allowing for selectively viewing the plurality of structural configurations. The structural plan data includes data of at 10 least one asset in a low-resolution mesh, and during the conversion, the asset is replaced by a high-resolution mesh product. Dffnnn'7ATTnn/UD 1ln2l1' 3/3 12 22 10 20 SIMULATION SOFTWARE DATABASE SOFTWARE o 0 SIMULATION RAW DATA DATABASE DATABASE 11 21 50 BUILDER SIMULATION INTERNET AGENT 2 (a) 2(b) 100 BUYER BUYER BUYER 1(a) 1(b) 1(c) Fig. 3

Description

3/3

12 22 10 20

SIMULATION SOFTWARE DATABASE SOFTWARE

o 0 SIMULATION RAW DATA DATABASE DATABASE

11 21 50

BUILDER SIMULATION INTERNET AGENT

2 (a) 2(b)

100

BUYER BUYER BUYER

1(a) 1(b) 1(c)

Fig. 3

METHOD AND SYSTEM FOR VIRTUAL REALITY SIMULATION OF A STRUCTURE TECHNICAL FIELD

This invention relates to a machine implemented method and system for virtual reality simulation of a structure. In particular, the present invention is described with reference to a virtual reality simulation of a building structure and more particularly to home designs which are available in various options.

BACKGROUND

In the prior art it is common for a builder of homes to offer to its potential buyer various designs of homes. It is also typical that a particular home design, may be offered with various structural options. Examples of simple structural options found in the prior art are shown in Figs. 1 and 2.

Fig. 1 depicts an example basic home plan, where the home is shown having the following structural options, kitchen (large or small), garage (single or double) and bedrooms (two is bedroom or three bedroom), and a possible resultant optioned home selected by a buyer has three bedrooms, single garage and a large kitchen. In Fig. 2, a home labelled "Hilton Home" is shown in a basic schematic floor plan view, with the garage being optional as single or double, so that the Hilton Home is shown in two variants (options), namely as a single garage configuration and a double garage configuration.

Builders, architects, engineers and designers typically use known software applications such as ARCHICADTM or Autodesk RevitTM to prepare plans with 3D models for structures including buildings and homes. These software applications typically utilise Industry Foundation Classes (IFC) data model intended to describe architectural, building and construction data, which is a "platform neutral" open file format specification. The IFC data is used in building information

modelling but it cannot be used to create a 3D virtual reality simulation. Furthermore, most building models include representations of "assets", such as kitchen sinks and toilets which are of low resolution. For this reason, along with the limitations of the IFC, reliance has been placed on the use of 3D artists and architectural firms, typically using games technology to create a virtual reality preview of a home or other building.

P20007AUOO/FP 210316

Whilst a virtual reality preview of a home design offer by a home builder is known, its creation is time consuming and costly. Typically, a buyer must first select a house design, for which architectural plans are available. Structural options are then chosen such as "fourth bedroom or rumpus room" before other features are specified such as materials, colours, cabinetry style, fixtures and fittings. This set of plans with options and specified features is then typically sent to an internal 3D artist or architectural visualisation firm who will provide a 3D model to the specification, perhaps taking a week or two and at a substantial expense. Once that 3D model is sourced it can be used to provide a simulation of the home design for the given set of options, colours, fixtures and fittings applied to a single house plan.

The reason it is time consuming and costly to produce a home design simulation is three-fold. Firstly, the abovementioned IFC used in the known ARCHICADTM or Autodesk RevitTM software used by builders utilises a right-handed coordinate system, and the known 3D virtual reality software utilises a left-handed coordinate system. Secondly, each 3D home design simulation created is for a particular "optioned" home design and does not provide for the is structural option alternatives. Thirdly, where assets must be included in the simulation, the low-resolution asset information must be replaced by the 3D artists with a higher quality image, and again this does not provide for the structural option alternatives.

MatterportTM is a popular web service which generates virtual reality walk throughs from 360 degree photographs of existing houses. MatterportTM can provide a captivating virtual reality experience, however its primary limitation is that it can only provide that experience for a pre built house having a given set of options, fixtures and fittings that has already been photographed. This can be used to showcase a display home built by a builder, without the buyer attending the display home. However, the MatterportT M virtual reality walk through cannot offer alternative options such as colours and fixtures and fittings that can be made to that home.

There are software tools, such as My Virtual HomeTM and others, that allow people to design their own homes or visualise rooms in those homes. These software applications are generally built using games technology rather than construction industry standard CAD technology. They cannot integrate with existing builder workflow, notably when constructing from their own catalogue of designs and preferred suppliers, of for example cabinetry, and therefore is of little value to a builder of homes.

D'nnn'7ATTnn/UD 31n2l1'

None of the prior art provides a virtual reality simulation derived from a builder's existing workflow processes, catalogue of home plans (including the various structural options offered) and supplier products (assets) that may be offered with such homes.

The present invention seeks to ameliorate at least some of the problems associated with the prior art.

SUMMARY OF INVENTION

In a first aspect the present invention consists in a machine-implemented method for a virtual reality simulation of a structure having various options, the method including: collecting structural plan data for said structure and storing same in a first database stored in at least one computer, said structural plan data comprising a plurality of structural configurations; passing said structural plan data to a simulation model stored in said at least one computer, wherein at least a portion of said structural plan data is converted to a standardised set of data for generating a virtual reality simulation of the internal surfaces of said structure, and said virtual reality simulation allowing for selectively viewing said plurality of structural configurations.

Preferably said structural plan data is IFC building model data.

Preferably when a structural configuration is initially requested and generated, said structural configuration is stored in cached memory for later retrieval.

Preferably a previously generated structural configuration held in cached memory, may in real time be retrieved for said virtual reality simulation.

Preferably said structural plan data, includes data of at least one asset in a low-resolution mesh, and during said conversion, said asset is replaced by a high-resolution mesh product.

Preferably said high-resolution mesh product is stored in a database of high-resolution mesh products.

Preferably said structure is a home and said high-resolution mesh products are commercially available products.

Preferably said home has structural plan data which has at least some features provided in an agreed standard.

P20007AUOO/FP 210316

Preferably said structural configuration may be rendered by a rendering process providing for an optional list of finishes or themes.

Preferably said optional list of finishes or themes, includes paints, tiles, bricks and flooring.

Preferably said structure is a home, and said rendering process automatically generates and applies, skirting and cornice, lighting, and furniture specific to the room types of said home.

In a second aspect the present invention consists in a system for virtual reality simulation of a home on a web-based network, said system comprising: (i) at least a first computer operated on behalf of a simulation agent for the purpose of maintaining a web-based virtual reality simulation model using simulation software and a database for storing a standardised set of data for at least one home plan comprising a plurality of structural configurations; (ii) at least a second computer used by a builder to access said virtual reality software for providing a virtual reality simulation, wherein at least a portion of structural plan data for said home provided by said builder to said database is converted to said standardised set of data for generating said virtual reality simulation of the internal surfaces of said home; and (iii) at least a third computer used by a buyer to access said virtual reality simulation via a website associated with said builder to selectively view said home, said virtual reality simulation comprising a plurality of structural configurations.

Preferably said structural plan data of said home is IFC building model data.

Preferably when a structural configuration of said home is initially requested and generated by said buyer, said structural configuration is stored in cached memory for later retrieval via said simulation software.

Preferably a previously generated structural configuration held in cached memory, may in real time be retrieved by said buyer for said simulation software.

D'nnn'7ATTnn/UD 31n2l1'

Preferably said rendering process automatically generates and applies, skirting and cornice, lighting, and furniture specific to the room types of said home.

BRIEF DESCRIPTION OF DRAWINGS

Fig. 1 is a basic home plan having various kitchen, garage and bedroom configurations as options, with a selected configuration as home with single garage, three bedrooms and a large kitchen.

Fig. 2 is a basic home floor plan labelled as the "Hilton Home Basic" showing the home in two variants, as "Single Garage" and "Double Garage".

Fig. 3 is a diagrammatic view of a system for virtual reality simulation of homes offered by a builder made available to buyers over a web-based network.

BEST MODE OF CARRYING OUT THE INVENTION

In this specification the term "structure" is a building or other object that would typically involve its design using building modelling software typically used by builders, engineers, is architects and designers. The term "structure" includes within its meaning but is not limited to a domestic home, secondary or accessory dwelling unit, barn, shed and commercial building.

In this specification, the term "builder" is someone who offers for sale a structure which it builds or subcontracts to build for a potential buyer. The builder may be a company or a natural person.

In this specification "assets" means goods that the builder may source from other suppliers and may offer for sale as part of the offer for sale of the structure. In the following preferred embodiment directed to 3D simulation of home plans, the assets may include but not be limited to such items as kitchen sinks and tapfittings, bathtubs, toilets, fireplaces, showers, dishwashers, refrigerators/freezers, ovens and stoves.

In this specification "simulation agent" is the party responsible for creating, maintaining and administering the virtual reality (VR) simulation software and any databases associated therewith. The simulation agent may be a company or at least one natural person.

P20007AUOO/FP 210316

In this specification "real time" means the actual time at which the user is undertaking the virtual reality simulation, which in the preferred embodiment is a potential buyer undertaking virtual reality walkthrough of the home.

Overview of the method for virtual reality simulation of homes

A builder prepares home plans in a conventional format for example ARCHICADTM (which utilises IFC building model data). These home plans must have various floor plan (structural) options identified. Also, the intended manufacturers products, namely "assets" to be provided in high resolution such as kitchen sinks and tap fittings, bathtubs, toilets, fireplaces, showers, dishwashers, refrigerators/freezers, ovens and stoves etc must also be identified.

• These home plans are delivered electronically from the builder to VR simulation software operated maintained and administered by a simulation agent, namely by exporting their home plan files from their cad package into a particular format and uploading them to the VR simulation software.

• The home plans are then processed in the VR simulation software as follows: (i) geometry is converted into a more appropriate format for visualisation;

(ii) products (assets) and the low-resolution mesh for those products are isolated

- where a product is contained in a housing (e.g. a bath in a bath hob, a basin in a vanity, the housing is separated from the product.

- a hi-resolution product is matched with the low-resolution product using SKU code and substituted.

• Initially home features are identified using builder specific processing methods - e.g. the swing of doors; - the behaviour of bulkheads and drop ceilings; - identification of wet areas, carpeted areas etc. (This step may be eliminated should builders migrate to a single standard for this purpose)

• Builder incorporates "simulation viewing" software, provided via VR simulation software into their website.

D nn7ATTnn/UD 31n2 1A

A library (via a database) is provided via the simulation software to the builder that can be used to request and customise home configurations;

The builder is free to completely customise the web experience for their customers, so that no two builders web sites will look alike.

By carrying out these steps, the simulation agent is responsible for providing the VR simulation (visualisation) of the home, even though the visualisation may be viewed via the builder's website.

An end user, namely a prospective buyer requests a home configuration from the web site.

- The configuration includes a home name, a size, a facade type, zero or more options, a theme and a default room to load first;

- if the configuration has been generated previously - including by a pre-generation script that can be run - then the configuration is returned instantly (previously run configurations having been cached);

- if not, rendering programs take that configuration and render it;

- the rendered configuration is then returned from the rendering program to the web site and then in turn to the customer;

- the configuration is then cached for future access.

- Rendering

- rendering the home uses information gathered by processing with the simulation software

- Any selected floor plan options are applied

- "themes" which include a list of paints, tiles, brick types etc are applied

- Bricks are individually laid the same way a bricklayer would lay them on any brick surfaces

- skirting and cornice are applied automatically

- lighting is automatically generated and placed

- furniture is automatically placed specific to the room types

P20007AUOO/FP 210316

- Rendering then creates 360 panorama images taken from each room, and floor plans

Configuration

- this includes floor plans that includes icons for all furniture and fixtures;

- floor plans can be rotated or scaled, fonts and colours can be set;

- floor plans can be set to be clickable to select new room 360 panorama images;

- the swing and placement of all doors and windows;

- 360-degree equirectangular panorama images taken from each room in the home; and

- resolution of both floor plans and panorama images can be selected on request.

Additionally

- the product information gathered from processing the home plans may provide a very useful communication tool between the drafting and purchasing departments;

- this can be provided as a pivot table that shows exactly what products are used in what configurations of homes

A system embodiment for virtual reality simulation of homes

Fig. 3 depicts a first embodiment of a system 100, which allows for users on a web-based network over the Internet 50 to simulate a virtual reality walkthrough of a structure. In this embodiment the structure is a "domestic home" available from a builder, the home having various structural options, and various optional fixtures and fittings.

The simulation is for a potential "buyer" to have a virtual reality walkthrough of the home and allow that buyer to experience a VR simulation of the home in its various optional configurations. The buyer is able to selectively choose various options in real time, including structural options, fixtures, fittings, colours and assets of the home simulation.

Examples of simple structural options are shown in the earlier mentioned Figs. 1 and 2.

A plurality of users, five of which are shown in Fig. 3 (are shown with computer access) are users of a "web-based simulation network". Buyers 1(a)-I(c) are potential customers of a builder. Builder 2(a) is the actual builder, or an employee or sub-contractor of the builder. The

D nn7ATTnn/UD 31n2 1A

"web-based simulation network" is administered by simulation agent 2(b) (or its website administrator), via at least a first computer 10.

A simulation database 11 associated with simulation software (application) 12 reside on first computer 10 administered by simulation agent 2(b).

A "raw data" database 21 with associated database software 22 resides on another computer 20 and is also administered by the earlier mentioned administrator. Database 21 contains a relational database of the "raw data".

In this embodiment the raw data are the plans for building a home, hereinafter referred to as "home plans", with various configurations/options as uploaded from the builder 2(a) to raw data database 21 with the authorisation of the simulation agent 2(b). These home plans contain the structural data and include any structural options to the home design. For example, for the same basic home plans there may be the structural options of kitchen (large or small), garage (single or double) and bedrooms (two bedroom or three bedroom) as shown in Fig. 1. They also include low-resolution asset locations.

is In use, the builder's home plans have been created in a conventional format for example ARCHICADTM or Autodesk RevitTM (which utilises IFC building model data with a right handed coordinate system). These home plans as supplied by the builder in their supplied conventional format are not suitable for generating a virtual reality simulation.

Once in database 21, the home plans are then processed by simulation software 12 in at least a two-step process. Firstly, the IFC file is read and converted into a standardised data set, which preferably is in a left-handed coordinate system format suitable for use with UnityT M game engine software. As part of a sub-step, certain home features such as the swing of doors, the behaviour of bulkheads and drop ceilings, identification of wet areas, carpeted areas are identified using builder specific processing methods. However, this sub-step may be eliminated should builders migrate to a single agreed standard for such home features for this purpose. Secondly, low resolution products (assets), such as kitchen sinks and tap fittings, bathtubs, toilets, fridges, dishwashers and like and the low-resolution mesh for those products are isolated. Where a product is contained in a housing (e.g. a bath in a bath hob, a basin in a vanity), the housing is separated from the product. A high-resolution mesh product is matched with the low-resolution product using SKU code and substituted. Initially, the high-resolution mesh product substituted may be one selected as default product by builder 2(a).

P20007AUOO/FP 210316

This hi-resolution product (asset) is contained within database 21 in a "table" of supplier's products. In use, the simulation agent will create and maintain this table of supplier's products and ensure the hi-resolution model of the product is suitable for use by the simulation software12. Preferably the various supplier's products, are categorised by model, style, colour size etc. Further details of how this table of supplier's products is used will be described later.

VR simulation software 12 makes available to builder 2(a), a "simulation viewing" software (not shown) for use on the builder's website (not shown).

A library (via database 21) is provided via simulation software 12 to builder 2(a) that can be used to request and customise home configurations. Builder 2(a) is free to completely customise the web experience for their customers, so that website is unique and not like that of other builders.

By carrying out these steps, simulation agent 2(b) is responsible for providing the VR simulation (visualisation) of the home, even though the visualisation may be viewed via the website (not shown) of builder 2(a).

In use, a prospective buyer, namely any of buyers 1(a)-1(c), by use of a computer can, via the website of builder 2(a), request (select) a particular "structural configuration" of a home being offered by builder 2(a). The "structural configuration" includes a home name, a size, a facade type, zero or more options, a theme and a default room to load first. If the configuration has been generated previously including by a pre-generation script that can be run, then the configuration is returned instantly. This is because previously run configurations have been stored in cache memory. If the requested configuration is not available from cache memory, rendering programs in simulation software 12 take that configuration and render it. This now rendered configuration is then returned from the rendering program of simulation software 12 and to the website of the builder 2(a), and then in turn via the simulation viewing software to buyer 1(a)-1(c) who has requested the particular home configuration. This particular home configuration when rendered for the first time, is then cached for future access.

What should be understood is that in order to provide a 3D virtual reality simulation to the buyer 1(a)-1(c) as 360-degree walkthrough, the home configurations generated only require the internal surfaces being viewed, such as walls, ceiling, and doorways. As such in the earlier mentioned processes to convert from builder's plans (IFC file) to a standardised data set, only those internal surfaces become part of the standardised data set. Any hidden detail, such as the

Df nnn'7ATfTnn/UD 31n21 internals of a brick-veneer wall, underside of floors are not necessary and stripped away. The only surfaces necessary to the standardised data are those to be rendered in the simulation for viewing.

When a particular "home configuration" is rendered, it uses information gathered by processing with the simulation software 12. This rendering includes the application of any selected floor plan options, "themes" which include a list of paints, tiles, brick types etc. Bricks are individually laid the same way a bricklayer would lay them on any brick surfaces. This rendering process automatically generates and applies, skirting and cornice, lighting, and furniture specific to the room types. Rendering then creates 360-degree panorama images taken from each room, and floor plans, with resolution of both floor plans and panorama images able to be selected on request.

The hi-resolution products (assets) that builder 2 (a) makes available to buyer 1(a)-1(c) will be specified by builder 2(a) for its particular homes. Whilst simulation agent 2(b) may within its table of products have a comprehensive range of supplier's products contained in database 21 is suitable for use in the simulation software, builder 2(a) specifies which products can be used with his home plans. This may be predicated by the builder having certain preferences for suppliers, certain product ranges and models suited to certain homes and options.

The product information gathered from processing the home plans, namely product (assets) requested for viewing by buyers 1(a)-i (c) may provide a very useful communication tool between the drafting and purchasing departments of builder 2(a). This product information can be provided as a "pivot" table to the builder 2(a) that shows exactly what products are used in what configurations of their homes as requested by buyers 1(a)-1(c).

An advantage of the system is that where previously generated home configurations have been generated and cached, a subsequent buyer 1(a)-1(c) requesting the same configuration, will in real time be able to undertake the virtual reality simulation, as the previously cached home configuration will be readily retrieved and presented for viewing.

In the present web-based system 100, builder 2(a) may have an online account that allows them access to the VR simulation software 12 administered by simulation agent 2(b). This online account may for example be accessible by a yearly or monthly subscription with said simulation agent 2(b) (or a not shown intermediate agent between said simulation agent 2(b) and said builder 2(a)), and provide the means for builder 2(a) to upload its home plan

P20007AUOO/FP 210316 configurations/options to database 21. The necessary customisable "simulation viewing" software (not shown) provided by VR simulation software 12 for use on the builder's website (not shown) would also be accessible via its earlier mentioned online account.

In the abovementioned system 100, it should be understood that the "computer" used by buyers 1(a)-1(c) may be any computing device able to access the builder's website by internet access, and may include, home or office computers, laptops, notebooks, tablets or smartphones, with or without a VR headset. For example, most prospective buyers would not have access to VR headsets, and therefore would simply view the VR simulation via the screen of their computing device. However, the builder may choose to provide a more detailed VR simulation to a prospective buyer via a VR headset connected to a computer with internet access at its office, showroom or at an organised presentation such as a home show or exhibition.

The terms "comprising" and "including" (and their grammatical variations) as used herein are used in an inclusive sense and not in the exclusive sense of "consisting only of'.

D nn7ATTnn/UD 31n2 1A

Claims

1. A machine-implemented method for a virtual reality simulation of a structure having various options, the method including: collecting structural plan data for said structure and storing same in afirst database stored in at least one computer, said structural plan data comprising a plurality of structural configurations; passing said structural plan data to a simulation model stored in said at least one computer, wherein at least a portion of said structural plan data is converted to a standardised set of data for generating a virtual reality simulation of the internal surfaces of said structure, and said virtual reality simulation allowing for selectively viewing said plurality of structural configurations.

2. A machine implemented method as claimed in claim 1, wherein said structural plan data is IFC building model data.

3. A machine implemented method as claimed in claim 1, wherein when a structural configuration is initially requested and generated, said structural configuration is stored in cached memory for later retrieval.

4. A machine implemented method as claimed in claim 3, wherein a previously generated structural configuration held in cached memory, may in real time be retrieved for said virtual reality simulation.

5. A machine implemented method as claimed in any of claims 1 to 4 wherein, said structural plan data, includes data of at least one asset in a low-resolution mesh, and during said conversion, said asset is replaced by a high-resolution mesh product.

6. A machine implemented method as claimed in claim 5, wherein said high-resolution mesh product is stored in a database of high-resolution mesh products.

7. A machine implemented method as claimed in claim 6, wherein said structure is a home, and said high-resolution mesh products are commercially available products.

8. A machine implemented method as claimed in claim 7, wherein said home has structural plan data which has at least some features provided in an agreed standard.

P20007AUOO/FP 210316

9. A machine implemented method as claimed in claims 3 or 4, wherein said structural configuration may be rendered by a rendering process providing for an optional list of finishes or themes.

10. A machine implemented method as claimed in claim 9, wherein said optional list of finishes or themes, includes paints, tiles, bricks and flooring.

11. A machine implemented method as claimed in claim 9, wherein said structure is a home, and said rendering process automatically generates and applies, skirting and cornice, lighting, and furniture specific to the room types of said home.

12. A system for virtual reality simulation of a home on a web-based network, said system comprising: (i) at least a first computer operated on behalf of a simulation agent for the purpose of maintaining a web-based virtual reality simulation model using simulation software and a database for storing a standardised set of data for at least one home plan comprising a plurality of structural configurations; is (ii) at least a second computer used by a builder to access said virtual reality software for providing a virtual reality simulation, wherein at least a portion of structural plan data for said home provided by said builder to said database is converted to said standardised set of data for generating said virtual reality simulation of the internal surfaces of said home; and (iii) at least a third computer used by a buyer to access to said virtual reality simulation via a website associated with said builder to selectively view said home, said virtual reality simulation comprising a plurality of structural configurations.

13. A system as claimed in claim 12 wherein, said structural plan data of said home is IFC building model data.

14. A system as claimed in claim 12, wherein when a structural configuration of said home is initially requested and generated by said buyer, said structural configuration is stored in cached memory for later retrieval via said simulation software.

15. A system as claimed in claim 14, wherein a previously generated structural configuration held in cached memory, may in real time be retrieved by said buyer for said simulation software.

D'nnn'7ATTnn/UD 31n2l1'

16. A system as claimed in any of claims 12 to 15 wherein, said structural plan data, includes data of at least one asset in a low-resolution mesh, and during said conversion, said asset is replaced by a high-resolution mesh product.

17. A system as claimed in claim 16, wherein said high-resolution mesh product is stored in a database of high-resolution mesh products.

18. A system as claimed in claims 14 or 15, wherein said structural configuration may be rendered by a rendering process providing for an optional list of finishes or themes.

19. A system as claimed in claim 18, wherein said optional list of finishes or themes, includes paints, tiles, bricks and flooring.

20. A system as claimed in claim 18, wherein said rendering process automatically generates and applies, skirting and cornice, lighting, and furniture specific to the room types of said home.

P20007AUOO/FP 210316