IL273037B1 - Augmented Reality System for Generating Formal Premises Designs - Google Patents

Augmented Reality System for Generating Formal Premises Designs

Info

Publication number
IL273037B1
IL273037B1 IL273037A IL27303720A IL273037B1 IL 273037 B1 IL273037 B1 IL 273037B1 IL 273037 A IL273037 A IL 273037A IL 27303720 A IL27303720 A IL 27303720A IL 273037 B1 IL273037 B1 IL 273037B1
Authority
IL
Israel
Prior art keywords
premises
dimensional
dimensional model
design
input
Prior art date
Application number
IL273037A
Other languages
Hebrew (he)
Other versions
IL273037A (en
IL273037B2 (en
Inventor
BAVASTRO Frederic
PEJIC Petar
Original Assignee
BAVASTRO Frederic
PEJIC Petar
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/533,993 external-priority patent/US10977859B2/en
Application filed by BAVASTRO Frederic, PEJIC Petar filed Critical BAVASTRO Frederic
Publication of IL273037A publication Critical patent/IL273037A/en
Publication of IL273037B1 publication Critical patent/IL273037B1/en
Publication of IL273037B2 publication Critical patent/IL273037B2/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/10Geometric CAD
    • G06F30/13Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/10Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • G06T17/205Re-meshing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/30Polynomial surface description
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/12Symbolic schematics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/18Details relating to CAD techniques using virtual or augmented reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/24Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/04Architectural design, interior design

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Architecture (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Structural Engineering (AREA)
  • Computational Mathematics (AREA)
  • Civil Engineering (AREA)
  • Evolutionary Computation (AREA)
  • Remote Sensing (AREA)
  • Algebra (AREA)
  • Mathematical Physics (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Description

AUGMENTED REALITY METHOD AND SYSTEM FOR DESIGN BACKGROUND OF THE INVENTION 1. Field of the invention This invention is directed to a method and system for aiding in design using augmented reality and virtual reality components. 2. Background of the Invention Many design tasks have seen only incremental improvements stemming from computerization. On the one hand, computerization has ended the days of manual drafting and re-drafting of designs. On the other hand, the steps which occur before the design stage are not significantly different than they would have been without a computer. Mainly, a rough sketch is entered into a formal system which then proceeds to perform the three­dimensional modeling.The entry of the initial design idea into a system is a considerable obstacle. The end user of the design software must become competent in use of the software. Different vendors take various approaches to the design input stage, and some are more successful at simplifying the task than others. However, the task of inputting the initial model of the design is an ever-present obstacle to many users beginning work on their design.One area where this is apparent is interior design software. While the details of operation have changed, and some features such as three dimensional modeling are quite impressive, inevitably the user of such design software is presented with a blank page at start. It is up to the end user to draft within the software the dimensions of the rooms, the placement of windows and doors, and so forth.
These initial steps have not changed since the first interior design software packages became available for sale on the market decades ago. Many users are discouraged when facing such a blank page. Other users that persevere and attempt to use the software may inadvertently use the design tools in an unintended way, resulting in a design that is frustratingly incorrect or entirely impossible. The system will attempt to model a design that does not follow best practices, is not safe, or is not commercially feasible. Users who invest considerable time to learn design software only to find out the resulting design is ineffectual will be discouraged from using any tool in the future.Previous attempts to solve this problem relied on ready-made templates which users then customize. While this solution will provide the users guidance to begin the work, it does not overcome the problems associated with learning an unfamiliar system. An additional tradeoff is that the users no longer have full flexibility in their design, without first extensively customizing the provided template. This significantly decreases the benefit of the design software. Eventually, in order to be able to create design which reflects the users’ ideas, the users must either significantly customize the starting template or re-work the design using the system input tools.Therefore, a need exists in the art for a system to simply the process of entering information into a software package. The system and method should use intuitive methods for every aspect of the design process, from adding the initial input to adding details to the initial input, and finally to revising the final design.US 2014/0267717 discloses a method for generating a floor plan of a room uses a mobile electronic device and a range finder to produce approximate and modified floor plans. The method includes receiving a plurality of strokes corresponding to walls in a room with a gesture input device, generating an approximate floor plan of the room based on the strokes, generating an approximate floor plan of the room with reference to the plurality of strokes, receiving an input gesture corresponding to one wall in the approximate floor plan of the room for measurement, receiving measurement data from a range finder corresponding to a dimension of the selected one wall, modifying the approximate floor plan with reference to the measurement data from the range finder, and generating with a display of the modified floor plan of the room.
US 2013/0179841 discloses a system and method for providing a virtual tour of a model property. In an embodiment, a computer-implemented method comprises providing one or more interactive three dimensional viewing modes for viewing the model property. An interactive user control is provided for moving between the one or more interactive three dimensional interactive viewing modes, wherein, the transition between one or more interactive three dimensional viewing modes is continuous. The one or more interactive three dimensional viewing modes may include a floor plan view mode, and a three dimensional room view mode, with a seamless transition in between giving the viewer a sensation of zooming into or out of a selected room. In another embodiment, an interactive first person walk-through view mode is provided whereby a user can interact with one or more features in a room. The user is able to modify a design of one or more features in the model based upon preferences of the user.US20110175916 discloses an animation system that can vectorize an image by generating, from an input drawing, a dataset corresponding to vector and digital representations of the input drawing such that a rendering engine could render an image having features in common with the input drawing from the representations, as a collection of strokes and/or objects rather than merely a collection of pixels having pixel color values. A vectorizer might receive an input image, generate a particle clustering data structure from a digitization of the input image, generate a stroke list, wherein strokes in the stroke list correspond to clusters of particles represented in the particle clustering data structure, generate a graph structure that represents connections between strokes on the stroke list, and determine additional characteristics of a stroke beyond the path of the stroke, additional characteristics being stored such that they correspond to strokes. The strokes might be generated using global topology information.
SUMMARY OF THE INVENTION An object of the present invention is to provide a designer system and method that overcomes many of the limitations of the prior art.A further object of the present invention is to provide a system that generates formal designs. A feature of the present invention is that several sources of input are combined to arrive at a formal design. An advantage of the present invention is that no single input method is required to create a final design.Another object of the present invention is to provide a system and method for saving time during the design process. A feature of the present invention is that the method automates several design input tasks. An advantage of the present invention is that the end user of the system can be presented with a design input in a limited amount of time.Another object of the present invention is to provide a system and method that does not require prior knowledge of computer-aided design software. A feature of the present invention is that the software accepts input from the user in an informal way without requiring the user to learn how to manipulate the input design within the software. An advantage of the present invention is that the end user may begin interacting with the software’s analysis tools without first learning how to input the design into the software.An additional object of the present invention is to provide a system and method that allow an end user to input a design into the software without becoming familiar with the rules of design within a particular area. A feature of the present invention is that the software analyses the end user’s input and provides feedback regarding compliance with best design practices. An advantage of the present invention is that the software highlights best design practices for the end user as each best practice or industry standard is relevant to the end user’s design.Another object of the present invention is to provide a system and method of inputting a design to a computer-aided design package using intuitive mechanisms. A feature of the present invention is that an informal sketch by the user is used as the initial input of the design. An advantage of the present invention is that it obviates the need for formal input by the user.A further object of the present invention is to allow the end user to sketch an informal design away from a computer. A feature of the invention is that the informal sketch may be provided to the system as a photograph of a line drawing or a scan of a sketch on paper. An advantage of the present invention is that the end user does not have to draw the sketch on a computer screen nor does the invention require the use of a touch screen. Instead, the input occurs in a method most familiar for the end user and the most comfortable for the end user.Another object of the present invention is to provide a system which operates in any convenient form factor. A feature of the invention is that its interface is presented as a mobile application, in one embodiment. An advantage of the present invention is that it designs created within the system can be worked on anywhere the end user has access to even a small-screen mobile device.A further object of the invention is to provide a three-dimensional model of the input design. A feature of the invention is that the informal input sketch by the end user is converted to a three dimensional model of the design. An advantage of the invention is that system converts a rough sketch into a computer-readable 3d model.A further object of the invention is to provide a means to confirm the three dimensional model. A feature of the system is that in one embodiment the system­generated 3d model is superimposed using augmented reality back on the sketch by the end user. An advantage of the system is that the end user can see how the 3d model corresponds to the features drawn on the initial informal sketch.A further object of the invention is to provide a means to refine the design throughout the process. A feature of one embodiment of the system is that previews of iterations of the design are shown to the user and the user is provided with an opportunity to update the design. An advantage of the system is that the end user will not waste time modeling or otherwise undertaking a detailed design that has unintended features or other errors.A further object of the invention is to provide an environment to finalize a design. A feature of one embodiment of the system is that all design elements can be added within the system, as appropriate to the task. For example, where the system is modeling a residential property, the system includes a facility to add furniture to the 3d model. An advantage of the system is that it supports detailed designs using custom and pre-existing components.An additional object of the system is to facilitate creation of a final design. A feature of the system is that it provides suggestions to the end users on how to finalize the design. An advantage of the system is that it provides the end users with multiple choices for feature designs and suggests certain options depending on user preferences.A further object of the system is to provide a means for the end user to interact with the final design. A feature of the system is that it generates a photo-realistic virtual reality review of a finalized design. An advantage of the system is that it provides a customizable virtual reality environment for the final design.An additional benefit of the system is that it provides manufacturers for an easy way to showcase products suitable for an end users’ design. A feature of the invention is that it provides promotions of certain third party products within the design environment. A benefit of the system is that it allows for additional exposure for third party products by customers currently engaged in design tasks.Briefly, the present invention provides a system for designing an environment, the system comprising inputting into the system an informal two-dimensional rendering of the premises; analyzing said informal two-dimensional rendering; determining features found on the premises depicted by the two-dimensional rendering; generating a three-dimensional model of the premises; populating said three-dimensional rendering with interactive objects; and providing multiple views of the three-dimensional rendering containing interactive objects.
BRIEF DESCRIPTION OF THE DRAWINGS The invention together with the above and other objects and advantages will be best understood from the following detailed description of the preferred embodiment of the invention shown in the accompanying drawings, wherein: FIG. 1is a flow chart describing the operation of one embodiment of the invention; FIGS. 2A and 2Bdepict flow charts describing the details of the design modifica­tion step, in accordance with the features of the present invention; FIG. 3is a flow chart showing the details of the analysis stage; FIG. 4is an example of a user interface of one embodiment of the invention; FIGS. 5A-Cis an overview of the operation of one embodiment of the invention; FIG. 6depicts the output of one embodiment of the present invention; FIGS. 7A-Fdepict the steps of one embodiment of the invention; FIG. 8depicts a flowchart of another embodiment of the invention.

Claims (20)

- 23 - CLAIMS
1. A system for generating formal premises designs comprising: inputting an address into the system; retrieving for the system an informal rendering of the premises from a data store; analyzing said informal rendering; determining features found on the premises depicted by the rendering; automatically generating a three-dimensional model of the premises using only the informal rendering of the premises highlighting dangerous areas; populating said three-dimensional rendering with interactive objects; and providing multiple views of the three-dimensional rendering containing interactive objects.
2. The system of claim 1 wherein said inputting into the system comprises taking a photograph of a two-dimensional hand drawn sketch of a premises.
3. The system of claim 1 wherein said analysis occurs in a distributed computing platform.
4. The system of claim 1 wherein said analysis further comprises an augmented reality preview of the three dimensional model.
5. The system of claim 1 wherein said interactive objects comprise virtual versions of furniture, household fixtures, and decorative items.
6. The system of claim 1 wherein said three-dimensional rendering comprises defining windows and doors in the three-dimensional model.
7. A system for generating formal premises designs comprising: reading address information into the system; obtaining initial data for the system on basis of address information; inputting into the system data to represent one or more premises; analyzing said input to generate a three-dimensional model; modifying the three-dimensional model using augmented reality; - 24 - determining features found on the premises; automatically generating a final three-dimensional model of the premises using the initial data based on the address information; generating a photorealistic visualization of the premises; and previewing the photorealistic visualization of the premises.
8. The system of claim 7 wherein said inputting step comprises providing the system a photo of a 2-dimensional sketch on paper.
9. The system of claim 7 wherein said inputting step comprises providing the system a video of a 2-dimensional sketch on paper.
10. The system of claim 7 wherein said inputting step comprises reading an existing three-dimensional model as a baseline.
11. The system of claim 7 wherein said inputting step comprises importing a completed three-dimensional model.
12. The system of claim 7 wherein said modification of input step further comprises use of artificial intelligence to generate the three-dimensional model.
13. The system of claim 7 wherein said final three-dimensional model is populated by one or more interactive objects.
14. The system of claim 13 wherein said interactive objects comprise furniture and surface finishes to be customized by an end user of the system.
15. The system of claim 7 wherein said previewing of the photorealistic visualization occurs using augmented reality.
16. The system of claim 7 wherein said previewing of the photorealistic visualization occurs using virtual reality. - 25 -
17. The system of claim 7 wherein said analysis of input determines the type of each room depicted on the premises.
18. The system of claim 7 wherein said analysis of input confirms that each room depicted in the premises is a valid room.
19. The system of claim 7 wherein said analysis step requests user input to ensure proper detection of rooms within depicted premises.
20. The system of claim 7 wherein said analysis step comprises detection of doors and windows within the input design.
IL273037A 2019-08-07 2020-03-03 Augmented Reality System for Generating Formal Premises Designs IL273037B2 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US16/533,993 US10977859B2 (en) 2017-11-24 2019-08-07 Augmented reality method and system for design

Publications (3)

Publication Number Publication Date
IL273037A IL273037A (en) 2021-03-01
IL273037B1 true IL273037B1 (en) 2024-02-01
IL273037B2 IL273037B2 (en) 2024-06-01

Family

ID=72039583

Family Applications (1)

Application Number Title Priority Date Filing Date
IL273037A IL273037B2 (en) 2019-08-07 2020-03-03 Augmented Reality System for Generating Formal Premises Designs

Country Status (5)

Country Link
EP (1) EP4010836A1 (en)
CN (1) CN114365137A (en)
GB (1) GB2601959A (en)
IL (1) IL273037B2 (en)
WO (1) WO2021023812A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11651550B2 (en) * 2020-09-02 2023-05-16 Treadstone Media Labs Private Limited Artificial intelligence based methods and systems for generating 3-Dimensional model from 2-Dimensional humanoid sketches
CN113094791B (en) * 2021-04-13 2024-02-20 笔天科技(广州)有限公司 Building data analysis processing method based on matrix operation

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020180726A1 (en) * 2000-11-06 2002-12-05 Jianbo Shi Paper-based remote sketching system
US20110175916A1 (en) * 2010-01-19 2011-07-21 Disney Enterprises, Inc. Vectorization of line drawings using global topology and storing in hybrid form
US20130179841A1 (en) * 2012-01-05 2013-07-11 Jeremy Mutton System and Method for Virtual Touring of Model Homes
US20140267717A1 (en) * 2013-03-15 2014-09-18 Robert Bosch Gmbh System and Method for Generation of a Room Model
US20150302630A1 (en) * 2006-09-19 2015-10-22 Imagination Technologies, Limited Compacting results vectors between stages of graphics processing
US20170256096A1 (en) * 2016-03-07 2017-09-07 Google Inc. Intelligent object sizing and placement in a augmented / virtual reality environment
EP3489909A1 (en) * 2017-11-24 2019-05-29 Bavastro, Frederic Augmented reality method and system for design
US20190228115A1 (en) * 2018-01-19 2019-07-25 Autodesk, Inc. Building information design synthesis (bids)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011163351A2 (en) * 2010-06-22 2011-12-29 Ohio University Immersive video intelligence network
CN103970920A (en) * 2013-02-05 2014-08-06 周柏贾 Earthquake emergency exercise virtual simulation system
FR3004455B1 (en) * 2013-04-10 2015-03-27 Arkema France COMPOSITION BASED ON TRANSPARENT AND ANTISTATIC PMMA
CN104834784B (en) * 2015-05-13 2018-06-19 西南交通大学 A kind of railway, which is met an urgent need, assists rescue three-dimensional goods electronic sand map system
US10977859B2 (en) * 2017-11-24 2021-04-13 Frederic Bavastro Augmented reality method and system for design
CN109284343B (en) * 2018-07-25 2021-06-29 中国地震局地球物理研究所 Building map construction method and platform for disaster insurance

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020180726A1 (en) * 2000-11-06 2002-12-05 Jianbo Shi Paper-based remote sketching system
US20150302630A1 (en) * 2006-09-19 2015-10-22 Imagination Technologies, Limited Compacting results vectors between stages of graphics processing
US20110175916A1 (en) * 2010-01-19 2011-07-21 Disney Enterprises, Inc. Vectorization of line drawings using global topology and storing in hybrid form
US20130179841A1 (en) * 2012-01-05 2013-07-11 Jeremy Mutton System and Method for Virtual Touring of Model Homes
US20140267717A1 (en) * 2013-03-15 2014-09-18 Robert Bosch Gmbh System and Method for Generation of a Room Model
US20170256096A1 (en) * 2016-03-07 2017-09-07 Google Inc. Intelligent object sizing and placement in a augmented / virtual reality environment
EP3489909A1 (en) * 2017-11-24 2019-05-29 Bavastro, Frederic Augmented reality method and system for design
US20190228115A1 (en) * 2018-01-19 2019-07-25 Autodesk, Inc. Building information design synthesis (bids)

Also Published As

Publication number Publication date
WO2021023812A1 (en) 2021-02-11
GB2601959A (en) 2022-06-15
CN114365137A (en) 2022-04-15
GB202202932D0 (en) 2022-04-20
IL273037A (en) 2021-03-01
EP4010836A1 (en) 2022-06-15
IL273037B2 (en) 2024-06-01

Similar Documents

Publication Publication Date Title
US10580207B2 (en) Augmented reality method and system for design
EP2252951B1 (en) Automatically creating and modifying furniture layouts in design software
US11816395B2 (en) System for generating visualizations in emergencies
Wüest et al. Flexisketch: A mobile sketching tool for software modeling
Lau et al. Modeling-in-Context: User Design of Complementary Objects with a Single Photo.
US7672822B2 (en) Automated three-dimensional alternative position viewer
Dorsey et al. The mental canvas: A tool for conceptual architectural design and analysis
Keefe et al. Reimagining the scientific visualization interaction paradigm
US8843352B2 (en) System and methods facilitating interfacing with a structure design and development process
WO2016050082A1 (en) Platform for displaying three-dimensional image of a building and application system thereof
WO2020252352A1 (en) Data serialization extrusion for converting two-dimensional images to three-dimensional geometry
IL273037B1 (en) Augmented Reality System for Generating Formal Premises Designs
US20230325544A1 (en) Methods and apparatus for artificial intelligence conversion of a two-dimensional reference into a takeoff
Stefani et al. A web platform for the consultation of spatialized and semantically enriched iconographic sources on cultural heritage buildings
US11861267B2 (en) Interactive design tool for real-time architectural adaptation
Olivier et al. Nested Explorative Maps: A new 3D canvas for conceptual design in architecture
Wang et al. Progressive sketching with instant previewing
US8560957B2 (en) Data-driven interface for managing materials
Agrawal et al. HoloLabel: Augmented reality user-in-the-loop online annotation tool for as-is building information
Schmitt Classes of design-classes of tools
Piccolotto Sketchpad+: architectural modeling through perspective sketching on a pen-based display
US20230281349A1 (en) Computer-aided techniques for automatically generating designs that reflect design intents
Hecher et al. “Tangible Culture”–Designing virtual exhibitions on multi-touch devices
Erlemeier The development of a virtual reality based cad system for design review
WO2012162106A1 (en) System and methods facilitating interfacing with a structure design and development process