EP4097686A1

EP4097686A1 - A system and method for visualization of glass products

Info

Publication number: EP4097686A1
Application number: EP21747335.4A
Authority: EP
Inventors: Sai TEJA V; Srihari KEZHEDATH; Rajadurai S; Sundaram D.R.; Ganesh AT
Original assignee: Saint Gobain Glass France SAS; Compagnie de Saint Gobain SA
Current assignee: Saint Gobain Glass France SAS; Compagnie de Saint Gobain SA
Priority date: 2020-01-27
Filing date: 2021-01-21
Publication date: 2022-12-07
Also published as: EP4097686A4; WO2021152612A1

Abstract

A system and method for visualization of glass products in real-time is disclosed. The method includes measuring dimension of a room by a hand-held measurement device. The room measurements are received by a server that triggers mapping of the measurements to related glass products. Thereafter, at least one selected glass product and parameters are received from a user through a graphical user interface of the computing device. The selected glass product made by the user is mapped to a catalogue glass product from a plurality of glass products stored in a database, where the chosen glass product is confirmed after verifying the glass products suited to the provided room measurements. A three-dimensional image of the chosen glass product is generated. Finally, th three-dimensional image of the chosen glass product is overlaid on the three-dimensional image of the room to create a panoramic and realistic 3D image of the product on a graphical user interface of the computing device. The method also includes providing one of a virtual display, augmented reality, and an immersive display of the glass product.

Description

A SYSTEM AND METHOD FOR VISUALIZATION OF GLASS PRODUCTS

Technical Field

[0001] The present disclosure relates generally to a method for glass product visualization, and particularly, relates to a method and system for generating and visualizing a virtual reality image of the glass products and more specifically to a visualization of a shower enclosure intended to be installed, based on measured dimensions of a room.

BACKGROUND

[0002] Recent developments in technologies have enabled us to purchase products in e- commerce websites by viewing 3D models of the products. Three-dimensional (3D) computer graphics refer to three -dimensionally expressing a model using geometric data stored in a computer, processing and outputting the three -dimensionally expressed model as a 2D resulting product. Apart from 3D visualization technique, there exist virtual reality, augmented reality techniques for products including furniture, clothing and the like.

[0003] However, the aforementioned techniques are neither prevalent nor explored in the glass industry. Visualization of glass products is quite complex and requires specialized templates. Further, the existing techniques of virtual reality does not consider precise measurements of a room for rendering images. Capturing the exact measurements of the room are required for glass products such as shower enclosures, kitchen shutters, windows, glass wardrobes etc., because these products redundant in case of any measurement mismatch. Typically, carpenters take measurements of the room manually. But these measurements cannot be used to render product images suited to those dimensions. Thus, there exists need for better visualization techniques that capture accurate measurements for installation of glass products.

[0004] A prior art, US20090153673 teaches a method and apparatus for measuring 3D graphical model using images. The method includes measuring optical and visual properties of the actual object to achieve similar properties in the 3D model. Further, the rendered output is analyzed to determine the variation in the product. However, the prior art does not teach about measuring actual properties of the room to generate a realistic image of the glass product intended to be installed in a room. [0005] Yet another prior art EP 1346323, teaches a method for electronically visualizing at least one product in a retail environment. The prior art teaches an input means for receiving user input concerning at least one product and processing means connected to the input means, the processing means comprising a first storage means for storing and retrieving visual information concerning at least one product. Further, the method includes displaying a 3D virtual object of at least one product. However, the prior art does not take into consideration the size and dimensions of the actual product required by the user, and room measurements before displaying 3D virtual object. Further, the prior art is not suited for glass industries where optical and visual characteristic alongside positioning of the glass product needs to be captured before rendering the 3D image.

[0006] Hence, we require a glass visualizing method and system that displays various glass products available in an inventory, in which the system is further configured to determine the precise dimensions of a room of a user / customer to display virtual image of the glass product suited to the measured dimensions of the room of the user / customer. Furthermore, it is required to have a glass visualizing system that enables the user to customize glass properties and visualize glass products in one of 3D image format, virtual reality format and / or an augmented reality format.

[0007] Other features and aspects of this disclosure will be apparent from the following description and the accompanying drawings.

Object of the invention

[0008] It is an object of the present invention to provide a glass visualization system and method that displays 3D or panoramic view of various glass products available in an inventory.

[0009] It is yet another object of the invention to provide a glass visualizing system that determines the precise dimensions of a room intended to be installed with selected glass product of a user / customer and further uses the dimensions to create a virtual image of the selected glass product suited to the said measured room dimensions.

[0010] It is another object of the present invention to provide a glass visualizing method that enables a user to customize glass properties and visualize glass products in one of 3D image format, virtual reality format and an augmented reality format. Summary

[0011] The present invention proposes a system that provides three-dimensional visualization of glass products suited to the dimensions of a room. The system overcomes the drawbacks of the prior art by capturing the precise dimensions of a room by using a measurement device. The measurement device is part of a portable mobile device and is coupled to a server.

[0012] According to an embodiment of the present invention, a method for visualization of glass products in real-time is disclosed. The method includes measuring room dimensions by a hand-held measurement device, wherein the measure room dimension is intended to be installed with a selected glass product. The room measurements are received by a server and trigger mapping of the measurements to related glass products from an inventory. Thereafter, at least one selected glass product and parameters are received from a user through a graphical user interface of a computing device. The user selected glass product is mapped to a specific product from a plurality of glass products stored in a database, where the specific product is confirmed after verifying the glass products suited to measurements. A three- dimensional image of the specific product is generated. Further, a three -dimensional image of the room is generated based on the measured dimensions of the room. Finally, the three- dimensional image of the specific product is overlaid on the three-dimensional image room to create a panoramic and realistic 3D image of the specific product on a graphical user interface of the computing device. The computing device displays the three-dimensional image the room installed with the specific product. The computing device is a portable device such as a mobile phone, tablet, and the like. The method also includes providing one of a virtual display, augmented reality, and an immersive display of the glass product.

[0013] According to an embodiment, the parameters received from the user include at least one of accessory information, design patterns, color combination, coating for glass, shower enclosure type, shape of the enclosure, door type and a combination thereof. The step of visualizing three-dimensional image of the product comprises overlaying a three- dimensional image of the glass product onto the real time image of the room to create a mixed reality image. The glass products comprise at least one of shower enclosure, window, kitchen shutters, wardrobes, planilaque, glass accessories and the like. The user is further enabled to select a coating type including hydrophobic coating, color or planilaque etc., for the glass product.

[0014] According to an embodiment, a system for visualization of glass products in real time is disclosed. The system includes a portable wireless measurement device to receive room measurements. A GPS sensor for identifying location information of the portable wireless measurement device. A computing device is communicably coupled to the portable wireless measurement device to receive the room measurements and trigger mapping of the measurement to related products. The system includes a user interface coupled to the computing device for visualization of the glass products. The portable wireless measurement device communicates through at least one of Wi-fi, Bluetooth, and other communication means.

[0015] Other features and aspects of this disclosure will be apparent from the following description and the accompanying drawings.

Brief Description of the Drawings

[0016] Embodiments are illustrated by way of example and are not limited in the accompanying figures.

[0017] FIG. 1 illustrates a block diagram of a system configured to visualize glass products in real-time, according to an embodiment of the present invention;

[0018] FIG. 2 illustrates a detailed block diagram of the first portable device 102;

[0019] FIG. 3 is a flowchart illustrating a method of visualization of glass products in real time; and

[0020] FIG. 4 illustrates an exemplary user interface present in the first portable device 102 and / or second portable device 108.

[0021] FIG. 5 illustrates positioning step of the system concerning visualization of shower enclosures.

[0022] Skilled artisans appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of embodiments of the invention. Detailed Description

[0023] The present invention is now discussed in more detail referring to the drawings that accompany the present application. In the accompanying drawings, like and/or corresponding elements are referred to by like reference numbers.

[0024] The shortcomings discussed in the background section are addressed by an improved glass visualizing system that displays 3D and / or panoramic view of various glass products available in an inventory. The glass visualizing system determines the precise dimensions of a room and further uses the measured dimensions of the room to create a virtual image of a glass product most suited to the measured room dimensions. The glass visualizing system of the present invention enables a user to customize and select a specific glass product based on glass properties and visualize the selected specific glass products in one of 3D image format, virtual reality format and an augmented reality format.

[0025] The glass visualization system is configured to communicate with a glass manufacturing/distribution center to retrieve inventory information of the available glass products therefrom and further update the inventory information on a portable device. A glass manufacturing/distribution center referenced herein relates to a manufacturing site and / or storage location and / or processing centers that manufacture, store and / or process glass products. A customer / user is typically enabled to select a glass product from the inventory and place an order for purchase of glass products through a portable device configured to receive and process said orders.

[0026] The manufacturing / distribution center then receives the orders from the customer / user through a network, wherein the orders correspond to varying types of glass products such as shower enclosure, kitchen shutter, window, wardrobe and the like. Following this, an order ID is generated and mapped to nearby distribution center based on the location of the customer / user.

[0027] The present invention relates to a system configured to process and visualize glass products in real-time such that the selection of glass products by the customer / user described above is facilitated and made user-friendly.

[0028] FIG. 1 illustrates a block diagram of system configured to visualize of glass products in real-time, according to an embodiment of the present invention. [0029] According to an embodiment of the present invention, a first portable device 102 is configured to receive user inputs through a graphical user interface. The user inputs include product selection and related parameters. The parameters received from the user include at least one of accessory information, design patterns, color combination, coating for glass and a combination thereof. The first portable device 102 is communicably coupled to a server 106. The first portable device 102 is configured to retrieve & display a list of glass products from the server. The first portable device 102 is also configured to receive customer information including name Firm name, Mobile, Email, Address, GST and PAN Number through the user interface.

[0030] According to an embodiment of the present invention, a measurement device 104 is configured to determine dimension a room intended to be installed with the selected glass product. The measurement information includes determining length, breath and width of the room. The measurement device 104 is a handheld device or a portable device. In an embodiment the measurement device 104 is coupled to the first portable device 102 either wirelessly or through a wired connection. In another embodiment, the measurement device 104 is coupled to the server 106. The measurement device 104 is configured to transmit measurement information to the server.

[0031] According to an embodiment of the present invention, the server 106 is configured to generate a 3-D image of the glass product selected by the user. The 3-D virtual image is generated in the server based on the order ID and the measurement received from the measurement device 104. A rendering file format is generated by the server from the output values (collected by measurement device). The rendering file format is applied to the glass products during three-dimensional modeling. The rendering file includes informa tion about the material properties and characteristics of the glass products. The server includes a processor that generates a 3D model by creating and exporting a 3D model of the desired glass product with its appropriate measured dimensions room where the glass product is intended to be installed. The processor is further configured to receive inputs from the customer / user through an input device 110 such as a virtual reality gadget.

[0032] User input includes rendering properties of the glass, transmission, angle of view, luminosity, color, lighting, specular reflection and diffusivity. Examples of virtual reality gadgets 110 include a microphone, a keyboard, a touch screen, a bar code reader, and a gesture unit. Thereafter, the processor positions the 3D model of the glass product in a specific camera angle and a standard layout of the room. The standard layout of the room is captured by a camera. Thus, the user is enabled to view an augmented reality image of the room with the 3D model of the glass product. In another embodiment, the 3D model of the glass product is overlaid on a dynamic environment generated by the processor. The environment is generated by defining room dimensions, tiles, color of room, and the like. The 3D model generated by the processor incorporates material properties, physical textures, render settings and actual measurements.

[0033] The server 106 is configured to store information corresponding to the product types received from the user. The server system generates an Order ID based on the user parameters. The Order ID includes information about the customer ID along with the category, product, thickness, length, width and quantity selected by the user. The order ID is further transmitted over the network to a nearest manufacturing/ distribution center.

[0034] According to an embodiment of the present invention, the glass product is a one of a shower enclosure, window, kitchen shutters, wardrobes, glass accessories and the like. According to another embodiment of the present invention, catalogue glass products herein refers to the glass product available in the manufacturing/ distribution centers as part of the inventory. According to another embodiment of the present invention, selected glass product is one of shower enclosure, window, kitchen shutters or wardrobes specifically selected by the user / customer that is suited to the measured dimensions of the room of the user / customer.

[0035] FIG. 2 illustrates a detailed block diagram of the portable device 102. According to an embodiment of the present invention, the portable device 102 includes a display component, input/output device and a processor. The processor identifies a customer using credentials. A display component displays information identifying the glass product. The display component communicates with the server (not shown in figure) to retrieve a list of types of Glass, glass product types and specifications of glass types present in a manufacturing center. The list of items that is displayed is updated continuously based on the inventory available at a manufacturing center. The portable device 102 also includes a 3D rendering module that is configured to retrieve templates of 3D models of the glass products. The 3D rendering module processes the 3D models of the glass products based on the measured dimension of a user’s room received from the measurement device 104. Further, the 3D rendering module captures the images of the room by a camera.

[0036] The second portable device 108 includes input/output device to receive inputs from the user and output the processed data. Example of the input/output device include touchscreen, keypad, display and the like. In another example, the first portable device 102 and the second portable device 108 are one and the same. The second portable device 108 wirelessly communicates with the server to retrieve virtual 3D images of selected glass products.

[0037] FIG. 3 is a flowchart illustrating a method of visualization of glass products in real time. The proposed method enables a customer to select desired list of glass products from a portable device for an augmented reality image of the product. The method discloses a visualization technique that captures accurate measurements of room intended to be installed with a specific glass products ordered by the user / customer.

[0038] According to an embodiment, the method includes the steps of measuring dimensions of a room by a hand-held measurement device (301). The room measurements are received by a server, which then triggers mapping of the measurements to related glass products (302) in an inventory linked to multiple glass manufacturing / distribution centers. Thereafter, at least one glass product selection and parameters are received from a user through a graphical user interface of the computing device (303). The product selection made by the user is mapped to a catalogue product from a plurality of products stored in a database, where the selected glass product is confirmed after verifying the products suited to measurements (304). A three-dimensional image of the selected glass product is generated by the server (305). The three-dimensional image is generated based on the optical characteristics of the glass. Further, a three-dimensional image of the room is generated based on the room measurements (306). Finally, the three-dimensional image of the selected glass product is overlaid on the three-dimensional image room to create a panoramic and realistic 3D image of the product on a graphical user interface of the computing device (307). In one example, the image of the room is captured by a camera using a AR device. The captured image is used as a standard layout for overlaying the rendered 3D image of the glass product. The computing device is a portable device such as a mobile phone, tablet, and the like. The method also includes providing one of a virtual display, augmented reality, and an immersive display of the glass product.

[0039] According to an embodiment, the parameters received from the user include at least one of accessory information, design patterns, color combination, coating for glass, shower enclosure type, shape of the enclosure, door type and a combination thereof. The parameters are mapped to an order ID and transmitted to a server. Further, additional specifications captured in the order ID comprises but not limited to product specifications, category, thickness, length, texture, coating, size, width and quantity of glass products. The order ID can additionally include information corresponding to the specifications such as glass texture, grinding pattern, mirroring pattern, window assembly specifications, lacquering pattern, and the like.

[0040] According to an embodiment, the 3-D virtual image is generated in the server based on the order ID and the measurement received from the measurement device. A rendering file format is generated by the server from the output values (collected by measurement device). The rendering file format is applied to the glass product during three-dimensional modeling. The rendering file includes information about the material properties and characteristics. A 3D model is generated by creating and exporting a 3D model of the desired glass product with its appropriate measured dimensions. Further, inputs are received from the user through the input device. User input includes rendering properties of the object, transmission, angle of view, luminosity, color, lighting, specularity and diffusivity. The input device communicates with the server through a wired or a wireless communication protocol. Thereafter, the 3D model of the selected product is overlaid on a standard layout of the room. The image of the room can be rendered based on measurements. In another embodiment, the image of the room is captured by a camera and the 2D image of the room is converted into a 3D image. Further, the 3D image of the selected product is positioned on the 3D image of the room to create a virtual reality image, that is precise and reflects actual properties of the glass product.

[0041] According to another embodiment, the step of visualizing three-dimensional image of the product comprises overlaying a three-dimensional image of the glass product onto the real time image of the room to create a mixed image. The glass products comprise at least one of shower enclosures, window, kitchen shutters, wardrobes, planilaque, glass accessories and the like. The user is enabled to select a coating type including hydrophobic coating, color of planilaque etc., for the glass product.

[0042] FIG. 4 illustrates an exemplary user interface present in the second portable device which in this embodiment is a mobile device. The interface provides item information retrieved from the manufacturing site through the server. Further, the user interface also displays the Order’s’ received from the user along with the product parameters and specifications. In multiple embodiments of the present invention, the camera of the mobile device is used in real-time to populate the rendered images of the selected glass product. Rendered images of multiple selected glass products can be saved in the second portable device 108 for visualization and comparison.

Examples

[0043] According to an exemplary embodiment of the present invention, a customer logs into a user interface of the first portable device 102 which in this case is a mobile device. Through the user interface the customer is enabled to select a particular ‘Product’ from a plurality of product listing available at manufacturing center. For example, the user selects one category of glass products ranging from shower enclosures, kitchen shutters, windows and glass wardrobes. Further, the customer selects criteria’s including but not limited to glass specifications, glass category, thickness, length, width and no. of sheets of glass panels etc. The customer details such as building type, block, floor, rooms are also captured in the user interface.

[0044] The user interface will also enable the customer to select at least one of a shower enclosure type, shape of shower enclosure including F shape, rectangular and the like, coating required for shower enclosure and accessories for shower enclosure. The accessories include doors, hinges, soap holder, tower holder, hand-shower holder, pipe fittings, electrical and digital fittings (FED, displays) and the like. Based on the customer selection, relevant products are displayed on the graphical user interface in the form of a virtual 3D image or panoramic 3D image or an augmented reality image as illustrated in FIG. 4.

[0045] In another example, the customer is enabled to select parameters such as color, finish of the hardware’s for visualization. Other parameters include matte, metallic finish for the accessories, shapes such as sharp edges, curved edges for the handles. [0046] According to an embodiment, the order placed by the user is received by the manufacturing center. Further, the product selected by the customer is shipped in one or more wooden craters or corrugated box.

[0047] It is to be understood that the example mentioned in Order ID can be extended to include any information corresponding to down-stream processes involved in glass, for example, glass texturing, attaching glass accessories, DGU specifications, TGU specifications, window assembly specifications and the like.

[0048] In an additional exemplary embodiment, the system further includes positioning choses for visualization of shower enclosures. In this step the user is prompted with a selection to be made to the type of shower enclosures to be installed from straight shower enclosures or L-shaped shower enclosures or pentagonal shower enclosures. Depending on the user selection product selection over a range of parameter options are displayed for each of the diagonal of glass i.e., diagonal 1 & diagonal 2 and the points of intersection as illustrated in FIG. 5. Again the camera of the mobile device is used in making the selection of diagonals and points of intersection from the camera view on the screen of the mobile device.

[0049] Although visualization of a shower enclosure is explained in detail, it should be understood that for other glass products such as windows, shutters and glass wardrobes the same steps are to be followed and the system uses the same process flow explained thereunder to visualize corresponding products. Nevertheless, the options provided to the user for these other product could vary slightly from the ones explained in the previous paragraphs. For example, for glass product category kitchen shutters the method and system described in the present invention should be modified to combine different individual units to one unit and be positioned during visualization according to the positioning step explained under the shower enclosure example.

[0050] Thus any minor adaptations to the above described method and system for inclusion of newer category of glass products or additional product specifications provided to the user are regarded to fall within the scope of the present invention. It is further understood that although the examples provided may have described certain preferred operations in details, they are provided primarily for teachings purposes only and do not in any manner restrict the scope of the present invention. [0051] Note that not all of the activities described above in the general description or the examples are required, that a portion of a specific activity may not be required, and that one or more further activities may be performed in addition to those described. Still, further, the order in which activities are listed is not necessarily the order in which they are performed. [0052] Benefits, other advantages, and solutions to problems have been described above with regard to specific embodiments. However, the benefits, advantages, solutions to problems, and any feature(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature of any or all the claims.

[0053] The specification and illustrations of the embodiments described herein are intended to provide a general understanding of the structure of the various embodiments. The specification and illustrations are not intended to serve as an exhaustive and comprehensive description of all of the elements and features of apparatus and systems that use the structures or methods described herein. Certain features, that are for clarity, described herein in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features that are, for brevity, described in the context of a single embodiment, may also be provided separately or in a sub combination. Further, reference to values stated in ranges includes each and every value within that range. Many other embodiments may be apparent to skilled artisans only after reading this specification. Other embodiments may be used and derived from the disclosure, such that a structural substitution, logical substitution, or another change may be made without departing from the scope of the disclosure. Accordingly, the disclosure is to be regarded as illustrative rather than restrictive.

[0054] The description in combination with the figures is provided to assist in understanding the teachings disclosed herein, is provided to assist in describing the teachings, and should not be interpreted as a limitation on the scope or applicability of the teachings. However, other teachings can certainly be used in this application.

[0055] While aspects of the present disclosure have been particularly shown and described with reference to the embodiments above, it will be understood by those skilled in the art that various additional embodiments may be contemplated by the modification of the disclosed machines, systems and methods without departing from the spirit and scope of what is disclosed. Such embodiments should be understood to fall within the scope of the present disclosure as determined based upon the claims and any equivalents thereof.

A SYSTEM AND METHOD FOR VISUALIZATION OF GLASS PRODUCTS

LIST OF ELEMENTS

102 First portable device

104 Measurement device

106 Server

108 Second portable device

110 Virtual reality gadget

Claims

CLAIMS I/We Claim:

1. A method for visualization of glass products in real-time, the method comprising the steps of: measuring dimension of a room by a hand-held measurement device, wherein the measured dimension of the room is intended to be installed with a selected glass product ; receiving the room measurements by a server triggering mapping of the measurements to related glass products; receiving at least one selected glass product and parameters from a user through a graphical user interface of a computing device; mapping the selected glass product to a catalogue glass product from a plurality of products stored in a database; generating a three-dimensional image of the selected glass product; generating a three-dimensional image of the room based on the measured dimension of the room; and visualizing a panoramic and / or realistic three-dimensional image of the selected glass product on a graphical display of the computing device; wherein the three- dimensional image of the selected glass product is displayed on the three-dimensional image of the room such that the room is installed with the selected glass product.

2. The method as claimed in claim 1, wherein the step of visualizing three -dimensional image of the specific product comprises overlaying a three-dimensional image of the selected glass product onto the real time image of the room to create a mixed reality image.

3. The method as claimed in claim 1, wherein the graphical display of the computing device is selected from a virtual display or an augment reality display or an immersive display of the selected product.

4. The method as claimed in claim 1, wherein the computing device is one of mobile phone or tablet or the like configured to process and visualize glass products.

5. The method as claimed in claim 1, wherein the glass products comprises at least one of shower enclosure, window, kitchen shutters, wardrobes, planilaque, glass accessories and the like.

6. The method as claimed in claim 1, wherein dimension of the room includes determining length, breath and width of the room

7. The method as claimed in claim 1, wherein the parameters received from the user include at least one of accessory information, design patterns, color combination, coating for glass product or a combination thereof.

8. The method as claimed in claim 1, wherein the parameters received from the user comprises accessory fittings, coating type, shower enclosure type, shape of the enclosure, door type, color and finish of the accessory and the like.

9. The method as claimed in claim 1, further enables the user to select a coating type including hydrophobic coating for the specific glass product.

10. The method as claimed in claim 1, wherein visualizing a panoramic and realistic three- dimensional image of the glass product includes reflecting actual properties of glass such as transmission and opacity.

11. The method as claimed in claim 1, further comprises the step of positioning of glass products when the selected glass product is a shower enclosure.

12. A system for visualization of glass products in real-time, the system comprising: a portable wireless measurement device to receive room dimension measurements; a GPS sensor for identifying location information of the portable wireless measurement device; a computing device communicably coupled to the portable wireless measurement device to receive the room measurements and trigger mapping of the measurement to related glass products; and a user interface coupled to the computing device for visualization of the glass products.

13. The system as claimed in claim 11, wherein the portable wireless measurement device communicates through at least one of Wi-fi, Bluetooth, and other communication means.