EP4226607A1 - Appareil et procédés de visualisation de caractéristiques d'objets - Google Patents
Appareil et procédés de visualisation de caractéristiques d'objetsInfo
- Publication number
- EP4226607A1 EP4226607A1 EP21786702.7A EP21786702A EP4226607A1 EP 4226607 A1 EP4226607 A1 EP 4226607A1 EP 21786702 A EP21786702 A EP 21786702A EP 4226607 A1 EP4226607 A1 EP 4226607A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- video
- feature
- floor covering
- computing device
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims description 59
- 238000012800 visualization Methods 0.000 title abstract description 139
- 230000004044 response Effects 0.000 claims description 37
- 239000000463 material Substances 0.000 description 51
- 238000004891 communication Methods 0.000 description 40
- 239000003086 colorant Substances 0.000 description 13
- 230000015654 memory Effects 0.000 description 13
- 238000013461 design Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 9
- 229920000742 Cotton Polymers 0.000 description 6
- 238000013135 deep learning Methods 0.000 description 6
- 238000010801 machine learning Methods 0.000 description 6
- 239000004744 fabric Substances 0.000 description 5
- 238000009408 flooring Methods 0.000 description 5
- 230000003936 working memory Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 239000002023 wood Substances 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- -1 flooring Substances 0.000 description 2
- 239000010985 leather Substances 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000003973 paint Substances 0.000 description 2
- 240000005319 Sedum acre Species 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 239000000919 ceramic Substances 0.000 description 1
- 239000004567 concrete Substances 0.000 description 1
- 239000007799 cork Substances 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000010408 film Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 229920003023 plastic Polymers 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 239000011347 resin Substances 0.000 description 1
- 229920005989 resin Polymers 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000004575 stone Substances 0.000 description 1
- 239000004753 textile Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 125000000391 vinyl group Chemical group [H]C([*])=C([H])[H] 0.000 description 1
- 229920002554 vinyl polymer Polymers 0.000 description 1
- 239000012855 volatile organic compound Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/3147—Multi-projection systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3185—Geometric adjustment, e.g. keystone or convergence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
- H04N9/3194—Testing thereof including sensor feedback
Definitions
- the disclosure relates generally to systems for interior and exterior design and, more particularly, to the digital display of objects for interior and exterior design.
- design materials such as fabrics, flooring, paints, housewares, or any other design materials
- the design materials may be advertised to potential clients such as designers (e.g., interior or exterior designers) as well as end users (e.g., homeowners, businesses, etc.).
- Images of the materials may be displayed in magazines such as industry magazines, in showrooms, or at conferences, for example.
- Images of the materials may be also displayed on a website, such as a manufacturer's or supplier's website.
- videos that include the design materials may be displayed.
- a manufacturer or supplier of a design material may display a promotional video of their design materials to potential clients in a showroom.
- a computing device includes at least one processor.
- the at least one processor is configured to receive first data identifying a selection of at least one feature for at least one object. In response to receiving the first data, the at least one processor is configured to obtain a video-mapped image characterizing the at least one object with the at least one feature.
- the at least one processor is also configured to provide the video-mapped image to at least one projecting device, where the projecting device is configured to project the video-mapped image onto the at least one object.
- a system includes a room display, a projecting device configured to project images onto the room display, and a computing device communicatively coupled to the projecting device. The computing device is configured to display an image of a scene including at least one object.
- the computing device is further configured to receive first data identifying a selection of the at least one object and, in response to the received first data, provide for display a plurality of feature categories for the at least one object.
- the computing device is also configured to receive second data identifying a selection of a first feature category of the plurality of feature categories. In response to the received second data, the computing device is configured to provide for display a plurality of features corresponding to the first feature category.
- the computing device is configured to receive third data identifying a selection of a first feature of the plurality of features corresponding to the first feature category and, in response to the received third data, obtain a video-mapped image characterizing the at least one object with the first feature.
- the computing device is also configured to provide the obtained video-mapped image to the projecting device.
- a method includes receiving first data identifying a selection of at least one feature for at least one object. The method also includes, in response to receiving the first data, obtaining a video-mapped image characterizing the at least one object with the at least one feature. Further, the method includes providing the video-mapped image to at least one projecting device, where the projecting device is configured to project the videomapped image onto the at least one object.
- a method includes displaying an image of a scene including at least one object.
- the method also includes receiving first data identifying a selection of the at least one object and, in response to the received first data, providing for display a plurality of feature categories for the at least one object.
- the method further includes receiving second data identifying a selection of a first feature category of the plurality of feature categories.
- the method includes providing for display a plurality of features corresponding to the first feature category.
- the method includes receiving third data identifying a selection of a first feature of the plurality of features corresponding to the first feature category and, in response to the received third data, obtaining a video-mapped image characterizing the at least one object with the first feature.
- the method also includes providing the obtained video-mapped image to the projecting device.
- a non-transitory, machine-readable storage medium stores instructions that, when executed by at least one processor, cause the at least one processor to perform operations including receiving first data identifying a selection of at least one feature for at least one object.
- the operations also include, in response to receiving the first data, obtaining a video-mapped image characterizing the at least one object with the at least one feature. Further, the operations include providing the video-mapped image to at least one projecting device, where the projecting device is configured to project the video-mapped image onto the at least one object.
- a non-transitory, machine-readable storage medium stores instructions that, when executed by at least one processor, cause the at least one processor to perform operations including receiving first data identifying a selection of the at least one object and, in response to the received first data, providing for display a plurality of feature categories for the at least one object.
- the operations further include receiving second data identifying a selection of a first feature category of the plurality of feature categories.
- the operations include providing for display a plurality of features corresponding to the first feature category.
- the operations include receiving third data identifying a selection of a first feature of the plurality of features corresponding to the first feature category and, in response to the received third data, obtaining a video-mapped image characterizing the at least one object with the first feature.
- the operations also include providing the obtained video-mapped image to the projecting device.
- a computing device includes at least one processor.
- the at least one processor is configured to receive first data identifying a selection of at least one feature for a floor covering. In response to receiving the first data, the at least one processor is also configured to obtain a video-mapped image characterizing the floor covering with the at least one feature. Further, the at least one processor is configured to provide the video-mapped image to at least one projecting device, where the projecting device is configured to project the video-mapped image onto the floor covering.
- a method includes receiving first data identifying a selection of at least one feature for a floor covering. The method further includes, in response to receiving the first data, obtaining a video-mapped image characterizing the floor covering with the at least one feature. Further, the method includes providing the video-mapped image to at least one projecting device, where the projecting device is configured to project the video-mapped image onto the floor covering.
- a non-transitory, machine-readable storage medium stores instructions that, when executed by at least one processor, cause the at least one processor to perform operations including receiving first data identifying a selection of at least one feature for a floor covering. The operations further include, in response to receiving the first data, obtaining a video-mapped image characterizing the floor covering with the at least one feature. Further, the operations include providing the video-mapped image to at least one projecting device, where the projecting device is configured to project the video-mapped image onto the floor covering.
- FIG. 1 illustrates an object feature visualization system in accordance with some embodiments
- FIG. 2 illustrates an example of an object feature visualization computing device of the object feature visualization system of FIG. 1 in accordance with some embodiments
- FIG. 3A illustrates exemplary portions of the object feature visualization system of FIG. 1 in accordance with some embodiments
- FIG. 3B illustrates an example user interface that may be provided by the object feature visualization computing device of FIG. 2 in accordance with some embodiments;
- FIG. 4A illustrates an example of objects in a room display in accordance with some embodiments
- FIG. 4B illustrates example object feature visualizations of at least some of the objects in the room display of FIG. 4A in accordance with some embodiments
- FIG. 5A illustrates an example of objects in a room display in accordance with some embodiments
- FIG. 5B illustrates example object feature visualizations of at least some of the objects in the room display of FIG. 5A in accordance with some embodiments
- FIG. 6 illustrates an example method that may be performed by the object feature visualization system of FIG. 1 in accordance with some embodiments
- FIG. 7 illustrates another example method that may be performed by the object feature visualization system of FIG. 1 in accordance with some embodiments
- FIG. 8 illustrates yet another example method that may be performed by the object feature visualization system of FIG. 1 in accordance with some embodiments
- FIG. 9 illustrates an object feature visualization system in accordance with some embodiments.
- FIG. 10 illustrates an example method that may be performed by the object feature visualization system of FIG. 9 in accordance with some embodiments.
- FIG. 11 illustrates another example method that may be performed by the object feature visualization system of FIG. 9 in accordance with some embodiments.
- Couple should be broadly understood to refer to connecting devices or components together either mechanically, electrically, wired, wirelessly, or otherwise, such that the connection allows the pertinent devices or components to operate (e.g., communicate) with each other as intended by virtue of that relationship.
- FIG. 1 shows a block diagram of an object feature visualization system 100 that includes an object feature visualization computing device 102, a plurality of projectors 104A, 104B, 104C, 104D, 104E, and a database 116.
- Each projector may be, for example, a digital light processing (DLP) projector, a liquid crystal display (LCD) projector, or any other suitable image projecting device.
- DLP digital light processing
- LCD liquid crystal display
- Object feature visualization computing device 102 may be communicatively coupled to database 116 via communication network 118.
- Communication network 118 can be a WiFi® network, a cellular network such as a 3GPP® network, a Bluetooth® network, a satellite network, a wireless local area network (LAN), a network utilizing radio-frequency (RF) communication protocols, a Near Field Communication (NFC) network, a wireless Metropolitan Area Network (MAN) connecting multiple wireless LANs, a wide area network (WAN), or any other suitable network.
- Communication network 118 can provide access to, for example, the Internet.
- Object feature visualization computing device 102 may transmit data to, and receive data from, communication network 118.
- Object feature visualization computing device 102 may also be communicatively coupled to projectors 104, such as via a wired or wireless network. Although not indicated, in some examples object feature visualization computing device 102 is communicatively coupled to projectors 104 via communication network 118.
- Object feature visualization computing device 102 may include hardware or hardware and software for processing and handling information.
- object feature visualization computing device 102 may include one or more processors, one or more field- programmable gate arrays (FPGAs), one or more application-specific integrated circuits (ASICs), one or more state machines, digital circuitry, or any other suitable circuitry.
- object feature visualization computing device 102 may be, for example, a web server, an application server, a cloud-based server, a workstation, a laptop, a tablet, a mobile device such as a cellular phone, or any other suitable computing device.
- FIG. 2 illustrates more details of object feature visualization computing device 102.
- object feature visualization computing device 102 may include one or more processors 201 , a working memory 202, one or more input/output devices 203, an instruction memory 207, a transceiver 204, one or more communication ports 207, and a display 206, all operatively coupled to one or more data buses 208.
- Data buses 208 allow for communication among the various devices.
- Data buses 208 can include wired, or wireless, communication channels.
- Processor(s) 201 can include one or more distinct processors, each having one or more cores. Each of the distinct processors can have the same or different structure.
- Processors 201 can include one or more central processing units (CPUs), one or more graphics processing units (GPUs), application specific integrated circuits (ASICs), digital signal processors (DSPs), and the like.
- Processors 201 can be configured to perform a certain function or operation by executing code, stored on instruction memory 207, embodying the function or operation.
- processors 201 can be configured to perform one or more of any function, method, or operation disclosed herein.
- Instruction memory 207 can store instructions that can be accessed (e.g., read) and executed by processors 201 .
- instruction memory 207 can be a non-transitory, computer-readable storage medium such as a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory, a removable disk, CD-ROM, any non-volatile memory, or any other suitable memory.
- ROM read-only memory
- EEPROM electrically erasable programmable read-only memory
- flash memory a removable disk
- CD-ROM any non-volatile memory, or any other suitable memory.
- Processors 201 can store data to, and read data from, working memory 202.
- processors 201 can store a working set of instructions to working memory 202, such as instructions loaded from instruction memory 207.
- Processors 201 can also use working memory 202 to store dynamic data created during the operation of object feature visualization computing device 102.
- Working memory 202 can be a random access memory (RAM) such as a static random access memory (SRAM) or dynamic random access memory (DRAM), or any other suitable memory.
- RAM random access memory
- SRAM static random access memory
- DRAM dynamic random access memory
- Input-output devices 203 can include any suitable device that allows for data input or output.
- input-output devices 203 can include one or more of a keyboard, a touchpad, a mouse, a stylus, a touchscreen, a physical button, a speaker, a microphone, or any other suitable input or output device.
- Communication port(s) 207 can include, for example, a serial port such as a universal asynchronous receiver/transmitter (UART) connection, a Universal Serial Bus (USB) connection, or any other suitable communication port or connection.
- the communication port(s) 207 allows for the programming of executable instructions in instruction memory 207.
- the communication port(s) 207 allow for the transfer (e.g., uploading or downloading) of data, such as material data stored about materials displays by the object feature visualization computing device 102.
- Display 206 can display user interface 205.
- User interfaces 205 can enable user interaction with object feature visualization computing device 102.
- user interface 205 can be a user interface for an application that allows for the viewing and manipulation of images of materials as well as material data.
- a user can interact with user interface 205 by engaging input-output devices 203.
- Transceiver 204 may be any suitable communication unit that allows for communication with a network, such as communication network 118 of FIG. 1 .
- transceiver 204 is selected based on the type of communication network 118 object feature visualization computing device 102 will be operating in. For example, if communication network 118 of FIG. 1 is a WiFi® network, transceiver 204 is configured to allow communications with the WiFi® network.
- Processor(s) 201 is operable to receive data from, or send data to, a network, such as communication network 118 of FIG. 1 , via transceiver 204.
- object feature visualization system 100 can simulate how objects (e.g., floors, walls, furniture, fixtures, items) may look with differing object features by video-mapping (e.g., 3D projection mapping) images onto the actual objects.
- objects e.g., floors, walls, furniture, fixtures, items
- video-mapping e.g., 3D projection mapping
- Features may include, for example, materials (e.g., carpet, tile, wood), fabrics, colors, patterns, design elements, or any other object features.
- object feature visualization system 100 allows for the virtual selection of a physical object in a physical room display.
- Object feature visualization system 100 may also allow for the selection of a particular feature for the selected object.
- Object feature visualization system 100 may generate an image based on the selected feature for the object, and video-map the generated image onto the physical object.
- object feature visualization system 100 may project different colors, materials, finishes, or patterns onto a piece of furniture, a wall, and a floor of a mini-room display in real time.
- object feature visualization system 100 may allow a person to observe and visualize how a room would look with objects of the room incorporating varying features via video-map projections.
- the objects being projected may accurately portray textures (e.g. carpet vs tile, fabric vs leather, different colors), shading or shadowing, and finishes in different lighting (e.g. daylight vs. night or evening light).
- the objects being projected may portray various combinations of features for one or more objects.
- object feature visualization system 100 may project a selected feature onto a piece of furniture and another selected feature onto a wall, and another selected feature onto flooring in a room display.
- object feature visualization system 100 may allow for the selection of more than one feature for a selected object, such as a first color, material, finish, or pattern for kitchen cabinets and a second color, material, finish or pattern for the countertops.
- the various features can be selected and changed by a user in real time.
- object feature visualization system 100 may allow the person to make interior design choices by reviewing how the objects look with the various projected features.
- object feature visualization computing device 102 may cause one or more projectors 104A, 104B, 104C, etc. to project one or more video-mapped images onto one or more objects of room display 150.
- room display 150 can include various objects, such as back wall 171 , sidewall 175, floor 173, picture frame 152, chair 154, table 156, rug 158, shelving 160, and flower vase 162.
- the illustrated objects are merely exemplary and by no means limit the present disclosures.
- projectors 104A, 104B, 104C, etc. are preconfigured (e.g., oriented and positioned) to direct an image to a portion of room display 150.
- projector 104A may be preconfigured to project a video-mapped image onto one or more of sidewall 175 and chair 154.
- projector 104B may be preconfigured to project a video-mapped image onto one or more of rug 158, table 156, and portions of back wall 171 ;
- projector 104C may be preconfigured to project a video-mapped image onto one or more of portions of floor 173 and portions of back wall 171 ;
- projector 104D may be preconfigured to project a video-mapped image onto one or more of shelving 160 and flower vase 162; and
- projector 104E may be preconfigured to project a video-mapped image onto or more of portions of back wall 171 and floor 173.
- object feature visualization computing device 102 can control a projection direction of each projector 104.
- object feature visualization computing device 102 may be operable to send messages to each of the projectors 104 to control a direction and/or zoom of their corresponding image projections.
- Object feature visualization computing device 102 may provide the video-mapped images to each of projectors 104A, 104B, 104C, etc. based on, for example, a selection of one or more features for each object.
- object feature visualization computing device 102 may receive a selection of a color, such as white, for chair 154.
- object feature visualization computing device 102 may provide a video-mapped image that includes a white chair image to projector 104A to be projected onto chair 154.
- FIG. 3A illustrates exemplary portions of the object feature visualization system 100 of FIG. 1 that may determine objects in a scene, such as objects of room display 150.
- object feature visualization computing device 102 is communicatively coupled to a plurality of cameras via communication network 118.
- object feature visualization computing device 102 is communicatively coupled to camera 302A, camera 302B, and camera 302C.
- Each of the cameras 302A, 302B, 302C may be a full-color camera configured to capture full-color images of a scene, video cameras, or any other suitable cameras.
- three cameras 302A, 302B, 302C are illustrated, other examples may include fewer, or more, cameras 302.
- Each of cameras 302 may be configured to capture at least a portion of room display 150.
- camera 302A may be configured to capture a left portion of room display 150
- camera 302B may be configured to capture a middle portion of room display 150
- camera 302C may be configured to capture a right portion of room display 150.
- the field of view of each of the cameras 302 may overlap, at least in part, with each other (as indicated in FIG. 3A by the dashed lines). In some examples, the field of view of each of the cameras do not overlap with each other.
- object position data 310 may be pre-stored in database 116.
- the position of each object in room display 150 may be predetermined and stored in database 116.
- object position data 310 may identify a position (e.g., outline) of each of a plurality of objects, such as sidewall 175, back wall 171 , chair 154, and table 156.
- cameras 302 may be utilized in real-time to capture images and identify objects within the images.
- object feature visualization computing device 102 may receive one or more images from one or more of the cameras 302, and identify objects in the images. To detect the objects, object feature visualization computing device 102 may employ any suitable object detection technique or process.
- object feature visualization computing device 102 may employ one or more machine-learning based approaches, such as one that identifies features based on a histogram of oriented gradients (HOG) and includes a classifier to determine objects, to identify objects in the images.
- HOG histogram of oriented gradients
- object feature visualization computing device 102 may employ one or more deep-learning based approaches, such as one based on convolutional neural networks (CNN), to identify objects in the images. Based on the technique or process employed, object feature visualization computing device 102 may generate data identifying the position of each object within an image provided by a camera 302. For example, object feature visualization computing device 102 may generate coordinate data that identifies coordinates that include or outline an object within an image from a particular camera 302. In some examples, object feature visualization computing device 102 generates pixel data that identifies pixel positions that include or outline an object in an image.
- CNN convolutional neural networks
- object feature visualization computing device 102 Based on the detected objects from one or more cameras 302, object feature visualization computing device 102 generates object position data 310 identifying and characterizing the position of each detected object in room display 150. For example, object feature visualization computing device 102 may determine a position of each object in room display 150 based on the field of view of the camera that captured the image with the object (e.g., how much or what part of room display 150 is the camera 302 capturing), the data identifying the position of the object within the captured image, and dimensions of room display 150 (e.g., 3D dimensions such as total height, total length, and total width). Object feature visualization computing device 102 may store object position data 310 in database 116.
- object feature visualization computing device 102 may generate a video-mapped image, and cause a corresponding projector 104 to project the video-mapped image onto the object. For example, based on object position data 310 for a particular object, object feature visualization computing device 102 may generate a video-mapped image that, when projected by a particular projector 104, will project onto only the physical object identified by object position data 310.
- the generated video-mapped image may include an overlay of the object with a selected feature (e.g., a different color, a different material, a different pattern, etc.).
- object feature selection data 312 which is stored in database 116, may identify features for each of a plurality of objects in room display 150.
- Object feature selection data 312 may be preconfigured and stored in database 116 by object feature visualization computing device 102, for example.
- a user may select a feature, identified and characterized by object feature selection data 312, for a particular object.
- object feature visualization computing device 102 may generate a video-mapped image to project onto the particular object that includes the selected feature (e.g., a color selected for a wall object, such as back wall 171 ).
- Object feature visualization computing device 102 may then cause a projector 104, such as one that is configured to project onto the particular object (e.g., projector 104C to project onto portions of back wall 171 ), to project the video-mapped image onto the particular object.
- a projector 104 such as one that is configured to project onto the particular object (e.g., projector 104C to project onto portions of back wall 171 )
- object feature visualization computing device 102 generates a video-mapped image for each such projector 104, where each of the generated video-mapped images include the feature.
- object feature visualization computing device 102 may generate a video-mapped image that, when projected by a particular projector 104, will project onto a plurality of objects.
- the video-mapped image may include features selected for each object, such as a color or material for each object.
- object feature visualization computing device 102 removes all brightness and color (e.g., luminance and chrominance) from portions of the video-mapped image that would project onto areas that do not fall on an object (e.g., areas in-between the objects).
- FIG. 3B illustrates an example user interface 205 that may be displayed, for example, on display 206 (as illustrated in FIG. 2) of object feature visualization computing device 102.
- display 206 may be a touchscreen, where user interface 205 is displayed on the touchscreen and allows for user input based on user touch.
- user input may be provided by one or more input/output devices 203.
- user interface 205 may include an object selection pane 352, a feature selection pane 354, and a user command pane 355.
- Object selection pane 352 may display one or more objects of room display 150.
- object selection pane 352 displays a selectable list of the objects (e.g., preconfigured objects, or objects object feature visualization computing device 102 detected in images received from cameras 302, as identified by object position data 310). By engaging (e.g., touching) at least a portion of a displayed object, a user may select the object.
- objects e.g., preconfigured objects, or objects object feature visualization computing device 102 detected in images received from cameras 302, as identified by object position data 310.
- object selection pane 352 displays an image of room display 350.
- object feature visualization computing device 102 may render an image based on images received from cameras 302, and display the rendered image in object selection pane 352.
- an image of room display 350 is predetermined and stored in database 116 for display. The displayed image of room display 350 may allow a user to select one or more objects displayed in the image by, for example, engaging (e.g., touching) at least a portion of the object as displayed.
- the feature selection pane 354 when a user selects an object, the feature selection pane 354 automatically updates with one or more feature categories and one or more possible features for each feature category that a user may select. For example, based on the selected object in object selection pane 352, feature selection pane 354 may display feature categories including materials 356, colors 358, and patterns 360. The displayed feature categories may be based on the type of object and possible features for that type of object. In addition, each feature category may include one or more features corresponding to that feature category, where a user can select a feature for each category for the object. Each feature category and corresponding features for each object may be identified and characterized by, for example, object feature selection data 312, which may be stored in database 116.
- Feature selection pane 352 may then automatically update and display feature categories including materials 356, colors 358, and patterns 360.
- the user may then be able to select a material (e.g., wood or plastic) under materials 356, a color (e.g., white or black) under colors 358, and a pattern (e.g., flowers or ocean theme) under patterns 360.
- a user may also decide not to select a feature under a particular feature category. In that event, object feature visualization computing device 102 would generate a video-mapped image to project onto the object with only the selected features.
- User command panel 355 may include a save selections icon 357.
- Save selections icon 357 if engaged (e.g., touched) by a user, causes object feature visualization computing device 102 to save the selected features for the selected object for the user.
- the selected features may be saved in database 116, for example, and may be associated with an account for the user.
- user command panel 355 may include an add selection to cart icon 359.
- Add selection to cart icon 359 facilitates a purchase of a selected object with the selected features by adding the object with the selected features to an online shopping cart.
- the online shopping cart may allow the user to place a purchase order for those items located added to the online shopping cart.
- the placement of the purchase order causes object feature visualization computing device 102 to transmit a communication to each manufacturer of each object in the online cart.
- the communication may be an electronic mail (email), a short message service (SMS) message, or any other suitable communication.
- SMS short message service
- the communication may identify the user, the object, and the selected features of the object.
- the communication may then allow the manufacturer, retailer, and/or one of their representatives to contact the user for sale of, or additional information about, the object with the selected features.
- a communication is transmitted to the user with manufacturer, retailer, and/or other representative contact information.
- FIG. 4A illustrates a room display 402 from a point of view of a person physically standing in front of the room display 402.
- Room display 402 includes a plurality of objects in a room before the projecting of any video-mapped images by object feature visualization computing device 102 onto any of the objects.
- room display 402 includes a chair 404, a first chair pillow 406, a second chair pillow 408, shelving 410, flooring 412, and walls 414, among other objects.
- the chair 404, first chair pillow 406, and second chair pillow 408 include a first material 416 with a first pattern 418 at a first color 420.
- the first material 416, first pattern 418 and the first color 420 can be selected to allow for optimal projection of video-mapped images.
- the first pattern 418 and first color 420 can be plain white, while the first material 416 can be selected from optimal display properties.
- FIG. 4B illustrates the same room display 402 of FIG. 4A, but with the projection of video-mapped images by object feature visualization computing device 102 onto chair 404, first chair pillow 406, and second chair pillow 408.
- object feature visualization computing device 102 may display the objects in room display 402 (including chair 404, first chair pillow 406, and second chair pillow 408) on a user interface, such as user interface 205.
- the user may select chair 404, and the user interface may display categories of features for the chair 404.
- the feature categories may include materials (e.g., materials 356), patterns (e.g., patterns 360), and colors (e.g., colors 358).
- the materials category may include selections for first material 416 and a second material 456.
- the patterns category may include selections for a first pattern 418 and a second pattern 458.
- the colors category may include selections for a first color 420 and a second color 460.
- the user may select a feature for one or more of the feature categories.
- object feature visualization computing device 102 generates a video-mapped image based on object position data for chair 404 that includes second material 456, second pattern 458, and second color 460.
- Object feature visualization computing device 102 may provide the generated video-mapped image to a projector configured to project images onto chair 404, such as one of projectors 104. For example, when projector 104 projects video-mapped image onto chair 404, chair 404 would appear to an outside person physically observing room display 402 to have second material 456, second pattern 458, and second color 460, rather than first material 416, first pattern 418, and first color 420, as illustrated in FIG. 4B.
- the user may select first chair pillow 406, and the user interface may display categories of features for first chair pillow 406, where each category includes selectable features for the first chair pillow 406.
- the user selects, a second material 456, a second pattern 458, and a second color 460 for first chair pillow 406.
- object feature visualization computing device 102 generates a video-mapped image based on object position data for first chair pillow 406 that includes second material 456, second pattern 458, and second color 460.
- Object feature visualization computing device 102 may provide the generated video-mapped image to a projector configured to project images onto first chair pillow 406, such as one of projectors 104.
- the user may also select second chair pillow 408, and the user interface may display categories of features for second chair pillow 408, where each category includes selectable features for the second chair pillow 408.
- the user selects a second material 456, a second pattern 458, and a second color 460 for second chair pillow 408.
- object feature visualization computing device 102 generates a video-mapped image based on object position data for second chair pillow 408 that includes second material 456, second pattern 458, and second color 460.
- Object feature visualization computing device 102 may provide the generated video-mapped image to a projector configured to project images onto second chair pillow 408, such as one of projectors 104.
- FIG. 5A illustrates a room display 502 from a point of view of a person physically standing in front of the room display 502.
- Room display 502 includes a plurality of objects in a room before the projecting of any video-mapped images by object feature visualization computing device 102 onto any of the objects.
- room display 502 includes shower tile 504, wall tile 506, vanity 508, and frame 510, among other objects.
- the wall tile 506 includes a first material 516 with a first pattern 518 at a first color 520.
- the first material 516, first pattern 518, and the first color 520 can be selected to allow for optimal projection of video-mapped images.
- the first pattern 518 and first color 520 can be plain white and the first material 516 can be selected for optimal display properties.
- FIG. 5B illustrates the same room display 502 of FIG. 5A, but with the projection of a video-mapped image by object feature visualization computing device 102 onto wall tile 506.
- object feature visualization computing device 102 may display the objects in room display 502 (including wall tile 506,) on a user interface, such as user interface 205.
- the user may select wall tile 506, and the user interface may display categories of features for the wall tile 506.
- the feature categories may include materials (e.g., materials 356), patterns (e.g., patterns 360), and colors (e.g., colors 358).
- the materials category may include selections for first material 516 and a second material 556.
- the patterns category may include selections for first pattern 518 and a second pattern 558.
- the colors category may include selections for first color 520 and a second color 560.
- the user may select a feature for one or more of the feature categories.
- object feature visualization computing device 102 selects, for wall tile 506, a color category feature of second color 560.
- the user does not select a material category feature or a pattern category feature.
- object feature visualization computing device 102 generates video-mapped images based on object position data for wall tile 506 that includes second color 560.
- Object feature visualization computing device 102 may provide the generated video-mapped images to a plurality of projectors configured to project images onto wall tile 506, such as a plurality of projectors 104.
- object feature visualization computing device 102 may generate a video-mapped image for a first projector that can project an image onto a back wall 570, and generate another video-mapped image for a second projector that can project an image onto a side wall 580.
- first projector and second projector project the video-mapped images onto the respective portions of wall tile 506, wall tile 506 would appear to an outside person physically observing room display 502 to have second color 560 rather than first color 520, as illustrated in FIG. 5B.
- feature categories for materials can include by type of material (e.g. textile, paint, laminate, ceramic, wood, leather, stone, resin, film, glass, concrete, vinyl, rubber, cork, pearl and seashell, paper, etc.), by application (e.g. wallcovering, upholstery, flooring, carpet, trim, indoor, outdoor, commercial, residential, etc.), by other features (e.g. stain-resistant, waterproof, recycled content, low VOCs, etc.), and/or by brand name or manufacturer.
- Feature categories can also include color categories (e.g. grays, blues, reds, etc.) or pattern categories (e.g., stripes, animal prints, etc.).
- Feature categories can also include themes (e.g. Victorian, Art Deco, Rustic, Coastal, etc.).
- FIG. 6 illustrates a flowchart of an example method 600 that may be carried out by, for example, the object feature visualization computing device 102 of FIG. 1 .
- image data is received from at least one camera.
- object feature visualization computing device 102 may receive image data from one or more cameras 302.
- at least one object in the received image data is determined.
- object feature visualization computing device 102 may execute one or more machinelearning or deep-learning based processes to identify at least one object in the image data received from cameras 302. Proceeding to step 606, a selection for at least one feature of the at least one object is received.
- object feature visualization computing device 102 may display a user interface 205 on display 206 allowing a user to select one or more features for the object, as described above with respect to FIG. 3B.
- a video-mapped image characterizing the at least one object with the selected at least one feature is generated.
- object feature visualization computing device 102 may generate the video-mapped image based on the selected features such that, when projected on the physical object, the projected video-mapped image changes the appearance of the physical object in accordance with the selected features.
- at least one projecting device is directed to project the generated video-mapped data onto the at least one object.
- object feature visualization computing device 102 may provide the generated video-mapped image to a projector 104 configured to project images onto the corresponding physical object, such as the chair 154 located in room display 150.
- object feature visualization computing device 102 may control the projector to adjust a direction and zoom of its image projection, such that the projector 104 will project the video-mapped image onto the corresponding physical object.
- FIG. 7 illustrates a flowchart of another example method 700 that may be carried out by, for example, the object feature visualization computing device 102 of FIG. 1 .
- an image of a scene comprising at least one object is displayed.
- object feature visualization computing device 102 may display a user interface 205 on display 206 that includes an object selection pane 352 that displays objects in room display 150, as described above with respect to FIG. 3B.
- object feature visualization computing device 102 may display user interface 205 on display 206 that includes an object selection pane 352 that allows the user to select an object, as described above with respect to FIG. 3B.
- object selection pane 352 that allows the user to select an object, as described above with respect to FIG. 3B.
- a plurality of feature categories for the at least one object are displayed.
- object feature visualization computing device 102 may display user interface 205 on display 206 that includes a feature selection pane 354 allowing the user to select one or more features for the object, as described above with respect to FIG. 3B.
- a selection of a feature category of the displayed plurality of feature categories is received.
- the user may engage one of the plurality of feature categories displayed in feature selection pane 354 and, in response, object feature visualization computing device 102 receives the selected feature category.
- a plurality of features for the selected feature category are displayed.
- feature selection pane 354 may include a drop-down menu that displays features for the feature category when a user selects the feature category.
- a selection of a feature of the displayed plurality of features for the selected feature category is received.
- the user may select one of the features in the drop-down menu and, in response, object feature visualization computing device 102 receives the selected feature.
- a video-mapped image is obtained based on the position.
- the video-mapped image includes image data characterizing the at least one object with the selected feature.
- object feature visualization computing device 102 may obtain predetermined object video-image data 315 corresponding to the selected object and the selected features. Predetermined object video-image data 315 may have been previously generated and stored in database 116, for example.
- at least one projecting device is directed to project the obtained video-mapped image onto the at least one object.
- object feature visualization computing device 102 may provide the obtained video-mapped image to a projector 104 configured to project images onto the corresponding physical object, such as the back wall 171 located in room display 150.
- object feature visualization computing device 102 may control the projector to adjust a direction and/or zoom of its image projection, such that the projector 104 will project the video-mapped image onto the corresponding physical object.
- FIG. 8 illustrates a flowchart of another example method 800 that may be carried out by, for example, the object feature visualization computing device 102 of FIG. 1 .
- object feature visualization computing device 102 receives an indication that a user has placed an order (e.g., via an online shopping cart). The user may have placed the order for objects placed into the online shopping cart using the add selection to cart icon 359 of user interface 205.
- object feature visualization computing device 102 determines a manufacturer associated with each object in the online cart. For example, object feature visualization computing device 102 may determine each manufacture based on object data stored in database 116. The object data may include information about each object, including an identification of the manufacturer and, in some examples, available features for each object.
- object feature visualization computing device 102 transmits a communication to each manufacturer of each object in the online cart.
- the communication may be an email, a SMS message, or any other suitable communication.
- Each communication may identify the user, each corresponding object, and any selected features for each object.
- the communication may allow each manufacturer to contact the user for the sale of, or additional information about, each object with the selected features.
- FIG. 9 shows a block diagram of an object feature visualization system 900 that includes the object feature visualization computing device 102 communicatively coupled to one or more projectors 104 over a communication link 910.
- the one or more projectors 104 can be a single projector as shown in FIG. 9.
- Communication link 910 may be a wired, or wireless, link.
- communication link 910 may be a cable (e.g., USB cable) that is coupled to object feature visualization computing device 102 on one end, and to projector 104 at the other end.
- communication link 910 may be a wireless communication link, such as a WiFi® or Bluetooth® communication link.
- Projector 104 is attached to a ceiling 902 of a room display 950 using, in this example, a bracket 904. In other examples, however, projector 104 may be attached to the ceiling 902 by any other suitable structures.
- Room display 950 can also include back wall 971 , sidewall 975, floor 973, chair 154, and floor covering 906.
- Floor covering 906 may be a rug (e.g., area rug), a carpet (e.g., area carpet), or any other suitable floor covering.
- object feature visualization computing device 102 may cause projector 104 to project one or more images (e.g., video-mapped images) onto floor covering 906. Each projected image may coincide with exact or near exact dimensions of floor covering 906. In some examples, object feature visualization computing device 102 may project an image onto a portion of floor covering 906.
- images e.g., video-mapped images
- projector 104 is preconfigured (e.g., oriented and positioned) to project an image onto floor covering 906.
- object feature visualization computing device 102 can control a projection direction of projector 104.
- object position data 310 stored within database 116, may identify a position (e.g., 3-dimensional position) of floor covering 906 within room display 950 (e.g., with respect to a position of projector 104).
- Object feature visualization computing device 102 may obtain the object position data 310 for floor covering 906 from database 116, and determine an orientation of projector 104 (e.g., a projection direction, a projection angle, a zoom setting, etc.) to project an image onto floor covering 106 based on the obtained object position data 310. Further, object feature visualization computing device 102 may generate orientation data identifying the determined orientation, and transmit a message (e.g., command) that includes the orientation data to projector 104 over communication link 910. Projector 104 may receive the message, and adjust its orientation based on the orientation data within the message.
- an orientation of projector 104 e.g., a projection direction, a projection angle, a zoom setting, etc.
- Projector 104 may receive the message, and adjust its orientation based on the orientation data within the message.
- object feature visualization computing device 102 may provide the images to projector 104 based on, for example, a selection of one or more features (e.g., via feature selection pane 354 of user interface 205) for the floor covering 906.
- object feature visualization computing device 102 may receive a selection of a fabric, such as cotton, for floor covering 906.
- object feature visualization computing device 102 may provide an image to projector 104 to be projected onto floor covering 906.
- the image may include a cotton rug image (e.g., an image that gives the appearance of a cotton rug when projected onto floor covering 106).
- object feature visualization computing device 102 receives a plurality of features for floor covering 906.
- object feature visualization computing device 102 may receive a selection of a fabric, and a color (e.g., brown), for floor covering 906.
- object feature visualization computing device 102 may provide an image to projector 104 to be projected onto floor covering 906.
- the image may include a white cotton rug image (e.g., an image that gives the appearance of a white cotton rug when projected onto floor covering 106), a patterned cotton rug image, a blue high pile rug image, a blue low pile rug image, or any other rug image depicting desired properties (e.g., color, texture, etc.).
- FIG. 10 illustrates a flowchart of an example method 1000 that may be carried out by, for example, the object feature visualization computing device 102 of FIG. 1 .
- a plurality of features for a floor covering e.g., floor covering 906
- user interface 205 of object feature visualization computing device 102 may display a plurality of features within a feature selection pane 354, as described above with respect to FIG. 3B, for floor covering 906.
- a selection of a feature of the plurality of features is received (e.g., via a user selecting a feature within the feature selection pane 354).
- a video-mapped image characterizing the floor covering with the selected feature is obtained.
- database 116 may include a plurality of video-mapped images, each video-mapped image characterizing the floor covering with one or more features.
- Object feature visualization computing device 102 may determine the video-mapped image that includes the selected feature, and obtains the determined videomapped image from database 116.
- a projecting device is directed to project the obtained video-mapped image onto the floor covering.
- object feature visualization computing device 102 may provide the obtained video-mapped image to a projector 104 configured to project images onto the floor covering 906 located in room display 950.
- object feature visualization computing device 102 may control the projector 104 to adjust a direction and zoom of its image projection, such that the projector 104 will project the video-mapped image onto the floor covering.
- FIG. 11 illustrates a flowchart of an example method 1000 that may be carried out by, for example, the object feature visualization computing device 102 of FIG. 1 .
- a selection of a feature of a plurality of features for a floor covering is received.
- user interface 205 of object feature visualization computing device 102 may display a plurality of features for the floor covering within a feature selection pane 354 whereby a user may select one or more of the features, as described above with respect to FIG. 3B.
- a video-mapped image characterizing the floor covering with the selected feature is obtained.
- database 116 may include a plurality of videomapped images, each video-mapped image characterizing the floor covering with one or more features.
- Object feature visualization computing device 102 may determine the videomapped image that includes the selected feature, and obtains the determined video-mapped image from database 116.
- a projecting device is directed to project the obtained video-mapped image onto the floor covering.
- object feature visualization computing device 102 may provide the obtained video-mapped image to a projector 104 configured to project images onto the floor covering 906 located in room display 950.
- object feature visualization computing device 102 may control the projector 104 to adjust a direction and zoom of its image projection, such that the projector 104 will project the video-mapped image onto the floor covering.
- step 1108 a determination is made as to whether a user has decided to save the selected feature. For example, object feature visualization computing device 102 may determine if a user has engaged the save selections icon 357 within the user command pane 355 of user interface 205, as described above with respect to FIG. 3B. If the user has not saved the selection, the method proceeds back to step 1102, where a selection of the same, or different, feature for the floor covering is received. Otherwise, if the user has saved the selection (e.g., the user engaged the save selections icon 357), the method proceeds to step 1110.
- the user has saved the selection (e.g., the user engaged the save selections icon 357)
- step 1110 a determination is made as to whether any additional features are to be selected. If additional features are to be selected, the method proceeds back to step 1102, where another selection of a same, or differing, feature for the floor covering is received. If, however, no additional features are to be selected, the method ends. For example, object feature visualization computing device 102 may determine if a user engages another feature within the feature selection pane 354 of user interface 205, or instead engages the add selection to cart icon 359 within the user command pane 355 of user interface 205, as described above with respect to FIG. 3B.
- a computing device such as object feature visualization computing device 102, includes at least one processor that is configured to receive first data identifying a selection of at least one feature for at least one object, and in response to receiving the first data, obtain a video-mapped image characterizing the at least one object with the at least one feature.
- the at least one processor is also configured to provide the video-mapped image to at least one projecting device, wherein the projecting device is configured to project the video-mapped image onto the at least one object.
- the at least one processor is further configured to receive image data from at least one camera, and determine the at least one object in the received image data based on applying one or more machine-learning or deep-learning based processes to the received image data.
- the computing device determines the at least one object in the received image data based on applying a histogram of oriented gradients (HOG) to the received image data to identify features, and applying a classifier to the identified features to determine the at least one object.
- HOG histogram of oriented gradients
- the at least one processor is configured to determine the at least one object in the received image data by generating position data identifying the position of each object within the received image data.
- the at least one processor is configured to provide the videomapped image to at least one projecting device by generating the video-mapped image based on the position data.
- the computing device is also configured to store the videomapped image in a database, such as database 116.
- the at least one processor is configured to provide for display object selection data identifying a plurality of objects, wherein each object corresponds to a physical object in a room display, and wherein the plurality of objects includes the at least one object.
- the at least one processor is configured receive second data identifying a selection of the at least one object and, in response to the received second data, the at least one processor is configured to provide for display feature selection data identifying a plurality of features for the at least one object, wherein the plurality of features includes the at least one feature.
- the at least one processor is configured to receive third data identifying a selection of the at least one feature, where obtaining the video-mapped image characterizing the at least one object with the at least one feature includes selecting the video mapped image from a plurality of video-mapped images characterizing the at least one object based on the third data.
- a system includes a room display, a projecting device configured to project images to the room display, and a computing device communicatively coupled to the at least one projecting device. The computing device is configured to display an image of a scene including at least one object.
- the computing device is also configured to receive first data identifying a selection of the at least one object and, in response to the received first data, provide for display a plurality of feature categories for the at least one object.
- the computing device is further configured to receive second data identifying a selection of a first feature category of the plurality of feature categories and, in response to the received second data, provide for display a plurality of features corresponding to the first feature category.
- the computing device is also configured to receive third data identifying a selection of a first feature of the plurality of features corresponding to the first feature category and, in response to the received third data, obtain a video-mapped image characterizing the at least one object with the first feature.
- the computing device is further configured to provide the obtained video-mapped image to the projecting device.
- the computing device is configured to select the video-mapped image from a plurality of video-mapped images stored in a database based on the third data, each of the plurality of video-mapped images characterizing the at least one object with a varying feature.
- the computing device is configured to adjust a direction of the projecting device such that the projecting device projects the video-mapped image onto the at least one object.
- the at least one object includes walls, flooring, fixtures, furniture, decor, or other interior design elements.
- the at least one feature for the at least one object is selected from at least one of: type of materials, colors, finishes, or patterns.
- the computing device is configured to receive image data from the projecting device, and determine the at least one object in the received image data based on applying one or more machine-learning or deep-learning based processes to the received image data.
- determining the at least one object in the received image data includes applying a histogram of oriented gradients (HOG) to the received image data to identify features, and applying a classifier to the identified features to determine the at least one object.
- HOG histogram of oriented gradients
- determining the at least one object in the received image data includes generating position data identifying the position of each object within the received image data.
- providing the video-mapped image to at least one projecting device includes generating the video-mapped image based on the position data.
- the computing device stores the video-mapped image in a database.
- a method includes receiving first data identifying a selection of at least one feature for at least one object and, in response to receiving the first data, obtaining a video-mapped image characterizing the at least one object with the at least one feature. The method also includes providing the video-mapped image to at least one projecting device, where the projecting device is configured to project the video-mapped image onto the at least one object.
- the method includes receiving image data from at least one camera, and determining the at least one object in the received image data based on applying one or more machine-learning or deep-learning based processes to the received image data.
- the method includes applying one or more machine-learning or deep-learning based processes includes applying a histogram of oriented gradients (HOG) to the received image data to identify features, and applying a classifier to the identified features to determine the at least one object.
- HOG histogram of oriented gradients
- determining the at least one object in the received image data includes generating position data identifying the position of each object within the received image data.
- providing the video-mapped image to at least one projecting device includes generating the video-mapped image based on the position data.
- the method includes storing the video-mapped image in a database.
- the methods and systems described herein can be at least partially embodied in the form of computer-implemented processes and apparatus for practicing those processes.
- the disclosed methods may also be at least partially embodied in the form of tangible, non-transitory machine-readable storage media encoded with computer program code.
- the steps of the methods can be embodied in hardware, in executable instructions executed by a processor (e.g., software), or a combination of the two.
- the media may include, for example, RAMs, ROMs, CD-ROMs, DVD-ROMs, BD-ROMs, hard disk drives, flash memories, or any other non-transitory machine-readable storage medium.
- the methods may also be at least partially embodied in the form of a computer into which computer program code is loaded or executed, such that, the computer becomes a special purpose computer for practicing the methods.
- the computer program code segments configure the processor to create specific logic circuits.
- the methods may alternatively be at least partially embodied in application specific integrated circuits for performing the methods.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Geometry (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/066,838 US11503256B2 (en) | 2019-09-04 | 2020-10-09 | Object feature visualization apparatus and methods |
PCT/US2021/049616 WO2022076123A1 (fr) | 2020-10-09 | 2021-09-09 | Appareil et procédés de visualisation de caractéristiques d'objets |
Publications (1)
Publication Number | Publication Date |
---|---|
EP4226607A1 true EP4226607A1 (fr) | 2023-08-16 |
Family
ID=78078415
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP21786702.7A Withdrawn EP4226607A1 (fr) | 2020-10-09 | 2021-09-09 | Appareil et procédés de visualisation de caractéristiques d'objets |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP4226607A1 (fr) |
JP (1) | JP2023544622A (fr) |
WO (1) | WO2022076123A1 (fr) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11683459B2 (en) | 2019-09-04 | 2023-06-20 | Material Technologies Corporation | Object feature visualization apparatus and methods |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102010007037A1 (de) * | 2010-02-07 | 2011-08-11 | Fritz Egger Gmbh & Co. Og | Anordnung und Verfahren zur Visualisierung von Dekoren in einem virtuellen Raum |
US11062383B2 (en) * | 2016-05-10 | 2021-07-13 | Lowe's Companies, Inc. | Systems and methods for displaying a simulated room and portions thereof |
JP2019053450A (ja) * | 2017-09-13 | 2019-04-04 | 長屋土地開発株式会社 | 内装材受注システム |
-
2021
- 2021-09-09 JP JP2023521474A patent/JP2023544622A/ja active Pending
- 2021-09-09 EP EP21786702.7A patent/EP4226607A1/fr not_active Withdrawn
- 2021-09-09 WO PCT/US2021/049616 patent/WO2022076123A1/fr active Application Filing
Also Published As
Publication number | Publication date |
---|---|
WO2022076123A1 (fr) | 2022-04-14 |
JP2023544622A (ja) | 2023-10-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11503256B2 (en) | Object feature visualization apparatus and methods | |
US12020353B2 (en) | Object feature visualization apparatus and methods | |
KR102186899B1 (ko) | 공간 인식에 기반한 인테리어 플랫폼 제공 방법 | |
US11875464B2 (en) | Systems and methods for scene-independent augmented reality interfaces | |
US20170140484A1 (en) | Virtual or augmented reality customization system and method | |
US10803630B2 (en) | Image processing system, method, and program | |
US12002181B2 (en) | System and method of providing a customizable virtual environment | |
US20170076508A1 (en) | Association of objects in a three-dimensional model with time-related metadata | |
EP4226607A1 (fr) | Appareil et procédés de visualisation de caractéristiques d'objets | |
JP6589444B2 (ja) | 建築素材画像処理システム、方法、及びプログラム | |
WO2015016798A2 (fr) | Système pour une application de réalité augmentée | |
US10553011B2 (en) | Image processing system, method, and program | |
KR102473478B1 (ko) | 전자 장치 및 그의 제어 방법 | |
US20240029148A1 (en) | Systems and methods for visualizing products in a user's space | |
US11257250B2 (en) | Blended physical and virtual realities | |
US20230360332A1 (en) | Augmented reality decorating system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20230403 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20231128 |