WO2020238022A1 - 三维空间视图显示方法、装置及存储介质 - Google Patents

三维空间视图显示方法、装置及存储介质 Download PDF

Info

Publication number
WO2020238022A1
WO2020238022A1 PCT/CN2019/115535 CN2019115535W WO2020238022A1 WO 2020238022 A1 WO2020238022 A1 WO 2020238022A1 CN 2019115535 W CN2019115535 W CN 2019115535W WO 2020238022 A1 WO2020238022 A1 WO 2020238022A1
Authority
WO
WIPO (PCT)
Prior art keywords
house
furniture
model
dimensional
dimensional model
Prior art date
Application number
PCT/CN2019/115535
Other languages
English (en)
French (fr)
Inventor
杨彬
胡亦朗
曹航
张瑞娜
祁梦迪
边疆
杨钰柯
Original Assignee
贝壳找房(北京)科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201910451604.0A external-priority patent/CN110689621B/zh
Priority claimed from CN201910637657.1A external-priority patent/CN110363853B/zh
Application filed by 贝壳找房(北京)科技有限公司 filed Critical 贝壳找房(北京)科技有限公司
Priority to AU2019447524A priority Critical patent/AU2019447524B2/en
Priority to JP2020567129A priority patent/JP7121811B2/ja
Priority to EP19928298.9A priority patent/EP3789967A4/en
Priority to US17/072,021 priority patent/US11158134B2/en
Publication of WO2020238022A1 publication Critical patent/WO2020238022A1/zh
Priority to US17/356,472 priority patent/US11875460B2/en
Priority to JP2022071869A priority patent/JP7407223B2/ja

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/10Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/08Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/04Architectural design, interior design
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/024Multi-user, collaborative environment

Definitions

  • the present disclosure relates to the field of computer technology, and in particular to a method, device and storage medium for displaying a three-dimensional space view.
  • VR viewing refers to the use of VR technology to truly restore the three-dimensional scene of the house.
  • Users provide an immersive viewing experience in a free mode, so that users can experience the real viewing scene without leaving home. For example, by opening the VR listings on the APP and touching anywhere on the screen, you can obtain depth information including the size, orientation, and distance of the real space of the house.
  • the VR houses that users see include new houses and second-hand houses. For new houses, many are rough houses. For second-hand houses, some have been renovated for many years and have outdated facilities. Users generally need to renovate after purchasing the house before moving in. Based solely on actual VR housing viewings, users cannot get the view of the refurbished housing. Therefore, the viewing information is not comprehensive, which is not conducive to the user's decision to purchase a house.
  • the present disclosure provides a method, device and storage medium for displaying a three-dimensional space view (or three-dimensional model).
  • the present disclosure provides a method for displaying a three-dimensional space view.
  • the three-dimensional space view includes a first three-dimensional space view and a second three-dimensional space view.
  • the method includes: presenting the first three-dimensional space on a first user interface. View; presenting the second three-dimensional view on the second user interface; changing the first three-dimensional view according to user input; and changing the second three-dimensional view according to the change of the first three-dimensional view .
  • the method is used to display the three-dimensional model of the house on the same screen before and after decoration,
  • changing the first three-dimensional space view includes:
  • the user terminal obtains the viewing angle change information of the user roaming and/or scanning in the first three-dimensional space view,
  • the first three-dimensional space view corresponds to a first three-dimensional model of a house
  • the second three-dimensional space view corresponds to a second three-dimensional model of a house
  • changing the second three-dimensional space view includes:
  • the display angle of view of the second house three-dimensional model is adjusted according to the view angle change information, so that the first house three-dimensional model and the second house three-dimensional model are displayed on the same screen and at the same angle of view.
  • the first user interface is a subpage of the first three-dimensional house model corresponding to the first three-dimensional space view
  • the obtaining the information about the viewing angle change of the user roaming and/or scanning in the first three-dimensional space view includes:
  • the second user interface is a sub-page of the second house 3D model corresponding to the second 3D space view
  • adjusting the display view angle of the second three-dimensional house model according to the view angle change information includes: sending the view angle change information to the sub-page of the second three-dimensional house model through the sub-page of the first three-dimensional house model.
  • the subpage of the second house three-dimensional model adjusts the display angle of the second house three-dimensional model according to the viewing angle change information.
  • presenting the first three-dimensional space view on the first user interface includes:
  • presenting the second three-dimensional space view on the second user interface includes:
  • the second house three-dimensional model is displayed according to the viewing angle information of the first house three-dimensional model, so that the first house three-dimensional model and the second house three-dimensional model are displayed on the same screen and at the same view angle.
  • preset house information includes house type information, floor height information, and point location information;
  • the three-dimensional model of the first house and the three-dimensional model of the second house are correspondingly stored.
  • At least one of the first three-dimensional model of the house and the second three-dimensional model of the house is a three-dimensional model of a renovated house
  • the method further includes:
  • the furniture information, and the sample house structure data process the designated house plans to generate a furniture placement plan for the designated house plans;
  • the three-dimensional model of the decorated house is generated for the designated house plan according to the furniture placement plan.
  • generating a furniture placement plan for the designated house plan includes generating first and second furniture placement plans for the designated house plan
  • generating the three-dimensional model of the renovated house for the designated house plan according to the furniture placement plan includes:
  • the second three-dimensional model of a house is a three-dimensional model of a renovated house
  • the method further includes:
  • the house plan that needs to be decorated is processed using preset furniture placement decision rules, Obtain the furniture placement plan corresponding to the floor plan to be decorated;
  • the three-dimensional model of the decorated house is generated according to the furniture placement plan.
  • processing the house plan that needs to be decorated, and obtaining the furniture placement plan corresponding to the house plan that needs to be decorated includes:
  • the neural network model and the preset furniture placement decision rules are used to process the house plan to be decorated, and to obtain a furniture placement plan corresponding to the house plan to be decorated.
  • using the neural network model and preset furniture placement decision rules to process the house plan that needs to be decorated, and obtaining a furniture placement plan corresponding to the house plan that needs to be decorated includes :
  • the neural network model includes: an input layer neuron model, a middle layer neuron model, and an output layer neuron model; the output of each layer of neuron model is used as the input of the next layer of neuron model ;
  • the neural network model is a sub-network structure of multiple neural network layers with a fully connected structure; the middle layer neuron model is a fully connected layer.
  • the furniture placement information includes: furniture placement heat map
  • the furniture heat map includes: location information of the furniture recommended to be placed in the floor plan requiring decoration, and the placement probability corresponding to the recommended furniture.
  • using the furniture placement decision rule to process the furniture placement information, and obtaining a furniture placement map includes:
  • the furniture placement strategy includes one or more of a wall sticking strategy and a floor sticking strategy.
  • changing the first three-dimensional space view includes:
  • the first user interface loads data for updating the first three-dimensional space view according to the view change instruction
  • the first user interface sends the view change instruction to the second user interface
  • the first user interface notifies the second user interface that it has completed data loading
  • changing the second three-dimensional space view includes:
  • the second user interface loads data for updating the second three-dimensional space view according to the view change instruction
  • the second user interface notifies the first user interface that it has completed data loading.
  • the user input is a first user input
  • the method further includes:
  • the first three-dimensional space view is changed.
  • the present disclosure provides a method for displaying a three-dimensional space view.
  • the three-dimensional space view includes at least a first three-dimensional space view and a second three-dimensional space view.
  • the method includes: presenting the first three-dimensional space on a first user interface.
  • the view change instruction loads data for updating the first three-dimensional space view; the view change instruction is sent from the first user interface to the second user interface; the second user interface changes according to the view Instruct to load data for updating the second three-dimensional space view; the first user interface and the second user interface are used to update the first three-dimensional space view according to the loaded data and the second three-dimensional space view respectively.
  • the data of the view updates the first three-dimensional space view and the second three-dimensional space view.
  • the first user interface notifies the second user interface that it has completed data loading
  • the second user interface notifies the first user interface that it has completed data loading
  • the first three-dimensional space view and the second three-dimensional space view are simultaneously updated.
  • the present disclosure provides a method for displaying a three-dimensional model of a house on the same screen before and after decoration, which includes: a user terminal obtains viewing angle change information of a user roaming and/or scanning in the current virtual three-dimensional space, and the viewing angle change information includes point positions Change information and/or line-of-sight direction change information; if the current virtual three-dimensional space corresponds to the first three-dimensional model of the house, adjust the display view angle of the second three-dimensional model of the house according to the view change information, so that the first three-dimensional model of the house Displaying on the same screen and the same viewing angle as the second house three-dimensional model; if the current virtual three-dimensional space corresponds to the second house three-dimensional model, the display angle of the first house three-dimensional model is adjusted according to the viewing angle change information, The first three-dimensional house model and the second house three-dimensional model are displayed on the same screen and the same viewing angle; wherein, the first house model and the second house model are already on the same screen before the user’s
  • the present disclosure provides a method for generating a furniture placement scheme based on a house type, including: obtaining sample house type structure data corresponding to a first sample house type diagram; obtaining data corresponding to the first sample house type diagram , A second sample house plan with furniture, mark the furniture placed in the second sample house plan to generate first furniture information; according to the first sample house plan, the second sample house plan Map, the first furniture information and the sample house structure data, use the preset furniture placement decision rules to process the house plans that need to be decorated, and obtain the furniture placement plan corresponding to the house plans that need to be decorated .
  • the present disclosure provides a computing device, including a memory and a processor, the memory stores program instructions, and when the program instructions are executed by the processor, the processor executes any aspect of the present disclosure. The method described.
  • a non-transitory computer-readable storage medium has program instructions stored thereon.
  • the program instructions When the program instructions are executed by a processor, the processor executes the method according to any aspect of the present disclosure .
  • FIG. 1 is a schematic diagram showing an exemplary three-dimensional virtual reality (VR) environment according to an embodiment of the present disclosure
  • Fig. 2 is a block diagram showing an exemplary computer system according to an embodiment of the present disclosure
  • FIG. 3 is a flowchart of a method for displaying a three-dimensional space view according to an embodiment of the present disclosure
  • FIG. 4 is a flowchart of another three-dimensional space view display method provided by an embodiment of the present disclosure.
  • FIG. 5 is a flow chart of a method for displaying a three-dimensional model of a house on the same screen before and after decoration provided by an embodiment of the present disclosure
  • FIG. 6 is a flowchart of a method for displaying a three-dimensional model of a house on the same screen before and after decoration provided by another embodiment of the present disclosure
  • FIG. 7 is a schematic diagram of the device structure for displaying a three-dimensional model of a house on the same screen before and after decoration provided by an embodiment of the present disclosure
  • FIG. 8 is a schematic structural diagram of a system for displaying a three-dimensional model of a house on the same screen before and after decoration provided by an embodiment of the present disclosure
  • FIG. 9 is a flowchart of an embodiment of a method for generating a furniture placement scheme based on a house type of the present disclosure
  • FIG. 10 is a flowchart of generating a furniture placement plan in an embodiment of the method for generating a furniture placement plan based on apartment type of the present disclosure
  • FIG. 11 is a flow chart of optimizing the placement of furniture in an embodiment of the method for generating a furniture placement scheme based on apartment type of the present disclosure
  • FIG. 12 is a flowchart of generating a three-dimensional rendering model in an embodiment of the method for generating a furniture placement scheme based on a house type of the present disclosure
  • FIG. 13A is a schematic structural diagram of an embodiment of an apparatus for generating a furniture placement scheme based on a house type of the present disclosure
  • FIG. 13B is a schematic structural diagram of another embodiment of the device for generating a furniture placement scheme based on apartment type of the present disclosure
  • FIG. 14 is a schematic structural diagram of another embodiment of the device for generating a furniture placement scheme based on apartment type of the present disclosure
  • FIG. 15 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.
  • plural may refer to two or more than two, and “at least one” may refer to one, two or more than two.
  • the term "and/or" in the present disclosure is only an association relationship that describes associated objects, indicating that there can be three relationships, such as A and/or B, which can mean: A alone exists, and both A and B exist. There are three cases of B alone.
  • the character "/" in the present disclosure generally indicates that the associated objects before and after are in an "or" relationship.
  • the embodiments of the present disclosure can be applied to electronic devices such as terminal devices, computer systems, servers, etc., which can operate with many other general-purpose or special-purpose computing system environments or configurations.
  • Examples of well-known terminal devices, computing systems, environments and/or configurations suitable for use with electronic devices such as terminal devices, computer systems or servers include, but are not limited to: personal computer systems, server computer systems, thin clients, and thick clients Computers, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, small computer systems, large computer systems, and distributed cloud computing technology environments including any of the above systems, etc.
  • Electronic devices such as terminal devices, computer systems, servers, etc. can be described in the general context of computer system executable instructions (such as program modules) executed by the computer system.
  • program modules may include routines, programs, object programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types.
  • the computer system/server can be implemented in a distributed cloud computing environment.
  • tasks can be performed by remote processing devices linked through a communication network.
  • program modules may be located on a storage medium of a local or remote computing system including a storage device.
  • FIG. 1 shows an exemplary three-dimensional virtual reality (VR) environment 100 according to an embodiment of the present disclosure.
  • the 3D VR environment 100 can simulate or represent a residential unit, such as an apartment or a residential floor.
  • the 3D VR environment 100 may include a VR representation of any indoor space or environment.
  • the 3D VR environment 100 may include one or more functional rooms, such as 110, 120, 130, 140, 150, and 160.
  • a function room refers to a closed or partially enclosed space associated with a specific function.
  • the function room may correspond to the room.
  • the function room 110 may correspond to the first bedroom
  • the function room 130 may correspond to the second bedroom.
  • the functional room may correspond to a closed or partially enclosed space in or adjacent to the room.
  • the function room 140 may correspond to a closet.
  • the function room can correspond to an area that is usually used for a specific purpose.
  • the function room 120 may correspond to a kitchen area
  • the function room 150 may correspond to a dining area
  • the function room 160 may correspond to a living room.
  • the function rooms 120, 150, and 160 may share the same room (for example, a closed area), they may be considered as different function rooms because of their different functions.
  • Figure 2 shows a block diagram of an exemplary computer system 200 configured to implement the various functions disclosed herein.
  • the computer system 200 may be configured as a server for creating or rebuilding the VR environment 100.
  • the computer system 200 may be configured as a terminal device for displaying or enriching the VR environment 100.
  • the computer system 200 may include a processor 210, a communication interface 220, a memory/storage device 230, and a display 240.
  • the memory/storage device 230 may be configured to store computer-readable instructions, which when executed by the processor 210 may cause the processor 210 to perform various operations disclosed herein.
  • the memory 230 may be any non-transitory type of mass storage device, such as volatile or nonvolatile, magnetic, semiconductor-based, tape-based, optical, removable, non-removable, or other types of storage devices, or Tangible computer-readable media, including but not limited to ROM, flash memory, dynamic RAM, and static RAM.
  • the processor 210 may be configured to perform operations according to instructions stored in the memory 230.
  • the processor 210 may include any suitable type of general-purpose or special-purpose microprocessor, digital signal processor, microcontroller, etc.
  • the processor 210 may be configured as a separate processor module dedicated to perform one or more specific operations disclosed herein.
  • the processor 210 may be configured as a shared processor module capable of performing other operations unrelated to one or more specific operations disclosed herein.
  • the communication interface 220 may be configured to transfer information between the computer system 200 and other devices or systems.
  • the communication interface 220 may include an integrated services digital network (ISDN) card, a cable modem, a satellite modem, or a modem for providing a data communication connection.
  • ISDN integrated services digital network
  • the communication interface 220 may include a local area network (LAN) card to provide a data communication connection with a compatible LAN.
  • LAN local area network
  • the communication interface 220 may include a high-speed network adapter, such as a fiber optic network adapter, a 10G Ethernet adapter, and the like.
  • the communication interface 220 may also implement a wireless link.
  • the communication interface 220 may send and receive electrical signals, electromagnetic signals, or optical signals that carry digital data streams representing various types of information via a network.
  • the network may generally include a cellular communication network, a wireless local area network (WLAN), a wide area network (WAN), and so on.
  • WLAN wireless local area network
  • WAN wide area network
  • the communication interface 220 may also include various I/O devices, such as a keyboard, a mouse, a touch pad, a touch screen, a microphone, a camera, a biosensor, and so on. The user can input data to the terminal device through the communication interface 220.
  • I/O devices such as a keyboard, a mouse, a touch pad, a touch screen, a microphone, a camera, a biosensor, and so on. The user can input data to the terminal device through the communication interface 220.
  • the display 240 may be integrated as a part of the computer system 200 or may be provided as a separate device communicatively coupled to the computer system 200.
  • the display 240 may include a display device such as a liquid crystal display (LCD), a light emitting diode display (LED), a plasma display or any other type of display, and provides a graphical user interface (GUI) presented on the display for user input and data description .
  • the display device 240 may include VR goggles, VR glasses, or other similar devices that provide an immersive VR experience.
  • the VR environment 100 may be displayed on the display 240.
  • the display 240 may be integrated as a part of the communication interface 220.
  • Fig. 3 is a flowchart of an example method for displaying a three-dimensional space view according to the present disclosure.
  • the three-dimensional view includes at least a first three-dimensional view and a second three-dimensional view.
  • the method includes: in step 301, presenting the first three-dimensional view on a first user interface; in step 302, in the second The second three-dimensional space view is presented on the user interface; in step 303, the first three-dimensional space view is changed according to the user input; in step 304, the second three-dimensional space view is changed according to the change in the first three-dimensional space view Space view.
  • Fig. 4 is a flowchart of another example method for displaying a three-dimensional space view according to the present disclosure.
  • the three-dimensional space view includes at least a first three-dimensional space view and a second three-dimensional space view.
  • step 401 a first three-dimensional space view is presented on the first user interface.
  • a second three-dimensional space view is presented on the second user interface.
  • the presented second three-dimensional space view and the first three-dimensional space view may have the same field of view.
  • the first user interface and the second user interface may be sub-pages, for example, the first sub-page and the second sub-page of a browser (eg, IE browser, Chrome browser, etc.).
  • a browser eg, IE browser, Chrome browser, etc.
  • Three-dimensional space view also called panoramic view.
  • One method of generating a three-dimensional view of a house is to use a camera to take photos of the surrounding environment at multiple locations in the house, and synthesize these photos to obtain a house panorama at these locations. For example, you can rotate the camera around the vertical axis in the horizontal direction at a certain position in the house and rotate the camera around the horizontal axis in the vertical direction to synthesize a series of photos taken thereby to obtain a panoramic view of the house at that position.
  • Another method is to use computer simulation to generate a three-dimensional view of the house.
  • the field of view usually includes the direction of the field of view and the angular range of the field of view (ie, the viewing angle), and the direction of the field of view is also called the line of sight direction of the viewing angle. Therefore, a feature of the field of view is its direction, which can be defined, for example, by an azimuth angle measured from a known direction (for example, north) and an inclination angle measured from a known direction (for example, a horizontal plane). Another feature of the field of view is the angle of view, which describes the angular range of a given scene.
  • step 403 a user input is received on the first user interface to generate a view change instruction of the first three-dimensional space view according to the user input.
  • the user can manipulate the three-dimensional space view in the display area (ie, the user interface).
  • the user can drag left and right, up and down to change the direction and angle range of the field of view.
  • the user can also change the angle range of the field of view by zooming.
  • the user can navigate from the three-dimensional view of one location to the three-dimensional view of another location by clicking the navigation control superimposed on the three-dimensional view.
  • a panoramic image can be generated at m locations for the first house (the m locations constitute the first location set), and a panoramic image can be generated at n locations for the second house (the n locations constitute the second location set).
  • n and m are integers, and they can be equal or unequal.
  • the m and n positions can be numbered respectively (for example, consecutively numbered from 1), that is, the positions are represented by numbers, and the position of the first number (for example, number 1) represents the initial position. Positions with the same number are considered to be corresponding positions, thereby establishing a mapping relationship between the first position set and the second position set.
  • the first house and the second house can be the same house, that is, different panoramas can be generated for the same house.
  • different three-dimensional space views before and after decoration can be generated for the same house
  • a first three-dimensional space view can be generated for a house before decoration
  • a second three-dimensional space view can be generated for a house after decoration.
  • the view change instruction includes field change information and/or number (or position, also referred to as point position) change information of the first three-dimensional space view.
  • step 404 the first user interface loads data for updating the first three-dimensional space view according to the view change instruction.
  • step 405 the first user interface sends a view change instruction to the second user interface.
  • step 406 the second user interface loads data for updating the second three-dimensional space view according to the view change instruction.
  • step 407 the first user interface and the second user interface respectively update the first three-dimensional space view according to the loaded data for updating the first three-dimensional space view and the loaded data for updating the second three-dimensional space view.
  • the first three-dimensional space view and the second three-dimensional space view have the same field of view. In some implementations, after updating, the first three-dimensional space view and the second three-dimensional space view correspond to the same position (or number).
  • the first user interface and the second user interface update the first user interface simultaneously according to the loaded data for the first three-dimensional space view and the loaded data for the second three-dimensional space view, respectively.
  • a three-dimensional space view and the second three-dimensional space view That is, the first user interface loads the data used to update the first three-dimensional space view, and the second user interface loads the data used to update the second three-dimensional space view, and then the two user interfaces will be synchronized , To simultaneously update the first three-dimensional space view and the second three-dimensional space view.
  • the synchronization includes, for example, that the first user interface notifies the second user interface that it has completed data loading, and the second user interface notifies the first user interface that it has completed data loading, thereby implementing the first user interface.
  • a user interface and the second user interface simultaneously update the first three-dimensional space view and the second three-dimensional space view.
  • An application scenario of the above-mentioned three-dimensional space view display method is to display the three-dimensional model of the house on the same screen before and after decoration.
  • changing the first three-dimensional space view according to user input includes: the user terminal obtains that the user is roaming in the first three-dimensional space view (also referred to as the current virtual three-dimensional space) and/ Or saccade's viewing angle change information.
  • the viewing angle change information may include, for example, point (or position) change information and/or line of sight direction change information.
  • changing the second three-dimensional space view includes: if the first three-dimensional space view corresponds to a first three-dimensional house model, and the second three-dimensional space view corresponds to a second house three-dimensional model Model, adjust the display view angle of the second house 3D model according to the view angle change information, so that the first house 3D model and the second house 3D model are displayed on the same screen and at the same view angle; if the first 3D space view Corresponding to the second three-dimensional model of the house, and the second three-dimensional space view corresponds to the first three-dimensional model of the house, adjust the display angle of the first three-dimensional model of the house according to the viewing angle change information, so that the first three-dimensional model of the house The three-dimensional model of the second house is displayed on the same screen and at the same viewing angle.
  • the following is a detailed description of the same-screen display of the three-dimensional model of the house before and after the decoration.
  • Fig. 5 is a flowchart of a method for displaying a three-dimensional model of a house on the same screen before and after decoration provided by an embodiment of the present disclosure. As shown in Figure 5, the method includes:
  • Step 501 The user terminal obtains the viewing angle change information of the user roaming and/or saccades in the current virtual three-dimensional space; the viewing angle change information includes point position change information and/or line of sight direction change information;
  • Step 502 If the current virtual three-dimensional space corresponds to the first three-dimensional model of the house, adjust the display perspective of the second three-dimensional model of the house according to the viewing angle change information, so that the first three-dimensional model of the house and the second three-dimensional model of the house The model is displayed on the same screen and the same viewing angle;
  • Step 503 If the current virtual three-dimensional space corresponds to the second house three-dimensional model, adjust the display angle of the first house three-dimensional model according to the viewing angle change information, so that the first house three-dimensional model and the The 3D model of the second house is displayed on the same screen and at the same viewing angle;
  • the first house model and the second house model are in the same-screen and same-view display state before the user’s perspective changes;
  • the first house three-dimensional model refers to the three-dimensional model of the current house (that is, no Load the three-dimensional model of the house with the recommended decoration effect)
  • the second three-dimensional model of the house refers to the three-dimensional model of the decorated house after the recommended decoration effect is loaded.
  • the three-dimensional model of the current house refers to the three-dimensional model of the actual house (the three-dimensional model of the house before decoration).
  • the three-dimensional model of the renovated house is based on the corresponding actual housing, and the three-dimensional model of the renovated house is simulated (the three-dimensional model of the renovated house).
  • the recommended decoration effect means that according to the user’s house type, orientation, lighting, floor and other house attributes, all existing decoration furniture and appliances are erased from the user’s original house’s three-dimensional model, and then added to the house’s three-dimensional model The decoration effect of various furniture and appliance models.
  • the user can walk and/or scan in the virtual three-dimensional space (VR space) of the three-dimensional model of the house to achieve an immersive view of the house.
  • Wandering such as moving from one point to another
  • scanning such as looking at a certain area of the room.
  • the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration have been displayed on the display interface of the user terminal (front end) on the same screen and same perspective.
  • the user can walk and/or scan in the virtual three-dimensional space of the three-dimensional model of the house before decoration, and can also walk and/or scan in the virtual three-dimensional space of the three-dimensional model of the house after decoration.
  • the direction of the line of sight can be changed (for example, by sliding the screen) to realize a glance at different areas of the room; when the user moves from one point to another, the viewing angle will inevitably change. And after moving to a new point, the user can further change the direction of the line of sight to make a new change in the viewing angle.
  • the viewing angle change information can be obtained through the point change information and the viewing angle change information.
  • the user terminal When the user roams and/or scans in the virtual three-dimensional space of the three-dimensional model of the house, the user terminal obtains the information of the current virtual three-dimensional space where the user is located.
  • the current virtual three-dimensional space corresponds to the three-dimensional model of the house before decoration or the one after the decoration.
  • a three-dimensional model of the house and obtains the viewing angle change information of the user roaming and/or scanning in the current virtual three-dimensional space.
  • the user terminal adjusts the position of the three-dimensional model of the house after decoration according to the user’s roaming and/or glance angle change information in the virtual three-dimensional space of the house before decoration.
  • the viewing angle is displayed so that the perspective change of the three-dimensional model of the house after decoration is consistent with the change of the perspective of the three-dimensional house model before decoration, so that the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are displayed on the same screen and with the same perspective.
  • the user terminal adjusts the view of the three-dimensional model of the house before decoration according to the user's roaming and/or glance in the virtual three-dimensional space of the house after decoration.
  • the viewing angle is displayed, so that the viewing angle change of the three-dimensional house model before decoration is consistent with the viewing angle change of the three-dimensional house model after decoration, so that the three-dimensional house model before decoration and the three-dimensional house model after decoration are displayed on the same screen with the same viewing angle.
  • the embodiment of the present disclosure adjusts the display angle of view of the decorated house 3D model according to the user's roaming and/or glance in the virtual three-dimensional space of the house 3D model before decoration, or adjusts the display angle of view of the decorated house 3D model according to the user's
  • the viewing angle change information of roaming and/or scanning in the virtual three-dimensional space Adjust the display perspective of the three-dimensional model of the house before decoration, realize the linkage of the three-dimensional model of the house before and after the decoration on the same screen and the same perspective, allowing users to visually observe the decoration
  • the difference comparison between the three-dimensional models of the two houses before and after decoration provides users with a real-life display of decoration effects.
  • the obtaining the information of the user's roaming and/or saccade perspective change information in the current virtual three-dimensional space specifically includes: obtaining the user's current status through the subpage of the house three-dimensional model corresponding to the current virtual three-dimensional space The viewing angle change information of roaming and/or saccade in the virtual three-dimensional space; if the current virtual three-dimensional space corresponds to the first three-dimensional model of the house, the display viewing angle of the second three-dimensional model of the house is adjusted according to the viewing angle change information, It specifically includes: reporting the viewing angle change information to the parent page through the child page of the first three-dimensional model of the house, and the parent page sends the viewing angle change information to the child page of the second three-dimensional model of the house.
  • the sub-page of the second house three-dimensional model adjusts the display view angle of the second house three-dimensional model according to the viewing angle change information; if the current virtual three-dimensional space corresponds to the second house three-dimensional model, the viewing angle is
  • the change information adjusts the display view angle of the first three-dimensional model of the house, which specifically includes: reporting the view angle change information to the parent page through a child page of the second three-dimensional house model, and the parent page then reports the view angle change information
  • the sub-page of the first three-dimensional model of the house is issued, and the sub-page of the first three-dimensional model of the house adjusts the display angle of the first three-dimensional model of the house according to the viewing angle change information.
  • the present disclosure is not limited to this, and it is also possible to communicate directly between child pages without passing through the parent page.
  • the display of the second three-dimensional model of the house is adjusted according to the viewing angle change information
  • the viewing angle specifically includes: sending the viewing angle change information to the subpage of the second three-dimensional house model through the subpage of the first three-dimensional house model, and the subpage of the second three-dimensional house model changes according to the viewing angle.
  • the information adjusts the display angle of view of the second house three-dimensional model.
  • the display angle of the first house three-dimensional model is adjusted according to the viewing angle change information, Specifically, it includes: sending the viewing angle change information to the subpage of the first three-dimensional house model through the subpage of the second three-dimensional house model, and the subpage of the first three-dimensional house model is adjusted according to the viewing angle change information The display angle of view of the first three-dimensional model of the house.
  • the subpage refers to the display page corresponding to the three-dimensional model of each house in the user terminal.
  • the parent page refers to the page manager used to manage and control each child page in the user terminal.
  • the page synchronization of the three-dimensional model of the house before and after the decoration can be realized through the transfer control of the parent page, or the house before and after the decoration can be realized by direct communication between the child pages without using the parent page.
  • the pages of the 3D model are synchronized.
  • the sub-page of the three-dimensional model of the house before decoration obtains the viewing angle change information of the user roaming and/or scanning in the current virtual three-dimensional space, and changes the viewing angle
  • the information is reported to the parent page, and the parent page sends the viewing angle change information to the child page of the three-dimensional model of the decorated house, and the child page of the three-dimensional model of the decorated house adjusts the decorated house according to the information of the viewing angle change.
  • the display angle of the three-dimensional model is such that the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are displayed on the same screen and at the same viewing angle.
  • the sub-page of the three-dimensional model of the house before decoration obtains the viewing angle change information of the user roaming and/or scanning in the current virtual three-dimensional space, and the viewing angle change information is directly sent to the sub-page of the three-dimensional model of the house after decoration
  • the sub-page of the three-dimensional model of the house after decoration adjusts the display angle of the three-dimensional model of the house after decoration according to the viewing angle change information, so that the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are displayed on the same screen and in the same viewing angle.
  • the sub-page of the three-dimensional model of the house after decoration obtains the viewing angle change information of the user roaming and/or scanning in the current virtual three-dimensional space, and changes the viewing angle
  • the information is reported to the parent page, and the parent page sends the viewing angle change information to the child page of the three-dimensional model of the house before decoration.
  • the child page of the three-dimensional model of the house before decoration adjusts the house before decoration according to the information of the change in viewing angle.
  • the display angle of the three-dimensional model is such that the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are displayed on the same screen and at the same viewing angle.
  • the subpage of the three-dimensional model of the house after decoration obtains the viewing angle change information of the user roaming and/or scanning in the current virtual three-dimensional space, and the viewing angle change information is directly sent to the subpage of the three-dimensional model of the house before decoration
  • the sub-page of the three-dimensional model of the house before decoration adjusts the display angle of the three-dimensional model of the house before decoration according to the viewing angle change information, so that the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are displayed on the same screen and in the same viewing angle.
  • the embodiments of the present disclosure use the parent page to control the child pages of the three-dimensional house model before decoration and the child pages of the three-dimensional house model after decoration (or the child pages of the three-dimensional house model before decoration and the decoration Direct communication between the sub-pages of the three-dimensional model of the house after the decoration), the three-dimensional model of the house before the decoration and the three-dimensional model of the house after the decoration are displayed on the same screen and the same viewing angle, which improves the convenience and reliability of the same screen and the same viewing angle display control.
  • the method before the acquisition of the viewing angle change information of the user roaming and/or scanning in the current virtual three-dimensional space, the method further includes: displaying the first three-dimensional model of the house, and acquiring the first The perspective information of the house three-dimensional model, the second house three-dimensional model is obtained from the back-end server, and the second house three-dimensional model is displayed according to the perspective information of the first house three-dimensional model, so that the first house three-dimensional model and the house The second house three-dimensional model is displayed on the same screen and the same viewing angle; or, the second house three-dimensional model is displayed, the viewing angle information of the second house three-dimensional model is obtained, the first house three-dimensional model is obtained from the background server, and the The view angle information of the second house three-dimensional model displays the first house three-dimensional model, so that the first house three-dimensional model and the second house three-dimensional model are displayed on the same screen and at the same view angle; wherein, the view angle information includes point information And sight direction information.
  • the embodiment of the present disclosure will provide an embodiment in which the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are initially displayed on the same screen and at the same viewing angle.
  • the user can click on a three-dimensional model of a house to enter the virtual space of a three-dimensional model of a house to scan and walk around, thereby realizing the display of the corresponding three-dimensional model of the house.
  • the user can click on the three-dimensional model of the house before decoration to display the three-dimensional model of the house before decoration; or click the three-dimensional model of the house after decoration to display the three-dimensional model of the house after decoration.
  • Both the decorated three-dimensional model of the house and the decorated three-dimensional model of the house are stored in the back-end server, and the user terminal can send a request instruction to the back-end server to display the corresponding three-dimensional model.
  • the user terminal obtains the display request information of the three-dimensional model of the house before decoration (for example, it obtains the user's click information on the three-dimensional model of the house before decoration), the three-dimensional model of the house before decoration is displayed.
  • the user terminal obtains the perspective information of the three-dimensional model of the house before the decoration after displaying the three-dimensional model of the house before the decoration (display angle information) , And obtain the three-dimensional model of the house after decoration from the back-end server, and display the three-dimensional model of the house after decoration according to the perspective information of the three-dimensional model of the house before decoration, so that the three-dimensional model of the house before decoration and the house after decoration are The 3D model is displayed on the same screen and at the same viewing angle.
  • the perspective information of the pre-renovated house 3D model can be sent to the parent page through the child page of the pre-renovated house 3D model, and the parent page sends the perspective information of the pre-renovated house 3D model to the renovated house 3D model.
  • the sub-page of the 3D model of the house after decoration displays the 3D model of the house after decoration according to the perspective information of the 3D model of the house before decoration, so that the 3D model of the house before decoration and the 3D model of the house after decoration are on the same screen and the same view angle display.
  • the sub-page of the three-dimensional house model after decoration is based on the three-dimensional house before decoration.
  • the perspective information of the model displays the three-dimensional model of the house after decoration, so that the three-dimensional model of the house before the decoration and the three-dimensional model of the house after the decoration are displayed on the same screen and at the same angle of view.
  • the user terminal obtains the display request information of the three-dimensional model of the decorated house (for example, obtains the user's click information on the three-dimensional model of the decorated house), the three-dimensional model of the decorated house is displayed.
  • the user terminal obtains the perspective information of the three-dimensional model after the decoration after displaying the three-dimensional model of the house after the decoration (display view information) , And obtain the three-dimensional model of the house before decoration from the back-end server, and display the three-dimensional model of the house before decoration according to the perspective information of the three-dimensional model of the house after decoration, so that the three-dimensional model of the house before decoration and the house after decoration are
  • the 3D model is displayed on the same screen and at the same viewing angle.
  • the perspective information of the decorated house 3D model can be sent to the parent page through the child page of the decorated house 3D model, and the parent page then sends the perspective information of the decorated house 3D model to the pre-renovated house 3D model
  • the sub-page of the 3D model of the house before decoration displays the 3D model of the house before decoration according to the perspective information of the 3D model of the house after decoration, so as to realize the same view of the 3D model of the house before decoration and the 3D model of the house after decoration. display. Or you can send the perspective information of the decorated house 3D model directly to the subpage of the house 3D model before decoration through the subpage of the decorated house 3D model.
  • the subpage of the house 3D model before decoration is based on the 3D model of the house after decoration.
  • the viewing angle information displays the three-dimensional model of the house before the decoration, so that the three-dimensional model of the house before the decoration and the three-dimensional model of the house after the decoration are displayed on the same screen and the same viewing angle.
  • the embodiments of the present disclosure display the three-dimensional model of the house after decoration according to the perspective information of the three-dimensional model of the house before decoration, or display the three-dimensional model of the house before decoration according to the perspective information of the three-dimensional model of the house after decoration,
  • the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are initially displayed on the same screen and with the same viewing angle.
  • the method before the obtaining the view angle information of the first three-dimensional model of the house, the method further includes: determining whether preset trigger information is received, and if it is determined that the preset trigger information is received , And then execute the action of obtaining the perspective information of the first three-dimensional model of the house; before the obtaining the perspective information of the second three-dimensional model of the house, the method further includes: determining whether the preset trigger is received Information, if it is determined that the preset trigger information is received, the action of acquiring the viewing angle information of the second house three-dimensional model is executed.
  • the initial display of the three-dimensional model of the house before the decoration and the three-dimensional model of the house after the decoration can be triggered by preset trigger conditions.
  • the user terminal obtains the display request information of the three-dimensional model of the house before decoration, it displays the three-dimensional model of the house before decoration, and determines whether the preset trigger information is received.
  • the preset trigger information may be the user's button (Such as displaying buttons on the same screen before and after decoration) click information. If it is determined that the preset trigger information is received, the perspective information of the three-dimensional house model before decoration is obtained, and the three-dimensional model of the house after decoration is obtained from the back-end server, and according to the perspective of the three-dimensional house model before decoration The information displays the three-dimensional model of the house after decoration, so that the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are displayed on the same screen and at the same viewing angle. If it is determined that the preset trigger information is not received, only the three-dimensional model of the house before decoration is displayed.
  • the user terminal obtains the display request information of the three-dimensional model of the house after decoration, it displays the three-dimensional model of the house after decoration, and determines whether the preset trigger information is received.
  • the preset trigger information may be the user's preset button (Such as displaying buttons on the same screen before and after decoration) click information.
  • the perspective information of the three-dimensional model of the house after decoration is obtained, and the three-dimensional model of the house before the decoration is obtained from the back-end server, and according to the perspective of the three-dimensional model of the house after decoration
  • the information displays the three-dimensional model of the house before decoration, so that the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are displayed on the same screen and at the same angle of view. If it is determined that the preset trigger information has not been received, only the three-dimensional model of the house after renovation is displayed.
  • the embodiments of the present disclosure realize the same screen and same viewing angle display of the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration after receiving the preset trigger information, which improves the flexibility of display control.
  • the method further includes: the background server obtains preset house information according to the first three-dimensional model of the house, the preset house information includes house type information, floor height information, and point location information; The preset house information generates a three-dimensional model of the vacant house corresponding to the three-dimensional model of the first house; adds the three-dimensional model of furniture and home appliances to the three-dimensional model of the vacant house to generate the three-dimensional model of the second house; The model is stored corresponding to the three-dimensional model of the second house.
  • the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are stored in the back-end server.
  • the 3D model of the house before decoration is realized by obtaining 3D point cloud data of the actual housing and 3D modeling.
  • the embodiment of the present disclosure will provide an embodiment in which the back-end server obtains a three-dimensional model of a house after decoration.
  • the background server obtains preset house information according to the three-dimensional model of the house before decoration.
  • the preset house information includes house type information, floor height information, and point location information. It is understandable that the house type information can also be obtained according to the house type map.
  • the back-end server generates a three-dimensional model of an unoccupied house corresponding to the three-dimensional model of the house before decoration according to the preset house information.
  • the three-dimensional model of the unoccupied house is generated according to the house type and floor height of the actual housing corresponding to the three-dimensional model of the house before decoration, and the point information is arranged consistently according to the point information of the three-dimensional model of the house before decoration.
  • the vacant three-dimensional model may include preliminary home improvement information such as floors.
  • the three-dimensional model of the furniture and home appliances can be obtained from a third party, or can be extracted from a large number of point cloud data of actual housing. Add the corresponding three-dimensional model of furniture and appliances to the three-dimensional model of the unoccupied house according to the information of the house type, and place the three-dimensional model of each furniture and appliance in the corresponding position. For example, put the three-dimensional model of the sofa in the living room to generate the decorated 3D model of the house.
  • the back-end server stores the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration correspondingly for display on the same screen and same viewing angle.
  • the embodiments of the present disclosure generate a three-dimensional model of an unoccupied house according to the preset house information of the three-dimensional model of the house before decoration, and then add the three-dimensional model of furniture and appliances to the three-dimensional model of the unoccupied house to generate a three-dimensional house after decoration.
  • the model realizes the effective acquisition of the three-dimensional model of the house after decoration, and provides a basis for displaying the three-dimensional model of the house before the decoration and the three-dimensional model of the house after the decoration on the same screen and at the same viewing angle.
  • adding a three-dimensional model of furniture and appliances to the three-dimensional model of the unoccupied house specifically includes: automatically adding a corresponding three-dimensional model of the furniture and appliances to the three-dimensional model of the unoccupied house, wherein the furniture and appliances
  • the three-dimensional model is a pre-generated three-dimensional model.
  • the three-dimensional model of the furniture and home appliances is a pre-generated three-dimensional model.
  • a three-dimensional model of furniture and home appliances can be added to the three-dimensional model of the unoccupied house by means of artificial intelligence to obtain a three-dimensional model of the house after decoration, or it can be added manually.
  • the renovated house 3D model is used as output, and the 3D model of the unoccupied house corresponding to the renovated house 3D model and the 3D model of furniture and home appliances are used as input.
  • a large number of training samples are used to obtain the added model of furniture and home appliances through machine learning training.
  • Using the furniture and household appliances adding model to automatically add the corresponding three-dimensional model of the furniture and household appliances to the three-dimensional model of the vacant house to generate a three-dimensional model of the house after decoration.
  • the three-dimensional model of the house after decoration is generated by automatically adding the corresponding three-dimensional model of furniture and household appliances to the three-dimensional model of vacant house, which improves the efficiency of generating the three-dimensional model of the house after decoration.
  • both the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration can realize the switching display of the VR real-view map, the three-dimensional model map, and the house map.
  • Fig. 6 is a flowchart of a method for displaying a three-dimensional model of a house on the same screen before and after decoration according to another embodiment of the present disclosure.
  • the method for displaying the three-dimensional model of the house before and after decoration on the same screen provided by the embodiment of the present disclosure can realize convenient comparison before and after decoration.
  • the front end needs to analyze the coordinates and line of sight in the user's current perspective screen, identify its point in the three-dimensional model, and trigger the synchronization of the two three-dimensional models to prompt the same screen to present the two before and after decoration Models.
  • the child page that rotates the angle of view will report the change of angle of view to the parent page, and the parent page will then send the change of angle of view to all the child pages to achieve the synchronization of the status of all the child pages.
  • the embodiment of the present disclosure presents two windows on one screen at the front end, presents different content, and synchronizes the user's coordinates in different three-dimensional spaces. Perspective to realize the linkage of two three-dimensional models.
  • the embodiments of the present disclosure obtain VR data, house data, house type data, and decoration data, in an intelligent manner, based on the existing house data, pre-generate a decorated three-dimensional model and input it into the background.
  • the user touches the sub-page
  • the status will be uploaded to the parent page, and then sent to other child pages through the parent page (or the status of the child page touched by the user will be directly sent to other child pages), and the three-dimensionality is guaranteed through perspective synchronization, panorama/model switching and point switching Synchronization of information display in the space.
  • Fig. 7 is a schematic structural diagram of a device for displaying a three-dimensional model of a house on the same screen before and after decoration provided by an embodiment of the present disclosure.
  • the device 700 for displaying the three-dimensional model of a house before and after decoration on the same screen includes a viewing angle change information acquisition module 701, a first display module 702, and a second display module 703.
  • the viewing angle change information acquisition module 701 is used for: Obtain the viewing angle change information of the user roaming and/or saccade in the current virtual three-dimensional space; the viewing angle change information includes point change information and/or line of sight change information; the first display module 702 is used to: The space corresponds to the first three-dimensional model of the house, and the display perspective of the second three-dimensional model of the house is adjusted according to the viewing angle change information, so that the first three-dimensional model of the house and the second three-dimensional model of the house are displayed on the same screen and at the same perspective;
  • the display module 703 is configured to: if the current virtual three-dimensional space corresponds to the second house three-dimensional model, adjust the display angle of the first house three-dimensional model according to the viewing angle change information, so that the first house three-dimensional model And the second house three-dimensional model is displayed on the same screen and at the same viewing angle; wherein, the first house model and the second house model are in the same screen and same viewing angle display state before the user’s viewing angle changes;
  • the embodiment of the present disclosure adjusts the display angle of view of the decorated house 3D model according to the user's roaming and/or glance in the virtual three-dimensional space of the house 3D model before decoration, or adjusts the display angle of view of the decorated house 3D model according to the user's
  • the viewing angle change information of roaming and/or scanning in the virtual three-dimensional space Adjust the display perspective of the three-dimensional model of the house before decoration, realize the linkage of the three-dimensional model of the house before and after the decoration on the same screen and the same perspective, allowing users to visually observe the decoration
  • the difference comparison between the three-dimensional models of the two houses before and after decoration provides users with a real-life display of decoration effects.
  • the viewing angle change information obtaining module 701 is specifically configured to: obtain the viewing angle change information of the user roaming and/or scanning in the current virtual three-dimensional space through the sub-page of the house three-dimensional model corresponding to the current virtual three-dimensional space
  • the first display module 702 is configured to: if the current virtual three-dimensional space corresponds to the first three-dimensional model of the house, report the viewing angle change information to the parent page through the child page of the first three-dimensional model of the house, the The parent page then sends the viewing angle change information to the child page of the second three-dimensional house model, and the child page of the second three-dimensional house model adjusts the display view angle of the second three-dimensional house model according to the viewing angle change information , So that the first three-dimensional model of the house and the second three-dimensional model of the house are displayed on the same screen and the same viewing angle; the second display module 703 is used to: if the current virtual three-dimensional space corresponds to the second three-dimensional model of the house, pass all
  • the first display module 702 is configured to: if the current virtual three-dimensional space corresponds to the first three-dimensional model of the house, directly send the viewing angle change information through the sub-page of the first three-dimensional model of the house Give the sub-page of the second house three-dimensional model, the sub-page of the second house three-dimensional model adjusts the display angle of the second house three-dimensional model according to the viewing angle change information, so that the first house three-dimensional model and the The second house 3D model is displayed on the same screen and at the same angle of view; the second display module 703 is used to: if the current virtual 3D space corresponds to the second house 3D model, display all data through the subpage of the second house 3D model The viewing angle change information is directly sent to the sub-page of the first three-dimensional house model, and the sub-page of the first three-dimensional house model adjusts the display angle of the first three-dimensional house model according to the viewing angle change information, so that the The three-dimensional model of a house and the three-dimensional model of the
  • the embodiments of the present disclosure use the parent page to control the child pages of the three-dimensional house model before decoration and the child pages of the three-dimensional house model after decoration (or the child pages of the three-dimensional house model before decoration and the decoration Direct communication between the sub-pages of the three-dimensional model of the house after the decoration), the three-dimensional model of the house before the decoration and the three-dimensional model of the house after the decoration are displayed on the same screen and the same viewing angle, which improves the convenience and reliability of the same screen and the same viewing angle display control.
  • the first display module 702 is further configured to: display the three-dimensional model of the first house, obtain the viewing angle information of the three-dimensional model of the first house, and obtain the three-dimensional model of the second house from the background server, And display the second house three-dimensional model according to the perspective information of the first house three-dimensional model, so that the first house three-dimensional model and the second house three-dimensional model are displayed on the same screen and at the same angle; the second display module 703 also uses In: display the second house three-dimensional model, obtain the view angle information of the second house three-dimensional model, obtain the first house three-dimensional model from the back-end server, and display the second house three-dimensional model according to the view angle information of the second house
  • the first three-dimensional model of the house enables the first three-dimensional model of the house and the second three-dimensional model of the house to be displayed on the same screen and at the same viewing angle; wherein the viewing angle information includes point information and line-of-sight direction information.
  • the embodiments of the present disclosure display the three-dimensional model of the house after decoration according to the perspective information of the three-dimensional model of the house before decoration, or display the three-dimensional model of the house before decoration according to the perspective information of the three-dimensional model of the house after decoration,
  • the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration are initially displayed on the same screen and with the same viewing angle.
  • the first display module 702 is further configured to: determine whether preset trigger information is received, and if it is determined that the preset trigger information is received, execute the acquisition of the first house three-dimensional model
  • the second display module 703 is also used to determine whether the preset trigger information is received, and if it is determined that the preset trigger information is received, execute the acquisition of the second house three-dimensional model The action of perspective information.
  • the embodiments of the present disclosure realize the same screen and same viewing angle display of the three-dimensional model of the house before decoration and the three-dimensional model of the house after decoration after receiving the preset trigger information, which improves the flexibility of display control.
  • Fig. 8 is a schematic structural diagram of a system for displaying a three-dimensional model of a house on the same screen before and after decoration provided by an embodiment of the present disclosure.
  • the system includes a device 700 for displaying the three-dimensional model of a house before and after decoration on the same screen and a back-end server 800; the back-end server 800 is specifically used to obtain preset house information according to the first three-dimensional model of the house, so
  • the preset house information includes house type information, floor height information, and point location information; according to the preset house information, a three-dimensional model of the unoccupied house corresponding to the three-dimensional model of the first house is generated; and the three-dimensional model of furniture and appliances is added to the three-dimensional unoccupied house.
  • the second house three-dimensional model is generated; the first house three-dimensional model and the second house three-dimensional model are correspondingly stored.
  • the embodiment of the present disclosure adjusts the display angle of view of the decorated house 3D model according to the user's roaming and/or glance in the virtual three-dimensional space of the house 3D model before decoration, or adjusts the display angle of view of the decorated house 3D model according to the user's
  • the viewing angle change information of roaming and/or scanning in the virtual three-dimensional space Adjust the display perspective of the three-dimensional model of the house before decoration, realize the linkage of the three-dimensional model of the house before and after the decoration on the same screen and the same perspective, allowing users to visually observe the decoration
  • the difference comparison between the three-dimensional models of the two houses before and after decoration provides users with a real-life display of decoration effects.
  • the background server 2 is further configured to automatically add the corresponding three-dimensional model of the furniture and home appliances to the three-dimensional model of the vacant house, wherein the three-dimensional model of the furniture and home appliances is a pre-generated three-dimensional model.
  • the embodiment of the present disclosure generates a three-dimensional model of the vacant house according to the preset house information of the three-dimensional model of the house before decoration, and automatically adds the corresponding three-dimensional model of the furniture and household appliances to the three-dimensional model of the vacant house to generate decoration
  • the final three-dimensional model of the house realizes the fast and effective acquisition of the three-dimensional model of the decorated house.
  • the method for generating a furniture placement scheme based on a house type generates a training sample set and performs neural network training to obtain a neural network model; using the neural network model and preset furniture placement decision rules to determine the type of house that needs decoration
  • the map is processed to obtain the furniture placement plan corresponding to the house plan that needs to be decorated, and the furniture placement plan corresponding to the user's house type can be generated intelligently.
  • FIG. 9 is a flowchart of an embodiment of a method for generating a furniture placement scheme based on a house type of the present disclosure.
  • the method shown in FIG. 5 includes steps: S901-S903. The steps are described separately below.
  • S901 Acquire sample house type structure data corresponding to the first sample house type map.
  • the first sample house plan may be a sample house plan generated by a CAD modeling tool, etc., the sample house plan may be a vector diagram, etc.
  • the sample house plan has multiple house type elements, and the sample house plan is set with house type structure data.
  • the sample house type structure data includes: wall distribution data, bearing wall distribution data, door and window distribution data, area data, floor height data, location coordinate data, etc. of the house type.
  • S902 Obtain a second sample house plan corresponding to the first sample house plan and on which furniture is placed, and mark the furniture placed in the second sample house plan to generate first furniture information.
  • the second sample house plan is a sample house plan with furniture, which corresponds to the first sample house plan.
  • the furniture can be a table, bed, electrical appliances, etc.
  • the second sample house plan can be marked manually.
  • the first furniture information includes furniture category, placement, orientation, style, size, etc., and the second sample house plan can also be scored.
  • S903 According to the first sample house plan, the second sample house plan, the first furniture information and the sample house structure data, use the preset furniture placement decision rules to process the house plans that need to be decorated, and obtain the house plans that need to be decorated.
  • the furniture placement plan corresponding to the picture.
  • the training sample set is generated according to the first sample house plan, the second sample house plan, the first furniture information, and the sample house structure data.
  • the neural network is trained according to the training samples, and the neural network model is obtained.
  • There are many types of neural network models. Use the neural network model and preset furniture placement decision rules to process the house plan that needs decoration, and obtain the furniture placement plan corresponding to the house plan that needs decoration.
  • the floor plan that needs to be decorated can provide users with the floor plan that needs to be decorated. Use the trained neural network model and the preset furniture placement decision rules to process the floor plan that needs to be decorated, and obtain the corresponding floor plan that needs to be decorated.
  • the number of furniture placement plans can be one or more.
  • the furniture placement plan includes a furniture placement plan and furniture display information used to display the placement of tables, beds, electrical appliances and other furniture in the floor plan that needs to be decorated.
  • the present disclosure is not limited to this.
  • the first and the first furniture information can be obtained.
  • the sample house structure data of the second sample house plan, and the first furniture information of the first and second sample house plans are generated, so as to according to the first sample house plan, the second sample house plan, the first furniture information and the sample house structure data Generate a training sample set.
  • the corresponding three-dimensional model of the decorated house (that is, the three-dimensional space) can be generated according to the furniture placement plan for the floor plan that needs to be decorated. Panorama).
  • the furniture placement decision rule may be a "core function allocation to room” rule, such as whether the dining table should be placed in the living room or the kitchen, and the washing machine should be placed in the bathroom or balcony.
  • FIG. 10 is a flowchart of an embodiment of a method for generating a furniture placement scheme based on a house type of the present disclosure.
  • the method shown in FIG. 10 includes steps: S1001-S1004. The steps are described separately below.
  • the user can input or select the floor plan to be decorated through the front-end page.
  • the house plan that needs decoration input by the user can be a house plan generated by CAD modeling tools, etc.
  • the house plan that needs decoration can be a vector diagram, etc., and the decoration house structure data can be obtained from the house plan that needs decoration.
  • the decoration house structure data includes: the wall distribution data of the house type, load-bearing wall distribution data, door and window distribution data, area data, floor height data, location coordinate data, etc.
  • S1002 Input the house plan and structure data of the house to be decorated into the neural network model, and obtain the furniture placement information corresponding to the house plan to be decorated and the second furniture corresponding to the furniture placement information from the neural network model information.
  • the second furniture information includes: furniture category, placement location, orientation, style, size, etc.
  • S1003 Use furniture placement decision rules to process furniture placement information, and obtain a furniture placement map.
  • S1004 Obtain display information corresponding to the furniture placed in the furniture placement diagram based on the second furniture information.
  • the display information includes: furniture category, placement position, orientation, style, size, etc., which is the display information of the actual furniture selected from the furniture placement information using the furniture placement decision rules.
  • the furniture placement information may be the furniture placement heat map output by the neural network model, etc.
  • the furniture placement heat map includes: the location information of the furniture recommended to be placed in the floor plan that needs decoration, and the recommended placement The corresponding placement probability of the placed furniture, etc.
  • the furniture placement heat map includes the location information of the recommended beds, tables and other furniture in the floor plan that needs to be decorated, the placement probability of the beds, tables and other furniture that are recommended to be placed in this location, and/or suggestions Display information of furniture such as beds and tables.
  • the energy function corresponding to the recommended furniture can be obtained according to the discharge position relationship of the furniture, and the constraint condition can be established based on the energy function.
  • the Monte Carlo search tree algorithm is used to traverse the furniture placement heat map to obtain the furniture placement graph that meets the constraints.
  • the number of furniture placed in the furniture placement graph is within the preset number interval.
  • the placement position between the recommended furniture and the wall and between other recommended furniture can be obtained, and the energy function E(x) can be established based on the placement position.
  • E(x) the energy function
  • min( ⁇ E(x)) is the constraint condition.
  • Monte Carlo tree search is also called random sampling or statistical test method.
  • Monte Carlo tree search method is a calculation method based on probability and statistical theory method because it can truly simulate the actual physical process. It uses random numbers to solve the problem. Many methods of calculating problems. Link the problem to be solved with a certain probability model to obtain an approximate solution to the problem.
  • the Monte Carlo search tree is traversed through the Monte Carlo search algorithm, and the recommended furniture is selected in the furniture placement heat map as the actual furniture. That is, from the constructed Monte Carlo search tree, the actual furniture that satisfies the constraints is selected, and at the same time, the comprehensive placement probability corresponding to all the selected actual furniture is maximized, and the furniture is placed
  • the number of furniture placed in the map is within the preset number interval.
  • the comprehensive placement probability can be the sum, weighted sum, etc. of placement probabilities of all the furniture actually placed.
  • the neural network model can be established using multiple algorithm models, for example, the neural network model can be established through the residual network ResNet/DenseNet.
  • ResNet Residual Neural Network
  • the structure of ResNet can speed up the training of neural networks very quickly, and the accuracy of the model has also been greatly improved.
  • the neural network model includes the input layer neuron model, the middle layer neuron model and the output layer neuron model.
  • the output of each layer of neuron model is used as the input of the next layer of neuron model.
  • the neural network model can have a fully connected structure
  • the sub-network structure of multiple neural network layers, the middle layer neuron model is a fully connected layer.
  • a training sample set will be generated according to the first sample house plan, the second sample house plan, the first furniture information, and the sample house structure data, and the neural network will be trained according to the training samples to obtain the neural network model. Use a large number of training samples to train the deep algorithm model to obtain a trained neural network model.
  • the furniture display heat map includes the recommended beds and tables in the house map that needs decoration Wait for the location information of the furniture, the placement probability of furniture such as beds, tables, etc. that are recommended to be placed at this location.
  • FIG. 11 is a flow chart of optimizing the placement of furniture in an embodiment of the method for generating a furniture placement scheme based on apartment type of the present disclosure.
  • the method shown in FIG. 11 includes steps: S1101-S1102. Each step is explained separately below.
  • S1101 Determine matching items corresponding to the furniture placed in the furniture placement map based on the preset furniture combination strategy and display information.
  • Furniture combination strategies include furniture combination algorithms, etc.
  • the supporting items can be furniture, bedding, and decorative items.
  • the matching item corresponding to the placed bed is determined as a bedside table based on the furniture combination algorithm, and the style and size of the bedside table are determined based on the display information of the bed.
  • the furniture placement strategy includes: wall placement strategy, placement to the floor Strategy etc.
  • the wall sticking strategy can be a wall sticking algorithm, etc.
  • the ground sticking strategy can be a ground sticking algorithm, etc. Based on the wall sticking algorithm, the grounding algorithm, etc., and according to the decoration structure data, the furniture placed in the furniture layout diagram and the corresponding The placement of supporting items.
  • FIG. 12 is a flow chart of generating a three-dimensional rendering model in an embodiment of the method for generating a furniture placement scheme based on apartment type of the present disclosure.
  • the method shown in FIG. 12 includes steps: S1201-S1204. The steps are described separately below.
  • S1201 Generate a three-dimensional house model according to the house plan to be renovated and the structure data of the renovated house.
  • modeling tools such as CAD modeling tools, etc.
  • a variety of modeling tools can be used to generate three-dimensional furniture models of the furniture placed in the furniture placement diagram and supporting items according to the display information.
  • S1203 Combine the three-dimensional house model and the three-dimensional furniture model according to the furniture layout to generate a three-dimensional house decoration model. Place the three-dimensional furniture model in the designated area of the three-dimensional house model according to the furniture placement plan.
  • S1204 Determine the decoration style according to the displayed information, and perform rendering processing on the three-dimensional house decoration model based on the decoration style. From this, a three-dimensional model of the decorated house is generated
  • the present disclosure provides an apparatus for generating a furniture placement scheme based on a house type, including: a house type data obtaining module 1301, a furniture information labeling module 1302, and a placement scheme obtaining module 1305.
  • the house type data obtaining module 1301 obtains sample house type structure data corresponding to the first sample house type map.
  • the furniture information labeling module 1302 obtains a second sample house plan corresponding to the first sample house plan with furniture, and labels the furniture placed in the second sample house plan to generate first furniture information.
  • the placement plan obtaining module 1305 uses the preset furniture placement decision rules to process the house plans that need to be decorated according to the first sample house plan, the second sample house plan, the first furniture information, and the sample house structure data.
  • the furniture placement plan corresponding to the floor plan that needs decoration.
  • the device for generating a furniture placement scheme based on a house type further includes: a training sample generating module 1303 and a model training module 1304.
  • the training sample generating module 1303 generates a training sample set according to the first sample house plan, the second sample house plan, the first furniture information, and the sample house structure data.
  • the model training module 135 trains the neural network according to the training samples to obtain the neural network model.
  • the placement plan obtaining module 1305 uses the neural network model and preset furniture placement decision rules to process the floor plan that needs to be decorated, and obtains the furniture placement plan corresponding to the floor plan that needs to be decorated.
  • the house type data obtaining module 1301 obtains the decoration house type structure data corresponding to the house type map that needs to be decorated.
  • the placement plan obtaining module 1305 inputs the floor plan and floor structure data to be decorated into the neural network model, and obtains the furniture placement information corresponding to the floor plan that needs to be decorated and the furniture placement information output from the neural network model.
  • the second furniture information The placement plan obtaining module 1305 uses the furniture placement decision rule to process the furniture placement information, obtain the furniture placement map, and obtain the display information corresponding to the furniture placed in the furniture placement map based on the second furniture information.
  • the furniture placement information includes furniture placement heat map, etc.
  • the furniture heat map includes: the location information of the furniture recommended to be placed in the floor plan that needs decoration, and the placement probability corresponding to the recommended furniture.
  • the placement scheme obtaining module 1305 obtains the energy function corresponding to the recommended placement of the furniture according to the discharge position relationship of the furniture, and establishes constraint conditions based on the energy function.
  • the placement plan obtaining module 1305 uses the Monte Carlo search tree algorithm to traverse the furniture placement heat map to obtain the furniture placement map that meets the constraint conditions; among them, the number of furniture placed in the furniture placement map is at the preset number Interval.
  • the placement position optimization module 1306 determines the matching items corresponding to the furniture placed in the furniture placement diagram based on a preset furniture combination strategy and display information.
  • the placement location optimization module 1306 optimizes the placement of the furniture placed in the furniture placement diagram and the placement of the corresponding supporting items based on the preset furniture placement strategy and according to the decoration structure data.
  • the furniture placement strategy includes: wall sticking Strategy, local strategy, etc.
  • the display module processing module 1307 generates a three-dimensional house model according to the house plan to be renovated and the structure data of the house decoration, and generates a three-dimensional furniture model corresponding to the furniture and accessory items placed in the furniture layout according to the display information.
  • the display module processing module 1307 combines the three-dimensional house model and the three-dimensional furniture model according to the furniture layout to generate a three-dimensional house decoration model, determines the decoration style according to the display information, and renders the three-dimensional house decoration model based on the decoration style.
  • the method, device, electronic equipment, and storage medium for generating a furniture placement scheme based on a house type generate a training sample set based on the first sample house type map, the second sample house type map, the first furniture information, and the sample house type structure data And carry out neural network training to obtain the neural network model; use the neural network model and preset furniture placement decision rules to process the house plans that need to be decorated, and obtain the furniture placement plan corresponding to the house plans that need to be decorated; Intelligently generate the furniture placement plan corresponding to the user's house type, and can generate a three-dimensional decoration rendering corresponding to the user's house type, so that the user can browse the house decoration plan in all directions, save designer resources and design process time, which can help Users can quickly and easily select suitable furniture and decoration schemes, which can simplify the process of decoration design and provide convenience for users to make decoration decisions and reduce the cost of decoration.
  • FIG. 15 is a structural diagram of an embodiment of the electronic device (ie, computing device) of the present disclosure. As shown in FIG. 15, the electronic device 1501 includes one or more processors 1511 and a memory 1512.
  • the processor 1511 may be a central processing unit (CPU) or other form of processing unit with data processing capability and/or instruction execution capability, and may control other components in the electronic device 1501 to perform desired functions.
  • CPU central processing unit
  • the memory 1512 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory.
  • Volatile memory for example, may include random access memory (RAM) and/or cache memory (cache).
  • Non-volatile memory for example, may include: read only memory (ROM), hard disk, flash memory, etc.
  • One or more computer program instructions may be stored on a computer-readable storage medium, and the processor 1511 may run the program instructions to implement the method for generating furniture placement schemes based on the apartment type and/or other embodiments of the present disclosure above. The desired function.
  • Various contents such as input signal, signal component, noise component, etc. can also be stored in the computer-readable storage medium.
  • the electronic device 1501 may further include: an input device 1513 and an output device 1514, etc., and these components are interconnected by a bus system and/or other forms of connection mechanisms (not shown).
  • the input device 1513 may also include, for example, a keyboard, a mouse, and so on.
  • the output device 1514 can output various information to the outside.
  • the output device 1514 may include, for example, a display, a speaker, a printer, and a communication network and a remote output device connected thereto.
  • the electronic device 1501 may also include any other appropriate components according to specific application conditions.
  • the embodiments of the present disclosure may also be computer program products, which include computer program instructions, which when run by a processor cause the processor to execute the description in the "exemplary method" section of this specification. Steps in a method for generating a furniture placement plan based on a house type according to various embodiments of the present disclosure.
  • the computer program product may use any combination of one or more programming languages to write program codes for performing the operations of the embodiments of the present disclosure.
  • the programming languages include object-oriented programming languages, such as Java, C++, etc. , Also includes conventional procedural programming languages, such as "C" language or similar programming languages.
  • the program code can be executed entirely on the user's computing device, partly on the user's device, executed as an independent software package, partly on the user's computing device and partly executed on the remote computing device, or entirely on the remote computing device or server Executed on.
  • embodiments of the present disclosure may also be a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the processor executes the “exemplary method” part of this specification.
  • the computer-readable storage medium may adopt any combination of one or more readable media.
  • the readable medium may be a readable signal medium or a readable storage medium.
  • the readable storage medium may include, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the above, for example. More specific examples (non-exhaustive list) of readable storage media may include: electrical connections with one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), Erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a method for displaying a three-dimensional model of a house on the same screen before and after decoration characterized in that it includes:
  • the user terminal obtains viewing angle change information of the user roaming and/or saccades in the current virtual three-dimensional space, where the viewing angle change information includes point change information and/or line of sight direction change information;
  • the current virtual three-dimensional space corresponds to the first three-dimensional model of the house
  • the display angle of view of the first house three-dimensional model is adjusted according to the viewing angle change information, so that the first house three-dimensional model and the second house The 3D model is displayed on the same screen and the same viewing angle
  • the first house model and the second house model are in the same-screen and same-view display state before the user's perspective changes;
  • the first three-dimensional house model refers to the three-dimensional model of the current house.
  • the 3D model of the second house refers to the 3D model of the decorated house after the recommended decoration effect is loaded.
  • the adjusting the display angle of the second three-dimensional model of the house according to the viewing angle change information specifically includes: passing through the sub-page of the first three-dimensional model of the house
  • the viewing angle change information is reported to the parent page, and the parent page sends the viewing angle change information to the child page of the second three-dimensional model of the house, and the child page of the second three-dimensional model of the house is based on the viewing angle.
  • the change information adjusts the display angle of view of the second house three-dimensional model;
  • adjusting the display angle of the first three-dimensional model of the house according to the viewing angle change information specifically includes: displaying the three-dimensional model of the second house through a sub-page of the second three-dimensional model.
  • the viewing angle change information is reported to the parent page, and the parent page sends the viewing angle change information to the child page of the first three-dimensional model of the house.
  • the child page of the first three-dimensional model of the house is based on the viewing angle.
  • the change information adjusts the display angle of view of the first three-dimensional model of the house.
  • EEE3 The method for displaying a three-dimensional model of a house on the same screen before and after decoration according to EEE1, characterized in that, before acquiring the information about the viewing angle change information of the user roaming and/or scanning in the current virtual three-dimensional space, the method further includes:
  • Display the first three-dimensional model of the house obtain the perspective information of the first three-dimensional model of the house, obtain the second three-dimensional model of the house from the backend server, and display the second three-dimensional model according to the perspective information of the first three-dimensional model A three-dimensional model of the house, so that the three-dimensional model of the first house and the three-dimensional model of the second house are displayed on the same screen and at the same viewing angle;
  • Display the second house three-dimensional model obtain the perspective information of the second house three-dimensional model, obtain the first house three-dimensional model from the backend server, and display the first house three-dimensional model according to the second house three-dimensional model perspective information A three-dimensional model of the house, so that the three-dimensional model of the first house and the three-dimensional model of the second house are displayed on the same screen and at the same viewing angle;
  • the viewing angle information includes point position information and line of sight direction information.
  • EEE4 The method for displaying a three-dimensional model of a house before and after decoration on the same screen as described in EEE3, characterized in that, before acquiring the view angle information of the first three-dimensional model of the house, the method further includes: determining whether a preset is received Trigger information, if it is determined that the preset trigger information is received, execute the action of obtaining the view angle information of the first three-dimensional model of the house;
  • the method further includes: determining whether the preset trigger information is received, and if it is determined that the preset trigger information is received, then executing the acquiring The action of the viewing angle information of the second house three-dimensional model.
  • EEE5 The method for displaying a three-dimensional model of a house on the same screen before and after decoration according to EEE3, characterized in that the method further includes:
  • the background server obtains preset house information according to the first three-dimensional model of the house, where the preset house information includes house type information, floor height information, and point location information;
  • the three-dimensional model of the first house and the three-dimensional model of the second house are correspondingly stored.
  • EEE6 The method for displaying a three-dimensional model of a house before and after decoration on the same screen according to EEE5, characterized in that, adding a three-dimensional model of furniture and home appliances to the three-dimensional model of vacant house specifically includes:
  • the corresponding three-dimensional model of the furniture and household appliances is automatically added to the three-dimensional model of the unoccupied house, wherein the three-dimensional model of the household appliances is a pre-generated three-dimensional model.
  • a device for displaying the three-dimensional model of a house on the same screen before and after decoration characterized in that it includes:
  • a viewing angle change information acquisition module which is used for: acquiring viewing angle change information of a user roaming and/or scanning in the current virtual three-dimensional space;
  • the first display module is configured to: if the current virtual three-dimensional space corresponds to the first house three-dimensional model, adjust the display angle of the second house three-dimensional model according to the viewing angle change information, so that the first house three-dimensional model and the house The three-dimensional model of the second house is displayed on the same screen and at the same viewing angle;
  • the second display module is configured to: if the current virtual three-dimensional space corresponds to the second house three-dimensional model, adjust the display angle of the first house three-dimensional model according to the viewing angle change information, so that the first house The three-dimensional model and the three-dimensional model of the second house are displayed on the same screen and at the same viewing angle;
  • the first house model and the second house model are in the same-screen and same-view display state before the user's perspective changes;
  • the first three-dimensional house model refers to the three-dimensional model of the current house.
  • the 3D model of the second house refers to the 3D model of the decorated house after the recommended decoration effect is loaded.
  • EEE8 A system for displaying the three-dimensional model of a house on the same screen before and after decoration, characterized in that it includes the device for displaying the three-dimensional model of the house before and after decoration on the same screen and the same viewing angle as described in EEE 7 and the back-end server described in any of EEE 5-6 .
  • An electronic device comprising a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor executes the program as described in any one of EEE1 to 4 Describes the steps of the method of displaying the three-dimensional model of the house on the same screen and at the same angle of view before and after decoration.
  • EEE10 A non-transitory computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the three-dimensional model of the house before and after decoration as described in any one of EEE1 to 4 can be on the same screen The steps of the same viewing angle display method.
  • the method, device and system for displaying the three-dimensional model of the house before and after decoration on the same screen provided by the embodiments of the present disclosure adjust the house after decoration according to the viewing angle change information of the user roaming and/or scanning in the virtual three-dimensional space of the three-dimensional house model before decoration.
  • the display perspective of the three-dimensional model or adjust the display perspective of the three-dimensional model of the house before the decoration according to the user's roaming and/or glance in the virtual three-dimensional space of the three-dimensional model of the house after the decoration, to realize the house before and after the decoration
  • the three-dimensional model is linked to the same screen and the same viewing angle, allowing users to visually observe the difference between the three-dimensional models of the two houses before and after decoration, providing users with a real-feeling display of the decoration effect.
  • a method for generating furniture placement scheme based on apartment type including:
  • the house plan that needs to be decorated is processed using preset furniture placement decision rules, Obtain the furniture placement plan corresponding to the floor plan to be decorated.
  • EEE12 The method described in EEE11, the processing of the house plan that needs to be decorated, and obtaining the furniture placement plan corresponding to the house plan that needs to be decorated includes:
  • the neural network model and the preset furniture placement decision rules are used to process the house plan to be decorated, and to obtain a furniture placement plan corresponding to the house plan to be decorated.
  • EEE13 the method as described in EEE12, which uses the neural network model and preset furniture placement decision rules to process the house plan that needs to be decorated, and obtains the furniture placement corresponding to the house plan that needs to be decorated
  • the plan includes:
  • EEE14 The method according to EEE13, wherein:
  • the neural network model includes: input layer neuron model, middle layer neuron model and output layer neuron model; the output of each layer of neuron model is used as the input of the next layer of neuron model;
  • the neural network model is a sub-network structure of multiple neural network layers with a fully connected structure; the middle layer neuron model is a fully connected layer.
  • EEE15 The method as described in EEE13, wherein:
  • the furniture placement information includes: furniture placement heat map;
  • the furniture heat map includes: location information of the furniture recommended to be placed in the floor plan requiring decoration, and the placement probability corresponding to the recommended furniture.
  • EEE16 The method described in EEE15, wherein the processing of the furniture placement information by using the furniture placement decision rule to obtain a furniture placement map includes:
  • the Monte Carlo search tree algorithm is used to traverse the furniture placement heat map to obtain the furniture placement graph that satisfies the constraint conditions; wherein, the number of furniture placed in the furniture placement graph is located in the preset Set the number interval.
  • EEE17 the method as described in EEE16, further includes:
  • the furniture placement strategy includes one or more of a wall sticking strategy and a floor sticking strategy.
  • a device for generating furniture placement scheme based on apartment type including:
  • the house-type data acquisition module is used to obtain the sample house-type structure data corresponding to the first sample house-type map
  • the furniture information labeling module is used to obtain a second sample house plan with furniture corresponding to the first sample house plan, mark the furniture placed in the second sample house plan, and generate the first sample house plan.
  • a piece of furniture information is used to obtain a second sample house plan with furniture corresponding to the first sample house plan, mark the furniture placed in the second sample house plan, and generate the first sample house plan.
  • the placement plan obtaining module is configured to use preset furniture placement decision rules to pair according to the first sample house plan, the second sample house plan, the first furniture information, and the sample house structure data
  • the floor plan that needs to be decorated is processed, and a furniture placement plan corresponding to the floor plan that needs to be decorated is obtained.
  • EEE19 A computer-readable storage medium storing a computer program, and the computer program is used to execute the method described in any one of EEE11-17.
  • EEE20 An electronic device, the electronic device comprising:
  • Processor a memory for storing executable instructions of the processor
  • the processor is configured to read the executable instruction from the memory, and execute the instruction to implement the method described in any one of EEE11-17.
  • a method and device for generating a furniture placement scheme based on a house type, as well as electronic equipment and storage media can intelligently generate a furniture placement scheme corresponding to the user’s house type, which can help users to quickly and easily Choosing suitable furniture and decoration plan locally can simplify the process of decoration design and provide convenience for users to make decoration decisions.
  • the method and apparatus of the present disclosure may be implemented in many ways.
  • the method and apparatus of the present disclosure can be implemented by software, hardware, firmware or any combination of software, hardware, and firmware.
  • the above-mentioned order of the steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above, unless specifically stated otherwise.
  • the present disclosure may also be implemented as programs recorded in a recording medium, and these programs include machine-readable instructions for implementing the method according to the present disclosure.
  • the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.
  • each component or each step can be decomposed and/or recombined. These decomposition and/or recombination should be regarded as equivalent solutions of the present disclosure.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Computer Graphics (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Architecture (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开提供一种三维空间视图显示方法,所述三维空间视图包括第一三维空间视图和第二三维空间视图,所述方法包括:在第一用户界面上呈现所述第一三维空间视图;在第二用户界面上呈现所述第二三维空间视图;根据用户输入,改变所述第一三维空间视图;和根据所述第一三维空间视图的改变,改变所述第二三维空间视图。

Description

三维空间视图显示方法、装置及存储介质 技术领域
本公开涉及计算机技术领域,尤其涉及一种三维空间视图显示方法、装置及存储介质。
背景技术
随着房地产行业的深入发展,家居装饰行业也得到了极大的发展,对家居的装饰需求也越来越大。在传统的装修流程中,需要专业的且经验丰富的设计师提出改造设计,普通住户往往无法胜任,家具布局的效果严重依赖于专业设计师。用户要想看到基于自己户型的房屋装修效果,需要经过专业设计师量房、与用户沟通风格喜好、设计等流程,往往需要大量的时间设计图纸,占用了大量的设计师资源,设计流程时间长、事情繁琐且价格昂贵,不具备普遍适用性。
与目前流行的图片看房、视频看房、全景看房等无法提供深度信息和真实感知的看房概念不同的是,“VR看房”是指利用VR技术真实还原出房源三维场景,为用户提供自由模式下的沉浸式看房体验,从而让用户足不出户即可体验到真实看房场景。例如,通过打开APP上的VR房源,触摸屏幕任意处即可获得包括房屋真实空间的尺寸、朝向、远近等深度信息。在还原房源三维场景这方面,可以先对房屋进行多点多角度的扫描拍摄,得到完整的三维点云数据、经纬度数据以及多曝光的高清彩色照片,后期通过自动建模、智能空洞填补、全自动数据提取,HDR优化等三维重建技术,将全部数据及图片纹理映射到三维模型上,得到最终用户看到的真实房屋空间。
用户所看到的VR房源,有新房、二手房,对于新房很多是毛坯房,对于二手房,有的装修多年,且设施陈旧,用户一般购买房屋后均需进行装修才能入住。单纯依据实际的VR房源看房,用户无法获知装修后的房源景象,因此,看房信息不全面,不利于用户购房决策。
发明内容
为解决上述问题,本公开提供一种三维空间视图(或三维模型)显示方法、装置及存储介质。
本公开在一方面提供一种三维空间视图显示方法,所述三维空间视图包括第一三维空间视图和第二三维空间视图,所述方法包括:在第一用户界面上呈现所述第一三维空间视图;在第二用户界面上呈现所述第二三维空间视图;根据用户输入,改变所述第一三维空间视图;和根据所述第一三维空间视图的改变,改变所述第二三维空间视图。
在本公开的一个实施方式中,所述方法用于装修前后房屋三维模型同屏显示,
其中,根据用户输入,改变所述第一三维空间视图包括:
用户终端获取用户在所述第一三维空间视图中漫游和/或扫视的视角变化信息,
其中,所述第一三维空间视图对应于第一房屋三维模型,所述第二三维空间视图对应于第二房屋三维模型,
其中,根据所述第一三维空间视图的改变,改变所述第二三维空间视图包括:
根据所述视角变化信息调整第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示。
在本公开的一个实施方式中,所述第一用户界面是所述第一三维空间视图对应的第一房屋三维模型的子页面,
其中,所述获取用户在所述第一三维空间视图中漫游和/或扫视的视角变化信息,包括:
通过所述第一三维空间视图对应的第一房屋三维模型的子页面获取用户在第一三维空间视图中漫游和/或扫视的视角变化信息。
在本公开的一个实施方式中,所述第二用户界面是所述第二三维空间视图对应的第二房屋三维模型的子页面,
其中,根据所述视角变化信息调整第二房屋三维模型的显示视角,包括:通过所述第一房屋三维模型的子页面将所述视角变化信息发给所述第二房屋三维模 型的子页面,所述第二房屋三维模型的子页面根据所述视角变化信息调整所述第二房屋三维模型的显示视角。
在本公开的一个实施方式中,在第一用户界面上呈现所述第一三维空间视图包括:
显示所述第一房屋三维模型,
其中,在第二用户界面上呈现所述第二三维空间视图包括:
获取所述第一房屋三维模型的视角信息;
获取所述第二房屋三维模型;和
根据所述第一房屋三维模型的视角信息显示所述第二房屋三维模型,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示。
在本公开的一个实施方式中,判断是否接收到预设触发信息,若判断接收到所述预设触发信息,则执行所述获取所述第一房屋三维模型的视角信息的动作。
本公开的一个实施方式还包括:
根据所述第一房屋三维模型获取预设房屋信息,所述预设房屋信息包括户型信息、层高信息及点位信息;
根据所述预设房屋信息生成与所述第一房屋三维模型对应的空房三维模型;
将家具家电三维模型添加到所述空房三维模型中,生成所述第二房屋三维模型;和
将所述第一房屋三维模型与所述第二房屋三维模型对应存储。
在本公开的一个实施方式中,所述第一房屋三维模型和所述第二房屋三维模型中的至少一个是已装修房屋三维模型,
其中,所述方法还包括:
获取与多个样本户型图相对应的样本户型结构数据和家具信息;
根据所述多个样本户型图、所述家具信息以及所述样本户型结构数据,对指定户型图进行处理,为所述指定户型图生成家具摆放方案;和
根据所述家具摆放方案为所述指定户型图生成所述已装修房屋三维模型。
在本公开的一个实施方式中,为所述指定户型图生成家具摆放方案包括为所述指定户型图生成第一和第二家具摆放方案,
其中,根据所述家具摆放方案为所述指定户型图生成所述已装修房屋三维模型包括:
根据所述第一和第二家具摆放方案为所述指定户型图生成所述第一房屋三维模型和所述第二房屋三维模型。
在本公开的一个实施方式中,所述第二房屋三维模型是已装修房屋三维模型,
其中,所述方法还包括:
获取与第一样本户型图相对应的样本户型结构数据;
获取与所述第一样本户型图相对应的、摆放有家具的第二样本户型图,对所述第二样本户型图中摆放的家具进行标注,生成第一家具信息;
根据所述第一样本户型图、所述第二样本户型图、所述第一家具信息以及所述样本户型结构数据,利用预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案;和
根据所述家具摆放方案生成所述已装修房屋三维模型。
在本公开的一个实施方式中,对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案包括:
根据所述第一样本户型图、所述第二样本户型图、所述第一家具信息以及所述样本户型结构数据生成训练样本集;
根据所述训练样本集进行神经网络的训练,得到神经网络模型;和
利用所述神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案。
在本公开的一个实施方式中,利用所述神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案包括:
获取与所述需要装修的户型图相对应的装修户型结构数据;
将所述需要装修的户型图和所述装修户型结构数据输入所述神经网络模型,获取所述神经网络模型输出的与所述需要装修的户型图相对应的家具摆放信息,以及与所述家具摆放信息相对应的第二家具信息;
利用所述家具摆放决策规则对所述家具摆放信息进行处理,获取家具摆放图;和
基于所述第二家具信息获取与所述家具摆放图中摆放的家具相对应的展示信 息。
在本公开的一个实施方式中,所述神经网络模型包括:输入层神经元模型、中间层神经元模型和输出层神经元模型;每层神经元模型的输出作为下一层神经元模型的输入;
其中,所述神经网络模型为具有全连接结构的多个神经网络层的子网络结构;所述中间层神经元模型为全连接层。
在本公开的一个实施方式中,所述家具摆放信息包括:家具摆放热力图;
其中,所述家具热力图包括:在所述需要装修的户型图中建议摆放的家具的位置信息、与所述建议摆放的家具相对应的摆放概率。
在本公开的一个实施方式中,利用所述家具摆放决策规则对所述家具摆放信息进行处理,获取家具摆放图包括:
根据家具的排放位置关系获取与所述建议摆放的家具相对应的能量函数;
基于所述能量函数建立约束条件;和
使用蒙特卡罗搜索树算法对所述家具摆放热力图进行遍历,获取满足所述约束条件的所述家具摆放图,其中,在所述家具摆放图中摆放的家具的数量位于预设数量区间。
本公开的一个实施方式还包括:
基于预设的家具组合策略以及所述展示信息确定与所述家具摆放图中摆放的家具相对应的配套物品;和
基于预设的家具摆放策略并根据所述装修户型结构数据,优化所述家具摆放图中摆放的家具以及相对应的配套物品的摆放位置,
其中,所述家具摆放策略包括:贴墙策略、贴地策略中的一项或者多项。
在本公开的一个实施方式中,根据用户输入,改变所述第一三维空间视图包括:
在所述第一用户界面接收用户输入,以根据所述用户输入生成第一三维空间视图的视图改变指令;
所述第一用户界面根据所述视图改变指令加载用于更新第一三维空间视图的数据;
所述第一用户界面将所述视图改变指令发送给所述第二用户界面;和
所述第一用户界面通知所述第二用户界面其已完成数据加载,
其中,根据所述第一三维空间视图的改变,改变所述第二三维空间视图包括:
所述第二用户界面根据所述视图改变指令加载用于更新第二三维空间视图的数据;和
所述第二用户界面通知所述第一用户界面其已完成数据加载。
在本公开的一个实施方式中,所述用户输入是第一用户输入,所述方法还包括:
根据第二用户输入,改变所述第二三维空间视图;和
根据所述第二三维空间视图的改变,改变所述第一三维空间视图。
本公开在另一方面提供一种三维空间视图显示方法,所述三维空间视图至少包括第一三维空间视图和第二三维空间视图,所述方法包括:在第一用户界面上呈现第一三维空间视图;在第二用户界面上呈现第二三维空间视图;在所述第一用户界面接收用户输入,以根据所述用户输入生成第一三维空间视图的视图改变指令;所述第一用户界面根据所述视图改变指令加载用于更新第一三维空间视图的数据;将所述视图改变指令从所述第一用户界面发送给所述第二用户界面;所述第二用户界面根据所述视图改变指令加载用于更新第二三维空间视图的数据;所述第一用户界面和所述第二用户界面分别根据加载的用于更新第一三维空间视图的数据和加载的用于更新第二三维空间视图的数据更新所述第一三维空间视图和所述第二三维空间视图。
本公开的一个实施方式还包括:
所述第一用户界面通知所述第二用户界面其已完成数据加载;
所述第二用户界面通知所述第一用户界面其已完成数据加载;和
响应于所述第一用户界面和所述第二用户界面均已完成数据加载,同时更新所述第一三维空间视图和所述第二三维空间视图。
本公开在另一方面提供一种装修前后房屋三维模型同屏显示的方法,包括:用户终端获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息,所述视角变化信息包括点位变化信息和/或视线方向变化信息;若所述当前虚拟三维空间对应于第一房屋三维模型,则根据所述视角变化信息调整第二房屋三维模型的显 示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;若所述当前虚拟三维空间对应于所述第二房屋三维模型,则根据所述视角变化信息调整所述第一房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;其中,所述第一房屋模型和所述第二房屋模型在所述用户的视角发生变化前已处于同屏同视角显示状态;所述第一房屋三维模型是指当前房屋的三维模型,所述第二房屋三维模型是指加载了推荐装修效果后的已装修房屋三维模型。
本公开在另一方面提供一种基于户型的家具摆放方案生成方法,包括:获取与第一样本户型图相对应的样本户型结构数据;获取与所述第一样本户型图相对应的、摆放有家具的第二样本户型图,对所述第二样本户型图中摆放的家具进行标注,生成第一家具信息;根据所述第一样本户型图、所述第二样本户型图、所述第一家具信息以及所述样本户型结构数据,利用预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案。
本公开在另一方面提供一种计算装置,包括存储器和处理器,所述存储器存储有程序指令,所述程序指令被所述处理器执行时,使得所述处理器执行根据本公开任何一方面所述的方法。
本公开在另一方面一种非暂态计算机可读存储介质,其上存储有程序指令,所述程序指令被处理器执行时,使得所述处理器执行根据本公开任何一方面所述的方法。
附图说明
为了更清楚地说明本公开实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本公开的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是示出根据本公开实施例的示例性三维虚拟现实(VR)环境的示意图;
图2是示出根据本公开实施例的示例性计算机系统的框图;
图3是本公开实施例提供的一种三维空间视图显示方法的流程图;
图4是本公开实施例提供的另一种三维空间视图显示方法的流程图;
图5是本公开实施例提供的装修前后房屋三维模型同屏显示的方法流程图;
图6是本公开另一实施例提供的装修前后房屋三维模型同屏显示的方法流程图;
图7是本公开实施例提供的装修前后房屋三维模型同屏显示的装置结构示意图;
图8是本公开实施例提供的装修前后房屋三维模型同屏显示的系统的结构示意图;
图9为本公开的基于户型的家具摆放方案生成方法的一个实施例的流程图;
图10为本公开的基于户型的家具摆放方案生成方法的一个实施例中生成家具摆放方案的流程图;
图11为本公开的基于户型的家具摆放方案生成方法的一个实施例中对家具的摆放进行优化的流程图;
图12为本公开的基于户型的家具摆放方案生成方法的一个实施例中生成三维渲染模型的流程图;
图13A为本公开的基于户型的家具摆放方案生成装置的一个实施例的结构示意图;
图13B为本公开的基于户型的家具摆放方案生成装置的另一个实施例的结构示意图;
图14为本公开的基于户型的家具摆放方案生成装置的又一个实施例的结构示意图;
图15是本公开实施例提供的电子设备的结构示意图。
具体实施方式
为使本公开实施例的目的、技术方案和优点更加清楚,下面将结合本公开实施例中的附图,对本公开实施例中的技术方案进行清楚、完整的描述,显然,所描述的实施例是本公开一部分实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施 例,都属于本发明保护的范围。
本领域技术人员可以理解,本公开实施例中的“第一”、“第二”等术语仅用于区别不同步骤、设备或模块等,既不代表任何特定技术含义,也不表示它们之间的必然逻辑顺序。
还应理解,在本公开实施例中,“多个”可以指两个或者两个以上,“至少一个”可以指一个、两个或两个以上。
还应理解,对于本公开实施例中提及的任一部件、数据或结构,在没有明确限定或者在前后文给出相反启示的情况下,一般可以理解为一个或多个。
另外,本公开中术语“和/或”,仅是一种描述关联对象的关联关系,表示可以存在三种关系,如A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本公开中字符“/”,一般表示前后关联对象是一种“或”的关系。
还应理解,本公开对各个实施例的描述着重强调各个实施例之间的不同之处,其相同或相似之处可以相互参考,为了简洁,不再一一赘述。
同时,应当明白,为了便于描述,附图中所示出的各个部分的尺寸并不是按照实际的比例关系绘制的。
以下对至少一个示例性实施例的描述实际上仅仅是说明性的,决不作为对本公开及其应用或使用的任何限制。
对于相关领域普通技术人员已知的技术、方法和设备可能不作详细讨论,但在适当情况下,所述技术、方法和设备应当被视为说明书的一部分。
应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步讨论。
本公开的实施例可以应用于终端设备、计算机系统、服务器等电子设备,其可与众多其它通用或者专用计算系统环境或配置一起操作。适于与终端设备、计算机系统或者服务器等电子设备一起使用的众所周知的终端设备、计算系统、环境和/或配置的例子包括但不限于:个人计算机系统、服务器计算机系统、瘦客户机、厚客户机、手持或膝上设备、基于微处理器的系统、机顶盒、可编程消费电子产品、网络个人电脑、小型计算机系统、大型计算机系统和包括上述任何系统的分布式云计算技术环境等等。
终端设备、计算机系统、服务器等电子设备可以在由计算机系统执行的计算 机系统可执行指令(诸如程序模块)的一般语境下描述。通常,程序模块可以包括例程、程序、目标程序、组件、逻辑、数据结构等等,它们执行特定的任务或者实现特定的抽象数据类型。计算机系统/服务器可以在分布式云计算环境中实施。在分布式云计算环境中,任务可以是由通过通信网络链接的远程处理设备执行的。在分布式云计算环境中,程序模块可以位于包括存储设备的本地或远程计算系统存储介质上。
图1示出了根据本公开的实施例的示例性三维虚拟现实(VR)环境100。如图1所示,3D VR环境100可以模拟或表示住宅单元,诸如公寓或住宅楼层。注意,3D VR环境100可以包括任何室内空间或环境的VR表示。参考图1,3D VR环境100可以包括一个或多个功能间,诸如110、120、130、140、150和160。如本文所使用的,功能间是指与特定功能相关联的封闭或部分封闭的空间。在一些情况下,功能间可以对应于房间。例如,功能间110可以对应于第一卧室,并且功能间130可以对应于第二卧室。在一些情况下,功能间可以对应于房间内或与房间相邻的封闭或部分封闭的空间。例如,功能间140可以对应于壁橱。在一些情况下,功能间可以对应于通常用于特定目的的区域。例如,功能间120可以对应于厨房区域,功能间150可以对应于餐厅区域,功能间160可以对应于客厅。尽管功能间120、150和160可以共享相同的房间(例如,封闭区域),但是由于它们的功能不同,它们可以被认为是不同的功能间。
图2示出了被配置为实施本文所公开的各种功能的示例性计算机系统200的框图。例如,计算机系统200可以被配置为用于创建或重建VR环境100的服务器。在另一示例中,计算机系统200可以被配置为用于显示或丰富VR环境100的终端设备。如图2所示,计算机系统200可以包括处理器210、通信接口220、存储器/存储设备230和显示器240。存储器/存储设备230可以被配置用于存储计算机可读指令,所述计算机可读指令在由处理器210执行时可以使处理器210执行本文所公开的各种操作。存储器230可以是任何非暂态类型的大容量存储设备,诸如易失性或非易失性、磁性、基于半导体、基于磁带、光学、可移除、不可移除或其他类型的存储设备,或有形计算机可读介质,包括但不限于ROM、闪速存储器、动态RAM和静态RAM。
处理器210可以被配置用于根据存储在存储器230中的指令来执行操作。处理器210可包括任何适当类型的通用或专用微处理器、数字信号处理器、微控制 器等。处理器210可以被配置为专用于执行本文所公开的一个或多个特定操作的单独处理器模块。可替代地,处理器210可以被配置为能够执行与本文公开的一个或多个特定操作无关的其他操作的共享处理器模块。
通信接口220可以被配置为在计算机系统200与其他设备或系统之间传输信息。例如,通信接口220可以包括综合业务数字网(ISDN)卡、电缆调制解调器、卫星调制解调器、或用于提供数据通信连接的调制解调器。作为另一示例,通信接口220可以包括局域网(LAN)卡,以提供与相容LAN的数据通信连接。作为另一示例,通信接口220可以包括高速网络适配器,诸如光纤网络适配器、10G以太网适配器等。通信接口220还可以实施无线链路。在这种实施方式中,通信接口220可以经由网络发送和接收携载表示各种类型信息的数字数据流的电信号、电磁信号或光信号。网络通常可以包括蜂窝通信网络、无线局域网(WLAN)、广域网(WAN)等。
通信接口220还可以包括各种I/O设备,诸如键盘、鼠标、触摸板、触摸屏、麦克风、相机、生物传感器等。用户可以通过通信接口220将数据输入到终端设备。
显示器240可以集成为计算机系统200的一部分,或者可以作为通信地耦接到计算机系统200的单独设备来提供。显示器240可以包括诸如液晶显示器(LCD)、发光二极管显示器(LED)、等离子显示器或任何其他类型的显示器等显示设备,并提供在显示器上呈现的图形用户界面(GUI)以供用户输入和数据描述。在一些实施例中,显示设备240可以包括提供沉浸式VR体验的VR护目镜、VR眼镜或其他类似设备。例如,VR环境100可以显示在显示器240上。在一些实施例中,显示器240可以集成为通信接口220的一部分。
图3是根据本公开的一种三维空间视图显示的示例方法的流程图。所述三维空间视图至少包括第一三维空间视图和第二三维空间视图,所述方法包括:在步骤301,在第一用户界面上呈现所述第一三维空间视图;在步骤302,在第二用户界面上呈现所述第二三维空间视图;在步骤303,根据用户输入,改变所述第一三维空间视图;在步骤304,根据所述第一三维空间视图的改变,改变所述第二三维空间视图。
图4是根据本公开的一种三维空间视图显示的另一示例方法的流程图。所述 三维空间视图至少包括第一三维空间视图和第二三维空间视图。
如图4所述,在步骤401,在第一用户界面上呈现第一三维空间视图。
在步骤402,在第二用户界面呈现第二三维空间视图。所呈现的第二三维空间视图和第一三维空间视图可以具有相同的视场。
第一用户界面和第二用户界面可以是子页面,例如是浏览器(如,IE浏览器,Chrome浏览器等)的第一子页面和第二子页面。
三维空间视图,也称全景视图。一种生成房屋的三维空间视图(即房屋全景)的方法是用相机拍摄房屋里多个位置的周围环境的相片,将这些相片进行合成,从而得到这些位置的房屋全景。例如,可以在房屋里的某个位置在水平方向上围绕垂直轴转动相机并在垂直方向上围绕水平轴转动相机,将由此拍摄的一系列相片进行合成,从而得到该位置的房屋全景。另一种方法是采用计算机模拟生成房屋的三维空间视图。
视场通常包括视场方向和视场的角度范围(即视角),视场方向也称作视角的视线方向。因此,视场的一个特征是其方向,例如可以由从已知方向(例如,北向)测得的方位角和从已知方向(例如,水平面)测得的倾角来定义。视场的另一个特征在于视角,视角描述给定场景的角度范围。
在步骤403,在所述第一用户界面接收用户输入,以根据所述用户输入生成第一三维空间视图的视图改变指令。
用户可在显示区域(即用户界面)中操纵三维空间视图。用户可以通过左右、上下拖动操作以改变视场的方向和角度范围。用户还可以通过缩放操作以改变视场的角度范围。在一些实现方式中,用户可以通过点击叠加在三维空间视图上的导航控件来从一个位置的三维空间视图导航到另一位置的三维空间视图。
在一些实现方式中,可以为第一房屋在m个位置生成全景图(这m个位置构成第一位置集合),为第二房屋在n个位置生成全景图(这n个位置构成第二位置集合)。n和m均为整数,这二者可以相等也可以不等。可以分别对这m和n个位置编号(例如从1开始连续编号),也即,用编号来表示位置,第一个编号(例如编号1)的位置表示初始位置。具有相同编号的位置认为是对应位置,由此建立第一位置集合和第二位置集合之间的映射关系。第一房屋和第二房屋可以是相同的 房屋,即可以为同一房屋生成不同的全景图。例如,可以为同一房屋生成装修前后的不同三维空间视图,为装修前的房屋生成第一三维空间视图,为装修后的房屋生成第二三维空间视图。
在一些实现方式中,视图改变指令包括第一三维空间视图的视场变化信息和/或编号(或位置,也称作点位)变化信息。
在步骤404,所述第一用户界面根据视图改变指令加载用于更新第一三维空间视图的数据。
在步骤405,所述第一用户界面将视图改变指令发送给所述第二用户界面。
在步骤406,所述第二用户界面根据视图改变指令加载用于更新第二三维空间视图的数据。
在步骤407,所述第一用户界面和所述第二用户界面分别根据加载的用于更新第一三维空间视图的数据和加载的用于更新第二三维空间视图的数据更新所述第一三维空间视图和所述第二三维空间视图。
在一些实现方式中,更新后,第一三维空间视图和第二三维空间视图具有相同的视场。在一些实现方式中,更新后,第一三维空间视图和第二三维空间视图对应于相同的位置(或编号)。
在一些实现方式中,所述第一用户界面和所述第二用户界面分别根据加载的用于第一三维空间视图的数据和加载的用于第二三维空间视图的数据同时更新所述第一三维空间视图和所述第二三维空间视图。也就是说,所述第一用户界面加载用于更新第一三维空间视图的数据,所述第二用户界面加载用于更新第二三维空间视图的数据,之后,会在两个用户界面进行同步,以同时更新所述第一三维空间视图和所述第二三维空间视图。所述同步例如包括:所述第一用户界面通知所述第二用户界面其已完成数据加载,所述第二用户界面通知所述第一用户界面其已完成数据加载,由此实现所述第一用户界面和所述第二用户界面同时更新所述第一三维空间视图和所述第二三维空间视图。
上述三维空间视图显示方法的一个应用场景是装修前后房屋三维模型同屏显示。在装修前后房屋三维模型同屏显示的情形下,根据用户输入,改变所述第一三维空间视图包括:用户终端获取用户在第一三维空间视图(也称作当前虚拟三 维空间)中漫游和/或扫视的视角变化信息。所述视角变化信息例如可以包括点位(或位置)变化信息和/或视线方向变化信息。其中,根据所述第一三维空间视图的改变,改变所述第二三维空间视图包括:若所述第一三维空间视图对应于第一房屋三维模型,第二三维空间视图对应于第二房屋三维模型,则根据所述视角变化信息调整第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;若所述当第一三维空间视图对应于所述第二房屋三维模型,第二三维空间视图对应于第一房屋三维模型,则根据所述视角变化信息调整所述第一房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示。下面对装修前后房屋三维模型同屏显示进行详细描述。
图5是本公开实施例提供的装修前后房屋三维模型同屏显示的方法流程图。如图5所示,所述方法包括:
步骤501、用户终端获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息;所述视角变化信息包括点位变化信息和/或视线方向变化信息;
步骤502、若所述当前虚拟三维空间对应于第一房屋三维模型,则根据所述视角变化信息调整第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
步骤503、若所述当前虚拟三维空间对应于所述第二房屋三维模型,则根据所述视角变化信息调整所述第一房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
其中,所述第一房屋模型和所述第二房屋模型在所述用户的视角发生变化前已处于同屏同视角显示状态;所述第一房屋三维模型是指当前房屋的三维模型(即未加载推荐装修效果的房屋三维模型),所述第二房屋三维模型是指加载了推荐装修效果后的已装修房屋三维模型。
所述当前房屋的三维模型是指实际房源的房屋三维模型(装修前的房屋三维模型)。所述已装修房屋三维模型是以相应的实际房源为基础,进行模拟装修后的房屋三维模型(装修后的房屋三维模型)。
所述推荐装修效果是指根据用户的房屋户型、朝向、采光、楼层等房屋属性, 在用户的原先房屋的三维模型中抹去了所有房屋已有装修家具家电后,在房屋的三维模型中添加了各种家具家电模型后的装修效果。
用户在房屋三维模型的虚拟三维空间(VR空间)中可以进行游走和/或扫视,以实现身临其境的看房效果。游走,比如从一个点位移动到另一个点位;扫视,比如看向房间的某部分区域。在用户漫游和/或扫视的视角发生变化前,装修前的房屋三维模型和装修后的房屋三维模型已同屏同视角显示于用户终端(前端)的显示界面。用户可以在装修前的房屋三维模型的虚拟三维空间中游走和/或扫视,也可以在装修后的房屋三维模型的虚拟三维空间中游走和/或扫视。
当用户在一个点位进行扫视时,可以转换视线方向(比如通过滑动屏幕),实现对于房间不同区域的扫视;当用户从一个点位移动到另一个点位时,必然会使得视角发生变化,并且用户移动到新点位后还可以进一步转换视线方向,使得视角发生新的变化。
因此,用户在同一个点位进行视角变化时,可以通过获取视线方向变化信息实现;用户从一个点位移动到另一个点位时,可以通过获取点位变化信息来获取视角变化信息;用户从一个点位移动到另一个点位,并且进一步转换视线方向时,可以通过点位变化信息和视角变化信息获取视角变化信息。
用户在房屋三维模型的虚拟三维空间中漫游和/或扫视时,用户终端获取用户所在的当前虚拟三维空间的信息,所述当前虚拟三维空间对应于装修前的房屋三维模型或对应于装修后的房屋三维模型;并获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息。
若所述当前虚拟三维空间对应于装修前的房屋三维模型,则用户终端根据用户在装修前的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装修后的房屋三维模型的显示视角,使得装修后的房屋三维模型的视角变化与装修前的房屋三维模型的视角变化一致,实现所述装修前的房屋三维模型和所述装修后的房屋三维模型同屏同视角显示。
若所述当前虚拟三维空间对应于装修后的房屋三维模型,则用户终端根据用户在装修后的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装修前的房屋三维模型的显示视角,使得装修前的房屋三维模型的视角变化与 装修后的房屋三维模型的视角变化一致,实现所述装修前的房屋三维模型和所述装修后的房屋三维模型同屏同视角显示。
本公开实施例通过根据用户在装修前的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装修后的房屋三维模型的显示视角,或根据用户在装修后的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装修前的房屋三维模型的显示视角,实现了装修前和装修后的房屋三维模型同屏同视角联动,让用户在视觉上直观观测到装修前和装修后两个房屋三维模型的差异对比,为用户提供具有真实感受的装修效果展示。
进一步地,基于上述实施例,所述获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息,具体包括:通过所述当前虚拟三维空间对应的房屋三维模型的子页面获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息;若所述当前虚拟三维空间对应于所述第一房屋三维模型,则所述根据所述视角变化信息调整第二房屋三维模型的显示视角,具体包括:通过所述第一房屋三维模型的子页面将所述视角变化信息上报给父页面,所述父页面再将所述视角变化信息下发给所述第二房屋三维模型的子页面,所述第二房屋三维模型的子页面根据所述视角变化信息调整所述第二房屋三维模型的显示视角;若所述当前虚拟三维空间对应于第二房屋三维模型,则所述根据所述视角变化信息调整第一房屋三维模型的显示视角,具体包括:通过所述第二房屋三维模型的子页面将所述视角变化信息上报给所述父页面,所述父页面再将所述视角变化信息下发给所述第一房屋三维模型的子页面,所述第一房屋三维模型的子页面根据所述视角变化信息调整所述第一房屋三维模型的显示视角。当然,本公开不限于此,也可以在子页面之间直接通信,而不经过父页面。
在子页面之间直接通信而不经过父页面的情形下,若所述当前虚拟三维空间对应于所述第一房屋三维模型,则所述根据所述视角变化信息调整第二房屋三维模型的显示视角,具体包括:通过所述第一房屋三维模型的子页面将所述视角变化信息发给所述第二房屋三维模型的子页面,所述第二房屋三维模型的子页面根据所述视角变化信息调整所述第二房屋三维模型的显示视角。在子页面之间直接通信而不经过父页面的情形下,若所述当前虚拟三维空间对应于第二房屋三维模 型,则所述根据所述视角变化信息调整第一房屋三维模型的显示视角,具体包括:通过所述第二房屋三维模型的子页面将所述视角变化信息发给所述第一房屋三维模型的子页面,所述第一房屋三维模型的子页面根据所述视角变化信息调整所述第一房屋三维模型的显示视角。
子页面是指用户终端中与各个房屋三维模型所对应的显示页面。父页面是指用户终端中用于管理和控制各个子页面的页面管理器。本公开实施例中可以通过父页面的中转控制来实现装修前和装修后的房屋三维模型的页面同步,也可以不通过父页面,而在子页面之间直接通信实现装修前和装修后的房屋三维模型的页面同步。
若所述当前虚拟三维空间对应于装修前的房屋三维模型,则装修前的房屋三维模型的子页面获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息,并将所述视角变化信息上报给父页面,父页面再将所述视角变化信息下发给所述装修后的房屋三维模型的子页面,装修后的房屋三维模型的子页面根据所述视角变化信息调整装修后的房屋三维模型的显示视角,使得所述装修前的房屋三维模型和所述装修后的房屋三维模型同屏同视角显示。或者,装修前的房屋三维模型的子页面获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息,并将所述视角变化信息直接发给所述装修后的房屋三维模型的子页面,装修后的房屋三维模型的子页面根据所述视角变化信息调整装修后的房屋三维模型的显示视角,使得所述装修前的房屋三维模型和所述装修后的房屋三维模型同屏同视角显示。
若所述当前虚拟三维空间对应于装修后的房屋三维模型,则装修后的房屋三维模型的子页面获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息,并将所述视角变化信息上报给父页面,父页面再将所述视角变化信息下发给所述装修前的房屋三维模型的子页面,装修前的房屋三维模型的子页面根据所述视角变化信息调整装修前的房屋三维模型的显示视角,使得所述装修前的房屋三维模型和所述装修后的房屋三维模型同屏同视角显示。或者,装修后的房屋三维模型的子页面获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息,并将所述视角变化信息直接发给所述装修前的房屋三维模型的子页面,装修前的房屋三维模型的子页面根据所述视角变化信息调整装修前的房屋三维模型的显示视角, 使得所述装修前的房屋三维模型和所述装修后的房屋三维模型同屏同视角显示。
在上述实施例的基础上,本公开实施例通过利用父页面控制装修前的房屋三维模型的子页面以及装修后的房屋三维模型的子页面(或者在装修前的房屋三维模型的子页面以及装修后的房屋三维模型的子页面之间直接通信),实现装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示,提高了同屏同视角显示控制的简便性和可靠性。
进一步地,基于上述实施例,在所述获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息之前,所述方法还包括:显示所述第一房屋三维模型,获取所述第一房屋三维模型的视角信息,从后台服务器获取所述第二房屋三维模型,并根据所述第一房屋三维模型的视角信息显示所述第二房屋三维模型,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;或,显示所述第二房屋三维模型,获取所述第二房屋三维模型的视角信息,从后台服务器获取所述第一房屋三维模型,并根据所述第二房屋三维模型的视角信息显示所述第一房屋三维模型,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;其中,所述视角信息包括点位信息及视线方向信息。
如前所述,在实现装修前的房屋三维模型和装修后的房屋三维模型同屏同视角联动之前,装修前的房屋三维模型和装修后的房屋三维模型处于同屏同视角显示状态。那么,在上述实施例的基础上,本公开实施例将给出装修前的房屋三维模型和装修后的房屋三维模型最初实现同屏同视角显示的实施例。
在用户终端的APP中,用户可以通过点击某个房屋三维模型进入某个房屋三维模型的虚拟空间进行扫视游走,从而实现相应房屋三维模型的显示。比如,用户可以点击装修前的房屋三维模型,实现装修前的房屋三维模型的显示;也可以点击装修后的房屋三维模型,实现装修后的房屋三维模型的显示。装修后的房屋三维模型和装修后的房屋三维模型均存储于后台服务器,用户终端可以向后台服务器发送请求指令显示相应的三维模型。
若用户终端获取到装修前的房屋三维模型的显示请求信息(比如获取到用户对装修前的房屋三维模型的点击信息),则显示所述装修前的房屋三维模型。为了实现装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示,用户终端 在显示所述装修前的房屋三维模型后,获取装修前的房屋三维模型的视角信息(显示视角信息),并从后台服务器获取所述装修后的房屋三维模型,并且根据所述装修前的房屋三维模型的视角信息显示所述装修后的房屋三维模型,使得装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示。
具体地,可以通过装修前的房屋三维模型的子页面发送装修前的房屋三维模型的视角信息至父页面,父页面再将装修前的房屋三维模型的视角信息下发给装修后的房屋三维模型的子页面,装修后的房屋三维模型的子页面根据装修前的房屋三维模型的视角信息显示装修后的房屋三维模型,从而实现装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示。或者,可以通过装修前的房屋三维模型的子页面直接发送装修前的房屋三维模型的视角信息给装修后的房屋三维模型的子页面,装修后的房屋三维模型的子页面根据装修前的房屋三维模型的视角信息显示装修后的房屋三维模型,从而实现装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示。
若用户终端获取到装修后的房屋三维模型的显示请求信息(比如获取到用户对装修后的房屋三维模型的点击信息),则显示所述装修后的房屋三维模型。为了实现装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示,用户终端在显示所述装修后的房屋三维模型后,获取装修后的房屋三维模型的视角信息(显示视角信息),并从后台服务器获取所述装修前的房屋三维模型,并且根据所述装修后的房屋三维模型的视角信息显示所述装修前的房屋三维模型,使得装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示。
具体地,可以通过装修后的房屋三维模型的子页面发送装修后的房屋三维模型的视角信息至父页面,父页面再将装修后的房屋三维模型的视角信息下发给装修前的房屋三维模型的子页面,装修前的房屋三维模型的子页面根据装修后的房屋三维模型的视角信息显示装修前的房屋三维模型,从而实现装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示。或者可以通过装修后的房屋三维模型的子页面直接发送装修后的房屋三维模型的视角信息给装修前的房屋三维模型的子页面,装修前的房屋三维模型的子页面根据装修后的房屋三维模型的视角信息显示装修前的房屋三维模型,从而实现装修前的房屋三维模型和装修后的房 屋三维模型同屏同视角显示。
在上述实施例的基础上,本公开实施例通过根据装修前的房屋三维模型的视角信息显示装修后的房屋三维模型,或根据装修后的房屋三维模型的视角信息显示装修前的房屋三维模型,实现了装修前的房屋三维模型和装修后的房屋三维模型初始同屏同视角显示。
进一步地,基于上述实施例,在所述获取所述第一房屋三维模型的视角信息之前,所述方法还包括:判断是否接收到预设触发信息,若判断获知接收到所述预设触发信息,再执行所述获取所述第一房屋三维模型的视角信息的动作;在所述获取所述第二房屋三维模型的视角信息之前,所述方法还包括:判断是否接收到所述预设触发信息,若判断接收到所述预设触发信息,则执行所述获取所述第二房屋三维模型的视角信息的动作。
装修前的房屋三维模型和装修后的房屋三维模型初始同屏同视角显示可以通过预设的触发条件进行触发。
若用户终端获取到装修前的房屋三维模型的显示请求信息,则显示所述装修前的房屋三维模型,并判断是否接收到预设触发信息,所述预设触发信息可以是用户对预设按钮(比如装修前后同屏显示按钮)的点击信息。若判断获知接收到所述预设触发信息,则获取装修前的房屋三维模型的视角信息,并从后台服务器获取所述装修后的房屋三维模型,并且根据所述装修前的房屋三维模型的视角信息显示所述装修后的房屋三维模型,使得装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示。若判断获知未接收到所述预设触发信息,则只显示装修前的房屋三维模型。
若用户终端获取到装修后的房屋三维模型的显示请求信息,则显示所述装修后的房屋三维模型,并判断是否接收到预设触发信息,所述预设触发信息可以是用户对预设按钮(比如装修前后同屏显示按钮)的点击信息。若判断获知接收到所述预设触发信息,则获取装修后的房屋三维模型的视角信息,并从后台服务器获取所述装修前的房屋三维模型,并且根据所述装修后的房屋三维模型的视角信息显示所述装修前的房屋三维模型,使得装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示。若判断获知未接收到所述预设触发信息,则只显示装 修后的房屋三维模型。
在上述实施例的基础上,本公开实施例通过在接收到预设触发信息后再实现装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示,提高了显示控制的灵活性。
进一步地,基于上述实施例,所述方法还包括:后台服务器根据所述第一房屋三维模型获取预设房屋信息,所述预设房屋信息包括户型信息、层高信息及点位信息;根据所述预设房屋信息生成与所述第一房屋三维模型对应的空房三维模型;将家具家电三维模型添加到所述空房三维模型中,生成所述第二房屋三维模型;将所述第一房屋三维模型与所述第二房屋三维模型对应存储。
如前所述,装修前的房屋三维模型和装修后的房屋三维模型存储于后台服务器。装修前的房屋三维模型是通过获取实际房源的三维点云数据以及三维建模等步骤实现。在上述实施例的基础上,本公开实施例将给出后台服务器获取装修后的房屋三维模型的实施例。
后台服务器根据装修前的房屋三维模型获取预设房屋信息,所述预设房屋信息包括户型信息、层高信息及点位信息,可以理解的,所述户型信息也可根据户型图获取。后台服务器根据所述预设房屋信息生成与所述装修前的房屋三维模型对应的空房三维模型。所述空房三维模型根据装修前的房屋三维模型对应的实际房源的户型、层高生成,并且,根据装修前的房屋三维模型的点位信息进行点位信息的一致性布置。另外,所述空房三维模型可以包括地板等初步家装信息。
所述家具家电三维模型可以从第三方获取,也可以从大量实际房源的点云数据中提取。根据户型等信息将相应的家具家电三维模型添加到所述空房三维模型中,可以将每个家具家电三维模型摆放到相应位置,如将沙发的三维模型摆放到客厅,生成所述装修后的房屋三维模型。后台服务器将装修前的房屋三维模型与装修后的房屋三维模型对应存储,以用于同屏同视角显示。
在上述实施例的基础上,本公开实施例通过根据装修前的房屋三维模型的预设房屋信息生成空房三维模型,再通过将家具家电三维模型添加到空房三维模型中,生成装修后的房屋三维模型,实现了装修后的房屋三维模型的有效获取,为装修前的房屋三维模型与装修后的房屋三维模型同屏同视角显示提供基础。
进一步地,基于上述实施例,所述将家具家电三维模型添加到所述空房三维模型中,具体包括:自动添加相应的所述家具家电三维模型到所述空房三维模型中,其中所述家具家电三维模型为预先生成的三维模型。
所述家具家电三维模型为预先生成的三维模型。可以通过人工智能的方式添加家具家电三维模型到所述空房三维模型中,得到装修后的房屋三维模型,也可以手工添加。
若采用人工智能的方式添加家具家电三维模型到所述空房三维模型,则需要通过机器学习训练得到家具家电添加模型。训练样本中,以装修后的房屋三维模型作为输出,以装修后的房屋三维模型对应的空房三维模型和其中的家具家电三维模型作为输入,通过大量的训练样本经过机器学习训练得到家具家电添加模型,利用所述家具家电添加模型自动添加相应的所述家具家电三维模型到所述空房三维模型中,生成装修后的房屋三维模型。
本公开实施例通过自动添加相应的家具家电三维模型到空房三维模型中,生成装修后的房屋三维模型,提高了装修后的房屋三维模型生成的效率。
进一步地,基于上述实施例,装修前的房屋三维模型和装修后的房屋三维模型均可实现VR实景图、三维模型图及户型图的切换显示。
图6是本公开另一实施例提供的装修前后房屋三维模型同屏显示的方法流程图。如图6所示,本公开实施例提供的装修前后房屋三维模型同屏显示的方法可以实现便利的装修前后对比,由步骤获取房屋数据601、输入对比模型602、同步坐标视线603、前端同步呈现604组成,具有实时性、同步性的特点。
首先在后台根据现有房屋的户型图等数据生成空的三维模型,再将已有的家具模型摆放到三维模型中,实现根据现有房屋三维模型生成装修后的三维模型,然后在后台输入两个已有模型,尤其对于毛坯房、简装房这些装修前后对比较为明显的房屋,两个对比性明显的三维空间可为用户提供更多的可视化信息。
用户在三维空间漫游及扫视时,前端需要对用户当前视角画面内的坐标和视线进行分析,识别其在三维模型中的点位,并触发同步两个三维模型,促使同屏呈现装修前后的两个模型。比如当用户在其中一个子页面中转动视角时,转动视角的子页面会把视角的变化上报给父页面,父页面再把视角的变化下发给全部的 子页面,实现所有子页面的状态同步,或者,转动视角的子页面把视角的变化直接发给其他子页面,实现所有子页面的状态同步。此外,用户在同屏的两个窗口中均可进行交互,根据自身需求可点击相应模型进行查看和对比。
在现有VR看房的基础上,为了实现装修前后房屋模型的同步对比,本公开实施例在前端的一个屏幕中呈现两个窗口,呈现不同内容,并同步用户在不同三维空间中的坐标和视角,实现两个三维模型的联动。
本公开实施例通过获取VR数据、房屋数据、户型数据、装修数据,以智能的方式,基于现有房屋数据预先生成装修后的三维模型并输入到后台中,在前端,用户触达的子页面状态会上传到父页面,再通过父页面下发给其他子页面(或者用户触达的子页面状态会直接发给其他子页面),并通过视角同步、全景/模型切换和点位切换保障三维空间内信息展示的同步性。
图7是本公开实施例提供的装修前后房屋三维模型同屏显示的装置结构示意图。如图7所示,所述装修前后房屋三维模型同屏显示的装置700包括视角变化信息获取模块701、第一显示模块702和第二显示模块703,其中:视角变化信息获取模块701用于:获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息;所述视角变化信息包括点位变化信息和/或视线方向变化信息;第一显示模块702用于:若所述当前虚拟三维空间对应于第一房屋三维模型,则根据所述视角变化信息调整第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;第二显示模块703用于:若所述当前虚拟三维空间对应于所述第二房屋三维模型,则根据所述视角变化信息调整所述第一房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;其中,所述第一房屋模型和所述第二房屋模型在所述用户的视角发生变化前已处于同屏同视角显示状态;所述第一房屋三维模型是指当前房屋的三维模型,所述第二房屋三维模型是指加载了推荐装修效果后的已装修房屋三维模型。所述装修前后房屋三维模型同屏显示的装置1可以为前述任一用户终端。
本公开实施例通过根据用户在装修前的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装修后的房屋三维模型的显示视角,或根据用户在装修后的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装 修前的房屋三维模型的显示视角,实现了装修前和装修后的房屋三维模型同屏同视角联动,让用户在视觉上直观观测到装修前和装修后两个房屋三维模型的差异对比,为用户提供具有真实感受的装修效果展示。
进一步地,基于上述实施例,视角变化信息获取模块701具体用于:通过所述当前虚拟三维空间对应的房屋三维模型的子页面获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息;第一显示模块702用于:若所述当前虚拟三维空间对应于所述第一房屋三维模型,通过所述第一房屋三维模型的子页面将所述视角变化信息上报给父页面,所述父页面再将所述视角变化信息下发给所述第二房屋三维模型的子页面,所述第二房屋三维模型的子页面根据所述视角变化信息调整所述第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;第二显示模块703用于:若所述当前虚拟三维空间对应于所述第二房屋三维模型,通过所述第二房屋三维模型的子页面将所述视角变化信息上报给所述父页面,所述父页面再将所述视角变化信息下发给所述第一房屋三维模型的子页面,所述第一房屋三维模型的子页面根据所述视角变化信息调整所述第一房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示。
在其他实施例中,第一显示模块702用于:若所述当前虚拟三维空间对应于所述第一房屋三维模型,通过所述第一房屋三维模型的子页面将所述视角变化信息直接发给所述第二房屋三维模型的子页面,所述第二房屋三维模型的子页面根据所述视角变化信息调整所述第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;第二显示模块703用于:若所述当前虚拟三维空间对应于所述第二房屋三维模型,通过所述第二房屋三维模型的子页面将所述视角变化信息直接发给所述第一房屋三维模型的子页面,所述第一房屋三维模型的子页面根据所述视角变化信息调整所述第一房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示。
在上述实施例的基础上,本公开实施例通过利用父页面控制装修前的房屋三维模型的子页面以及装修后的房屋三维模型的子页面(或者在装修前的房屋三维模型的子页面以及装修后的房屋三维模型的子页面之间直接通信),实现装修前的 房屋三维模型和装修后的房屋三维模型同屏同视角显示,提高了同屏同视角显示控制的简便性和可靠性。
进一步地,基于上述实施例,第一显示模块702还用于:显示所述第一房屋三维模型,获取所述第一房屋三维模型的视角信息,从后台服务器获取所述第二房屋三维模型,并根据所述第一房屋三维模型的视角信息显示所述第二房屋三维模型,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;第二显示模块703还用于:显示所述第二房屋三维模型,获取所述第二房屋三维模型的视角信息,从后台服务器获取所述第一房屋三维模型,并根据所述第二房屋三维模型的视角信息显示所述第一房屋三维模型,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;其中,所述视角信息包括点位信息及视线方向信息。
在上述实施例的基础上,本公开实施例通过根据装修前的房屋三维模型的视角信息显示装修后的房屋三维模型,或根据装修后的房屋三维模型的视角信息显示装修前的房屋三维模型,实现了装修前的房屋三维模型和装修后的房屋三维模型初始同屏同视角显示。
进一步地,基于上述实施例,第一显示模块702还用于:判断是否接收到预设触发信息,若判断获知接收到所述预设触发信息,再执行所述获取所述第一房屋三维模型的视角信息的动作;第二显示模块703还用于:判断是否接收到所述预设触发信息,若判断接收到所述预设触发信息,则执行所述获取所述第二房屋三维模型的视角信息的动作。
在上述实施例的基础上,本公开实施例通过在接收到预设触发信息后再实现装修前的房屋三维模型和装修后的房屋三维模型同屏同视角显示,提高了显示控制的灵活性。
图8是本公开实施例提供的装修前后房屋三维模型同屏显示的系统的结构示意图。如图8所示,所述系统包括装修前后房屋三维模型同屏显示的装置700及后台服务器800;所述后台服务器800具体用于:根据所述第一房屋三维模型获取预设房屋信息,所述预设房屋信息包括户型信息、层高信息及点位信息;根据所述预设房屋信息生成与所述第一房屋三维模型对应的空房三维模型;将家具家电 三维模型添加到所述空房三维模型中,生成所述第二房屋三维模型;将所述第一房屋三维模型与所述第二房屋三维模型对应存储。
本公开实施例通过根据用户在装修前的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装修后的房屋三维模型的显示视角,或根据用户在装修后的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装修前的房屋三维模型的显示视角,实现了装修前和装修后的房屋三维模型同屏同视角联动,让用户在视觉上直观观测到装修前和装修后两个房屋三维模型的差异对比,为用户提供具有真实感受的装修效果展示。
进一步地,基于上述实施例,所述后台服务器2还用于:自动添加相应的所述家具家电三维模型到所述空房三维模型中,其中所述家具家电三维模型为预先生成的三维模型。
在上述实施例的基础上,本公开实施例通过根据装修前的房屋三维模型的预设房屋信息生成空房三维模型,自动添加相应的所述家具家电三维模型到所述空房三维模型中,生成装修后的房屋三维模型,实现了装修后的房屋三维模型的快速有效获取。
本公开实施例提供的装置及系统是用于上述方法的,具体功能可参照上述方法流程,此处不再赘述。
在实现本公开的过程中,发明人还发现,在传统的装修流程中,需要专业的且经验丰富的设计师提出改造设计,普通住户往往无法胜任,家具布局的效果严重依赖于专业设计师,需要大量的时间设计图纸,占用了大量的设计师资源,设计流程时间长、事情繁琐且价格昂贵。
本公开提供的基于户型的家具摆放方案生成方法,生成训练样本集并进行神经网络的训练,得到神经网络模型;利用所述神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案,能够智能生成与用户的户型相对应的家具摆放方案。
图9为本公开的基于户型的家具摆放方案生成方法的一个实施例的流程图,如图5所示的方法包括步骤:S901-S903。下面对各步骤分别进行说明。
S901,获取与第一样本户型图相对应的样本户型结构数据。
第一样本户型图可以为通过CAD建模工具等生成的样本户型图,样本户型图可以为矢量图等,样本户型图中有多种户型元素,并且样本户型图设置有户型结构数据。获取第一样本户型图相对应的样本户型结构数据,样本户型结构数据包括:户型的墙面分布数据、承重墙分布数据、门窗分布数据、面积数据、层高数据、位置坐标数据等。
S902,获取与第一样本户型图相对应的、摆放有家具的第二样本户型图,对第二样本户型图中摆放的家具进行标注,生成第一家具信息。
第二样本户型图为与第一样本户型图相对应的、摆放有家具的样本户型图,家具可以为桌子、床、电器等。可以采用人工方式对第二样本户型图进行标注,第一家具信息包括家具类别、摆放位置、朝向、风格、尺寸等,也可以对第二样本户型图进行打分。
S903,根据第一样本户型图、第二样本户型图、第一家具信息以及样本户型结构数据,利用预设的家具摆放决策规则对需要装修的户型图进行处理,获取与需要装修的户型图相对应的家具摆放方案。
对需要装修的户型图进行处理可以有多种方法。例如,根据第一样本户型图、第二样本户型图、第一家具信息以及样本户型结构数据生成训练样本集。根据训练样本进行神经网络的训练,得到神经网络模型。神经网络模型可以有多种。利用神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与需要装修的户型图相对应的家具摆放方案。
需要装修的户型图可以为用户提供的需要装修的户型图,利用训练好的神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与需要装修的户型图相对应的家具摆放方案,家具摆放方案的数量可以为一个或多个。家具摆放方案包括用于展示桌子、床、电器等家具在需要装修的户型图中摆放位置的家具摆放图、家具的展示信息等。
虽然上文中,以获取第一样本户型图的样本户型结构数据和生成第二样本户型图的第一家具信息为例进行了描述,但是本公开不限于此,例如,可以获取第一和第二样本户型图的样本户型结构数据,并生成第一和第二样本户型图的第一家具信息,从而根据第一样本户型图、第二样本户型图、第一家具信息以及样本户型结构数据生成训练样本集。
根据本公开的一些实现方式,在获取与需要装修的户型图相对应的家具摆放 方案后,可以根据家具摆放方案为这些需要装修的户型图生成相应的已装修房屋三维模型(即三维空间全景图)。
根据本公开的一些实现方式,家具摆放决策规则可以是“核心功能分配到间”规则,例如餐桌应该放客厅间还是厨房,洗衣机应该放卫生间还是阳台。
图10为本公开的基于户型的家具摆放方案生成方法的一个实施例的流程图,如图10所示的方法包括步骤:S1001-S1004。下面对各步骤分别进行说明。
S1001,获取与需要装修的户型图相对应的装修户型结构数据。
用户可以通过前端页面输入或选择需要装修的户型图。用户输入的需要装修的户型图可以为通过CAD建模工具等生成的户型图,需要装修的户型图可以为矢量图等,能够从需要装修的户型图中获取装修户型结构数据。
如果用户输入的需要装修的户型图不为通过CAD建模工具等生成的户型图,从存储的样本户型图中查找到与用户输入的需要装修的户型图对应的样本户型图,并从此样本户型图中获取装修户型结构数据。装修户型结构数据包括:户型的墙面分布数据、承重墙分布数据、门窗分布数据、面积数据、层高数据、位置坐标数据等。
S1002,将需要装修的户型图和装修户型结构数据输入神经网络模型,获取神经网络模型输出的与需要装修的户型图相对应的家具摆放信息,以及与家具摆放信息相对应的第二家具信息。家具摆放信息可以有多种,第二家具信息包括:家具类别、摆放位置、朝向、风格、尺寸等。
S1003,利用家具摆放决策规则对家具摆放信息进行处理,获取家具摆放图。
S1004,基于第二家具信息获取与家具摆放图中摆放的家具相对应的展示信息。展示信息包括:家具类别、摆放位置、朝向、风格、尺寸等,为利用家具摆放决策规则从家具摆放信息选取的实际摆放家具的展示信息。
在一个实施例中,家具摆放信息可以为神经网络模型输出的家具摆放热力图等,家具摆放热力图包括:在需要装修的户型图中建议摆放的家具的位置信息、与建议摆放的家具相对应的摆放概率等。例如,家具摆放热力图包括在需要装修的户型图中建议摆放的床、桌子等家具的位置信息、在此位置上建议摆放的床、桌子等家具的摆放概率、和/或建议摆放的床、桌子等家具的展示信息。
例如,可以根据家具的排放位置关系获取与建议摆放的家具相对应的能量函数,基于能量函数建立约束条件。使用蒙特卡罗搜索树算法对家具摆放热力图进 行遍历,获取满足约束条件的家具摆放图,在家具摆放图中摆放的家具的数量位于预设数量区间。
例如,可以获取与建议摆放的家具与墙之间、与其他建议摆放的家具之间的摆放位置,基于摆放位置建立能量函数E(x)。使用蒙特卡罗搜索树算法对家具摆放热力图进行遍历,min(∑E(x))为约束条件。
蒙特卡洛树搜索又称随机抽样或统计试验方法,蒙特卡洛树搜索方法由于能够真实地模拟实际物理过程,是以概率和统计理论方法为基础的一种计算方法,是使用随机数来解决很多计算问题的方法。将所求解的问题同一定的概率模型相联系,以获取问题的近似解。通过蒙特卡罗搜索算法对蒙特卡罗搜索树进行遍历,在家具摆放热力图中选定建议摆放的家具,作为实际摆放的家具。即从所构建的蒙特卡罗搜索树中选择满足约束条件的实际摆放的家具,同时使与全部选定的实际摆放的家具相对应的综合摆放概率为最大,并且在所述家具摆放图中摆放的家具的数量位于预设数量区间。例如,综合摆放概率可以为全部实际摆放的家具的摆放概率之和、加权和等。
在一个实施例中,神经网络模型可以采用多种算法模型建立,例如通过残差网络ResNet/DenseNet等建立神经网络模型。ResNet(Residual Neural Network)的结构可以极快的加速神经网络的训练,模型的准确率也有比较大的提升。
例如,神经网络模型包括输入层神经元模型、中间层神经元模型和输出层神经元模型,每层神经元模型的输出作为下一层神经元模型的输入,神经网络模型可以为具有全连接结构的多个神经网络层的子网络结构,中间层神经元模型为全连接层。
将根据第一样本户型图、第二样本户型图、第一家具信息以及样本户型结构数据生成训练样本集,根据训练样本进行神经网络的训练,得到神经网络模型。利用大量的训练样本对深度算法模型进行训练,获取训练好的神经网络模型。
将需要装修的户型图和装修户型结构数据输入训练好的神经网络模型,通过神经网络模型输出家具摆放热力图,家具摆放热力图包括在需要装修的户型图中建议摆放的床、桌子等家具的位置信息、在此位置上建议摆放的床、桌子等家具的摆放概率等。
图11为本公开的基于户型的家具摆放方案生成方法的一个实施例中对家具的摆放进行优化的流程图,如图11所示的方法包括步骤:S1101-S1102。下面对各 步骤分别进行说明。
S1101,基于预设的家具组合策略以及展示信息确定与家具摆放图中摆放的家具相对应的配套物品。
家具组合策略包括家具组合算法等,配套物品可以为家具、床上用品、装饰物品等。例如,对于在家具摆放图中摆放的床,则基于家具组合算法确定与摆放的床相对应的配套物品为床头柜等,基于床的展示信息确定床头柜的风格、大小等。
S1102,基于预设的家具摆放策略并根据装修户型结构数据,优化家具摆放图中摆放的家具以及相对应的配套物品的摆放位置,家具摆放策略包括:贴墙策略、贴地策略等。
贴墙策略可以为贴墙算法等,贴地策略可以为贴地算法等,基于贴墙算法、贴地算法等并根据装修户型结构数据,优化家具摆放图中摆放的家具以及相对应的配套物品的摆放位置。
图12为本公开的基于户型的家具摆放方案生成方法的一个实施例中生成三维渲染模型的流程图,如图12所示的方法包括步骤:S1201-S1204。下面对各步骤分别进行说明。
S1201,根据需要装修的户型图以及装修户型结构数据生成三维户型模型。
可以使用多种建模工具,例如CAD建模工具等,根据需要装修的户型图以及装修户型结构数据生成三维户型模型。
S1202,根据展示信息生成与在家具摆放图中摆放的家具以及配套物品相对应的三维家具模型。
可以使用多种建模工具,例如CAD建模工具等,根据展示信息生成在家具摆放图中摆放的家具以及配套物品的三维家具模型。
S1203,根据家具摆放图将三维户型模型和家具三维模型进行组合处理,生成三维房屋装修模型。根据家具摆放图将家具三维模型摆放至三维户型模型中的指定区域。
S1204,根据展示信息确定装修风格,基于装修风格对三维房屋装修模型进行渲染处理。由此,生成已装修房屋三维模型
可以实现不同装修风格下的家具摆放、墙地铺贴、门窗的填充和渲染效果,可以通过前端页面展示给用户。获取与需要装修的户型图相对应的家具摆放方案, 生成与家具摆放方案相对应的虚拟三维空间全景渲染图。用户可在前端呈现的虚拟三维空间全景渲染图内游走、全方位浏览房屋设计方案,最终实现基于自己家户型的装修方案浏览。
在一个实施例中,如图13A所示,本公开提供一种基于户型的家具摆放方案生成装置,包括:户型数据获得模块1301、家具信息标注模块1302和摆放方案获得模块1305。户型数据获得模块1301获取与第一样本户型图相对应的样本户型结构数据。家具信息标注模块1302获取与第一样本户型图相对应的、摆放有家具的第二样本户型图,对第二样本户型图中摆放的家具进行标注,生成第一家具信息。摆放方案获得模块1305根据第一样本户型图、第二样本户型图、第一家具信息以及样本户型结构数据,利用预设的家具摆放决策规则对需要装修的户型图进行处理,获取与需要装修的户型图相对应的家具摆放方案。
在一个实施例中,如图13B所示,基于户型的家具摆放方案生成装置还包括:训练样本生成模块1303、模型训练模块1304。训练样本生成模块1303根据第一样本户型图、第二样本户型图、第一家具信息以及样本户型结构数据生成训练样本集。模型训练模块135根据训练样本进行神经网络的训练,得到神经网络模型。摆放方案获得模块1305利用神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与需要装修的户型图相对应的家具摆放方案。
在一个实施例中,户型数据获得模块1301获取与需要装修的户型图相对应的装修户型结构数据。摆放方案获得模块1305将需要装修的户型图和装修户型结构数据输入神经网络模型,获取神经网络模型输出的与需要装修的户型图相对应的家具摆放信息,以及与家具摆放信息相对应的第二家具信息。摆放方案获得模块1305利用家具摆放决策规则对家具摆放信息进行处理,获取家具摆放图,基于第二家具信息获取与家具摆放图中摆放的家具相对应的展示信息。
家具摆放信息包括家具摆放热力图等,家具热力图包括:在需要装修的户型图中建议摆放的家具的位置信息、与建议摆放的家具相对应的摆放概率。摆放方案获得模块1305根据家具的排放位置关系获取与建议摆放的家具相对应的能量函数,基于能量函数建立约束条件。摆放方案获得模块1305使用蒙特卡罗搜索树算法对家具摆放热力图进行遍历,获取满足约束条件的家具摆放图;其中,在家具摆放图中摆放的家具的数量位于预设数量区间。
在一个实施例中,如图14所示,摆放位置优化模块1306基于预设的家具组 合策略以及展示信息确定与家具摆放图中摆放的家具相对应的配套物品。摆放位置优化模块1306基于预设的家具摆放策略并根据装修户型结构数据,优化家具摆放图中摆放的家具以及相对应的配套物品的摆放位置,家具摆放策略包括:贴墙策略、贴地策略等。
展示模块处理模块1307根据需要装修的户型图以及装修户型结构数据生成三维户型模型,根据展示信息生成与在家具摆放图中摆放的家具以及配套物品相对应的三维家具模型。展示模块处理模块1307根据家具摆放图将三维户型模型和家具三维模型进行组合处理,生成三维房屋装修模型,根据展示信息确定装修风格,基于装修风格对三维房屋装修模型进行渲染处理。
上述实施例中的基于户型的家具摆放方案生成方法、装置以及电子设备、存储介质,根据第一样本户型图、第二样本户型图、第一家具信息以及样本户型结构数据生成训练样本集并进行神经网络的训练,得到神经网络模型;利用神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与需要装修的户型图相对应的家具摆放方案;能够智能生成与用户的户型相对应的家具摆放方案,并可以生成与用户的户型相对应的三维装修效果图,使用户能够全方位浏览房屋装修方案,节省设计师资源和设计流程时间,可以帮助用户能够快速、简便地选择合适的家具以及装修方案,能够简化装修设计环节流程并可以为用户装修的决策提供方便,减少装修的成本。
图15是本公开的电子设备(即计算装置)的一个实施例的结构图,如图15所示,电子设备1501包括一个或多个处理器1511和存储器1512。
处理器1511可以是中央处理单元(CPU)或者具有数据处理能力和/或指令执行能力的其他形式的处理单元,并且可以控制电子设备1501中的其他组件以执行期望的功能。
存储器1512可以包括一个或多个计算机程序产品,计算机程序产品可以包括各种形式的计算机可读存储介质,例如易失性存储器和/或非易失性存储器。易失性存储器,例如,可以包括:随机存取存储器(RAM)和/或高速缓冲存储器(cache)等。非易失性存储器,例如,可以包括:只读存储器(ROM)、硬盘以及闪存等。在计算机可读存储介质上可以存储一个或多个计算机程序指令,处理器1511可以运行程序指令,以实现上文的本公开的各个实施例的基于户型的家具摆放方案生成方法以及/或者其他期望的功能。在计算机可读存储介质中还可以存储诸如输入 信号、信号分量、噪声分量等各种内容。
在一个示例中,电子设备1501还可以包括:输入装置1513以及输出装置1514等,这些组件通过总线系统和/或其他形式的连接机构(未示出)互连。此外,该输入设备1513还可以包括例如键盘、鼠标等等。该输出装置1514可以向外部输出各种信息。该输出设备1514可以包括例如显示器、扬声器、打印机、以及通信网络及其所连接的远程输出设备等等。
当然,为了简化,图15中仅示出了该电子设备1501中与本公开有关的组件中的一些,省略了诸如总线、输入/输出接口等等的组件。除此之外,根据具体应用情况,电子设备1501还可以包括任何其他适当的组件。
除了上述方法和设备以外,本公开的实施例还可以是计算机程序产品,其包括计算机程序指令,计算机程序指令在被处理器运行时使得处理器执行本说明书上述“示例性方法”部分中描述的根据本公开各种实施例的基于户型的家具摆放方案生成方法中的步骤。
所述计算机程序产品可以以一种或多种程序设计语言的任意组合来编写用于执行本公开实施例操作的程序代码,所述程序设计语言包括面向对象的程序设计语言,诸如Java、C++等,还包括常规的过程式程序设计语言,诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算设备上执行、部分地在用户设备上执行、作为一个独立的软件包执行、部分在用户计算设备上部分在远程计算设备上执行、或者完全在远程计算设备或服务器上执行。
此外,本公开的实施例还可以是计算机可读存储介质,其上存储有计算机程序指令,所述计算机程序指令在被处理器运行时使得所述处理器执行本说明书上述“示例性方法”部分中描述的根据本公开各种实施例的基于户型的家具摆放方案生成方法中的步骤。
所述计算机可读存储介质可以采用一个或多个可读介质的任意组合。可读介质可以是可读信号介质或者可读存储介质。可读存储介质例如可以包括但不限于电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。可读存储介质的更具体的例子(非穷举的列举)可以包括:具有一个或者多个导线的电连接、便携式盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。
可以从以下枚举的示例实施例(EEE)中理解本公开的各个方面:
EEE1、一种装修前后房屋三维模型同屏显示的方法,其特征在于,包括:
用户终端获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息,所述视角变化信息包括点位变化信息和/或视线方向变化信息;
若所述当前虚拟三维空间对应于第一房屋三维模型,则根据所述视角变化信息调整第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
若所述当前虚拟三维空间对应于所述第二房屋三维模型,则根据所述视角变化信息调整所述第一房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
其中,所述第一房屋模型和所述第二房屋模型在所述用户的视角发生变化前已处于同屏同视角显示状态;所述第一房屋三维模型是指当前房屋的三维模型,所述第二房屋三维模型是指加载了推荐装修效果后的已装修房屋三维模型。
EEE2、根据EEE1所述的装修前后房屋三维模型同屏显示的方法,其特征在于,所述获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息,具体包括:通过所述当前虚拟三维空间对应的房屋三维模型的子页面获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息;
若所述当前虚拟三维空间对应于所述第一房屋三维模型,则所述根据所述视角变化信息调整第二房屋三维模型的显示视角,具体包括:通过所述第一房屋三维模型的子页面将所述视角变化信息上报给父页面,所述父页面再将所述视角变化信息下发给所述第二房屋三维模型的子页面,所述第二房屋三维模型的子页面根据所述视角变化信息调整所述第二房屋三维模型的显示视角;
若所述当前虚拟三维空间对应于第二房屋三维模型,则所述根据所述视角变化信息调整第一房屋三维模型的显示视角,具体包括:通过所述第二房屋三维模型的子页面将所述视角变化信息上报给所述父页面,所述父页面再将所述视角变化信息下发给所述第一房屋三维模型的子页面,所述第一房屋三维模型的子页面根据所述视角变化信息调整所述第一房屋三维模型的显示视角。
EEE3、根据EEE1所述的装修前后房屋三维模型同屏显示的方法,其特征在于, 在所述获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息之前,所述方法还包括:
显示所述第一房屋三维模型,获取所述第一房屋三维模型的视角信息,从后台服务器获取所述第二房屋三维模型,并根据所述第一房屋三维模型的视角信息显示所述第二房屋三维模型,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
或,
显示所述第二房屋三维模型,获取所述第二房屋三维模型的视角信息,从后台服务器获取所述第一房屋三维模型,并根据所述第二房屋三维模型的视角信息显示所述第一房屋三维模型,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
其中,所述视角信息包括点位信息及视线方向信息。
EEE4、根据EEE3所述的装修前后房屋三维模型同屏显示的方法,其特征在于,在所述获取所述第一房屋三维模型的视角信息之前,所述方法还包括:判断是否接收到预设触发信息,若判断接收到所述预设触发信息,则执行所述获取所述第一房屋三维模型的视角信息的动作;
在所述获取所述第二房屋三维模型的视角信息之前,所述方法还包括:判断是否接收到所述预设触发信息,若判断获知接收到所述预设触发信息,再执行所述获取所述第二房屋三维模型的视角信息的动作。
EEE5、根据EEE3所述的装修前后房屋三维模型同屏显示的方法,其特征在于,所述方法还包括:
后台服务器根据所述第一房屋三维模型获取预设房屋信息,所述预设房屋信息包括户型信息、层高信息及点位信息;
根据所述预设房屋信息生成与所述第一房屋三维模型对应的空房三维模型;
将家具家电三维模型添加到所述空房三维模型中,生成所述第二房屋三维模型;
将所述第一房屋三维模型与所述第二房屋三维模型对应存储。
EEE6、根据EEE5所述的装修前后房屋三维模型同屏显示的方法,其特征在于, 所述将家具家电三维模型添加到所述空房三维模型中,具体包括:
自动添加相应的所述家具家电三维模型到所述空房三维模型中,其中所述家具家电三维模型为预先生成的三维模型。
EEE7、一种装修前后房屋三维模型同屏显示的装置,其特征在于,包括:
视角变化信息获取模块,用于:获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息;
第一显示模块,用于:若所述当前虚拟三维空间对应于第一房屋三维模型,则根据所述视角变化信息调整第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
第二显示模块,用于:若所述当前虚拟三维空间对应于所述第二房屋三维模型,则根据所述视角变化信息调整所述第一房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
其中,所述第一房屋模型和所述第二房屋模型在所述用户的视角发生变化前已处于同屏同视角显示状态;所述第一房屋三维模型是指当前房屋的三维模型,所述第二房屋三维模型是指加载了推荐装修效果后的已装修房屋三维模型。
EEE8、一种装修前后房屋三维模型同屏显示的系统,其特征在于,包括EEE 7所述的装修前后的房屋三维模型同屏同视角显示的装置及EEE 5-6任一所述的后台服务器。
EEE9、一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时实现如EEE1至4任一项所述装修前后的房屋三维模型同屏同视角显示的方法的步骤。
EEE10、一种非暂态计算机可读存储介质,其上存储有计算机程序,其特征在于,该计算机程序被处理器执行时实现如EEE1至4任一项所述装修前后的房屋三维模型同屏同视角显示的方法的步骤。
本公开实施例提供的装修前后房屋三维模型同屏显示的方法、装置及系统,通过根据用户在装修前的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装修后的房屋三维模型的显示视角,或根据用户在装修后的房屋三维模型的虚拟三维空间中漫游和/或扫视的视角变化信息调整装修前的房屋三维 模型的显示视角,实现了装修前和装修后的房屋三维模型同屏同视角联动,让用户在视觉上直观观测到装修前和装修后两个房屋三维模型的差异对比,为用户提供具有真实感受的装修效果展示。
EEE11、一种基于户型的家具摆放方案生成方法,包括:
获取与第一样本户型图相对应的样本户型结构数据;
获取与所述第一样本户型图相对应的、摆放有家具的第二样本户型图,对所述第二样本户型图中摆放的家具进行标注,生成第一家具信息;
根据所述第一样本户型图、所述第二样本户型图、所述第一家具信息以及所述样本户型结构数据,利用预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案。
EEE12、如EEE11所述的方法,所述对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案包括:
根据所述第一样本户型图、所述第二样本户型图、所述第一家具信息以及所述样本户型结构数据生成训练样本集;
根据所述训练样本集进行神经网络的训练,得到神经网络模型;
利用所述神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案。
EEE13、如EEE12所述的方法,所述利用所述神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案包括:
获取与所述需要装修的户型图相对应的装修户型结构数据;
将所述需要装修的户型图和所述装修户型结构数据输入所述神经网络模型,获取所述神经网络模型输出的与所述需要装修的户型图相对应的家具摆放信息,以及与所述家具摆放信息相对应的第二家具信息;
利用所述家具摆放决策规则对所述家具摆放信息进行处理,获取家具摆放图;
基于所述第二家具信息获取与所述家具摆放图中摆放的家具相对应的展示信息。
EEE14、如EEE13所述的方法,其中,
所述神经网络模型包括:输入层神经元模型、中间层神经元模型和输出层神经元模型;每层神经元模型的输出作为下一层神经元模型的输入;
其中,所述神经网络模型为具有全连接结构的多个神经网络层的子网络结构;所述中间层神经元模型为全连接层。
EEE15、如EEE13所述的方法,其中,
所述家具摆放信息包括:家具摆放热力图;
其中,所述家具热力图包括:在所述需要装修的户型图中建议摆放的家具的位置信息、与所述建议摆放的家具相对应的摆放概率。
EEE16、如EEE15所述的方法,所述利用所述家具摆放决策规则对所述家具摆放信息进行处理,获取家具摆放图包括:
根据家具的排放位置关系获取与所述建议摆放的家具相对应的能量函数;
基于所述能量函数建立约束条件;
使用蒙特卡罗搜索树算法对所述家具摆放热力图进行遍历,获取满足所述约束条件的所述家具摆放图;其中,在所述家具摆放图中摆放的家具的数量位于预设数量区间。
EEE17、如EEE16所述的方法,还包括:
基于预设的家具组合策略以及所述展示信息确定与所述家具摆放图中摆放的家具相对应的配套物品;
基于预设的家具摆放策略并根据所述装修户型结构数据,优化所述家具摆放图中摆放的家具以及相对应的配套物品的摆放位置;
其中,所述家具摆放策略包括:贴墙策略、贴地策略中的一项或者多项。
EEE18、一种基于户型的家具摆放方案生成装置,包括:
户型数据获得模块,用于获取与第一样本户型图相对应的样本户型结构数据;
家具信息标注模块,用于获取与所述第一样本户型图相对应的、摆放有家具的第二样本户型图,对所述第二样本户型图中摆放的家具进行标注,生成第一家具信息;
摆放方案获得模块,用于根据所述第一样本户型图、所述第二样本户型图、所述第一家具信息以及所述样本户型结构数据,利用预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案。
EEE19、一种计算机可读存储介质,所述存储介质存储有计算机程序,所述计算机程序用于执行上述EEE11-17任一项所述的方法。
EEE20、一种电子设备,所述电子设备包括:
处理器;用于存储所述处理器可执行指令的存储器;
所述处理器,用于从所述存储器中读取所述可执行指令,并执行所述指令以实现上述EEE11-17任一项所述的方法。
基于本公开上述实施例提供的一种基于户型的家具摆放方案生成方法、装置以及电子设备、存储介质,能够智能生成与用户的户型相对应的家具摆放方案,可以帮助用户能够快速、简便地选择合适的家具以及装修方案,可以简化装修设计环节流程并可以为用户装修的决策提供方便。
以上结合具体实施例描述了本公开的基本原理,但是,需要指出的是,在本公开中提及的优点、优势、效果等仅是示例而非限制,不能认为这些优点、优势以及效果等是本公开的各个实施例必须具备的。另外,上述公开的具体细节仅是为了示例的作用和便于理解的作用,而非限制,上述细节并不限制本公开为必须采用上述具体的细节来实现。
本说明书中各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其它实施例的不同之处,各个实施例之间相同或相似的部分相互参见即可。对于系统实施例而言,由于其与方法实施例基本对应,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。
本公开中涉及的器件、装置、设备、系统的方框图仅作为例示性的例子并且不意图要求或暗示必须按照方框图示出的方式进行连接、布置、配置。如本领域技术人员将认识到的,可以按任意方式连接、布置、配置这些器件、装置、设备以及系统。诸如“包括”、“包含、“具有”等等的词语是开放性词汇,指“包括但不限于”,且可与其互换使用。这里所使用的词汇“或”和“和”指词汇“和/或”,且可与其互换使用,除非上下文明确指示不是如此。这里所使用的词汇“诸如”指词组“诸如但不限于”,且可与其互换使用。
可能以许多方式来实现本公开的方法和装置。例如,可通过软件、硬件、固件或者软件、硬件、固件的任何组合来实现本公开的方法和装置。用于所述方法的步骤的上述顺序仅是为了进行说明,本公开的方法的步骤不限于以上具体描述的顺序,除非以其它方式特别说明。此外,在一些实施例中,还可将本公开实施为记录在记录介质中的程序,这些程序包括用于实现根据本公开的方法的机器可读指令。因而,本公开还覆盖存储用于执行根据本公开的方法的程序的记录介质。
还需要指出的是,在本公开的装置、设备和方法中,各部件或各步骤是可以分解和/或重新组合的。这些分解和/或重新组合应视为本公开的等效方案。
提供所公开的方面的以上描述,以使本领域的任何技术人员能够做出或者使用本公开。对这些方面的各种修改等对于本领域技术人员而言,是非常显而易见的,并且在此定义的一般原理可以应用于其他方面,而不脱离本公开的范围。因此,本公开不意图被限制到在此示出的方面,而是按照与在此公开的原理和新颖的特征一致的最宽范围。
为了例示和描述的目的已经给出了以上描述。此外,此描述不意图将本公开的实施例限制到在此公开的形式中。尽管以上已经讨论了多个示例方面以及实施例,但是本领域技术人员将认识到其某些变型、修改、改变、添加和子组合。

Claims (24)

  1. 一种三维空间视图显示方法,所述三维空间视图至少包括第一三维空间视图和第二三维空间视图,所述方法包括:
    在第一用户界面上呈现所述第一三维空间视图;
    在第二用户界面上呈现所述第二三维空间视图;
    根据用户输入,改变所述第一三维空间视图;和
    根据所述第一三维空间视图的改变,改变所述第二三维空间视图。
  2. 如权利要求1所述的方法,
    其中,所述方法用于装修前后房屋三维模型同屏显示,
    其中,根据用户输入,改变所述第一三维空间视图包括:
    用户终端获取用户在所述第一三维空间视图中漫游和/或扫视的视角变化信息,
    其中,所述第一三维空间视图对应于第一房屋三维模型,所述第二三维空间视图对应于第二房屋三维模型,
    其中,根据所述第一三维空间视图的改变,改变所述第二三维空间视图包括:
    根据所述视角变化信息调整第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示。
  3. 根据权利要求2所述的方法,其中,所述第一用户界面是所述第一三维空间视图对应的第一房屋三维模型的子页面,
    其中,所述获取用户在所述第一三维空间视图中漫游和/或扫视的视角变化信息,包括:
    通过所述第一三维空间视图对应的第一房屋三维模型的子页面获取用户在第一三维空间视图中漫游和/或扫视的视角变化信息。
  4. 根据权利要求3所述的方法,其中,所述第二用户界面是所述第二三维空间视图对应的第二房屋三维模型的子页面,
    其中,根据所述视角变化信息调整第二房屋三维模型的显示视角,包括:通 过所述第一房屋三维模型的子页面将所述视角变化信息发给所述第二房屋三维模型的子页面,所述第二房屋三维模型的子页面根据所述视角变化信息调整所述第二房屋三维模型的显示视角。
  5. 根据权利要求2-4中任一项所述的方法,
    其中,在第一用户界面上呈现所述第一三维空间视图包括:
    显示所述第一房屋三维模型,
    其中,在第二用户界面上呈现所述第二三维空间视图包括:
    获取所述第一房屋三维模型的视角信息;
    获取所述第二房屋三维模型;和
    根据所述第一房屋三维模型的视角信息显示所述第二房屋三维模型,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示。
  6. 根据权利要求5所述的方法,还包括:
    判断是否接收到预设触发信息,若判断接收到所述预设触发信息,则执行所述获取所述第一房屋三维模型的视角信息的动作。
  7. 根据权利要求2-6中任一项所述的方法,还包括:
    根据所述第一房屋三维模型获取预设房屋信息,所述预设房屋信息包括户型信息、层高信息及点位信息;
    根据所述预设房屋信息生成与所述第一房屋三维模型对应的空房三维模型;
    将家具家电三维模型添加到所述空房三维模型中,生成所述第二房屋三维模型;和
    将所述第一房屋三维模型与所述第二房屋三维模型对应存储。
  8. 根据权利要求2-7中任一项所述的方法,其中,所述第一房屋三维模型和所述第二房屋三维模型中的至少一个是已装修房屋三维模型,
    其中,所述方法还包括:
    获取与多个样本户型图相对应的样本户型结构数据和家具信息;
    根据所述多个样本户型图、所述家具信息以及所述样本户型结构数据,对指定户型图进行处理,为所述指定户型图生成家具摆放方案;和
    根据所述家具摆放方案为所述指定户型图生成所述已装修房屋三维模型。
  9. 根据权利要求8所述的方法,
    其中,为所述指定户型图生成家具摆放方案包括为所述指定户型图生成第一和第二家具摆放方案,
    其中,根据所述家具摆放方案为所述指定户型图生成所述已装修房屋三维模型包括:
    根据所述第一和第二家具摆放方案为所述指定户型图生成所述第一房屋三维模型和所述第二房屋三维模型。
  10. 根据权利要求2-7中任一项所述的方法,其中,所述第二房屋三维模型是已装修房屋三维模型,
    其中,所述方法还包括:
    获取与第一样本户型图相对应的样本户型结构数据;
    获取与所述第一样本户型图相对应的、摆放有家具的第二样本户型图,对所述第二样本户型图中摆放的家具进行标注,生成第一家具信息;
    根据所述第一样本户型图、所述第二样本户型图、所述第一家具信息以及所述样本户型结构数据,利用预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案;和
    根据所述家具摆放方案生成所述已装修房屋三维模型。
  11. 如权利要求10所述的方法,其中,对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案包括:
    根据所述第一样本户型图、所述第二样本户型图、所述第一家具信息以及所述样本户型结构数据生成训练样本集;
    根据所述训练样本集进行神经网络的训练,得到神经网络模型;和
    利用所述神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案。
  12. 如权利要求11所述的方法,其中,利用所述神经网络模型以及预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案包括:
    获取与所述需要装修的户型图相对应的装修户型结构数据;
    将所述需要装修的户型图和所述装修户型结构数据输入所述神经网络模型,获取所述神经网络模型输出的与所述需要装修的户型图相对应的家具摆放信息, 以及与所述家具摆放信息相对应的第二家具信息;
    利用所述家具摆放决策规则对所述家具摆放信息进行处理,获取家具摆放图;和
    基于所述第二家具信息获取与所述家具摆放图中摆放的家具相对应的展示信息。
  13. 如权利要求11或12所述的方法,
    其中,所述神经网络模型包括:输入层神经元模型、中间层神经元模型和输出层神经元模型;每层神经元模型的输出作为下一层神经元模型的输入;
    其中,所述神经网络模型为具有全连接结构的多个神经网络层的子网络结构;所述中间层神经元模型为全连接层。
  14. 如权利要求12所述的方法,
    其中,所述家具摆放信息包括:家具摆放热力图;
    其中,所述家具热力图包括:在所述需要装修的户型图中建议摆放的家具的位置信息、与所述建议摆放的家具相对应的摆放概率。
  15. 如权利要求14所述的方法,其中,利用所述家具摆放决策规则对所述家具摆放信息进行处理,获取家具摆放图包括:
    根据家具的排放位置关系获取与所述建议摆放的家具相对应的能量函数;
    基于所述能量函数建立约束条件;和
    使用蒙特卡罗搜索树算法对所述家具摆放热力图进行遍历,获取满足所述约束条件的所述家具摆放图,其中,在所述家具摆放图中摆放的家具的数量位于预设数量区间。
  16. 如权利要求15所述的方法,还包括:
    基于预设的家具组合策略以及所述展示信息确定与所述家具摆放图中摆放的家具相对应的配套物品;和
    基于预设的家具摆放策略并根据所述装修户型结构数据,优化所述家具摆放图中摆放的家具以及相对应的配套物品的摆放位置,
    其中,所述家具摆放策略包括:贴墙策略、贴地策略中的一项或者多项。
  17. 根据权利要求1-16中任一项所述的方法,
    其中,根据用户输入,改变所述第一三维空间视图包括:
    在所述第一用户界面接收用户输入,以根据所述用户输入生成第一三维空间 视图的视图改变指令;
    所述第一用户界面根据所述视图改变指令加载用于更新第一三维空间视图的数据;
    所述第一用户界面将所述视图改变指令发送给所述第二用户界面;和
    所述第一用户界面通知所述第二用户界面其已完成数据加载,
    其中,根据所述第一三维空间视图的改变,改变所述第二三维空间视图包括:
    所述第二用户界面根据所述视图改变指令加载用于更新第二三维空间视图的数据;和
    所述第二用户界面通知所述第一用户界面其已完成数据加载。
  18. 根据权利要求1-17中任一项所述的方法,其中所述用户输入是第一用户输入,所述方法还包括:
    根据第二用户输入,改变所述第二三维空间视图;和
    根据所述第二三维空间视图的改变,改变所述第一三维空间视图。
  19. 一种三维空间视图显示方法,所述三维空间视图至少包括第一三维空间视图和第二三维空间视图,所述方法包括:
    在第一用户界面上呈现第一三维空间视图;
    在第二用户界面上呈现第二三维空间视图;
    在所述第一用户界面接收用户输入,以根据所述用户输入生成第一三维空间视图的视图改变指令;
    所述第一用户界面根据所述视图改变指令加载用于更新第一三维空间视图的数据;
    将所述视图改变指令从所述第一用户界面发送给所述第二用户界面;
    所述第二用户界面根据所述视图改变指令加载用于更新第二三维空间视图的数据;和
    所述第一用户界面和所述第二用户界面分别根据加载的用于更新第一三维空间视图的数据和加载的用于更新第二三维空间视图的数据更新所述第一三维空间视图和所述第二三维空间视图。
  20. 根据权利要求19的方法,还包括:
    所述第一用户界面通知所述第二用户界面其已完成数据加载;
    所述第二用户界面通知所述第一用户界面其已完成数据加载;和
    响应于所述第一用户界面和所述第二用户界面均已完成数据加载,同时更新所述第一三维空间视图和所述第二三维空间视图。
  21. 一种装修前后房屋三维模型同屏显示的方法,包括:
    用户终端获取用户在当前虚拟三维空间中漫游和/或扫视的视角变化信息,所述视角变化信息包括点位变化信息和/或视线方向变化信息;
    若所述当前虚拟三维空间对应于第一房屋三维模型,则根据所述视角变化信息调整第二房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
    若所述当前虚拟三维空间对应于所述第二房屋三维模型,则根据所述视角变化信息调整所述第一房屋三维模型的显示视角,使得所述第一房屋三维模型和所述第二房屋三维模型同屏同视角显示;
    其中,所述第一房屋模型和所述第二房屋模型在所述用户的视角发生变化前已处于同屏同视角显示状态;所述第一房屋三维模型是指当前房屋的三维模型,所述第二房屋三维模型是指加载了推荐装修效果后的已装修房屋三维模型。
  22. 一种基于户型的家具摆放方案生成方法,包括:
    获取与第一样本户型图相对应的样本户型结构数据;
    获取与所述第一样本户型图相对应的、摆放有家具的第二样本户型图,对所述第二样本户型图中摆放的家具进行标注,生成第一家具信息;
    根据所述第一样本户型图、所述第二样本户型图、所述第一家具信息以及所述样本户型结构数据,利用预设的家具摆放决策规则对需要装修的户型图进行处理,获取与所述需要装修的户型图相对应的家具摆放方案。
  23. 一种计算装置,包括存储器和处理器,所述存储器存储有程序指令,所述程序指令被所述处理器执行时,使得所述处理器执行权利要求1至22中任一项所述的方法。
  24. 一种非暂态计算机可读存储介质,其上存储有程序指令,所述程序指令被处理器执行时,使得所述处理器执行权利要求1至22中任一项所述的方法。
PCT/CN2019/115535 2019-05-28 2019-11-05 三维空间视图显示方法、装置及存储介质 WO2020238022A1 (zh)

Priority Applications (6)

Application Number Priority Date Filing Date Title
AU2019447524A AU2019447524B2 (en) 2019-05-28 2019-11-05 Method, apparatus and storage medium for displaying three-dimensional space view
JP2020567129A JP7121811B2 (ja) 2019-05-28 2019-11-05 三次元空間の眺めを表示させる方法、装置、及び記憶媒体
EP19928298.9A EP3789967A4 (en) 2019-05-28 2019-11-05 Three-dimensional space view display method, apparatus, and storage medium
US17/072,021 US11158134B2 (en) 2019-05-28 2020-10-15 Method, apparatus and storage medium for displaying three-dimensional space view
US17/356,472 US11875460B2 (en) 2019-05-28 2021-06-23 Method, apparatus and storage medium for displaying three-dimensional space view
JP2022071869A JP7407223B2 (ja) 2019-05-28 2022-04-25 三次元空間の眺めを表示させる方法、装置、及び記憶媒体

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201910451604.0A CN110689621B (zh) 2019-05-28 2019-05-28 装修前后房屋三维模型同屏显示的方法、装置及系统
CN201910451604.0 2019-05-28
CN201910637657.1 2019-07-15
CN201910637657.1A CN110363853B (zh) 2019-07-15 2019-07-15 家具摆放方案生成方法、装置以及设备、存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/072,021 Continuation US11158134B2 (en) 2019-05-28 2020-10-15 Method, apparatus and storage medium for displaying three-dimensional space view

Publications (1)

Publication Number Publication Date
WO2020238022A1 true WO2020238022A1 (zh) 2020-12-03

Family

ID=73553422

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/115535 WO2020238022A1 (zh) 2019-05-28 2019-11-05 三维空间视图显示方法、装置及存储介质

Country Status (4)

Country Link
US (2) US11158134B2 (zh)
JP (2) JP7121811B2 (zh)
AU (1) AU2019447524B2 (zh)
WO (1) WO2020238022A1 (zh)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11049317B2 (en) 2018-04-20 2021-06-29 Marxent Labs, LLC Technologies for 3D placement of virtual objects from a 2D layout
US11473927B2 (en) * 2020-02-05 2022-10-18 Electronic Arts Inc. Generating positions of map items for placement on a virtual map
CN113536680A (zh) * 2021-07-20 2021-10-22 杭州群核信息技术有限公司 家装设计方法、装置、计算机可读存储介质和处理器
CN113806850A (zh) * 2021-09-30 2021-12-17 深圳海智创科技有限公司 地产产品数字化管理方法、装置、计算机设备及存储介质
US11875280B2 (en) * 2021-12-08 2024-01-16 Marxent Labs Llc Rendering 3D model data for prioritized placement of 3D models in a 3D virtual environment
CN114693895B (zh) * 2022-03-24 2023-03-03 北京城市网邻信息技术有限公司 贴图切换方法、装置、电子设备及存储介质
JP7440972B2 (ja) 2022-06-23 2024-02-29 nat株式会社 室内レイアウト支援方法、システム及びプログラム

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140340396A1 (en) * 2013-05-14 2014-11-20 Electronics And Telecommunications Research Institute Method of representing environment object in cyber-physical system using environment data model structure and computer-readable storage medium storing program therefor
CN106157352A (zh) * 2015-04-08 2016-11-23 苏州美房云客软件科技股份有限公司 精装360与毛坯无缝切换的数字展示方法
CN107590337A (zh) * 2017-09-13 2018-01-16 灵图互动(武汉)科技有限公司 一种家装展示互动方法和装置
CN108694266A (zh) * 2017-04-07 2018-10-23 美宅科技(北京)有限公司 基于机器学习的智能装修设计方法与系统
CN110363853A (zh) * 2019-07-15 2019-10-22 贝壳技术有限公司 家具摆放方案生成方法、装置以及设备、存储介质

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6005570A (en) * 1993-03-05 1999-12-21 Inprise Corporation Graphical user interface system and methods for improved user feedback
JP4396008B2 (ja) * 2000-07-26 2010-01-13 パナソニック電工株式会社 インテリアシミュレーションシステム
US20070127791A1 (en) * 2005-11-15 2007-06-07 Sectra Ab Automated synchronization of 3-D medical images, related methods and computer products
US9355470B2 (en) 2011-11-30 2016-05-31 The Board Of Trustees Of The Leland Stanford Junior University Method and system for interactive layout
US8989440B2 (en) 2012-03-27 2015-03-24 Way Out Ip, Llc System and method of room decoration for use with a mobile device
JP6090321B2 (ja) * 2012-07-25 2017-03-08 ソニー株式会社 情報処理装置及びプログラム
US9340304B2 (en) * 2013-02-28 2016-05-17 The Boeing Company Aircraft comparison system
US10067650B2 (en) * 2013-06-20 2018-09-04 The Boeing Company Aircraft comparison system with synchronized displays
CN103400415B (zh) 2013-08-07 2016-03-02 赞奇科技发展有限公司 平面空间结构三维数字模型自动生成及在线互动的实现方法
CN103700127A (zh) 2013-09-02 2014-04-02 西安工程大学 基于虚拟现实技术的古遗址虚拟场景快速生成方法
CN104252561A (zh) 2014-09-05 2014-12-31 北京尔宜居科技有限责任公司 一种在单一界面中同时展示同一装修场景的2d图像和3d图像的方法
WO2016080437A1 (ja) * 2014-11-21 2016-05-26 株式会社ネクスト 画像処理装置および方法
CN104461309A (zh) 2014-12-26 2015-03-25 北京奇虎科技有限公司 基于拖拽操作跨页面调整对象位置的方法和装置
US10230326B2 (en) * 2015-03-24 2019-03-12 Carrier Corporation System and method for energy harvesting system planning and performance
US9676521B2 (en) 2015-09-21 2017-06-13 Daniel McGee Breathing assist device storage compartment assembly
CN106293972B (zh) 2016-08-12 2019-12-10 金蝶软件(中国)有限公司 单页应用页面通讯方法和装置
CN106569595A (zh) 2016-10-19 2017-04-19 上海市城市建设设计研究总院 基于vr和bim的虚拟工程体验方法及装置
JP6116746B1 (ja) * 2016-11-17 2017-04-19 株式会社ネクスト 情報処理装置、情報処理方法、及びプログラム
CN106777666A (zh) 2016-12-13 2017-05-31 周振华 装修指导图生成方法及装置
CN106600709A (zh) 2016-12-15 2017-04-26 苏州酷外文化传媒有限公司 基于装修信息模型的vr虚拟装修方法
CN106683177B (zh) 2016-12-30 2019-03-05 四川讯视科技有限公司 基于互动漫游式房屋装修数据交互方法及装置
US10572970B2 (en) * 2017-04-28 2020-02-25 Google Llc Extracting 2D floor plan from 3D GRID representation of interior space
CN108961426A (zh) 2017-05-19 2018-12-07 深圳市掌网科技股份有限公司 基于虚拟现实的家居设计方法及系统
CN107526895B (zh) 2017-09-06 2021-02-05 合肥工业大学 一种古民居群快速建模系统
CN107515991A (zh) 2017-09-06 2017-12-26 北京市金龙腾装饰股份有限公司 一种基于bim技术的户型全装修模拟展示方法及展示系统
CN107742319A (zh) 2017-10-27 2018-02-27 北京小米移动软件有限公司 模型数据处理方法及装置
US10580207B2 (en) * 2017-11-24 2020-03-03 Frederic Bavastro Augmented reality method and system for design
CN108062797A (zh) 2017-12-15 2018-05-22 威仔软件科技(苏州)有限公司 一种基于虚拟现实技术的选房装置及选房方法
CN108459715A (zh) 2018-03-13 2018-08-28 重庆卢浮印象数字科技有限公司 建筑设计系统
CN108595773A (zh) 2018-03-28 2018-09-28 超选(北京)科技有限公司 室内装修设计装置及方法
CN108961387A (zh) 2018-05-30 2018-12-07 链家网(北京)科技有限公司 一种房屋虚拟三维模型的显示方法及终端设备
CN109559379B (zh) 2018-09-20 2023-06-06 中建科技有限公司深圳分公司 一种基于装配式建筑平台的全景看房方法及装置
CN109448120B (zh) 2018-10-31 2023-09-08 广州凡拓动漫科技有限公司 三维建筑模型的处理方法、装置和计算机设备
CN109583038A (zh) 2018-11-07 2019-04-05 北京自由灵动科技有限公司 一种室内设计方法及装置
CN109740243B (zh) 2018-12-29 2022-07-08 江苏艾佳家居用品有限公司 一种基于分件强化学习技术的家具布局方法及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140340396A1 (en) * 2013-05-14 2014-11-20 Electronics And Telecommunications Research Institute Method of representing environment object in cyber-physical system using environment data model structure and computer-readable storage medium storing program therefor
CN106157352A (zh) * 2015-04-08 2016-11-23 苏州美房云客软件科技股份有限公司 精装360与毛坯无缝切换的数字展示方法
CN108694266A (zh) * 2017-04-07 2018-10-23 美宅科技(北京)有限公司 基于机器学习的智能装修设计方法与系统
CN107590337A (zh) * 2017-09-13 2018-01-16 灵图互动(武汉)科技有限公司 一种家装展示互动方法和装置
CN110363853A (zh) * 2019-07-15 2019-10-22 贝壳技术有限公司 家具摆放方案生成方法、装置以及设备、存储介质

Also Published As

Publication number Publication date
US11875460B2 (en) 2024-01-16
US20210327158A1 (en) 2021-10-21
US11158134B2 (en) 2021-10-26
JP7121811B2 (ja) 2022-08-18
AU2019447524A1 (en) 2020-12-17
JP2021523493A (ja) 2021-09-02
AU2019447524B2 (en) 2021-12-23
JP2022105083A (ja) 2022-07-12
JP7407223B2 (ja) 2023-12-28
US20210049829A1 (en) 2021-02-18

Similar Documents

Publication Publication Date Title
WO2020238022A1 (zh) 三维空间视图显示方法、装置及存储介质
US11144680B2 (en) Methods for determining environmental parameter data of a real object in an image
JP7325602B2 (ja) インテリアデザインのための人工知能システム及び方法
US11676344B2 (en) Presenting building information using building models
CN105787230B (zh) 一种家居仿真设计系统及方法
WO2019058266A1 (en) SYSTEM AND METHOD FOR CONVERTING A 3D SCALE SOIL PLAN FOR THE CREATION AND RENDERING OF ARCHITECTURAL SCENES OF VIRTUAL REALITY, VIDEOS AND VISUAL IMAGES
CN106055762A (zh) 一种家居装修设计系统及方法
KR20190065933A (ko) 공간 인식에 기반한 인테리어 플랫폼 제공 방법
Kieferle et al. BIM interactive-about combining bim and virtual reality
US20160300293A1 (en) Device, system and method for designing a space
WO2015075705A2 (en) Device, system and method for designing a space
US20230196684A1 (en) Presenting Building Information Using Video And Building Models
JP7287509B2 (ja) 現在空間及び媒体内の品目情報を表示する方法及び装置
EP3789967A1 (en) Three-dimensional space view display method, apparatus, and storage medium
US20210225044A1 (en) System and Method for Object Arrangement in a Scene
KR20180031890A (ko) 3d 인테리어 시뮬레이션 프로그램을 이용한 인테리어 역경매 시스템 및 방법
Dai et al. Virtual Housing Design Experience Platform

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2020567129

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 19928298031220

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2019928298

Country of ref document: EP

Effective date: 20201203

ENP Entry into the national phase

Ref document number: 2019447524

Country of ref document: AU

Date of ref document: 20191105

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19928298

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE