KR101980261B1 - System and method for furniture placement simulation using augmented reality and computer program for the same - Google Patents

Abstract

The present invention relates to a furniture placement simulation system comprising: a receiving unit receiving image and measurement information from a user device; a modeling unit using the received image and measurement information to generate a three-dimensional (3D) model of a user′s environment; a storage unit storing product information including a 3D model of one or more furniture products; and an augmented reality (AR) experience unit using the 3D model of the user′s environment and the product information to provide an AR model allowing the user to edit the 3D model of the user′s environment and arrange the 3D model of the furniture product on the 3D model of the user′s environment. According to the present invention, the furniture placement simulation system provides the AR model of a user′s environment based on information acquired from a device, such as a user′s smartphone and the like, thereby allowing the user to use the AR model to virtually remove objects included in the user′s environment and virtually arrange a furnace product to be bought in the user′s environment to experience in advance whether multiple pieces of furniture match in the user′s environment before actual purchase.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system and method for simulating a furniture layout using an augmented reality and a computer program for the same.

The present invention relates to a system and a method for simulating a furniture layout, and more particularly, to a system and method for simulating a furniture layout, which is based on information acquired from a device such as a smartphone of a user, Based on Augmented Reality (AR) based technology that can be edited and virtually arrange furniture items to purchase.

In the field of architecture, the term remodeling often refers to altering the furniture or interior of a room to the extent that the particular space has a completely new feel and design, including altering the structure of the partially obscured furniture or space It is mainly used as a meaning.

For example, in the case of a newly-married couple or a single-person household, there is a large desire to change the interior of the house in which the person is living or living in the future. In this case, in order to equip the furniture suitable for the new interior, the user must go through the online or offline store and purchase the necessary furniture considering the design and size of the furniture suitable for the new space. In addition, since furniture is not easy to carry, it is inconvenient to return or exchange the furniture even if the furniture is unfavorable.

In addition, when a new furniture is purchased or replaced for partial remodeling or full remodeling of a space, the user directly measures the dimensions of the space to determine whether the furniture to be purchased is properly positioned within the space, And whether the colors of the wallpaper, the interior decorations, and the furniture match well. From the buyer's point of view, there is a demand to confirm these items before the remodeling or furniture purchase, and the company specialized in the remodeling shows the product catalog applied by the structure and allows the consumer to select it. However, since there is a difference between the space that is confirmed through the catalog and the actual residence space of the user, the degree of experience the consumer experiences varies.

Meanwhile, in recent years, with the development of smartphone technology, a variety of applications have emerged, and a technology has been introduced that enables a user to virtually arrange furniture using Augmented Reality (AR). For example, Korean Patent Laid-Open Publication No. 10-2016-0033495 discloses a furniture arrangement apparatus using an AR. However, conventional AR technology such as disclosed in Korean Patent Laid-Open Publication No. 10-2016-0033495 merely displays virtual furniture at a specific point in the image of the real space, so that the consumer actually exists in the real space It is impossible to move or remove furniture and to arrange new furniture, so there is a limit to the utilization and applicability of consumers.

Korean Patent Publication No. 10-2016-0033495

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems of the conventional art and it is an object of the present invention to provide an Augmented Reality (AR) model of a user environment based on information acquired from a device such as a smartphone of a user, A furniture placement simulation system and method in which objects existing in the environment of the user can be virtually moved or removed, and a furniture product to be purchased by the user can be virtually arranged, and a computer program therefor can be provided.

A furniture placement simulation system according to an embodiment of the present invention includes a receiving unit configured to receive image information and survey information from a user device; A modeling unit configured to generate a three-dimensional model of the user environment using the received image information and the measurement information; A product information storage unit configured to store product information including a three-dimensional model of one or more household goods; And using the three-dimensional model of the user environment and the product information, the user can edit the three-dimensional model of the user environment and place the three-dimensional model of the furniture product on the three- And an augmented reality experience unit for providing an augmented reality (AR) model to the user equipment.

In one embodiment, the modeling unit includes: a two-dimensional modeling unit configured to generate a two-dimensional drawing of the user environment using the measurement information; A three-dimensional modeling unit configured to convert the two-dimensional drawing of the user environment into three-dimensional data and combine with the image information to generate a three-dimensional model of the user environment; And a model storage configured to store a three-dimensional model of the user environment.

In one embodiment, the model storage is configured to further store a two-dimensional view or a three-dimensional model of one or more buildings to which the location information is tagged.

In one embodiment, the image information includes user location information. The two-dimensional modeling unit may be further configured to generate a two-dimensional model of the user environment using a result of comparing the position information included in the image information with a two-dimensional drawing of the one or more buildings stored in the model storage unit . Alternatively, the three-dimensional modeling unit may generate a three-dimensional model of the user environment using a result of comparing the location information included in the image information with a three-dimensional model of the one or more buildings stored in the model storage unit Lt; / RTI >

In one embodiment, the survey information includes planar structural information of a user environment selected by the user and dimensional information corresponding to each section of the planar structural information.

In one embodiment, the merchandise information further includes price information corresponding to the one or more furniture merchandise. The furniture placement simulation system may further include an order processing unit configured to receive the order information generated using the augmented reality model from the user equipment and perform order processing.

A method of simulating a furniture layout according to an exemplary embodiment includes storing product information including a three-dimensional model of one or more furniture articles in a furniture placement simulation system; The furniture placement simulation system receiving image information and survey information from a user device; Wherein the furniture placement simulation system comprises: generating a three-dimensional model of the user environment using the received image information and the survey information; And a furniture arrangement simulation system, wherein the user can edit the three-dimensional model of the user environment using the three-dimensional model of the user environment and the product information, and the three-dimensional model of the furniture product And providing the user device with an augmented reality model capable of placing a three-dimensional model.

In one embodiment, the step of creating a three-dimensional model of the user environment comprises the steps of: the furniture placement simulation system generating a two-dimensional drawing of the user environment using the survey information; Wherein the furniture placement simulation system comprises: converting a two-dimensional drawing of the user environment into three-dimensional data and combining the three-dimensional drawing with the image information to generate a three-dimensional model of the user environment; And storing the three-dimensional model of the user environment in the furniture placement simulation system.

A method of simulating a furniture layout according to an exemplary embodiment of the present invention includes storing a two-dimensional drawing or a three-dimensional model of one or more buildings tagged with location information in the furniture layout simulation system, prior to the step of generating a three- .

In one embodiment, the image information includes user location information. In this case, the step of generating the two-dimensional drawing of the user environment may include a step of comparing the position information included in the image information with the two-dimensional drawing of the one or more buildings stored in the furniture arrangement simulation system, And generating a two-dimensional model of the user environment using the two-dimensional model. Alternatively, the step of generating the three-dimensional model of the user environment may further comprise the step of comparing the location information included in the image information with the three-dimensional model of the one or more buildings stored in the model storage unit And generating a three-dimensional model of the user environment using the result.

In one embodiment, the survey information includes planar structural information of a user environment selected by the user and dimensional information corresponding to each section of the planar structural information.

In one embodiment, the merchandise information further includes price information corresponding to the one or more furniture merchandise. In this case, the furniture placement simulation method may further include a step of receiving the order information generated using the augmented reality model from the user equipment and performing an order processing, in the furniture placement simulation system.

A computer program according to an embodiment is stored in a computer readable recording medium and is combined with hardware to implement a furniture placement simulation method according to the embodiments described above.

The furniture arrangement simulation system and method according to an aspect of the present invention provides an Augmented Reality (AR) model of a user environment based on information acquired from a device such as a smartphone of a user, It is possible to virtually remove the objects in the environment by using it, and by arranging the furniture products that the user wants to purchase to be virtual in the user environment, it is possible to experience beforehand how the furniture will fit in the environment before the actual purchase There is an advantage to be able to.

In addition, using the furniture arrangement simulation system and method according to one aspect of the present invention, a user can not only arrange furniture virtually in the AR model, but also promptly confirms information such as the price of a product he / Since it is possible to purchase the corresponding product, it is possible to reduce a large amount of cost required for maintaining the offline exhibition hall from the viewpoint of the seller, and there is an advantage that the purchase of goods can be promoted through the process of purchasing the product easily and quickly.

Further, in the furniture arrangement simulation system and method according to one aspect of the present invention, it is possible to accurately measure the space using a smart phone or the like without the user having to separate equipment by photographing the space together with the size of the reference object There is an advantage that the user environment can be precisely three-dimensionally simulated by generating an AR model by comparing the user environment with a previously stored two-dimensional or three-dimensional model through tagged location information.

1 is a configuration diagram of a furniture placement simulation system according to an embodiment.
2 is a flowchart showing each step of a furniture placement simulation method according to an embodiment.
3 is a conceptual diagram of a process of measuring a user environment using a user apparatus in a furniture placement simulation method according to an exemplary embodiment.
4 is a flowchart showing each step of the furniture placement simulation method according to another embodiment.

Hereinafter, some exemplary embodiments of the present invention will be described in detail with reference to the drawings.

Where reference in the specification to " above " another part, it may be directly on the other part or be accompanied by another part therebetween. In contrast, when a section is referred to as being " directly above " another section, no other section is involved.

Herein, the terms first, second and third, etc. are used to describe various parts, components, regions, layers and / or sections, but are not limited thereto. These terms are only used to distinguish any moiety, element, region, layer or section from another moiety, moiety, region, layer or section. Thus, a first portion, component, region, layer or section described below may be referred to as a second portion, component, region, layer or section without departing from the scope of the present invention.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular forms as used herein include plural forms as long as the phrases do not expressly express the opposite meaning thereto. Means that a particular feature, region, integer, step, operation, element and / or component is specified and that the presence or absence of other features, regions, integers, steps, operations, elements, and / It does not exclude addition.

The term " below ", " above ", and the like, which denote relative space in this specification, can be used to more easily describe the relationship to other parts of a part shown in the drawings. These terms are intended to include other meanings or acts of the apparatus in use, as well as intended meanings in the drawings. For example, when inverting a device in the figures, certain parts that are described as being " below " other parts are described as being " above " other parts. Thus, an exemplary term " below " includes both up and down directions. The device can be rotated by 90 degrees or rotated at different angles, and terms indicating relative space are interpreted accordingly.

Unless defined otherwise, all terms including technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Commonly used predefined terms are further interpreted as having a meaning consistent with the relevant technical literature and the present disclosure, and are not to be construed as ideal or very formal meanings unless defined otherwise.

1 is a configuration diagram of a furniture placement simulation system according to an embodiment.

1, the furniture arrangement simulation system 1 according to the present embodiment operates while communicating with the user apparatus 2, and is configured to receive, based on information received from the user apparatus 2, augmented reality ; AR) model to the user device 2 so that the user can virtually edit his / her environment and virtualize the furniture items of interest within his / her environment. In addition, the furniture layout simulation system 1 according to the present embodiment can communicate with and operate with one or more external servers 3, 4.

The communication method between the furniture layout simulation system 1 and the user apparatus 2 or the external servers 3 and 4 can include all the communication methods in which objects and objects can be networked, , 4G, or otherwise. For example, the wired and / or wireless network 2 may be a Local Area Network (LAN), a Metropolitan Area Network (MAN), a Global System for Mobile Network (GSM), an Enhanced Data GSM Environment (EDGE) Packet Access, W-CDMA, CDMA, TDMA, Bluetooth, Zigbee, Wi-Fi, (3GPP LTE), Mobile WiMAX (IEEE 802.16e), UMB (formerly EV-DO Rev. C), Flash- A communication network by one or more communication methods selected from the group consisting of OFDM, iBurst and MBWA (IEEE 802.20) systems, HIPERMAN, Beam-Division Multiple Access (BDMA), Wi-MAX (World Interoperability for Microwave Access) , But is not limited thereto.

In one embodiment, the user device 2 is implemented in the form of a smartphone and communicates with the furniture placement simulation system 1 via an application (or app) running on the user device 2 Thereby transmitting and receiving information necessary for the AR experience. In this case, the furniture layout simulation system 1 performs the functions of an application service server or a web server which enables the operation of the application on the user device 2. [

However, the form of the user device 2 is not limited to a smart phone, and the user device 2 may be other mobile communication terminals, a personal computer, a notebook computer, a personal digital assistant (PDA) a set-top box for Internet Protocol Television (IPTV), and the like. The user device 2 may be operated using various operating systems (OS), for example, a computer operating system such as Microsoft Windows, OS X, or Linux, or a mobile operating system such as Apple iOS, Google Android, May be operated using an operating system, but the present invention is not limited thereto.

In one embodiment, the furniture layout simulation system 1 includes a receiving unit 10, a modeling unit 20, a merchandise information storage unit 30, and an AR experience unit 40. Also, in one embodiment, the furniture placement simulation system 1 further includes an order processing unit 50.

The furniture layout simulation system 1 according to the embodiments and each unit included therein may be entirely hardware, or partly hardware, and partly software. For example, the furniture layout simulation system 1 according to the embodiments and each unit included therein may collectively refer to hardware and related software for processing data of a specific type and contents and / or for exchanging data in an electronic communication manner. The terms "part", "module", "device", "terminal", "server" or "system" are used herein to refer to a combination of hardware and software driven by that hardware. For example, the hardware may be a data processing device comprising a CPU or other processor. Also, the software driven by the hardware may refer to a running process, an object, an executable, a thread of execution, a program, and the like.

Furthermore, each element constituting the furniture layout simulation system 1 according to the present embodiment is not intended to refer to a separate apparatus which is physically separated from each other. That is, the receiving unit 10, the modeling unit 20, the product information storage unit 30, the AR experience unit 40, and the order processing unit 50 shown in FIG. It is not necessary that the respective sections be provided independently of each other. Of course, depending on the embodiment, one or more of the receiving unit 10, the modeling unit 20, the merchandise information storage unit 30, the AR experience unit 40, and the order processing unit 50 may be physically separated from each other, As shown in FIG.

The receiving unit 10 receives the image information of the user environment and the measurement information obtained by using the user apparatus 2 from the user apparatus 2. [ In order to transmit the above information to the receiving unit 10, a dedicated application may be installed in the user device 2, but the present invention is not limited thereto. The image information is an image of a user environment, and may include a photograph of a user environment photographed toward a plurality of directions different from each other, or a moving image of a user environment. The survey information refers to the design and / or dimension information of the space acquired posteriorly or in real time from the photographed image by photographing the environment in which the user wants to arrange the furniture by using the user apparatus 2.

The modeling unit 20 generates a three-dimensional model in which the user environment is three-dimensionally converted using the image information and the measurement information received by the receiving unit 10. [ In one embodiment, the modeling unit 20 includes a two-dimensional modeling unit 201 for converting the measurement information into a two-dimensional drawing, a display unit 201 for converting the two-dimensional drawing into three-dimensional data, And a three-dimensional modeling unit 202 for generating a three-dimensional model by synthesizing the three-dimensional model. In one embodiment, the modeling unit 20 further includes a model storage unit 203 for storing the generated three-dimensional model.

In one embodiment, the modeling unit 20 may generate a three-dimensional model of the user environment using a database in which a two-dimensional drawing or a three-dimensional model of previously created buildings is stored. Specifically, the modeling unit 20 specifies the building corresponding to the user environment in which the user apparatus 2 is located by comparing the position information of the user apparatus 2 with the two-dimensional drawing of the database or the position information of the three-dimensional model, A three-dimensional model of the user environment can be created using the two-dimensional drawing or the three-dimensional model of the specified building at least partially. For this operation, the modeling unit 20 may communicate with one or more external servers 3 stored in a database in a two-dimensional drawing or a three-dimensional model of the buildings. Alternatively, the database of the two-dimensional drawing or the three-dimensional model may be stored in the model storage unit 203 in advance.

The product information storage unit 30 stores a three-dimensional model of furniture products that the user can virtually arrange as product information. The product information stored in the product information storage unit 30 includes information such as a product name, a material, a price, a size, a selling place, a purchase page access address, and the like related to the products so that the user can purchase the furniture products As shown in FIG.

The AR experience unit 40 uses the three-dimensional model of the user environment generated by the modeling unit 20 and the three-dimensional model of the goods stored in the product information storage unit 30 so that the user can imagine his or her environment Provides the user device 2 with an AR model that can be edited and virtually arranged for furniture. For example, the user can utilize the AR model by virtually removing the furniture existing in the real space of the user in the AR model and arranging the new furniture in the space to see if it matches with the surroundings.

The order processing unit 50 receives the order information from the user device 2, processes the order, and executes the purchase when the user attempts to arrange the furniture virtually using the AR model and purchase the furniture. For example, the order processing unit 50 may provide a connection between an external shopping mall server 4 and the user device 2 when the user desires to order. Alternatively, in another embodiment, the order processing unit 50 itself may function as an online shopping mall where a user can browse and purchase goods without a separate external server.

2 is a flowchart showing each step of a furniture placement simulation method according to an embodiment. For convenience of explanation, a furniture placement simulation method according to the present embodiment will be described with reference to FIGS. 1 and 2. FIG.

First, the goods information can be stored in the furniture placement simulation system 1 (S1). The product information stored at this time is for one or more furniture products that a user can virtually arrange using the furniture placement simulation system 1, and includes a three-dimensional model of the furniture. The product information may further include information such as a product name, a material, a dimension, a price, a selling place, a purchase page access address, etc. related to the furniture product.

Next, the receiving unit 10 of the furniture placement simulation system 1 can receive the image information of the user environment and the measurement information of the user environment from the user apparatus 2 to which the furniture is to be virtually arranged S2). In this case, the image information refers to the photograph and / or moving image of the user environment, and the measurement information refers to the space division information and the dimension information of the user environment required to create the user environment by the blueprint. An angular velocity sensor, an acceleration sensor, a gyroscope, and a GPS (Global Positioning System) device mounted on the user device 2 may be used to acquire survey information.

Among the survey information, the segment information may be obtained automatically by analyzing the image photographed by the user apparatus 2, or may be automatically acquired from a plurality of design drawings set in advance, Lt; / RTI > For example, the application of the user device 2 or the furniture placement simulation system 1 communicating therewith has a block diagram of the flat structure of the house (e.g., living room, bedroom, kitchen, small room 1, small room 2, etc.) The user can input the segment information in a form that selects the one that best represents his / her environment among various stored types of drawings.

In addition, the dimension information in the survey information can be obtained by analyzing the image photographed by the user apparatus 2. [ In this case, in order to obtain the actual dimensions of the space from the image, the space of the user environment may be measured in each direction after arranging the reference object (e.g., a coin or the like) having a known size in advance in the space. It is also possible for the user to directly modify the dimension information obtained by the application on the user device 2 if necessary.

3 is a conceptual diagram of a process of measuring a user environment using a user apparatus in a furniture placement simulation method according to an exemplary embodiment.

3, a user can take a picture of the space in which the user device 2 is located using the user device 2, and the application on the user device 2 is displayed on a boundary line between the wall 1001 and the bottom surface 1003 It is possible to acquire the space segment information in a manner that recognizes the space segment 1002. In Fig. 3, dotted line 1020 represents the boundary of the space recognized by the application of the user device 2. In order to measure all the boundaries of the space, the user can use the user device 2 to photograph the directions of the space (for example, north, south, east, and west), or check the boundaries 1020 of the recognized space in real- The space can be measured by moving in one direction. At this time, the length information of the boundary line may be calculated by calculating the moving distance of the user device 2 using the angular velocity sensor, the acceleration sensor, the gyroscope, the GPS device, and the like on the user device 2. Further, the above-described measuring process can be performed independently or sequentially for each of the compartments when the environment in which the user is located includes a plurality of divided compartments (e.g., living room, kitchen, room, etc.).

In one embodiment, the user can perform the measurement of the space with the reference object 1000 in one area of the space for acquiring dimensional information. At this time, since the application on the user device 2 stores the size information of the reference object 1000, by comparing the length of the boundary line 1020 of the space measured through the image with the size of the reference object 1000, The size can be calculated. Although the reference object 1000 in the form of a coin is illustrated as an example in the drawing, the reference object 1000 may be any object that is known in advance and is not limited to a coin.

1 and 2, the modeling unit 20 of the furniture layout simulation system 1 generates a two-dimensional drawing of the user environment based on the image information and the measurement information received from the user apparatus 2 (S3). For example, the survey information includes the schematic design information of the space selected by the user and the dimension information of each partition of the space obtained by using the user apparatus 2, and the modeling unit 20 of the furniture placement simulation system 1 ) Can use this to convert the user environment into a two-dimensional drawing.

Next, the modeling unit 20 of the furniture layout simulation system 1 converts the two-dimensional drawing of the user environment into three-dimensional data, synthesizes the three-dimensional drawing data with the image information received from the user apparatus 2, A model can be created (S4). For example, the furniture layout simulation system 1 forms a three-dimensional space by arranging a wall having a predetermined height on a two-dimensional drawing, texture-maps the user's image information to a three-dimensional space, A three-dimensional model of the user environment can be generated. However, the method of generating the three-dimensional model may vary, and is not limited to the above-described order.

Next, the AR experience unit 40 of the furniture layout simulation system 1 can generate a user-editable AR model from the three-dimensional model of the user environment (S5). In the AR model, furniture such as a sofa, a cabinet, and a bed existing in the user environment are expressed in a separate three-dimensional object form independent of the wall or the floor surface, and the user uses the AR model to virtually position You can move or remove it. For example, the furniture layout simulation system 1 recognizes objects such as furniture from the image information of the user environment in a method based on pattern recognition or object recognition algorithm, and uses the recognized objects and the measurement information received from the user apparatus 2 Realistic furniture can be converted into a user-editable three-dimensional model. An AR model can be created by arranging a three-dimensional model of the converted furniture in a three-dimensional model of the user environment.

Next, the AR experience unit 40 of the furniture placement simulation system 1 can provide the user device 2 with a three-dimensional model of the generated AR model and furniture (S6). The three-dimensional model of the furniture provided at this time is modeled by one or more furniture products that do not actually exist in the user environment but are desired to be arranged by the user in a virtual manner, Dimensional model of the goods stored in the shop. For example, the AR model can be configured such that when a user looks around himself using the camera of the user device 2, the virtual furniture selected by the user is placed and displayed within the user environment. At this time, the other part except for the virtual furniture may be the rendering result of the three-dimensional model generated corresponding to the user environment, or may be at least partially the actual shooting image, or may be a combination of the actual shooting image and the rendering result It may be something.

In providing the AR experience, a product name, material, dimensions, a seller, purchase page access information, and the like may be provided as part of product information related to the furniture product. This information may be provided in an overlay or pop-up fashion in association with a three-dimensional model of a household item in the AR model or may be provided to the user device 2 via a separate transmission path from the AR model May be provided. Using the AR model, the user can remove or move the windows, furniture, etc. existing in the real space, and can arrange the new furniture in the virtual space and look at the color and size of the furniture.

In one embodiment, the user may wish to purchase a particular item after placing the furniture virtually within his or her user environment using the AR model. In this case, the order processing unit 50 of the furniture placement simulation system 1 can receive the order information from the user device 2 of the user who desires to purchase (S7), and further perform the process for the order (S8 ). The processing of the order information may mean that the order processing unit 50 directly pays the amount corresponding to the commodity price, receives the delivery address of the commodity from the user and instructs the delivery, or processes the order process as described above Or to connect the external server 4 and the user device 2 for the connection.

According to the above-described embodiments, by virtually modeling the furniture or the set product prepared for the use of the real space, such as the room, the nursery, the study, the kitchen, the living room, The virtual space placed through the function can be experienced as if it is a real space. Therefore, the user can easily test the relocation of furniture or space of various concepts without visiting the merchant's offline store. The seller can deliver the goods according to the data and the order information selected by the customer without visiting the customer directly. Therefore, there is an advantage that both of the discomfort of the seller and the consumer can be solved.

In addition, a product that can be ordered by the user may be a stand-alone product, a multi-family set product, or a remodeling set product including a design change or rearrangement with respect to a space together with the furniture. In this case, the remodeling recommendation screen suitable for the use of the actual space prepared by the seller can be synthesized with the 3D model of the user environment and provided as the AR model. The user can check the remodeling set through the AR model, You can order. Therefore, when the order is received, the seller can go out of business and proceed with accurate measurement, saving time and money because it is unnecessary to go to the actual trip.

4 is a flowchart showing each step of the furniture placement simulation method according to another embodiment. The present embodiment is characterized in that, in the processes (S3 and S4) of generating a three-dimensional model of the user environment among the above-described embodiments with reference to FIG. 3, the furniture layout simulation system 1 at least partially displays the location information As shown in FIG. The present embodiment can be used in combination or complementary to the embodiment described above with reference to Fig. 3, and both embodiments are not intended to be arranged with respect to each other or alternative.

1 and 4, the modeling unit 20 of the furniture layout simulation system 1 can extract tagged tagged location information from the image information received from the user apparatus 2 S31).

Next, the modeling unit 20 matches the position information extracted from the image information with the two-dimensional drawing in which the positions are recorded and stored in advance, thereby obtaining the two-dimensional drawings corresponding to the user environment (S32). For the above operation, the buildings according to their locations and their two-dimensional drawing information are stored in a database in the external server 3 communicating with the modeling unit 20 or the modeling unit 20. The modeling unit 20 compares the position information of the user apparatus 2 with the position information of the database to determine whether the user apparatus 2 is currently in the current position It is possible to determine a building that is supposed to be located, and recall a previously stored two-dimensional drawing of the building.

However, since the previously stored drawing may not completely coincide with the actual environment of the user, the modeling unit 20 performs fine adjustment based on the survey information received from the user apparatus 2 with respect to the two- (S33). For example, in the modeling unit 20, by adjusting the size of each section of the two-dimensional drawing based on the survey information, or the like, the two-dimensional map that best represents the survey information received from the user apparatus 2 A drawing can be generated.

Next, the modeling unit 20 can convert the two-dimensional drawing of the user environment into three-dimensional data (S41). At this time, the modeling unit 20 can perform matching with the database using the positional information with respect to the three-dimensional data. That is, the modeling unit 20 performs matching of the user environment with the three-dimensional data of the buildings stored in advance based on the location information received from the user device 2 (S42), and identifies the building corresponding to the user environment can do. Next, the modeling unit 20 can fine-adjust the three-dimensional data of the building specified as corresponding to the user environment based on the survey information received from the user apparatus 2 (S43). For example, fine adjustment of three-dimensional data may mean adjusting the size of each compartment, the height of the wall, and the position and size of the window.

Finally, the modeling unit 20 can generate a three-dimensional model of the user environment by synthesizing the fine-tuned three-dimensional data with the image information (S44). The synthesis process of the three-dimensional data and the image information is the same as that of the step S4 of the above-described embodiment with reference to FIG.

In the embodiment shown in FIG. 4, the two-dimensional drawings of the buildings according to their positions and the three-dimensional data of the buildings according to their positions are all stored in the database in advance, so that the two- And the like. However, in an exemplary embodiment, the database is used only for generating a two-dimensional drawing and the three-dimensional data is generated only through conversion of the generated two-dimensional drawing, or the two-dimensional drawing is generated using only the measurement information, It is also possible that the database is used only for fine-tuning of the three-dimensional data generated on the basis.

Alternatively, in another embodiment, a three-dimensional model of the user environment may be created based on only the image information and the measurement information received from the user apparatus without utilizing the database as in the flowchart shown in FIG.

The above-described method has been described with reference to the flowchart shown in the drawings. While the above method has been shown and described as a series of blocks for purposes of simplicity, it is to be understood that the invention is not limited to the order of the blocks, and that some blocks may be present in different orders and in different orders from that shown and described herein And various other branches, flow paths, and sequences of blocks that achieve the same or similar results may be implemented. Also, not all illustrated blocks may be required for implementation of the methods described herein.

The operation by the above-described furniture placement simulation method can be at least partially realized by a computer program and recorded on a computer-readable recording medium. The program for implementing the operation according to the furniture arrangement simulation method according to the embodiments is recorded, and the computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer is stored. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. The computer readable recording medium may also be distributed over a networked computer system so that computer readable code is stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the present embodiment may be easily understood by those skilled in the art to which this embodiment belongs.

While the invention has been shown and described with reference to certain embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. However, it should be understood that such modifications are within the technical scope of the present invention. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (15)

A receiving unit configured to receive image information and measurement information from a user device, the image information including location information of the user equipment;
A modeling unit configured to generate a three-dimensional model of the user environment using the received image information and the measurement information;
A product information storage unit configured to store product information including a three-dimensional model of one or more household goods; And
A user can edit a three-dimensional model of the user environment using the three-dimensional model of the user environment and the product information, and a three-dimensional model of the furniture product can be placed on the three- An augmented reality experience unit for providing an augmented reality model to the user device,
The modeling unit,
A two-dimensional drawing or a three-dimensional model of one or more buildings tagged with location information is stored,
Comparing the location information of the user device with the location information of the two-dimensional drawing or the three-dimensional model of the one or more buildings to specify a building corresponding to the environment where the user equipment is located,
Dimensional model or three-dimensional model of the specified building from the two-dimensional drawings or three-dimensional models of the one or more buildings stored on the basis of the survey information to generate a three-dimensional model of the user environment, system. The method according to claim 1,
The modeling unit,
A two-dimensional modeling unit configured to generate a two-dimensional drawing of a user environment using the measurement information;
A three-dimensional modeling unit configured to convert the two-dimensional drawing of the user environment into three-dimensional data and combine with the image information to generate a three-dimensional model of the user environment; And
A model storage unit configured to store a three-dimensional model of the user environment and a two-dimensional drawing or three-dimensional model of the one or more structures. delete 3. The method of claim 2,
Wherein the two-dimensional modeling unit is further configured to generate a two-dimensional model of the user environment using a result of comparing the position information included in the image information with a two-dimensional drawing of the one or more buildings stored in the model storage unit Simulation system. 3. The method of claim 2,
Wherein the 3D modeling unit is further configured to generate a three-dimensional model of the user environment using a result of comparing the location information included in the image information with a 3D model of the one or more buildings stored in the model storage unit Simulation system. The method according to claim 1,
Wherein the survey information includes planar structural information of a user environment selected by a user and dimensional information corresponding to each section of the planar structural information. The method according to claim 1,
Wherein the product information further includes price information corresponding to the one or more furniture products,
And an order processing unit configured to receive the order information generated using the augmented reality model from the user equipment and perform order processing. Storing product information including a three-dimensional model of one or more household goods in a furniture placement simulation system;
Storing a two-dimensional drawing or three-dimensional model of one or more buildings tagged with location information in the furniture placement simulation system;
The furniture placement simulation system receiving image information and survey information from a user device, the image information including location information of the user equipment;
Wherein the furniture placement simulation system comprises: generating a three-dimensional model of the user environment using the received image information and the survey information; And
Wherein the furniture placement simulation system is capable of editing a three-dimensional model of the user environment using a three-dimensional model of the user environment and the product information, And providing an augmented reality model capable of placing a dimensional model to the user device,
Wherein the generating the three-dimensional model of the user environment comprises:
Comparing the location information of the user equipment with the location information of the two-dimensional drawing or the three-dimensional model of the one or more buildings to specify a building corresponding to the environment where the user equipment is located; And
Wherein the furniture placement simulation system includes a step of processing a two-dimensional drawing or a three-dimensional model of the specified building among the two-dimensional drawings or three-dimensional models of the one or more buildings stored in the furniture placement simulation system based on the survey information How to simulate the included furniture layout. 9. The method of claim 8,
Wherein the generating the three-dimensional model of the user environment comprises:
Wherein the furniture placement simulation system comprises: generating a two-dimensional drawing of the user environment using the survey information;
Wherein the furniture placement simulation system comprises: converting a two-dimensional drawing of the user environment into three-dimensional data and combining the three-dimensional drawing with the image information to generate a three-dimensional model of the user environment; And
And storing the three-dimensional model of the user environment in the furniture placement simulation system. delete 9. The method of claim 8,
Wherein the step of generating the two-dimensional drawing of the user environment comprises the step of using the result of comparing the location information included in the image information with the two-dimensional drawing of the one or more buildings stored in the furniture layout simulation system And generating a two-dimensional model of the user environment. 9. The method of claim 8,
Wherein the generating of the three-dimensional model of the user environment comprises: using the result of comparing the location information included in the image information with the three-dimensional model of the one or more buildings stored in the furniture layout simulation system And generating a three-dimensional model of the user environment. 9. The method of claim 8,
Wherein the survey information includes planar structural information of a user environment selected by a user and dimensional information corresponding to each section of the planar structural information. 9. The method of claim 8,
Wherein the product information further includes price information corresponding to the one or more furniture products,
Wherein the furniture placement simulation system further comprises receiving order information generated using the augmented reality model from the user equipment and performing order processing. A computer program stored in a computer-readable medium for executing a method of simulating furniture placement according to any one of claims 8, 9 and 11 to 14 in combination with hardware.

Images