KR20240056946A - Furniture recommendation provision system and method ref - Google Patents

Abstract

According to an embodiment of the present invention, in the system and method for providing furniture recommendations reflecting user tastes performed by a server, the steps include obtaining first image information of a residential space generated through photography of a user terminal, Analyzing the first image information, recognizing the first furniture placed in the residential space, confirming the type of the first furniture, and creating a list of related furniture used in connection with the first furniture through the type of the first furniture. Generating step, calculating user preference based on user preference information pre-registered for each household included in the related household list, second household having the highest user preference score without overlapping with the first household in the related household list A system and method for providing furniture recommendations that reflect user preferences are provided, including the step of selecting and providing recommendation information about the second furniture to the user terminal.

Description

System and method for providing furniture recommendations that reflect user tastes {FURNITURE RECOMMENDATION PROVISION SYSTEM AND METHOD REF}

The present invention relates to a system and method for providing furniture recommendations that reflect user tastes, and more specifically, to obtain first image information of a residential space created through photography of a user terminal and analyze the first image information of the residential space. Thus, the first furniture placed in the residential space is recognized, the type of the first furniture is confirmed, a list of related furniture used in connection with the first furniture is generated through the type of the first furniture, and a list of related furniture is created. Calculate user preference based on pre-registered user preference information for each household included, select the second household with the highest user preference score without overlapping with the first household from the list of related households, and select the second household. It relates to a method of providing recommended information about to a user terminal.

In general, when purchasing furniture, remember the size of the space where the furniture will be placed, purchase the furniture based on that size, and then place it. Sometimes, the placement location may change, and in this case, also measure the size of the space where you want to rearrange the furniture. And we must remember this.

In other words, when redecorating the interior, such as when moving, purchasing new furniture, or changing the position of previously placed furniture, there is the inconvenience of having to check each item individually.

Accordingly, a simulation service is provided that allows the user to place the furniture selected by the user in a virtual space. However, it only allows the user to place the selected furniture in a designated virtual space, and does not provide a function to directly place the furniture in the user's actual living space. There is a limit to what you can't do.

Accordingly, there is an increasing demand for services that not only check the interior by changing it within the user's actual living space, but also recommend the interior by reflecting the user's tastes.

The present invention is intended to solve the problems of the prior art described above. The present invention is to obtain first image information of the residential space generated through photography of a user terminal, analyze the first image information of the residential space, and place the first image information of the residential space in the residential space. Recognizes the existing first household, confirms the type of the first household, creates a list of related households used in connection with the first household through the type of the first household, and pre-registers each household included in the related household list. Calculate user preference based on the user preference information, select the second household with the highest user preference score without overlapping with the first household from the list of related households, and send recommendation information about the second household to the user terminal. The purpose is to provide a method to provide it. The purpose of the present invention is not limited to the purposes mentioned above, and other purposes not mentioned are described below.

It will be clearly understandable from now on.

According to an embodiment of the present invention for achieving the above-described purpose, in the method of recommending furniture to be added through existing furniture, which is performed by a server, the residential space created through photography of the user terminal acquiring first image information; Analyzing first image information of the residential space, recognizing first furniture arranged in the residential space, and confirming the type of the first furniture; generating a list of related furniture used in connection with the first household through the type of the first furniture; calculating user preferences based on user preference information pre-registered for each household included in the related household list; selecting a second household from the list of related households that does not overlap with the first household and has the highest user preference score; A method of recommending additional households through existing households is provided, including providing recommendation information about the second household to the user terminal.

The step of providing recommendation information for the second household includes analyzing first image information of the residential space to identify an empty space around the first household; And if the size of the empty space is confirmed to be larger than the size of the second furniture, it is determined that the second furniture can be placed around the first furniture, and the recommendation information for the second furniture is provided. It may include providing information to a user terminal.

The method of recommending additional furniture through the existing furniture includes, when the location where the second furniture is to be placed within the empty space is selected, the virtual object of the second furniture is added to the placement location of the second furniture and synthesized. Generating second image information of a residential space; And it may further include providing the second image information showing the second furniture placed in the residential space to the user terminal.

The method of recommending additional furniture through the existing furniture includes the steps of analyzing second image information of the residential space to confirm the arrangement position of the first furniture and the arrangement position of the second furniture within the residential space; Calculating the frequency of use of the first furniture according to the type of the first furniture, based on pre-registered user lifestyle information, and calculating the frequency of use of the second furniture according to the type of the second furniture. ; Predicting a user movement pattern based on the arrangement position of the first furniture, the arrangement position of the second furniture, the frequency of use of the first furniture, and the frequency of use of the second furniture; Analyzing the user's movement pattern, determining whether a change in the arrangement position of at least one of the first furniture and the second furniture is necessary; As a result of the determination, if it is determined that a change in the arrangement position is necessary, resetting the arrangement positions for the first furniture and the second furniture to optimize the user movement pattern, and generating third image information of the residential space. ; And it may further include providing the third image information in which the arrangement positions of the first furniture and the second furniture are reset to the user terminal.

According to an embodiment of the present invention, the user's interest can be increased by recommending an interior that reflects the user's taste and allowing the user to confirm the recommended interior by changing it on an image of the user's actual living space.

The effects of the present invention are not limited to the effects described above, and should be understood to include all effects that can be inferred from the configuration of the invention described in the detailed description or claims of the present invention.

The present invention will be described below with reference to the attached drawings. However, the present invention can be implemented in many different forms and is therefore not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts unrelated to the description are omitted, and similar parts are given similar reference numerals throughout the specification.

Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

Figure 1 is a diagram schematically showing the configuration of an interior recommendation system according to an embodiment of the present invention.

Referring to FIG. 1, a system according to an embodiment of the present invention includes a server 100 and a user terminal 200, and a communication network 300 interconnecting the server 100 and the user terminal 200. Includes.

The server 100 according to an embodiment of the present invention may provide an interior recommendation service through an application mounted on the user terminal 200.

The user terminal 200 can receive a user interface that can register various information related to the user, such as user preference information and lifestyle information, from the server 100, and uses a camera module included in the user terminal 200. The user's living space can be photographed, and image information generated through the photograph can be transmitted to the server 100.

The server 100 may receive and acquire image information of the residential space from the user terminal 200, analyze the acquired image information, and recommend an interior suitable for the residential space.

The application used to provide the interior recommendation service may be an application built into the user terminal 200 or an application downloaded from an application distribution server and installed on the user terminal 200.

The user terminal 200 may refer to a communication terminal that can use an application in a wired or wireless communication environment, and may be, for example, a portable terminal. User terminal 200 may include any type of handheld computing device (e.g., PDA, email client, etc.), cell phone, or other type of computing or communication platform, but the present invention does not include It is not limited to this, and can be borrowed without limitation for terminals capable of mounting the application as described above.

Meanwhile, the communication network 300 serves to connect the server 100 and the user terminal 200. In other words, the communication network 300 refers to a communication network that provides a connection path so that the user terminal 200 can transmit and receive data after connecting to the server 100. The communication network 300 may be, for example, a wired network such as Local Area Networks (LANs), Wide Area Networks (WANs), Metropolitan Area Networks (MANs), or Integrated Service Digital Networks (ISDNs), or wireless LANs, CDMA, Bluetooth, or satellite communication. It may cover wireless networks such as, but the scope of the present invention is not limited thereto.

Figure 2 is a diagram showing the configuration of the server 100 according to an embodiment of the present invention.

Referring to FIG. 2, the server 100 according to an embodiment of the present invention includes a communication module 110, memory 120, processor 130, and database 140.

The communication module 110 provides a communication interface necessary to provide transmission and reception signals between the server 100 and the user terminal 200 in the form of packet data in conjunction with the communication network 300. Furthermore, the communication module 110 may receive a data request from the user terminal 200 and transmit data in response.

The communication module 110 may be a device that includes hardware and software necessary to transmit and receive signals such as control signals or data signals through wired or wireless connections with other network devices.

The memory 120 records a program for performing a method of providing an interior recommendation service. Additionally, it performs a function of temporarily or permanently storing data processed by the processor 130. Here, the memory 120 may include magnetic storage media or flash storage media, but the scope of the present invention is not limited thereto.

The processor 130 is a type of central processing unit that controls the entire process of providing interior recommendation services. Each step performed by the processor 130 will be described later with reference to FIGS. 4 to 11.

Here, the processor 130 may include all types of devices that can process data, such as a processor. Here, 'processor' may mean, for example, a data processing device built into hardware that has a physically structured circuit to perform a function expressed by code or instructions included in a program. Examples of data processing devices built into hardware like this include microprocessor, central processing unit (CPU), processor core, multiprocessor, and application-specific (ASIC). It may encompass processing devices such as integrated circuits (ICs) and FPGAs (field programmable gate arrays), but the scope of the present invention is not limited thereto.

The database 140 may store information related to the user, such as user preference information and user lifestyle information received from the user terminal 200, and information related to interior design such as furniture, carpets, curtains, lighting, and props. You can.

Figure 3 is a diagram showing the configuration of a user terminal 200 according to an embodiment of the present invention.

Referring to FIG. 3, the user terminal 200 according to an embodiment of the present invention includes a communication module 210, a memory 220, and a processor.

230, a display module 240, and a camera module 250.

In the description of the communication module 210, memory 220, and processor 230, description overlaps with the description of the communication module 110, memory 120, and processor 130 described above with reference to FIG. 2. will be omitted.

In detail, the communication module 210 provides a communication interface necessary to provide transmission and reception signals between the server 100 and the user terminal 200 in the form of packet data in conjunction with the communication network 300. Furthermore, the communication module 210 may transmit a data request to the server 100 and receive data in response.

The memory 220 records a program for performing a method of providing an interior recommendation service. Also, the processor

(230) performs the function of temporarily or permanently storing the data processed. At this time, the memory 120 and the program for performing the method for providing the interior recommendation service recorded in the memory 220 may be different for the terminal and the server.

The processor 230 is a type of central processing unit that controls the entire process of providing interior recommendation services. processor

230 may perform the process of providing the interior recommendation service on its own, but preferably, it may perform the process of providing the interior recommendation service through the server 100.

The display module 240 performs the function of displaying an application execution screen for providing interior recommendation services, and through the application, products such as furniture, carpets, curtains, lighting, and props that match the user's taste in relation to interior design. If they are recommended, a function to display them can be performed.

The camera module 250 is a device for photographing a user's residential space, and has a function of generating image information, video information, etc. about the area within the residential space.

According to one embodiment, the camera module 250 is implemented as a depth camera, so that image information captured in a residential space can be generated as a three-dimensional model.

Figure 4 is a flowchart showing a process for recommending furniture that can be placed in the remaining space according to an embodiment of the present invention. Referring to FIG. 4, first, in step S401, the server 100 creates a first image of a residential space created through photography of the user terminal 200.

Image information can be obtained.

For example, when any one of the various spaces included in the user's home, such as a room, living room, or bathroom, is photographed through the user terminal 200, the image information captured for the space is converted into first image information of the residential space. It can be obtained.

In step S402, the server 100 may analyze the first image information of the residential space.

In step S403, the server 100 may calculate the size of the residential space through the analysis result of the first image information.

For example, the server 100 may recognize the floor, wall, and ceiling areas of the residential space by analyzing the first image information of the residential space, and calculate the size for each of the recognized floor, wall, and ceiling areas. , the size of the residential space can be calculated. Additionally, the server 100 can receive the size of the residential space from the user terminal 200 and set the received value as the size of the residential space.

In addition, the server 100 can obtain a blueprint corresponding to the user address based on the user address, and when any space such as a room, living room, or bathroom is selected as the type of residential space, the size of the selected space is displayed on the blueprint. By checking the above, you can calculate the size of the living space.

In step S404, the server 100 can check whether any furniture is placed in the residential space through the analysis result of the first image information and recognize the first furniture placed in the residential space.

In step S405, the server 100 may calculate the size of the first furniture placed in the residential space.

In step S406, the server 100 may calculate the size of the first remaining space by subtracting the size of the first furniture from the size of the residential space.

For example, when only the first household is recognized in the residential space, the server 100 may calculate the size of the first remaining space by subtracting the size of the first household from the size of the residential space, and calculate the size of the first remaining space within the residential space. When the first and second households are recognized, the size of the first remaining space can be calculated by subtracting the sum of the sizes of the first and second households from the size of the residential space.

That is, the server 100 may recognize areas other than furniture within the residential space as remaining space and calculate the size of the first remaining space.

In step S407, the server 100 may select a second piece of furniture that can be placed in the first remaining space, based on the size of the first remaining space.

That is, the server 100 can be placed in the first remaining space. Furniture that is smaller in size than the first remaining space can be selected as the second furniture.

According to one embodiment, when selecting the second furniture, when a type of residential space is selected, the server 100 may generate a list of essential furniture required for the residential space according to the selected type.

For example, when the type of residential space is selected as living room, the server 100 creates a list including sofas, chairs, dining tables, etc. required for the living space according to the living room type, and divides the list into essential items required for the living space. It can be set as a furniture list.

The server 100 may calculate user preferences based on user preference information pre-registered for each household included in the essential household list.

For example, the server 100 can calculate user preferences for each piece of furniture such as a sofa, chair, and dining table included in the essential furniture list, as well as user preference information, user lifestyle information, user interest information, and user lifestyle information. User preference can be calculated using, etc.

According to one embodiment, user preference information may include information related to the user's favorite colors, shapes, patterns, materials, etc., and user lifestyle information may include the user's hobbies, number of family members, marital status, and whether there are any children in the family. User interest information may include information related to other users' accounts, interior design websites, brands, etc. registered by the user because they are interested in it. User lifestyle information may include frequently used products, commuting to and from work, etc. It can include information related to time of day, time spent at home, sleep time, etc.

The server 100 may select as the second household a household that does not overlap with the first household and has the highest user preference score from the list of required households.

For example, a sofa is recognized as the first furniture in the user's living space, the type of living space is selected as living room, and the user preference score is calculated for each sofa, chair, and dining table required for the living space, the sofa Except for

The chair, which is the furniture with the highest preference score among the districts, can be selected as the second furniture.

According to one embodiment, when selecting a second household, the server 100 sets and registers the size of the minimum secured space in advance, and then subtracts the size of the minimum secured space from the size of the first remaining space to determine the second remaining space. The size of the space can be calculated, and based on the size of the second remaining space, the second furniture that can be placed in the second remaining space can be selected. That is, the server 100 secures the minimum space according to user settings. If the size of the space is set wide, the size of the second remaining space is reduced, so only small furniture can be selected as the second furniture that can be placed in the second remaining space, and the blank area where furniture is not placed will be set wide. You can.

In step S408, the server 100 may provide recommendation information about the second household to the user terminal 200.

That is, the server 100 may select the second furniture as furniture that can be placed in the first remaining space and provide recommendation information about the second furniture to the user terminal 200.

In step S409, when the location where the second furniture will be placed within the first remaining space is selected, the server 100 creates a second image of the residential space synthesized by adding the virtual object of the second furniture to the placement location of the second furniture. Information can be generated.

That is, when the placement position of the second furniture in the user's living space is selected through a recommendation for the second furniture, the server 100 synthesizes the second furniture to be displayed in augmented reality at the placement position of the second furniture, Second image information of the residential space can be generated.

In step S410, the server 100 may provide second image information showing the second furniture placed in the residential space to the user terminal 200.

That is, the server 100 selects and recommends second furniture that can be placed in the remaining space based on the first image information generated through photography of the user terminal 200, and adds the second furniture so that it is displayed. In order to generate second image information and provide a service that allows confirmation in advance that second furniture is placed in the remaining space, the second image information may be provided to the user terminal 200.

Figure 5 is a flowchart showing the process of recommending furniture to be added through existing furniture according to an embodiment of the present invention.

In describing FIG. 5, descriptions that overlap with those described above with reference to FIG. 4 will be omitted.

Referring to FIG. 5 , first, in step S501, the server 100 may obtain first image information of a residential space created through photography by the user terminal 200.

In step S502, the server 100 analyzes the first image information of the residential space of the user terminal 200 and recognizes the first furniture placed in the residential space through the analysis result of the first image information, You can check the type of first furniture recognized.

In step S503, the server 100 may generate a list of related furniture used in connection with the first household based on the type of the first household.

For example, if the first type of furniture is confirmed to be a sofa, the server 100 may generate a sofa-related furniture list including furniture such as chairs and tables used in conjunction with the sofa.

In step S504, the server 100 may calculate user preferences based on user preference information pre-registered for each household included in the related household list.

When calculating user preferences for each household included in the related household list, the server 100 may calculate user preferences using user taste information, user lifestyle information, user interest information, and user lifestyle information. In step S505, the server 100 has the highest user preference score without overlapping with the first household in the list of related households.

A high second household can be selected.

In step S506, the server 100 may provide recommendation information about the second household to the user terminal 200.

According to one embodiment, in providing recommendation information about the second household, the server 100 may analyze the first image information of the residential space and check the empty space around the first household.

For example, the server 100 may check whether there is a blank space in the left or right area of the first furniture placed in the residential space and calculate the size of the blank space.

If the size of the empty space is confirmed to be larger than the size of the second furniture, the server 100 determines that it is possible to place the second furniture around the first furniture, and sends recommendation information about the second furniture to the user terminal (200). ). For example, if the first furniture is a dining table and the second furniture is a chair, the server 100 checks whether the size of the empty space next to the table is larger than the size of the chair, If it is determined that placement is possible, recommended information about the chair can be provided to the user terminal 200.

If the size of the empty space is confirmed to be smaller than the size of the second furniture, the server 100 may provide a warning message to the user terminal 200 indicating that placement of the second furniture is impossible due to lack of space. .

In step S507, when the location where the second furniture will be placed in the empty space is selected, the server 100 creates a second image of the residential space synthesized by adding the virtual object of the second furniture to the location of the selected second furniture. Information can be generated.

That is, when the placement position of the second furniture is selected within the empty space around the first furniture through recommendation of the second furniture, the server 100 displays the second furniture in augmented reality at the placement position of the second furniture. By compositing to be displayed, second image information of the residential space can be generated.

In step S508, the server 100 may provide second image information showing the second furniture placed in the residential space to the user terminal 200.

That is, the server 100 selects and recommends a second furniture that can be additionally placed through the existing first furniture, based on the first image information generated through photography of the user terminal 200, and recommends the second furniture that can be additionally placed. In order to generate second image information by adding two households to be displayed, and to provide a service that allows confirmation in advance that the second furniture is placed together with the first furniture in the residential space, the second image information is sent to the user terminal (200) ) can be provided.

Figure 6 is a flowchart showing the process of resetting the arrangement position of furniture in recommending furniture to be added through existing furniture according to an embodiment of the present invention.

In describing FIG. 6, descriptions that overlap with those described above with reference to FIGS. 4 and 5 will be omitted.

Referring to FIG. 6, after providing the second image information showing the second furniture placed in the residential space to the user terminal 200, in step S601, the server 100 may analyze the second image information of the residential space. there is.

In step S602, the server 100 can confirm the arrangement position of each household arranged in the residential space through the analysis result of the second image information.

For example, the server 100 may check the arrangement position of the first furniture, the arrangement position of the second furniture, etc. within the residential space. In step S603, the server 100 checks the type of each furniture identified in the residential space, and calculates the frequency of use of the first furniture according to the type of the first furniture, based on pre-registered user lifestyle information, The frequency of use of the second furniture can be calculated depending on the type of second furniture.

For example, when the first furniture is identified as a sofa, the server 100 calculates the frequency of use of the sofa through the user's lifestyle habits, and when the second furniture is identified as a dining table, the server 100 calculates the frequency of use of the dining table through the user's lifestyle habits. It can be calculated.

In step S604, the server 100 may predict the user's movement pattern based on the arrangement position of the first furniture, the arrangement position of the second furniture, the frequency of use of the first furniture, and the frequency of use of the second furniture.

That is, the server 100 predicts how much the first furniture placed in a specific area within the residential space is used and how much the second furniture placed in an area other than the area where the first furniture is placed is used, and Through this, user movement patterns can be predicted.

For example, if the server 100 determines that the frequency of use of the first household is high and the frequency of use of the second household is low, the server 100 determines the movement route used only by the first household and the movement route used by the second household after the first household has been used. , the user movement pattern can be predicted by using the movement route of using the first furniture, then using the second furniture, and then using the first furniture again.

In step S605, the server 100 may analyze the user's movement pattern and determine whether it is necessary to change the arrangement position of the furniture in the residential space.

For example, if the server 100 determines that the first furniture is placed inside the room and that the frequency of use of the first furniture is high and that there is a lot of movement to the inside of the room to use the first furniture, the server 100 determines that the first furniture is placed inside the room. It can be judged that a change in placement location is necessary.

In addition, if the server 100 determines that the second furniture is placed near the entrance door and that the frequency of use of the second furniture is low and that many movement lines pass by without using the second furniture, the server 100 changes the arrangement position of the second furniture. It can be judged that this is necessary.

As a result of the determination in step S605, if it is determined that a change in the arrangement position of at least one of the first and second households is necessary, in step S606, the server 100 configures the first and second households to optimize the user movement pattern. You can reset the placement position for furniture.

For example, if the server 100 determines that the first furniture is placed inside the room and that the frequency of use of the first furniture is high and that there is a lot of movement to the inside of the room to use the first furniture, the server 100 determines that the first furniture is placed inside the room. It can be reset by changing the placement location toward the door.

In addition, if the server 100 determines that the second furniture is placed near the entrance door and that the frequency of use of the second furniture is low and that many movement lines pass by without using the second furniture, the server 100 determines the placement location of the second furniture. You can reset it by changing it inside.

As a result of the determination in step S605, if it is determined that there is no need to change the arrangement positions for the first and second households, the server 100 returns to step S601 and re-acquires the second image information of the residential space. It can be analyzed.

In step S607, the server 100 may reset the arrangement positions of the first and second households and generate third image information of the residential space.

That is, the server 100 synthesizes the first and second furniture, whose arrangement positions have been reset to optimize the user's movement pattern within the user's residential space, to be displayed in augmented reality, and provides the third image information of the residential space. can be created.

In step S608, the server 100 may provide third image information in which the arrangement positions of the first and second furniture are reset to the user terminal 200.

That is, the server 100 selects and recommends a second furniture that can be additionally placed through the existing first furniture, based on the first image information generated through photography of the user terminal 200, and recommends the second furniture that can be additionally placed. After creating second image information by adding 2 furniture to be displayed, based on the second image information, check whether the placement positions of the first and second furniture are optimal, change them to the optimal location, and recommend it. In order to create third image information by adding furniture whose arrangement positions have been reset to be newly displayed, and to provide a service that allows users to check in advance that the arrangement positions of the first and second furniture in the residential space have changed, the third image information Image information may be provided to the user terminal 200.

Figure 7 is a flowchart showing a process for recommending a change in the position of existing furniture according to an embodiment of the present invention. In describing FIG. 7, descriptions that overlap with those described above with reference to FIGS. 4 to 6 will be omitted.

Referring to FIG. 7 , first, in step S701, the server 100 may obtain first image information of a residential space created through photography by the user terminal 200.

In step S702, the server 100 may analyze the first image information of the residential space.

In step S703, the server 100 may recognize a plurality of furniture arranged in the residential space through the analysis result of the first image information.

For example, the server 100 may recognize first and second furniture placed in a residential space.

In step S704, the server 100 may check the arrangement position of the first furniture and the arrangement position of the second furniture within the residential space.

In step S705, the server 100 may determine whether a change in the arrangement position of at least one of the first furniture and the second furniture is necessary based on the arrangement position of the first furniture and the arrangement position of the second furniture. .

According to one embodiment, in determining whether a change in the placement location is necessary, the server 100 calculates the frequency of use of the first furniture according to the type of the first furniture, based on pre-registered user lifestyle information. And, the frequency of use of the second furniture can be calculated depending on the type of the second furniture.

The server 100 may predict the user's movement pattern based on the arrangement position of the first furniture, the arrangement position of the second furniture, the frequency of use of the first furniture, and the frequency of use of the second furniture.

The server 100 may analyze the user's movement pattern and determine whether it is necessary to change the arrangement location of at least one of the first and second households.

According to one embodiment, in determining whether a change in the placement location is necessary, the server 100 may analyze the usage patterns of the user group using the first and second households.

For example, households may be grouped according to users who use them, and in particular, users who use multiple households together may be grouped. At this time, the server 100 may analyze the usage patterns of the user group that uses the first household and the second household together.

As a result of analyzing the usage patterns of the user group using the first household and the second household, the server 100 determines that the number of times the second household has been used after using the first household is more than the standard number, The separation distance between the placement location and the placement location of the second furniture can be calculated.

For example, if the server 100 determines that the number of times the second furniture has been used after the use of the first furniture is 20 and the standard number of times is set to 10, the number of times the second furniture has been used after the use of the first furniture Since the number is more than the standard number, it is judged that there is a high possibility that the first and second households will be used consecutively, and in order to place the second furniture in an area adjacent to the first furniture, the placement location of the first furniture and that of the second furniture are determined. The separation distance between placement locations can be calculated.

The server 100 compares the separation distance between the arrangement position of the first furniture and the arrangement position of the second furniture with a reference distance to determine whether a change in the arrangement position for at least one of the first furniture and the second furniture is necessary. You can.

For example, the server 100 has determined that there is a high possibility of using the first and second households in succession, and if it is confirmed that the first and second households are located further apart than the reference distance, the reference distance The arrangement position of at least one of the first and second households may be reset so that both the first and second households are placed within the unit.

As a result of the determination in step S705, if it is determined that a change in the arrangement position of at least one of the first and second households is necessary, in step S706, the server 100 changes the arrangement positions of the first and second households. It can be reconfigured to optimize within your living space.

For example, the server 100 can obtain reference information for the interior from an external device, and through the information, the sofa is placed against the wall and the table is placed in front of the sofa, which is the living space. It can be seen that this is the optimal location for user convenience. At this time, when the sofa is placed away from the wall and the table is placed in front of the sofa, the server 100 repositions the sofa so that it is placed in contact with the wall, and positions the server so that the table is placed in front of the sofa. It can be reset.

In resetting the arrangement position of the furniture so that the arrangement position is optimized, the server 100 resets the arrangement position of the furniture in a user-customized manner using user taste information, user lifestyle information, user interest information, user lifestyle information, etc. can do.

As a result of the determination in step S705, if it is determined that there is no need to change the arrangement positions for the first and second households, the server 100 returns to step S701 and acquires the first image information of the residential space. It can be analyzed.

In step S707, the server 100 may reset the arrangement positions of the first and second households and generate second image information of the residential space.

According to one embodiment, when generating the second image information, if it is determined that the furniture arrangement position needs to be changed, the server 100 resets the arrangement positions for the first and second furniture so that the user movement pattern is optimized. Thus, second image information of the residential space can be generated.

According to one embodiment, when generating the second image information, if it is determined that the furniture arrangement position needs to be changed, the server 100 arranges the first furniture and the second furniture within a reference distance, 2 By resetting the arrangement positions for the furniture, second image information of the residential space can be generated.

That is, the server 100 synthesizes the first furniture and the second furniture whose arrangement positions have been reset to optimize the arrangement of the furniture in the user's residential space, so that they are displayed in augmented reality, and generate second image information of the residential space. You can.

In step S708, the server 100 may provide the user terminal 200 with second image information in which the arrangement positions of the first and second furniture are reset.

The server 100 may provide the second image information and additionally provide the user terminal 200 with a recommendation message regarding a change in the location of furniture placed in the residential space.

That is, the server 100 determines whether the arrangement positions of the first and second furniture are optimal based on the first image information generated through photography by the user terminal 200, and changes them to the optimal positions. To recommend and add furniture whose placement positions have been reset to be newly displayed to create second image information, and to provide a service that allows you to check in advance that the placement positions of the first and second furniture in the residential space have changed. , While providing the second image information to the user terminal 200, a recommendation message regarding a change in the location of the furniture can also be additionally provided.

Figure 8 is a flowchart showing a process for recommending replacement of furniture in recommending a change in the position of existing furniture according to an embodiment of the present invention.

In describing FIG. 8, descriptions that overlap with those described above with reference to FIGS. 4 to 7 will be omitted.

Referring to FIG. 8 , first, in step S801, the server 100 may obtain first image information of a residential space created through photography by the user terminal 200.

In step S802, the server 100 may analyze the first image information of the residential space.

In step S803, the server 100 may recognize the first and second furniture arranged in the residential space through the analysis result of the first image information.

In step S804, the server 100 may select a third household to be used in conjunction with the first household based on the type of the first household.

For example, if the type of first furniture is confirmed to be a sofa, the server 100 may select a table used in conjunction with the sofa as the third furniture.

In step S805, the server 100 may analyze usage patterns of user groups that use the first, second, and third households together.

For example, households may be grouped according to users who use them, and in particular, users who use multiple households together may be grouped. At this time, the server 100 may analyze usage patterns of user groups that use the first, second, and third households together.

In step S806, the server 100 may determine whether placement of the third household is necessary based on the analysis results of the usage patterns of the user group that uses the first, second, and third households together.

For example, the server 100 determines whether placement of the third furniture is necessary by comparing the number of times the third furniture has been used after the first furniture and the number of times the second furniture has been used after the first furniture. If it is confirmed that the number of times the third piece of furniture has been used after the first piece of furniture is greater than the number of times the second piece of furniture has been used after the first piece of furniture, it may be determined that placement of the third piece of furniture in the residential space is necessary. You can.

That is, if the server 100 predicts that the third furniture that is not placed will be used more than the second furniture that is already placed in the residential space, it may determine that placement of the third furniture is necessary.

If, as a result of the determination in step S806, it is determined that placement of a third household is necessary, in step S807, the server 100 may check whether there is remaining space in the residential space where a third household can be additionally placed. .

As a result of the determination in step S806, if it is determined that placement of the third furniture is not necessary, the server 100 returns to step S801 and can re-acquire and analyze the first image information of the residential space.

As a result of the determination in step S807, if it is confirmed that there is a remaining space in the residential space where a third household can be additionally placed, in step S808, the server 100 adds the virtual object of the third household to the remaining space and synthesizes it. Third image information of a residential space can be generated.

As a result of the determination in step S807, if it is confirmed that there is no remaining space in the residential space where a third household can be additionally placed, in step S809, the server 100 installs the virtual object of the third household at the placement location of the second household. By adding , third image information of the synthesized residential space can be generated.

That is, the server 100 newly arranges the third furniture in the remaining space within the user's residential space, or places the third furniture in place of the second furniture, and synthesizes the placed third furniture so that it is displayed in augmented reality. , third image information of the residential space can be generated.

In step S810, the server 100 provides third image information to the user terminal 200 and, when a third furniture is newly placed in the remaining space, a recommendation message for adding the third furniture placed in the residential space. can be additionally provided to the user terminal 200, and when a third furniture is placed in place of the second furniture, a recommendation message for replacement of the furniture placed in the residential space is additionally sent to the user terminal 200. can be provided.

Figure 9 is a flowchart showing a process for recommending a user-customized interior according to an embodiment of the present invention.

In describing FIG. 9, descriptions that overlap with those described above with reference to FIGS. 4 to 8 will be omitted.

Referring to FIG. 9 , first, in step S901, the server 100 may obtain first image information of the residential space generated through photography by the user terminal 200.

In step S902, the server 100 may analyze the first image information of the residential space.

In step S903, the server 100 may recognize the floor area, wall area, and ceiling area within the residential space through the analysis result of the first image information.

In step S904, the server 100 may check the color and material of each of the floor area, wall area, and ceiling area.

In step S905, the server 100 may determine whether the color and material of each of the floor area, wall area, and ceiling area matches the user's taste, based on pre-registered user taste information.

As a result of the determination in step S905, if it is determined that each area matches the user's preference, the server 100 returns to step S901, and the server 100 may re-acquire and analyze the first image information of the residential space.

As a result of the determination in step S905, if it is determined that some of the floor area, wall area, and ceiling area do not match the user's taste, in step S906, the server 100 selects the area determined to not match the user's taste. By checking, you can change the color and material of the area according to the user's preference.

For example, if the color of the floor area is confirmed to be white and the user's preference is confirmed to be gray, the server 100 may change the color of the floor area from white to gray.

In step S907, the server 100 may generate second image information of the residential space by reflecting changes in color and material according to the user's preference.

That is, the server 100 can change the color and material according to the user's preference, composite the changed area to be displayed in augmented reality, and generate second image information of the residential space.

In step S908, the server 100 may provide second image information to the user terminal 200 and additionally provide a recommendation message for floor coverings, wallpaper, and ceiling sheets in the changed area according to the user's taste.

For example, when the floor area is changed according to the user's preference, the server 100 may provide second image information with the changed floor area and additionally provide a recommendation message about the floor covering.

Figure 10 is a flow chart showing the process of recommending carpets, curtains, and lighting according to the user's taste in recommending a user-customized interior.

In describing FIG. 10, descriptions that overlap with those described above with reference to FIGS. 4 to 9 will be omitted. Referring to FIG. 10, first, in step S1001, the server 100 creates a picture of the residential space created through photography of the user terminal 200.

1 Image information can be obtained.

In step S1002, the server 100 may analyze the first image information of the residential space.

In step S1003, the server 100 may recognize the residential space by area through the analysis result of the first image information, for example, recognize the floor area, wall area, and ceiling area within the residential space. .

In step S1004, the server 100 may check whether there is a carpet in the floor area, check whether there is a curtain in the wall area, and check whether there is a light in the ceiling area.

As a result of the determination in step S1004, if it is confirmed that there is a carpet, curtain, and lighting, in step S1005, the server 100 may determine whether the carpet, curtain, and lighting match the user's taste.

Specifically, if it is confirmed that there is a carpet in the floor area, the server 100 determines whether the color and shape of the confirmed carpet matches the user's taste, and if it is confirmed that there is a curtain in the wall area, the server 100 determines whether the confirmed curtain is present in the wall area. It is determined whether the color and shape of matches the user's taste, and if it is confirmed that there is lighting in the ceiling area, it can be confirmed whether the color and shape of the confirmed light matches the user's taste.

As a result of the determination in step S1005, if it is determined that the carpet, curtain, and lighting match the user's taste, the process returns to step S1001, and the server 100 may re-acquire and analyze the first image information of the residential space.

As a result of the determination in step S1005, if it is confirmed that there is at least one of the carpet, curtain, and lighting that does not match the user's taste, in step S1006, the server 100 selects the carpet, curtain, and lighting that are confirmed to not match the user's taste. By changing the shape according to the user's preference, third image information of the residential space can be created.

If, as a result of the determination in step S1004, it is determined that there are no carpets, curtains, or lights, in step S1007, the server 100 may check user groups grouped according to user tastes and lifestyles.

For example, multiple users may be grouped using user preference information, user lifestyle information, user interest information, user lifestyle information, etc., and the server 100 may confirm the user group to which the user belongs.

In step S1008, the server 100 can check the carpets, curtains, and lighting used by other users in the user group to which the user belongs. At this time, the server 100 can select and check carpets, curtains, and lighting used by many users in the user group.

Specifically, if it is determined that there is no carpet in the floor area, the server 100 checks the carpet placed in the residential space of other users within the user group grouped according to user tastes and lifestyles, and curtains in the wall area. If it is confirmed that there are no lights, check the curtains placed in the living spaces of other users within the user group. If it is confirmed that there are no lights in the ceiling area, check the lights placed in the living spaces of other users within the user group. You can.

In step S1009, the server 100 may generate third image information by adding carpets, curtains, and lights placed in another user's living space.

Specifically, the server 100 generates third image information of the residential space synthesized by adding the virtual object of the carpet placed in the residential space of another user to the floor area, and the virtual object of the curtain placed in the residential space of another user is generated. Third image information of a composite residential space can be created by adding an object to the wall area, and third image information of a composite residential space can be created by adding a virtual object of lighting placed in another user's residential space to the ceiling area. You can.

In step S1010, the server 100 may provide the user terminal 200 with third image information generated by changing the carpet, curtain, and lighting, or third image information generated by adding the carpet, curtain, and lighting.

The server 100 provides third image information generated through changes in carpets, curtains, and lighting to the user terminal 200, and additionally provides recommendation messages about carpets, curtains, and lighting changed according to the user's taste. You can.

The server 100 provides third image information created through the addition of carpets, curtains, and lights to the user terminal 200, and provides recommendation messages about the added carpets, curtains, and lights according to the user's taste and lifestyle. Additional information may be provided.

Figure 11 is a flowchart showing the process of recommending interior accessories suitable for a residential space when recommending a user-customized interior.

In describing FIG. 11, descriptions that overlap with those described above with reference to FIGS. 4 to 10 will be omitted. Referring to FIG. 11, first, in step S1101, the server 100 creates a picture of the residential space created through photography of the user terminal 200.

1 Image information can be obtained.

In step S1102, the server 100 may analyze the first image information of the residential space.

In step S1103, the server 100 may recognize the residential space by area through the analysis result of the first image information, for example, recognize the floor area, wall area, and ceiling area within the residential space. .

In step S1104, the server 100 can check the color and material of each of the floor area, wall area, and ceiling area. In step S1105, the server 100 analyzes the first image information of the residential space and determines the color and material of each of the floor area, wall area, and ceiling area. The furniture that is placed can be recognized.

In step S1106, the server 100 can check the color and material of the furniture.

In step S1107, the server 100 may select interior accessories suitable for placement in the residential space based on the color and material of the furniture and the colors and materials of the floor area, wall area, and ceiling area, respectively.

In other words, the server 100 compares the colors and materials identified in each area of the residential space with the colors and materials of the furniture placed in the residential space, and selects interior accessories that are judged to be suitable for additional placement in the residential space. You can.

In step S1108, the server 100 may check whether there is remaining space in the residential space where interior accessories can be additionally placed.

As a result of the determination in step S1108, if it is confirmed that additional arrangement of interior accessories is possible on the remaining space, in step S1109, the server 100 adds virtual objects of the interior accessories to the remaining space to create a composite residential space. 3 Image information can be created.

If, as a result of the determination in step S1108, it is confirmed that additional arrangement of the interior props is not possible in the remaining space, the server 100 may reselect the interior props in step S1107.

In step S1110, the server 100 may provide third image information of the residential space to the user terminal 200 and additionally provide a recommendation message for interior accessories.

FIG. 12 is a diagram illustrating a process of generating second image information based on first image information of a residential space generated through photography by a user terminal according to an embodiment of the present invention.

Referring to FIG. 12, the user terminal 200 may capture a residential space where the first furniture 1201 is placed and generate first image information of the residential space.

The server 100 can recognize the first furniture 1201 by analyzing the first image information of the residential space, check the size of the remaining space where the first furniture 1201 is not placed, and place the first furniture 1201 in the remaining space. An available second household (1202) can be selected.

The server 100 may select the first furniture 1201 and subsequently the most frequently used furniture as the second furniture 1202, and arrange the second furniture 1202 so that it is placed in an area adjacent to the first furniture 1201. You can set the location.

The server 100 generates second image information by adding the second furniture 1202 to be displayed in the remaining space, and provides a service to confirm in advance that the second furniture 1202 is placed, by adding the second image information to the remaining space. By providing information to the user terminal 200, the second furniture 1202 can be displayed in augmented reality.

The description of the present invention described above is for illustrative purposes, and those skilled in the art can understand that the present invention can be easily modified into other specific forms without changing the technical idea or essential features of the present invention. There will be. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. For example, each component described as single may be implemented in a distributed manner, and similarly, components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the patent claims described below, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention.

Claims (4)

A method of recommending furniture to be added through existing furniture, performed by a server, comprising: acquiring first image information of a residential space created through photography by a user terminal;
Analyzing first image information of the residential space, recognizing first furniture arranged in the residential space, and confirming the type of the first furniture;
generating a list of related furniture used in connection with the first furniture through the type of the first furniture;
calculating user preferences based on user preference information pre-registered for each household included in the related household list;
selecting a second household from the list of related households that does not overlap with the first household and has the highest user preference score; and
A system and method for providing furniture recommendations reflecting user preferences, including providing recommendation information about the second furniture to the user terminal. According to paragraph 1,
The step of providing recommendation information for the second household is,
Analyzing first image information of the residential space to identify an empty space around the first furniture; and
If the size of the empty space is confirmed to be larger than the size of the second furniture, it is determined that the second furniture can be placed around the first furniture, and recommendation information about the second furniture is sent to the user terminal. A system and method for providing furniture recommendations that reflect user tastes, including the step of providing them. According to paragraph 2,
When a location in the empty space where the second furniture will be placed is selected, generating second image information of the residential space synthesized by adding a virtual object of the second furniture to the location of the second furniture; and
A system and method for providing furniture recommendations reflecting user preferences, further comprising providing the second image information showing the second furniture arranged in the residential space to the user terminal. According to paragraph 3,
Analyzing second image information of the residential space to confirm the arrangement position of the first furniture and the arrangement position of the second furniture within the residential space;
Based on pre-registered user lifestyle information, calculating the frequency of use of the first furniture according to the type of the first furniture, and calculating the frequency of use of the second furniture according to the type of the second furniture;
Predicting a user movement pattern based on the arrangement position of the first furniture, the arrangement position of the second furniture, the frequency of use of the first furniture, and the frequency of use of the second furniture;
Analyzing the user's movement pattern to determine whether a change in the arrangement position of at least one of the first furniture and the second furniture is necessary;
As a result of the determination, if it is determined that a change in the arrangement position is necessary, resetting the arrangement positions for the first furniture and the second furniture to optimize the user movement pattern, and generating third image information of the residential space. ; and
A system and method for providing furniture recommendations reflecting user preferences, further comprising providing the third image information in which the arrangement positions of the first furniture and the second furniture are reset to the user terminal.