KR20230153165A - Home Furnishing O2O service platform system based on virtual simulation using XR technologies and apparatus and method for the same - Google Patents

Abstract

A home furnishing O2O service platform system based on virtual simulation using XR technology and an apparatus and method therefor are disclosed. The home furnishing O2O service providing device based on virtual simulation using XR technology according to the present invention is a home furnishing O2O service providing device that provides virtual simulation of the interior target space by communicating with at least one user terminal and business operator terminal. , a data collection module that collects user data from the user terminal and interior data from the business operator terminal, extracts features of the user data and maps the extracted features to at least one preset preference class to generate user preference profile information; , a recommendation module that generates recommended interior product information based on user preference profile information, provides recommended interior product information to the user terminal, selects interior products to be applied to the interior target space from the user terminal, and applies the selected interior product to the interior. Provides a virtual simulation provision module that provides virtual simulation by applying it to the virtual space of the target space and at least one quotation list for interior products applied to the virtual space, and provides the corresponding quotation when one of the quotation lists is selected from the user terminal. It includes an O2O service provision platform module that mediates transaction conclusion with at least one operator terminal. Therefore, according to the present invention described above, it is possible to customize an interior design that suits the user's taste, such as wallpaper, windows, joints, furniture, and props, inside a home modeled with a 3D model, and calculate a construction estimate for the customized interior design. We can provide an O2O service that brokers construction with construction companies.

Description

Home Furnishing O2O service platform system based on virtual simulation using XR technologies and apparatus and method for the same}

The present invention relates to a home furnishing O2O service platform system based on virtual simulation using XR technology and an apparatus and method therefor. More specifically, it relates to providing an interior O20 service by providing a virtual simulation of an interior target space. This relates to a home furnishing O2O service platform system based on virtual simulation using XR technology and devices and methods for the same.

XR (eXtended Reality) technology, which collectively refers to VR, AR, and MR, is a technology that applies realistic technology to digital content and provides information through stimulation of the human five senses, enabling a life-like experience.

Meanwhile, while efforts are being made to accelerate digital transformation in all industries due to the COVID-19 incident, information has announced a 'Virtual Convergence Economy Development Strategy' centered on XR technology to become one of the world's top five virtual convergence economy leaders. .

These XR technologies enable a shift in the way people live, work, and communicate from existing physical spaces to non-face-to-face XR spaces. As a result, within the XR space, users can have a realistic immersive experience similar to the experience in existing physical spaces through multi-functional interactions such as touching and manipulating 3D objects.

Meanwhile, the architecture and interior industry has traditionally been recognized as a low-tech industry, but recently, XR technology has been used to create new added value and seek to survive in the industrial ecosystem.

Therefore, there is a need to develop technology that provides interior O2O services based on virtual simulation using such XR technology.

Korean Patent No. 10-1926701

One aspect of the present invention provides recommended interior information based on user preference profile information generated from user data, provides a virtual simulation by applying interior products to be applied to the target space among the recommended interior information to a virtual space, and provides a virtual simulation of the applied interior. The purpose is to provide a home furnishing O2O service platform system based on virtual simulation using XR technology that provides quotations for products and brokers transactions with business terminals, as well as devices and methods for the same.

A home furnishing O2O service providing device based on virtual simulation using XR technology according to an embodiment of the present invention is a home furnishing service that provides virtual simulation of the interior target space by communicating with at least one user terminal and business operator terminal. An O2O service providing device, comprising a data collection module that collects user data from the user terminal and interior data from the business operator terminal, extracts features of the user data, and maps the extracted features to at least one preset preference class. A recommendation module that generates user preference profile information and generates recommended interior product information based on the user preference profile information, provides the recommended interior product information to the user terminal, and applies it to the interior target space from the user terminal. Provides a virtual simulation providing module that selects an interior product to be used, provides a virtual simulation by applying the selected interior product to the virtual space of the interior target space, and provides a list of at least one quote for the interior product applied to the virtual space; , When one of the quotation lists is selected from the user terminal, it includes an O2O service providing platform module that mediates transaction conclusion with at least one business terminal providing the corresponding quotation.

Meanwhile, the recommendation module maps the characteristics of the user data to each preference class according to a preset similarity measurement algorithm, and assigns a weight to the preference class according to the mapping result to generate the user preference profile information. A profile information generator, an interior data classification unit that maps the interior data to each preference class according to the preset similarity measurement algorithm and classifies the interior data, and inputs the user preference profile information into a preset interior recommendation model to classify the interior data into each preference class. It may include a recommended interior product information generation unit that outputs the recommended interior product information from the classified interior data.

In addition, the virtual simulation providing module includes a virtual space generator that receives a floor plan for the interior target space from the user terminal and converts the floor plan into a 3D drawing in real time to generate a virtual space for the interior target space, the user By providing a virtual simulation authoring tool screen to the terminal, an interior product to be applied to the interior target space and a location to apply the interior product are selected from among the recommended interior product information, and the selected interior product and location are selected in the virtual space. It may include an applied virtual simulation providing unit and an output unit combining and outputting AR content data to the virtual space, or outputting a VR image for the virtual space to output a realistic virtual simulation.

In addition, the O2O service provision platform module includes an automatic quote calculation unit that provides at least one quote list containing the total cost and detailed cost information for interior products applied to the virtual space based on the interior data, and the user terminal. When one quotation from the quotation list is selected, a business information provider provides information on at least one business operator capable of providing services at the cost of the quote, and when a business operator with whom to conclude a transaction is selected from the user terminal based on the business information, It may include a transaction brokerage unit that mediates the conclusion of a transaction with the corresponding business operator terminal, and a virtual interior design sharing unit that shares the results of the virtual interior design for the interior target space when the transaction is concluded.

In addition, the business information includes specialty information, regional information, and portfolio information, and the business information provider may provide the business information for each request area upon receiving the request area information from the user terminal.

A method of providing a home furnishing O2O service based on virtual simulation using XR technology according to another embodiment of the present invention is performed in a home furnishing O2O service providing device that communicates with at least one user terminal and an operator terminal, and is performed in an interior target space. A method of providing a home furnishing O2O service based on virtual simulation using XR technology, which provides a virtual simulation for, collecting user data from the user terminal and collecting interior data from the business operator terminal, characteristics of the user data Extracting and mapping the extracted features to at least one preset preference class to generate user preference profile information, and generating recommended interior product information based on the user preference profile information, the recommended interior product information providing a user terminal to select an interior product to be applied to the interior target space from the user terminal, applying the selected interior product to a virtual space of the interior target space to provide a virtual simulation, and providing a virtual simulation to the virtual space. Providing at least one quotation list for the applied interior product, and when one of the quotation lists is selected from the user terminal, brokering a transaction with at least one business terminal providing the corresponding quotation.

Meanwhile, the step of generating recommended interior product information maps the characteristics of the user data to each preference class according to a preset similarity measurement algorithm, and assigns a weight to the preference class according to the mapped result to create the user preference profile. Generating information, classifying the interior data by mapping the interior data to each preference class according to the preset similarity measurement algorithm, and inputting the user preference profile information into a preset interior recommendation model to classify the interior data. It may include outputting the recommended interior product information from interior data.

In addition, the step of brokering a transaction with the business operator terminal includes providing a list of at least one quote containing the total cost and detailed cost information for interior products applied to the virtual space based on the interior data,

When one quotation from the quotation list is selected from the user terminal, providing information on at least one business operator capable of providing a service at the cost of the quotation, selecting a business operator to conclude a transaction from the user terminal based on the business information. If so, it may include a step of brokering a transaction with the corresponding business operator terminal and sharing a virtual interior design result for the interior target space when the transaction is concluded.

A home furnishing O2O service platform system based on virtual simulation using XR technology according to another embodiment of the present invention includes at least one user terminal transmitting user data and at least one transmitting interior data including interior product information. Collect the above operator terminal and the user data and interior data, extract characteristics of the user data and map them to at least one preset preference class to generate user preference profile information, and recommend interior design based on the user preference profile information. A home furnishing O2O service providing device that generates product information and provides it to the user terminal, wherein the home furnishing O2O service device selects an interior product to be applied to the interior target space from the user terminal. Provides a virtual simulation by applying the received interior product to the virtual space of the interior target space, provides a list of at least one quotation for the interior product applied to the virtual space, and when one of the quotation list is selected from the user terminal It mediates the conclusion of a transaction with at least one business terminal that provides the corresponding quotation.

Meanwhile, the home furnishing O2O service providing device provides at least one quotation list containing the total cost and detailed cost information for interior products applied to the virtual space based on the interior data, and provides a quotation list from the user terminal. When one of the quotations is selected, information on at least one business operator capable of providing services at the cost of the quote is provided, and when a business operator to conclude a transaction is selected from the user terminal based on the business information, contact with the terminal side of the business operator is provided. The transaction may be concluded, and once the transaction is concluded, the virtual interior design results for the interior target space may be shared.

According to the present invention described above, it is possible to customize an interior design that suits the user's taste, such as wallpaper, windows, joints, furniture, and props, inside a home modeled with a 3D model, and calculate a construction estimate for the customized interior design to provide a construction company. We can provide an O2O service that mediates construction.

Additionally, since recommended interior product information is provided based on the user's preference profile, there is an advantage in being able to recommend personalized interior products based on user preference analysis.

Additionally, since virtual simulation is provided in an XR environment such as AR/VR, there is an advantage in providing interior services in a more immersive manner.

Figure 1 is a diagram illustrating a home furnishing O2O service platform system based on virtual simulation using XR technology according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a service operation scenario in a home furnishing O2O service platform system based on virtual simulation using XR technology shown in FIG. 1.
Figure 3 is a diagram showing the configuration of a home furnishing O2O service providing device based on virtual simulation using XR technology according to another embodiment of the present invention.
FIGS. 4A and 4B are diagrams illustrating an example of interior data collected by the data collection module shown in FIG. 3.
FIG. 5 is a diagram illustrating user preference profile information generated by the user preference profile information generation unit shown in FIG. 3.
FIGS. 6A to 6D are diagrams illustrating a process of creating a virtual space for an interior target space in real time in the virtual space creation unit shown in FIG. 3.
FIGS. 7A to 7D are diagrams illustrating a process of selecting an interior product to be applied to an interior target space and a location to apply the interior product through a virtual simulation authoring tool screen provided from the virtual simulation provider shown in FIG. 3.
FIG. 8 is a diagram illustrating a process for providing a virtual simulation in the virtual simulation providing module shown in FIG. 3.
FIG. 9 is a diagram illustrating the process of brokering a transaction between a user terminal and a business operator terminal in the O2O service providing platform module shown in FIG. 3.
Figure 10 is a flowchart showing a method of providing a home furnishing O2O service based on virtual simulation using XR technology according to another embodiment of the present invention.

The detailed description of the present invention described below refers to the accompanying drawings, which show by way of example specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different from one another but are not necessarily mutually exclusive. For example, specific shapes, structures and characteristics described herein may be implemented in one embodiment without departing from the spirit and scope of the invention. Additionally, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the detailed description that follows is not intended to be taken in a limiting sense, and the scope of the invention is limited only by the appended claims, together with all equivalents to what those claims assert, if properly described. Similar reference numbers in the drawings refer to identical or similar functions across various aspects.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

Figure 1 is a diagram showing a home furnishing O2O service platform system based on virtual simulation using XR technology according to an embodiment of the present invention, and Figure 2 is a diagram showing a home furnishing based on virtual simulation using XR technology shown in Figure 1. This is a diagram showing the service operation scenario in the Sing O2O service platform system.

The home furnishing O2O service platform system (1000, hereinafter referred to as 'this system') based on virtual simulation using XR technology according to this embodiment is a floor plan by applying virtual simulation based on XR technology to the home furnishing interior industry. It is a system that converts into a 3D model, allows users to create their own home design, and recommends interior design and home furnishing products that suit the user's taste.

To this end, the system 1000 includes at least one user terminal 10, a business terminal 20, and a home furnishing O2O service providing device 100.

The user terminal 10 is a terminal owned by a prospective consumer who selects an interior product to be applied to the interior target space using a virtual interior service and proceeds to purchase the selected product, and is provided to the user on the home furnishing O2O service providing device 100. transmit data. In addition, the user's residential space can be photographed using the camera module included in the user terminal 10 and transmitted to the home furnishing O2O service providing device 100.

The business terminal 20 is a terminal owned by a manufacturer that manufactures interior furniture, a company that carries out actual interior construction according to the interior design, and/or an independent company that supplies construction materials in cooperation with a construction company, and is a home furnishing O2O service. Interior data including interior product information is transmitted to the provision device 100.

These user terminals 10 and operator terminals 20 are terminals or devices capable of wireless communication, for example, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Celluar), and PHS (Personal Communication System). Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminal, It may be in the form of a smartphone, smartpad, tablet PC, desktop, HMD (Head Mount Display), wearable-HMD, etc., but is not limited thereto.

The home furnishing O2O service providing device 100 may be a server including a communication module, memory, and a processor that processes interior services as a type of central processing unit, but is not limited to this. The home furnishing O2O service providing device 100 is network-based connected to at least one user terminal 10 and the business operator terminal 20 through a communication module and can provide a home furnishing O2O service based on virtual simulation. Meanwhile, a network refers to a connection structure that allows information to be exchanged between nodes such as terminals and servers, and includes the Internet, Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), and PAN ( Personal Area Network), 3G. This includes, but is not limited to, Long Term Evolution (LTE), Wireless Fidelity (WiFi), World Interoperability for Microwave Access (WiMAX), and Wireless Gigabit (WiGig).

In particular, the home furnishing O2O service providing device 100 according to this embodiment provides real-time floor plan conversion services such as converting a 2D floor plan into a 3D model, as shown in FIG. 2, Home-Furnishing Simulation authoring tool service provides a simple, intuitive drag-and-drop interface, and recommends interior design and home furnishing products based on a learning-based customized recommendation algorithm through analysis of user data patterns. It provides a personalized recommendation service based on user preferences. In addition, the home furnishing O2O service providing device 100 according to this embodiment provides a multi-device-based XR experience contents environment to provide VR-based interior show room experience services and AR-based experience services. You can. In addition, the home furnishing O2O service providing device 100 according to this embodiment provides a full-cycle O2O-based home furnishing integrated service platform, from online quotation and contract service to construction and home furnishing product purchase/delivery. By doing so, non-face-to-face company selection, quotation, and contract services can be performed.

To this end, the home furnishing O2O service providing device 100 collects user data and interior data, extracts characteristics of the user data, and maps them to at least one preset preference class to generate user preference profile information. In addition, the home furnishing O2O service providing device 100 generates recommended interior product information based on user preference profile information and provides it to the user terminal 10, and provides interior design information to be applied to the interior target space from the user terminal 10. When a product is selected, a virtual simulation is provided by applying the selected interior product to the virtual space of the interior target space, and a list of at least one quote for the interior product applied to the virtual space is provided to the user terminal 10. When one of the quotation lists is selected from (10), transaction conclusion is brokered with at least one business terminal 20 providing the corresponding quotation.

Below, the specific configuration of the home furnishing O2O service providing device 100 will be described with reference to FIGS. 3 to 8.

Figure 3 is a diagram showing the configuration of a home furnishing O2O service providing device based on virtual simulation using XR technology according to another embodiment of the present invention, and Figures 4a and 4b are collected from the data collection module shown in Figure 3. This is a diagram illustrating an example of interior data, and FIG. 5 is a diagram illustrating the user preference profile information generated in the user preference profile information generator shown in FIG. 3, and FIGS. 6A to 6D are diagrams shown in FIG. 3. It is a diagram showing the process of creating a virtual space for an interior target space in real time in the virtual space creation unit, and FIGS. 7A to 7D show the interior target through the virtual simulation authoring tool screen provided from the virtual simulation provider shown in FIG. 3. It is a diagram illustrating the process of selecting the interior product to be applied to the space and the location to apply the interior product to, and Figure 8 is a diagram illustrating the process of providing virtual simulation in the virtual simulation provision module shown in Figure 3. 9 is a diagram illustrating the process of brokering a transaction between a user terminal and a business operator terminal in the O2O service provision platform module shown in FIG. 3.

A home furnishing O2O service providing device 100 (hereinafter referred to as 'device') based on virtual simulation using XR technology according to this embodiment communicates with at least one user terminal and a business operator terminal to perform a virtual simulation of the interior target space. The device 100 provides a data collection module 110, a recommendation module 120, a virtual simulation provision module 130, and an O2O service provision platform module 140.

The data collection module 110 collects user data, which is various information related to the user, such as user taste or lifestyle, from the user terminal. To this end, the data collection module 110 may provide a user interface screen on which user data can be registered to the user terminal.

Meanwhile, user data may include user personal information, log information, residential space information, preference concept information, and situation information.

User personal information may include user gender, age, family members, marital status, occupation, hobbies, pet status, etc.

Log information may include search history, output history, product purchase history, other user accounts registered by the user out of interest, content information such as interior website brands, SNS activity information, etc.

Residential space information may include image information such as photos taken of the residential space, and residential information such as address, floor space, type, and residential type.

Preferred concept information is interior-related concept information preferred by the user and may include, for example, information such as preferred color, brightness, pattern, brand, and design concept.

Contextual information includes the user's current situation information such as the user's current location information, weather, temperature, time, and day of the week, and current life information such as frequently used products, commuting time, time staying at home, sleeping time, and remaining space information. It can be included.

The data collection module 110 collects interior data. The data collection module 110 can collect interior data by providing a screen for registering interior data on a business terminal, or collect interior data existing on the Internet by web crawling.

Meanwhile, interior data may include interior furniture information, interior design information, and business operator information.

Interior furniture information is information about home furnishing furniture and includes furniture image information as shown in Figure 4a, and may include furniture attribute information such as price, standard, material, color, pattern, tone, and manufacturer (brand). .

Interior design information includes images of props such as carpets, curtains, and lighting used in interiors as shown in Figure 4b, and prices, specifications, materials, colors, patterns, tones, manufacturers, etc. of walls, flooring, and joints used in interior work. Can include attribute information.

Business information includes basic company information such as business registration certificate, representative, and phone number, professional field information such as professional construction field and professional production furniture field, regional information such as company address information, and portfolio such as construction cases and furniture delivery cases. Includes information and pricing policy information.

The recommendation module 120 generates user preference profile information by extracting features of user data and mapping the extracted features to at least one preset preference class, and generates recommended interior product information based on the user preference profile information. To this end, the recommendation module 120 may be configured with MongoDBDATAModel, one of the models that can easily and quickly process large amounts of big data, but is not limited to this.

The recommendation module 120 may include a user preference profile information generation unit 121, an interior data classification unit 122, and a recommendation interior product information generation unit 123.

The user preference profile information generation unit 121 maps the characteristics of the user data to each preference class according to a preset similarity measurement algorithm, and assigns a weight to the preference class according to the mapping result to generate user preference profile information.

More specifically, the user preference profile information generator 121 extracts features of user data and sorts the extracted features according to a similarity measurement algorithm. At this time, the similarity measurement algorithm may include, but is not limited to, Pearson correlation, Euclidean distance, cosine measurement, Spearman correlation, Tanimoto coefficient, and log-likelihood. In other words, the user preference profile information generator 121 groups the characteristics of the user data into similar characteristics.

The user preference profile information creation unit 121 maps the sorted features in correspondence to at least one preference class provided in advance. Here, the preferred class is a classification class according to interior style, and may be, for example, classic, modern, natural, Nordic, romantic, vintage, casual, etc., but is not limited thereto.

The user preference profile information generator 121 may match the characteristics of the grouped user data to preference classes and then assign a high weight to a higher preference class to which multiple features of each preference class are mapped. That is, the user preference profile information generator 121 reviews the characteristics of the user data and the aspects corresponding to each preference class and assigns a weight to each preference class. For example, as shown in Figure 5, User 1 may be given a high weight to Classic, Modern, and Romantic preference classes, User 2 may be given a high weight to Natural, Vintage, and Casual, and User 3 may be given a high weight to Romantic, Casual. High weight may be assigned to .

The interior data classification unit 122 classifies the interior data by mapping the interior data to each preferred class according to a preset similarity measurement algorithm.

The interior data classification unit 122 can classify which of the preferred classes each interior furniture belongs to based on the image and attribute information of the interior furniture information. Additionally, the interior data classification unit 122 can classify which of the preferred classes each interior design belongs to based on the image and attribute information of the interior design information. At this time, the similarity measurement algorithm used for classification in the interior data classification unit 122 may be any one of Pearson correlation, Euclidean distance, cosine measurement, Spearman correlation, Tanimoto coefficient, and log likelihood, but is not limited thereto.

The recommended interior product information generation unit 123 inputs user preference profile information into a previously prepared interior recommendation model and outputs recommended interior product information. Here, the interior recommendation model is a form of artificial neural network and is a model learned based on user preference profile information, classified interior data, and user selection history. This interior recommendation model can be output in the form of consumption prediction scores for each interior furniture or design by inputting user preference profile information.

Additionally, the recommended interior product information generator 123 may sort the recommended interior product information based on interior product selection history information of other users with similar user preference profile information. That is, the recommended interior product information generation unit 123 may provide recommended interior product information in the form of a plurality of recommendation classes through a collaborative filtering algorithm based on the selection history of other users.

Meanwhile, the recommended interior product information generation unit 123 can change and generate recommended interior product information in real time according to user context information and residential space information through the user terminal.

For example, if only the floor plan of the residential space is obtained from the user terminal, the recommended interior product information generator 123 may recommend interior design or furniture based only on the user preference profile prepared in advance. However, when image information such as a current photo of the residential space is obtained from the user terminal, the recommended interior product information generation unit 123 recognizes the floor, wall, and ceiling areas within the residential space and analyzes the interior style of the current residential space. The interior design can be changed and recommended in real time based on the user's preference profile. In addition, even when recommending a product, the recommended interior product information generation unit 123 changes and recommends furniture based on the user's preference profile in real time, taking into account the style of the product in the current residential space, the size of the remaining space, the user's lifestyle, and the user's movement route. can do.

The virtual simulation providing module 130 provides recommended interior product information to the user terminal, selects an interior product to be applied to the interior target space from the user terminal, and applies the selected interior product to the virtual space of the interior target space to simulate a virtual simulation. provides.

To this end, the virtual simulation providing module 130 may include a virtual space creation unit 131, a virtual simulation providing unit 132, and an output unit 133.

The virtual space creation unit 131 receives a floor plan of the interior target space from the user terminal and converts the floor plan into a 3D drawing in real time to generate a virtual space of the interior target space.

Below, a specific mechanism for generating a virtual space by real-time conversion of the floor plan in the virtual space creation unit will be described through FIGS. 6A to 6D. FIG. 6A is a diagram illustrating an example of target drawings, FIG. 6B is a diagram illustrating an example of a process for extracting wall-related components, and FIG. 6C is a diagram illustrating an example of the result of extracting wall-related components. , and FIG. 6D is a diagram showing an example of a finally converted 3D drawing.

The virtual space creation unit 131 extracts key factors and semantic information from a previously prepared design drawing, and constructs a rule data set by correlating the extracted key factors and corresponding semantic information.

To this end, the virtual space creation unit 131 first collects design drawings. At this time, the virtual space creation unit 131 may collect design drawings pre-stored in the device 100, collect design drawings in conjunction with an external server, or collect design drawing images on the Internet. The design drawings collected in this way may be floor plan files or elevation files, which are drawings that simulate the structure within a three-dimensional building.

Next, the virtual space creation unit 131 extracts key factors from each collected design drawing. Main factors are factors that symbolize structural elements within the building and include geometric figures, tables, symbols, and strings. Geometric figures refer to geometric images such as points, lines, and polygons. These key factors have patterns according to certain rules to express structural elements within the building. More specifically, the key factors may have individual patterns in which geometric figures, tables, symbols, and character strings each individually represent structural elements, or they may have a combination pattern that represents structural elements by combining at least one of the key factors.

The virtual space creation unit 131 analyzes the structure within the building simulated as a design drawing based on pre-stored structural element information of the building and extracts semantic information symbolized by the key factors. Here, structural element information is pre-stored information representing structural elements within a building, including structural element shape information including beams, columns, slabs, and walls, and the material, dimensions, floor information, load information, and member characteristics of each structural element. Structural element attribute information containing information necessary for structural analysis may be included. The virtual space creation unit 131 analyzes each design drawing based on the above-described structural element information and extracts semantic information of key factors in the design drawing. For example, the virtual space creation unit 131 may extract semantic information of 'circular column' in relation to the main factors of a circular shape, and extract semantic information of 'beam' in relation to the main factors of a straight figure. In addition, the virtual space creation unit 131 extracts the semantic information of 'door' in relation to the main factor that there is a vertical line segment connected to the rectangle and the arc is connected to the end of the rectangle and the end of the line segment, and extracts the semantic information of the 'door' to a certain size. The semantic information of 'window' can be extracted in relation to the main factors of the rectangle below.

The virtual space creation unit 131 constructs a rule data set by correlating key factors and semantic information. More specifically, the virtual space generator 131 generates first rule data by correlating the main factors of the circular shape and the semantic information of the 'circular column', and the main factors of the straight figure and the semantic information of the 'beam'. By creating second rule data by interrelating them, a rule data set that matches each key factor and its semantic information can be constructed.

The virtual space generator 131 analyzes the floor plan requiring 3D conversion based on a rule data set, extracts wall-related components from the floor plan, and assigns an array value to indicate that the wall-related components are in a preset arrangement. This generates real-time analysis data on the floor plan.

More specifically, the virtual space creation unit 131 analyzes the floor plan input from the user and requires 3D conversion based on the rule data set, extracts wall-related components from the floor plan, and determines that the wall-related components are in a preset arrangement. Real-time analysis data for the floor plan is generated by assigning array values to display. In other words, real-time analysis data may include object attribute information of objects in the floor plan and arrangement information changed to indicate that the object is a wall-related component.

To this end, the virtual space creation unit 131 may first provide a user screen so that the user can input a floor plan within a certain area by dragging and dropping. The user screen provides a list of candidate floor plans, and the user can input any one floor plan from this list by dragging and dropping.

Meanwhile, a floor plan is a drawing file prepared in a form that can be read by computing means such as a computer, for example, a drawing produced using a computer program for design such as CAD (Computer Aided Design) or a drawing computerized through an optical device. It could be a file. This floor plan may be composed of a plurality of pixels, for example, M*N pixels organized in a matrix of M horizontally and N vertically, and each pixel has a unique color of R (Red), G (Green), and B (Blue). It has pixel information consisting of RGB element values representing and HSV information representing color, saturation, and brightness, and this pixel information and HSV information can be stored in an M*N array to correspond to each pixel.

The virtual space creation unit 131 converts the input floor plan into gray scale, as shown in FIG. 6A, and loads the target drawing to be analyzed. That is, the virtual space creation unit 131 converts the plan view of the color image into gray scale based on the pixel information and HSV information of each pixel and loads the plan view of the color image as the target view of the black and white image.

The virtual space creation unit 131 analyzes object properties in the target drawing based on the rule data set. More specifically, the virtual space creation unit 131 extracts key factors from the target drawing, searches for key factors extracted from the rule data set, and analyzes object properties based on semantic information associated with the searched key factors. For example, if the virtual space creation unit 131 extracts a key factor in which a vertical line segment is connected to a rectangle and an arc is connected to the end of the rectangle and the end of the line segment, the object attribute related to the key factor is 'door'. is analyzed, and if a rectangular key factor of a certain size or less is extracted, it can be analyzed that the object attribute related to the key factor is 'window'. Additionally, the virtual space creation unit 131 may set an area forming a rectangle of a preset size or larger as a wall candidate area and analyze objects in the area excluding 'doors' and 'windows' as 'walls'.

The virtual space generator 131 extracts wall-related components including points, lines, and cubes from the object corresponding to the wall based on the object properties, and provides an array value according to a preset method to indicate that it is a wall-related component. Allocate .

More specifically, the virtual space creation unit 131 can extract points that are wall-related components from the 'wall' object, extract lines connecting the points, and extract cubes connecting the lines, as shown in Figure 6b. there is. Additionally, the virtual space creation unit 131 assigns an array value to indicate that it is a wall-related component to the array of areas corresponding to the wall-related components extracted in this way. More specifically, the virtual space creation unit 131 may change and assign pixel information and HSV information of the array within the corresponding area to a preset array value to indicate that it is a wall-related component. Accordingly, as shown in FIG. 6C, areas corresponding to wall-related components can be separately displayed (hatched).

The virtual space generator 131 extracts wall-related components based on array values from real-time analysis data, matches the extracted wall-related components in 3D space to generate a continuous 3D mesh wall, and converts the floor plan into a 3D drawing in real time. can do.

To this end, first, the virtual space creation unit 131 filters the area requiring 3D transformation based on real-time analysis data. That is, the virtual space creation unit 131 can leave areas requiring 3D transformation and exclude unnecessary areas based on object attribute information and arrangement information included in the real-time analysis data.

In addition, the virtual space generator 131 checks the array value related to the area requiring 3D transformation within the array, extracts the array value corresponding to the wall-related component, and converts the wall-related component corresponding to the extracted array value into a 3D A 3D mesh wall is created by matching within the space and interconnecting wall-related components that are continuous in the axial direction. That is, the virtual space creation unit 131 confirms that pixels at positions with specific arrangement values are pixels of wall-related components, and converts the coordinates of the areas of these pixels into three dimensions. Additionally, the virtual space creation unit 131 may generate a 3D mesh wall by connecting consecutive coordinates based on the x-axis and z-axis. As a result, as in FIG. 6D, the area (hatched marking) corresponding to the wall-related component in FIG. 6C can be converted into a three-dimensional mesh wall.

In addition, the virtual space creation unit 131 assigns IDs to preset objects based on object properties, distinguishes them by ID, and converts the objects into 3D polygons. More specifically, the object conversion unit 133 can assign IDs to exterior walls, doors, windows, etc., and distinguish them from each other to generate 3D polygons suitable for each object. Accordingly, as shown in FIG. 6D, a 3D shape suitable for an object within the building can be created.

The virtual simulation providing unit 132 provides a virtual simulation authoring tool screen as shown in FIGS. 7A to 7D to the user terminal to select an interior product to be applied to the interior target space and a location to apply the interior product from among the recommended interior product information. , the selected interior products and locations are applied to the virtual space.

As shown in FIG. 7A, the virtual simulation provider 132 displays a list of multiple furniture in a certain area through the furniture tab, selects the desired furniture from the user, and determines where to place the furniture at the desired location in the virtual space. can be input. In addition, as shown in FIG. 7B, the virtual simulation providing unit 132 can provide a virtual simulation authoring tool screen that can change the size of the walls or rooms of the virtual space to more accurately simulate the residential space, and through this, the changed You can reload and display the recommended furniture list. Additionally, the virtual simulation providing unit 132 may provide a virtual simulation authoring tool screen that changes the height or position of the arranged furniture or rotates and rearranges it, as shown in FIG. 7C. In addition, the virtual simulation provider 132 can provide a virtual simulation authoring tool screen that can change the wall and floor materials, as shown in FIG. 7D. At this time, in order to implement an interior design closer to reality on the screen, Graphic effects such as texture, color mapping, and rendering can be applied.

The output unit 133 combines and outputs AR content data in a virtual space, or outputs a VR image of the virtual space to output a realistic virtual simulation. As shown in FIG. 8, the output unit 133 outputs a realistic output image of a virtual space implemented through a virtual simulation authoring tool on a user terminal such as an HMD. Through this, users can have a realistic VR experience of a home-styled virtual space, which can contribute to increasing sales by attracting customers and inducing actual interior design contracts.

The output unit 133 may define the movement (direction, rotation angle, etc.) of an object in virtual space according to a scaling factor generated based on the movement of the user terminal. More specifically, the output unit 133 can provide AR/VR content about the interior and exterior of a building subject to interior design. The output unit 133 can output AR/VR content by combining or moving it in response to the movement of the user terminal. At this time, AR/VR content may be attribute information about the object currently being output, and may be output in the form of any one of text, image, or optional image.

The O2O service provision platform module 140 provides at least one quotation list for interior products applied to the virtual space, and when one of the quotation lists is selected from the user terminal, a transaction is made with at least one business terminal that provides the corresponding quotation. Intermediate the conclusion.

To this end, the O2O service provision platform module 140 may include an automatic quotation calculation unit 141, a business information provision unit 142, a transaction brokerage unit 143, and a virtual interior design sharing unit 144.

The automatic quotation calculation unit 141 may provide at least one quotation list containing the total cost and detailed cost information for interior products applied to the virtual space based on interior data. The automatic quote calculation unit 141 checks the type of interior product applied to the virtual space and calculates the cost based on the price and application area of the product. In addition, the automatic estimate calculation unit 141 can provide total cost information in the virtual space and detailed cost information calculated by calculating the cost for each space or similar type of interior product. Additionally, the automatic quotation calculation unit 141 can provide a plurality of quotation lists based on price information provided by each business operator terminal. The automatic quotation calculation unit 141 may check the pricing policy information for each business operator provided by the user terminal, calculate the average price for each region and industry, and provide a list of multiple quotations based on the calculated average price. As a result, the user terminal can check the list of quotations for various interior products in various cases and select the price quotation that is most advantageous to the user.

When one quotation from the quotation list is selected from the user terminal, the business information provider 142 may provide information on at least one business operator capable of providing a service at the cost of the quotation. The business information provider 142 identifies a group of businesses that can provide services with the quotation selected from the user terminal, and provides information about these businesses, such as basic business information, specialty information, regional information, portfolio information, and pricing policy information, to the user terminal. It can be provided to the side. As a result, the user terminal can check differentiated information for each business operator and select the business operator with which to conclude the final transaction.

Meanwhile, when the business information provider 142 receives certain search requirements from the user terminal, it may sort and provide business information according to the search requirements. For example, when the business information provider 142 receives request area information, it can provide business information for each request area.

When a business operator to conclude a transaction is selected from the user terminal, the transaction brokerage unit 143 may broker a transaction with the terminal of the relevant business operator. At this time, the transaction brokerage unit 143 can deliver request information including interior target space information, interior product information, and user terminal information to the business terminal, and if the business terminal accepts this, both parties can contact. Contact information such as phone number may be disclosed. Additionally, the transaction brokerage unit 143 may request a certain fee when a transaction is concluded between the two parties, and the procedure may be accomplished through the addition or subtraction of electronic money.

The virtual interior design sharing unit 144 can share the virtual interior design results for the interior target space when a transaction is concluded. The virtual interior design sharing unit 144 can enable other customers to share interior design results in conjunction with a specific interior portal site.

Figure 9 is a flowchart showing a method of providing a home furnishing O2O service based on virtual simulation using XR technology according to another embodiment of the present invention.

The method of providing a home furnishing O2O service based on virtual simulation using XR technology according to this embodiment is performed on a home furnishing O2O service providing device that communicates with at least one user terminal and an operator terminal, and provides virtual simulation for the interior target space. A method of providing a home furnishing O2O service based on virtual simulation using XR technology that provides simulation, collecting user data from the user terminal and collecting interior data from the business operator terminal (S10), extracting and extracting the characteristics of the user data Creating user preference profile information by mapping the selected features to at least one preset preference class, generating recommended interior product information based on the user preference profile information (S20), and providing recommended interior product information to the user terminal. A step (S30) of receiving an interior product to be applied to the interior target space from the user terminal and providing a virtual simulation by applying the selected interior product to the virtual space of the interior target space (S30), and providing at least one interior product applied to the virtual space. It includes providing one or more quotation lists and, when one of the quotation lists is selected from the user terminal, brokering a transaction with at least one business terminal providing the corresponding quotation (S40).

Meanwhile, in the step of generating recommended interior product information (S20), the characteristics of the user data are mapped to each preference class according to a preset similarity measurement algorithm, and a weight is given to the preference class according to the mapping result. Creating user preference profile information, classifying the interior data by mapping the interior data to each preference class according to a preset similarity measurement algorithm, and inputting the user preference profile information into a preset interior recommendation model. This may include outputting the recommended interior product information.

In addition, the step of brokering a transaction with a business operator terminal (S40) is a step of providing a list of at least one quote containing the total cost and detailed cost information for interior products applied to the virtual space based on interior data, the user When one quotation from the quotation list is selected from the terminal, providing information on at least one business operator capable of providing a service at the cost of the quote; When a business operator with whom to conclude a transaction is selected from the user terminal based on the business information, the business terminal It may include the step of brokering a deal with the other party and sharing the virtual interior design results for the interior target space once the deal is concluded.

According to the present invention described above, it is possible to customize an interior design that suits the user's taste, such as wallpaper, windows, joints, furniture, and props, inside a home modeled with a 3D model, and calculate a construction estimate for the customized interior design to provide a construction company. We can provide an O2O service that mediates construction.

Additionally, since recommended interior product information is provided based on the user's preference profile, there is an advantage in being able to recommend personalized interior products based on user preference analysis.

Additionally, since virtual simulation is provided in an AR/VR environment, there is an advantage in providing interior services in a more immersive manner.

Although the above has been described with reference to embodiments, those skilled in the art will understand that various modifications and changes can be made to the present invention without departing from the spirit and scope of the present invention as set forth in the following patent claims. You will be able to.

110: data collection module
120: Recommended module
130: Virtual simulation provision module
140: O2O service provision platform module

Claims (10)

A home furnishing O2O service providing device based on virtual simulation using XR technology that communicates with at least one user terminal and business operator terminal to provide a virtual simulation of the interior target space,
a data collection module that collects user data from the user terminal and interior data from the business operator terminal;
a recommendation module that extracts features of the user data, maps the extracted features to at least one preset preference class to generate user preference profile information, and generates recommended interior product information based on the user preference profile information;
The recommended interior product information is provided to the user terminal to select an interior product to be applied to the interior target space from the user terminal, and the selected interior product is applied to the virtual space of the interior target space to provide a virtual simulation. a module that provides virtual simulation; and
Provides an O2O service that provides at least one quotation list for interior products applied to the virtual space, and brokers transaction conclusion with at least one business terminal providing the corresponding quotation when one of the quotation lists is selected from the user terminal. A home furnishing O2O service provision device based on virtual simulation using XR technology, including a platform module. According to claim 1,
The recommended module is,
a user preference profile information generator that maps the characteristics of the user data to each preference class according to a preset similarity measurement algorithm and assigns a weight to the preference class according to the mapping result to generate the user preference profile information;
an interior data classification unit that classifies the interior data by mapping the interior data to each preferred class according to a preset similarity measurement algorithm; and
A virtual simulation-based home furnishing O2O service providing device using XR technology, including a recommended interior product information generation unit that inputs the user preference profile information into a pre-prepared interior recommendation model and outputs the recommended interior product information. According to claim 1,
The virtual simulation providing module is,
A virtual space generator that receives a floor plan for the interior target space from the user terminal and converts the floor plan into a 3D drawing in real time to generate a virtual space for the interior target space;
A virtual simulation authoring tool screen is provided to the user terminal to select an interior product to be applied to the interior target space and a location to apply the interior product from among the recommended interior product information, and the selected interior product and the location to apply the interior product are selected in the virtual space. A virtual simulation providing unit that applies location; and
A home furnishing O2O service providing device based on virtual simulation using XR technology, including an output unit that combines and outputs AR content data in the virtual space, or outputs a VR image of the virtual space to output a realistic virtual simulation. . According to claim 1,
The O2O service provision platform module is,
an automatic quotation calculation unit that provides at least one quotation list containing the total cost and detailed cost information for interior products applied to the virtual space based on the interior data;
When one quotation from the quotation list is selected from the user terminal, a business information providing unit that provides information on at least one business operator capable of providing a service at the cost of the corresponding quotation;
a transaction brokerage unit that mediates transaction conclusion with the terminal of the relevant operator when a business operator to conclude a transaction is selected from the user terminal based on the business information; and
A virtual simulation-based home furnishing O2O service providing device using XR technology, including a virtual interior design sharing unit that shares virtual interior design results for the interior target space when the transaction is concluded. According to claim 4,
The above business information is,
Includes specialty information, regional information, and portfolio information,
The business information providing unit is a virtual simulation-based home furnishing O2O service providing device using XR technology, which provides the business information for each request area upon receiving request area information from the user terminal. A method of providing a home furnishing O2O service based on virtual simulation using XR technology, which is performed on a home furnishing O2O service providing device that communicates with at least one user terminal and an operator terminal, and provides a virtual simulation of an interior target space, comprising:
Collecting user data from the user terminal and collecting interior data from the business operator terminal;
Extracting features of the user data and mapping the extracted features to at least one preset preference class to generate user preference profile information, and generating recommended interior product information based on the user preference profile information;
The recommended interior product information is provided to the user terminal to select an interior product to be applied to the interior target space from the user terminal, and the selected interior product is applied to the virtual space of the interior target space to provide a virtual simulation. steps; and
Providing at least one quotation list for interior products applied to the virtual space, and when one of the quotation lists is selected from the user terminal, brokering a transaction with at least one business terminal providing the corresponding quotation. A method of providing home furnishing O2O service based on virtual simulation using XR technology. According to claim 6,
The step of generating the recommended interior product information is,
mapping the characteristics of the user data to each preference class according to a preset similarity measurement algorithm, and assigning a weight to the preference class according to the mapping result to generate the user preference profile information;
Classifying the interior data by mapping the interior data to each preference class according to a preset similarity measurement algorithm; and
A method of providing a home furnishing O2O service based on virtual simulation using XR technology, comprising inputting the user preference profile information into a pre-prepared interior recommendation model and outputting the recommended interior product information. According to claim 6,
The step of brokering a transaction with the business operator terminal is,
providing a list of at least one quotation including total cost and detailed cost information for interior products applied to the virtual space based on the interior data;
When one quotation from the quotation list is selected from the user terminal, providing information on at least one business operator capable of providing a service at the cost of the quotation;
When a business operator to conclude a transaction is selected from the user terminal based on the business information, mediating a transaction with the corresponding business terminal side; and
A method of providing a home furnishing O2O service based on virtual simulation using XR technology, including the step of sharing virtual interior design results for the interior target space when the transaction is concluded. At least one user terminal transmitting user data;
At least one business terminal transmitting interior data including interior product information; and
Collect the user data and interior data, extract features of the user data and map them to at least one preset preference class to generate user preference profile information, and generate recommended interior product information based on the user preference profile information. It includes a home furnishing O2O service provision device provided to the user terminal,
The home furnishing O2O service providing device, when an interior product to be applied to the interior target space is selected from the user terminal, applies the selected interior product to the virtual space of the interior target space to provide a virtual simulation,
XR technology that provides at least one list of quotations for interior products applied to the virtual space and brokers a transaction with at least one business terminal providing the corresponding quotation when one of the quotation lists is selected from the user terminal. A home furnishing O2O service platform system based on virtual simulation using. According to clause 9,
The home furnishing O2O service providing device,
Based on the interior data, provide a list of at least one quote containing the total cost and detailed cost information for interior products applied to the virtual space,
When one quotation from the quotation list is selected from the user terminal, information on at least one business operator capable of providing a service at the cost of the quotation is provided,
When a business operator with which to conclude a transaction is selected from the user terminal based on the business information, the transaction is concluded with the terminal side of the corresponding business operator,
A home furnishing O2O service platform system based on virtual simulation using XR technology that shares the virtual interior design results for the interior target space when the transaction is concluded.

Images