KR20220023029A - An apparatus for providing real estate market platform services using realistic scene images based on virtual space interior design content and a method for operating it - Google Patents

Abstract

A method, according to an embodiment of the present invention, for operating a service providing apparatus comprises the steps of: processing distributed rendering based on virtual space content data produced by one or more user terminals, to configure one or more pieces of realistic scene image content; matching the one or more pieces of realistic scene image content with creator information, and registering the same a database; providing a mediation interface authoring service using the realistic scene image to a real estate operator terminal; and registering real estate product information based on authoring data input from the real estate operator terminal on a real estate market platform interface.

Description

A method and device for providing a real estate market platform service using a virtual space content data-based realistic scene image

The present invention relates to a service providing method and an apparatus therefor. More specifically, the present invention relates to a method and apparatus for providing a real estate market platform service using a virtual space content data-based realistic scene image.

In general, when designing drawings of buildings, CAD programs are installed on personal computers or notebook computers, and drawings are created using devices such as mice or tablets, and the results are calculated. However, as society develops from an industrial society to an information society, virtual reality technologies that can replace functions such as model houses by providing users with 3D modeling results rather than drawings more easily in a user experience format are emerging.

VR (Virtual Reality) or AR (Augmented Reality) for the purpose of, for example, a virtual tour of a building interior (house, apartment, office, hospital, church, etc.), interior or furniture placement simulation (or interior simulation) is created, and various methods have been proposed to provide the user with a simulated environment and situation based thereon and to interact with it.

To this end, a method of generating 3D data of a building or indoor structure in advance manually or using a 3D scanner and providing virtual reality based thereon may be used. However, in the case of this method, a three-dimensional architectural modeling process by estimation from scan information or drawings is required, so there is difficulty in manufacturing, and the accuracy is lowered due to limitations in data processing and manual work. There is this.

In addition, when a user intends to design an interior through furniture or objects that are arbitrarily arranged on an indoor structure, it must be precisely installed and harmoniously arranged in a three-dimensional space, but this work is very difficult unless you are a professional 3D designer. . Therefore, in reality, only the current technology requires a professional manpower to structure and generate the indoor information and the interior of a building, and the time and cost are excessively consumed.

In addition, the indoor information and interior constructed in this way are currently provided through a display device that displays the virtual space interior as a two-dimensional or three-dimensional image.

Such a display device may output various pieces of furniture and objects shown in a view image according to a user's point of view according to the virtual space interior content data, and in general, the user selects any one of them to input a movement of the furniture or Detailed information for purchase may be provided.

However, in order to provide such information, a scene image obtained by rendering virtual space interior content data in three dimensions should be output through a display device of users.

In particular, recently, in order to show 3D rendering as a more realistic image, a global lighting rendering technique based on ray tracing that analyzes the physical interaction of light and medium is applied to show rendering effects like real photos. A possible technique is being proposed.

Here, rendering is impossible to replace by hand, unlike modeling or animation, where quality supplementation is easy by hand, so the performance greatly depends on which rendering technology is used, and it can be said that the realism and quality of the generated image are determined accordingly. there is. With the development of global illumination and shading technology compared to the past, rendering of hyper-realistic images has become possible, but a lot of computation time is still required for this.

Despite the development of rendering technology and the rapid development of the computer speed for calculating rendering, the demand for the required image quality is also increasing, so the final rendering time is not shortened. The reason that it takes from a few minutes to a few days to obtain a rendering result for a single scene is that the required image quality has significantly increased.

Therefore, it is still difficult to quickly perform the rendering process on content data with high complexity and high diversity in which various spaces and objects are arranged, such as virtual space interior content, and provide it to a user terminal.

In addition, since realistic scene rendering, such as global lighting-based rendering processing, tracks the movement path emitted from the light source, when a specific object is replaced, the entire scene must be recalculated. , excessive computing power and data throughput are required, and there is a limit to providing it as a commercial service.

In order to overcome this, a method of separating and simply replacing only a specific object in the scene image has been proposed, but due to the sense of heterogeneity caused by the light source and the afterimage of the existing object, there is a problem that the realism and the quality of service are deteriorated. .

On the other hand, recently, various online market platforms for selling real estate or related interior products have emerged, and these online market platforms use space photos of the interior of real estate or photos of interior products in which interior products are placed. A screen interface is provided to check the space in advance.

However, as the competition for promotion in the real estate online market platform intensifies, more and more sellers are taking high-quality real estate photos or interior photos and using them for publicity.

In particular, as high-cost interior photos taken by photo professionals using high-performance cameras in photo studios equipped with sets, etc. are utilized, the phenomenon of main customer conduction, in which sales volume or popularity depends on the composition and quality of photos rather than the real estate itself, has occurred. is currently appearing.

Since most of the cost for indoor photography of real estate is caused by highly specialized human resources and camera equipment, real estate agents have a problem in that they spend excessively on photography rather than on the quality of the product itself to compete. These expenses are reflected in the real estate brokerage cost, and as a result, the overall service and reliability of the real estate market deteriorated, and the brokerage price increased, leading to consumer dissatisfaction.

The present invention was devised to solve the above problems, and based on virtual space content data created and shared by users, builds a realistic and realistic interior scene image database of a distributed rendering method, and provides interior scene images to real estate businesses Real estate market platform interface and its market platform service that enable real estate brokerage service using images from database, reducing costs for interior photography, etc. Its purpose is to provide

The method of operating a service providing apparatus according to an embodiment of the present invention for solving the above-described problems, by processing distributed rendering based on virtual space content data produced by one or more user terminals, one or more realistic scene image content constructing; registering the one or more realistic scene image contents in a database by matching them with producer information; providing a real estate brokerage interface authoring service using the realistic scene image to a real estate operator terminal; and registering real estate product information based on author data input from the real estate operator terminal on a real estate market platform interface.

In addition, the service providing apparatus according to an embodiment of the present invention for solving the above-described problems, by processing distributed rendering based on virtual space content data produced by one or more user terminals, one or more realistic scene image content a space and interior rendering unit constituting it; and a service providing unit that matches the one or more realistic scene image contents with creator information and registers it in a database, wherein the service providing unit provides an intermediary interface authoring service using the realistic scene image to a real estate operator terminal. content creation module; and a market platform interface module for registering real estate product information based on author data input from the real estate operator terminal on a real estate market platform interface.

On the other hand, the method of operating a service providing apparatus according to an embodiment of the present invention for solving the above-described problems may be implemented as a program for executing the method in a computer and a computer-readable recording medium in which the program is recorded. there is.

According to an embodiment of the present invention, a realistic and realistic interior scene image database of a distributed rendering method is built based on virtual space content data created and shared by users, and real estate brokerage using images of the interior scene image database to real estate operators The purpose of the service is to provide a real estate market platform interface and a market platform service that enables the service to reduce costs for interior photography, etc., and to utilize realistic scene images shared by various users for real estate brokerage services. .

In addition, according to an embodiment of the present invention, in order to compose realistic scene images, a user performs a separate precise design or a professional It allows you to create space and interior design information intuitively and conveniently without requesting work.

And, according to an embodiment of the present invention, virtual space content configured according to various methods such as space and interior design is efficiently and quickly pre-rendered through a cloud service network, thereby providing global illumination and shading effects. is applied, so that a three-dimensional scene image of a virtual space interior such as a realistic and rich photorealistic image can be provided through a user terminal.

1 is a diagram for schematically explaining an entire system according to an embodiment of the present invention.
2 is a block diagram for explaining in more detail an apparatus for providing a service according to an embodiment of the present invention.
3 is a block diagram for explaining in more detail a service providing unit according to an embodiment of the present invention.
4 is a flowchart for describing a service providing method according to an embodiment of the present invention in more detail.
5 is a diagram for explaining a market platform interface based on a realistic scene image according to an embodiment of the present invention.
6 to 8 illustrate an indoor structure information interface output from a service providing apparatus according to a method execution according to an embodiment of the present invention.
9 is a block diagram illustrating in more detail a space and interior rendering unit according to an embodiment of the present invention, and FIGS. 10 to 11 are exemplary views of a rendered realistic scene image according to an embodiment of the present invention.
12 to 15 are flowcharts and reference diagrams for explaining in more detail an operation of a rendering unit according to an embodiment of the present invention.
16 to 20 are flowcharts and reference diagrams for explaining in more detail an object conversion operation of a rendering unit according to an embodiment of the present invention.

The following is merely illustrative of the principles of the invention. Therefore, those skilled in the art will be able to devise various devices that, although not explicitly described or shown herein, embody the principles of the present invention and are included within the spirit and scope of the present invention. Further, it is to be understood that all conditional terms and examples listed herein are, in principle, expressly intended solely for the purpose of enabling the concept of the present invention to be understood, and not limited to the specifically enumerated embodiments and states as such. should be

Moreover, it is to be understood that all detailed description reciting the principles, aspects, and embodiments of the invention, as well as specific embodiments, are intended to cover structural and functional equivalents of such matters. It should also be understood that such equivalents include not only currently known equivalents, but also equivalents developed in the future, i.e., all devices invented to perform the same function, regardless of structure.

Thus, for example, the block diagrams herein are to be understood as representing conceptual views of illustrative circuitry embodying the principles of the present invention. Similarly, all flowcharts, state transition diagrams, pseudo code, etc. may be tangibly embodied on computer-readable media and be understood to represent various processes performed by a computer or processor, whether or not a computer or processor is explicitly shown. should be

The functions of the various elements shown in the drawings including a processor or functional blocks represented by similar concepts may be provided by the use of dedicated hardware as well as hardware having the ability to execute software in association with appropriate software. When provided by a processor, the functionality may be provided by a single dedicated processor, a single shared processor, or a plurality of separate processors, some of which may be shared.

In addition, the clear use of terms presented as processor, control, or similar concepts should not be construed as exclusively referring to hardware having the ability to execute software, and without limitation, digital signal processor (DSP) hardware, ROM for storing software. It should be understood to implicitly include (ROM), RAM (RAM) and non-volatile memory. Other common hardware may also be included.

In the claims of the present specification, a component expressed as a means for performing the function described in the detailed description includes, for example, a combination of circuit elements that perform the function or software in any form including firmware/microcode, etc. It is intended to include all methods of performing the functions of the device, coupled with suitable circuitry for executing the software to perform the functions. Since the present invention defined by these claims is combined with the functions provided by the various enumerated means and in a manner required by the claims, any means capable of providing the functions are equivalent to those contemplated from the present specification. should be understood as

The above objects, features and advantages will become more apparent through the following detailed description in relation to the accompanying drawings, and accordingly, those of ordinary skill in the art to which the present invention pertains can easily implement the technical idea of the present invention. There will be. In addition, in the description of the present invention, if it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram schematically illustrating an entire system according to an embodiment of the present invention.

Referring to FIG. 1 , the entire system according to an embodiment of the present invention includes a service providing device 100 , one or more cloud devices 200 , a consumer terminal 300 , a content producer terminal 400 , and a real estate operator terminal 500 . includes

First, the consumer terminal 300, the content producer terminal 400, and the real estate operator terminal 500 described in this specification may be collectively referred to as the user terminals 300, 400, and 500 according to general functions, and first, will be described, and the operation of each terminal will be described in detail.

The user terminals 300 , 400 , and 500 are one or more electronic devices that are operated according to a user input and output a user interface. Various electronic devices such as (Personal Digital Assistants), Portable Multimedia Player (PMP), navigation devices, and virtual reality devices may be exemplified.

In addition, a program or application for executing the methods according to an embodiment of the present invention in conjunction with the service providing apparatus 100 may be installed and operated in the user terminals 300 , 400 , and 500 .

Accordingly, the service providing apparatus 100 according to an embodiment of the present invention generates and edits the indoor structure information output from the user terminals 300, 400, and 500, or information necessary for driving the interface to the user terminals 300 and 400. , 500), and the indoor structure information generated according to an embodiment of the present invention may be stored in the service providing device 100 or uploaded to a separate server (not shown) and managed according to user information. .

Here, the indoor structure information may include two-dimensional or three-dimensional building plan information, and may include structure information that can be used for indoor interior simulation by matching three-dimensional modeling information. In addition, the indoor structure information may include one or more wall surfaces and connection information of each wall surface, and may form one or more closed spaces.

In order to facilitate the generation of the indoor structure information, the user terminals 300 , 400 , and 500 may include a distance measuring sensor and an angle measuring sensor inside or outside, and may determine the indoor structure information according to a user input.

In addition, the service providing apparatus 100 may obtain pre-stored or uploaded indoor structure information in response to user information from the user terminals 300 , 400 , and 500 , and perform an interior layout editing function corresponding to the obtained indoor structure information. can provide

In particular, according to an embodiment of the present invention, the service providing apparatus 100 provides an interior layout automation function capable of automatically processing furniture interior arrangement and space design according to user style information analysis in response to the user's indoor structure information to the user terminal. (300, 400, 500) can be provided.

More specifically, when the service providing apparatus 100 according to an embodiment of the present invention obtains the indoor structure information of the user, the space determined in response to the indoor structure information according to the style information analysis processing corresponding to the user The interior layout automation information including the layout and interior layout design may be generated, and the interior layout automation information may be output through the user terminals 300 , 400 , and 500 .

The automation information output as described above may be used for interior rendering processing of the interior structure information in the service providing apparatus 100 , and the rendered interior structure information is an interior structure information interface of the user terminals 300 , 400 , and 500 . can be output through

Accordingly, the information on the interior structure of which interior furniture and space layout design has been automated can be used for editing, information sharing, and storage according to user input, and furthermore, it can be used as an indoor simulation and purchase interlocking function of each arranged furniture. .

For example, the service providing apparatus 100 visualizes a three-dimensional space similar to reality on a virtual space displayed on the display of the user terminals 300, 400, and 500, and displays a three-dimensional object based on the interior layout automation information. It is possible to provide a function of arranging on the indoor simulation graphic based on the indoor structure information. Accordingly, the indoor simulation may be preferably used for a floor plan that simulates furniture to be placed in a room, and the application providing the indoor simulation may include a floor plan application.

Accordingly, the service providing apparatus 100 according to an embodiment of the present invention generates an interior arrangement and a space layout design according to a user style according to a user input on the indoor structure information according to a user input, and provides rendering information to the user terminals 300 , 400 , and 500 . ), the user can receive the desired style of space layout and furniture arrangement without additional precise design or design work, edit it, and build 2D and 3D interior structure information in various ways. let there be

To this end, a separate server device may store the predetermined application that can be installed in the user terminals 300 , 400 , and 500 and information necessary to provide the indoor simulation, and the user of the user terminals 300 , 400 and 500 . It can provide user registration and indoor structure information management for The user terminals 300 , 400 , and 500 may download and install the application from the server device.

In addition, the service providing apparatus 100 according to an embodiment of the present invention performs more realistic and realistic scene image rendering for virtual space interior content including 3D indoor structure information, so that the user terminals 300, 400, 500) may provide rendered image data.

Here, the rendered image data may be a three-dimensional image projected corresponding to a first viewpoint set in response to the virtual space interior, and may be image data to which one or more rendering effect calculation processes for realizing a realistic scene are applied. .

More specifically, the rendering effect may include effect processing for applying various lighting algorithms, such as a well-known REYES structure, in response to 3D data. However, REYES has a problem that it is fast but lacks realism, and the rendering technique based on global illumination more physically interprets the interaction of light and medium more precisely, but there is a problem that requires high-spec computing due to the high amount of computation.

In particular, global illumination can give a more realistic feel by calculating both direct light from the light source and indirect light reflected from other materials, objects, and walls. Soft shadow, caustics, color bleeding, etc. can all appear through the global lighting effect, and the light source tracking method simulates the movement of light in the real world as it is. It is difficult to implement in real time even on the latest hardware.

Accordingly, the service providing apparatus 100 according to an embodiment of the present invention uses a cloud-based rendering service network configured by one or more cloud devices 200, and a ray tracing method based on global illumination. By distributing the (ray tracing) process to the cloud devices 200 , it is possible to effectively build pre-rendered 3D virtual space interior content. This is based on a rendering optimization process of the service providing apparatus 100 that effectively shares computing resources and efficiently reduces computation time.

Here, the service providing device 100 may be a master device that distributes a realistic scene rendering task into a partial image rendering task and allocates it to the cloud device 200, and the cloud device 200 processes the partial image rendering and optimizes it. It may be a slave device that transmits a partial image of a realistic scene to the service providing device 100 .

More specifically, the service providing apparatus 100 according to an embodiment of the present invention corresponds to the 3D virtual space interior content to be provided to the user terminals 300 , 400 , and 500 , and provides a realistic image of the scene image projected from the first viewpoint. It is possible to configure distributed processing data optimized for distributed rendering processing, and transmit the configured distributed processing data to one or more cloud devices 200 connected to the rendering service network, and distributed rendered realistic scenes from the cloud devices 200 . By receiving the partial images, it is possible to configure a realistic scene image of a first viewpoint corresponding to the 3D virtual space interior content.

The realistic scene image of the first viewpoint configured according to this may be provided to the user terminals 300 , 400 , and 500 , and as the pre-rendering is repeatedly performed, the first viewpoint may be extended to a plurality of viewpoints. Furthermore, the plurality of viewpoints may be composed of omnidirectional point viewpoints corresponding to the three-dimensional virtual space. According to optimization of pre-rendering and improvement of cloud network performance, a 720-degree omnidirectional virtual space interior in which a realistic scene image is processed Content may be provided.

Furthermore, the service providing apparatus 100 according to an embodiment of the present invention can provide an object conversion service in a realistic scene image, and for this purpose, a plurality of object-converted realistic scene images are generated in advance, stored in a database, and can manage For example, it is possible to easily provide realistic scene image processing, such as changing furniture to another type within a specific virtual space interior content, through a pre-rendering process.

However, as described above, in order to generate an object-converted realistic scene image, a re-computation process corresponding to the entire image is required, and there is a problem that the amount of computation is very high. In addition, when only a simple object part is replaced, a sense of heterogeneity is generated due to an afterimage of a surrounding image due to an existing object, and there is a problem in that the sense of reality is lowered.

Accordingly, the service providing apparatus 100 according to an embodiment of the present invention determines a partial transformation boundary area corresponding to the range of influence by object transformation, corresponding to the first object before transformation and the second object after transformation, By performing only the realistic scene image re-rendering processing corresponding to the partial transformation boundary area, and combining the re-rendered scene image part and the remaining existing scene image part, the first object is converted into a second object by generating a realistic scene image, It is possible to provide object conversion processing that minimizes the amount of computation in the re-computation process and prevents a sense of heterogeneity.

In addition, the service providing apparatus 100 according to an embodiment of the present invention provides a market platform service that enables a real estate operator to sell products using pre-rendered three-dimensional virtual space interior content to each user terminal ( 300 , 400 , 500 ). can be provided with

Here, the pre-rendered 3D virtual space interior content may be composed of one or more realistically rendered realistic scene images. For the realistic scene image, high-cost interior photos taken by photo professionals using a high-performance camera of a photo studio equipped with a set or the like as described above can be replaced with image data based on low-cost and efficient calculation. Accordingly, a market platform that can increase the quality of images by using 4K or higher photo-rendered realistic images while reducing the human cost of photo work can be provided.

To this end, the content creator terminal 400 constitutes the three-dimensional virtual space interior content as described above, and is a user terminal that requests the service providing apparatus 100 for realistic distributed rendering processing of the scene image projected to the first viewpoint. Also, the service providing apparatus 100 may compose realistic scene image content based on distributed rendering, match it with the creator information of the content creator terminal 400, and store and register it in the database.

In addition, the real estate operator terminal 500 may be a user terminal of an operator providing interior goods and services, and using the realistic scene image content registered in the service providing device 100 , a brokerage containing product information to be sold An interface may be created, and the generated mediation interface may be requested to be registered with the service providing apparatus 100 . The registration-requested mediation interface may be registered on the interior-related market platform interface provided by the service providing apparatus 100 .

For example, the product information to be sold may include an interior construction product, and the realistic scene image content may be provided as a construction sample image of the interior construction product. And, to create an intermediary interface, the service providing apparatus 100 may provide an intermediary interface authoring service including the construction sample image to the real estate operator terminal 500, and the writing input from the real estate operator terminal 500 Real estate product information based on data may be registered on the real estate market platform interface.

Accordingly, the service providing apparatus 100 may provide real estate product information including the realistic scene image content to one or more consumer terminals 300 connected to the market platform interface. The service providing apparatus 100 may collect real estate brokerage request information input through a real estate brokerage interface corresponding to the real estate product information in the consumer terminal 300 and perform brokerage processing.

By this process, the service providing apparatus 100 generates a high-quality, low-cost, high-quality mediation interface for the real estate operator terminals 500 including real estate product information by using realistic scene images configured from various content creator terminals 400 . By receiving the mediation request information of the consumer terminal 300 for this mediation interface and processing the payment, it is possible to provide a real estate market platform more efficiently and with a small fee.

Also, the producer information of the content creator terminal 400 may be used to calculate a reward corresponding to the realistic scene image. For example, when the inquiry and payment processing of the real estate product information is completed or registered on the market platform interface, the service providing device 100 calculates a reward for the use of the realistic scene image, and the producer information In response, the reward may be paid or provided.

Detailed configurations of each device for implementing this will be described in more detail with reference to FIG. 2 .

Referring to FIG. 2 , the service providing apparatus 100 includes a communication unit 105 , an input unit 110 , a style information analysis unit 120 , a layout generation processing unit 130 , a control unit 140 , an interface output unit 150 , It includes a space and interior rendering unit 160 , a service providing unit 170 , and a storage unit 180 . Since the components shown in FIG. 2 are not essential, a terminal having more or fewer components may be implemented.

First, the communication unit 105 includes one or more modules that enable wired/wireless communication between the service providing apparatus 100 and the rendering service network or between the service providing apparatus 100 and the network in which the user terminals 300, 400, and 500 are located. can do.

For example, the communication unit 105 may include a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module. The mobile communication module transmits/receives wireless signals to and from at least one of a server device, a base station, an external terminal, and a server on a mobile communication network. The wireless Internet module refers to a module for wireless Internet access, and may be built-in or external to the service providing apparatus 100 . As wireless Internet technologies, wireless LAN (WLAN) (Wi-Fi), wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), etc. may be used.

The short-distance communication module refers to a module for short-distance communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used as short range communication technologies.

The location information module is a module for acquiring the location of the terminal, and a representative example thereof is a Global Position System (GPS) module.

Also, for example, the communication unit 105 receives the completed interior structure information and interior layout information from the user terminals 300 , 400 , and 500 , or registers the user information in response to the user information with the user terminals 300 , 400 , 500 . It may provide interior structure information or interior layout information. Here, the interior layout information may be interior layout information obtained from image information input from the user terminals 300 , 400 , and 500 , or may include interior layout automation information processed by the service providing apparatus 100 .

The input unit 110 may receive and process input data for controlling a user's operation according to an input of the user terminals 300 , 400 , and 500 .

The style information analysis unit 120 analyzes the user's style information, and transmits the analyzed style information to the layout generation processing unit 130 . To this end, the style information analyzer 120 may include a feature analyzer 121 .

First, the style information analyzer 120 may receive style-related information corresponding to the user through the input unit 110 , and the input style-related information may be transmitted to the feature analyzer 121 .

More specifically, the style-related information may indicate user preference interior information according to a user input, and the style information analysis unit 120 analyzes the user preference interior information to calculate user style information to be transmitted to the layout generation processing unit 130 . can

Here, as a specific element indicating user preference interior information, the style-related information may include interior image information that the user desires to build in a similar form, or may include user style pattern information that the user directly selects and inputs.

For example, the user inputs specific video or image information to apply a spatial interior layout similar to that of a specific video or image to his/her indoor structure information, or an interior photo or video checked through a social network service Information or its social network service link information may be input as the style-related information.

Also, for example, the user may input preference style information for an interior to be automatically arranged in his/her indoor structure information as the style-related information. For example, the user may input various style information such as the size, arrangement, and matching style of furniture or the size, shape, number, and type of the space through the user terminals 300 , 400 , and 500 , and the input unit 110 . can be received through

The feature analyzer 121 may obtain user's style information by analyzing the style-related information, and the acquired style information may be transmitted to the layout generation processing unit 130 . Here, the user style information may include feature variable information for the layout generation iteration processing of the layout generation processing unit 130 .

More specifically, for example, the feature analysis unit 121 may perform a process of calculating a feature variable for calculating the interior cost function based on the user's style information.

The interior cost function is devised to determine the optimal space and interior layout in the layout generation processing unit 130, and evaluates the actual arrangement degree of the interior according to the characteristic variable of the interior object set corresponding to the interior structure information. can be used

That is, the layout generation processing unit 130 may repeatedly iterate the interior cost function calculation based on the characteristic variable information in order to calculate an optimized space and interior layout, and the characteristic analysis unit 121 may iterate through the image information, etc. By analyzing the corresponding style information, it is possible to obtain feature variable information corresponding to the user's style information and provide it to the layout generation processing unit 130 .

Accordingly, the style information analyzed by the feature analysis unit 121 may be used for calculating the spatial layout design function of the layout generation processing unit 130 , and the layout generation processing unit 130 is a space for correcting the interior cost function You can determine the layout design function.

For example, the layout x may include one or more sets of interior characteristic variables, and the interior characteristic parameters may correspond to, for example, interior structures, walls, corners, windows, doors, and respective furniture object elements, each Size, shape, type, position, and rotation values corresponding to elements may be assigned as respective feature variables.

In addition, the space usage rate analysis unit 123 may process the space usage rate analysis for each layout. In the space usage rate analysis, for example, factors such as the degree of space within the space, the density, and the proximity between spaces according to the movement path may be taken into consideration, and the space usage rate analysis unit 123 calculates the usage rate when a specific layout is input to the layout A function to output to the generation processing unit 130 may be processed.

Also, the space usage rate analyzer 123 may be included as an element of the style information analyzer 120 . For example, the style information analyzed by the style information analyzer 120 may include space usage rate information, and accordingly, an allowable space usage rate iteration threshold may be set differently for each user style.

Through this iteration process, optimal interior layout automation information may be determined, and the determined interior layout automation information may be transmitted to the space and interior rendering unit 160 .

On the other hand, the rendering unit 160 may perform a realistic scene image rendering process for a 3D virtual space interior content written by a user or by applying the interior layout automation information to indoor structure information, and the rendered space and interior Data may be output to the user terminals 300 , 400 , and 500 through the interface output unit 150 .

In particular, the rendering unit 160 according to an embodiment of the present invention corresponds to the 3D virtual space interior content to be provided to the user terminals 300 , 400 , and 500 , and provides realistic distributed rendering of the scene image projected from the first viewpoint. It is possible to configure distributed processing data optimized for processing, and transmit the configured distributed processing data to one or more cloud devices 200 connected to the rendering service network, and distributed rendered realistic scene partial images from the cloud devices 200 . A more detailed configuration of a bar capable of composing a realistic scene image of a first viewpoint corresponding to the three-dimensional virtual space interior content by receiving the contents will be described later with reference to FIGS. 9 to 15 .

In addition, the rendering unit 160 according to an embodiment of the present invention determines a partial transformation boundary region corresponding to an influence range by object transformation, corresponding to the first object before transformation and the second object after transformation, and performs partial transformation Only the realistic scene image re-rendering process corresponding to the boundary area is performed, and the re-rendered scene image part and the remaining existing scene image part are combined to generate a realistic scene image in which the first object is converted into a second object, thereby re-computing It is possible to provide an object conversion process that minimizes the amount of computation in the process and prevents a sense of heterogeneity from occurring. A more detailed configuration will be described later with reference to FIGS. 16 to 20 .

In addition, the service providing unit 170 provides service functions such as space interior experience, interior editing, furniture tagging, and provision of furniture information and purchase information, based on the interior layout automation information.

In addition, the service providing unit 170 may include a market platform interface module for processing market platform services and mediation request information, and support the production and registration of realistic scene image content to be used in the market platform interface module. It may include a virtual space interior content creation module for

For example, the service providing unit 170 uses the virtual space interior content creation module to allow the content creator terminal 400 to produce realistic scene image content including furniture information and purchase links used for interior arrangement. In addition, it is possible to obtain manufacturer information and register matching on the database of the storage unit 180 .

Also, for example, the service providing unit 170 may display a tagging interface of one or more furniture information included in the video image on which the interior layout automation information is rendered through the interface output unit 150 to the user terminals 300 , 400 , 500 . ), and a service providing the furniture information and a purchase link according to a user input corresponding to the tagging interface may be processed.

Accordingly, the user can be provided with an automated interior layout service, and can check detailed information and purchase information of furniture to be actually directly applied to his or her own indoor space.

The interface output unit 150 is for generating an output related to sight, hearing, or tactile sensation by providing the interface as described above through the user terminals 300 , 400 , and 500 , and the user terminals 300 , 400 and 500 have A display unit, a sound output module, an alarm unit, and a haptic module may be included, and the interface output unit 150 transmits data for controlling the display unit, the sound output module, the alarm unit, and the haptic module to the user terminal 300, 400, 500).

The display unit of the user terminals 300 , 400 , and 500 displays (outputs) information provided by the service providing apparatus 100 . For example, when the user terminals 300 , 400 , and 500 are in the indoor simulation mode, a user interface (UI) or graphic user interface (GUI) related to an indoor simulation and a floor plan is displayed. In addition, a user interface for generating indoor structure information according to an embodiment of the present invention may be displayed on the interface screen.

The display unit includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, 3 It may include at least one of a 3D display.

The storage unit 180 may store a program for the operation of the control unit 140 and may temporarily store input/output data.

The storage unit 180 includes a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, It may include at least one type of storage medium among a magnetic disk and an optical disk. The service providing apparatus 100 may operate in relation to a web storage that performs a storage function of the storage unit 180 on the Internet.

The control unit 140 generally controls the overall operation of the terminal, and the control unit 140 stores the interior structure information in which the interior automation is processed according to user input information received from the user terminals 300 , 400 , and 500 . Data stored in the unit 180 or rendered through the communication unit 105 may be processed to be transmitted to the user terminals 300 , 400 , and 500 .

For example, 3D furniture object data generated by a user of the user terminals 300 , 400 , 500 , 3D space interior data, or interior structure information in which the interior automation is processed may be stored in the service providing apparatus 100 . It may be stored and managed in the cloud device 200 or the service providing device 100 by matching the user account information.

3 is a block diagram for explaining in more detail a service providing unit according to an embodiment of the present invention.

Referring to FIG. 3 , the service providing unit 170 according to an embodiment of the present invention includes a user information registration unit 1701 and a realistic scene image content registration unit 1703 . It includes a market platform interface providing unit 1705 , a mediation information processing unit 1707 , and a reward providing unit 1709 .

The user information registration unit 1701 may receive user information of each of the consumer terminal 300 , the content producer terminal 400 , and the real estate operator terminal 500 , and store and register in advance in the storage unit 180 .

And, the realistic scene image content registration unit 1703, according to the request of the content creator terminal 400, processes distributed rendering based on the virtual space content data produced by one or more user terminals, to obtain one or more realistic scene image content It is possible to configure, store and register the one or more realistic scene image contents in the database of the storage unit 180 by matching the contents with the creator information.

In addition, the market platform interface providing unit 1705 may provide an intermediary interface authoring service using the realistic scene image to the real estate operator terminal 500 , and real estate based on the authoring data input from the real estate operator terminal 500 . Product information can be registered and processed on the real estate market platform interface. The registered product information may be shared with one or more consumer terminals 300 .

Accordingly, the market platform interface providing unit 1705 may provide the real estate product information to the consumer terminal 300 through the real estate market platform interface. Here, the real estate product information may include the above-described realistic scene image content.

Then, the mediation information processing unit 1707 checks the mediation request information input from the consumer terminal 300 and processes related information. The brokerage information processing unit 1707 may include one or more brokerage modules (not shown) for supporting real estate transaction brokerage information corresponding to the brokerage request of the consumer terminal 300 and related interior company recommendation processing, and the brokerage information is It may be transmitted to the reward providing unit 1709 .

And, according to the brokerage information, the reward providing unit 1709 provides or pays a reward of a preset ratio or quantity corresponding to the producer information of the realistic scene image applied to the real estate product information to the account corresponding to the producer information. can

In addition, the preset ratio or quantity of the reward may be determined in various ways.

For example, the preset ratio or quantity of the reward may be determined according to the evaluation information of the realistic scene image collected through the real estate market platform interface in response to the real estate product information. The evaluation information may include the number of views, a rating value, the number of like selections, and the like.

In addition, the reward providing unit 1709 receives a content usage fee from the real estate operator terminal 500 when the real estate product information is registered in the real estate market platform interface as well as a reward for real estate brokerage information, and the creator Information may also be delivered to a corresponding user account.

According to such processing, a realistic interior scene image based on the construction of each user's three-dimensional indoor spatial data can be easily configured, and a market platform interface based on the configured realistic scene image content can be provided. It is easy to create a mediation interface for real estate product information based on a competitive realistic interior scene image without the need for human resources.

In addition, by registering the creator information of such realistic interior scene image content, it is possible to provide a reward according to a real estate operator's charge or reward setting, thereby increasing the participation of content creators, which leads to activation of the market platform service will come

4 is a flowchart for describing a service providing method according to an embodiment of the present invention in more detail.

Referring to FIG. 4 , the service providing apparatus 100 according to an embodiment of the present invention processes distributed cloud rendering based on three-dimensional virtual space interior information produced by one or more user terminals 300 , 400 , and 500 . , composes a realistic interior scene image content corresponding to one or more viewpoints (S1101).

Then, the service providing apparatus 100 matches the actual scene image content with the producer information and registers it in the database of the storage unit 180 ( S1103 ).

In addition, the service providing apparatus 100 provides a mediation interface authoring tool using realistic scene image content to a real estate operator terminal through a market platform interface (S1105).

Here, the mediation interface authoring tool may include an interface capable of indexing and selecting product information to be registered in the market platform in the real estate operator terminal 500 and the corresponding realistic scene image content.

As described above, since tag information corresponding to an interior product or style disposed in an indoor space may be mapped to realistic scene image content, the mediation interface authoring tool is one corresponding to the product information input by the real estate operator terminal 500 . By indexing the above realistic scene image contents using the tag information, it is possible to provide a function to be arranged on the mediation interface. For example, when the interior construction product information input from the real estate operator terminal 500 includes specific interior products or style information, the actual scene image content including the specific interior product or style information as tag information is indexed and the It can be provided through an intermediary interface.

Then, the service providing apparatus 100 registers real estate product information on the market platform interface according to the mediation interface authoring data input from the real estate operator terminal (S1107).

Thereafter, the service providing apparatus 100 provides realistic scene image content through the mediation interface of real estate product information output from the consumer terminal 300 connected to the market platform ( S1109 ).

Here, the realistic scene image content may include the tag information as described above, and the consumer terminal 300 checks each tag information and the details of the real estate product information, and provides the corresponding brokerage request information. can be entered into the mediation interface.

And, the service providing apparatus 100 performs mediation processing of the mediation request information input from the consumer terminal 300 (S1111), and based on the mediation information, a ratio preset to the user terminal 400 of the content creator or A quantity of rewards is provided (S1113).

5 is a diagram for explaining a real estate market platform interface based on a realistic scene image according to an embodiment of the present invention.

As shown in Figure 5 (A), the content creator terminal 400, based on the three-dimensional virtual space interior data according to an embodiment of the present invention, one or more realistic scene image content corresponding to the indoor space of various real estate can be configured as a distributed rendering method.

And, as shown in FIG. 5(B), the configured realistic scene image content may be processed as real estate product information in the real estate operator terminal 500 and provided through an intermediary interface.

For example, according to an embodiment of the present invention, the mediation interface may be a general real estate mediation interface or may include a real estate mediation interface including recommended interior and interior company recommendation information as shown in FIG. 5(B) .

More specifically, for example, the interior operator may register a realistic scene image portfolio in the service providing apparatus 100 using his/her own information. And, when the request information inputted from the consumer terminal 300 includes the required condition information, the recommended interior and the interior company recommendation information will be provided on the intermediary interface along with the realistic scene image content corresponding to the required condition information. can

The consumer terminal 300 may select a desired interior company or a recommended interior, and may receive realistic scene images corresponding to the interior portfolio of the interior business operator, along with a real estate brokerage request to the real estate business terminal 500, the selected interior business side You can also request for interior design construction.

In addition, the service providing apparatus 100 may determine a recommended interior business operator in consideration of the priority corresponding to the requirement information of the brokerage request information, and provide a portfolio based on the content of the actual scene image of the determined business operator. The requirement information may include, for example, an interior object, an interior type, an address, a building name, a construction unit price, a construction period, and the like.

In addition, the service providing device 100 may pay a reward to the creator account of the content creator terminal 400 corresponding to the realistic scene image provided in the mediation interface when a mediation request or consultation application corresponding to the mediation interface is confirmed. , the number of visitors corresponding to the mediation interface, the number of likes, the evaluation score, the number of bookmark registrations, the ratio or quantity of rewards may be determined according to at least one of mediation performance information or consultation performance information.

6 to 8 illustrate an indoor structure information interface provided by a service providing apparatus and outputted from a user terminal according to the execution of the method according to an embodiment of the present invention.

Referring to FIG. 6 , the service providing apparatus 100 according to an embodiment of the present invention sets the interior automation mode corresponding to the user's indoor structure information through the interface output unit 150 to the user terminals 300 , 400 , and 500 . can be provided as The user inputs desired style photo or image information as style-related information through the input unit of the user terminals 300 , 400 , 500 , sets a preferred style pattern, sets specific preferred furniture, or any recommended style without separate setting may be set and input, and input information of the user terminals 300 , 400 , and 500 may be provided to the input unit 110 of the service providing apparatus 100 . In addition, the user may start the style analysis of the style information analysis unit 120 and the layout generation processing of the layout generation processing unit 130 according to an embodiment of the present invention by inputting an automatic arrangement button.

And, referring to FIG. 7, FIG. 7 is a diagram for explaining a layout automation result interface generated according to an embodiment of the present invention, in which an interior structure interface in which a space layout and an interior are automatically arranged is rendered, and an interface output unit ( 160) to the user terminals 300, 400, and 500 are shown.

As shown in FIG. 7 , the user can check the list of placed products, furniture information, and purchase information, select storage or sharing of interior structure information processed by interior automation, or perform automated processing by other styles. You may request again. In this way, by enabling the automation of interior layout processing of interior structures according to various users' style input, users can create space and interior design information intuitively and conveniently without requiring a separate precise design or requesting work from an expert. do.

8 is an exemplary diagram of a virtual space interior display including a tag interface according to an embodiment of the present invention.

As shown in FIG. 8 , the service providing apparatus 100 according to an embodiment of the present invention provides a space and layout interface rendered in a virtual space to the user terminals 300 , 400 , 500 through the interface output unit 150 . 101 may be output, and the above-described interfacing points 101 may be output on the space and layout interface. In FIG. 5 , the interfacing points 101 are displayed in a circular shape disposed on an object, but may also be output in various other forms, such as a separate icon image, a square, a triangle, or a three-dimensional object.

In particular, the interfacing points according to an embodiment of the present invention can arrange the objects exposed on the user's viewing area in an optimized position so that they do not overlap and do not overlap, and the user can comfortably and comfortably without stress due to excessive object information identification. You can choose the interior object you want.

In addition, when the user performs a pointing input such as a touch or a virtual touch corresponding to the interfacing point 101 through the user terminals 300 , 400 , and 500 , the tag interface 103 may be output. The tag interface 103 may be linked with various service functions such as object information provided by the service providing unit 170 , related content information, and purchase information. In addition, the service providing unit 170 may collect user selection input information and use it for future statistical analysis of users, provision of recommended interiors, and the like.

9 is a block diagram illustrating in more detail a space and interior rendering unit according to an embodiment of the present invention, and FIGS. 10 to 11 are diagrams illustrating realistic scene rendering-processed images according to an embodiment of the present invention.

As described above, the rendering unit 160 according to an embodiment of the present invention provides virtual space interior content provided to the user terminals 300 , 400 , and 500 by using a cloud service network constituted by the cloud device 200 . It is possible to perform distributed rendering into a realistic scene image, and build a realistic scene image database corresponding to each viewpoint from the distributed rendered partial rendering image in the storage unit 180 .

And, the rendering unit 160, according to the request of the control unit 140, the service providing unit 170, or the user terminals (300, 400, 500), the 3D virtual space interior content corresponding to each view realistic scene images. It may be provided to the user terminals 300 , 400 , and 500 .

Here, the 3D virtual space interior content may include furniture content pre-built in relation to the interior, indoor space interior content created by a user, or automatically constructed indoor space interior content. In addition, the realistic scene image processing may include the global illumination-based rendering distribution process as described above, and the rendering unit 160 is a data optimization process for effectively processing computing resources in the global lighting-based rendering distribution process can be performed.

In addition, the rendering unit 160 may perform object conversion processing for converting one or more first objects included in the realistic scene image into a second object according to the request of the user terminals 300 , 400 , and 500 , and thus By rendering the object-converted realistic scene image, it can be provided to the user terminals 300 , 400 , and 500 .

More specifically, referring to FIG. 9 , the rendering unit 160 according to an embodiment of the present invention includes a geometric information optimization unit 1601 , a texel information optimization unit 1602 , a transport packet processing unit 1603 , and a realistic scene image. It includes a construction unit 1604 and an object transformation image reconstruction unit 1605 .

The geometric information optimizer 1601 may optimize the geometric data of the scene image projected to the first viewpoint in response to the 3D virtual space interior.

The geometric information optimization unit 1601 according to an embodiment of the present invention indexes geometric data to be optimized for geometric data optimization, and configures geometric data that can be processed as meta information among the indexed geometric data as a meta information index, A geometric buffer including at least a portion of the indexed geometric data and the meta information index is configured and transmitted to the transport packet processing unit 1603 .

Then, the transport packet processing unit 1603 packetizes the geometric data corresponding to the geometric buffer and the index in the buffer, and transmits the packetized data to one or more cloud devices 200 .

In general, model data in 3D graphic applications can be mainly described as geometric data, but when looking at the geometric data pattern, the proportion of data generated by vertices such as vertices, normals, and faces is about 45% to 95% of the total. It can be seen that it occupies, and it can be seen that it is significantly larger than the data generated by other commands. Therefore, it can be seen that the geometric data in the transport packet requested for distributed processing by the cloud device 200 has an average overlap rate of 35% to 61%.

Accordingly, the geometry information optimization unit 1601 according to an embodiment of the present invention is a method for reducing network traffic required for distributed processing using the cloud device 200, and the geometry including vertex information among data to be distributed is requested. When geometric data similar to the data already exists, the overall network bandwidth for implementing the realistic scene image rendering process as a cloud service can be lowered by processing the corresponding meta information index mapping and transmitting only the meta information index.

For example, the meta information index of the geometric data may include at least one of index information of the geometric data to be transmitted and position information, rotation information, and scale information index corresponding to the index information.

Accordingly, the cloud device 200 may distribute and perform photorealistic rendering processing such as global illumination-based ray tracing using the geometric data and meta information index, and the required amount of network bandwidth for this may be reduced.

Meanwhile, the texel information optimization unit 1602 may process the optimization of texture pixel data (texel data) in which a 3D object rendered by geometric data is projected onto a 2D realistic scene image.

More specifically, for texture data optimization, the texel information optimization unit 1602 configures a Z buffer corresponding to the texture data to be optimized, and resizes the texture data according to the texture ratio configured in the Z buffer to be used for rendering. Texel information and memory area information are acquired, and the texture data to be resized is indexed according to the memory area information and the texel information to configure a texture buffer.

The texture buffer thus constructed may be transmitted to the transport packet processing unit 1603 , and the transport packet processing unit 1603 may include a texture buffer including indexing information of texture data to be resized and a texture data portion including texture data to be resized The rendering request may be packetized and transmitted to the cloud device 200 .

Here, the Z-buffer is a 3D graphics image depth coordinate management method. When 3D data is rendered as a 2D scene image, the depth information (z coordinate) of the pixel configured by resizing is stored. It can mean a buffer. These buffers can be aligned with the respective screen pixel elements based on the two-dimensional coordinates of (xy). If another object needs to be rendered in the same pixel, the Z buffer is selected between the current pixel and the newly drawn pixel. It can be used to compare depth which one is closer to the observer.

Various technical elements well-known in the graphic processing field may be used for this Z-buffer configuration process. According to the Z-buffer configuration, resizing information of texel information to be rendered and memory information used for rendering may be acquired in advance.

Accordingly, the texel information optimization unit 1602 according to an embodiment of the present invention configures the Z buffer in order to reduce the redundancy rate of data to be transmitted to the cloud device 200, reduce the capacity of the transmission packet and increase the bandwidth efficiency. A texture buffer including texture data to be resized by the process, index information of texture data to be resized, and memory area information corresponding to the texture data to be resized may be configured and delivered to the transport packet processing unit 1603 there is.

Also, the texture buffer may include meta information mapped to index information of texture data, and the meta information may include main texel information and representative color information. Here, the representative color information may include color information representing the overall color of the texture data requested for partial rendering, and the main texel information includes texture information allocated corresponding to the main object in the 3D virtual space to be rendered. can do.

As described above, according to the texture buffer configuration requested for distributed rendering, the cloud device 200 performs rendering of a realistic scene image for each texel corresponding to the main texel region when constructing rendering data, and the remaining region is a realistic scene using representative color information. By batch processing image rendering, efficient data processing can be performed.

In addition, according to the texture buffer configuration of the texel information optimization unit 1602, the texture data included in the transport packet is resized and indexed based on the Z buffer configuration process, so that the transport packet capacity can be reduced, and the overlapping usage rate is reduced. By reducing the bar network bandwidth and usage rate, efficient distributed processing of realistic scene images becomes possible.

On the other hand, the realistic scene image configuration unit 1604 receives a partial scene image rendered in each cloud device 200 based on the data transmitted from the transport packet processing unit 1603 to the cloud device 200, and the received partial scene Combining images to compose a realistic scene image corresponding to the first viewpoint, storing and managing through the storage unit 140, and pre-built realistic scene images at the request of the user terminals (300, 400, 500) can provide As described above, the first viewpoint may be extended to a plurality of viewpoints, and the realistic scene image according to an embodiment of the present invention is a plurality of realistic scene images in the form of omnidirectional (720 degrees) or 360-degree realistic scene images of specific objects. It may also be provided as scene image content.

The object transformation image reconstruction unit 1605 determines a partial transformation boundary region corresponding to the range of influence by object transformation, corresponding to the first object before transformation and the second object after transformation, and realistically corresponding to the partial transformation boundary region. Only the scene image re-rendering process is performed, and the re-rendered scene image part and the remaining existing scene image part are combined to generate a realistic scene image in which the first object is converted into a second object, thereby minimizing the amount of computation of the re-computation process. It is possible to provide object conversion processing that prevents a sense of heterogeneity from occurring.

More specifically, the object conversion image reconstruction unit 1605 may determine a conversion target first object of the virtual space interior content corresponding to the first realistic scene image, and the first object is a furniture object to which a tag interface is mapped. can be exemplified.

In addition, the object conversion image reconstruction unit 1605 may set a first boundary area corresponding to the first object before conversion and a second boundary area corresponding to the second object after conversion, the first boundary area and the second boundary area. After merging the regions, it is possible to determine the partial transformation boundary region according to the convex hull algorithm, and the object transformation image reconstruction unit 1605 may reconstruct the object transformed image through re-rendering processing corresponding to the partial transformation boundary region. there is.

Here, the re-rendering process may be performed by the object transformation image reconstruction unit 1605 of the service providing apparatus 100, but preferably the above-described geometric information optimization unit 1601 and texel information optimization unit 1602, The request may be made to one or more cloud devices 200 through the transport packet processing unit 1603 and distributed processing may be performed.

More specifically, the object transformation image reconstruction unit 1605 may acquire blank setting information for setting the first boundary region and the second boundary region, and the blank setting information of the first boundary region is the existing first It may correspond to a range of a surrounding area affected by the object, and the blank setting information of the second boundary area may correspond to a range of a surrounding area affected by the second object to be replaced. Each boundary area may have various shapes, but a rectangular shape is preferable to improve processing efficiency.

In addition, the object transformation image reconstruction unit 1605 may determine a merge region in which the first boundary region and the second boundary region are merged. Here, when the first boundary area and the second boundary area are simply overlapped, the merge area may not be formed as a whole.

Accordingly, the object transformation image reconstruction unit 1605 may apply the convex hull algorithm to determine a merge structure including one or more first intersection points formed by intersecting the first boundary region and the second boundary region, the merge structure and A partial transformation boundary region including the intersection point may be determined.

Accordingly, the partial transformation boundary region may be a region in which the first boundary region and the second boundary region are simply combined, or may be a region merged according to a convex hull algorithm. In addition, the object transformation image reconstruction unit 1605 may generate distributed rendering request data using the partial transformation boundary area and second object information to be replaced, and may transmit it to one or more cloud devices 200 .

Accordingly, an area to be re-rendered according to the selected specific first object and the second object to be replaced may be minimized, and bandwidth efficiency and network usability may be increased while throughput is reduced.

10 is a virtual space interior content of the rendering unit 160 according to an embodiment of the present invention, and is an exemplary view of processing a realistic scene image corresponding to the interior space structure.

As shown in the upper part of FIG. 10 , first viewpoint information and global illumination information may be preset through the user terminals 300 , 400 , 500 or the service providing apparatus 100 .

And, the virtual space interior information is a photorealistic scene image as shown in the lower part of FIG. 7 according to the cloud device 200-based distributed rendering processing of the rendering unit 160 corresponding to the set lighting information and viewpoint information. It may be configured and provided to the user terminals 300 , 400 , and 500 .

11 is a virtual space interior content of the rendering unit 160 according to an embodiment of the present invention, and is an exemplary view of processing a realistic scene image corresponding to furniture interior information.

11 , furniture information to be rendered may be preset through the user terminals 300 , 400 , and 500 or the service providing apparatus 100 .

And, the virtual space interior information including the furniture information is composed of a photorealistic scene image as shown in the right side of FIG. 11 according to the cloud device 200-based distributed rendering process of the rendering unit 160, and the user It may be provided to the terminals 300 , 400 , and 500 .

12 to 14 are flowcharts for explaining in more detail the operation of the rendering unit according to an embodiment of the present invention.

First, FIG. 12 is a first flowchart for explaining the operation of the rendering unit 160 of the service providing apparatus 100 according to an embodiment of the present invention, in which the service providing apparatus 100 corresponds to a 3D virtual space interior; The geometric buffer according to the geometric data optimization processing decision of the scene image projected to the first viewpoint is initialized ( S101 ).

Then, the service providing apparatus 100 indexes geometric data (eg, vertex data) to be optimized ( S103 ), and determines whether processing of meta information corresponding to the geometric data is necessary ( S105 ).

Here, whether or not to process the meta information may be determined according to whether the same or similar geometric data to be included in the geometric buffer exists, whether to decrease the bandwidth, whether to increase or decrease the compression rate, etc. 100) inserts the geometric data and index information corresponding to the geometric data into the geometric buffer without meta information processing (S107), and packetizes the geometric data and the geometric data corresponding to the index in the buffer and transmits it to one or more cloud devices ( S109).

On the other hand, when meta information processing is required, the service providing apparatus 100 configures meta information (position information, rotation information, scale information) of the geometric data as a meta information index and inserts it into the geometry buffer (S111), The buffer and geometric data corresponding to the meta information index in the buffer are packetized and transmitted to one or more cloud devices (S113).

Thereafter, the service providing device 100 receives the partially rendered realistic scene partial image using the geometric buffer from the plurality of cloud devices 200, and configures a realistic scene image corresponding to the 3D virtual space interior content ( S115).

13 is a second flowchart for explaining the operation of the rendering unit 160 of the service providing apparatus 100 according to an embodiment of the present invention, wherein the service providing apparatus 100 corresponds to a 3D virtual space interior; The texture buffer according to the texture data optimization process decision of the scene image projected to the first viewpoint is initialized ( S201 ).

Then, the service providing apparatus 100 configures a Z buffer corresponding to the texture data to be optimized ( S203 ).

Thereafter, the service providing apparatus 100 resizes the texture data according to a ratio configured in the Z buffer to obtain texel information and memory area information to be used for rendering ( S05 ).

Then, the service providing apparatus 100 indexes the texture data to be resized according to the memory area information and the texel information and inserts it into the texture buffer ( S207 ).

Thereafter, the service providing apparatus 100 packetizes the texture buffer including indexing information of the texture data to be resized and transmits it to the cloud apparatus 200 ( 209 ).

Then, the service providing apparatus 100 receives the partially rendered realistic scene partial image using the texture buffer, and configures a realistic scene image corresponding to the 3D virtual space interior content ( S211 ).

Meanwhile, FIG. 14 is a flowchart for explaining the operation of the cloud device 200 according to an embodiment of the present invention.

Referring to FIG. 14 , the cloud device 200 receives packet data for distributed rendering from the service providing device 100 that is the master device ( S301 ).

Then, the cloud device 200 first obtains geometric data and meta information indexes from the packet data, and performs vertex shader processing and rasterization processing (S303).

Then, the cloud device 200 acquires indexing information and texture data of the texture data subjected to the Z-buffer-based resizing process from the packet data, and allocates a memory for applying the fragment shader ( S305 ).

Thereafter, the cloud device 200 configures a partially rendered realistic scene image by applying a fragment shader corresponding to the rasterized data and determining a rasterized pixel value ( S307 ).

Then, the cloud device 200 transmits the partially rendered realistic scene image to the service providing device 100 which is the master device (S309).

Here, the cloud device 200 may perform a process of various global illumination methods for imparting a photorealistic effect in the shading processing of each step, and the global illumination method is preferably a ray that traces back rays A ray tracing method may be exemplified, but further methods such as path tracing, photon mapping, and radiosity may be added.

15 is a diagram for explaining the structure of a transport packet configured in the rendering unit 160 according to an embodiment of the present invention.

15(A) shows the data structure before optimization. Geometric data such as Vector3f and texture data such as X, Y, and Z may overlap on the entire original 3D data.

Accordingly, the rendering unit 160 according to an embodiment of the present invention performs indexing processing of the geometric meta information through the geometry information optimization unit 1601 , and through the texel information optimization unit 1602 , the Z-buffer-based texel By processing the information and memory information indexing, it is possible to construct the optimized transport packet data as shown in Fig. 12(B).

According to the data optimization processing of the service providing device 100 , the cloud service network-based realistic scene data configuration is possible, the quality of the realistic scene image provided to the user terminals 300 , 400 , 500 is improved, and the processing time is shortened, network bandwidth is reduced, and overall service efficiency can be improved.

16 to 20 are diagrams for explaining in more detail an object conversion operation of a rendering unit according to an embodiment of the present invention.

First, referring to FIG. 16 , the object transformation image reconstruction unit 1605 sets the transformation object of the virtual space interior content corresponding to the first realistic scene image ( S401 ).

Then, the object conversion image reconstruction unit 1605 sets a first boundary area corresponding to the first object before conversion (S403).

Thereafter, the object transformation image reconstruction unit 1605 sets a second boundary region corresponding to the second object after transformation ( S405 ).

Then, the object transformation image reconstruction unit 1605 merges the first boundary region and the second boundary region, and then determines the partial transformation boundary region according to the convex hull algorithm.

Thereafter, the object transformation image reconstruction unit 1605 performs a re-rendering process corresponding to the partial transformation boundary region (S409), and combines the re-rendered scene image part and the remaining existing image part of the first realistic scene image, A converted realistic scene image is generated (S411).

Then, the object-converted image reconstruction unit 1605 stores and manages the converted real scene image as a second object-converted second real scene image for the first object (S413).

Then, the object conversion image reconstruction unit 1605, according to the object replacement request in the image, the conversion service using the pre-converted second realistic scene image through the service providing unit 170 to the user terminals (300, 400, 500) is provided (S415).

Here, referring to FIG. 17 , in FIG. 17 , boundary regions for changing the first object 13 before transformation into the second object 12 after transformation are respectively shown. Referring to FIG. 17 , the first boundary area 13 and the second boundary area 14 may be determined differently depending on the shape or shape of each object 11 and 12 .

And, referring to FIG. 18 , in the object transformation image reconstruction unit 1605 according to an embodiment of the present invention, a merge region 15 in which the first boundary region 13 and the second boundary region 14 are merged is formed. can be

As the merging area 15 is formed, an object range that substantially affects the composition of a realistic scene image may be set.

However, since the object range is preferably a polygon, it is preferably set as the convex hull area merging area 15 for configuring the polygon.

And, as shown in FIG. 19 , the convex hull region may mean a convex polygonal region configured to include all remaining nodes when some of the points (nodes) constituting the polygon are connected. Various general algorithms may be used to determine the convex hull region, and a Graham's scan method that can be performed in O(n) time according to the arrangement of nodes may be exemplified.

It consists of a list that sorts the edges of nodes in a clockwise or counterclockwise order, and sequentially indexes each node in a clockwise or counterclockwise direction, depending on whether it is included in the convex hull region, composing the convex hull. It is a method of determining whether or not a node is a node.

Accordingly, FIG. 19 shows that the determined merge region 15 is determined according to the convex hull algorithm.

In addition, the object transformation image reconstruction unit 1605 may determine the merge region 15 as a partial transformation boundary region. The object-converted image reconstruction unit 1605 may reconstruct the object-converted real scene image through re-rendering corresponding to the partial transformation boundary region without a separate full image rendering.

20 is an exemplary view of interface screens of the user terminals 300 , 400 , and 500 according to the re-rendering process of the object transformation image reconstruction unit 1605 according to an embodiment of the present invention.

As shown in FIG. 20A , the user of the user terminals 300 , 400 , and 500 may select the first object 11 to be replaced on the virtual space interior image rendered with the realistic scene image, and the service providing device ( 100 may determine the corresponding first boundary area 13 to have a rectangular shape.

And, as shown in FIG. 20B , the user may select second object information to be replaced. For example, the second object 12 may be a replaceable furniture interior such as a chair or a sofa, and related 3D object information may be pre-stored in the storage unit 140 .

Thereafter, when a replacement confirmation input is received as shown in FIG. 20(C) , the service providing apparatus 100 is a first image rendered as a realistic scene image, as shown in FIG. 20(D), in FIG. 20( A second realistic scene image including a pre-built second object 12 by processing only the re-rendering corresponding to the partial transformation boundary region 15 as shown in E) and merging with the remaining regions that are not re-rendered, It can be output to the user terminal (300, 400, 500).

According to such processing, even if an object is changed, high-complexity rendering such as global illumination rendering for each object transformation is partially processed and merged instead of being completely reprocessed, so efficiency can be improved, and partial transformation that does not reduce the sense of heterogeneity and realism Since it is possible to configure the boundary area, it is possible to provide a natural object conversion service process.

The method according to the present invention described above may be produced as a program to be executed by a computer and stored in a computer-readable recording medium. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape. , a floppy disk, an optical data storage device, and the like, and also includes those implemented in the form of a carrier wave (eg, transmission through the Internet).

The computer-readable recording medium is distributed in a network-connected computer system, so that the computer-readable code can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the method can be easily inferred by programmers in the art to which the present invention pertains.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims In addition, various modifications may be made by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or outlook of the present invention.

Claims (15)

In the method of operating a service providing device,
processing distributed rendering based on virtual space content data produced by one or more user terminals to configure one or more realistic scene image content;
registering the one or more realistic scene image contents in a database by matching them with producer information;
providing a real estate brokerage interface authoring service using the realistic scene image to a real estate operator terminal; and
Comprising the step of registering real estate product information based on the authoring data input from the real estate operator terminal on a real estate market platform interface
How the service providing device works. According to claim 1,
providing the real estate product information to a consumer terminal through the real estate market platform interface; and
According to the payment processing of the order information input from the consumer terminal, further comprising the step of providing a reward of a preset ratio or quantity corresponding to the producer information of the realistic scene image applied to the real estate product information
How the service providing device works. 3. The method of claim 2,
The preset ratio or quantity of the reward is,
Determined according to the evaluation information of the realistic scene image collected through the real estate market platform interface in response to the real estate product information
How the service providing device works. 3. The method of claim 2,
When the real estate product information is registered in the real estate market platform interface, receiving a content usage fee from the real estate operator terminal, further comprising the step of transmitting the content to a user account corresponding to the producer information
How the service providing device works. 3. The method of claim 2,
The real estate market platform interface includes a real estate brokerage interface,
The preset ratio or quantity of the reward is determined according to brokerage performance information or consultation performance information corresponding to the real estate brokerage interface
How the service providing device works. According to claim 1,
The step of composing the one or more realistic scene image contents,
composing distributed processing data optimized for distributed rendering processing of a realistic scene image projected to a first viewpoint in response to 3D virtual space content to be provided to a user terminal;
transmitting the configured distributed processing data to one or more cloud devices connected to a rendering service network; and
Receiving distributed rendered realistic scene partial images from the cloud device, comprising the step of composing a first-view realistic scene image corresponding to the 3D virtual space content
How the service providing device works. 7. The method of claim 6,
The step of composing the one or more realistic scene image contents,
setting a transformation object in virtual space content corresponding to the first realistic scene image;
Determining a partial transformation boundary region corresponding to an influence range by object transformation corresponding to the first object before transformation and the second object after transformation according to the transformation object setting;
performing a realistic scene image re-rendering process corresponding to the partial transformation boundary region; and
By combining the re-rendered realistic scene image portion and the remaining portion of the first realistic scene image except for the partial transformation boundary region, the first object is converted into the second object to construct a second realistic scene image including steps
How the service providing device works. In the service providing device,
a space and interior rendering unit that processes distributed rendering based on virtual space content data produced by one or more user terminals to configure one or more realistic scene image content; and
and a service providing unit that matches the one or more realistic scene image contents with producer information and registers it in a database,
The service provider,
a virtual space interior content creation module that provides a mediation interface authoring service using the realistic scene image to a real estate operator terminal; and
and a market platform interface module for registering real estate product information based on author data input from the real estate operator terminal on a real estate market platform interface.
Service providing device. 9. The method of claim 8,
The service provider,
a market platform interface providing unit providing the real estate product information to a consumer terminal through the real estate market platform interface; and
In accordance with the payment processing of the order information input from the consumer terminal, comprising a reward providing unit that provides a reward of a preset ratio or quantity corresponding to the producer information of the realistic scene image applied to the real estate product information
Service providing device. 10. The method of claim 9,
The preset ratio or quantity of the reward is,
Determined according to the evaluation information of the realistic scene image collected through the real estate market platform interface in response to the real estate product information
Service providing device. 10. The method of claim 9,
The reward providing unit,
When the real estate product information is registered in the real estate market platform interface, a content usage fee is paid from the real estate operator terminal and delivered to a user account corresponding to the producer information
Service providing device. 10. The method of claim 9,
The real estate market platform interface includes a real estate brokerage interface,
The preset ratio or quantity of the reward is determined according to brokerage performance information or consultation performance information corresponding to the real estate brokerage interface
Service providing device. 9. The method of claim 8,
The space and interior rendering unit,
In response to the 3D virtual space content to be provided to the user terminal, distributed processing data optimized for distributed rendering processing of the realistic scene image projected to the first viewpoint is configured, and the configured distributed processing data is connected to a rendering service network. Transmitting to one or more cloud devices, receiving distributed rendered realistic scene partial images from the cloud devices, and configuring a first-view realistic scene image corresponding to the 3D virtual space content
Service providing device. 14. The method of claim 13,
The space and interior rendering unit,
Set a transformation object in the virtual space content corresponding to the first realistic scene image, and corresponding to the first object before transformation and the second object after transformation according to the transformation object setting, partial transformation corresponding to the range of influence by object transformation A boundary region is determined, and a realistic scene image re-rendering process corresponding to the partial transformation boundary region is performed, and the re-rendered realistic scene image part and the first realistic scene image are the remaining parts except for the partial transformation boundary region. By combining the object conversion image reconstruction unit that configures a second realistic scene image in which the first object is converted into the second object
Service providing device. A computer-readable recording medium in which a program for executing the method according to any one of claims 1 to 7 on a computer is recorded.

Images