KR102481969B1 - System for providing interior service providing three-dimentional simulation video - Google Patents

Abstract

Provided is a system for providing an interior-design service providing a 3D simulation video for each stage of construction work. The system comprises: a client terminal which receives a 3D simulation video for each stage of construction work and decides whether to confirm or not; at least one designer terminal which produces a 3D simulation video for each stage of construction work including planning design, basic design, working design, on-site shop drawing review, and construction management, transmits the produced 3D simulation video to the client terminal, and receives confirmation; and an interior-design service providing server. The interior-design service providing server comprises: a storage unit which stores data on work performance details and phased achievements for each stage of construction work including planning design, basic design, working design, on-site shop drawing review, feedback, and construction management; an allocation unit which transmits, to the at least one designer terminal, the data on the work performance details and phased achievements for each stage of construction work; a transmission unit which transmits a 3D simulation video corresponding to the phased achievements uploaded from the at least one designer terminal to the client terminal; and a confirmation checking unit which carries out a process to proceed to the next step when a confirmation is received from the client terminal. According to the present invention, by providing a 3D simulation video for each stage of construction work to a client, a different in thoughts between the client and a contractor after the interior design is completed can be minimized.

Description

Interior service providing system that provides 3D simulation video for each stage of construction

The present invention relates to an interior service providing system that provides 3D simulation images for each construction activity step, and provides a system capable of providing a client with 3D simulation for each construction activity step in advance.

The architectural design expression method has changed in various ways with the development of digital technology. In order to convey the design intent, it took a long time because it was done by hand, and the perspective drawing work was left to a non-expert, so the expert's intention could not be completely captured. With the advent of the CAD system for more efficient architectural design expression, efficient use of time and more accurate delivery of design intentions by experts have become possible. However, both drawings and 3D visualization images created by CAD systems are only symbolic representations, and there is difficulty in representing the same appearance of the actual indoor space. With the advent of photography, it has become possible to express indoor spaces that are perfectly identical to real buildings, but there is another difficulty in that general photographs also show only a fragmentary view of space.

At this time, a method for providing interior results in 3D simulation has been researched and developed. In this regard, prior art Korean Patent Publication No. 2018-0001261 (published on January 04, 2018) and Korean Patent Registration No. 10-1789931 ( Announced on November 21, 2017), when the customer terminal transmits the 2D image to the server, the server converts the 2D image into a 3D image and transmits 3D interior information based on the 3D image to the customer terminal; After creating walls and various interior objects on the 2D screen, create walls and create various interior objects based on the created walls so that they can be converted to 3D, convert the walls and interior objects created on the screen to 3D, A configuration of arranging interior objects by measuring the absolute size after checking the dimensions of the created wall is disclosed.

However, among the above configurations, the former simply converts a 2D image into a 3D image, so there is a limit to actually providing a sense of space beyond replacing with a photographic image as described above. Even in the latter case, only the arrangement of each interior object is initiated, and the BIM process for how to proceed with the interior is not disclosed. Therefore, while virtually modeling facilities from planning, design, engineering (structure, facility, electricity, etc.), construction and maintenance in multidimensional virtual space, research and development of an integrated platform that can provide and confirm 3D simulations to clients at each stage development is required

An embodiment of the present invention provides a 3D simulation to the client at each stage while virtually modeling facilities from planning, design, engineering, construction, and maintenance in a multidimensional virtual space, and based on a process that can receive confirmation, By providing 3D simulation images for each construction activity step, it is possible to minimize the difference or gap between the client and the constructor after the interior is completed, and the client can check and confirm each construction activity step in advance, so that the reconstruction or work is incomplete. It is possible to provide an interior service providing system that provides 3D simulation images for each stage of construction activity, which can minimize the risk of finishing, and which can also reduce the expenditure incurred by the construction company to zero. However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, an embodiment of the present invention receives a 3D simulation image for each stage of construction activity and determines whether or not to confirm the client's terminal, planning design, basic design, implementation design, on-site shop drawing drawing Review and feedback and at least one designer terminal receiving confirmation after producing a 3D simulation video for each construction activity step of construction management and sending it to the client terminal and planning design, basic design, construction design, on-site shop drawing drawing review and feedback and construction A storage unit for storing data on work performance details and results for each stage of management, an allocation unit for transmitting data on work performance details and results for each stage of construction activity to at least one designer terminal, at least one designer It includes an interior service providing server including a transmission unit that transmits 3D simulation images corresponding to step-by-step results uploaded from the terminal to the client terminal, and a confirmation confirmation unit that proceeds with a process to proceed to the next step when confirmation is received from the client terminal.

According to any one of the above-described problem solving means of the present invention, a process of providing and confirming a 3D simulation to a client at each stage while virtually modeling a facility in a multidimensional virtual space from planning, design, engineering, construction, and maintenance Based on this, by providing the client with 3D simulation images for each stage of construction activity, it is possible to minimize the difference or gap between the client and the constructor after the interior is completed, and the client can check and confirm each construction activity step in advance. The risk of reconstruction or work being completed incompletely can be minimized, and the construction company can also zero out the expenses incurred by proceeding with reconstruction.

1 is a diagram for explaining an interior service providing system that provides 3D simulation images for each stage of a building act according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating an interior service providing server included in the system of FIG. 1 .
3 and 4 are views for explaining an embodiment in which an interior service providing 3D simulation images for each stage of a building act according to an embodiment of the present invention is implemented.
5 is an operation flowchart for explaining a method for providing an interior service for providing 3D simulation images for each stage of a building act according to an embodiment of the present invention.
6 is a flowchart illustrating a method of providing a 3D simulation image selected for each construction activity step from a plurality of candidate group 3D simulation images for each construction activity step in an interior providing server according to a modified example of the present invention to a client terminal.

Hereinafter, embodiments of the present invention will be described in detail so that those skilled in the art can easily practice the present invention with reference to the accompanying drawings. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected" but also the case where it is "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, this means that it may further include other components, not excluding other components, unless otherwise stated, and one or more other characteristics. However, it should be understood that it does not preclude the possibility of existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

As used throughout the specification, the terms "about", "substantially", etc., are used at or approximating that value when manufacturing and material tolerances inherent in the stated meaning are given, and do not convey an understanding of the present invention. Accurate or absolute figures are used to help prevent exploitation by unscrupulous infringers of the disclosed disclosure. The term "step of (doing)" or "step of" as used throughout the specification of the present invention does not mean "step for".

In this specification, a "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized using two or more hardware, and two or more units may be realized by one hardware. On the other hand, '~ unit' is not limited to software or hardware, and '~ unit' may be configured to be in an addressable storage medium or configured to reproduce one or more processors. Thus, as an example, '~unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables. Functions provided within components and '~units' may be combined into smaller numbers of components and '~units' or further separated into additional components and '~units'. In addition, components and '~units' may be implemented to play one or more CPUs in a device or a secure multimedia card.

In this specification, some of the operations or functions described as being performed by a terminal, device, or device may be performed instead by a server connected to the terminal, device, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed by a terminal, apparatus, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal mean mapping or matching the terminal's unique number or personal identification information, which is the terminal's identifying data. can be interpreted as

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram for explaining an interior service providing system that provides 3D simulation images for each stage of a building act according to an embodiment of the present invention. Referring to FIG. 1 , the interior service providing system 1 that provides 3D simulation images for each stage of construction activity includes at least one client terminal 100, an interior service providing server 300, and at least one designer terminal 400. can include However, since the interior service providing system 1 that provides 3D simulation images for each stage of the building act shown in FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1 .

At this time, each component of FIG. 1 is generally connected through a network (Network, 200). For example, as shown in FIG. 1 , at least one client terminal 100 may be connected to the interior service providing server 300 through the network 200 . Also, the interior service providing server 300 may be connected to at least one client terminal 100 and at least one designer terminal 400 through the network 200 . In addition, at least one designer terminal 400 may be connected to the interior service providing server 300 through the network 200 .

Here, the network refers to a connection structure capable of exchanging information between nodes such as a plurality of terminals and servers, and examples of such networks include a local area network (LAN) and a wide area network (WAN: Wide Area Network), the Internet (WWW: World Wide Web), wired and wireless data communications networks, telephone networks, and wired and wireless television communications networks. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), 5th Generation Partnership Project (5GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi , Internet (Internet), LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), RF (Radio Frequency), Bluetooth (Bluetooth) network, NFC ( A Near-Field Communication (Near-Field Communication) network, a satellite broadcasting network, an analog broadcasting network, a Digital Multimedia Broadcasting (DMB) network, etc. are included, but not limited thereto.

In the following, the term at least one is defined as a term including singular and plural, and even if at least one term does not exist, each component may exist in singular or plural, and may mean singular or plural. It will be self-evident. In addition, the singular or plural number of each component may be changed according to embodiments.

At least one client terminal 100 is a terminal that receives and confirms 3D simulation images for each interior construction activity step by using an interior service-related web page, app page, program, or application that provides 3D simulation images for each construction activity step. can

Here, at least one client terminal 100 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop, a desktop, a laptop, and the like equipped with a navigation system and a web browser. At this time, at least one client terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one client terminal 100 is, for example, a wireless communication device that ensures portability and mobility, and includes navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet ) may include all types of handheld-based wireless communication devices such as terminals, smartphones, smart pads, tablet PCs, and the like.

The interior service providing server 300 may be a server providing an interior service web page, an app page, a program, or an application that provides 3D simulation images for each construction activity step. Further, the interior service providing server 300 may be a server that stores task execution details and achievements for each stage of construction activity, and registers at least one designer terminal 400 for each stage of construction activity. In addition, the interior service providing server 300 may be a server that collects results of each stage of construction activity from the designer terminal 400, transmits a 3D simulation image to the client terminal 100 before construction, and receives confirmation.

Here, the interior service providing server 300 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop, a desktop, a laptop, and the like equipped with a navigation system and a web browser.

At least one designer terminal 400 performs tasks according to the contents of the work performed at each stage of the building activity using an interior service related web page, app page, program or application that provides 3D simulation images for each stage of the building activity, and displays the results of each stage. While uploading, it may be a terminal that receives confirmation from the client terminal 100 by requesting a 3D simulation image from the outside or producing it on its own.

Here, at least one designer terminal 400 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop, a desktop, a laptop, and the like equipped with a navigation system and a web browser. At this time, at least one designer terminal 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one designer terminal 400 is, for example, a wireless communication device that ensures portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet ) may include all types of handheld-based wireless communication devices such as terminals, smartphones, smart pads, tablet PCs, and the like.

2 is a block diagram illustrating an interior service providing server included in the system of FIG. 1, and FIGS. 3 and 4 are implementations of an interior service providing 3D simulation images for each construction activity step according to an embodiment of the present invention. It is a drawing for explaining one embodiment.

Referring to FIG. 2 , the interior service providing server 300 includes a storage unit 310, an allocation unit 320, a transmission unit 330, a confirmation unit 340, a rendering unit 350, and a simulation unit 360. ) may be included.

The interior service providing server 300 according to an embodiment of the present invention or another server (not shown) operating in conjunction with at least one client terminal 100 and at least one designer terminal 400 performs 3D simulation for each construction activity. In the case of transmitting an interior service application, program, app page, web page, etc. that provides images, at least one client terminal 100 and at least one designer terminal 400 provide an interior that provides 3D simulation images for each construction activity step. You can install or open service applications, programs, app pages, web pages, etc. Also, the service program may be driven in at least one client terminal 100 and at least one designer terminal 400 by using a script executed in a web browser. Here, the web browser is a program that allows users to use the web (WWW: World Wide Web) service, and means a program that receives and displays hypertext described in HTML (Hyper Text Mark-up Language). For example, Netscape , Explorer, Chrome, and the like. In addition, an application means an application on a terminal, and includes, for example, an app running on a mobile terminal (smart phone).

Referring to FIG. 2 , the storage unit 310 may store data on work performed by each stage of construction activity and results of planning design, basic design, construction design, on-site shop drawing drawing review and feedback, and construction management. . Planning design, basic design, implementation design, on-site shop drawing, drawing review and feedback, and construction management may be sequential steps in the listed order.

The allocator 320 may transmit data on work performed by each construction activity stage and achievements by stage to at least one designer terminal 400 .

The transmission unit 330 may transmit a 3D simulation image corresponding to a step-by-step result uploaded from at least one designer terminal 400 to the client terminal 100 . At least one designer terminal 400 produces a 3D simulation image for each construction activity step of planning design, basic design, construction design, on-site shop drawing drawing review and feedback, and construction management, transmits it to the client terminal 100, and confirms can receive The client terminal 100 may receive a 3D simulation image for each construction activity step and determine whether to confirm.

When confirmation is received from the client terminal 100, the confirmation confirmation unit 340 may proceed with a process to proceed to the next step. In this case, when at least one interior construction process is performed, a schedule for each construction may be adjusted. General construction companies that receive orders for construction work are subcontracting construction parts such as civil engineering, plastering, furniture, and finishing work to discontinued companies. In the actual finishing construction stage, the design details are often changed for reasons such as reduction of construction cost due to budget reduction of the entire building construction and design change. As a result, frequent meetings are held between the finishing workers, and time and manpower for drawing changes are wasted. In addition, when a new quantity, quotation calculation, and design revision are completed, on-site measurement must be performed again when a situation occurs where the initial drawing and actual construction dimensions are different. As a way to prevent these problems in advance, a BIM process that virtually models facilities from planning, design, engineering (structure, facility, electricity, etc.), construction, maintenance, and disposal can be used in a multidimensional virtual space.

As a solution to problems such as communication confusion between workers and current status due to design change, material and quantity change that occur in the construction activity stage, the construction status stage using 3D scanning data is identified and the decision is made smooth through BIM linkage Scenarios for communication are available. After the frame work is completed, the construction officials gather before the start of the finishing work to reorganize the actual amount of the finishing work. Due to the many variables that change according to the site situation during the finishing work process, most of the cases are changed differently from the materials, quantity, and design of the finishing work planned in the design stage. Therefore, it is possible to provide guidelines for configuring the system so that the design details that change according to the site situation during the construction process can be changed and the construction completion status can be estimated through simulation. The system uses BIM modeling and drawing information originally designed and 3D scanning technology to apply the information that changes during the finishing process to the system in real time, and shares the changed data with designers, clients, subcontractors, and supervisors. It is a system that supports the use of shared data in each person's work.

When the role and demand data of each construction party are organized, there are cases where the materials and quantity of finishing work are changed due to changes in design and budget basically according to the request of the owner. The owner requests design and budget changes to the implementer or builder, and for this task, a server and configuration system are required to request from the system. According to the client's request for change, the constructor holds a meeting with the designer and subcontractors and changes the construction details. A remote meeting server that can minimize such work and a server that can provide site information in real time are needed. In addition, a server is needed to change the site BIM information in the order of dimension information change, design change, and quantity change by applying the changed design to the construction site in conjunction with BIM. In order to minimize errors caused by communication and wasted time and manpower in the course of the process, it is possible to provide a system for collaboration among construction officials. Among the parts that need to be collaborated in the work between the departments, the parts that are based on 3D scanning data are analyzed.

<Finish 3D scanning collaboration process>

Although many architecture-related companies are conducting research and development to establish a specific and systematic building system, the utilization of building systems at construction sites is insufficient. In order to compensate for this, in one embodiment of the present invention, an XR collaboration system that can be utilized in finishing work using BIM technology and 3D scanning technology can be used. The system must be built so that virtualized 3D scanning collections can be provided immediately upon demand for system resources (IT resources) through a cloud server. BIM construction project and photo-based 3D scanning function, on-site 3D image data DB, 3D BIM data DB, user data management DB, construction data management DB, etc. must be established and the server operated to provide users with the necessary data immediately. . In addition, necessary materials for finishing work should be composed of technologies such as BIM data conversion module for XR environment support, 3D data management server application, and DB server compatible module. Through the proposed system, it is possible to convert the contents to be changed in the finishing construction stage into actual necessary data and reflect them to the construction in real time, and to check the simulation to reduce construction errors, thereby increasing work efficiency.

<Composition of the Finishing Work XR Collaboration System>

For example, in the case of Google, after converting 3D modeling using 3D scanning using mobile photos, technology is used in various fields. In one embodiment of the present invention, a system that can be applied by applying to finishing work is built can do. BIM Partners uses functions to interlock with BIM through 3D scanning to locate frame steps and formwork, locate pipes, and examine interference in error measurement construction. Daelim Industrial collects information acquired based on 3D scanning technology It is used to extract or compare with the existing drawing to catch minute errors in the unit of mm of the building. GS E&C announced that it is conducting various researches such as image segmentation, augmented reality, and big data construction through AI image analysis based on 3D scanning in construction in collaboration with CUPIX.

In the construction process, the finishing work is carried out by several interior-related subcontractors. Prior to the commencement of finishing work, the contents such as drawings, construction details, and process schedules are often changed by clients, contractors, and construction companies for various reasons such as design changes and requests for reduction of construction costs. Many meetings and on-site briefings are held between construction officials to change the start plan for finishing work. In this process, many construction details are changed, and many details such as design, materials, and quantity estimates are recalculated. If the finishing material is changed, the construction method must also be changed, and the drawing needs to be completely revised. In order to enable 3D scanning VR Information during the simulation of 3D scanning-based XR collaboration system in finishing construction, it is necessary to separate objects by obtaining information with image separation technology Semantic Segmentation & Instance Segmentation or image separation technology Image Semantic Segmentation, and You can use software that can link information to objects and work with BIM. Based on this, the field 3D scanning data is converted into BIM data through point cloud and applied to the existing BIM, and the field situation and the initially designed field BIM data are compared and extracted. This compares the planned design contents and the actual frame construction finished contents, and the error range part of the two contents is displayed. In addition, it should be possible to check the material size and material type, and a system configuration capable of changing design elements such as color and material may be further added. Using the above-mentioned technologies, BIM data, scanning data, XR simulation data, etc. can be immediately checked, corrected, and applied to extract, etc., so that construction officials can minimize the time waste of actual meetings and communication. to be able to provide it to them. In addition, the saved data can be shared with construction workers and used usefully in remote meetings between workers.

<Finishing XR Collaboration Scenario>

3D data of the site situation is completed through 3D scanning spatial information data and BIM data before the start of finishing construction. 3D data is converted into XR data and registered in the DB server along with drawing materials. In the XR environment before construction, construction officials can check the construction simulation, and in response to requests for changes in drawings, materials, quantity, and design, designers modify drawings, constructors modify schedules, materials, and quantities, subcontractor schedules, and secure quantities. do the job In addition, all work on site is stored in the DB server, and when a construction error occurs, the supervisor, designer, and constructor check the construction status in the XR environment so that they can come up with a solution for the error. In other words, it is the order applied according to the work of the designer, constructor, and subcontractor. It is a construction site XR collaboration support system based on 3D scanning technology. It is a guideline that shows the process from the finishing work to the completion of the finishing work. Guidelines can be set so that each role can be divided into designers, constructors, and workers.

The person involved in the first finishing work logs in and brings up on-site information through information and location data suitable for the process. Second, after connecting to the server, space is scanned. The connected construction company scans the space using a 3D scanning device and transmits the information to the DB server. Third, data conversion and extraction. 3D scanning data information provides necessary environmental information after recognizing environmental information and linking with the DB server. Data can be extracted by comparing the 3D data of the existing BIM with the 3D scanning data of the construction site. Fourth, on-site BIM data environmental information recognition. Extracted New BIM data is compared with existing BIM, and environmental information recognition is expressed so that various functions such as construction errors and object selection can be selected. Fifth, the provision of necessary information. Before commencing the finishing work, the contractor uses the system to collaborate with clients, designers, and subcontractors to check construction materials, quantity, dimensions, etc., and convert data to fit actual construction and upload it. Uploaded data is shared with construction officials, and subcontractors start construction after preparing for construction according to the data.

Sixth, there are changes in the construction details, and the construction details are often changed for various reasons, such as the client's request to change the construction details and the reduction in construction costs. By utilizing the previous data, the XR environment construction simulation can be executed within the system, and through collaboration between finishing work officials, the changed construction contents such as design, materials, and quantity can be immediately received and added to the process. Seventh, the finishing work is checked in, and the primarily completed finishing work is again 3D Scanned to find errors. You can check the part that the operator missed once more. Upon completion without any problems, all data will be uploaded to the DB server. Eighth is inspection request and approval. The data of the previously uploaded construction site can be shared and used for various document work such as inspection and daily ledger. The ninth is the upload of completion data from the DB server. Data from the finishing work system are uploaded to the DB server and can be reused in future processes and projects. When using this, it shows a construction simulation of various information such as visual aspects and dimensions, quantity, and material information that can be confirmed by the naked eye to construction officials, enabling accurate information delivery and efficient communication to clients, designers, constructors, and subcontractors. of field benefits can be expected.

The rendering unit 350 may perform rendering to produce a 3D simulation image. Representative programs that support real-time rendering include game engines such as Unity and Unreal, and programming languages that implement images through direct coding are also used. Processing, Max/MSP, Pure Data, Quartz Composer, TouchDesigner, and VVVV are used, and they use simpler syntax than common script languages. It is convenient to implement real-time video and various interactive techniques because it can be programmed with the VPL (Visual Programming Language) structure.

In addition, the actual measurement service can use 3D space scan technology using 3D scanning technology by utilizing the photo function of a smartphone instead of the existing laser equipment. You can select an object by scanning the part you want in the field and proceed with 3D modeling, and you need steps from the work of extracting the details of the object to the ability to modify it. In order to materialize this, it is necessary to configure interior mobile system engines and functions using 3D scanning.

The main purpose of the interior system using 3D scanning technology is to convert the space into 3D data using a mobile system in a space by general users and interior designers. As for the configuration of the system, conversion engines for 3D data conversion of space must be configured, and various functions must be configured to convert 3D data into images, length measurement, and plan drawing. These functions will be used as information that can change and modify designs such as furniture, wallpaper, lighting, and floors requested by the user, and this will be processed in real time so that you can get a personalized design by processing everything on mobile. In addition, simulation can be configured to check the changed space image, and more realistic information can be obtained by linking with XR-related equipment through the XR conversion engine. These materials can be used as data to receive a quote for interior construction by requesting an actual interior expert in the future.

Spatial scan using 3D scanning, which is the main function of the system, can be classified as to what functions are needed after 3D modeling data conversion is in progress. The system may include a function in which each object in the modeled space is classified by object through image segmentation and image recognition and has properties. Image segmentation is a technology that divides the background of an object or the area between objects in pixel units. It is a technology that recognizes the image boundary of the scanned space and divides the object. It is a technique to By combining various technologies, not only simple images and object dimensions of spatial 3D modeling obtained through 3D scanning, but also functions such as object deletion in the design model change space can be added to configure the 3D modeling space to be changed as desired by the user.

First, with the mobile photo-based 3D scanning function, space can be 3D modeled within the system. Second, the objects in the 3D modeled spatial data are classified into images through the image segmentation function. Thirdly, among the touch methods for displaying the length and dimensions of the photo-based space scan 3D modeling data, it is difficult to touch the exact location to add a function that creates a vertex marker of the object. Fourth, image-segmented objects are linked to an object list suitable for each property through image recognition and configured to be modified and changed, and can be further subdivided among furniture, which is a list of 3D modeling data. With deep learning for image recognition classification, you can include functions within the system that allow objects such as sofas, beds, desks, and so on to belong to the right list. Fifth, the sofa classified in the object list through image recognition can be configured to be deleted. By deleting, the empty space can be displayed without awkwardness by recognizing the surrounding object properties and filling it to fit the boundary line.

Using the main functions of the system, it is possible to acquire and modify space information, and it can be configured to classify into lists of each object by grafting the image segmentation function to objects in the space. These are essential elements that create a background that allows users to change the design of their space in a personalized way according to their taste. In this way, the system can be configured so that the space can be 3D modeled within the system with the mobile photo-based 3D scanning function by scanning the space and changed to the design requested by the user. In order to implement the system, many technologies are required. In addition to simply performing image segmentation, it requires a function that connects attributes to objects by adding image recognition technology to the segmented image.

First of all, various data such as measurement of the length of an image of space are completed using space 3D scanning on a mobile device. Completed data can perform various tasks in mobile. It may be possible from the stage where the user connects to the server to change the design and the stage where the interior expert can check and make a quote through the changed design confirmation function in the XR environment. First, the user connects to the server by generating a space where the user wants to change the interior. Second, 3D Scannig & 3D modeling data conversion and extraction are performed, and after connecting to the server, it is changed and the space is 3D modeling through mobile 3D scanning. The third is data modification and modification. 3D modeling data can be modified on mobile, and a desired part or object can be selected and modified. Fourth, sharing of design change data, users can design by calling the desired design from the server and applying it to the scanned 3D model. Also, the changed design data is stored on the server and can be shared with other users. Fifth, linkage between 3D Model and XR environment. Data changed on mobile can be implemented in MR form, and the interior environment that has actually changed can be checked in the XR environment by linking with equipment.

According to the above-described process, a scenario is configured so that the user scans the space within the system and is provided with information up to the step of extracting a quote after design change. Mobile space scan data is 3D modeled and used, and various functions such as image segmentation and image recognition are utilized within the system, and can be used for design change along with big data-based information. The data changed to the design requested by the user can be simulated through the XR conversion module and checked by real interior experts to provide a service that can extract a more accurate estimate.

The simulation unit 360 may perform 3D simulation work including Furniture, Fixtures and Equipment (FF&E) elements. At this time, at least one image blending algorithm for reducing the color difference between the FF&E element and the interior in the 3D simulation may be used. The simulation unit 360, after synthesizing the object of the FF&E element into a 3D simulation image by the Poisson blending method, compares the color difference between the blended 3D simulation image and the FF&E element, and if the color difference is greater than a preset threshold value, the FF&E element After performing alpha blending on the object, it is possible to synthesize the FF&E element and the 3D simulation image, characterized in that the 3D simulation image blended by the Poisson blending method and weights are added and synthesized.

In the Poisson blending method, the color of a source image object may be distorted by the color of a target image. This is because, in the Poisson blending process, pixel values of the target image are used as pixel values of the synthesized image at the boundary of the synthesized region due to the Dirichlet boundary condition of Equation 1. Types of color distortion can be divided into a color bleeding phenomenon and a color artifact phenomenon. The color spreading phenomenon means distortion in the form of spreading the edge pixel values of the target image to the entire synthesized object area. Also, the color error phenomenon refers to a phenomenon in which the border area of the synthesized area is partially stained with the color of the target image border.

[Equation 1]

Accordingly, in order to suppress the color distortion caused by Poisson blending and improve the naturalness of the synthesized image, the characteristics and source of alpha blending that preserves the color and texture of the object of the source image (FF&E element) in the synthesized image. The object of the image and the background of the target image (3D simulation image) can be made in a way that simultaneously utilizes the characteristics of Poisson blending that are combined seamlessly. This is based on the color difference, and the color difference can be calculated based on the RGB and color components, the number of pixels included in the composition area, and the pixel values of the alpha-blended object. Various equations may be applied, but in one embodiment of the present invention, it is not limited to any one equation.

Hereinafter, an operation process according to the configuration of the above-described interior service providing server of FIG. 2 will be described in detail with reference to FIGS. 3 and 4 as examples. However, it will be apparent that the embodiment is only any one of various embodiments of the present invention, and is not limited thereto.

3 is a table illustrating a process in which an interior service is performed. It may proceed in the order of FIG. 3, but the contents of each step may be changed. 4a to 4f are examples of providing design drawings of each floor as a 2D plan view, a 3D plan view, and VR content. At this time, the 3D simulation may be provided as an image and may be expressed as a 360-degree panoramic image or XR, that is, MR, VR, AR, and the like. Experts must be able to understand and convince others of their architectural design intentions. In this process, sketches, drawings, photos, and 3D visualization models play a large role as auxiliary tools in conveying the expert's intention. However, the aforementioned methods are limited in that they have difficulties in conveying the building as it is and can only convey a limited view. Accordingly, in the case of providing the 3D simulation image or the above-described 360 panoramic image according to an embodiment of the present invention, images of various views desired by the user can be extracted with only one image. In addition, the user can easily edit and create the desired image from one image by adjusting the shooting angle of the photo.

Matters that have not been described for the interior service providing method of providing 3D simulation images for each construction activity stage of FIGS. 2 to 4 are described in the interior service providing method for providing 3D simulation images for each construction activity stage through FIG. 1 . Since it can be easily inferred from the same or described content, the following description will be omitted.

FIG. 5 is a diagram illustrating a process of transmitting and receiving data between components included in an interior service providing system providing 3D simulation images for each stage of a construction act of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of a process of transmitting and receiving data between each component will be described through FIG. 5, but the present application is not limited to such an embodiment, and according to various embodiments described above, It is obvious to those skilled in the art that a process of transmitting and receiving data may be changed.

Referring to FIG. 5, the interior service providing server stores data on work performance and results for each stage of construction activity such as planning design, basic design, construction design, on-site shop drawing drawing review and feedback, and construction management (S5100 ).

The interior service providing server transmits data on the contents of each stage of construction activity and the results of each stage to at least one designer terminal (S5200), and transmits the 3D simulation image corresponding to the staged achievement uploaded from the at least one designer terminal to the client It is transmitted to the terminal (S5300).

In addition, the interior service providing server proceeds with a process to proceed to the next step when receiving confirmation from the client terminal (S5400).

The order between the above-described steps (S5100 to S5400) is only an example, and is not limited thereto. That is, the order of the above-described steps (S5100 to S5400) may be mutually changed, and some of the steps may be simultaneously executed or deleted.

Items not described for the interior service providing method of providing 3D simulation images for each stage of construction activity in FIG. Since it can be easily inferred from the same or described content, the following description will be omitted.

The interior service providing method for providing 3D simulation images for each stage of a construction activity according to an embodiment described with reference to FIG. 5 is in the form of a recording medium including instructions executable by a computer such as an application or program module executed by a computer. can also be implemented. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

Hereinafter, with reference to FIG. 6, a modified example of a method for providing interior services for providing 3D simulation images for each stage of a building act according to the present invention will be described. In the modified example of the interior service providing method for providing 3D simulation images for each stage of construction activity of the present invention, 3D simulation images produced by BMI/3D scanning technology, etc. are prepared as a plurality of candidate group images with different modeling/rendering styles, and then the client's individual By analyzing the information and selecting and providing customized 3D simulation images according to the client, a technology has been added that can increase the client's satisfaction and increase the confirmation rate.

To this end, the client terminal 100 may receive a 3D simulation image selected for each construction activity step, and at least one designer terminal 400 reviews and feedbacks planning design, basic design, implementation design, on-site shop drawing drawings, and Produces a plurality of 3D simulation candidate group images for each construction activity step for construction management, receives confirmation of the selected 3D simulation image for each construction activity step from the client terminal, and transmits from the interior service providing server 300 The unit 330 may transmit the 3D simulation image selected for each construction activity step corresponding to the step-by-step result to the client terminal, and the confirmation confirmation unit 340 receives the satisfaction index information from the client terminal 100 and receives confirmation. You can proceed the process to proceed to the next step. Furthermore, the interior service providing server 300 reflects the personal information of the client uploaded from the client terminal 100 in the 3D simulation plural candidate group images for each construction act step uploaded from at least one designer terminal 400, and then displays the client terminal 100. It may further include a determination unit (not shown) for determining the 3D simulation image selected for each construction activity stage to be transmitted.

In this case, the interior service providing server 300 includes the step of uploading the client's personal information to the determination unit by the client terminal 100 (S6100); Uploading, by at least one designer terminal 400, a plurality of 3D simulation images of candidate groups for each construction activity stage to a judgment unit (S6200); The judgment unit generates a 3D simulation image selected for each construction activity step by using first artificial intelligence, and the transmitter 330 provides the 3D simulation image selected for each construction activity step to the client terminal 100 (S6300); Transmitting, by the client terminal 100, satisfaction index information for the 3D simulation image selected for each construction activity stage to the confirmation confirmation unit 340 (S6400); The judgment unit updates the first artificial intelligence using the second artificial intelligence (S6500), and the client terminal (100 ) can be provided.

In the interior service providing server 300, the client terminal 100 uploads the client's personal information to the judgment unit (S6100), the client sends the client's personal information including information about the client's gender, age, and occupation to the judgment unit. It may be an upload step.

Uploading, by at least one designer terminal 400, a plurality of 3D simulation images of candidate groups for each stage of construction activity to the judgment unit (S6200), at least one designer designs different types of designs (modeling/rendering style, It may be a step of uploading 3D simulation images of a plurality of candidate groups produced in different styles, such as line thickness, type, expression method, color brightness, and saturation, to the determination unit.

The step of generating a 3D simulation image selected for each construction activity step by the judgment unit using the first artificial intelligence and providing the 3D simulation image selected for each construction activity step by the transmission unit 330 to the client terminal 100 (S6300). It may be a step of generating a 3D simulation image selected from a plurality of candidate 3D simulation images by processing the personal information of the client using the first artificial intelligence in the determination unit and providing the selected 3D simulation image to the client through the transmission unit.

On the other hand, since the data that can be obtained through the platform is limited at the beginning of operation, there may be a problem of not securing enough datasets for learning the first artificial intelligence. Accordingly, in the modified example of the present invention, an artificial intelligence prediction algorithm may be generated with virtual data and the selected 3D simulation image may be provided to the client. A detailed description of generating the above-described first artificial intelligence algorithm will be described later.

In the step of the client terminal 100 transmitting satisfaction index information on the 3D simulation image selected for each construction activity stage to the confirmation confirmation unit 340 (S6400), the client evaluates the satisfaction with the 3D simulation image selected by the judgment unit It may be a step to In this case, the satisfaction index information may be a natural number value for absolute evaluation of the 3D simulation image selected for each construction activity stage provided to the client terminal from the transmission unit 330 .

In the step of updating the first artificial intelligence by the judgment unit using the second artificial intelligence (S6500), the judgment unit learns based on the client's actual satisfaction index information for the actual client's personal information and the 3D simulation image selected for each actual construction activity stage. It may be a step of updating the first artificial intelligence with the second artificial intelligence.

In other words, in the stage where the operation of the platform is stabilized, the personal information of the client obtained by the platform itself, the 3D simulation image selected for each construction activity stage, and the satisfaction index information are set as a dataset to update the above-mentioned first artificial intelligence algorithm in real time. The first AI can be continuously updated by creating a new artificial intelligence prediction algorithm. A detailed description of generating the above-described second artificial intelligence algorithm will be described later.

Hereinafter, the artificial intelligence used in the modified example of the present invention will be described in detail. Artificial intelligence (AI) is a field of computer engineering and information technology that realizes human learning ability, reasoning ability, perception ability, and natural language understanding ability through computer programs. In particular, supervised learning, which is used in the most fields of artificial intelligence, is a method of predicting future values using training data including correct answers (labels).

For reference, machine learning can be defined as a methodology that gives computers the ability to learn on their own without being explicitly programmed. Machine learning is divided into supervised learning and unsupervised learning depending on whether or not the correct answer is specified in the data required for learning, classification that divides data into finite categories according to the purpose of use, and continuous It is divided into regression methodology that maps to values, clustering method that groups similar data, and dimension reduction methodology that maps multidimensional data to a representative lower dimension.

Deep learning, one of the machine learning techniques, has dramatically improved the performance of machine learning, which has been stagnant for a while. , The deep learning structure is a deep neural network (DNN) in which multiple hidden layers exist between the input layer and the output layer, and a filter required for factor extraction in front of the hidden layer. It may include a Convolutional Neural Network (CNN) that learns filters together with , and a Recurrent Neural Network (RNN) capable of processing time-series data by stacking artificial neural networks of each time. Here, the high performance of the deep learning model is explained in two ways. First, the neural network is a universal approximator that can approximate all kinds of functions by overlapping the weighted sum of functions in each layer. If sufficiently general data is given, Data can be replicated with high accuracy. Second, in order to classify data well, it is important to properly extract factors representing the data, and optimal factors can be extracted through filter learning using a convolutional neural network. In addition, deep learning is a form in which a model in the field of artificial intelligence called a neural network has been developed, and a structure in which a hidden layer of an artificial neural network composed of a hierarchical structure is composed of several steps. Recent deep learning models have many internal layers, and the number of weights (meaning the strength of connection) connecting nodes can reach up to billions.

In the modified example of the present invention, since data for learning artificial intelligence is insufficient in the initial stage of operation of the platform, the interior service providing server 300 uses the personal information of the virtual client set by the manager as a feature value for each virtual building set by the manager. By using the first artificial intelligence that learned the dataset set as the label value of the 3D simulation image selected for each action step, if the client's personal information input by the actual client terminal 100 is entered, the selected 3D image for each virtual construction action step is entered. A simulation image can be created.

Accordingly, the interior service providing server 300 learns artificial intelligence with the virtual client's personal information (feature value) and the 3D simulation image (label value) selected for each virtual construction activity stage, so that the actual client can obtain the client's personal information. If input, it is possible to generate a first artificial intelligence prediction algorithm that outputs a 3D simulation image selected for each virtual construction activity step matching the client's propensity from a plurality of candidate 3D simulation images for each virtual construction activity step.

Furthermore, in the modified example of the present invention, when the operation of the platform is stabilized, artificial intelligence is learned with data generated within the platform itself, and a second artificial intelligence prediction algorithm is generated to provide feedback to the first artificial intelligence algorithm described above. The intelligent algorithm can be updated in real time.

In detail, the interior service providing server 300 uses the personal information of clients accumulated by a plurality of real clients and the 3D simulation image selected for each virtual construction activity step to obtain a second artificial intelligence that learns satisfaction index information as a label value as a feature value. It is possible to predict the satisfaction index information that the client feels when the 3D simulation image selected for each virtual construction activity step is recommended to the client who prefers a specific design style by using intelligence. Next, the interior service providing server 300 uses the personal information of the virtual client set by the existing manager and the 3D simulation image selected for each virtual construction activity stage to train the first AI as a feature value of the second AI. If you enter in , you can predict the user's satisfaction index information. Next, the interior service providing server 300 uses the second of a plurality of datasets for the virtual client's personal information set by the manager and the 3D simulation image selected for each virtual construction activity stage in order to train the first artificial intelligence. By excluding the data set in which the value of the satisfaction index information derived by inputting into artificial intelligence is less than the average value of the predetermined satisfaction index information (the average value of the satisfaction index information evaluated by a plurality of actual users) from the data set for learning the first artificial intelligence. The first artificial intelligence can be updated in real time. In this case, the first artificial intelligence continuously receives and learns the virtual client's personal information newly set by the manager and the 3D simulation image selected for each virtual construction activity step, so the absence of learning data does not occur and evolves according to the user can do.

The above-described interior service providing method for providing 3D simulation images for each stage of construction activity according to an embodiment of the present invention is an application basically installed in a terminal (this may include a program included in a platform or operating system basically installed in the terminal). It can be executed by an application (i.e., a program) directly installed in the master terminal through an application providing server such as an application store server, an application, or a web server related to the corresponding service. In this sense, the above-described interior service providing method for providing 3D simulation images for each stage of construction activity according to an embodiment of the present invention is implemented as an application (ie, a program) that is basically installed in a terminal or directly installed by a user, and is implemented in a terminal. It can be recorded on a computer-readable recording medium, such as

The above description of the present invention is for illustrative purposes, and those skilled in the art can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts should be construed as being included in the scope of the present invention. do.

Claims (2)

A client terminal for receiving a 3D simulation image selected for each construction activity step and determining whether to confirm;
Planning design, basic design, detailed design, on-site shop drawing drawing review and feedback, and production of a plurality of 3D simulation candidate group images for each of the above construction activities for construction management, and 3D simulation images selected for each construction activity phase from the client terminal at least one designer terminal receiving confirmation for; and
A storage unit that stores data on the details of work performed by each stage of construction activities and the results of each phase of planning design, basic design, detailed design, on-site shop drawing, drawing review and feedback, and construction management. An allocator for transmitting data for at least one designer terminal, a transmission unit for transmitting the 3D simulation image selected for each construction activity step corresponding to the achievement for each step to the client terminal, and satisfaction index information from the client terminal. If received and confirmed, a confirmation confirmation unit that proceeds with the process to proceed to the next step, the personal information of the client uploaded from the client terminal from the plurality of 3D simulation candidate images for each construction activity stage uploaded from the at least one designer terminal an interior service providing server including a determination unit for determining the 3D simulation image selected for each construction activity stage to be reflected and transmitted to the client terminal;
including,
The interior service providing server,
Uploading, by the client terminal, personal information of the client to the judgment unit;
Uploading, by the at least one designer terminal, a plurality of 3D simulation images of candidate groups for each construction activity stage to the determination unit;
generating a 3D simulation image selected for each construction activity stage by the determination unit using first artificial intelligence, and providing the 3D simulation image selected by each construction activity stage to the client's terminal by the transmission unit;
Transmitting, by the client terminal, satisfaction index information for the 3D simulation image selected for each construction activity step to the confirmation confirmation unit;
In a method including the step of updating the first artificial intelligence by using the second artificial intelligence, the determination unit transmits the 3D simulation image selected for each construction activity step from the plurality of 3D simulation images of the candidate group for each construction activity step to the client terminal. provide,
The client's personal information includes information about the client's gender, age, and occupation;
The satisfaction index information is a natural number value for absolute evaluation of the 3D simulation image selected for each construction activity step provided to the client terminal from the transmitter,
The determination unit learns the first artificial intelligence with a data set set as a label value of the virtual 3D simulation image selected for each construction activity step using the virtual client's personal information as a feature value, and the client's personal information uploaded from the client terminal Generates a 3D simulation image selected for each construction activity stage, which is input and output to the first artificial intelligence,
The determination unit uses a plurality of personal information of the client previously uploaded from the client terminal and a plurality of 3D simulation images selected for each construction activity step previously provided to the client terminal to obtain a plurality of previously transmitted from the client terminal as feature values. The satisfaction index information is used as a label value to train the second artificial intelligence, and the personal information of the virtual client to learn the first artificial intelligence and the data set for the 3D simulation image selected for each virtual construction activity stage are transferred to the second artificial intelligence. When the input and output satisfaction index information is less than the average value of a plurality of satisfaction index information previously transmitted from the client terminal, the first artificial intelligence is updated by excluding the corresponding dataset from the dataset for learning the first artificial intelligence. An interior service providing system that provides 3D simulation images for each stage of construction activity.
According to claim 1,
Planning design, basic design, construction design, on-site shop drawing drawing review and feedback, and construction management are sequentially performed in the order listed. An interior service providing system that provides 3D simulation images for each stage of construction activity.

Images