KR102424894B1 - Method and server for managing construction information and maintenance information based on augmented reality - Google Patents

Abstract

In the method for managing at least a part of construction information and maintenance information based on augmented reality, (a) (i) an individual space in the building specified by at least one of a building, an arc, a floor, and a room From the user terminal to the user terminal in a state in which spatial information that is information about the fields, (ii) work type information for each part in the individual spaces, and (iii) activity information corresponding to the work type information is obtained When a request for augmented reality information for a specific part in specific spatial information on a live-action image taken by to do; And (b) the construction information management server, of the work information and the activity information corresponding to the specific individual space, the specific construction information and specific activity information for the specific part corresponding to the actual image Classify according to a set category, and transmit the selection menus for the specific work type information and the specific activity information classified according to the preset category to the user terminal, thereby causing the user terminal to render the selection menus, and A method and a construction information management server using the method including; supporting the display of an augmented reality screen by superimposing the selection menus on the actual image are disclosed.

Description

A method for managing construction information and maintenance information based on augmented reality and a server using the same

The present invention relates to a method for managing construction information and maintenance information based on augmented reality and a construction information management server using the same.

Buildings are divided into unique detailed spaces such as buildings, arcs, floors, and rooms, and numerous construction methods must be sequentially applied in accordance with design drawings and specifications for each detailed space in order to perform construction work correctly.

In this construction process, construction photos and construction videos as well as various inspection documents and quality control documents should be prepared for each stage of construction. Such documents may include a checklist, quality control ledger, test report, material approval, design change ledger, construction log, supervision log, building regulations, building-related certification standards, building maintenance checklist, and the like.

However, if a large number of documents are prepared for each stage of construction according to the Building Act and the Construction Technology Promotion Act as described above, it is difficult to carry the documents at the actual construction site.

Accordingly, it is very difficult to immediately inquire design drawings or other documents in order to grasp the progress of the past work type when the inspection is performed on a specific construction site.

In order to improve this problem, a method of converting paper documents into electronic documents and inquiring them through a portable terminal is used. For example, a method for integrated management of a construction site using a construction site management application is disclosed in Korean Patent Registration No. 10-1829169.

However, in the above method, there is a problem in that it is difficult to easily inquire suitable data due to the complex structure of the construction site.

For example, in the case of a large-scale apartment construction site, there are numerous construction-related electronic documents corresponding to thousands of detailed spaces, but there is still a problem in that it is difficult to easily inquire and modify a specific electronic document among a large number of electronic documents.

Therefore, there is a need for an improvement method to solve the above problems.

US 10-1829169 B1

An object of the present invention is to solve all of the above problems.

Another object of the present invention is to display spatial information, work type information, and activity information about an individual space in a complex construction site in augmented reality with reference to location information of a user terminal.

In addition, it is another object of the present invention to display in augmented reality so that existing design information for a building and actual construction information can be compared with each other.

In addition, another object of the present invention is to detect a specific part where construction is made and display the detection result in augmented reality.

In addition, another object of the present invention is to allow process instruction information to be shared through augmented reality regardless of the distance from a construction site or a maintenance target building.

In addition, another object of the present invention is to facilitate the maintenance of the building even after the building is completed by making it possible to easily inquire information about the existing process.

In order to achieve the object of the present invention as described above and to realize the characteristic effects of the present invention to be described later, the characteristic configuration of the present invention is as follows.

According to one aspect of the present invention, in a method for managing at least a portion of construction information and maintenance information based on augmented reality, (a) (i) at least one of the building's wing, room, floor, and room In a state in which spatial information, which is information about individual spaces in the building specified by , when a request for augmented reality information for a specific part in specific spatial information on the actual image taken by the user terminal is obtained from the user terminal, the construction information management server refers to the location information in which the user terminal is located, the user terminal identifying a specific individual space in which it is located; And (b) the construction information management server, of the work information and the activity information corresponding to the specific individual space, the specific construction information and specific activity information for the specific part corresponding to the actual image Classify according to a set category, and transmit the selection menus for the specific work type information and the specific activity information classified according to the preset category to the user terminal, thereby causing the user terminal to render the selection menus, and A method comprising; supporting the display of an augmented reality screen by superimposing the selection menus on the live-action image is disclosed.

As an example, (c) when a selection signal for a specific selection menu corresponding to any one of the specific construction type information and the specific activity information among the selection menus is obtained from the user terminal, the construction information management server, By transmitting specific design information and specific construction information corresponding to any one of specific construction information and specific activity information corresponding to the specific selection menu to the user terminal, the user terminal causes the specific design information and the specific construction information Rendering to support the display of an augmented reality screen by superimposing the specific design information and the specific construction information on the live-action image; a method comprising further comprising is disclosed.

As an example, when the detection menu for detecting the specific part of the selection menu is selected, the construction information management server (i) analyzes the actual image corresponding to the specific part obtained from the user terminal and the Generate new detection information for a specific part, check the reference value corresponding to the specific part with reference to the specific design information, and transmit the new detection information and the reference value to the user terminal to make the user terminal the reference value And by rendering the new detection information, the reference value and the new detection information is superimposed on the live-action image to support the display of an augmented reality screen is disclosed.

As an example, in the step (a), the construction information management server, with reference to at least one of GPS information and augmented reality markers for the user terminal, characterized in that to obtain the location information in which the user terminal is located A method is disclosed.

As an example, a method is disclosed, wherein the category includes at least document information, drawing information, image information, and detection information.

As an example, (d) the construction information management server, (i) when a process monitoring request is obtained from the user terminal, or transmits the actual image taken by the user terminal obtained from the user terminal to the monitoring terminal, Let the user terminal transmit the actual image to the monitoring terminal, and (ii) transmit process indication information for a specific area of any area of the actual image obtained from the monitoring terminal to the user terminal, or A monitoring terminal transmits the process instruction information to the user terminal, causes the user terminal to render a markup corresponding to the process instruction information, and displays an augmented reality screen by superimposing the markup on the live-action image A method comprising further comprising; assisting to do so is disclosed.

As an example, when the process instruction voice information corresponding to the process instruction for the specific region of the live-action image is additionally obtained from the monitoring terminal, the construction information management server causes the user terminal to perform the actual inspection of the markup Disclosed is a method characterized by outputting the process instruction voice information while displaying an augmented reality screen by superimposing it on an image.

As an example, the construction information management server includes at least one unit cube cell including a unit space, a unit work type, and a unit time with reference to each of the spatial information and the work type information of each of the activity information. a space axis in which the spatial information is arranged on the first axis of the three-dimensional axis, a joint axis in which the spatial information is arranged on the second axis of the three-dimensional axis, and the time information is arranged on the third axis of the three-dimensional axis By arranging the construction information structures in a specific area of the three-dimensional construction information posting space consisting of an axis to create a three-dimensional construction information cube in the three-dimensional construction information posting space, the user terminal causes the three-dimensional construction information A method is disclosed, characterized in that the spatial information, the work type information, and the activity information are displayed through the cube.

According to another aspect of the present invention, there is provided a construction information management server for managing at least a portion of construction information and maintenance information based on augmented reality, comprising: at least one memory for storing instructions; and at least one processor configured to execute the instructions; In a state in which spatial information that is information about, (ii) work type information for each part in the individual spaces, and (iii) activity information corresponding to the work type information has been obtained, photographed by the user terminal from the user terminal a process of confirming a specific individual space in which the user terminal is located by referring to the location information in which the user terminal is located, when a request for augmented reality information for a specific part in the specific spatial information on the actual image to be obtained is obtained; and (2) classifying specific work type information and specific activity information for the specific part corresponding to the live-action image among the work type information and the activity information corresponding to the specific individual space according to a preset category, By transmitting the selection menus for the specific work type information and the specific activity information classified according to the preset category to the user terminal, the user terminal renders the selection menus, and the selection menus are applied to the live-action image. A construction information management server that executes the instructions to perform a process supporting the display of an augmented reality screen by overlapping is disclosed.

As an example, (3) the processor, when a selection signal for a specific selection menu corresponding to any one of the specific work type information and the specific activity information among the selection menus from the user terminal is obtained, the specific selection By transmitting specific design information and specific construction information corresponding to any one of specific construction information corresponding to the menu and specific activity information to the user terminal, the user terminal renders the specific design information and the specific construction information A process of supporting the display of an augmented reality screen by superimposing the specific design information and the specific construction information on the actual image; a construction information management server comprising further comprising is disclosed.

As an example, the processor, when a detection menu for detecting the specific part of the selection menu is selected, (i) analyzing the actual image corresponding to the specific part obtained from the user terminal to the specific part Generate new detection information for, check the reference value corresponding to the specific part with reference to the specific design information, and transmit the new detection information and the reference value to the user terminal to make the user terminal the reference value and the new A construction information management server is disclosed, characterized in that it supports to display an augmented reality screen by superimposing the reference value and the new detection information on the live-action image by rendering the detection information.

As an example, the processor, in the (1) process, with reference to at least one of the GPS information and the augmented reality marker for the user terminal, construction information management, characterized in that obtaining the location information in which the user terminal is located The server is started.

As an example, the category discloses a construction information management server, characterized in that it includes at least document information, drawing information, image information and detection information.

As an example, (4) the processor, (i) when a process monitoring request is obtained from the user terminal, or transmits the live-action image taken by the user terminal obtained from the user terminal to the monitoring terminal, or the user terminal to transmit the actual image to the monitoring terminal, and (ii) transmit process indication information for a specific area among any areas of the actual image obtained from the monitoring terminal to the user terminal, or the monitoring terminal to transmit the process indication information to the user terminal, to cause the user terminal to render a markup corresponding to the process indication information, and to superimpose the markup on the live-action image to display an augmented reality screen Process; construction information management server characterized in that it further comprises is disclosed.

As an example, the processor, when the process instruction voice information corresponding to the process instruction for the specific region of the live-action image is additionally obtained from the monitoring terminal, causes the user terminal to superimpose the markup on the live-action image A construction information management server is disclosed, characterized in that it outputs the process instruction voice information while displaying the augmented reality screen.

As an example, the processor generates construction information structures including at least one unit cube cell consisting of a unit space, a unit work type and a unit time with reference to each of the spatial information and the work type information of each of the activity information, and , a spatial axis in which the spatial information is arranged on the first axis of the three-dimensional axis, a work axis in which the work type information is arranged on the second axis of the three-dimensional axis, and a time axis in which the time information is arranged on the third axis of the three-dimensional axis By arranging the construction information structures in a specific area of the three-dimensional construction information posting space to create a three-dimensional construction information cube in the three-dimensional construction information posting space, the user terminal allows the three-dimensional construction information cube through the A construction information management server is disclosed, characterized in that it displays the spatial information, the construction type information, and the activity information.

In addition to this, a computer-readable recording medium for recording a computer program for executing the method of the present invention is further provided.

The present invention has an effect of displaying spatial information, work type information, and activity information about an individual space in a complex construction site in augmented reality with reference to location information of a user terminal.

In addition, the present invention has an effect of displaying in augmented reality so that the existing design information for the building and the actual construction information can be compared with each other.

In addition, the present invention has the effect of detecting a specific part where construction is made and displaying the detection result in augmented reality.

In addition, the present invention has the effect of allowing the process instruction information to be shared through augmented reality regardless of the distance from the construction site or the maintenance target building.

In addition, the present invention has the effect of promoting the smooth maintenance of the building even after the building is completed by allowing the information on the existing process to be easily inquired.

The accompanying drawings for use in the description of the embodiments of the present invention are only a part of the embodiments of the present invention, and for those of ordinary skill in the art to which the present invention pertains (hereinafter referred to as "those of ordinary skill in the art"), the invention Other drawings may be obtained based on these drawings without any work being done.
1 schematically shows a construction information management server, a user terminal and a monitoring terminal for managing at least some of construction information and maintenance information based on augmented reality according to an embodiment of the present invention;
Figure 2 schematically shows at least one construction information structure including at least one cube cell according to an embodiment of the present invention,
3 is a space axis in which spatial information is arranged on a first axis of a three-dimensional axis, a work axis in which work type information is arranged on a second axis of a three-dimensional axis, and time information on a third axis of the three-dimensional axis according to an embodiment of the present invention; It schematically shows the arrangement of construction information structures in a specific area of the three-dimensional construction information posting space consisting of the listed time axes,
4a to 4c schematically show a state in which specific work type information and specific activity information are superimposed and displayed on a live-action image according to an embodiment of the present invention;
5 schematically shows a state in which an augmented reality screen is displayed by superimposing new detection information and a reference value on a live-action image according to an embodiment of the present invention;
6 schematically illustrates a state in which an augmented reality screen is displayed by superimposing a markup corresponding to process instruction information on a live-action image according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following detailed description of the present invention refers to the accompanying drawings, which show by way of illustration a specific embodiment in which the present invention may be practiced, in order to clarify the objects, technical solutions and advantages of the present invention. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present invention.

Also, throughout this description and claims, the word "comprises" and variations thereof are not intended to exclude other technical features, additions, components or steps. Other objects, advantages and characteristics of the present invention will become apparent to a person skilled in the art in part from this description and in part from practice of the present invention. The following illustrations and drawings are provided by way of illustration and are not intended to limit the invention.

Moreover, the invention encompasses all possible combinations of the embodiments indicated herein. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein with respect to one embodiment may be implemented in other embodiments without departing from the spirit and scope of the invention. In addition, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description set forth below is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all scope equivalents to those claimed. Like reference numerals in the drawings refer to the same or similar functions throughout the various aspects.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily practice the present invention.

1 schematically shows a construction information management server 110, a user terminal 120, and a monitoring terminal 130 for managing at least some of construction information and maintenance information based on augmented reality according to an embodiment of the present invention. 1, the construction information management server 110 is a memory 111 and memory 111 for storing instructions for managing at least some of construction information and maintenance information based on augmented reality. It may include a processor 112 that performs an operation of managing at least some of construction information and maintenance information based on augmented reality in response to the instructions stored in the .

Specifically, the construction information management server 110 is typically a computing device (eg, a computer processor, memory, storage, input device and output device, other devices that may include components of existing computing devices; routers, switches, etc.) using a combination of electronic communication devices, such as electronic information storage systems such as network attached storage (NAS) and storage area networks (SANs), and computer software (i.e., instructions that cause the computing device to function in a particular way). It may be to achieve the desired system performance.

In addition, the processor of the computing device may include a hardware configuration such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software configuration of an application for performing a specific purpose.

However, a case in which the computing device includes an integrated processor in which a medium, a processor, and a memory are integrated for implementing the present invention is not excluded.

On the other hand, the user terminal 120 is based on the augmented reality in response to the instructions stored in the memory 121 and the memory 121 for storing instructions for managing at least some of the construction information and maintenance information based on the augmented reality. to include a processor 122 that performs an operation to manage at least some of the construction information and maintenance information.

Specifically, user terminal 120 is typically a computing device (eg, a device that may include a computer processor, memory, storage, input and output devices, other components of a conventional computing device; electronic devices such as routers, switches, etc.) A desired system using a combination of communication devices; electronic information storage systems such as network attached storage (NAS) and storage area networks (SANs)) and computer software (ie, instructions that cause the computing device to function in a particular way). performance may be achieved.

In addition, the processor of the computing device may include a hardware configuration such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software configuration of an application for performing a specific purpose.

However, a case in which the computing device includes an integrated processor in which a medium, a processor, and a memory are integrated for implementing the present invention is not excluded.

On the other hand, the monitoring terminal 130 corresponds to the instructions stored in the memory 131 and the memory 131 for storing instructions for managing construction information based on the augmented reality based on the augmented reality construction information and maintenance information It may include a processor 132 that performs an operation to manage at least a part of the.

Specifically, the monitoring terminal 130 is typically a computing device (eg, a computer processor, memory, storage, input device and output device, a device that may include other components of a conventional computing device; an electronic device such as a router, switch, etc.) A desired system using a combination of communication devices; electronic information storage systems such as network attached storage (NAS) and storage area networks (SANs)) and computer software (ie, instructions that cause the computing device to function in a particular way). performance may be achieved.

In addition, the processor of the computing device may include a hardware configuration such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software configuration of an application for performing a specific purpose.

However, a case in which the computing device includes an integrated processor in which a medium, a processor, and a memory are integrated for implementing the present invention is not excluded.

When describing a method of managing at least some of construction information and maintenance information using the construction information management server 110, the user terminal 120, and the monitoring terminal 130 according to an embodiment of the present invention configured as described above As follows.

For reference, the drawings show that the augmented reality screen is displayed through a head mounted display or a handheld display for convenience of explanation, but the present invention is not limited to the corresponding devices, and any device capable of displaying the augmented reality screen is used in the present invention. processing can be performed.

First, spatial information that is information about individual spaces in a building specified by at least one of the building's wing, arc, floor, and room, work type information for each part in individual spaces, and construction type information Activity information may be obtained.

In this case, the information on the type of work for each part in the individual spaces may include information on foundation work, temporary work, frame work, masonry work, masonry work, tile work, plaster work, and the like. However, information on the type of work is not limited to the works exemplified above, and any number of work types that can be applied to a building at a construction site may be included.

In addition, the activity information corresponding to the construction type information may include information on a specific construction status for each construction type, and the like.

For example, activity information regarding tile construction in a specific space may include information on the status of work related to tile construction performed for a specific space from January 5, 2020 to January 19, 2020.

As another example, the activity information about tile work in a specific space may also include information about the detection performed on January 20, 2020 by a specific supervisor for a specific space where tile work is completed.

That is, the activity information may include not only construction information before completion of the building but also maintenance information after completion, and may include any number of information on specific actions performed by time/type of construction for a specific space. For example, it may include at least one of technical information, inspection information, defect information, photo information, video information, cost information, safety information, design information, and maintenance information. In addition, various contracts, contract details, etc. may be included in the activity information.

And, as shown in FIG. 2 , the construction information management server 110 refers to each of the space information, the work type information, and the time information of each of the activity information, and a unit consisting of a unit space, a unit work type, and a unit time. Construction information structures (201, 202, 203, 204) including at least one cube cell may be generated. Here, the cube cell may mean a minimum unit for generating the construction information structure.

Such a construction information structure may have various shapes according to spatial information, construction type information, and activity information, as can be seen through FIG. 2 .

For example, when the construction information structure for the reinforcement work made for a specific period on the 5th floor has the shape of a square bar, the construction information structure for the reinforcement construction on the 6th and 7th floors above the ground for a specific period is 5 above the ground. It may have the shape of a rectangular bar having a width twice that of the construction information structure for the floor.

And, the construction information management server 110, the spatial axis in which the spatial information is arranged on the first axis of the three-dimensional axis, the construction type axis in which the construction type information is arranged on the second axis of the three-dimensional axis, and the time information on the third axis of the three-dimensional axis By arranging construction information structures in a specific area of the three-dimensional construction information posting space consisting of the listed time axis and creating a three-dimensional construction information cube 200 in the construction information database, the user terminal 120 causes the three-dimensional construction It is possible to display spatial information, work type information, and activity information through the information cube 200 .

At this time, the construction information structures may have different arranged areas according to spatial information, work type information, and activity information. In FIG. 3 , one three-dimensional construction information cube 200 is generated by arranging a plurality of construction information structures shows the appearance.

For example, from January 5, 2020 to January 12, 2020, for the specific construction information made for each part of 105 Building 401, the color of the specific cube and the position of the specific cube on the 3D construction information cube 200 By using, it is possible to display information about a specific construction made in a specific period for a specific space.

On the other hand, in a state in which spatial information, work type information, and activity information are obtained as described above, a request for augmented reality information for a specific part in specific spatial information on a live-action image taken by the user terminal 120 is requested by the user terminal 120 . When obtained from, the construction information management server 110, with reference to the location information in which the user terminal 120 is located, can identify a specific individual space in which the user terminal 120 is located.

Here, the construction information management server 110 may obtain location information in which the user terminal 120 is located by referring to at least one of GPS information and an augmented reality marker for the user terminal 120 .

In this case, when the location information of the user terminal 120 is obtained by GPS information, there is a convenience in not having to go through a process of generating a separate marker for obtaining the location information of the user terminal 120 . In addition, the marker has an advantage that it can be recognized quickly and accurately even with a simple algorithm. Therefore, it is not limited to using only one of the GPS information and the augmented reality marker, and it may be advantageous to appropriately use them together.

For example, when construction is performed in a place where GPS information reception is not smooth, such as a basement, by using the augmented reality marker alone, or by using the GPS information and the augmented reality marker in combination, it is possible to obtain accurate location information of the user terminal 120. can

Additionally, information on the direction in which the camera lens of the user terminal faces may be acquired by a direction sensor, a gravity sensor, a geomagnetic sensor, or the like of the user terminal 120 .

And, when a specific individual space in which the user terminal 120 is located is identified, the construction information management server 110 for a specific part corresponding to the actual image among the work type information and activity information corresponding to the specific individual space. By classifying specific work type information and specific activity information according to a preset category, and transmitting selection menus for specific work type information and specific activity information classified according to a preset category to the user terminal 120 , the user terminal 120 ) can be supported to render the selection menus and display the augmented reality screen by superimposing the selection menus on the actual image.

In this case, the category may include at least document information, drawing information, image information, and detection information.

As an example, Figure 4a is, in a state in which the actual image of the user's surrounding environment, for example, the reinforcing work site, is output through the head mounted display mounted by the user, specific work information and specific activity for a specific part on the actual image It shows a state in which the information is displayed while being classified into categories such as drawings, galleries, and documents, superimposed on a live-action image.

More specifically, documents such as inspection journals for each work type may be classified into document categories, inspection photos for a specific part may be classified into a gallery category, and drawings for a specific part may be classified into a drawing category.

On the other hand, while construction information and activity information corresponding to a specific individual space can be checked through augmented reality as shown in FIG. 4A, construction type information corresponding to a specific individual space for reasons of maintenance, etc. even after construction is completed Users and activity information can be checked through augmented reality.

As an example, FIG. 4B shows, in a state in which a live-action image of the user's surrounding environment, for example, a completed apartment living room, is output through the user's tablet PC, specific work type information and specific activity information for a specific part appearing in the live-action image are predetermined. It is classified into the category of and shows the augmented reality display with selection menus superimposed on the live-action image.

Specifically, in FIG. 4B , there are 32 pieces of construction information classified as drawings corresponding to the apartment living room, 115 pieces of construction information classified as documents corresponding to the apartment living room, and construction information classified as photos corresponding to the apartment living room. You can see how they are displayed as 20.

In addition, in a situation where a selection menu such as drawing, gallery, document, inspection, safety, etc. is displayed as shown in FIG. 4B , when the user selects a specific selection menu, sub-information corresponding to the corresponding selection menu may be displayed as shown in FIG. 4C .

Specifically, when the user selects the document menu from the selection menu such as drawings and gallery documents through the augmented reality environment, detailed documents corresponding to the living room of the apartment where the user is located, for example, photo sites, checklists, and supervision journals As sub-information corresponding to the document menu, it is shown that the image is superimposed on the actual image and displayed.

In addition, it is not limited to inquiring the previously acquired construction information corresponding to a specific individual space, and new construction information corresponding to a specific individual space may be updated by selecting a document creation menu or the like.

For example, when a defect occurs due to a leak in a specific part of the living room of an apartment, the range in which the leak may occur may be specified by inquiring the previously stored construction information. Accordingly, when the defect repair is actually completed, new information indicating that the defect repair has been made for a specific part may be updated.

Accordingly, it is possible to check from time to time whether the progress of construction is being carried out accurately according to the design document before completion, and after completion, it is possible to make accurate defect repair work based on the accumulated design information and inspection information for each specific individual space. do.

On the other hand, when a selection signal for a specific selection menu corresponding to any one of specific work type information and specific activity information among selection menus is obtained from the user terminal 120 , the construction information management server 110 , the specific selection menu By transmitting specific design information and specific construction information corresponding to any one of specific construction type information and specific activity information corresponding to the user terminal 120, the user terminal 120 renders specific design information and specific construction information. Thus, specific design information and specific construction information can be superimposed on the actual image to support displaying the augmented reality screen.

For example, while it was initially designed to construct 10 5m long boiler hot water pipes for a specific individual space, in reality, 8 5m long boiler hot water pipes and 3 3m long boiler hot water pipes were constructed according to the site situation. The construction situation can be assumed.

In this case, the construction information management server 110 causes the user terminal 120 to (i) information indicating a plan to construct 10 boiler hot water pipes of 5 m length as specific design information, (ii) 5 m as specific construction information It is possible to support displaying an augmented reality screen by superimposing each of the information indicating that eight long boiler hot water pipes and three 3 m long boiler hot water pipes were actually constructed on the actual image for a specific individual space.

Accordingly, the user can easily compare and analyze information discrepancies that may occur at any time between design information and actual construction results at the construction site through the augmented reality screen.

In addition, when the detection or inspection menu for detecting a specific part of the selection menu is selected, the construction information management server 110 (i) analyzes the actual image corresponding to the specific part obtained from the user terminal 120, Generate new detection information for a specific part, check the reference value corresponding to the specific part with reference to the specific design information, and transmit the new detection information and the reference value to the user terminal 120 so that the user terminal 120 makes the reference value and By rendering the new detection information, it is possible to support displaying the augmented reality screen by superimposing the reference value and the new detection information on the actual image.

For example, as shown in FIG. 5 , when the user selects the detection menu to detect the reinforcement spacing of the reinforcing bars, the construction information management server 110 corresponds to a specific portion obtained from the user terminal 120 . It is possible to generate new detection information for a specific site by analyzing the actual image of reinforcing reinforcement. In this case, the new detection information may include actual measurement information about the rebar spacing corresponding to the acquired actual image.

And, the construction information management server 110 may check the reference value corresponding to the specific part with reference to the specific design information for the specific part. In this case, the reference value may include design information regarding the reinforcement interval.

And, the construction information management server 110 transmits the actual measurement information and design information about the reinforcing bar spacing to the user terminal 120 to allow the user terminal 120 to add each of the measurement information and the design information to the actual image. It can be overlapped to display the augmented reality screen. Through this, the user can immediately and easily compare and analyze design information and actual measurement information in the field.

On the other hand, when the process monitoring request is obtained from the user terminal 120, the construction information management server 110, the actual image captured by the user terminal 120 obtained from the user terminal 120 to the monitoring terminal 130 Or, the user terminal 120 can be made to directly transmit the actual image to the monitoring terminal (130).

And, the construction information management server 110, or transmits the process instruction information for a specific area of the arbitrary area of the actual image obtained from the monitoring terminal 130 to the user terminal 120, or the monitoring terminal 130 is the process Directly transmit the instruction information to the user terminal 120, the user terminal 120 to render the markup 600 corresponding to the process instruction information, and superimpose the markup 600 on the actual image to augmented reality It can support to display the screen.

As an example, as shown in FIG. 6, when a user, for example, a field worker, wants to receive specific instructions from a field engineer, engineer, or supervisor, etc. about the reinforcing process, a live-action image showing how reinforcing is made is taken and the user It may be transmitted directly from the terminal 120 to the monitoring terminal 130 , or may be transmitted from the user terminal 120 to the monitoring terminal 130 through the construction information management server 110 .

In addition, an indicator using the monitoring terminal 130, for example, a field technician, may deliver process instruction information to the user terminal 120 for a specific area on the actual image obtained from the user terminal 120 of the operator.

In this case, the process instruction information may include a supplementary work implementation instruction for an inappropriate construction state, an instruction on a work order, and an instruction to respond to civil complaints in a specific area of the construction site.

And, the process management server causes the user terminal 120 to render a markup 600 corresponding to the process instruction information, for example, a pin-shaped mark, and superimpose the markup 600 on the actual reinforcing image. Thus, by supporting the display of the augmented reality screen, it is possible to transmit and receive accurate work instructions in real time even if the operator and the indicator are not together in the same space.

Meanwhile, although the pin-shaped markup 600 is illustrated as being rendered in FIG. 6 for convenience of description, the shape of the markup is not limited thereto, and may be rendered in various shapes such as arrows, circles, and check marks. In addition, the markup 600 may include text information corresponding to the process instruction.

In addition, when the process instruction voice information corresponding to the process instruction for a specific area of the actual image is additionally obtained from the monitoring terminal 130 , the construction information management server 110 causes the user terminal 120 to markup 600 ) to display the augmented reality screen by superimposing it on the live-action image, it is also possible to output the process instruction voice information.

Accordingly, the process operator can proceed with the process according to the process instruction explained by the manager, and the manager can manage and supervise the process carried out by the operator in real time, thereby preventing process defects in advance Not only that, but it can also enable process operators to proceed with the process according to the designed construction standards.

In addition, the embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software field. Examples of the computer-readable recording medium include a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM, a DVD, and a magneto-optical medium such as a floppy disk. media), and hardware devices specially configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform processing according to the present invention, and vice versa.

In the above, the present invention has been described with specific matters such as specific components and limited embodiments and drawings, but these are provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , those of ordinary skill in the art to which the present invention pertains can devise various modifications and variations from these descriptions.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and not only the claims described below, but also all modifications equivalently or equivalently to the claims described below belong to the scope of the spirit of the present invention. will do it

Claims (12)

In a method for managing at least some of construction information and maintenance information based on augmented reality,
(a) (i) spatial information that is information about individual spaces in the building specified by at least one of the building's wing, arc, floor, and room, (ii) information on the type of work for each part in the individual spaces and (iii) in a state in which activity information corresponding to the work type information is obtained, when a request for augmented reality information for a specific part in specific spatial information on a live-action image taken by the user terminal is obtained from the user terminal, Step, by the construction information management server, with reference to the location information in which the user terminal is located, confirming a specific individual space in which the user terminal is located;
(b) the construction information management server, among the work type information and the activity information corresponding to the specific individual space, the specific work type information and specific activity information for the specific part corresponding to the live-action image are preset Classify according to a category, and transmit the selection menus for the specific work type information and the specific activity information classified according to the preset category to the user terminal so that the user terminal renders the selection menus, and the selection supporting menus to be superimposed on the actual image to display an augmented reality screen; and
(c) when a selection signal for a specific selection menu corresponding to any one of the specific construction type information and the specific activity information among the selection menus is obtained from the user terminal, the construction information management server selects the specific By transmitting specific design information and specific construction information corresponding to any one of specific construction information corresponding to the menu and specific activity information to the user terminal, the user terminal renders the specific design information and the specific construction information supporting the display of an augmented reality screen by superimposing the specific design information and the specific construction information on the actual image;
including,
When the detection menu for detecting the specific part of the selection menu is selected, the construction information management server (i) analyzes the actual image corresponding to the specific part obtained from the user terminal to the specific part Generate new detection information including actual measurement information for, check the reference value indicating the construction plan information corresponding to the specific part with reference to the specific design information, and the new detection including the actual measurement information for the specific part By transmitting the reference value indicating the information and the construction plan information corresponding to the specific part to the user terminal, the user terminal renders the reference value and the new detection information so that the reference value and the new detection information are the live-action image It supports to display the augmented reality screen by superimposing it on
In step (a),
The construction information management server obtains the location information in which the user terminal is located with reference to at least one of the GPS information and the augmented reality marker for the user terminal,
The category includes at least document information, drawing information, image information, and detection information. delete delete According to claim 1,
(d) the construction information management server, (i) when a process monitoring request is obtained from the user terminal, transmits the live-action image taken by the user terminal obtained from the user terminal to the monitoring terminal, or the user terminal to transmit the actual image to the monitoring terminal, and (ii) transmit process indication information for a specific area among any areas of the actual image obtained from the monitoring terminal to the user terminal, or the monitoring terminal to transmit the process indication information to the user terminal, to cause the user terminal to render a markup corresponding to the process indication information, and to superimpose the markup on the live-action image to display an augmented reality screen step;
Method characterized in that it further comprises. 5. The method of claim 4,
When the process instruction voice information corresponding to the process instruction for the specific area of the live-action image is additionally obtained from the monitoring terminal, the construction information management server causes the user terminal to superimpose the markup on the live-action image to output the process instruction voice information while displaying the augmented reality screen. According to claim 1,
The construction information management server includes at least one unit cube cell consisting of a unit space, a unit construction type, and a unit time with reference to each of the spatial information, the construction type information, and the time information of each of the activity information. A spatial axis in which structures are created, the spatial information is arranged on the first axis of the three-dimensional axis, the work type information is arranged on the second axis of the three-dimensional axis, and the time information is arranged on the third axis of the three-dimensional axis By arranging the construction information structures in a specific area of the three-dimensional construction information posting space consisting of a time axis to create a three-dimensional construction information cube in the construction information database, the user terminal can use the three-dimensional construction information cube Method characterized in that to display the spatial information, the work type information and the activity information. In the construction information management server for managing at least some of construction information and maintenance information based on augmented reality,
at least one memory storing instructions; and
at least one processor configured to execute the instructions;
The processor is configured to: (1) (i) spatial information, which is information about individual spaces in the building specified by at least one of a building, an arc, a floor, and a room, (ii) in the individual spaces In a state in which the work type information for each part, and (iii) the activity information corresponding to the work type information is obtained, augmented reality information request for a specific part in the specific spatial information on the actual image taken by the user terminal from the user terminal When this is obtained, the process of identifying a specific individual space in which the user terminal is located with reference to the location information in which the user terminal is located; and (2) classifying specific work type information and specific activity information for the specific part corresponding to the live-action image among the work type information and the activity information corresponding to the specific individual space according to a preset category, By transmitting the selection menus for the specific work type information and the specific activity information classified according to the preset category to the user terminal, the user terminal renders the selection menus, and the selection menus are applied to the live-action image. A process of supporting to display an augmented reality screen by overlapping; and (3) when a selection signal for a specific selection menu corresponding to any one of the specific work type information and the specific activity information among the selection menus is obtained from the user terminal, a specific work type corresponding to the specific selection menu By transmitting specific design information and specific construction information corresponding to any one of information and specific activity information to the user terminal, the user terminal renders the specific design information and the specific construction information to obtain the specific design information and the A process of supporting to display an augmented reality screen by superimposing specific construction information on the actual image;
Execute the instructions to perform
The processor is
In the process (3) above,
When the detection menu for detecting the specific part is selected from among the selection menus, (i) the actual image corresponding to the specific part obtained from the user terminal is analyzed to include actual measurement information on the specific part. Generate detection information, check the reference value indicating the construction plan information corresponding to the specific part with reference to the specific design information, and correspond to the new detection information including the actual measurement information for the specific part and the specific part By transmitting the reference value indicating the construction plan information to be transmitted to the user terminal to render the reference value and the new detection information to the user terminal, the reference value and the new detection information are superimposed together on the live-action image, augmented reality screen support to display
The processor is
In the process (1) above,
Obtaining the location information in which the user terminal is located by referring to at least one of GPS information and an augmented reality marker for the user terminal,
Construction information management server, characterized in that the category includes at least document information, drawing information, image information and detection information. delete delete 8. The method of claim 7,
(4) the processor, (i) when a process monitoring request is obtained from the user terminal, transmits the live-action image taken by the user terminal obtained from the user terminal to the monitoring terminal, or causes the user terminal to transmit the actual image to the monitoring terminal, and (ii) transmit process instruction information for a specific area among any areas of the actual image obtained from the monitoring terminal to the user terminal, or the monitoring terminal directs the process a process of transmitting information to the user terminal, causing the user terminal to render a markup corresponding to the process indication information, and superimposing the markup on the live-action image to display an augmented reality screen;
Construction information management server, characterized in that it further comprises. 11. The method of claim 10,
The processor is
When the process instruction voice information corresponding to the process instruction for the specific region of the live-action image is additionally obtained from the monitoring terminal, the user terminal superimposes the markup on the live-action image while displaying an augmented reality screen Construction information management server, characterized in that to output the process instruction voice information. 8. The method of claim 7,
The processor is
By referring to each of the spatial information and the construction type information of each of the activity information, construction information structures including at least one unit cube cell consisting of a unit space, a unit construction type, and a unit time are generated, and the spatial information is 3D A three-dimensional construction information posting space consisting of a space axis arranged on the first axis of the axis, a construction axis in which the work type information is arranged on the second axis of the three-dimensional axis, and a time axis in which the time information is arranged on the third axis of the three-dimensional axis By arranging the construction information structures in a specific area to generate a three-dimensional construction information cube in the three-dimensional construction information posting space, the user terminal allows the spatial information, the work type through the three-dimensional construction information cube. Construction information management server, characterized in that to display the information and the activity information.

Images