KR20220007968A - Method Of Image Data Processing For Remote Safety Management of Construction Site - Google Patents

Abstract

The present invention provides a system for enabling a supervisor to perform supervision at a remote location by using an image taken by a constructor. According to the present invention, the entire construction site is divided into appropriate unit areas and arrange a designated unit shooting area so that at least one shooting is done, and shooting starts when a person in charge of photography reaches the corresponding unit shooting area, so that captured images of the entire construction site are acquired, thereby implementing objective data collection. When a shooting location is transmitted to a server along with the captured images, the captured images are automatically classified and managed by unit shooting area, thereby facilitating review and management of image data. In addition, when the supervisor reviews the image data in an AR image type, images managed for each unit shooting area are provided by being including in an AR image, thereby facilitating remote supervision of the construction site. An image data processing method for remote construction site management comprises a transmission step, a storage and management step, and a supervisor output step.

Description

Method Of Image Data Processing For Remote Safety Management of Construction Site

The present invention relates to a method of processing image data for remote safety management of a construction site.

The content described in this section merely provides background information for the present embodiment and does not constitute the prior art.

As stipulated by the Building Act, construction site supervision is required to check whether buildings, construction equipment, or structures are constructed according to the contents of the design drawings, and to supervise and supervise quality control, construction management and safety management. However, if the building is not subject to resident supervision, there is no safety manager obligation, so there is a safety management gap, which makes it particularly vulnerable to safety accidents. Safety management is carried out for each detailed work type in the construction stage, and despite advances in information and communication technology, numerous documents such as checklists, inspection requests, and result reports are still created and managed offline at small and medium-sized construction sites, which wastes site resources and wastes site resources. , there is a possibility that sincere inspection and reporting may not be made.

As an alternative to this, a method in which the construction site is photographed by the builder and the supervisor reviews the video filmed from a remote location to conduct the supervision may be used. Since it is premised that a person other than the supervisor in charge can film at a remote location, in order to ensure the objectivity of the video filming process, an image with a 360-degree viewing angle is filmed, and the entire area of the construction site is filmed objectively in advance. It is preferable that the shooting location where the image is taken is also designated by the supervisor.

A supervisor reviews a number of captured images, and since the captured data is acquired several times depending on the progress of the process, a significant amount of image data is accumulated. In terms of management and utilization of image data, the captured images need to be systematically managed.

The present invention is a system in which a contractor can record a site image at a plurality of designated locations within a construction site in the form of an image having a 360-degree viewing angle, and a supervisor checks the site image received from a remote site through a server to perform remote site supervision. In this case, the purpose is to increase the usability by effectively classifying and managing the images taken at a plurality of shooting locations in the construction site.

In order to solve the above problems, the method for processing image data for remote safety management of a construction site according to an embodiment of the present invention is that a shooting point where a shooting device for shooting an image of a 360-degree viewing angle is installed is located in the center , defining the entire shooting point of the construction site by arranging the unit shooting area in the area between the construction site boundary and the building boundary; The steps of the constructor sequentially installing the photographing device at all the photographing points to photograph the image, measuring the photographing position at which the image was taken with a satellite positioning device, and transmitting the image and the photographing position to the server; The server categorizes the images for each shooting area based on the shooting location, stores them in respective folders, and manages them; The process of the construction site is progressed, the subsequent photographing of at least a part of the unit photographing area is made, and transmitting the image and the photographing location to the server; The server designates an image as data belonging to a corresponding unit shooting area based on the shooting location of the image acquired in the subsequent shooting, storing and managing the image for each unit shooting area; And by the call of the supervisor, the server is characterized in that it comprises the step of arranging and outputting the images belonging to the unit shooting area.

In addition, the server is characterized in that it further comprises the steps of generating a navigation map including unit photographing area information and a photographing location where the image was captured, and generating an overlay image in which the navigation map is displayed on the image.

In addition, the navigation map is characterized in that the photographing location is displayed on the drawing of the construction site, and the boundary of the photographing location and the unit photographing area adjacent to the photographing location are displayed together.

In addition, it is characterized in that at least one of a list and a preview image of images captured and stored in each unit shooting area and a preview image are displayed on the photographing position and the unit photographing area adjacent to the photographing position.

In addition, when the supervisor selects any one of the list and the preview image, it is characterized in that the image indicated by any one of the list and the preview image is called and outputted from the folder designated in response to the unit shooting area in the server.

The present invention is a system in which a supervisor performs supervision from a remote location using an image taken by a constructor, in which the entire area of the construction site is divided into appropriate unit areas in advance, and a designated unit photographing area is arranged so that at least one photographing is performed. In addition, by having the filming person start filming when they reach the corresponding unit filming area, filming images for the entire construction site are acquired and objective data collection is achieved. There is an effect of providing a high-level image, that is, an image that includes the entire object to be photographed and provides resolution sufficient to review the object to be photographed.

1 is a perspective view showing a VR image capturing apparatus for remote safety management of a construction site according to an embodiment of the present invention.
2 is a conceptual diagram illustrating an example of use of a VR image capturing apparatus for remote safety management of a construction site according to an embodiment of the present invention.
3 is a conceptual diagram illustrating the configuration of a construction site remote safety management system according to an embodiment of the present invention.
4 illustrates a unit photographing area and photographing location of a construction site remote safety management system according to an embodiment of the present invention.
5 illustrates a classification method of VR image data for remote safety management of a construction site according to an embodiment of the present invention.

Hereinafter, some embodiments of the present invention will be described in detail with reference to exemplary drawings. In adding reference numerals to the components of each drawing, it should be noted that the same components are given the same reference numerals as much as possible even though they are indicated on different drawings. In addition, in describing the present invention, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

In addition, in describing the components of the present invention, terms such as first, second, A, B, (a), (b), etc. may be used. These terms are only for distinguishing the elements from other elements, and the essence, order, or order of the elements are not limited by the terms. Throughout the specification, when a part 'includes' or 'includes' a certain element, this means that other elements may be further included, rather than excluding other elements, unless otherwise stated. . In addition, the '... Terms such as 'unit' and 'module' mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software.

1 is a perspective view showing a VR image capturing apparatus for remote safety management of a construction site according to an embodiment of the present invention.

Referring to FIG. 1 , the VR image recording device 10 includes a 360 degree camera 100 , a grid dome cover 120 , a tripod 140 , a horizontal adjustment unit 130 , and a network module 150 . include A person in charge of filming by installing the VR image capturing apparatus 10 at a plurality of filming points 200 in the construction site 20 may be an authorized person such as a contractor or a field assistant supervisor.

Although the photographed image according to an embodiment has been described based on the VR/AR image, the present invention is not limited thereto, and a photographed image containing a photographing range of a sufficient viewing angle or an image output device having a wide output range sufficient to display the photographed image is also used. can be The photographed image according to the present invention may be in any form as long as the photographing is performed in all directions at the same time so that the subjectivity of the photographer can be excluded.

The 360-degree camera 100 is formed to take a VR image, and a plurality of cameras 110 may be arranged radially based on a central axis on a horizontal plane. Preferably, it may include at least four cameras 110 . The 360 degree camera 100 is preferably composed of a plurality of cameras 110 overlapping at least a portion of a field of view (FoV).

The grid dome cover 120 is a transparent hemispherical cover sized to accommodate the 360-degree camera 100, and grid lines 122 corresponding to latitude and longitude are displayed, so that the 360-degree camera 100 is a grid line 122 and You can record videos at the same time. The grid dome cover 120 preferably covers a wider area than a hemisphere that is exactly half of a sphere. The radius of the grid dome cover 120 is selected to a size capable of clearly capturing both the grid line 122 and the image in the 360 degree camera 100 . Since the 360-degree camera 100 in which a small number of cameras 110 are combined has a wide focal range using a fisheye lens, the radius of the grid dome cover 120 is difficult to easily transport the VR image capturing device 10 . may not be enough to cause In addition, the grid dome cover 120 includes a mark indicating true north, and is rotatably formed based on the central axis of the 360-degree camera 100 on a plane on which the 360-degree camera 100 is disposed. The photographer may rotate the grid dome cover 120 to align the mark indicating true north to the magnetic north indicated by the compass 910 .

The VR image photographing apparatus 10 according to an embodiment may photograph the VR image after aligning the grid dome cover 120 to true north. The tripod 140 may have any shape as long as it is for installing the VR image capturing device 10 at the shooting position, and it is preferable that the tripod 140 includes a horizontal adjustment unit 130 at the top because it can shorten the installation time.

The network module 150 of the VR image photographing apparatus 10 connects the VR image photographing apparatus 10 and the server 310 through the Internet, and may additionally be connected to a personal terminal (not shown) in charge of photographing. The personal terminal connected to the VR image photographing apparatus 10 may function as an input device or an output device of the VR image photographing apparatus 10 .

The VR image recording device 10 may include a GPS receiving module (not shown) on its own, but in some cases, it receives GPS information from the personal terminal in charge of shooting, undergoes appropriate authentication and verification procedures, and then sets it to the shooting location. You can also use it. A dedicated program for exchanging data with a VR image capturing device may be installed in the personal terminal to increase shooting convenience. Meanwhile, high-precision GNSS (GLONASS) may be used in parallel with GPS to acquire satellite location information, particularly in an environment where high-rise buildings are dense. In addition, it will be apparent to those skilled in the art that various auxiliary means such as a wi-fi positioning system (WPS) and a beacon may be included as a positioning system for securing location information. The photographing location secured through such a positioning system can be utilized to systematically manage the photographed image in the server.

The VR image photographing apparatus 10 may include an authentication means. It may include authentication means for obtaining approval from the server 310 by receiving an input whether the VR image photographing device 10 is installed at a specified shooting location, shooting at a specified time, and/or an authorized person in charge. It is possible to increase the reliability of the supervision by checking whether such authentication for the captured image. A personal terminal in charge of photographing connected to the VR image photographing apparatus 10 may be used for such authentication. The VR image photographing device 10 may be configured to authenticate the identity of the constructor who is in charge of filming by itself, and to be authenticated by connecting the personal terminal in charge of the photographing to the VR image photographing apparatus 10 by communication. may be

2 is a conceptual diagram illustrating an example of use of a VR image capturing apparatus for remote safety management of a construction site according to an embodiment of the present invention.

Referring to FIG. 2 , according to the shooting instruction of the supervisor, the constructor takes a VR image using the VR image capturing device 10 at a pre-designated shooting location.

The VR image photographing apparatus 10 may be mounted on a tripod 140 including a bowl head or a ball head that is easily horizontally adjusted, and the installer installs the tripod 140 at the photographing position and then performs the VR image After fixing the photographing device 10 horizontally, check the magnetic north with a separate or built-in compass 910, and rotate the grid dome cover 120 in consideration of the declination of the work site to determine the true north of the grid dome cover 120 After rotating the marker to match true north, VR images can be taken.

VR images can be taken continuously along the designated shooting route at the job site, and if the supervisor reviews the VR images in real time from a remote location, the supervisor will review the VR images in real time, and if there is an approval that there is no abnormality and a movement instruction is given, the shooting location will be changed. You can also move on to continue the follow-up shooting.

3 is a conceptual diagram illustrating the configuration of a construction site remote safety management system according to an embodiment of the present invention.

Referring to FIG. 3 , the construction site remote safety management system includes a VR image capturing device 10 , a server 310 , and a supervisor terminal device 320 . The VR image capturing device 10 , the server 310 , and the supervisor terminal device 320 may exchange data with each other through the network 330 .

The VR image photographing device 10 is connected to a personal terminal such as a smart phone or tablet carried by the person in charge of filming to output information of the VR image photographing apparatus 10 or input data into the VR image photographing apparatus 10 . The VR image photographing apparatus 10 may be connected to the server 310 to receive data stored in the database of the server 310, such as data related to the shooting instruction, the progress of the work, and the supervision result.

The server 310 transmits data between the VR image capturing device 10 and the supervisor terminal device 320, creates a document in the required format from the transmitted data, and manages a database for various documents and field drawings, It is possible to perform a task of converting a VR image into an AR image so that it can be output to the image processing and supervisor terminal device 320 with a large computational load. The database stored and managed in the server 310 includes a design book file, project name, design company, design supervisor, construction company, construction supervisor, drawing name, drawing number, applied standard version, history number, drawing scale, PJ stage, orientation Various information such as information (horizontal-vertical position information) and the like may be stored.

The supervisor terminal device 320 may display the AR image transmitted from the server 310, and receive tagging including instructions and the like at a predetermined location in the AR image from the supervisor. The supervisor terminal device 320 may include an AR image display unit, an input means for tagging the AR image, and a network module for connecting to a personal terminal such as a supervisor's smart phone or tablet.

The supervisor terminal device 320 may include an AR image display unit using AR goggles, etc., an input means for tagging the AR image, and a network module for connecting to a personal terminal such as a supervisor's smartphone or tablet.

The supervisor can use the supervisor terminal device 320 to review the AR image of the scene filmed or filmed in real time by the person in charge of filming, and can use the input means to leave a tag in the target area that requires action. In addition, detailed instructions can be recorded in addition to the tag using a personal terminal as an input means. Also, the supervisor terminal device 320 may transmit all documents exchanged with the server 310, such as instruction documents, re-examination request documents, and approval review documents, to the supervisor's personal terminal connected thereto. In the case of a document requiring approval, the supervisor's terminal device 320 may transmit the document to the supervisor's personal terminal and request to select payment for approval or rejection.

The supervisor examines the AR image and, if there is a target area that requires instructions, can tag the corresponding location in the AR image and input instructions with a personal terminal. When the supervisor confirms the instruction and approves the tagging information, the supervisor terminal device 320 transmits the information to the server 310 . When the server 310 receives the tagging information left by the supervisor in the AR image, the server 310 extracts the target location information corresponding to the field drawing for the target area from the AR image and transmits the related information and the generated document to the supervisor terminal device 320 . do. The supervisor terminal device 320 may display the received target location information on the AR image to receive review and approval of the supervisor, or transmit a document to the supervisor's personal terminal to receive review and approval. The supervisor-approved work order including instructions is transmitted from the supervisor terminal device 320 to the server 310, and the server 310 stores and manages the work order in the document database, and then a VR image recording device (10) send to

The VR image photographing device 10 displays the location, that is, the shooting point 200, to which the received work content corresponds, on the personal terminal connected to the VR image photographing apparatus 10 or the VR image photographing apparatus 10, and the constructor Refer to it so that you can take action and result shooting.

The contractor may check the receipt of the work instruction received in the VR image recording device 10 or the personal terminal of the contractor connected thereto, process the task, and then shoot an image reporting the processing result and input the content. The VR image photographing apparatus 10 may transmit whether or not reception of a document such as a work order is confirmed, a work processing result report, etc., to the server 310 with the approval of the builder. The server 310 may store and manage the progress of these tasks in a document database and transmit the corresponding details to the supervisor terminal device 320 . The supervisor's terminal device 320 may request the supervisor's review and approval by transmitting the corresponding details to the supervisor's personal terminal. The approved details are transmitted to the server 310, stored and managed in the document database, and the server 310 transmits the approval result to the VR image recording device 10 to confirm the construction's reception, Supervision work is completed.

4 illustrates a unit photographing area and photographing location of a construction site remote safety management system according to an embodiment of the present invention.

5 illustrates a classification method of VR image data for remote safety management of a construction site according to an embodiment of the present invention.

4 and 5, the method for processing VR image data for remote safety management of a construction site according to an embodiment of the present invention is characterized in that the VR image is classified and managed for each unit shooting area 420 in which it is captured. do.

The unit photographing area 420 determines the identification distance 410 in consideration of, for example, the resolution of the VR image photographing apparatus 10 and the minimum identification size of the photographing target, and a hexagon inscribed in a circle whose radius is the identification distance 410 size. A unit photographing area 420 of the shape may be defined. The unit photographing area 420 arranged in a honeycomb shape is merely an example, and other types of unit photographing area 420 may be arranged. The VR image is taken by the person in charge of shooting in the unit shooting area 420 within the construction site 20 designated by the supervisor.

However, considering the general situation of the construction site 20, it is easy to expect that it is difficult to install the VR image photographing device 10 at the specified precise location. can increase

In one embodiment of the present invention, the unit photographing area 420 is arranged in advance at the construction site 20, and the photographing officer performs at least one photographing in all the unit photographing areas 420, preferably at a designated photographing location. Although shooting is performed in , it is characterized in that it supports shooting within at least the unit shooting area 420 .

The VR image photographing apparatus 10 may be connected to a personal terminal in charge of photographing. The personal terminal possessed by the person in charge of filming exchanges data with the VR image photographing device 10 and receives the VR image photographing apparatus 10 from the server 310 in the construction site 20 in which the unit photographing area 420 is disposed. You can download the shooting map, check the shooting point 200 using the satellite positioning information provided from the personal terminal, and move according to the instructions of the shooting map.

The program mounted on the personal terminal in charge of the photographing may display a drawing of the construction site 20, and the form in which the unit photographing area 420 is arranged may be displayed in an overlay form on the drawing. It may have a form similar to general map navigation, and the current location by satellite positioning provided by the personal terminal in charge of photographing may be displayed on the screen output by the program. When it is confirmed from the satellite positioning information of the personal terminal that the person in charge of filming moves within the construction site 20 and enters the unit photographing area 420 to be photographed, the personal terminal sends the person in charge of filming to the VR image photographing device 10 ) can be marked for installation.

When the person in charge of shooting installs the VR image capturing device 10 at the current location and finishes shooting, the unit shooting area 420 on the screen output by the program may be displayed as having completed shooting. For example, if the person in charge of shooting selects and clicks the unit shooting area 420 on the screen output by the program mounted on the personal terminal after installing the VR image capturing device 10, the VR image capturing device 10 receives this signal This allows you to shoot VR images.

The person in charge of shooting moves so that all the unit shooting areas 420 displayed on the screen of the personal terminal are in the shooting completion state, and when shooting is completed, VR image shooting for the entire construction site 20 is completed.

When partial shooting of a specific area within the construction site 20 is requested by the supervisor, the personal terminal screen of the person in charge of shooting connected to the VR image capturing device 10 displays the unit shooting areas 420 for which shooting is requested separately. can be specified to be The person in charge of photographing may perform the requested photographing operation with reference to the personal terminal screen on which the photographing point 200 received from the server 310 is displayed.

VR images photographed in each unit photographing area 420 may be transmitted to the server 310 together with the photographing location and classified into respective designated folders and managed. The server 310 identifies and classifies the unit shooting area 420 including the shooting location provided with the VR image, and records the received VR image in a folder assigned to the corresponding unit shooting area 420 in a form that can be managed save as Each folder may be assigned in the initial stage of arranging the unit photographing area 420 with reference to the drawing of the construction site 20 .

In addition, when the shooting point 200 is within a building, the altitude of the shooting point 200 is reviewed from the satellite location information to automatically determine the location of the shooting point 200, and then classified and stored in a folder managed separately for each building floor. can be

Meanwhile, at the construction site 20 , a record may be left by photographing an area being worked at any time during the process. Even when general image data other than VR images are transmitted to the server 310, the location information is input, and the location of the folder in which the general image data is stored based on the location information is found in the previously classified unit shooting area 420. You can save it in the corresponding folder. The image data input to the server 310 requires no additional effort by automatically classifying and storing the data in the case where the shooting is not according to the supervisor's instruction or the scheduled schedule, where the shooting location and shooting area are classified and stored in a folder where the history is managed. It can be minimized and classified and managed. As a result, the supervisor or contractor can easily access and utilize the data without requiring additional time or cost to manage the video data.

Data in the form of images or videos is not easy to search or review compared to data organized in text form. If the image data collected in the same manner as in an embodiment is not spatially and temporally managed in advance, the usefulness of the data may be drastically reduced. In addition, it may not be efficient to limit the form of the image only to the format designated by the supervisor (eg, a VR image with a 360-degree viewing angle). In fact, in the construction site 20, it is often the case that constructors or workers personally carry smartphones, and the images obtained by these means are automatically classified in the corresponding folder based on the location and time to manage the data. It would be desirable to provide a system capable of In addition, since data in the same place is managed in the same folder, it can be efficient to extract and organize the images to be submitted and prepared for the supervision report.

On the other hand, the VR images classified and stored in the server 310 for each shooting area 420 can be utilized to produce AR images for review by the supervisor. A navigation map based on the construction site 20 drawing may be configured to reside in an overlay form on a part of the screen on the screen formed so that the supervisor can look at the AR image including the 360-degree viewing angle. The navigation map may be enlarged and reduced, may display the entire construction site 20, and may display an area on the drawing that the AR image currently under review covers.

Since the image data according to an embodiment is classified for each unit capturing area 420 , when the navigation map is displayed, the image data may be shown in a form in which the unit capturing area 420 is disposed thereon. The supervisor can perform remote monitoring with a sense of presence as if in the construction site 20 by referring to the navigation map displayed on a part of the screen of the AR image. In addition, the unit capturing area 420 of the navigation map additionally shows past captured image data in the form of a list or preview image so that the supervisor selects the unit capturing area 420 on the screen to perform a more comprehensive review. can

If the constructor provides other information such as the stage of construction and work progress along with the VR image, such information may also be displayed in the AR image reviewed by the supervisor. The server 310 can store and manage past VR images that are managed by the progress of construction and work step by step, and the supervisor calls the past VR images at the shooting point 200 of the site and compares them with the current AR images. to assist you in your review. That is, the server 310 may be configured to provide a kind of time machine image at the corresponding shooting location when the supervisor requests it.

The above description is merely illustrative of the technical idea of this embodiment, and a person skilled in the art to which this embodiment belongs may make various modifications and variations without departing from the essential characteristics of the present embodiment. Accordingly, the present embodiments are intended to explain rather than limit the technical spirit of the present embodiment, and the scope of the technical spirit of the present embodiment is not limited by these embodiments. The protection scope of this embodiment should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present embodiment.

Claims (5)

defining an entire shooting point of the construction site by arranging a unit shooting area, in which a shooting point for capturing an image of a 360-degree viewing angle is installed, is located in the center, in an area between the construction site boundary and the building boundary;
The construction method comprising: sequentially installing the photographing device at all the photographing points, photographing the image, measuring the photographing position at which the image was photographed with a satellite positioning device, and transmitting the image and the photographing position to a server;
classifying, by the server, the images according to the unit shooting area based on the shooting location, storing them in respective folders, and managing;
The process of the construction site is progressed so that a subsequent photographing of at least a part of the unit photographing area is made, and transmitting the image and the photographing location to the server;
designating, by the server, the image as data belonging to the corresponding unit photographing area based on the photographing location of the image acquired in the subsequent photographing, storing and managing the image for each unit photographing area; and
Image data processing method for remote safety management of a construction site comprising the step of arranging and outputting, by the server, the images belonging to the unit shooting area by a call from a supervisor. The method of claim 1,
The server generates a navigation map including the unit photographing area information and the photographing location where the image was captured, and generating an overlay image in which the navigation map is displayed on the image. Image data processing method for management. 3. The method of claim 2,
The navigation map is
An image data processing method for remote safety management of a construction site, wherein the photographing location is displayed on the drawing of the construction site, and the boundary of the photographing location and the unit photographing area adjacent to the photographing location are also displayed. In the image data processing method for remote safety management of a construction site according to any one of claims 1 to 3,
An optimal arrangement method of an image capturing apparatus for remote safety management of a construction site in which at least one of a list and a preview image of images captured and stored in each unit capturing area is displayed in the capturing position and the unit capturing area adjacent to the capturing position . 5. The method of claim 4,
When the supervisor selects any one of the list and the preview image, a construction site remote that calls and outputs the image pointed to by any one of the list and the preview image from a folder designated in response to the unit shooting area on the server Optimal arrangement of video recording devices for safety management.

Images