KR20220075779A - Block status management system and method of the same - Google Patents

Abstract

An embodiment of the present invention provides a block status management system for efficiently identifying and managing the stacking status of blocks. The block placement status management system according to an embodiment of the present invention includes a data receiving unit for receiving image data and location data photographed from an aircraft, recognizing a block using the image data, and 3D of the block from the recognized block image An image data analysis unit that performs modeling processing and converts it into 3D data, a design data analysis unit that matches the 3D data with the 3D design data of the block stored in advance, and a detail of the block based on the matching result of the design data analysis unit A block data generation unit for generating data, a position data analysis unit for generating position data of a block by using the position data, and a position data analysis unit for determining a position of a block, and based on the output of the block data generation unit and the position data analysis unit It may include a block stacking status output unit for outputting the block stacking status data.

Description

Block status management system and method {BLOCK STATUS MANAGEMENT SYSTEM AND METHOD OF THE SAME}

The present invention relates to a block status management system, and more particularly, to a system and method for efficiently identifying and managing the block stacking status in a system for stacking and managing blocks necessary for shipbuilding.

Recently, in the shipbuilding industry, a ship is manufactured by introducing a shipbuilding technology called a block type based on three-dimensional (3D) design. The block method is a method in which a ship is divided into blocks, which are several lumps, and the process is carried out and then put together.

The raw materials are machined according to the 3D blueprint to create blocks of a size suitable for handling and assembly. The size of the block varies depending on the type and size of the ship, but usually it is about 100 to 200 tons, and in order to assemble hundreds of blocks in the exact shape of a ship, it is necessary to use a precise measuring device to determine the location.

These blocks are manufactured while being placed in the lot number, which is a location designated in the yard where shipbuilding work is carried out, and moved to another lot number according to the process process.

Therefore, there is a need for a system that manages the location and production status of blocks stacked in a large shipyard yard, and the block stocking status is managed using an enterprise resource planning system (ERP).

In the prior art, as shown in FIG. 1 , there is a method of attaching a tag to the block for the location of the block, recognizing the movement of the tag by the vehicle, and recognizing the current coordinates through the GPS mounted when the vehicle moves.

1 is a block diagram illustrating a method for managing block placement status according to an embodiment of the related art.

Referring to FIG. 1 , in the prior art, blocks were placed and managed by giving the lot number 11 to the yard 10 in advance. For example, when an operator moves the location of block A to another location, a tag is attached to block A, and when the carrier confirms the existence of block A in the corresponding lot number 11, the block is mounted.

When block A is placed on the carrier, the acceleration sensor in the tag recognizes it and the movement can be captured. When the vehicle moves, it recognizes the current coordinates through the GPS mounted on the vehicle and transmits the recognized data to the control server.

In addition, after inputting basic data into the system to manage the blocks, the person in charge issues a work instruction (21, 22).

After the instruction is issued, the worker moves block A to another location (23). The person in charge confirms the location of the moved block A through the GPS transmitted from the vehicle. The confirmed movement data of block A is input to the management system, and the input data of block A is stored in the block DB (24, 25).

The management system according to the prior art must attach a tag to all blocks in order to determine the location of the block. Blocks with tags may be damaged or lost due to environmental factors. In addition, attaching tags to all blocks incurs a lot of cost, and if lost, data omission may occur.

In addition, since the GPS mounted on the vehicle recognizes the block and inquires the shape information only when the block is moved, it is difficult to grasp the current state of the block when the block is not moved.

That is, it cannot be guaranteed that the GPS provided by the vehicle is accurate block location information. Therefore, the person in charge must go around and check the lot number (11) of the block. Excessive man-hours are invested in this task to identify the current situation and are managed inefficiently.

If the person in charge needs to directly input the block location data and storage status data into the management system, data input delays and omissions may occur.

In addition, it is difficult to visually check the process state of blocks weighing 100 to 200 tons, so it is difficult to confirm the exact process state.

This omission of computerized data may result in delays in the block stacking process and further delay the process progress of the entire vessel. This had a problem in that the reliability of the inquiry result of the block stacking status was lowered.

(Patent Document 001) Prior Document 1: Republic of Korea Patent Publication No. 10-2008-0132827 - Yard management system for heavy material processing

The technical problem to be achieved by the present invention is to provide a block status management system in which a person can efficiently check the location of a block without directly checking the block stacking status, as devised to solve the above problems.

In addition, it is to provide a block status management system that can reduce the ship's process progress by automatically recognizing blocks and collecting data.

In addition, since block information is integrated and managed in real time, it is to solve the problem of data omission and to provide a block status management system with improved reliability.

The technical problems to be achieved by the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. There will be.

In order to achieve the above technical problem, the block placement status management system according to an embodiment of the present invention includes a data receiving unit for receiving image data and location data photographed from an aircraft, recognizing a block using the image data, and An image data analysis unit that performs 3D modeling processing of the block from the recognized block image to convert it into 3D data, a design data analysis unit that matches the 3D data with the 3D design data of the block stored in advance, and the design data analysis unit A block data generator for generating detailed data of the block based on a matching result, a location data analyzer for generating location data of the block using the location data and determining the location of the block, and the block data generator; It may include a block stacking status output unit for outputting the block stacking status data based on the output of the location data analysis unit.

Here, the image data analysis unit analyzes the collected image data of the block and the image data around the block to identify a region corresponding to the block, and a block image recognition unit for recognizing a block image and 3D modeling the recognized block image and a block image processing unit for generating the 3D data by processing.

The block image processing unit may perform 3D modeling processing with reference to 3D design data of a block stored in the design data analysis unit.

Here, the block data may include at least one of block identification information, process progress information, and ship information in which the block is used.

In addition, the location data is provided in the form of GPS information matched to the timeline of the image data, and the location data analyzer identifies the lot number on the yard of the block using the GPS information matched to the timeline.

In addition, the block stacking status management method according to an embodiment of the present invention includes the steps of receiving image data and location data photographed from an aircraft, recognizing a block analyzing the image data, and the block from the recognized block image processing as 3D data by performing 3D modeling of , generating position data of the block by analyzing the position data, determining the position of the block by matching with the lot number data, and outputting the block stacking status data based on the block data and the determined block position may include

Here, the block data may include at least one of block identification information, process progress information, and ship information in which the block is used.

In addition, the location data is provided in the form of GPS information matched to the timeline of the image data, and may be matched with the lot number data on the yard of the block by using the GPS information matched to the timeline.

According to an embodiment of the present invention, the data receiving unit of the management system can receive the data collected by the aircraft, so that the person in charge can check the location of the block without going around the entire yard directly.

In addition, even when the block is not moved, the position of the block and the status of the stacking of the block can be grasped. This can effectively shorten the time to check the ship process progress.

In addition, it is possible to convert the collected planar data into 3D data using the image data analysis unit, and provide a function of automatically recognizing blocks by matching with design data stored in advance.

In addition, by matching 3D data and design data, detailed information of the recognized block and information on process progress can be generated. In addition, according to the present invention, block stacking status data can be output by combining the generated block location data with detailed block information. Because the data is output from the system rather than directly input by the person in charge, data omission does not occur and reliability can be improved.

The effects of the present invention are not limited to the above effects, but it should be understood to include all effects that can be inferred from the configuration of the invention described in the description or claims of the present invention.

1 is a diagram illustrating a method for managing block placement status according to the prior art.
2 is a diagram showing an example of obtaining block storage status information using an air vehicle according to an embodiment of the present invention.
3 is a block diagram illustrating a management system according to an embodiment of the present invention.
4 is a diagram illustrating an image data analyzer according to an embodiment of the present invention.
5 is a flowchart illustrating a method of identifying the block placement location and current status of the management system according to an embodiment of the present invention.

Hereinafter, the present invention will be described with reference to the accompanying drawings. However, the present invention may be embodied in several different forms, and thus is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be “connected (connected, contacted, coupled)” with another part, it is not only “directly connected” but also “indirectly connected” with another member interposed therebetween. "Including cases where In addition, when a part "includes" a certain component, this means that other components may be further provided without excluding other components unless otherwise stated.

The terminology used herein is used only to describe specific embodiments, and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present specification, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is an exemplary diagram illustrating a state of photographing an aircraft according to an embodiment of the present invention.

Referring to FIG. 2 , the vehicle D takes off automatically and moves to an altitude previously designated by the user. In addition, the vehicle (D) flies based on the route information specified in advance by the user, and acquires the block and information around the block while flying the set route.

When the aircraft (D) completes the flight of the set route, it returns to the pre-designated location and lands. The aircraft may be used in plurality according to the area of the yard 10 . The vehicle can be managed and monitored in an integrated way through a single take-off and landing system. Here, the vehicle D is an unmanned aerial vehicle, and may be implemented as an airplane such as a drone or a heliKite.

The vehicle (D) can be equipped with a high-resolution camera and GPS to match and store the high-resolution image data for the block and the GPS information in the timeline of the corresponding image data.

The vehicle (D) may store the image data and GPS in a storage medium, and a wireless communication method that provides coverage for data communication in real time on a flight path, for example, LTE, 5G, NB-IoT, Image data and GPS information can be transmitted to a management system or a client device in real time using LoRA or the like.

3 is a block diagram illustrating a management system according to an embodiment of the present invention.

Referring to FIG. 3 , the management system 100 includes a data receiving unit 110 , an image data analyzing unit 120 , a design data analyzing unit 130 , a block data generating unit 140 , a location data analyzing unit 150 , and It includes a block stacking status output unit 160 .

First, the data receiver 110 includes an image data receiver 111 and a location data receiver 112 .

The image data receiving unit 111 receives a block photographed from the vehicle and an image around the block. As described above, the image data may be received from a storage medium mounted on the vehicle, and may be received in real time through a wireless communication method. In this case, the received image data may be RAW data of a photographed image, or may be data to be filtered and selected by a specific time or space.

In addition, the location data receiving unit 112 receives location data such as GPS information and geomagnetic information from the vehicle. The GPS information may provide the absolute position coordinates of the vehicle being photographed, and the geomagnetic information may be used to correct accurate position information from the GPS information.

The image data analysis unit 120 includes a block image recognition unit 121 and a block image processing unit 122 .

The block image recognition unit 121 recognizes the block by analyzing the block photographed from the vehicle and image data around the block. For example, an area corresponding to a block in the frame image may be identified by analyzing an outline or color from the frame image of the captured image. The image of the recognized block may be cropped and stored separately by tagging the photographing time or location information.

The block image processing unit 122 may perform 3D modeling processing on image data of the recognized block. It is possible to reconstruct the 2D image recognized by the block image recognition unit 121 into 3D data through background-providing outline recognition and low-pass filtering processing. In this case, it is preferable that the 3D data conversion process be transformed into a 3D modeling format comparable to the 3D design data of the block.

As will be described later, the image recognized as a block is a two-dimensional image such as a perspective view or a top view taken at one point of view of a 3D block diagram of 3D design data. Therefore, when 3D design data is referred to when reconstructing a captured 2D image of a block into 3D data, 3D modeling can be easily and accurately performed through a small amount of computation.

The design data analysis unit 130 includes a design data DB 131 and a design data matching unit 132 .

The design data DB 131 stores design data of a block of a ship being manufactured in advance. The design data is stored in the form of 3D modeling data for each block, and the corresponding 3D modeling data may be provided by the request of the management system.

The design data matching unit 132 matches the 3D modeling data processed by the block image processing unit 122 with the 3D design data stored in the design data DB 131 . By matching the 3D modeling data obtained from the photographed image data and the 3D design data of the matching block, it is possible to determine which block was placed and how much and the process progress.

The block data generation unit 140 generates block data for checking the stacking status and detailed information of the recognized blocks based on the data of the design data matching unit 132 . The generated block data may include data such as block identification information, 3D design data and related information, and process progress.

The location data analysis unit 150 includes a lot number matching unit 151 and a block position determination unit 152 .

The lot number matching unit 151 matches the location data received from the location data receiving unit 112 with the preset lot number data. For example, the lot number data includes coordinate information, and the corresponding coordinate information may be matched with GPS information at the time of shooting.

The block position determination unit 152 may determine the current lot number and location of the block based on the data matched by the lot number matching unit 151 . For example, the lot number and location may be confirmed using GPS information corresponding to the timeline of the image in which the block is recognized.

The block stacking status output unit 160 may generate block stacking status data by combining the block data of the block data generating unit 140 with the location data of the block location determining unit 152 . The stacking status data of the combined block can output the real-time stacking status of the block, process progress, movement path, and the like.

Therefore, through the present invention, it is possible to integrate and manage the location of a block disposed at a specific location and detailed information of the block in real time. In addition, because tags are not attached to blocks, tag loss does not occur, and the system outputs block status data including block location and block detail information instead of directly inputting data into the system, so computerized data is missing. This does not happen.

4 is a block diagram illustrating an image data analyzer according to an embodiment of the present invention.

Referring to FIG. 4 , the block image recognition unit 121 recognizes a block as plane data B1 . The image collected from the vehicle may include a block and an image around the block.

Therefore, in order to grasp the location data and detailed information of a specific block, it is necessary to recognize the block. For example, the block image recognition unit 121 may identify an area corresponding to a specific block by analyzing an outline or a color of the collected image.

At this time, the image area identified as a block is cropped or enlarged and processed into a usable form.

The recognized block is converted into 3D data B2 through 3D modeling data processing in the block image processing unit 122 . For example, a two-dimensional image may be formed with the main features of a shape through a low-pass filter of the captured block image, and then reconstructed into 3D data based on this.

In addition, more accurate 3D data conversion is possible using a plurality of image frame data and the moving direction of the vehicle.

Meanwhile, although the captured block image planar data B1 is a two-dimensional image, it may be a planar image captured at one point of view of the 3D block design data among the design data. Therefore, when referring and using a database of 3D block design data with limited numbers, 3D conversion is more easily possible.

That is, when 3D modeling processing is difficult depending on technical factors such as the resolution of the collected image and external factors such as birds and flying objects, it is possible to reconstruct the planar data (B1) from the design data and convert it into 3D data (B2). .

The converted 3D data B2 may be matched with the design data to determine the current status of the corresponding block. Furthermore, since the blocks required for each ship may be different, it is possible to check which ship the block is by using the converted 3D data B2. In addition, it is possible to check how much the block stacking process has progressed.

5 is a flowchart illustrating a method for managing block placement locations and status according to an embodiment of the present invention.

Referring to FIG. 5 , the management system collects image data and location data from the vehicle (S100).

The collected image data may include a block and a surrounding environment of the block. In order to recognize a specific block, a process of identifying the block with the surrounding environment may be performed.

Block recognition may be performed by analyzing an outline, color, etc. of a collected image. Therefore, the system can automatically recognize the block by analyzing the collected image data (S110).

In step S120, the image data of the recognized block is converted into 3D data by 3D modeling processing.

The image of the block may be a two-dimensional image taken at one point of view of the 3D block diagram of the design data. Therefore, the planar data is converted into 3D data in order to match the block image taken from the design data. The converted 3D data is matched with design data of a previously stored block to generate block data (S130). When the generated block data is used, a specific block can be recognized, and a corresponding vessel, process progress, etc. can be identified.

In addition, the management system analyzes the collected location data (S140). The location data may include GPS and geomagnetic data at the time the vehicle was photographed.

The analyzed location data may be matched with the lot number data to confirm the location of the block (S150). Since the lot number data may include coordinate information designated in advance, the location of the block may be confirmed by matching with the GPS information of the corresponding shooting time.

In step S160, the generated block data and the block location data are combined to output block stacking status data to provide a management system.

Accordingly, the management system can automatically recognize the block without human direct confirmation, and grasp the detailed information of the block. In addition, it is possible to manage the stacking status of blocks in real time using the identified status.

The above description of the present invention is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention.

100. Management system
110. Data receiver
120. Image data analysis unit
130. Design data analysis department
140. Block data generation unit

Claims (8)

In the block stockpiling status management system for managing blocks necessary for shipbuilding,
a data receiving unit for receiving image data and location data taken from the vehicle;
an image data analyzer for recognizing a block using the image data and converting the block into 3D data by performing 3D modeling processing of the block from the recognized block image;
a design data analysis unit matching the 3D data and the 3D design data of the block stored in advance;
a block data generation unit generating detailed data of the block based on a matching result of the design data analysis unit;
a location data analysis unit that generates location data of a block using the location data and determines a location of the block; and
a block stacking status output unit for outputting block stacking status data based on the output of the block data generating unit and the location data analyzing unit;
Block stockpiling status management system that includes.


The method of claim 1,
The image data analysis unit,
a block image recognition unit that analyzes the collected image data of the block and the image data around the block to identify a region corresponding to the block, and recognizes the block image; and
and a block image processing unit generating the 3D data by 3D modeling the recognized block image.
3. The method of claim 2,
The block stacking status management system in which the block image processing unit performs 3D modeling processing with reference to 3D design data of the block stored in the design data analysis unit.
According to claim 1,
The block data includes at least one of block identification information, process progress information, and ship information in which the block is used.


According to claim 1,
The location data is provided in the form of GPS information matched to the timeline of the image data,
The location data analysis unit using the GPS information matched to the time line to identify the lot number on the yard of the block block stockpiling status management system.
In the block stockpiling status management method for managing blocks necessary for shipbuilding,
Receiving image data and location data taken from the vehicle;
recognizing a block analyzing the image data;
performing 3D modeling processing of the block from the recognized block image to process it as 3D data;
matching the 3D data and 3D design data of the block stored in advance;
generating block data that is detailed data of the block based on the matching result;
generating position data of the block by analyzing the position data, and determining the position of the block by matching with the lot number data; and
outputting block stacking status data based on the block data and the determined block location;
A method for managing block stockpiling status, including.

7. The method of claim 6,
The block data includes at least one of block identification information, process progress information, and ship information in which the block is used.
7. The method of claim 6,
The location data is provided in the form of GPS information matched to the timeline of the image data,
The block stacking status management method that matches the lot number data on the yard of the block by using the GPS information matched to the time line.

Images