KR102542869B1 - Block status management system and method of the same - Google Patents

Abstract

One embodiment of the present invention provides a block status management system that efficiently grasps and manages the placement status of blocks. The block placement status management system according to an embodiment of the present invention includes a data receiving unit for receiving image data and location data captured from an aircraft, recognizing a block using the image data, and obtaining a 3D image of the block from the recognized block image. An image data analysis unit that performs modeling processing and converts it into 3D data, a design data analysis unit that matches the 3D data and 3D design data of the block stored in advance, and details of the block based on the matching result of the design data analysis unit A block data generation unit for generating data, a location data analysis unit for generating block location data using the location data and determining the location of the block, and based on the outputs of the block data generation unit and the location data analysis unit A block stacking status output unit for outputting block stacking status data may be included.

Description

Block status management system and its method {BLOCK STATUS MANAGEMENT SYSTEM AND METHOD OF THE SAME}

The present invention relates to a block status management system, and more particularly, to a system and method for efficiently identifying and managing the stacking status of blocks in a system for stacking and managing blocks necessary for shipbuilding.

Recently, in the shipbuilding industry, ships are manufactured by introducing a shipbuilding technology called block type based on 3D design. The block method is a method in which the ship is divided into several blocks, which are blocks, and then assembled after the process is performed.

The raw materials are processed according to the 3D design drawing to create a block that is easy to handle and has a size suitable for assembly. The size of the blocks varies depending on the type and size of the ship, but usually ranges from 100 to 200 tons, and to assemble hundreds of blocks into the exact shape of the ship, precise measurement equipment must be used to determine their location.

These blocks are manufactured in a state of being piled up in a designated location in the yard where shipbuilding is performed, and are also manufactured by being moved to another lot according to the process.

Therefore, a system for managing the location and manufacturing status of blocks stacked in a large shipyard yard is required, and the stacking status of blocks is managed using an enterprise resource planning system (ERP).

In the prior art, as shown in FIG. 1, there is a method in which a tag is attached to the block to determine the location of the block, and the vehicle recognizes the movement of the tag and recognizes the current coordinates through a GPS installed when the vehicle moves.

1 is a block diagram illustrating a method for managing a block placement status according to a conventional embodiment.

Referring to FIG. 1, in the prior art, a lot number 11 was given to a yard 10 in advance to stack and manage blocks. For example, when a worker moves the location of block A to another location, a tag is attached to block A, and when the carrier confirms the existence of block A in the corresponding lot 11, the corresponding block is loaded.

When the A block is placed on the carrier, the motion can be captured by the acceleration sensor in the tag. When the carrier moves, the current coordinates are recognized through the GPS mounted on the carrier and the recognized data is transmitted to the control server.

In addition, the person in charge inputs basic data into the system to manage the blocks and then issues a work order (21, 22).

After the instruction is issued, the operator moves block A to another location (23). The person in charge checks the location of the moved block A through the GPS transmitted from the carrier. The confirmed movement data of block A is input to the management system, and the input data of block A is stored in the block DB (24, 25).

A management system according to the prior art must attach a tag to every block in order to locate the block. Blocks with tags may be damaged or lost due to environmental factors. In addition, attaching tags to all blocks incurs a lot of cost, and if lost, data may be omitted.

In addition, since the GPS mounted on the carrier can recognize the block and inquire the shape information only when the block is moved, it is difficult to grasp the current state of the block when the block is not moved.

That is, it cannot be guaranteed that the GPS provided by the carrier is accurate block location information. Therefore, the person in charge must go around and check the number 11 of the block. This current status assessment task requires excessive hours and is inefficiently managed.

If the person in charge needs to directly input block location data and stacking status data into the management system, data input delay and omission may occur.

In addition, it is difficult to visually check the processing state of the block weighing 100 to 200 tons, which makes it difficult to confirm the exact state of the process.

Omission of such data in the computer may result in a delay in the block placement process and, furthermore, a slowdown in the process progress of the entire ship. This had a problem in that the reliability of the inquiry result of the block placement status was lowered.

(Patent Document 001) Prior Document 1: Republic of Korea Patent Publication No. 10-2010-0074411-Heavy Material Process Yard Management System

The technical problem to be achieved by the present invention is to provide a block status management system that can efficiently check the location of blocks without directly checking the block placement status, which has been made to solve the above problems.

In addition, it is to provide a block status management system capable of reducing the process progress of a ship by automatically recognizing blocks and collecting data.

In addition, since block information is integrated and managed in real time, the problem of data omission is solved and reliability is improved to provide a block status management system.

The technical problem to be achieved by the present invention is not limited to the above-mentioned technical problem, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below. There will be.

In order to achieve the above technical problem, the block placement status management system according to an embodiment of the present invention recognizes a block using a data receiving unit for receiving image data and location data photographed from an aircraft, the image data, and the An image data analysis unit that performs 3D modeling processing of the block from the recognized block image and converts it into 3D data, a design data analysis unit that matches the 3D data and previously stored 3D design data of the block, and the design data analysis unit A block data generation unit generating detailed data of the block based on a matching result, a location data analysis unit generating block location data using the location data and determining a location of the block, and the block data generation unit; and A block placement status output unit for outputting block placement status data based on the output of the location data analysis unit may be included.

Here, the image data analysis unit identifies a region corresponding to the block by analyzing a block of the collected image data and image data around the block, and a block image recognition unit recognizing a block image and 3D modeling the recognized block image and a block image processor generating the 3D data by processing.

The block image processing unit may perform 3D modeling processing by referring to 3D design data of blocks stored in the design data analysis unit.

Here, the block data may include at least one of block identification information, process progress information, and ship information using the block.

In addition, the location data is provided in the form of GPS information matched to the timeline of the image data, and the location data analyzer identifies the lot number on the yard of the block by using the GPS information matched to the timeline.

In addition, the block placement status management method according to an embodiment of the present invention includes the steps of receiving image data and location data photographed from an aircraft, recognizing a block for analyzing the image data, and the block from the recognized block image. Performing 3D modeling processing of and processing it into 3D data, matching the 3D data with previously stored 3D design data of the block, and generating block data, which is detailed data of the block, based on the matching result. Analyzing the location data to generate block location data, matching the lot number data to determine the block location, and outputting block placement status data based on the block data and the determined block location. can include

Here, the block data may include at least one of block identification information, process progress information, and ship information using the block.

In addition, the location data is provided in the form of GPS information matched to the timeline of the image data, and can be matched with land number data on the yard of the block using the GPS information matched to the timeline.

According to an embodiment of the present invention, the data receiving unit of the management system can receive the data collected by the vehicle, so that the person in charge can check the location of the block without directly walking around the entire yard.

In addition, even when a block is not moved, the position of the block and the current status of the block placement can be grasped. This can effectively shorten the time for checking the ship process progress.

In addition, plane data collected using the image data analyzer may be converted into 3D data, and a function of automatically recognizing blocks by matching with previously stored design data may be provided.

Also, by matching 3D data and design data, detailed information of the recognized block and information on process progress may be generated. In addition, according to the present invention, block placement status data may be output by combining the location data of the created block and the detailed information of the block. Reliability can be improved because data omission does not occur because the person in charge does not directly input data into the system, and data is output from the system.

The effects of the present invention are not limited to the above effects, and should be understood to include all effects that can be inferred from the description of the present invention or the configuration of the invention described in the claims.

1 is a diagram illustrating a method of managing block placement status according to the prior art.
2 is a diagram showing an example of obtaining block piling status information using an air vehicle according to an embodiment of the present invention.
3 is a block diagram illustrating a management system according to an embodiment of the present invention.
4 is a diagram illustrating an image data analyzer according to an embodiment of the present invention.
5 is a flowchart illustrating a method of determining a block placement location and current status of a management system according to an embodiment of the present invention.

Hereinafter, the present invention will be described with reference to the accompanying drawings. However, the present invention may be embodied in many different forms and, therefore, is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected (connected, contacted, combined)" with another part, this is not only "directly connected", but also "indirectly connected" with another member in between. "Including cases where In addition, when a part "includes" a certain component, it means that it may further include other components without excluding other components unless otherwise stated.

Terms used in this specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "include" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Figure 2 is an exemplary diagram showing a state of photographing an air vehicle according to an embodiment of the present invention.

Referring to FIG. 2, the aircraft D automatically takes off and moves to an altitude designated by the user in advance. In addition, the vehicle D flies based on route information designated by the user in advance, and acquires block and information around the block while flying along the set route.

After completing the flight of the set path, the aircraft D returns to a pre-specified location and lands. A plurality of air vehicles may be used depending on the area of the yard 10 . Vehicles can be managed and monitored integrally through a single take-off and landing system. Here, the air vehicle D is an unmanned air vehicle, and may be implemented as an air vehicle such as a drone or a HeliKite.

The aircraft D may be equipped with a high-resolution camera and GPS to match and store high-resolution image data of a block and GPS information on a timeline of the corresponding image data.

The vehicle (D) may store the image data and GPS in a storage medium, and a wireless communication method that provides coverage for real-time data communication on the flight path, for example, LTE, 5G, NB-IoT, Video data and GPS information can be transmitted to a management system or a client device in real time using LoRA or the like.

3 is a block diagram illustrating a management system according to an embodiment of the present invention.

Referring to FIG. 3, the management system 100 includes a data receiving unit 110, an image data analyzing unit 120, a design data analyzing unit 130, a block data generating unit 140, a location data analyzing unit 150, and It includes a block placement status output unit 160 .

First, the data receiver 110 includes an image data receiver 111 and a location data receiver 112 .

The image data receiving unit 111 receives a block photographed from an air vehicle and an image around the block. As described above, image data may be received from a storage medium mounted on an air vehicle, and may be received in real time through a wireless communication method. At this time, the received image data may be RAW data of a photographed image, or may be data to be filtered and selected according to a specific time or space.

In addition, the location data receiving unit 112 receives location data such as GPS information and geomagnetic information from the vehicle. The GPS information can provide absolute positional coordinates of the aircraft being photographed, and the geomagnetic information can be used to correct accurate positional information from the GPS information.

The image data analysis unit 120 includes a block image recognition unit 121 and a block image processing unit 122 .

The block image recognition unit 121 recognizes a block by analyzing a block photographed from an aircraft and image data around the block. For example, an area corresponding to a block in a frame image may be identified by analyzing an outline or color of a frame image of a captured video. The image of the recognized block may be cropped and stored separately by attaching a tag with capturing time or location information.

The block image processing unit 122 may process 3D modeling of image data of a recognized block. The 2D image recognized by the block image recognizing unit 121 may be reconstructed into 3D data through background providing outline recognition and low-pass filtering. At this time, it is preferable that the conversion process into 3D data is transformed into a 3D modeling format comparable to the 3D design data of the corresponding block.

As will be described later, the image recognized as a block is a two-dimensional image such as a perspective view or a top view taken at one viewpoint of a 3D block diagram of 3D design data. Therefore, when reconstructing a captured block 2D image into 3D data, when referring to 3D design data, 3D modeling can be easily and accurately performed with a small amount of calculation.

The design data analysis unit 130 includes a design data DB 131 and a design data matching unit 132 .

The design data DB 131 stores design data of a block of a ship being manufactured in advance. The design data is stored in the form of 3D modeling data for each block, and the corresponding 3D modeling data may be provided upon request from the management system.

The design data matching unit 132 matches the 3D modeling data processed by the block image processing unit 122 with the 3D design data stored in the design data DB 131 . By matching the 3D modeling data obtained from the captured image data with the 3D design data of the matching blocks, it is possible to determine which blocks have been stacked and how much they have been stacked and the progress of the process.

The block data generation unit 140 generates block data capable of checking the placement status and detailed information of the recognized blocks based on the data of the design data matching unit 132 . The generated block data may include data such as block identification information, 3D design data and related information, and process progress.

The location data analysis unit 150 includes a lot number matching unit 151 and a block location determination unit 152.

The lot matching unit 151 matches the location data received from the location data receiving unit 112 with the previously designated lot number data. For example, lot number data includes coordinate information, and the corresponding coordinate information may be matched with GPS information at the time of photographing.

The block location determination unit 152 may determine the current lot number and location of the block based on data matched by the lot number matching unit 151 . For example, a lot number and location may be confirmed using GPS information corresponding to a timeline of an image in which a block is recognized.

The block placement status output unit 160 may generate block placement status data by combining the block data of the block data generation unit 140 and the location data of the block position determining unit 152 . The stacking status data of the combined blocks may output the real-time stacking status of the block, process progress, movement route, and the like.

Therefore, through the present invention, it is possible to integrate and manage the location of a block arranged in a specific location and detailed information of the block in real time. In addition, tags are not attached to blocks, so there is no loss of tags, and data is omitted computationally because the system outputs block status data including block location and detailed information, rather than the user directly inputting data into the system. this doesn't happen

4 is a block diagram illustrating an image data analyzer according to an embodiment of the present invention.

Referring to FIG. 4 , the block image recognizing unit 121 recognizes a block as plane data B1. Images collected from the vehicle may include blocks and images around the blocks.

Therefore, in order to grasp location data and detailed information of a specific block, it is necessary to be able to recognize the block. For example, the block image recognizing unit 121 may identify an area corresponding to a specific block by analyzing the outline or color of the collected image.

At this time, the image area identified as a block is cropped or enlarged and processed into a usable form.

The recognized block is converted into 3D data B2 through 3D modeling data processing in the block image processing unit 122 . For example, a 2D image may be formed with main features of a shape through a low-pass filter of a captured block image and reconstructed into 3D data based on the 2D image.

In addition, it is possible to convert more accurate 3D data by using a plurality of image frame data and the moving direction of the vehicle.

Meanwhile, the captured block image plane data B1 is a two-dimensional image, but may be a planar image captured at one viewpoint of 3D block design data among design data. Therefore, when referring to and using a database of 3D block design data with a limited number, 3D conversion is more easily possible.

That is, when it is difficult to process 3D modeling due to technical factors such as resolution of collected images and external factors such as birds and flying objects, plane data B1 can be reconstructed from design data and converted into 3D data B2. .

The converted 3D data (B2) can grasp the stacking status of the block through matching with the design data. Furthermore, since the blocks required for each ship may be different, it is possible to check which ship's block is used by using the converted 3D data (B2). You can also check how much the block stacking process has progressed.

5 is a flowchart illustrating a method of managing a block placement location and current status according to an embodiment of the present invention.

Referring to Figure 5, the management system collects image data and location data from the vehicle (S100).

Collected image data may include a block and its surrounding environment. In order to recognize a specific block, a process of identifying the block with the surrounding environment may be performed.

Recognition of blocks may be performed by analyzing outlines, colors, and the like of collected images. Therefore, the system can automatically recognize a block by analyzing the collected image data (S110).

In step S120, the image data of the recognized block is converted into 3D data by 3D modeling.

The image of the block may be a two-dimensional image taken at one viewpoint of the 3D block diagram of the design data. Accordingly, the planar data is converted into 3D data in order to match the block image taken from the design data. The converted 3D data is matched with previously stored design data of blocks to generate block data (S130). When using the generated block data, a specific block can be recognized, and the corresponding ship and process progress can be grasped.

In addition, the management system analyzes the collected location data (S140). The location data may include GPS and geomagnetic data at the time the aircraft is photographed.

The analyzed location data may be matched with lot number data to confirm the location of the block (S150). Since the lot number data may include coordinate information designated in advance, the location of the block may be confirmed by matching with GPS information at a corresponding shooting time point.

In step S160, a management system is provided by combining generated block data and block location data to output block placement status data.

Therefore, the management system can automatically recognize the block without a person's direct confirmation, and grasp the detailed information of the block. In addition, it is possible to manage the stacking status of blocks in real time using the identified status.

The above description of the present invention is for illustrative purposes, and those skilled in the art can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts should be interpreted as being included in the scope of the present invention.

100. Management system
110. Data receiver
120. Image data analysis unit
130. Design data analysis unit
140. Block data generation unit

Claims (8)

In the block stacking status management system for managing blocks necessary for shipbuilding,
a data receiving unit for receiving image data and location data captured from the aircraft;
an image data analyzer for recognizing a block using the image data, performing 3D modeling of the block from the recognized block image, and converting the block into 3D data;
a design data analysis unit matching the 3D data with the previously stored 3D design data of the block;
a block data generation unit generating detailed data of the block based on a matching result of the design data analysis unit;
a location data analysis unit generating location data of a block using the location data and determining a location of the block; and
A block placement status output unit configured to output block placement status data based on outputs of the block data generation unit and the location data analysis unit,
The video data analysis unit,
A block image recognizing unit that identifies a region corresponding to a block by analyzing a block of the collected image data and image data around the block, and recognizes a block image; and
A block image processing unit generating the 3D data by performing 3D modeling on the recognized block image;
The block image processing unit performs 3D modeling processing by referring to the 3D design data of the block stored in the design data analysis unit,
The 3D modeling process is performed using a plurality of frame data of the image data, a moving direction of the aircraft, and a plane image taken at at least one viewpoint of the 3D design data.
delete delete According to claim 1,
The block data includes at least one of block identification information, process progress information, and ship information using the block.


According to claim 1,
The location data is provided in the form of GPS information matched to the timeline of the image data,
Wherein the location data analysis unit identifies the number on the yard of the block using GPS information matched to the time line.
In the block stacking status management method for managing blocks necessary for shipbuilding,
a) receiving image data and location data captured from the aircraft;
b) recognizing a block for analyzing the image data;
c) performing 3D modeling processing of the block from the recognized block image and processing it into 3D data;
d) matching the 3D data with previously stored 3D design data of the block;
e) generating block data that is detailed data of the block based on the matching result;
f) analyzing the location data to generate block location data, and determining the location of the block by matching with lot number data; and
g) outputting block placement status data based on the block data and the determined block location;
The step b) may include: analyzing a block of the collected image data and image data around the block to identify a region corresponding to the block and recognizing a block image; and
Generating the 3D data by subjecting the recognized block image to 3D modeling,
3D modeling process is performed with reference to the 3D design data of the stored block, and the 3D modeling process is performed by taking a plurality of frame data of the image data, a moving direction of the vehicle, and at least one viewpoint of the 3D design data Block stacking status management method performed using a flat image.
According to claim 6,
The block data includes at least one of block identification information, process progress information, and ship information using the block.
According to claim 6,
The location data is provided in the form of GPS information matched to the timeline of the image data,
Block placement status management method that is matched with lot number data on the yard of the block using GPS information matched to the timeline.

Images