KR20170024824A - Apparatus and method for providing information on scaffold - Google Patents

Apparatus and method for providing information on scaffold Download PDF

Info

Publication number
KR20170024824A
KR20170024824A KR1020150120343A KR20150120343A KR20170024824A KR 20170024824 A KR20170024824 A KR 20170024824A KR 1020150120343 A KR1020150120343 A KR 1020150120343A KR 20150120343 A KR20150120343 A KR 20150120343A KR 20170024824 A KR20170024824 A KR 20170024824A
Authority
KR
South Korea
Prior art keywords
image
dimensional model
information
composite image
area
Prior art date
Application number
KR1020150120343A
Other languages
Korean (ko)
Other versions
KR101785517B1 (en
Inventor
박정서
강태선
김호구
박인하
홍지수
황인혁
Original Assignee
삼성중공업 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성중공업 주식회사 filed Critical 삼성중공업 주식회사
Priority to KR1020150120343A priority Critical patent/KR101785517B1/en
Publication of KR20170024824A publication Critical patent/KR20170024824A/en
Application granted granted Critical
Publication of KR101785517B1 publication Critical patent/KR101785517B1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/04Manufacturing
    • G06F17/50
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Manufacturing & Machinery (AREA)
  • Architecture (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention relates to an apparatus and method for providing information on a scaffold. The apparatus for providing information on a scaffold according to an embodiment of the present invention includes: an input unit which receives data; an image processing unit which generates a synthesis image by synthesizing a real image obtained by photographing a structure with a 3D model related to the structure and generates the information on the scaffold installed in the structure based on the synthesis image; and an output unit which outputs the information on the scaffold. Accordingly, the present invention can supply useful information related to a scaffold installation to a user for preventing a collision between the scaffold and a product installed in the structure.

Description

[0001] APPARATUS AND METHOD FOR PROVIDING INFORMATION ON SCAFFOLD [0002]

The present invention relates to an apparatus and method for providing chief information.

When building large structures such as blocks in shipyards, chiefs are installed and work is done. A patriarch is a scaffold that is installed to enable a worker to work in a high place, and is used as a passageway or footing for an operator.

Generally, a patriarch is installed along the outer periphery or inner periphery of the structure to be worked, such as a wall surface of the structure. However, when a work such as a piece of equipment is additionally installed on a part where a chief is installed as a work on a structure progresses, there is a problem that the chief installed on the part is removed and reinstalled on another part.

An embodiment of the present invention aims to provide a device and method for providing patriarchal information capable of providing information on patriarchs in connection with the installation of patriarchs.

An embodiment of the present invention aims to provide a device and method for providing chuck information that can check whether a chief is installed at a proper position.

According to an aspect of the present invention, there is provided an apparatus for providing chickpea information comprising: an input unit for receiving data; An image processing unit for generating a composite image by synthesizing a real image obtained by photographing a structure and a three-dimensional model related to the structure, and generating information about a patriotism installed on the structure based on the composite image; And an output unit for outputting information on the patriarchy.

Wherein the chick information providing apparatus comprises: an image input unit for receiving the real image from a user; A camera unit for photographing the structure to generate the real image; As shown in FIG.

Wherein the output unit displays a three-dimensional model related to the structure, the input unit inputs data regarding a position where the structure is photographed based on the displayed three-dimensional model, from the user, and the image processing unit It is possible to detect the three-dimensional model corresponding to the photographing direction of the structure as a basis.

Wherein the image processing unit is configured to: extract a patriarchal object corresponding to the patriarch from the physical image, extract an article object corresponding to the article provided in the structure from the three-dimensional model, To generate the composite image, and to detect an overlapping area in which the chief object and the article object overlap in the composite image.

The image processing unit may determine an object whose ratio between the length of the one direction and the length of the other direction in the real image exceeds a preset reference value as the chief object.

The image processing unit may determine, as the thumbpit installable area, an area that extends beyond the area where the article object is located in the composite image and reaches a preset distance when the overlap area is detected.

The output unit may: highlight the thumbpit installable area in the composite image and output it.

The method of providing chief information according to an embodiment of the present invention is a method of providing chief information about a chief installed in a structure, the method comprising: acquiring a real image obtained by photographing the structure; Loading a three-dimensional model of the structure; Synthesizing the real image and the three-dimensional model to generate a composite image; Generating information about the chiefs based on the composite image; And outputting information on the patriarchy.

The method of providing chief information according to an embodiment of the present invention may be embodied in a computer-executable program and recorded in a computer-readable recording medium.

The method of providing patriarchal information according to an embodiment of the present invention may be implemented by a computer program stored in a medium for execution in combination with the computer.

According to an embodiment of the present invention, it is possible to provide the user with useful information relating to the installation of the chieftain so that the chieftain does not collide with the article to be installed in the structure.

According to the embodiment of the present invention, it is possible to prevent the construction from being delayed and to improve the productivity by preventing the situation in which the chief is removed and reinstalled during the progress of work on the structure.

1 is an exemplary block diagram of a device for providing chuck information according to an embodiment of the present invention.
FIG. 2 is a view illustrating an example of photographing a structure in which a patriot is installed according to an embodiment of the present invention.
3 is an exemplary perspective view of a three-dimensional model of a structure according to an embodiment of the present invention.
4 is a view for explaining a user input process for determining a viewing direction of a three-dimensional model corresponding to a photographing direction of a structure according to an embodiment of the present invention.
5 is a diagram illustrating an example of a real image obtained by photographing a structure in which a patriot is installed according to an embodiment of the present invention.
FIG. 6 is an exemplary view showing a three-dimensional model according to an embodiment of the present invention viewed in the same direction as the photographing direction of the real image shown in FIG.
FIG. 7 is an exemplary view illustrating a composite image in which a real image and a three-dimensional model of a structure are matched according to an embodiment of the present invention.
8 is an exemplary diagram illustrating a composite image in which overlapping regions are emphasized according to an embodiment of the present invention.
Figure 9 is an exemplary illustration of a composite image in which a chief installable area capable of installing a chief, avoiding collisions, is emphasized in accordance with an embodiment of the present invention.
10 is an exemplary flowchart of a method of providing chief information according to an embodiment of the present invention.
11 is an exemplary flow chart illustrating a process for generating information about a patriot based on a composite image in accordance with an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings attached hereto.

1 is an exemplary block diagram of an apparatus 100 for providing chuck information according to an embodiment of the present invention.

1, the chuck information providing apparatus 100 may include an input unit 110, an image processing unit 120, and an output unit 130.

The input unit 110 may receive data from a user. The image processing unit 120 may generate a composite image by combining a real image obtained by photographing a structure and a three-dimensional model related to the structure, and generate information about a patriarch installed on the structure based on the composite image have. The output unit 130 may output information on the patriarchy.

The apparatus 100 for providing the chick information according to the embodiment of the present invention may be a portable device such as a smart device or a tablet PC, which can be used by a user, for example, an operator installing a patriarch, . According to an embodiment, the chief information providing apparatus 100 may be a kiosk disposed in a workplace where a chief installation work is performed.

The input unit 110 may include a touch screen, a touch pad, a keypad, and the like, but the present invention is not limited thereto.

The image processing unit 120 is a processor for processing data, particularly image data, and may include, for example, a CPU, a GPU, and the like.

The output unit 130 is an output device for outputting data. For example, the output unit 130 may include a display device for visually displaying information on a screen using an LCD, a PDP, or the like. According to an embodiment, the output 130 may include a printing device, in which case the printing device may print information about the patriotism on a medium such as paper.

Furthermore, the apparatus 100 for providing chuckweed information may further include a controller 140. The control unit 140 is a controller for controlling the operation of the patriotic information providing apparatus 100. The controller 140 may execute a program or software for driving the apparatus and generate commands and control signals according to the programs and software.

According to an embodiment of the present invention, the apparatus 100 for providing chuckweed information may further include an image input unit 150. The image input unit 150 is an interface device that receives a real image obtained by photographing the structure from a user. For example, the image input unit 150 may include a data port (e.g., a USB port, etc.) connected to a camera of a user and receiving image data through a wire, but the present invention is not limited thereto.

The method by which the image input unit 150 receives image data is not limited to wired communication, and may receive data through wireless communication, for example, near-field wireless communication. In this case, the user can transmit an image from the device storing the real image to the chief information providing device 100 using Bluetooth or the like.

According to another embodiment of the present invention, the apparatus 100 for providing chuckweed information may further include a camera unit 160. The camera unit 160 can capture the structure and generate the real image.

FIG. 2 is an exemplary view illustrating a structure 10 in which chiefs 101, 102, 103, 104, 105, 106, and 107 are installed according to an embodiment of the present invention.

Referring to FIG. 2, chiefs 101, 102, 103, 104, 105, 106 and 107 are installed on the outer wall of the structure 10, The structure and the chiefs 101, 102, 103, 104, 105, 106, and 107 installed in the structure can be photographed.

As shown in FIG. 2, the patriarchs 101, 102, 103, 104, 105, 106 and 107 include foot plates 101, 102 and 103 and columns 104, 105, 106 and 107 .

The camera unit 160 generates a real image 11 of the photographed structure 10 and the real image 11 may be displayed on the output unit 130 (e.g., a display).

The image processing unit 120 processes the three-dimensional model related to the real image 11 and the structure 10 obtained by photographing the structure 10, Can be generated.

According to one embodiment of the present invention, the three-dimensional model of the structure 10 may include a completed structure model including the completed shape of the structure 10. [

3 is an exemplary perspective view of a three-dimensional model 21 of a structure 10 according to an embodiment of the present invention.

The three-dimensional model 21 is a model in which the shape of the structure 10 is modeled in a three-dimensional coordinate space. According to one embodiment, when the operation on the structure 10 is completed, the three- Lt; / RTI >

For example, referring to FIG. 3, the three-dimensional model 21 includes a plurality of objects 201, 202, and 203, such as a fitting (e.g., a pipe or a duct) And the shape model may be a three-dimensional shape model.

The chief information providing apparatus 100 may invoke the three-dimensional model 21 relating to the structure 10 to generate information on the patriarchs 101, 102, 103, 104, 105, 106,

According to one embodiment, the 3D model 21 may be stored in a separate server 200, and the chuck information providing apparatus 100 may access the server 200 through the communication unit 170 The three-dimensional model 21 can be called up.

According to another embodiment, the three-dimensional model 21 may be stored in the storage unit 180 provided in the apparatus 100 for providing chuckweed information. In this case, the chuck information providing apparatus 100 can retrieve the three-dimensional model 21 from the storage unit 180.

According to an embodiment of the present invention, the input unit 110 may receive structure identification data for identifying the structure 10 in order to call up the three-dimensional model 21 of the structure 10.

For example, the user may input an ID or serial number previously assigned to the structure 10 through the input unit 110. [ Then, the chief information providing apparatus 100 can process the three-dimensional model 21 corresponding to the structure identification data from the server 200 or the storage unit 180 and process it.

According to another embodiment, the camera section 160 may photograph a structure identifier for identifying the structure 10 to recall the three-dimensional model 21 of the structure 10.

For example, the user can photograph the bar code or the QR code displayed on the structure 10 by the camera unit 160. [ Then, the chief information providing apparatus 100 can process the three-dimensional model 21 corresponding to the photographed structure identification symbol from the server 200 or the storage unit 180 and process it.

According to the embodiment, the chief information providing apparatus 100 may include an RFID reader to identify the structure 10 by reading the RFID data from the RFID tag provided in the structure 10. The chuck information providing apparatus 100 can process the three-dimensional model 21 corresponding to the read RFID data from the server 200 or the storage unit 180. [

According to an embodiment of the present invention, the image processing unit 120 may generate a composite image by synthesizing the three-dimensional model 21 of the structure 10 with the real image 11 of the structure 10. [ The output unit 130 may output the composite image.

In this case, the image processing unit 120 may add the three-dimensional model 11 to the real image 11 so that the at least one reference point extracted from the real image 11 matches the corresponding point of the three-dimensional model 21 corresponding to the reference point, (21) can be matched. The reference point may be a pixel corresponding to an edge or a corner in the real image 11. Similarly, the corresponding point may be a point corresponding to an edge or a corner of the three-dimensional model 21.

In order to match the three-dimensional model 21 to the two-dimensional real image 11 in this way, the viewing direction of the three-dimensional model 21 corresponding to the photographing direction of the real image 11 may be required. Although the real image 11 and the three-dimensional model 21 include shape data for the same structure 10, unlike the real image 11 including only two-dimensional plane data, the three- Dimensional model, it is required to match the three-dimensional model 21 viewed in the same direction as the photographing direction of the real image 11 to the real image in order to generate the composite image.

According to an embodiment of the present invention, the output unit 130 displays a three-dimensional model 21 on a screen in order to determine a viewing direction of the three-dimensional model 21, Based on the three-dimensional model 21, data regarding the position at which the structure 10 is photographed. Then, the image processing unit 120 can detect the line-of-sight direction of the three-dimensional model 21 corresponding to the photographing direction of the structure 10 based on the received photographing position.

4 is a diagram illustrating an exemplary user input process for determining the viewing direction of the three-dimensional model 21 corresponding to the photographing direction of the structure 10 according to an embodiment of the present invention.

According to this embodiment, the user inputs data regarding the photographing point of the structure 10 to the patriotic information providing apparatus 100, so that the patriotic information providing apparatus 100 allows the three- The direction can be quickly detected with a smaller amount of computation.

For example, referring to FIG. 4, the output unit 130 of the chuck information providing apparatus 100 may display a three-dimensional model 21 of the structure 10 on a screen. The user can input data regarding the structure photographing position based on the displayed three-dimensional model 21 through the input unit 110 such as a touch screen.

For example, as shown in FIG. 4, the chuck information providing apparatus 100 may include touch buttons 111, 112, and 113 for rotating the displayed three-dimensional model 21 in a three-dimensional coordinate space on a touch screen .

4, the touch button 111 relating to the x-axis is a button for rotating the three-dimensional model 21 around the x-axis, and the touch button 112 relating to the y- Axis, and the touch button 113 related to the z-axis is a button for rotating the three-dimensional model 21 about the z-axis. The user rotates the three-dimensional model 21 displayed on the output unit 130 in the three-dimensional coordinate space by touching the touch buttons 111, 112 and 113 so that the user corresponds to the direction in which the structure 10 is photographed The three-dimensional model 21 can be operated.

The touch buttons 111, 112 and 113 for rotating the three-dimensional model 21 in the three-dimensional coordinate space and the touch buttons 114 and 115 for enlarging and reducing the three- ). ≪ / RTI >

Then, when the user touches the OK button 116, the image processing unit 120 searches the three-dimensional model 21 based on the viewing direction of the three-dimensional model 21 displayed on the output unit 130 by the user's operation, The viewing direction of the corresponding three-dimensional model 21 can be detected.

According to this embodiment, the image processing unit 120 can search the three-dimensional model 21 of the three-dimensional model 21 without having to search for the viewing direction of the three-dimensional model 21 corresponding to the photographing direction of the real image 11 over the entire area of the three- Dimensional model 21 can be searched only for a certain region centered on the structure photographing position input by the user, so that the gaze direction corresponding to the photographing direction of the real image 11 can be detected. As a result, the embodiment of the present invention can greatly reduce the data throughput of the three-dimensional model 21 required for image matching, thereby improving the processing speed and reducing the hardware resources used in the computation.

4 receives the structure photographing position from the user through the touch button provided on the touch screen, but the method of receiving the photographing position is not limited thereto and can be implemented by various user interfaces.

In the following, the plane on which the patriarchs 101, 102, 103, 104, 105, 106, 107 are installed in the structure 10 of FIG. 2 is a plane 210 ). ≪ / RTI >

According to an embodiment of the present invention, the image processing unit 120 may convert the image data of the chiefs 101, 102, 103, 104, 105, 106, and 106 based on the composite image of the real image 11 and the three- 107 may collide with the articles 201, 202, 203 to be installed on the structure 10.

In this case, the image processing unit 120 may extract the patriotic objects corresponding to the patriarchs 101, 102, 103, 104, 105, 106, and 107 from the real image 11.

5 is a diagram illustrating an example of a real image 11 obtained by photographing a structure 10 provided with a patriarch 101, 102, 103, 104, 105, 106, 107 according to an embodiment of the present invention.

2, when the user photographs the structure 10 provided with the patriarchs 101, 102, 103, 104, 105, 106 and 107, the real image 11 is divided into a part corresponding to the structure and a part corresponding to the patriarch ≪ / RTI > The image processing unit 120 can extract the chief objects 101 ', 102', 103 ', 104', 105 ', 106', and 107 'corresponding to the patriarch from the real image 11 through image processing have.

For example, the image processing unit 120 may detect an edge in the real image 11 and then extract a pixel area surrounded by the edge as an object. However, the object extraction method is not limited to this, have.

According to an embodiment of the present invention, the image processing unit 120 may convert an object whose ratio between the length of the one direction and the length of the other direction in the real image 11 exceeds the predetermined reference value, ', 103', 104 ', 105', 106 ', 107').

The members used as the footsteps 101, 102, 103 and the posts 104, 105, 106, 107 are standardized and the footsteps 101, 102, 103 of the same size 5, the image processing unit 120 has a ratio of the length of the one direction to the length of the other direction in the real image 11 as shown in FIG. 5, since the image processing unit 120 is coupled to the columns 104, 105, 106, It is possible to determine an elongated object that exceeds the preset reference value as the patriotic objects 101 ', 102', 103 ', 104', 105 ', 106', and 107 '.

The image processing unit 120 may extract an article object corresponding to the articles 201, 202, and 203 provided in the structure 10 from the three-dimensional model 21.

FIG. 6 is an exemplary view showing a state in which the three-dimensional model 21 according to the embodiment of the present invention is viewed in the same direction as the photographing direction of the real image 11 shown in FIG.

6, the image processing unit 120 adjusts the three-dimensional model 21 of the structure 10 as shown in FIG. 3 to look in the same direction as the photographing direction of the real image 11, The article object 201 'corresponding to the article provided in the structure 10 can be extracted from the three-dimensional model 21.

In the three-dimensional model 21 shown in Fig. 6, only the object 201 'corresponding to the article 201 among the articles 201, 202, and 203 of Fig. 3 can be extracted in the view direction.

Then, the image processing unit 120 can match the real image 11 and the three-dimensional model 21. As described above, the matching of the real image 11 and the three-dimensional model 21 is performed by detecting the visual direction of the three-dimensional model 21 corresponding to the photographing direction of the real image 11, The three-dimensional model 21 is synthesized on the real image 11 so that the reference image extracted from the real image 11 and the corresponding points of the corresponding three- (21). ≪ / RTI >

FIG. 7 is an exemplary diagram illustrating a composite image 31 in which a real image 11 and a three-dimensional model 21 of the structure 10 are matched according to an embodiment of the present invention.

When the real image 11 of FIG. 5 is matched with the three-dimensional model 21 of FIG. 6, a composite image 31 as shown in FIG. 7 can be obtained. The portion 10 'corresponding to the structure 10 in the composite image 31 corresponds to the structural portion of the real image 11 and the structural portion of the three-dimensional model 21, The structure part and the structure part of the three-dimensional model (21) are the same in size and shape in the composite image (31).

In the composite image 31, the image data of the thumbnail images 101 ', 102', 103 ', 104', 105 ', 106', 107 ' 201 ') are all included.

According to an embodiment of the present invention, the image processing unit 120 may generate the image data of the object image 101 ', 102', 103 ', 104', 105 ', 106' 201 'may overlap with each other.

8 is an exemplary diagram illustrating a composite image 31 in which an overlapping area 301 is highlighted according to an embodiment of the present invention.

Referring to FIG. 8, in the composite image 31, some areas overlap with the patriotic objects 101 ', 102', 103 ', 104', 105 ', 106', 107 'and the article object 201' . The image processing unit 120 can detect the overlapping area 301 in which two objects overlap each other through image processing.

8, part of the scaffolding object 101 'corresponding to the footstep 101 and part of the column object 106' corresponding to the column 106 belong to the area of the article object 201 ' And is detected as the overlap area 301.

According to this embodiment, the output unit 130 can emphasize the overlap area 301 in the composite image 31 and output it. For example, the output unit 130 may display or print the color of the overlapping region 301 by changing the color of the overlapping region 301 to a predetermined color or changing the color of the overlapping region 301 to a predetermined color.

In the composite image 31, the overlapping area 301 is formed in such a manner that a part of the chiefs 101, 102, 103, 104, 105, 106, The chief information providing apparatus 100 may provide the user with a combined image 31 including the overlap area 301 to thereby display the confusion image 101 with the chief information 101, 102, 103, 104, 105, 106, 107 may need to be changed.

Further, the chief information providing apparatus 100 may notify the user of a substitute area in which the chiefs 101, 102, 103, 104, 105, 106, 107 may collide with the article 201, You may.

FIG. 9 is an exemplary illustration of a composite image 31 in which a patriot installable area 302 is provided that is capable of installing a chief in avoiding collisions, according to one embodiment of the present invention.

According to this embodiment, when the overlapping area 301 is detected in the composite image 31, the image processing unit 120 detects the overlapping area 301 out of the area where the article object 201 'is located in the composite image 31, An area from the area 301 to a predetermined distance d in the vertical axis direction can be determined as the patriarchal installable area 302. [

In the composite image 31 of Fig. 9, the vertical axis direction, i.e., the direction corresponding to the paper plane direction on the composite image 31 is the opposite direction of the z axis. The image processing unit 120 determines the area of the article object 201 'overlapping with the patriotic objects 101', 102 ', 103', 104 ', 105', 106 ', and 107' And can be determined as the patriotic mountable area 302 in which the patriarch can be installed by avoiding collision from the overlap area 301 downward (i.e., the opposite direction of the z-axis) by a distance d.

According to this embodiment, the output unit 130 can emphasize and output the clan installable area 302 in the composite image 31. For example, the output unit 130 may display or print the hill-mountable region 302 by changing the color of the hill-mountable region 302 to a different color or changing the hill color to a predetermined color.

If the superimposing area 301 and the phallic mountable area 302 are displayed together in the composite image 31, the output unit 130 can display the superimposing area 301 and the phallic mountable area 302 in the composite image 31 302 can be distinguished and output.

As a result, the user can install the chiefs 101, 102, 103, 104, 105, 106, and 107 installed in the current structure 10 at appropriate positions in consideration of the article 201 to be installed in the structure 10 Can be known in advance. Further, when the positions of the chiefs 101, 102, 103, 104, 105, 106, and 107 are overlapped with the article 201, the user is guided to the chief position replacement operation Can proceed more easily.

10 is an exemplary flow diagram of a method 40 of providing chief information in accordance with one embodiment of the present invention.

The chief information providing method 40 is a method for providing information on the chiefs 101, 102, 103, 104, 105, 106 and 107 by the chief information providing apparatus 100 according to the embodiment of the present invention .

10, the chick information providing method 40 may include a step S410 of obtaining a real image 11 obtained by photographing the structure 10, a three-dimensional model 21 relating to the structure 10, (S430) of synthesizing the real image (11) and the three-dimensional model (21) to generate a composite image (31) 104, 105, 106, and 107, and outputting information about the patriarchs 101, 102, 103, 104, 105, 106, and 107 (S450) . ≪ / RTI >

According to an exemplary embodiment, the step of acquiring the real image 11 (S410) may include receiving the real image 11 from the user. According to another embodiment, the step S410 of acquiring the real image 11 may include a step in which the camera unit 160 photographs the structure 10 and receives the generated real image 11 .

According to an embodiment of the present invention, the chief information providing method 40 may be configured to provide structure identification data for identifying a structure 10 from a user before the step (S420) of loading the three-dimensional model 21 relating to the structure 10 And receiving an input.

According to one embodiment, the three-dimensional model 21 for the structure may include a finished structure model representing the completed shape of the structure 10. [ The finished structure model shows in the three-dimensional coordinate space the structure (10) in which the articles (201, 202, 203) such as the equipment are additionally installed.

According to one embodiment of the present invention, the chuckweed information providing method 40 is a method for providing the chick information 31 by using the composite image 31 in order to determine the viewing direction of the three-dimensional model 21 in correspondence with the photographing direction of the real image 11 Displaying the three-dimensional model 21 relating to the structure 10 before the step S430 of generating the three-dimensional model 21; Dimensional model 21 corresponding to the photographing direction of the structure 10 based on the inputted structure photographing position.

11 is an exemplary flow chart illustrating a process for generating information about a chief based on a composite image 31 in accordance with an embodiment of the present invention.

Referring to FIG. 11, in an embodiment of the present invention, the step S430 of generating the composite image 31 may include the step of generating the composite image 31 from the object image 101, (S432) of extracting the article object 201 'corresponding to the article 201 provided in the structure 10 from the three-dimensional model 21 (S432 (S433) of creating the composite image 31 by matching the real image 11 and the three-dimensional model 21 with each other.

The step S440 of generating information about the patriotism based on the composite image 31 may include the step of generating the information on the patriotic objects 101 ', 102', 103 ', 104', 105 ', 106 (S441) of detecting an overlapping area 301 in which the article object 201 ', 107' and the article object 201 'overlap.

The overlapped area 301 is formed by overlapping the positions of the chiefs 101, 102, 103, 104, 105, 106, and 107 installed in the current structure 10 with the article 201 to be installed in the structure 10 . In this case, the step S450 of outputting the information on the patriarchy may include a step of highlighting and outputting the overlapping area 301 in the composite image 31. [

In addition, the step S440 of generating information about the patriotism based on the composite image 31 may include a step S440 of detecting an overlapping area 301 in the composite image 31, (E.g., in the opposite direction of the z-axis in Fig. 9) from the overlapping area 301 outside the area to a predetermined distance d as the patriarch installable area 302 .

The patriotic installation area 302 indicates a replacement area where the patriarch can be installed to avoid overlapping with the article 201 to be installed in the structure 10. In this case, the step S450 of outputting the information about the patriarchy may further include the step of highlighting and outputting the patriarchy-installable area 302 in the composite image 31. [

In the case where both the overlapping area 301 and the patriarchy attachable area 302 are displayed in the composite image 31, the step S450 of outputting the information about the patriarchy may include the step of: And outputting the installable area 302 separately.

The chief information providing method 40 may be stored in a computer-readable recording medium that is manufactured as a program to be executed by a computer. The computer-readable recording medium includes all kinds of storage devices in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. Also, the chief information providing method 40 may be embodied as a computer program stored in the medium for execution in association with the computer.

While the present invention has been described with reference to the exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. Those skilled in the art will appreciate that various modifications may be made to the embodiments described above. The scope of the present invention is defined only by the interpretation of the appended claims.

10: Structure
11: The real image
21: Three-dimensional model
31: Composite image
100: Chief information providing device
101, 102, 103, 104, 105, 106, 107:
101 ', 102', 103 ', 104', 105 ', 106', 107 ': a chieftain object
110: input unit
120:
130:
140:
150: Image input unit
160:
170:
180:
200: Server
201, 202, 203: Goods
201 ': Goods object
301: overlap area
302: Chief Area Available Area

Claims (8)

An input unit for receiving data;
An image processing unit for generating a composite image by synthesizing a real image obtained by photographing a structure and a three-dimensional model related to the structure, and generating information about a patriotism installed on the structure based on the composite image; And
And an output unit for outputting information on the patriarchy.
The method according to claim 1,
An image input unit receiving the real image from a user; And
A camera unit for photographing the structure to generate the real image;
Wherein the at least one chick information providing apparatus further comprises:
The method according to claim 1,
Wherein the output unit displays a three-dimensional model related to the structure,
Wherein the input unit receives data regarding a position where the structure is photographed based on the displayed three-dimensional model from a user,
Wherein the image processing unit detects the three-dimensional model corresponding to a photographing direction of the structure based on an input structure photographing position.
The method according to claim 1,
Wherein the image processing unit comprises:
Extracting a chief object corresponding to the chief from the physical image,
Extracting an article object corresponding to the article provided in the structure from the three-dimensional model,
Generating a composite image by matching the real image and the three-dimensional model,
And detecting an overlapping area in which the chief object and the article object overlap in the composite image.
5. The method of claim 4,
Wherein the image processing unit comprises:
And determines an object whose ratio between the length of the one direction and the length of the other direction in the real image exceeds a predetermined reference value as the chief object.
5. The method of claim 4,
Wherein the image processing unit comprises:
And determines an area that reaches a predetermined distance outside the area where the article object is located in the composite image as the patriarch installable area when the overlap area is detected.
The method according to claim 6,
The output unit includes:
And highlighting and outputting the patriarch installable area in the composite image.
A method for providing information on a patriarchy installed on a structure,
Acquiring a real image obtained by photographing the structure;
Loading a three-dimensional model of the structure;
Synthesizing the real image and the three-dimensional model to generate a composite image;
Generating information about the chiefs based on the composite image; And
And outputting information on the patriarchy.
KR1020150120343A 2015-08-26 2015-08-26 Apparatus and method for providing information on scaffold KR101785517B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150120343A KR101785517B1 (en) 2015-08-26 2015-08-26 Apparatus and method for providing information on scaffold

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150120343A KR101785517B1 (en) 2015-08-26 2015-08-26 Apparatus and method for providing information on scaffold

Publications (2)

Publication Number Publication Date
KR20170024824A true KR20170024824A (en) 2017-03-08
KR101785517B1 KR101785517B1 (en) 2017-10-16

Family

ID=58404595

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150120343A KR101785517B1 (en) 2015-08-26 2015-08-26 Apparatus and method for providing information on scaffold

Country Status (1)

Country Link
KR (1) KR101785517B1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180061714A (en) * 2016-11-30 2018-06-08 삼성중공업 주식회사 Apparatus and method for providing scaffold installation information, recording medium
KR20190136042A (en) * 2017-12-14 2019-12-09 캐논 가부시끼가이샤 Generating device, generation method, and program of three-dimensional model

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180061714A (en) * 2016-11-30 2018-06-08 삼성중공업 주식회사 Apparatus and method for providing scaffold installation information, recording medium
KR20190136042A (en) * 2017-12-14 2019-12-09 캐논 가부시끼가이샤 Generating device, generation method, and program of three-dimensional model
KR20200129184A (en) * 2017-12-14 2020-11-17 캐논 가부시끼가이샤 3-dimensional model generation device, method and program
US11151787B2 (en) 2017-12-14 2021-10-19 Canon Kabushiki Kaisha Generation device, generation method and storage medium for three-dimensional model from object images and structure images

Also Published As

Publication number Publication date
KR101785517B1 (en) 2017-10-16

Similar Documents

Publication Publication Date Title
JP6326996B2 (en) Terminal device, information processing system, and display control program
US10001844B2 (en) Information processing apparatus information processing method and storage medium
EP3053145B1 (en) Generating augmented reality content for unknown objects
JP6077010B2 (en) Work support terminal and work support system
US20180027218A1 (en) Work assistance device, work assistance system, work assistance method, and recording medium storing work assistance program
JP2017191351A (en) Work support system and method
US11727624B2 (en) Construction visualization systems and methods
KR101785517B1 (en) Apparatus and method for providing information on scaffold
JP2018142109A (en) Display control program, display control method, and display control apparatus
KR102344227B1 (en) Moving body detecting device, moving body detecting method, and moving body detecting program
JPWO2005096130A1 (en) Method and apparatus for detecting designated position of imaging apparatus, and program for detecting designated position of imaging apparatus
KR101792701B1 (en) Apparatus and method for inspecting drawing
KR101845423B1 (en) Apparatus and method for supporting inspection of structure
WO2018179223A1 (en) Remote operation assistance system, remote operation assistance method and program
JP2018144952A (en) Information processing unit
JP2018084951A (en) Behavior analysis device and behavior analysis method
KR101756313B1 (en) Apparatus for guiding location of member
KR20210023663A (en) Image processing method and image processing apparatus for generating 3d content using 2d images
KR101702518B1 (en) Apparatus for providing information on structure
KR101873983B1 (en) Apparatus for providing structure information, and recording medium
JP2021060784A (en) Object detection device, system, method, and program
US11636827B2 (en) Method for managing the display of a least one information item, and associated computer program product, information medium and display system
KR20170025439A (en) Apparatus and method for managing process for outfit
JP5182023B2 (en) Connector model detection device, connector model detection method, and connector model detection program
WO2021040342A2 (en) Image processing method and image processing device for generating 3d content by means of 2d images

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right