KR20170021689A - System and method for supporting design/manufacture of marine structure using argumented reality - Google Patents

System and method for supporting design/manufacture of marine structure using argumented reality Download PDF

Info

Publication number
KR20170021689A
KR20170021689A KR1020150116357A KR20150116357A KR20170021689A KR 20170021689 A KR20170021689 A KR 20170021689A KR 1020150116357 A KR1020150116357 A KR 1020150116357A KR 20150116357 A KR20150116357 A KR 20150116357A KR 20170021689 A KR20170021689 A KR 20170021689A
Authority
KR
South Korea
Prior art keywords
design drawing
image
display device
design
menu
Prior art date
Application number
KR1020150116357A
Other languages
Korean (ko)
Inventor
류민철
Original Assignee
대우조선해양 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 대우조선해양 주식회사 filed Critical 대우조선해양 주식회사
Priority to KR1020150116357A priority Critical patent/KR20170021689A/en
Publication of KR20170021689A publication Critical patent/KR20170021689A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G06F17/5004—

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention relates to a system and method for supporting the design / production of an offshore structure using an augmented reality, which comprises a display unit, a photographing unit for photographing an image, a design drawing matching the photographed image, And a controller for displaying the overlay on the screen of the display unit.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a marine structure designing /

The present invention relates to a system and method for supporting the design and production of an offshore structure using an augmented reality, and more particularly, to a system and method for supporting the design and production of an offshore structure by using an augmented reality The present invention relates to a system and method for supporting design / production of offshore structures using reality.

Augmented Reality (Augmented Reality) creates a new environment by combining the real world that the user sees with the virtual world with the additional information. Since the late 1990s, research and development have been conducted mainly in the United States and Japan. Augmented reality, a concept that complements the real world with a virtual world, uses a virtual environment created by computer graphics, but the protagonist is a real environment. Computer graphics serve to provide additional information needed for the real world.

Meanwhile, designers and engineers who design ships and offshore structures encounter unfamiliar production environments, new offshore structures and complex construction methods. On-site engineers will examine the drawings prepared in CAD (Computer-aided Design) in advance to identify the types of offshore structures to be produced beforehand in order to grasp the offshore structures to be produced in advance. In addition, designers and engineers produce ocean structures and identify design drawings of offshore structures within a flat screen.

However, if the shape of the offshore structure is complex or the production process is difficult, the engineer who has no production experience may experience difficulties in understanding and planning the offshore structure, which may cause the production error or mistake The range can be made large.

Therefore, it is required to develop a technology that can complement the design while viewing the actual structure of the offshore structure.

Prior Art 1: Korea Patent Publication No. 2011-0116842 (Published on October 26, 2011)

SUMMARY OF THE INVENTION The present invention has been conceived to solve the problems described above, and it is an object of the present invention to provide a three-dimensional display device for realizing an augmented reality by overlaying a design drawing of an offshore structure in production on an image of a corresponding offshore structure, The present invention provides a system and method for supporting the design / production of an offshore structure using an augmented reality that can complement a design while viewing the system.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.

According to an aspect of the present invention, there is provided an image processing apparatus including: a display unit; a photographing unit that photographs an image; a design drawing matching the photographed image is acquired, and the obtained design drawing is overlaid on the image, And a control unit for displaying on the screen of the display device.

The three-dimensional display device further includes a communication unit for communicating with the service server, a measurement unit for measuring position information, direction information, and attitude information, and the control unit controls the three-dimensional display device based on the measured position information, The coordinates of the photographed image are calculated, and a design drawing of a structure located in the calculated image coordinates is requested to the service server and acquired.

The three-dimensional display device may further include a storage unit storing at least one of a design drawing, position information, and an image of the structures, and a measurement unit for measuring position information, direction information, and attitude information, Calculating coordinates of the photographed image using direction information and attitude information, acquiring a design drawing of a structure located at the calculated image coordinates from the storage unit, or image-processing the photographed image and matching the photographed image with the image A design drawing of the structure to be obtained can be obtained from the storage section.

The control unit may convert the design drawing into a three-dimensional image or a displayable format in a three-dimensional display device when the photographed design drawing is two-dimensional or non-displayable format.

In addition, the control unit displays a menu including at least one of a site design drawing menu, a design drawing search menu, and an email search menu, and a screen displaying the photographed image on the display unit, and when a site design drawing menu is selected from the menu A design drawing matching the image is overlaid on the image, a design drawing list is displayed when the design drawing search menu is selected, a specific design drawing selected from the design drawing list is overlaid on the image, When the menu is selected, the design drawing selected in the e-mail can be overlaid and displayed on the image.

According to another aspect of the present invention, there is provided a three-dimensional display device for requesting a design drawing matching with an image photographed through a photographing unit to a service server, overlaying a design drawing received from the service server and displaying the overlay on the image, There is provided an offshore structure design / production support system using an augmented reality including a design drawing and location information of the augmented reality and a service server for acquiring a design drawing requested from the 3D display device and transmitting the design drawing to the 3D display device .

The marine structure design / production support system using the augmented reality further includes a conversion server for converting a two-dimensional design drawing and a three-dimensional design drawing or a design drawing into a displayable format in the three-dimensional display device, When the obtained design drawing is a format that can not be displayed in two-dimensional or three-dimensional display device, the server converts the design drawing into a three-dimensional display or a format displayable in a three-dimensional display device and transmits the three- .

Also, the system for supporting the design / production of an offshore structure using the augmented reality stores e-mail information and provides an e-mail list to a three-dimensional display device when e-mail inquiry is requested in the three- And an e-mail server for transmitting the drawing to the three-dimensional display device.

Wherein the 3D display device calculates coordinates of the photographed image and requests a design drawing corresponding to the calculated image coordinates to the service server, and the service server obtains a design drawing corresponding to the image coordinates, And can be transmitted to the three-dimensional display device.

According to another aspect of the present invention, there is provided a method for supporting design / production of an offshore structure using augmented reality, comprising: (a) capturing an image; (b) Obtaining a design drawing, and (c) overlaying the obtained design drawing on the image and displaying the drawn design drawing on a screen.

The step (b) includes the steps of measuring position information, direction information, and attitude information, calculating coordinates of the photographed image using the measured position information, direction information, and attitude information, And acquiring the design drawing of the structure located in the storage unit acquired or requested by the service server.

The step (b) may include displaying a menu including at least one of a site design drawing menu, a design drawing search menu, and an email search menu and a screen displaying the photographed image, , A design drawing matching the image or a design drawing of a point selected by a user in the image is obtained from a service server or a storage unit provided therein, and when the design drawing search menu is selected, a design drawing list is displayed, Acquiring a selected design drawing from the drawing list, displaying the e-mail list when the e-mail inquiry menu is selected, and obtaining a selected design drawing on the e-mail.

According to another aspect of the present invention, a three-dimensional display device calculates a coordinate of the obtained image when an image is acquired through an imaging unit, and transmits a design drawing request signal including the calculated image coordinates to a service server The service server obtains a design drawing corresponding to the image coordinates, determines whether the acquired design drawing needs to be converted, and transmits a design drawing conversion request signal including the design drawing to the conversion server when the conversion is necessary Wherein the conversion server converts the design drawing and transmits the converted design drawing to the 3D display device via a service server, the 3D display device overlaying the design drawing on the obtained image A method of supporting design / production of an offshore structure using an augmented reality including a step of displaying an augmented reality is provided.

According to another aspect of the present invention, there is provided a three-dimensional display device including a menu including at least one of a site design drawing menu, a design drawing search menu, and an email search menu, Wherein the 3D display device calculates coordinates of the obtained image when the site design drawing menu is selected and transmits a design drawing request signal including the calculated image coordinates to a service server, The service server obtains a design drawing corresponding to the image coordinates, determines whether the acquired design drawing is required to be converted, and transmits a design drawing conversion request signal including the design drawing to a conversion server when conversion is required , The conversion server converts the design drawing and transmits the converted design drawing to the service server Dimensional display device, and the 3D display device displays overlaying the design drawing on the acquired image, thereby providing a method for supporting the design / production of an offshore structure using an augmented reality.

According to another aspect of the present invention, there is provided a recording medium on which program instructions for performing an augmenting reality based offshore structure design / production support method are recorded.

According to the present invention, the design drawings of an offshore structure being produced can be overlaid on an image of a corresponding offshore structure by using a three-dimensional display device implementing an augmented reality to complement the design while viewing the actual structure of the offshore structure.

The effects of the present invention are not limited to the above-mentioned effects, and various effects can be included within the scope of what is well known to a person skilled in the art from the following description.

FIG. 1 is a view illustrating a marine structure design / production support system using an augmented reality according to an embodiment of the present invention.
FIG. 2 is a diagram for explaining a method of confirming a specification through an e-mail inquiry according to an embodiment of the present invention.
3 is a block diagram schematically showing a configuration of a three-dimensional display device according to an embodiment of the present invention.
4 is an exemplary view of an initial screen for implementing an augmented reality according to an embodiment of the present invention.
FIG. 5 is a view illustrating a method for supporting design / production of an offshore structure using an augmented reality according to an embodiment of the present invention.
6 is a diagram illustrating a method for supporting design / production of an offshore structure using an augmented reality according to another embodiment of the present invention.
FIG. 7 is a flowchart illustrating a method for supporting design / production of an offshore structure using augmented reality in a three-dimensional display device according to an embodiment of the present invention.

The foregoing and other objects, features, and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a system and method for supporting the design / production of an offshore structure using an augmented reality according to the present invention will be described in detail with reference to the accompanying drawings. The embodiments are provided so that those skilled in the art can easily understand the technical spirit of the present invention, and thus the present invention is not limited thereto. In addition, the matters described in the attached drawings may be different from those actually implemented by the schematic drawings to easily describe the embodiments of the present invention.

In the meantime, each constituent unit described below is only an example for implementing the present invention. Thus, in other implementations of the present invention, other components may be used without departing from the spirit and scope of the present invention. In addition, each component may be implemented solely by hardware or software configuration, but may be implemented by a combination of various hardware and software configurations performing the same function. Also, two or more components may be implemented together by one hardware or software.

Also, the expression " comprising " is intended to merely denote that such elements are present as an expression of " open ", and should not be understood to exclude additional elements.

FIG. 1 is a diagram illustrating a system for supporting the design / production of an offshore structure using an augmented reality according to an embodiment of the present invention. FIG. 2 is an exemplary diagram for explaining a method of confirming a specification through an e-mail inquiry according to an embodiment of the present invention to be.

Referring to FIG. 1, an offshore structure design / production support system using an augmented reality includes a 3D display device 100, a service server 200, and a conversion server 300, which are connected through a communication network.

The 3D display device 100 requests and receives a design drawing matching the image photographed through the photographing unit, and displays the received design drawing on a screen by overlaying the received design drawing on the photographed image. At this time, the three-dimensional display device 100 measures the position information, the direction information, and the attitude information, calculates coordinates of the photographed image, and transmits a design drawing request signal including the calculated image coordinates to the service server 200 And receives the design drawing of the structure located at the image coordinates from the service server 200.

The three-dimensional display device 100 includes a head mounted display (HMD), an eye-mounted display (EMD), an eyeglass, an eyepiece, an eye wear, a headworn display (HWD) And the like, and is not limited to the terms used in the present invention.

A detailed description of the three-dimensional display device 100 will be made with reference to FIG.

The service server 200 stores the design drawings and positional information of the structures, acquires the requested design drawings from the three-dimensional display device 100, and transmits the design drawings to the three-dimensional display device 100. At this time, if the acquired design drawing is a format that can not be displayed in the two-dimensional or three-dimensional display device 100, the service server 200 determines that the conversion of the design drawing is necessary, And transmits the design drawing converted by the conversion server 300 to the three-dimensional display device 100.

That is, when receiving the design drawing request signal including the image coordinates from the three-dimensional display device 100, the service server 200 obtains a design drawing of the structure located at the image coordinates. Then, if the obtained design drawing is 2D or in a format that can not be displayed in the 3D display device 100, the service server 200 determines that conversion is necessary, and transmits a design drawing conversion request signal including the design drawing To the conversion server (300). When the service server 200 receives the design drawing converted by the conversion server 300, the service server 200 transmits the design drawing to the 3D display device 100.

The conversion server 300 converts the two-dimensional design drawing and the three-dimensional design drawing or the design drawing into a format that can be displayed on the three-dimensional display device 100 according to reception of the design drawing conversion request signal, Lt; / RTI >

Here, the conversion server 300 for converting the design drawing is separately provided, but the service server 200 may convert the design drawing. In this case, the service server 200 performs the operation of the conversion server 300.

The system configured as described above may further include an e-mail server 400.

When the e-mail information is stored in the e-mail server 400 and the e-mail inquiry is requested in the three-dimensional display device 100, the e-mail list is provided to the three-dimensional display device 100, and the design drawings existing on the e- Dimensional display apparatus 100 according to the present invention.

The user can inquire the e-mail to select the design drawing on the e-mail. When the e-mail server 400 needs to convert the selected design drawing, the e-mail server 400 transmits the design drawing to the conversion server 300, And transmits the design drawing to the three-dimensional display device 100.

As described above, the three-dimensional display device 100 is connected to the e-mail server 400 through a communication network, and the design drawing (or specification) 420 on the e-mail can be overlaid on the image 410 .

FIG. 3 is a block diagram schematically showing a configuration of a three-dimensional display device according to an embodiment of the present invention, and FIG. 4 is an exemplary view of an initial screen for implementing an augmented reality according to an embodiment of the present invention.

3, the three-dimensional display device 100 includes a photographing unit 110, a display unit 120, an input unit 130, a measuring unit 140, a storage unit 150, a communication unit 160, ).

The photographing unit 110 photographs an image according to a user operation, and may include, for example, a camera. The photographing unit 110 includes various types of image sensing apparatuses such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor) camera module as well as a depth camera module and an infrared camera module. In the present embodiment, only the image capturing using the elements provided in the image capturing unit 110 has been described. However, the present invention can also be implemented by receiving an image from an external camera.

The display unit 120 is a means for providing a user with an operation result or status of the three-dimensional display device 100. The display unit 120 may be a form of a display that can be visually confirmed, for example, a liquid crystal display (LCD) Light Emitting Diodes) and the like. In particular, the display unit 120 according to the present invention displays a design drawing realized as an augmented reality on the screen by the control unit 170. [

The input unit 130 is a means for receiving a user request for controlling the operation of the three-dimensional display device 100. The input unit 130 converts a user's request into an electric signal according to a user's operation.

The measurement unit 140 measures position information, direction information, and attitude information of the three-dimensional display device 100 and includes a position information measurement unit (not shown), a direction information measurement unit (not shown), an attitude information measurement unit (Not shown).

The position information measuring unit measures the position of the three-dimensional display device 100, and may be a position measuring device such as a Global Positioning System (GPS), WIPI positioning, or the like. That is, the position information measuring unit may include a GPS sensor that receives a signal from a GPS satellite, a GPS sensor that detects a current position of the GPS satellite, a wireless LAN (WiFi) base station The wireless LAN device may include a wireless LAN device that receives a radio wave from the wireless LAN device and detects an approximate current position of the wireless LAN device.

The direction information measuring unit measures the photographing direction of the three-dimensional display device 100 to obtain direction information (azimuth angle or yaw angle?). For example, the direction information measuring unit may include a gyroscope sensor, a geomagnetic sensor, a digital azimuth sensor, and the like.

The attitude information measuring unit measures the roll angle h and the pitch angle v of the three-dimensional display device 100. For example, the attitude information measuring unit may be a tilt sensor.

The storage unit 150 stores a program necessary for the operation / support of an offshore structure design / production using an augmented reality and data generated during the execution of the program. Basically, the operation program of the 3D display device 100 is stored.

In addition, the storage unit 150 may store design drawings and location information of the structures.

The communication unit 160 is a communication unit that interconnects the three-dimensional display device 100 with a service server, a conversion server, and an e-mail server through a communication network so that the design diagram of the structure can be provided. A wired communication module such as the Internet, and a short-range wireless communication module such as a Wi-Fi modem.

The control unit 170 obtains a design drawing matched with the image photographed by the photographing unit 110, and displays the overlaid design plan on the image of the display unit 120 by overlaying the obtained design drawing.

Since the control unit 170 acquires the design drawing and realizes it as an augmented reality, there are various ways of implementing it.

First, when an image is acquired through the photographing unit 110, the controller 170 may automatically request and receive a design drawing matched to the image by the service server, thereby implementing an augmented reality. In this case, when an image is acquired through the photographing unit 110, the controller 170 calculates coordinates of the photographed image using the position information, direction information, and attitude information measured by the measuring unit 140, And requests the service server through the communication unit 160 for the design drawing of the structure located at the image coordinates. When the design drawing of the structure located at the image coordinates is received from the service server, the control unit 170 overlays the received design drawing on the image obtained through the photographing unit 110 and displays the overlaid design drawing on the screen of the display unit 120. [

Next, when an image is obtained through the photographing unit 110, the control unit 170 displays a menu for acquiring a design drawing and a screen displaying the acquired image, acquiring a design drawing through menu selection, Can be implemented.

In this case, when the image is obtained through the photographing unit 110, the control unit 170 displays at least one of the field design drawing menu 171, the design drawing retrieving menu 173, and the e-mail inquiry menu 172 as shown in FIG. And displays the menu including the menu 175 and the image captured by the photographing unit 110 on the display unit 120. Here, the field design drawing menu 171 is a menu for requesting a design drawing matching a photographed image or a design drawing of a point selected by a user in a photographed image, a design drawing retrieval menu 173 is a menu A menu for inquiring a desired design drawing in the list, and an e-mail inquiry menu 173 may be a menu for inquiring a design drawing on an e-mail.

When the site design drawing menu 171 is selected from the menu, the controller 170 overlays and displays the design drawing of the point selected by the user on the design drawing or the image matching the image. At this time, the control unit 170 can request and receive the corresponding design drawing from the service server. If the design drawing of the structures is stored in the storage unit 150, the control unit 170 can acquire the corresponding design drawing from the storage unit 150.

When the design drawing inquiry menu 173 is selected, the control unit 170 displays a list of previously stored design drawings. When a specific design drawing is selected from the design drawing list, the controller 170 acquires a specific design drawing through the photographing unit 110 Can be overlaid on the displayed image. In this case, the control unit 170 can receive the design drawing list and the specific design drawing from the service server. When the design drawing of the structures is stored in the storage unit 150, May be obtained.

When the e-mail inquiry menu 172 is selected, the control unit 170 displays the e-mail list, selects the design drawing existing on the e-mail, and superimposes the selected design drawing on the image obtained through the photographing unit 110 Can be displayed.

Finally, when the design drawing and the position information of the structures are stored in the storage unit 150, when the image is acquired through the photographing unit 110, the control unit 170 stores the design drawing matching the acquired image into the storage unit 150 ) To realize an augmented reality.

In this case, when an image is acquired through the photographing unit 110, the controller 170 calculates coordinates of the photographed image using the position information, direction information, and attitude information measured by the measuring unit 140, The design drawing of the structure located at the image coordinates is extracted from the storage unit 150. The control unit 150 overlays the extracted design drawing on the image obtained through the photographing unit 110 and displays the overlaid design on the screen of the display unit 120. [

In addition, the control unit 170 may process the photographed image and acquire a design drawing of the structure matching the image from the storage unit 150. [ That is, the control unit 170 processes the image to obtain an image of a black and white line signal in order to determine whether the photographed image matches a certain figure of the structure. To this end, the control unit 170 performs image edge processing and thinning processing on the image photographed through the photographing unit to obtain an image of a monochrome line signal. Then, the controller 170 matches the obtained image with the drawing of the structure stored in the storage unit 150, grasps to which drawing of the structure the drawing corresponds, and extracts the grasped drawing.

If the acquired design drawing is two-dimensional or non-displayable format, the control unit 170 can convert the design drawing into a three-dimensional image or a displayable format in the three-dimensional display device 100. [

The control unit 170 controls the overall function of the three-dimensional display device 100 by executing a pre-stored driving program according to a user's instruction.

The control unit 170 controls the operation of various components of the photographing unit 110, the display unit 120, the input unit 130, the measurement unit 140, the storage unit 150, and the communication unit 160.

The control unit 170 may include at least one computing unit, which may be a general purpose central processing unit (CPU), programmable device elements (CPLDs, FPGAs) suitably implemented for a particular purpose, Device (ASIC) or a microcontroller chip.

These components, which the three-dimensional display device 100 may include, may be implemented by hardware, software, or a combination thereof, and two or more components may be simultaneously implemented by one hardware or software.

FIG. 5 is a view illustrating a method for supporting design / production of an offshore structure using an augmented reality according to an embodiment of the present invention.

Referring to FIG. 5, when an image is acquired through the photographing unit (S502), the 3D display device calculates coordinates of the acquired image (S504), transmits a design drawing request signal including the calculated image coordinates to a service server (S506).

The service server obtains a design drawing corresponding to the image coordinates (S508), and determines whether conversion of the obtained design drawing is necessary (S510).

If it is determined in operation S510 that the conversion is necessary, the service server transmits a design drawing conversion request signal including the design drawing to the conversion server (S512).

The conversion server converts the design drawing (S514), and transmits the converted design drawing to the 3D display device through the service server (S516).

The 3D display device displays the design drawing overlaying the acquired image (S518).

6 is a diagram illustrating a method for supporting design / production of an offshore structure using an augmented reality according to another embodiment of the present invention.

Referring to FIG. 6, when an image is acquired through the photographing unit (S602), the 3D display device displays a menu and a screen displaying the obtained image (S604). The menu displayed on the displayed screen includes a field design drawing menu, a design drawing query menu, and an e-mail inquiry menu.

When the field design drawing menu is selected from the menu (S606), the 3D display device calculates coordinates of the obtained image (S608), and transmits a design drawing request signal including the calculated image coordinates to the service server (S610 ).

The service server acquires a design drawing corresponding to the image coordinates (S608), and determines whether conversion of the obtained design drawing is necessary (S610).

If it is determined in S610 that the conversion is required, the service server transmits a design drawing conversion request signal including the design drawing to the conversion server (S612).

The conversion server converts the design drawing (S614), and transmits the converted design drawing to the three-dimensional display device through the service server (S616).

The 3D display device displays the design drawing overlaying the acquired image (S618).

FIG. 7 is a flowchart illustrating a method for supporting design / production of an offshore structure using augmented reality in a three-dimensional display device according to an embodiment of the present invention.

Referring to FIG. 7, the 3D display device determines whether an augmented reality is automatically set (S704) when an image is acquired through an imaging unit (S702).

If it is determined as a result of the determination in S704, the 3D display device obtains a design drawing matching the photographed image (S706). At this time, the three-dimensional display device can request and obtain a design drawing matched to the image photographed by the service server, and when the design drawing information is stored in the storage, the design drawing matching the photographed image is acquired You may.

Then, the 3D display device displays the obtained design drawing overlaying the photographed image on the screen (S708).

If the result of the determination in S704 is NO, the three-dimensional display device displays a menu and a screen on which the image is displayed (S710).

When the field design drawing menu is selected in the menu (S712), the 3D display device performs S706.

When the design drawing inquiry menu is selected in the menu (S714), the 3D display device displays the pre-stored list of design drawings (S716), and when a specific design drawing is selected from the design drawing list (S718), S606 is performed.

When the e-mail inquiry menu is selected from the menu (S720), the 3D display device displays the e-mail list (S722) and selects the design drawing existing on the e-mail (S724), and performs S706.

The method for supporting the design / production of an offshore structure using the augmented reality according to the present invention can be implemented in the form of a program command which can be executed through various computer means and recorded on a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination.

The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Includes all types of hardware devices that are specially configured to store and execute magneto-optical media and program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

The teachings of the principles of the present invention may be implemented as a combination of hardware and software. In addition, the software can be implemented as an application program that is actually implemented on the program storage unit. The application program can be uploaded to and executed by a machine that includes any suitable architecture. Advantageously, the machine may be implemented on a computer platform having hardware such as one or more central processing units (CPUs), a computer processor, a random access memory (RAM), and input / output (I / . In addition, the computer platform may include an operating system and microinstruction code. The various processes and functions described herein may be part of microcommand codes or a portion of an application program, or any combination thereof, and they may be executed by various processing devices including a CPU. In addition, various other peripheral devices such as additional data storage and printers may be connected to the computer platform.

It is to be understood that the actual connections between system components or process functional blocks may vary depending on how the principles of the present invention are programmed, as some of the constituent system components and methods illustrated in the accompanying drawings are preferably implemented in software It should be further understood. Given the teachings herein, those skilled in the relevant art (s) will be able to contemplate these and similar implementations or configurations of the principles of the invention.

As described above, the method and apparatus for supporting the design / production of an offshore structure using the augmented reality according to the present invention can be applied to a configuration and a method of the embodiments described above in a limited manner, All or some of the embodiments may be selectively combined so that various modifications can be made.

Thus, those skilled in the art will appreciate that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the embodiments described above are to be considered in all respects only as illustrative and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: three-dimensional display device 110:
120: display unit 130: input unit
140: Measuring section 150:
160: communication unit 170:
200: service server 300: conversion server
400: Email server

Claims (14)

A display section;
A photographing unit for photographing an image; And
Acquiring a design drawing matching the photographed image, overlaying the obtained design drawing on the image, and displaying the overlaid design drawing on a screen of the display unit;
Dimensional display device.
The method according to claim 1,
A communication unit for communication with the service server; And
Further comprising a measuring section for measuring position information, direction information and attitude information,
The control unit calculates coordinates of the photographed image using the measured position information, direction information, and attitude information, and requests the service server to obtain a design drawing of a structure located at the calculated image coordinates, And the three-dimensional display device.
The method according to claim 1,
A storage unit for storing at least one of design drawings, position information, and images of structures; And
Further comprising a measuring section for measuring position information, direction information and attitude information,
The control unit calculates coordinates of the photographed image using the measured position information, direction information, and attitude information, acquires a design drawing of the structure located in the calculated image coordinates from the storage unit, And acquires a design drawing of a structure matching the image by processing the image.
The method according to claim 1,
Wherein the controller converts the design drawing into a three-dimensional image or a displayable format in a three-dimensional display device when the acquired design drawing is two-dimensional or non-displayable format.
The method according to claim 1,
Wherein the control unit displays a menu including at least one of a site design drawing menu, a design drawing search menu, and an email search menu and a screen displaying the photographed image on the display unit, and when the site design drawing menu is selected from the menu, A design drawing list is displayed when the design drawing retrieving menu is selected, a specific design drawing selected from the design drawing list is overlaid on the image and the e-mail retrieving menu is displayed And when selected, overlaying the design drawing selected in the email on the image.
A three-dimensional display device for requesting a design drawing matching with an image photographed through a photographing section to a service server, overlaying a design drawing received from the service server on the image, and displaying the overlay on the screen;
A service server for storing design drawings and positional information of structures, obtaining a design drawing requested from the 3D display device and transmitting the design drawings to the 3D display device;
Design / Production Support System for Offshore Structures Using Augmented Reality.
The method according to claim 6,
Further comprising a conversion server for converting the two-dimensional design drawing and the three-dimensional design drawing into a format that can be displayed in the three-dimensional display device,
Wherein the service server converts the design drawing into a three-dimensional image or a displayable format in a three-dimensional display device when the obtained design drawing is a two-dimensional or non-displayable format in the three-dimensional display device, Wherein the augmented reality is transmitted to the offshore structure.
The method according to claim 6,
Further comprising an e-mail server for storing e-mail information, providing an e-mail list to the three-dimensional display device when the e-mail inquiry is requested from the three-dimensional display device, and transmitting the selected design drawing on the e-mail list to the three- A system for supporting the design / production of offshore structures using an augmented reality.
The method according to claim 6,
The three-dimensional display device calculates coordinates of the photographed image, requests a design drawing corresponding to the calculated image coordinates to the service server,
Wherein the service server obtains a design drawing corresponding to the image coordinates and transmits the design drawing to the 3D display device.
A method for supporting design / production of an offshore structure using augmented reality in a three-dimensional display device,
(a) photographing an image;
(b) obtaining a design drawing matching the photographed image; And
(c) overlaying the obtained design drawing on the image and displaying on the screen;
A method of design / production of an offshore structure using augmented reality.
11. The method of claim 10,
The step (b)
Measuring position information, direction information, and posture information;
Calculating coordinates of the photographed image using the measured position information, direction information, and attitude information;
And requesting a design drawing of a structure located at the calculated image coordinates to a service server and acquiring the acquired design drawing in a storage unit.
11. The method of claim 10,
The step (b)
Displaying a menu including at least one of a field design drawing menu, a design drawing inquiry menu, and an email inquiry menu and a screen displaying the photographed image;
A design drawing matching the image or a design drawing of a point selected by a user in the image is obtained from a service server or a storage unit provided when the site design drawing menu is selected,
When the design drawing query menu is selected, displaying a design drawing list, acquiring a design drawing selected from the design drawing list,
Displaying the e-mail list and acquiring a design drawing selected on the e-mail when the e-mail inquiry menu is selected; and a method of supporting design / production of an offshore structure using an augmented reality.

The three-dimensional display device calculates a coordinate of the obtained image when the image is acquired through the photographing unit, and transmits a design drawing request signal including the calculated image coordinate to the service server.
The service server obtains a design drawing corresponding to the image coordinates, determines whether the acquired design drawing is required to be converted, and transmits a design drawing conversion request signal including the design drawing to a conversion server when conversion is required ;
Wherein the conversion server converts the design drawing and transmits the converted design drawing to the 3D display device through a service server;
Wherein the 3D display device displays a design drawing overlaid on the acquired image;
A method of design / production of an offshore structure using augmented reality.
The three-dimensional display device includes a menu including at least one of a site design drawing menu, a design drawing search menu, and an email search menu when an image is acquired through a photographing unit, and displaying a screen displaying the obtained image;
Wherein the 3D display device calculates a coordinate of the obtained image when the site design drawing menu is selected and transmits a design drawing request signal including the calculated image coordinates to a service server;
The service server obtains a design drawing corresponding to the image coordinates, determines whether the acquired design drawing is required to be converted, and transmits a design drawing conversion request signal including the design drawing to a conversion server when conversion is required ;
Wherein the conversion server converts the design drawing and transmits the converted design drawing to the 3D display device through a service server;
Wherein the 3D display device displays a design drawing overlaid on the acquired image;
A method of design / production of an offshore structure using augmented reality.
KR1020150116357A 2015-08-18 2015-08-18 System and method for supporting design/manufacture of marine structure using argumented reality KR20170021689A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150116357A KR20170021689A (en) 2015-08-18 2015-08-18 System and method for supporting design/manufacture of marine structure using argumented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150116357A KR20170021689A (en) 2015-08-18 2015-08-18 System and method for supporting design/manufacture of marine structure using argumented reality

Publications (1)

Publication Number Publication Date
KR20170021689A true KR20170021689A (en) 2017-02-28

Family

ID=58543336

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150116357A KR20170021689A (en) 2015-08-18 2015-08-18 System and method for supporting design/manufacture of marine structure using argumented reality

Country Status (1)

Country Link
KR (1) KR20170021689A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200056688A (en) 2018-11-15 2020-05-25 주식회사 아디아랩 System and method for structural quality inspection using augmented reality
KR102181584B1 (en) * 2019-11-11 2020-11-20 (주)아이소프트 Ship Design Inspection System Using Coexistence Reality Based 3D Design Drawing, and Method thereof

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110116842A (en) 2010-04-20 2011-10-26 목포대학교산학협력단 Electronic navigational chart display method of vessels navigation system using augmented reality

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110116842A (en) 2010-04-20 2011-10-26 목포대학교산학협력단 Electronic navigational chart display method of vessels navigation system using augmented reality

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200056688A (en) 2018-11-15 2020-05-25 주식회사 아디아랩 System and method for structural quality inspection using augmented reality
KR102181584B1 (en) * 2019-11-11 2020-11-20 (주)아이소프트 Ship Design Inspection System Using Coexistence Reality Based 3D Design Drawing, and Method thereof

Similar Documents

Publication Publication Date Title
US10699481B2 (en) Augmentation of captured 3D scenes with contextual information
KR101835434B1 (en) Method and Apparatus for generating a protection image, Method for mapping between image pixel and depth value
JP5538667B2 (en) Position / orientation measuring apparatus and control method thereof
JP6635037B2 (en) Information processing apparatus, information processing method, and program
KR101285360B1 (en) Point of interest displaying apparatus and method for using augmented reality
JP6496671B2 (en) Information processing apparatus, terminal apparatus, information processing method, and program
EP3246660A1 (en) System and method for referencing a displaying device relative to a surveying instrument
WO2016017254A1 (en) Information processing device, information processing method, and program
KR20190089957A (en) Mismatch detection system, composite reality system, program and mismatch detection method
KR101665399B1 (en) Object generation apparatus and method of based augmented reality using actual measured
US20140192055A1 (en) Method and apparatus for displaying video on 3d map
KR101413011B1 (en) Augmented Reality System based on Location Coordinates and Augmented Reality Image Providing Method thereof
KR101181967B1 (en) 3D street view system using identification information.
JPWO2019012803A1 (en) Designated device and designated program
JP7109395B2 (en) WORK SUPPORT SYSTEM, WORK SUPPORT DEVICE, AND WORK SUPPORT METHOD
CN105814604B (en) For providing location information or mobile message with the method and system of at least one function for controlling vehicle
KR20170021689A (en) System and method for supporting design/manufacture of marine structure using argumented reality
US11354897B2 (en) Output control apparatus for estimating recognition level for a plurality of taget objects, display control system, and output control method for operating output control apparatus
JP6405539B2 (en) Label information processing apparatus for multi-viewpoint image and label information processing method
US11869159B2 (en) High density 3D environment capture with guided mixed reality
JP2017134775A (en) Image processing apparatus, image processing method, and program
JP6685814B2 (en) Imaging device and control method thereof
JP2011209622A (en) Device and method for providing information, and program
JP5065455B2 (en) Feature three-dimensional data generation method and feature three-dimensional data generation system
US20200005527A1 (en) Method and apparatus for constructing lighting environment representations of 3d scenes