KR20210075723A - Method and system of process design for hexpod usage in assembly process of aircraft - Google Patents

Abstract

The present invention relates to a process design method for hexapod use in an aircraft fuselage assembly process for flexible manufacture/production using an augmented reality (AR) technique for reinforcing a cooperation system between a design department and a production site and reducing an organizational silos effect between a designer and a site worker for an aircraft fuselage structure manufacturing production environment, and a system thereof. According to the present invention, the process design method for hexapod use in an aircraft fuselage assembly process comprises: a step of tracking the position, movement, speed, direction, etc. of an object of a real-world camera photographing image through a video interface when the image is transmitted; a step of creating a virtual object through computer graphics and accurately arranging the virtual object at a position of a real image; and a step of processing an interaction with a user through a display. The tracking step uses a GPS, an acceleration sensor, a gyro sensor, etc. usable in a mobile device as a sensor-based technique to track the movement, position, direction, etc. of an object to identify an augmented position on the screen, uses a camera or the like as a marker-based technique among vision-based techniques to recognize, track, and map a marker such as a QR code, or provides related information by filtering and comparing an image photographed through a camera and an object to be compared as a non-marker-based technique.

Description

TECHNICAL FIELD [0002] Method and system of process design for hexpod usage in assembly process of aircraft}

The present invention relates to a process design method and system for utilizing hexapods in an aircraft body assembly process.

The latest industrial trends will definitely be artificial intelligence (AI), Internet of Things (IoT), big data, and the fourth industrial revolution. In this manufacturing industry platform revolution, IoT technologies such as artificial intelligence (AI), augmented reality (AR) and virtual reality (VR), which are based on software/hardware convergence technology that can efficiently analyze, control, and realize the production process, and various types Hardware technology of flexible and variable equipment suitable for production is required in a complex way.

In particular, in the field of aircraft manufacturing, the virtual reality technology that started with the flight training simulator for aviation has a number of related smart device apps in the field of leisure and clothing as well as game simulators, but it can be said that there is no solution for the manufacturing site of the aircraft. IDC RESEARCH predicts that the virtual reality (VR) and augmented reality (AR) market will expand from $5.2 billion in 2016 to $162 billion in 2020.

Tools and fixtures, which are essential in the manufacturing and production site of aircraft airframe structures, are indispensable items in order to increase the precision and efficiency of manufacturing and assembly in aircraft manufacturing and production. It is a jig like a mold, manufactured through machining, welding, and assembly processes, and is used in other automobiles, railway vehicles, shipbuilding and industrial machinery fields.

However, since most jigs are specialized in one manufacturing part and serve as a dedicated jig, each jig must be manufactured in order to apply it to various products, so it has many disadvantages in terms of design, cost, and time. Most of the flexible jigs that have been or are already applied are researched and manufactured focusing on machining, so research on reconfigurable jigs used in the assembly process is insufficient. In particular, in the aviation industry, it is difficult to make a suitable jig due to the nature of small-volume production of various types, and a jig that is specialized for one thing is a factor that makes the introduction of automation technology more difficult in the aviation manufacturing field.

The present invention utilizes augmented reality (AR) technology that strengthens the collaboration system between the design department and the production site and reduces the 'Organizational Silos Effect' between designers and field workers for an aircraft airframe structure manufacturing and production environment. It relates to a process design method and system for using hexapods in an aircraft airframe assembly process for flexible manufacturing/production.

In the process design method for using hexapods in the aircraft body assembly process according to the present invention for solving the above problems, when a camera photographed image of the real world is transmitted, the image is displayed through a video interface to the position of an object and tracking movement, speed direction, etc.; creating a virtual object through computer graphics and arranging it exactly at the location of the real image; and processing the interaction with the user through the display. The tracking step is a sensor-based technology that tracks the movement, location, direction, etc. of an object using GPS, an acceleration sensor, a gyro sensor, etc. that can be used in a mobile device. to identify the augmented position on the screen, or among vision-based technologies, marker-based technologies recognize, track and map markers such as QR codes using a camera, etc., or, as a non-marker-based technology, compare an image taken through a camera with an object to be compared It is characterized in that it provides related information by filtering and comparing them.

AR Phone and Studistube ES are used as the vision-based augmented reality technology, and Phone Guide and SR Engine software are used as vision-based.

It is a technology for accurately arranging a virtual object at the location of an actual image, and it is characterized by performing three steps of positioning, rendering, and merging.

In the process design system for using hexapods in the aircraft body assembly process according to the present invention for solving the above problems, when a camera image of the real world is transmitted, the image is displayed through a video interface to the position of an object and a tracking module that tracks movement, speed direction, etc.; a matching module for creating virtual objects through computer graphics and arranging them exactly on the actual positions of the images; and a user interface module that processes interaction with the user through the display, and the tracking module is a sensor-based technology that uses GPS, accelerometer, gyro sensor, etc. that can be used in mobile devices, such as movement, location, direction, etc. to identify the augmented location on the screen by tracking the image, or among vision-based technologies, marker-based technology recognizes, tracks, and maps markers such as QR codes using a camera, etc., or compares it with images captured by a camera as a non-marker-based technology. It is characterized by providing related information by filtering the target object and comparing it.

The tracking module is characterized by using AR Phone and Studistube ES as the vision-based augmented reality technology, and using Phone Guide and SR Engine software as a vision-based technology.

The matching module is a technology for accurately arranging a virtual object at the location of an actual image, and is characterized in that it consists of three steps: Positioning, Rendering, and Merging.

According to the present invention, a virtual work in the shape of a 3D model with augmented reality technology is displayed on the actual jig centered on the jig tool mounting position essential in the manufacturing site of the aircraft airframe structure, thereby effectively promoting process work and improving productivity and quality. can contribute

In addition, the world-class level specialized for small quantity production of various kinds through quantification of the difficult aircraft body structure assembly production environment, cell automation for product production process, real-time processing and quality data DB creation, and ERP-linked environment by applying ICT information and communication technology of high-quality aircraft airframe structures can be established.

1 is a reference diagram illustrating an assembly process to which a flexible fixture is applied.
2 is a reference diagram illustrating an AR system as a process design method for utilizing the aforementioned hexapod in an aircraft body assembly process.
3 is a reference diagram illustrating an AR browser.
4 is a reference diagram for explaining tracking and recognition of a square marker for generating a coordinate system in an AR browser.
5 is a reference diagram illustrating generation of a coordinate system using a square marker.
6 is a reference diagram illustrating generation of a coordinate system using an IR target.
7 is a reference diagram illustrating an example of tracking using an IR target.
8 is a reference diagram illustrating generation of a virtual object using a square marker.
9 is a reference diagram illustrating the coordinate movement for verification of the assembly work radius and the movement path of the operator.
10 is a reference diagram illustrating a relative position measurement between virtual objects.
11 is a reference diagram illustrating AR Open Source Mixare AR.
12 is a reference diagram illustrating a sensor test result and correction example.
13 is a reference diagram illustrating an example of detecting a location signal using general GPS location information.
14 is a reference diagram illustrating an indoor GPS deviation correction screen.
15 is a reference diagram illustrating the OPC UA System Architecture.
16 is a reference diagram illustrating the configuration of an OPC UA-based Interface Module.
17 is a reference diagram illustrating a factory overview screen.
18 is a reference diagram illustrating an equipment dashboard screen.
19 is a reference diagram illustrating an equipment status report screen generated in REDAX.
20 is a reference diagram illustrating a tool management screen.

Hereinafter, with reference to the drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them.

The present invention may be embodied in many different forms and is not limited to the embodiments described herein.

In order to clearly explain the present invention, parts irrelevant to the description are omitted, and the same reference numerals are given to the same or similar elements throughout the specification. In the following, the provision or arrangement of an arbitrary component on the “upper (or lower)” or “top (or below)” of the substrate means that any component is provided or disposed in contact with the upper surface (or lower surface) of the substrate. means that Further, it is not limited to not include other components between the substrate and any components provided or disposed on (or under) the substrate.

World-class high-quality aircraft specialized in small-lot production of various types through quantification of difficult aircraft airframe structure production environments, cell automation for product production processes, real-time processing and quality data DB creation, and ERP-linked environment by applying ICT information and communication technology In order to establish a supply system for an airframe assembly system, 'development of an aircraft structure assembly and production automation solution applying Flex-Fixture' is required.

Not a large corporation that is building a perfect system for high-tech aircraft production based on a relatively systematic process development capability, but a small and medium-sized company with weak technological competitiveness and a poor technical manpower and personnel composition, frequent design changes, quality requirements, and cost of major customers In order to respond to the frequent demands for reduction, it is urgent to secure independent technology development capabilities and build production automation.

1 is a reference diagram illustrating an assembly process to which a flexible fixture is applied.

As shown in FIG. 1, a hexapod, a parallel instrument robot for realizing reconfigurable Flex-Fixture, will be described.

The types of parallel mechanical robots for realizing reconfigurable Flex-Fixture are divided into Hexapod and Flexapod. Hexapod and Flexapod are parallel robots of the same class, only the structure of the parts designed and used is different, and the basic kinematics are the same. Therefore, since this design difference does not significantly affect the kinematics or the idea for realizing the Reconfigurable Flex-Fixture, the Hexapod and the Flexapod are not separately distinguished, and an overview is given based on the basic structure of the parallel robot.

Parallel mechanical robots are also called Stewart Platforms after the name of the first proponent, D Stewart, is a parallel system in which two platforms, usually composed of an upper plate and a lower plate, are connected by a linear motion actuator (leg) of a Prismatic type. The rescue robot is called Hexapod robot. The six legs are connected to the base platform at one end and the other end to the mobile platform. The difference in design between a Flexapod and a standard Hexapod is that the hexapod has a spherical joint where the upper attachment point is connected to the leg through a spherical joint, whereas the Flexapod has a universal joint for the upper attachment point and a spherical joint that is the final degree of freedom in the shape of the hexapod relative to its own axis. The part is configured to cause rotation of the legs.

The present invention provides a process design method and system for utilizing the aforementioned hexapod in an aircraft body assembly process.

2 is a reference diagram illustrating an AR system as a process design method for utilizing the aforementioned hexapod in an aircraft body assembly process.

1. A look at the Reconfigurable Flex Fixture virtual assembly process system using AR is as follows.

Major technologies required for mobile AR implementation include tracking technology for the user's location, direction, and movement, registration technology that creates virtual objects through computer graphics and places them exactly in the actual image location, and display There is a UI (User Interface) technology that handles interactions with users, etc.

The AR system is a tracking module that performs a function of tracking the position, movement, speed direction, etc. of an object through a video interface when the image captured by a camera in the real world is transmitted as shown in the figure above. transmit

The rendering module creates an augmented image through the creation or removal of a virtual object based on the location of the object identified through the tracking module.

The tracking module can be divided into sensor-based technology and vision-based technology. Vision-based technology is divided into marker-based and non-marker-based technologies.

Sensor-based technology refers to a technology that uses GPS, accelerometer, and gyro sensor that can be used in mobile devices to track the movement, location, and direction of an object to identify the augmented location on the screen and visualize related content. Although it is widely used because there is one, there is a disadvantage that it is difficult to augment accurate information at a specific location.

Among vision-based technologies, marker-based technology is a technology that recognizes, tracks, and maps markers such as QR codes using a camera, etc. technology that provides information.

Examples of vision-based augmented reality technology include AR Phone and Studistube ES, and vision-based examples include Phone Guide and SR Engine software.

In addition, the matching technology is a technology that accurately places a virtual object at the location of the actual image, and consists of three steps: Positioning, Rendering, and Merging.

In the future, AR technology will evolve from vision-based and location-based AR, such as GPS, which provides information through markers, to image recognition, in terms of tracking technology, and further recognizes the real 3D environment like Google's 'Glass' and analyzes the relevant environment. It is expected to develop into context-aware-based AR that understands the context.

In addition, if AR technology is built into the smartphone chipset, it will be easier to develop advanced AR applications (apps) than the present.

Composition and Types of Augmented Reality System

The AR system, which enhances the sense of reality of the real environment by matching virtual objects to the real environment, consists of an AR browser for processing images and virtual objects and an interface of related devices, and the image acquired through the camera is processed in the AR browser. Through this, registration with the virtual object is achieved. 3 is a reference diagram illustrating an AR browser.

The matched image information is transmitted to the operator through a display device such as a monitor or a head mounted display (HMD). The AR browser, which performs image processing to create a virtual object based on the obtained image information, is largely a tracking module for recognizing and tracking a marker that provides the creation reference information of the virtual object, and creation/removal of the virtual object. / Consists of a rendering module for movement and a measurement module for measuring distance between virtual objects and checking interference.

The three main modules are composed of basic algorithms for image processing and C++-based libraries to perform mathematical operation processing, and each of these modules is mutually integrated based on ActiveX, an integrated standard of visual software. .

tracking module

In order to create a virtual object in a real image, a medium between the virtual object and the real image is required. The AR browser establishes a reference coordinate system for the creation of virtual objects by continuously tracking and recognizing these mediums. The module that performs this role is the tracking module.

4 is a reference diagram for explaining tracking and recognition of a square marker for generating a coordinate system in an AR browser.

Although various principles such as mechanical, magnetic, and optical are provided to perform tracking, optical tracking using a square marker is the mainstream of AR systems to secure precision because the method using optics currently shows the highest precision among them. have. However, since the optical-based tracking method is greatly affected by lighting, a method using an IR (infrared) target is sometimes used to overcome this.

Square marker-based tracking method:

For tracking using optics, a square marker is mainly used. To create a coordinate system based on the square marker, the AR browser sequentially performs the image process for detection and recognition of the square marker.

In addition, a reference coordinate system for generating a virtual object is generated through matching between the size and pattern information of the marker provided through the UI (User Interface) and the information stored in the marker database. In addition, a two-dimensional matrix marker or template composed of black and white is used to determine the direction of the reference coordinate system.

When a square marker is used to create an operating program of a dynamic field system, the square marker can be obscured by other field components, and the camera continues to operate even when the position and direction are frequently changed like a robot. It is impossible to track the marker. To solve these problems, a coordinate system using a multi-marker system is used.

5 is a reference diagram illustrating generation of a coordinate system using a square marker.

If it is possible for the camera to acquire an image of one or more markers among a plurality of markers used in the multi-marker system, the AR browser may continuously maintain the reference coordinate system.

How to track using an IR target:

The tracking method using a square marker has a lot of influence on the registration robustness of virtual objects by surrounding environmental variables that affect image processing, such as lighting conditions of the workplace where the AR system is applied, the distance and angle between the camera and the marker, and the size of the marker. will receive In general, the job site does not meet these conditions. In order to solve these problems, a tracking methodology using an IR target is presented.

First, the work area is defined using two or more infrared cameras, and the world coordinate system, which is the basis of the overall coordinate system, is set. Then, a reference coordinate system for creating a virtual object is generated using the IR target.

6 is a reference diagram illustrating generation of a coordinate system using an IR target.

When using the IR target provided by ART (Advanced Realtime Tracking) GmbH, it is possible to set the local coordinate system in three ways as shown in FIG. 6 .

In the ART tracking system, the infrared camera continuously tracks the IR target and transmits the relative position values of the local coordinate system obtained based on the world coordinate system to the AR system. Based on the transmitted data, the AR browser sets a reference coordinate system for the creation of virtual objects. These two methods can be used simultaneously if necessary. 7 shows an application example of an AR system using an IR target.

The following figure shows the configuration diagram of an AR system that uses a square marker and an IR target at the same time.

rendering module

Creation and removal of virtual objects based on the coordinate system created through the tracking module is performed through the rendering module. It is possible to create several virtual objects using one marker.

8 is a reference diagram illustrating generation of a virtual object using a square marker. As in the left image of FIG. 8 , when all virtual objects do not have relative motion, the entire virtual system can be matched to the real environment with one marker. However, as in the right image of FIG. 8 , when there is a relative movement between virtual objects like an AGV, a respective reference coordinate system is required for each generated component, and thus a respective marker is required for each corresponding virtual object.

The generated virtual objects have a matching order based on distance information from the camera. That is, the distant virtual object is obscured by the virtual object close to the camera. In the process of performing a task, information on a distant virtual object may be required. In this case, information of a distant virtual object can be obtained by removing a nearby virtual object.

Moving the coordinates of the virtual object

9 is a reference diagram illustrating the coordinate movement for verification of the assembly operation radius and the movement path of the operator.

The initially created virtual object is created with the center of the marker as the origin.

Depending on the situation in the field, it may not be possible to place the marker at a desired location, or it may receive visual interference from other objects while performing marker tracking.

In this case, the marker is installed at a location where tracking is easy, and coordinate movement is performed to position the virtual object in the correct position on the AR browser.

Also, it may be required to move the created virtual object to an arbitrary location for system verification. The figure below shows the movement of the operator performing the manual assembly process by moving the coordinates.

measurement module

Since the image obtained through the AR browser is two-dimensional, it is not easy to grasp the location and distance information between virtual objects at a glance.

Various measurement tools are needed to measure the distance between the generated virtual objects, to measure the distance and direction between the created coordinate systems, and to check the interference between the virtual objects. It is the measurement module that does this.

Distance measurement between virtual objects

Since the virtual object is created around the marker, the distance between any two points can be calculated using P1 and P2 based on the marker.

By adding distance information between markers in real space, it is also possible to measure the distance between any two points generated based on different markers. 10 is a reference diagram illustrating a relative position measurement between virtual objects.

Interference check between virtual object and real environment

Virtual objects always exist on top of real images. That is, it is impossible to visually check the interference between the virtual object and the real environment.

For this, a clipping plane is used.

A clipping plane is a transparent virtual plate that is also created based on markers.

The function of the clipping plane is to remove a virtual object on one side based on the corresponding reference plane, and by creating a clipping plane based on the marker attached to the wall, the interference between the virtual body and the surrounding system is visually identified. it is possible to do

RFF virtual assembly process system using AR

The application (Application, App) for augmented reality application service outputs various information that matches the reference shape and fixture position 1:1 through AR (augmented reality) technology implemented in the aircraft manufacturing and production site environment in the actual application. It implements the service provided by matching the field environment and virtual shape information as accurately as possible. The app developed for this purpose applies AR (augmented reality) module, gyroscope sensing technology, GPS detection and application algorithm, and GPS Map Utility that can correct the indoor DGPS error range.

AR application service App module

It is a free augmented reality open source that can be used on Android and iPhone 3G or higher, and is developed based on Mixare AR, which implements basic functions for augmented reality.

Unlike image-based augmented reality with many open sources, Mixare is almost the only open source for location-based augmented reality, so it analyzes, corrects and supplements it to implement Mixare-RFF, which uses Reconfigurable Flex Fixture as an object.

11 is a reference diagram illustrating AR Open Source Mixare AR.

Since the Mixare AR module operates along a specific circular line on the smartphone camera view as shown in the figure above, Mixare-RFF applies an algorithm to change the icon size of the overlaid objects according to the distance for visual effect. call

In addition, in order to increase the position and accuracy of the point matching the target position of the jig tool, an algorithm using triangulation azimuth is applied, and the azimuth angle is calculated as shown in the table below after comparing and analyzing the error degree of the azimuth through the laser tracker. It is possible to quantify how much the distance and position accuracy between two points is improved. Table 1 is a table showing the performance comparison between Mixare and Mixare-RFF.

Item Mixare Mixare-RFF remark object placement circle level object size Impossible to change changeable Icon size according to distance object accuracy difficult to locate good positioning sensor sensitivity severe usually

Gyroscope sensing technology applied

Sensors constituting rotation or acceleration also differ depending on the manufacturer and manufacturing terminal, and although the response speed of the proximity sensor is fast, the distance is very short.

12 is a reference diagram illustrating a sensor test result and correction example.

In general, acceleration, illuminance, proximity, and magnetic sensors are base modules, so only acceleration, illuminance, and magnetic sensors, which are sensor functions necessary for development, are extracted and applied. There is an advantage to

However, according to previous experiments, the sensitivity of the gyroscope sensor of the Android phone itself is too fine, so when calling the sensor data value, the decimal point is rounded off. is investigated as

It is planned to acquire the direction data to the target point by calling the coordinate data of the mobile phone location and the target point that the camera is facing, and the object location algorithm according to the sensor value of the acquired direction data and in-device direction data is applied.

Indoor DGPS signal detection and application algorithm

13 is a reference diagram illustrating an example of detecting a location signal using general GPS location information.

Calculating and presenting the exact distance and location is very important in terms of securing usability through reliable information provision. Therefore, it is very important to know how accurately the distance or location information received through the GPS sensor can be displayed compared to the actual one. That is, it is necessary to check how accurately information about one's current location is received.

14 is a reference diagram illustrating an indoor GPS deviation correction screen.

Since the GPS of the smartphone contains an error of about 5 to 10 m, as shown in FIG. 14, depending on the characteristics of the device, an algorithm or an active correction method for calculating the difference between the actual distance and the position of the reference map is required. . In order to solve this problem, a function capable of compensating the GPS in the program is configured as shown in FIG. 14 . Table 2 is a table showing an example of error comparison after deviation correction.

division android phone General GPS error 5 ~ 10m Error after GPS error correction (accuracy) Within 5m (cm class error)

Assembly process information system

The information system related to the assembly and production of aircraft structures is based on the basic model of the operator's manual work, and based on Android by referring to actual photographic information and 3D drawings of the work object.

As an augmented reality application system through the application of Mixare-RFF and gyroscope sensing technology developed by modifying and supplementing Mixare, an augmented reality development open source, and GPS calculation and deviation correction, the Assembly Process Information System (ASFP) menu is divided into the main categories in the table below, It is structured like a middle class.

The main screen consists of workshop information and assembly process OPR, Quick OPR, object management, environment setting and usage (Help) menus, which are major categories. The augmented reality menu, which can be said to be the core of this app development, is the assembly process OPR on the main screen. Organize in a submenu of the menu.

2. Aircraft structure production process management system

In general, the aircraft parts manufacturing process can be broadly divided into a machining process that produces unit parts by cutting, cutting, and molding materials, and an assembly process that performs combining operations on completed individual parts such as fastening and assembling. The drilling process takes up a lot of weight.

In particular, in aircraft manufacturing, the drilling process, unlike the drilling operation expressed in the general industrial machine process, contains various work characteristics, such as a springback phenomenon due to the influence of large plate structure materials, and difficulty in estimating drilling cutting force due to aluminum alloy heterojunction Therefore, in most aircraft production and manufacturing sites, as shown in the figure, the rate of processing depending on the skill of field workers is quite high, and the rate of automation for process unit work is also quite low.

However, recently, the US and European countries are actively discussing to maximize the productivity of aircraft parts by automating this inefficient and inefficient drilling process, and concurrent design engineering, which is presented as an important factor in the development of next-generation aircraft or new aircraft In order to maximize the effect, research on automated process development and related fields related to aircraft body manufacturing is actively underway.

Here, Robotic Drilling System (RDS) refers to a fastening hole in which the size of the work process object like an aircraft is large and the number of holes corresponding to the work teaching point is quite large, making it impossible for the operator to perform the entire process work by simply manipulating the teaching by the teaching pendant. It refers to a dedicated automation system for processing and riveting processes.

In the field of aircraft manufacturing and production, the development of 'aircraft structure production process management system' is a fundamental environment that must be reviewed when building solutions that apply industrial robots in relation to the 4th industrial revolution, and responds to the technology protectionism in advanced countries that is intensifying as time goes by It is an essential issue that must be pursued nationally.

15 is a reference diagram illustrating the OPC UA System Architecture. 16 is a reference diagram illustrating the configuration of an OPC UA-based Interface Module.

Composition of production process management system using OPC:

Concept and Architecture of OPC and OPC UA

OPC (OLE for Process Control)

The OPC standard provides an industry standard mechanism for communication and data conversion between a client and a server based on MS's OLE technology.

OPC compatible client can read/write data from multiple OPC compatible servers by defining the interface method between the client application and server of Process Data.

OPC UA (Open Platform Communication Unified Architecture):

Integrates existing OPC DA/HAD/A&E and Security with IEC 62541 standard

Provides real-time and synchronization based on standard Ethernet

OPC UA System Architecture:

OPC UA Information Model for IEC 61131-3 7.1.1 System Architecture General

Interface Module based on OPC UA standard:

Internalization of OPC UA Protocol Unit

Aircraft structure production process management system using OPC

This software system is a production process management system using middleware that can track process data.

By unifying the data of PLC-dependent devices including robots and PLCs as OPC servers and PLC-independent devices including sensors and cameras, data can be collected for all devices in the production plant through the OPC server, middleware and data The data collected using the storage server can be monitored and tracked in real time, compared with the product and process data pre-stored in the data storage server, and the device for the process can be automatically controlled. It is a production process management system using middleware that can track process data that can receive various control commands from the user and control the process to automatically create finished products and receive the results for each process by receiving various control commands from the user.

To this end, this software system generates data in industrial sites including sensors and cameras, and generates data in industrial sites including PLC-independent devices, robots, and PLCs that transmit and receive data according to different communication protocols, a device unit including a PLC-dependent device for transmitting and receiving data according to each different communication protocol; A device server that receives data from a PLC non-dependent device and performs PLC functions instead, receives data communicated in a non-standard communication method and relays it to enable OPC communication, and a device server that enables OPC communication for PLC-independent devices OPC server that unifies and manages data transmitted through and data transmitted from PLC-dependent devices, middleware that detects changes in device data from the OPC server and controls the device, receives and stores the changed data from the middleware and stores it in the production process Process data transmitted by connecting to a web server of the service unit and the service unit including a data storage server that stores process data including control values according to the data storage server, a web server that receives data stored in the data storage server and enables service in a web environment Based on real-time process monitoring, it is possible to track the process of production products, and it is possible to control devices by inputting control values for each process. The 'aircraft structure production process management system' used is provided as follows.

Remote data analysis

It performs the following two functions to monitor the real-time equipment operation status.

It uses OPC UA (Open Platform Communication Unified Architecture), an international standard unified language for smart manufacturing, to monitor equipment operation status and display data.

Third-party OPC-compatible users collect and aggregate data and display it on web pages in real time.

User login The web browser connects to the server through the user login and password authentication procedures.

The Administrator menu is available only when logged in as an administrator.

In the admin menu, you can add equipment or configure settings for E-Mail and SMS messages.

Factory Overview

17 is a reference diagram illustrating a factory overview screen.

Displays the registered equipment status in the factory.

Real-time production operation status is displayed. Ex) Tool name, equipment status and status Displays the status of daily production, spindle load, user name, and equipment status indicator.

Displays equipment uptime and user actions.

A message is displayed when the equipment is turned off or the server's network connection is disconnected.

equipment dashboard

18 is a reference diagram illustrating an equipment dashboard screen.

It displays tool and process work data, feed rate and tool management information.

Equipment status, work report, daily/weekly production status and records are displayed.

Displays loadermate information and cycle time charts.

The spindle load graph and process capability index (Cp/Cpk) are displayed.

error log

19 is a reference diagram illustrating an equipment status report screen generated in REDAX.

When the error log page is opened, the most recent 20 error message records are displayed.

You can use the Find function to find specific errors.

Log history is saved even when the device is turned off or no error occurs due to a network connection error

Select the appropriate language from the drop-down menu and select Error.

The report server generates the following types of reports, and creates reports in the period set in the drop-down menu or in a user-specified format.

Set all devices to generate a report, select from the drop-down menu to generate a report only for specific devices.

After setting the report type and other report filters, press the Create Report button to print it.

The generated report data can be output in CSV format or printed as a report page.

The following is an example of displaying the device status report generated from the client to the server.

Email and SMS message notification function

Notifies the person in charge designated by the administrator by e-mail or SMS message.

tool management

20 is a reference diagram illustrating a tool management screen.

Tool management is linked with the central integrated management system for tool files on the server.

Compare the master file and the tool file to check the differences and changes.

tool management

Jigonggu information management is linked with the central integrated management system on the server.

It is possible to use the tool dimensions and information interchangeably between each process.

You can use the quick find function to search the tool library for the tools and packs you want.

Another important function is to prevent damage or damage to the jig by installing the function to prevent overlapping of the jig used in the process simulation process and the jig used in the actual process.

In the above, detailed embodiments of the process design method and system for using hexapods in the aircraft body assembly process of the present invention have been described, but it is obvious that various implementation modifications are possible within the limits that do not depart from the scope of the present invention.

Therefore, the scope of the present invention should not be limited to the described embodiments, and should be defined by the following claims as well as the claims and equivalents. That is, it should be understood that the above-described embodiment is illustrative in all respects and not restrictive, and the scope of the present invention is indicated by the claims to be described later rather than the detailed description, and the meaning and scope of the claims and their equivalents All changes or modifications derived from the concept should be construed as being included in the scope of the present invention.

Claims (6)

When transmitting a camera-captured image of the real world, tracking the image through a video interface, the position, movement, speed direction, etc. of the object;
creating a virtual object through computer graphics and arranging it exactly at the location of the real image; and
and handling interactions with the user through the display;
The tracking stage is a sensor-based technology that uses GPS, accelerometer, and gyro sensor that can be used in mobile devices to track the movement, location, and direction of objects to determine the augmented location on the screen, or marker-based technology among vision-based technologies. An aircraft body characterized by recognizing, tracking and mapping a marker such as a QR code using a camera, or filtering an image taken through a camera and a comparison target object as a non-marker-based technology, and providing related information by comparing it A process design method for the use of hexapods in the assembly process. The method according to claim 1,
A process design method for using hexapods in the aircraft body assembly process, characterized in that AR Phone and Studistube ES are used as the vision-based augmented reality technology, and Phone Guide and SR Engine software are used based on vision. The method according to claim 1,
Process design for hexapod utilization in the aircraft body assembly process, characterized by performing three steps of positioning, rendering, and merging as a technology to accurately place a virtual object at the location of an actual image Way. a tracking module for tracking the position, movement, speed direction, etc. of an object through a video interface when transmitting an image captured by a camera in the real world;
a matching module for creating virtual objects through computer graphics and arranging them exactly on the actual images; and
Includes a user interface module that handles interaction with the user through the display,
The tracking module is a sensor-based technology that uses GPS, accelerometer, and gyro sensor that can be used in mobile devices to track the movement, location, and direction of objects to determine the augmented location on the screen, or marker-based technology among vision-based technologies. An aircraft body characterized by recognizing, tracking and mapping a marker such as a QR code using a camera, or filtering an image taken through a camera and a comparison target object as a non-marker-based technology, and providing related information by comparing it Process design system for the utilization of hexapods in the assembly process. 5. The method according to claim 4,
The tracking module,
A process design system for hexapod utilization in the aircraft body assembly process, characterized in that AR Phone and Studistube ES are used as the vision-based augmented reality technology, and Phone Guide and SR Engine software are used as vision-based. 5. The method according to claim 4,
The matching module is
A process design system for using hexapods in the aircraft body assembly process, characterized in that it consists of three steps: Positioning, Rendering, and Merging, as a technology to accurately place a virtual object at the location of the actual image. .

Images