CN112461207A - Projection device and method for guiding airplane assembly - Google Patents

Projection device and method for guiding airplane assembly Download PDF

Info

Publication number
CN112461207A
CN112461207A CN202010891673.6A CN202010891673A CN112461207A CN 112461207 A CN112461207 A CN 112461207A CN 202010891673 A CN202010891673 A CN 202010891673A CN 112461207 A CN112461207 A CN 112461207A
Authority
CN
China
Prior art keywords
projection
assembly
module
holes
guiding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010891673.6A
Other languages
Chinese (zh)
Inventor
李泷杲
黄翔
李�根
褚文敏
楼佩煌
钱晓明
陶克梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Research Institute Of Nanjing University Of Aeronautics And Astronautics
Nanjing University of Aeronautics and Astronautics
Original Assignee
Suzhou Research Institute Of Nanjing University Of Aeronautics And Astronautics
Nanjing University of Aeronautics and Astronautics
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Research Institute Of Nanjing University Of Aeronautics And Astronautics, Nanjing University of Aeronautics and Astronautics filed Critical Suzhou Research Institute Of Nanjing University Of Aeronautics And Astronautics
Priority to CN202010891673.6A priority Critical patent/CN112461207A/en
Publication of CN112461207A publication Critical patent/CN112461207A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/02Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64FGROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
    • B64F5/00Designing, manufacturing, assembling, cleaning, maintaining or repairing aircraft, not otherwise provided for; Handling, transporting, testing or inspecting aircraft components, not otherwise provided for
    • B64F5/10Manufacturing or assembling aircraft, e.g. jigs therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Manufacturing & Machinery (AREA)
  • Signal Processing (AREA)
  • Transportation (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a projection device and a projection method for guiding airplane assembly, wherein the projection device comprises a vision measurement module and a projection module, the vision measurement module consists of two cameras, the projection module comprises a DLP projector, and the projection method comprises the following steps: s1: calibrating the parameters of the vision measurement module and the conversion relation between the parameters and the projection module; s2: acquiring a conversion relation between an assembly object and a projection device; s3: the DLP projector generates a projection image according to the conversion relation; s4: and assembling according to the guiding information projected to the surface of the assembling object by the projection device. According to the projection device and the method for guiding the aircraft assembly, data can be imported and projection images can be generated only through simple operation, the cost is saved, the visualization effect is good, operators can operate according to visible product objects, types and process step sequences, the labor intensity of the operators is reduced, the assembly precision is improved, the assembly error rate is reduced, and the application range is wide.

Description

Projection device and method for guiding airplane assembly
Technical Field
The invention relates to a projection device, in particular to a projection device and a projection method for guiding airplane assembly, and belongs to the technical field of airplane assembly.
Background
The assembly of the airplane is an important link for manufacturing the airplane, and the assembly accuracy of the airplane directly influences the service performance and the production interchangeability of the airplane. Aircraft assembly is the process of accurately positioning parts or assemblies relative to each other according to product specifications and assembling the parts or assemblies into components or products using prescribed joining methods. Aircraft assembly accounts for 50% -70% of the total labor of aircraft manufacturing.
At present, the assembly AO of aircraft assembly workshop adopts the paper media in a large number, and assembly operating personnel all need carry paper AO at every station during operation, and contained a large amount of information on the paper assembly AO: the method comprises the following steps of process instruction information, quality inspection information, production information and process information, wherein an operator needs to firstly look up the AO, find corresponding operation instructions and operate, and for a complex assembly process, an AO list is often more complex and the operator is extremely inconvenient to use. Meanwhile, due to the lack of visual assembly guide information, the phenomena of neglected installation and wrong installation are likely to occur when an operator installs the aircraft fastener, and then the aircraft fastener needs to be reassembled or repaired, so that the development period of the aircraft is influenced.
Disclosure of Invention
The invention aims to provide a projection device and a method for guiding aircraft assembly, which aim to solve the problems that the prior art lacks visual assembly guide information, and operators are likely to miss-assembly and mistaken-assembly when installing aircraft fasteners, and further need to be reassembled or repaired to influence the development cycle of the aircraft.
In order to achieve the purpose, the invention provides the following technical scheme: a projection arrangement for guiding aircraft assembly, includes vision measurement module and projection module, vision measurement module comprises two cameras, projection module includes a DLP projector.
As a preferred technical scheme of the invention, the distance between the two cameras is 300mm, the included angle of the axes of the cameras is 30 degrees, the DLP projector is arranged between the two cameras, and the included angle between the projection direction of the DLP projector and the installation plane is 6 degrees.
As a preferred technical solution of the present invention, the projection method includes the steps of:
s1: calibrating the vision measurement module and the projection module to obtain the parameters of the vision measurement module and the conversion relation between the parameters and the projection module;
s2: mounting a projection auxiliary tool on the assembly object, measuring the coordinates of the projection auxiliary tool by a vision measuring module, matching the coordinates with a theoretical model, and acquiring the conversion relation between the assembly object and a projection device;
s3: generating a projection image according to the theoretical model of the assembly object, the conversion relation between the theoretical model and the vision measurement module and the conversion relation between the vision measurement module and the projection module, and projecting the image to the surface of the assembly object by using a DLP (digital light processing) projector;
s4: and assembling by an assembling operator according to the guide information projected to the surface of the assembling object by the projection device.
In a preferred embodiment of the present invention, in the step S2, the number of the projection assistance tools is 4, and the projection assistance tools are installed in the hole feature of the assembly object.
As a preferred embodiment of the present invention, the projection image generated in step S3 includes fitting information of the hole.
As a preferred embodiment of the present invention, in step S3, the assembly information of the holes in the projection image includes an assembly object name, a serial number of the assembly holes, and a total number of the assembly holes, the holes with different apertures are set with different projection pattern colors, the projected patterns are dotted circles and lines, the dotted circles are distributed around the holes, and the lines cross the assembly holes.
As a preferred technical solution of the present invention, in step S3, the projected image is modified in real time according to the assembly process, after the assembly is completed, the vision measuring module collects the pattern at the corresponding position in real time, and changes the projected pattern according to the line feature change.
Compared with the prior art, the invention has the beneficial effects that:
1. the projection device and the method for guiding the aircraft assembly are high in flexibility, and data can be imported and projection images can be generated only through simple operation; the traditional auxiliary assembly tool and paper data are completely replaced, and the cost is greatly saved.
2. The projection device and the method for guiding the aircraft assembly have the advantages that the visualization effect is good, operators can operate according to visible product objects, types and process step sequences, the labor intensity of the operators is reduced, the assembly precision is improved, the assembly error rate is reduced, the application range is wide, the projection device and the method can be widely applied to the field of aircraft assembly and can be popularized to the field of automobile manufacturing.
Drawings
FIG. 1 is a schematic flow chart of steps of a projection method;
FIG. 2 is a schematic view of a projection apparatus;
FIG. 3 is a schematic view of the installation angle and distance of the camera;
FIG. 4 is a schematic view of a mounting angle of the projection module;
FIG. 5 projects image information;
FIG. 6 is a schematic view of a projected pattern of holes without fasteners;
FIG. 7 is a schematic view of a projected pattern change of installed fasteners at holes.
In the figure: 1. a camera; 2. DLP projector.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-3, the present invention provides a projection apparatus and method for guiding aircraft assembly, comprising: the utility model provides a projection arrangement for guiding aircraft assembly, includes vision measurement module and projection module, and vision measurement module comprises two cameras 1 for measure projection auxiliary fixtures, projection module include a DLP projecting apparatus 2, project the picture that will generate to the assembly object surface.
The distance between two cameras 1 is 300mm, and 1 axis contained angle of camera is 30 degrees, and DLP projecting apparatus installs in the middle of two cameras 1, and DLP projecting apparatus 2 throws the direction and is 6 with the mounting plane contained angle.
According to fig. 2 and 3, specifically, the distance between the two cameras 1 is 300mm, the DLP projector is installed between the two cameras 1, the included angle between the axes of the cameras 1 is 30 degrees, and the included angle between the projection direction of the DLP projector 2 and the installation plane is 6 degrees.
The projection method comprises the following steps:
s1: calibrating the vision measurement module and the projection module to obtain the parameters of the vision measurement module and the conversion relation between the parameters and the projection module;
s2: mounting a projection auxiliary tool on the assembly object, measuring the coordinates of the projection auxiliary tool by a vision measuring module, matching the coordinates with a theoretical model, and acquiring the conversion relation between the assembly object and a projection device;
s3: generating a projection image according to the theoretical model of the assembly object, the conversion relation between the theoretical model and the vision measurement module and the conversion relation between the vision measurement module and the projection module, and projecting the image to the surface of the assembly object by using a DLP (digital light processing) projector;
s4: and assembling by an assembling operator according to the guide information projected to the surface of the assembling object by the projection device.
In step S2, the number of the projection auxiliary tools is 4, and the projection auxiliary tools are installed in the hole features of the assembly object.
The projection image generated in step S3 includes fitting information of the hole.
In step S3, the assembly information of the holes in the projected image includes the name of the assembly object, the serial number of the assembly hole, and the total number of the assembly holes, the holes with different apertures are set with different projection pattern colors, the projected patterns are dotted circles and lines, the dotted circles are distributed around the holes, and the lines cross the assembly holes.
As shown in fig. 4, the assembly information of the holes in the projection image includes the name of the assembly object, the serial number of the assembly holes, and the total number of the assembly holes, the holes with different apertures are set with different projection pattern colors, the projected patterns are circles and lines, the circles are distributed around the holes, and the lines cross the assembly holes.
In step S3, the projected image is changed in real time according to the assembly process, after the assembly is completed, the vision measuring module collects the pattern at the corresponding position in real time, the projected pattern is changed according to the line feature change, after the assembly and the detection are completed, the highlight pattern at the corresponding position is changed, the dotted line circle is changed into a solid line circle, which indicates that the fastener is installed at the hole site, as shown in fig. 7, the color after the initial projection and the operation are completed can be set in software.
According to the embodiment shown in fig. 6 and 7, the projected image is changed in real time according to the assembly process, after the assembly is completed, the vision measuring module collects the patterns of the corresponding positions in real time, the projected patterns are changed according to the line characteristic changes, the lines before the assembly operation are projected to the surface of the assembly hole and have breakpoints after being collected and processed by the vision measuring module, and the lines have no breakpoints due to the existence of fasteners after the assembly.
When the projection device and the projection method are used specifically, the projection method is operated specifically as follows, firstly, calibration is carried out, a vision measuring module and a projection module are calibrated, parameters of the vision measuring module and a conversion relation between the parameters and the projection module are obtained, secondly, a projection auxiliary tool is installed on an assembly object, 4 projection auxiliary tools installed on the assembly object are installed in hole characteristics of the assembly object, in addition, in the practical application, in order to facilitate installation and guarantee the projection precision, the surface of the hole characteristic of the installation auxiliary tool is preferably a plane, then, the vision measuring module measures coordinates of the projection auxiliary tool and is matched with a theoretical model, and the conversion relation between the assembly object and the vision measuring module is obtained; thirdly, generating a projection image according to the theoretical model of the assembly object, the conversion relation between the theoretical model and the vision measurement module and the conversion relation between the vision measurement module and the projection module, wherein the assembly information of holes in the projection image comprises the name of the assembly object, the serial number of assembly holes and the total number of the assembly holes, different projection pattern colors are set for the holes with different apertures, the projected patterns are circles and lines, the circles are distributed around the holes, the lines cross the assembly holes, and the DLP projector 2 projects the image to the surface of the assembly object; fourthly, assembly operators assemble the assembly object according to the guide information projected to the surface of the assembly object by the projection device, projected images are changed in real time according to the assembly process, after assembly is completed, the vision measurement module collects patterns of corresponding positions in real time, the projected patterns are changed according to line characteristic changes, breakpoints exist after the lines are projected to the surface of the assembly hole before assembly operation and collected and processed by the vision measurement module, due to the fact that fasteners exist after assembly, the lines have no breakpoints, after assembly and detection are completed, highlight patterns of corresponding positions change, the broken line circles change into solid line circles to indicate that the fasteners are installed at the hole positions, and the colors after initial projection and operation are completed can be set in software.
In the description of the present invention, it is to be understood that the indicated orientations or positional relationships are based on the orientations or positional relationships shown in the drawings and are only for convenience in describing the present invention and simplifying the description, but are not intended to indicate or imply that the indicated devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and are not to be construed as limiting the present invention.
In the present invention, unless otherwise explicitly specified or limited, for example, it may be fixedly attached, detachably attached, or integrated; can be mechanically or electrically connected; the terms may be directly connected or indirectly connected through an intermediate, and may be communication between two elements or interaction relationship between two elements, unless otherwise specifically limited, and the specific meaning of the terms in the present invention will be understood by those skilled in the art according to specific situations.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims (7)

1. A projection device for guiding the assembly of an aircraft, comprising a vision measurement module and a projection module, characterized in that the vision measurement module consists of two cameras (1) and the projection module comprises one DLP projector (2).
2. A projection device for guiding aircraft assembly according to claim 1, characterized in that the distance between two cameras (1) is 300mm, the angle between the axes of the cameras (1) is 30 degrees, and the DLP projector is mounted in the middle of two cameras (1), the DLP projector (2) projection direction is 6 ° to the mounting plane.
3. A projection method for guiding aircraft assembly, said projection method comprising the steps of:
s1: calibrating the vision measurement module and the projection module to obtain the parameters of the vision measurement module and the conversion relation between the parameters and the projection module;
s2: mounting a projection auxiliary tool on the assembly object, measuring the coordinates of the projection auxiliary tool by a vision measuring module, matching the coordinates with a theoretical model, and acquiring the conversion relation between the assembly object and a projection device;
s3: generating a projection image according to the theoretical model of the assembly object, the conversion relation between the theoretical model and the vision measurement module and the conversion relation between the vision measurement module and the projection module, and projecting the image to the surface of the assembly object by using a DLP (digital light processing) projector;
s4: and assembling by an assembling operator according to the guide information projected to the surface of the assembling object by the projection device.
4. The projection method for guiding aircraft assembly according to claim 3, wherein the number of projection auxiliary tools in the step S2 is 4, and the projection auxiliary tools are installed in hole features of an assembly object.
5. A projection method for guiding aircraft assembly according to claim 3, wherein the projection image generated in step S3 includes assembly information of the hole.
6. A projection method for guiding aircraft assembly according to claim 3, wherein in step S3, the assembly information of the holes in the projected image includes the name of the assembly object, the serial number of the assembly holes, and the total number of the assembly holes, the holes with different diameters are set with different colors of the projected pattern, the projected pattern is a dashed circle and a line, the dashed circle is distributed around the holes, and the line crosses the assembly holes.
7. The projection method for guiding aircraft assembly according to claim 3, wherein in step S3, the projection image is modified in real time according to the assembly process, after the assembly is completed, the vision measuring module collects the pattern of the corresponding position in real time, and the projection pattern is modified according to the line feature change.
CN202010891673.6A 2020-08-31 2020-08-31 Projection device and method for guiding airplane assembly Pending CN112461207A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010891673.6A CN112461207A (en) 2020-08-31 2020-08-31 Projection device and method for guiding airplane assembly

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010891673.6A CN112461207A (en) 2020-08-31 2020-08-31 Projection device and method for guiding airplane assembly

Publications (1)

Publication Number Publication Date
CN112461207A true CN112461207A (en) 2021-03-09

Family

ID=74832933

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010891673.6A Pending CN112461207A (en) 2020-08-31 2020-08-31 Projection device and method for guiding airplane assembly

Country Status (1)

Country Link
CN (1) CN112461207A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113724321A (en) * 2021-07-08 2021-11-30 南京航空航天大学苏州研究院 Self-adaptive laser projection auxiliary assembly method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101336546A (en) * 2006-02-07 2008-12-31 夏普株式会社 Image projecting method and projector
CN103713457A (en) * 2013-12-12 2014-04-09 浙江大学 Geometrical correction device and method for 360-degree annular screen multi-projection system
CN106454291A (en) * 2015-08-07 2017-02-22 克里斯蒂数字系统美国有限公司 System and method for automatic alignment and projection mapping

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101336546A (en) * 2006-02-07 2008-12-31 夏普株式会社 Image projecting method and projector
CN103713457A (en) * 2013-12-12 2014-04-09 浙江大学 Geometrical correction device and method for 360-degree annular screen multi-projection system
CN106454291A (en) * 2015-08-07 2017-02-22 克里斯蒂数字系统美国有限公司 System and method for automatic alignment and projection mapping

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
周经纬: ""基于信息投影技术的辅助装配平台开发"", 《中国优秀硕士学位论文全文数据库 工程科技Ⅰ辑》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113724321A (en) * 2021-07-08 2021-11-30 南京航空航天大学苏州研究院 Self-adaptive laser projection auxiliary assembly method

Similar Documents

Publication Publication Date Title
CN108363508B (en) Mark positioning non-contact visual detection method for mobile phone touch screen
AU2012203199B2 (en) Projection aided feature measurement using uncalibrated camera
CN104913722B (en) A kind of car body controller connector pin normotopia degree detection method
CN108981677B (en) Method for mounting aircraft component based on laser positioning
CN111861147B (en) Digital detection method and system for whole process of manufacturing complex parts
CN112461207A (en) Projection device and method for guiding airplane assembly
CN113420363B (en) Method for predicting matching of skin skeleton of aircraft component
CN112828878B (en) Three-dimensional measurement and tracking method for large-scale equipment in butt joint process
CN111765843A (en) Laser measurement adapter
CN110044266B (en) Photogrammetry system based on speckle projection
CN114518081A (en) Supplementary subsides of unit class device concentricity pastes dress device
CN109175992B (en) Intelligent assembling platform for man-machine cooperation case based on AR technology
CN113478418B (en) Projector-based part clamping and dismounting method
CN113335553A (en) Airplane assembling and positioning method based on three-dimensional laser projection
CN110455499B (en) Imaging camera MTF testing device and method
KR20210102566A (en) Machine vision apparatus for installation of automobile door parts with precision compensation
CN105759196A (en) Automatic positioning initial workpiece circuit board detection system with compensation calibration function
CN105759559A (en) Movement control method for focusing dispensing device
CN114719751B (en) VR lens installation and calibration processing method and processing system on VR all-in-one machine
CN212332187U (en) Magnetic ring marking device
CN115229489A (en) Position adjusting device and method for mounting point of rack
CN115406352A (en) Large-scale barrel section pose measuring device and method based on machine vision
CN116061438B (en) Detection system and method for 3D printing repair of blade
CN215222603U (en) Configuration tool applied to mosaic equipment digital display meter
CN112461504B (en) VR lens consistency test-based method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210309