WO2003034318A1 - Procede et appareil d'utilisation d'images representationnelles dans des activites commerciales et analogues - Google Patents

Procede et appareil d'utilisation d'images representationnelles dans des activites commerciales et analogues Download PDF

Info

Publication number
WO2003034318A1
WO2003034318A1 PCT/US2001/046711 US0146711W WO03034318A1 WO 2003034318 A1 WO2003034318 A1 WO 2003034318A1 US 0146711 W US0146711 W US 0146711W WO 03034318 A1 WO03034318 A1 WO 03034318A1
Authority
WO
WIPO (PCT)
Prior art keywords
representational
image
representational image
information
manufactured object
Prior art date
Application number
PCT/US2001/046711
Other languages
English (en)
Inventor
Ronald R. Erickson
Eliezer D. Sandler
Joel N. Bock
Original Assignee
Polydimension, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Polydimension, Inc. filed Critical Polydimension, Inc.
Publication of WO2003034318A1 publication Critical patent/WO2003034318A1/fr

Links

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22—Processes or apparatus for obtaining an optical image from holograms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/26—Processes or apparatus specially adapted to produce multiple sub- holograms or to obtain images from them, e.g. multicolour technique
    • G03H1/2645—Multiplexing processes, e.g. aperture, shift, or wavefront multiplexing
    • G03H1/265—Angle multiplexing; Multichannel holograms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22—Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2249—Holobject properties
    • G03H2001/2284—Superimposing the holobject with other visual information
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/31—From computer integrated manufacturing till monitoring
    • G05B2219/31047—Display image of finished workpiece on screen, show how, where to mount next part
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present invention relates to a method for creating and using representational images, including holographic representational images in various activities, including industrial processes, manufacturing and quality control/quality assurance.
  • representational images, including holographic representational images may be used to enhance accurate analysis, facilitate improved assembly, implementation and quality, and reduce error and misinterpretation.
  • Representational images are very useful as a tool for visual guidance during a wide range of activities involved in industry, including, for example, manufacturing, product development, strategic planning, change implementation and verification and quality assurance and control.
  • Representational images may range, for example, from schematic diagrams of electronic circuits or construction blueprints to fabric cutting diagrams, component layout and placement, and images on surfaces.
  • the representational image used during a manual assembly operation is a schematic diagram which guides the operator and which is used to confirm the proper assembly operation for the workpiece.
  • These schematic diagrams must be placed within the visual range of the operator, and are usually posted directly in front of the operator. However, the position of the schematic diagram requires the operator to look away from the object being assembled to ascertain the proper step. After many repetitions of the same operation, operators usually commit the diagram to memory and rely on their memory to ensure the correctness of their activity, or they become familiar with the assembly step and no longer require a visual check of the schematic diagram to confirm proper assembly.
  • the present invention provides a method for creating and using representational images, including holographic representational images, and an apparatus for using representational images, to increase efficiency, reduce costs, and provide greater amounts of information for a variety of tasks and analysis across many different sectors of the workplace and the home.
  • the representational images described herein may be used as a Two or Three Dimensional Visual Template (2DVT or 3DVT) type of representational image presented in superimposition with the object to be manufactured.
  • the 2DVT and 3DVT superimpose the visual image of the task specific information onto the workpiece, for example, the workpiece as it will appear on completion of that particular step in the manufacturing process, onto the workpiece from the previous step(s). Additionally, the 3DVT places the visual image in exact register, including depth, with the workpiece.
  • the 2DVT utilizes the superimposed image to capture in 2-D the visual image of its subject, and the 3DVT utilizes the unique properties of a hologram to capture in full 3-D, including depth, the visual image of its subject.
  • the 2DVT and 3DVT will enable the worker to clearly see the precise location or path, for example, of the component that is to be added to the object to be manufactured at that point in the manufacturing process.
  • the 2DVT and 3DVT also allow for clear and effective visual emphasis or instruction regarding the step to be accomplished without the risk of translational errors, language impediments, learning curves or other problems associated with operator fatigue and training.
  • a representational image may be created by hand, using conventional photography or by computer aided design. These representational images can be superimposed onto a workpiece where a simple two-dimensional representational image (2DRI) is sufficient for the operation being contemplated, such as, for example, component assembly, painting, the cutting of fabric or the location of a bend or cut in a workpiece.
  • 2DRI simple two-dimensional representational image
  • the superimposition of these representational images may be accomplished, using, for example, a slide or computer image projector, an overhead projector, a high intensity computer display, an optical combiner, a prismatic screen, a splitter, or some other form of image projection or display, including using a computer controlled display, such as, for example, a liquid crystal display (LCD), a plasma display, a light emitting diode (LED) display, spacial light modulator, fiber optics, or any other display that can either project an image onto or superimpose an image with an object (actually or virtually) using a light or other visible energy source, or allow light to pass through for projecting or superimposing an image of the displayed information directly or indirectly, thereby causing a superimposition of the image and the object.
  • a computer controlled display such as, for example, a liquid crystal display (LCD), a plasma display, a light emitting diode (LED) display, spacial light modulator, fiber optics, or any other display that can either project an image onto or superimpose an
  • the representational images may also be created or prepared in one location and digitized and transmitted to a remote location, for example, via the internet, a LAN, WAN or other intranet, or via a storage medium, such as, for example, CD-ROM, DVD, optical, magnetic, electronic or some other form of currently known or future developed storage media or transmission method or medium.
  • a storage medium such as, for example, CD-ROM, DVD, optical, magnetic, electronic or some other form of currently known or future developed storage media or transmission method or medium.
  • a 2DRI including an outline of the image or of the preprinted materials may be projected onto or superimposed with the surface, thereby simplifying the task for the operator and allowing the application or painting to be accomplished quickly and efficiently, and with fewer errors.
  • a two dimensional representational image may be projected onto or superimposed with the surface using a holographic optical element (HOE) to affect the necessary curvature of the representational image on the surface.
  • HOE holographic optical element
  • an optical combiner interposed between the operator and the workpiece may be used.
  • one type of optical combiner that can be used is a clear glass sheet that can be partially silvered such that some of the light (from the first object, the workpiece) passes straight through the combiner to reach the operator's eyes; while the light from a second object (a projector, or computer display projecting the 2DRI, which may be positioned at 90 degrees to the workpiece) is reflected off of the combiner to also reach the operator's eyes.
  • a second object a projector, or computer display projecting the 2DRI, which may be positioned at 90 degrees to the workpiece
  • a holographic representational image may be utilized.
  • a holographic representational image may be created using a variety of holographic techniques, including traditional holographic techniques, and and the technique described in U.S. Patent No. 5,748,347 ("V-3DTM").
  • the HRI is created in a manner in which it can be integrated into the task or analysis that is to be accomplished, in most instances with the imagery superimposed with the workpiece.
  • the task or analysis is then performed in a manner whereby the HRI and the information contained therein are used to improve the efficiency and effectiveness of the task and/or analysis being done, for example, by using the image to identify or verify the location or position of a part or component.
  • a two dimensional representational image (2DRI) or a holographic representational image (HRI) of an object to be manufactured may be created.
  • the number of 2DRIs or HRIs used for a manufacturing process may depend, for example, on the number of stages in the manufacturing process, i.e., the number of workstations or assembly points in the manufacturing line, and/or the number of steps or tasks accomplished at each workstation or assembly point.
  • multiple 2DRIs or HRIs may be created using any of the various known techniques or techniques described herein, such as, for example, holographic techniques, including traditional holographic techniques and V-3DTM .
  • Each 2DRI or HRI created corresponds to a particular stage and step or stages and/or steps of the manufacturing process.
  • each stage or stages of the manufacturing process may be represented by one or more separate 2DRIs or HRIs that include information that correspond to the step or task, or steps or tasks to be accomplished at that stage or those stages of the manufacturing process.
  • single HRIs For a single or multiple stage manufacturing process having multiple steps or tasks at a single workstation or assembly point, or at multiple workstations or assembly points, single HRIs, multiple HRIs, compound HRIs, or any combinations thereof may be used.
  • 2DRIs, multiple 2DRIs or compound 2DRIs may be used, any combinations thereof or any combinations of HRIs and 2DRIs.
  • the type of 2DRI or HRI used may vary depending on the number and types of steps or tasks to be accomplished.
  • Single HRIs are HRIs having one image contained therein.
  • Multiple HRIs is a group of single HRIs, each representing one of multiple steps performed at a single stage or multiple stages of the manufacturing process.
  • multiple 2DRIs is a group of single 2DRIs, each representing one of multiple steps performed at a single stage or multiple stages of the manufacturing process.
  • a compound HRI is a single HRI containing multiple images.
  • a compound 2DRI is a single 2DRI containing multiple images. Compound HRIs and 2DRIs will be described in greater detail below.
  • one or more pieces of information may be included in the HRI or 2DRI. For example, if there are three components that are to be added to the product being manufactured at a single stage or assembly point, the locations of one or more of these three components in the product to be manufactured may be indicated in a single HRI or 2DRI. The operator must be able to distinguish between these three components to accomplish the steps or tasks effectively.
  • a single piece of information or multiple pieces of information may be included in each of the HRIs or 2DRIs. For example, if there are four components to be added to a product being manufactured at a particular stage of the manufacturing process, the location of a single component may be indicated in a single HRI or 2DRI, thus requiring four separate HRIs or 2DRIs to provide the information regarding the four components necessary to complete this stage of the manufacturing process. Using the four HRIs or 2DRIs, this stage of the manufacturing process would be accomplished in four steps.
  • each of the four components may be indicated in a single HRI or 2DRI, thus requiring a single HRI or 2DRI to accomplish the four steps or tasks included in this stage of the manufacturing process.
  • Another option is to combine HRIs and/or 2DRIs having single and/or multiple pieces of information to accomplish the steps or tasks required at the particular stage of the manufacturing process. For example, if there are four components to be added to the product being manufactured at a particular stage of the manufacturing process, the location of a first component may be indicated in a single HRI or 2DRI and the location of the three other components may be indicated in a separate HRI or 2DRI. This combination of HRIs and/or 2DRIs containing different amounts of information would require the use of only two HRIs and/or 2DRIs to accomplish the steps or tasks necessary for that stage of the manufacturing process.
  • a manufacturing process can use multiple 2DRIs or HRIs by switching between each of the single 2DRIs and/or HRIs. This can be done mechanically, such as, for example, by rotating a positioning device in which each of the 2DRIs or HRIs is positioned or by moving the object to be manufactured, or electronically, such as, for example, by utilizing computer generated 2DRIs and switching between the computer generated 2DRIs. There are many other ways to accomplish such switching.
  • a compound HRI is a single HRI having multiple sets of information contained therein.
  • a compound 2DRI is a single 2DRI having multiple sets of information contained therein.
  • Each of the sets of information contained in a compound HRI or 2DRI may be accessible in a number of different ways, including, for example, by viewing the HRI or 2DRI at different angles or positions, by viewing the HRI or 2DRI under lights of different wavelengths, by viewing the HRI or 2DRI from different distances, by placing the HRI or 2DRI at different distances from the workpiece, and by illuminating the HRI or 2DRI at different angles.
  • a compound HRI can be created using the V-3DTM process or conventional holography.
  • a compound 2DRI can be created using conventional photography, printing, or using a computer controlled display, such as, for example, a liquid crystal display (LCD), a plasma display, a light emitting diode (LED) display, spacial light modulator, fiber optics, or any other display that can either project or superimpose an image using a light or other visible energy source, or allow light to pass through for projecting or superimposing an image of the displayed information.
  • a computer controlled display such as, for example, a liquid crystal display (LCD), a plasma display, a light emitting diode (LED) display, spacial light modulator, fiber optics, or any other display that can either project or superimpose an image using a light or other visible energy source, or allow light to pass through for projecting or superimposing an image of the displayed information.
  • a compound 2DRI using a single transparency may be created in a number of different ways.
  • the two dimensional information may first be scan analyzed into the necessary sub-components, for example, vertical or horizontal stripes. These sub-components are correlated with one or more lenticulated lens elements.
  • the sub-components from a first set of two dimensional information can then be interposed with the sub-components from a second set (or more sets) of two dimensional information in a fixed relationship.
  • the resulting series of sub-components for example, stripes, are situated in a predetermined spatial relationship to the lenticulated lens/filter, for example, by laminating or printing the stripes in register with the lenticulated lens/filter.
  • the resulting compound 2DRI will present each of the sets of two-dimensional information, for example, images, to the projection optics (which can be similar to that from a slide projector) when the lenticulated side of the 2DRI is illuminated from a particular off-axis angle.
  • the sub-components may be correlated woth one or more polarizing filter.
  • Each set of 2-D information will be presented upon illumination by light having the corresponding polarization.
  • a compound 2DRI using a single transparency may also be created using color separation techniques, for example, by providing the representation of each set of two dimensional information in a different color or corresponding to a different wavelength of light.
  • the projection optics would then present each of the sets of two-dimensional information using a light source of a different color or wavelength, for example, by using colored filters.
  • the 2DRIs and/or HRIs must be physically arranged so that the information contained in the 2DRIs and/or HRIs, for example, information regarding the location of a specific component to be inserted during the manufacturing process or the location, position, or shape of a cut or bend, may be utilized by the operators at the various stages of the manufacturing process. This may be accomplished by removably positioning each of the 2DRIs and/or HRIs at their corresponding stages of the manufacturing process in fixed or adjustable relation to the location of the object to be manufactured. The object to be manufactured is placed in a predetermined position, which may be fixed or adjustable by the operator.
  • the 2DRI or HRI is then coupled to, or positioned on or in a mounting or positioning device, which is either fixed or adjustable, at some predetermined or adjustable distance from the object to be manufactured.
  • a light source is then positioned in such a way that the information contained in the 2DRI or HRI may be utilized by an operator, for example, by projecting or superimposing the 2DRI or HRI information onto or with the object to be manufactured, directly or indirectly, such that the 2DRI or HRI information and the object are superimposed, i.e., they overlap, and for the HRI they are substantially in register or near register in all three dimensions, including depth.
  • the 2DRI or HRI information is available to the operator, for example, by being projected onto or superimposed with the object to be manufactured, thereby clearly indicating to the operator the required task, for example, the location of the component to be inserted or the location, position or shape of a cut or bend.
  • the manufacturing process will include a new source of information for the operators that will provide improved guidance, for example, through the use of a Two or Three Dimensional Visual Template (2DVT or 3DVT) type of representational image presented in superimposition with the object to be manufactured.
  • This 2DVT or 3DVT representational image can be used by the operator to identify the task to be performed, for example, the location of the component on the object being manufactured or the position or shape of a cut or bend.
  • the 2DVT utilizes the projected or superimposed image to capture in 2-D the visual image of its subject
  • the 3DVT utilizes the unique properties of the hologram to capture in full 3-D, including depth, the visual image of its subject.
  • a single 2DRI or HRI may be used for a single step or task, thereby requiring multiple 2DRIs or HRIs to be used to accomplish the necessary steps or tasks at a particular stage of the manufacturing process.
  • the operator is provided access to the information contained in each 2DRI or HRI and is able to cycle or switch between each of the multiple 2DRIs and/or HRIs that are utilized.
  • the various 2DRIs and/or HRIs may be coupled to, or positioned on or in a mounting or positioning device, which is either fixed or adjustable, at some predetermined or adjustable distance from the object to be manufactured, in planar fashion.
  • the various 2DRIs and HRIs can be moved into a position from which the information from the 2DRI or HRI can become substantially in register with the object to be manufactured.
  • a light source is positioned as described above in a manner that will allow the information contained in the 2DRI or HRI to be utilized by an operator, for example, by projecting or superimposing the 2DRI or HRI information onto or with the object to be manufactured such that the projected or superimposed 2DRI or HRI information and the object are substantially in register or near register.
  • the apparatus may be rotated so as to move the next 2DRI or HRI into the proper position for the next operation.
  • the different sets of information contained in the compound HRI may be accessible by viewing the HRI at different angles or from different positions. This may be accomplished by placing the HRI in an adjustable positioning device.
  • the positioning device may be adjustable by fixed or variable increments.
  • the HRI may then be repositioned, for example, by moving the HRI horizontally, vertically, diagonally or a combination thereof.
  • the HRI is then illuminated again to allow the operator to access the next set of information. This process is continued until all of the information contained in the HRI necessary for the operator to accomplish each required step or task is accessed.
  • the different sets of information contained in a compound 2DRI may be accessible by illuminating the 2DRI from different angles either by moving the 2DRI or the light source as described above. This may be accomplished by placing the 2DRI in an adjustable positioning device as described above for the HRI.
  • Accessing the various sets of information in a compound 2DRI or HRI may also be accomplished by viewing the 2DRI or HRI under lights of different wavelengths.
  • First the 2DRI or HRI is placed in a positioning device, as described above.
  • the 2DRI or HRI is then illuminated using a light source of a first predetermined wavelength. This allows the operator to access the first set of information contained in the 2DRI or HRI.
  • the 2DRI or HRI is illuminated using a light source of a second predetermined wavelength. This process is continued until all of the information contained in the 2DRI or HRI necessary for the operator to accomplish each required step or task is accessed.
  • Accessing the various sets of information in a compound 2DRI or HRI may also be accomplished by viewing the 2DRI or HRI from different distances.
  • First the HRI is placed in a positioning device, as described above.
  • the 2DRI or HRI is adjusted to a position at a first predetermined distance from the plane of the object to be manufactured, i.e., a first predetermined focal point. This allows the operator to access the first set of information contained in the 2DRI or HRI.
  • the 2DRI or HRI is then repositioned, for example, by moving the 2DRI or HRI toward or away from the object to be manufactured, i.e., to a second predetermined focal point.
  • the 2DRI or HRI is then illuminated again to allow the operator to access the next set of information. This process is continued until all of the information contained in the 2DRI or HRI necessary for the operator to accomplish each required step or task is accessed.
  • the various sets of information contained in a compound 2DRI or HRI may be accessible by viewing the 2DRI or HRI from different distances from the plane of the 2DRI or HRI, or by moving the object to be manufactured toward or away from the 2DRI or HRI. To provide for this type of viewing, the 2DRI and HRI must be created with the different sets of information at different distances or focal points from its surface, with a corresponding change in the light source distance or projection optics.
  • Accessing the various sets of information in a compound 2DRI or HRI may also be accomplished by illuminating the 2DRI or HRI at different angles. This may be accomplished by placing the 2DRI or HRI in a positioning device.
  • the light source used to illuminate the 2DRI or HRI may be adjustable by fixed or variable increments or multiple adjustable light sources may be used. The light source is placed in a first predetermined position, or a first light source (located at a first predetermined position) may be used.
  • the 2DRI or HRI is then illuminated allowing the operator to access the first set of information located therein.
  • the light source may then be repositioned, for example, by moving the light source horizontally, vertically, diagonally or a combination thereof, or a second light source may be used.
  • the 2DRI or HRI may be repositioned.
  • the 2DRI or HRI is then illuminated again to allow the operator to access the next set of information. This process is continued until all of the information contained in the 2DRI or HRI necessary for the operator to accomplish each required step or task is accessed.
  • a multiple stage manufacturing process may be consolidated into a single physical stage and/or numerous steps of a manufacturing process may be consolidated so as to be accomplished by a single operator, thereby reducing the physical size of the manufacturing line and reducing the number of operators.
  • the time required for training may also be reduced, for example, because all of the tasks to be accomplished will be viewable as a projected or superimposed image on the workpiece, which will serve as a template for the operator.
  • the quality assurance (QA) and quality control (QC) processes may also be enhanced and improved using 2DRIs and/or HRIs.
  • 2DRIs and/or HRIs instead of a manual QA/QC review by an inspector who must identify every component in the object being manufactured and verify the accurate placement of each component, usually by reference to a schematic or model, the QA/QC review can be made using a 2DRI or HRI.
  • Using a 2DRI or HRI allows the comparison of the finished workpiece to the model or schematic to be accomplished using a projected or superimposed image of the desired final product with all of the necessary components.
  • the QA QC inspection process may become partially or even fully automated. After all of the manufacturing steps have been completed, the finished product may be sent to another station. At this station, the QA/QC review is begun.
  • a 2DRI or HRI is positioned in fixed or adjustable relation to the finished product.
  • the information contained in the 2DRI or HRI is projected or superimposed onto the finished product.
  • An inspector or an automated detection device such as, for example, a machine vision system, or both, view the finished product with the projected or superimposed 2DRI or HRI information and make a determination as to whether the finished product has passed inspection. If the finished product does not pass inspection, the inspector and/or the automated detection device will then be able to identify the specific items that caused the failed inspection.
  • a compound 2DRI or HRI can be used in place of a single 2DRI or HRI, respectively, by using one of the processes described above to project or superimpose, in succession, the various sets of information contained in the compound 2DRI or HRI onto the finished product for a QA/QC inspection.
  • each of the sub-assembly images could be superimposed on the work piece in quick succession to confirm that each element that was to be added in the production line is in place and in the correct location.
  • Such inspection could identify faulty pieces instantly, as well as which workstation would need to do the revision on the piece to achieve Zero Defects.
  • the 2DRI and/or HRI can be used in conjunction with a machine vision system to effectively take over a portion of the QA/QC inspection.
  • the machine vision system would detect errors in a workpiece by a comparison of the workpiece to the image of the correct object as projected or superimposed by the 2DRI or HRI. The machine vision system could then identify whether any errors exist and any necessary revisions.
  • the machine vision system could also compile information about the manufacturing assembly line, for example, relating to which steps and/or workers exhibit above average or above normal error rates.
  • the language free aspect of the present invention is also significant considering the expanding use of a multinational workforce and overseas manufacturing, and the cost savings associated with centralizing any training operations. Additionally, with the use of low cost labor, there is often a language issue since quite often English is the first the language of the management and training department, while the first language of such labor force is not English.
  • Figures 1(a) and 1(b) show a top view and a side view (along a plane defined by points a - a), respectively, of a positioning and setup operation according to an embodiment of the present invention.
  • Figure 2 shows a flow diagram of an assembly operation according to an embodiment of the present invention.
  • Figures 3(a) and 3(b) show positions for a sub-frame according to an embodiment of the present invention.
  • Figure 4 shows a quality control/quality assurance procedure according to an embodiment of the present invention.
  • Figure 5 shows a quality control/quality assurance procedure utilizing a compound HRI, according to an embodiment of the present invention.
  • Figures 6(a) and 6(b) show a top view and a side view (along a plane defined by points a - a), respectively, of a positioning and setup operation according to an embodiment of the present invention.
  • Figure 7 shows a flow diagram of an assembly operation according to an embodiment of the present invention.
  • Figures 8(a) and 8(b) show positions for the sub-frame when a compound HRI is used according to an embodiment of the present invention.
  • FIGs. 1(a) and 1(b) there is shown a top view and a side view (along a plane defined by points a - a), respectively, of a positioning and setup operation according to an embodiment of the present invention.
  • Figs. 1(a) and 1(b) show a manufacturing assembly line 1 where an operator 3 at a step 5 of the manufacturing process is working on the assembly of a product. The product is assembled using a sub-frame 7 and a number of components. At this step 5 of the manufacturing process, the operator 3 is responsible for the insertion and connection of a component 9 onto the sub-frame 7. Before any assembly is performed, an HRI 1 1 is created using traditional holographic techniques. Alternatively, HRI 11 could be a 2DRI.
  • the information contained in the HRI 11 includes a representational image of the sub-frame 7 having the same shape, dimensions and physical structure as the actual sub-frame 7 when viewed in its proper position of assembly at step 5 of the manufacturing process.
  • the HRI 1 1 also includes a representational image of the component 9 that is to be added during step 5 in its proper position of assembly.
  • the HRI 11 is positioned on or in an adjustable frame 13 that is coupled to the work area adjacent to the operator 3.
  • the adjustable frame 13 may be positioned using a first positioning device 15 or a second positioning device 17, which may be, for example, a rotating knob or lever connected to a mechanical gear or mechanism, a mechanical assembly, or an electronic switch connected to a motor.
  • both the first positioning device 15 and the second positioning device 17 may be used to position the adjustable frame 13 or additional positioning devices may be used.
  • the sub-frame 7 is positioned in correlation to the HRI 1 1. Prior to adjusting the position of the adjustable frame 13, the HRI 11 is illuminated by light source 21. Upon illumination of the HRI 1 1 by light source 21, the representational image stored in the HRI 1 1, including the holographic 3-dimensional image of the sub-frame 7 and the component 9, is superimposed with the actual sub-frame 7.
  • the adjustable frame 13 is then adjusted using one or both of the first positioning device 15 and the second positioning device 17, until the representational image presented by the HRI 11 is substantially in or near register with and appears to overlap the actual sub-frame 7.
  • the first positioning device 15 and the second positioning device 17 may then be fixed in position.
  • the sub-frame 7 may be adjusted until the representational image presented by the HRI 1 1 is substantially in or near register with and appears to overlap the actual sub-frame 7.
  • each sub-frame 7 is moved into position at step 5 of the manufacturing assembly line 1.
  • step 23 where the HRI 1 1 is illuminated by the light source 21.
  • the representational image stored in the HRI 11 including a holographic 3-dimensional image of the sub-frame 7 and the component 9, is superimposed with the actual sub-frame 7.
  • a next step 24 the operator 3 performs an assembly operation by placing the component 9 in the location corresponding to that indicated by the presented image of the component 9 with sub-frame 7.
  • the sub- frame is moved to the next step of the manufacturing assembly line 1, where further assembly may be accomplished.
  • the same operations as described above may be implemented for the next and any other stages of the manufacturing assembly line 1 as desired.
  • Figs. 3(a) and 3(b) there is shown a position for the sub-frame according to an embodiment of the present invention. Alternatively, as shown in Fig.
  • the sub-frame 7 may be positioned such that side 30, which is located furthest from the operator 3, is raised with respect to side 32, which is located nearest the operator 3.
  • the sub-frame 7 may be positioned on a plane parallel to the plane on which the HRI 1 1 is positioned.
  • the sub-frame 7 may be positioned in or on an adjustable device 33, whereby the position of the sub-frame 7 may be adjusted relative to the HRI 11 using one or more of positioning devices 35.
  • a quality control/quality assurance procedure Upon completion of the assembly of the components on the sub-frame 7, the sub-frame 7 is moved to a quality control location 40.
  • a plurality of HRIs 42 corresponding to the number of steps in the manufacturing assembly line 1, are adjustably (or fixedly) positioned in a fixed or adjustable frame 44.
  • a compound HRI containing all or some of the information corresponding to the steps of the manufacturing assembly line 1, or any number of HRIs may be used.
  • Each HRI 42 includes a representational image of a single component or a plurality of components in its or their proper location(s) on the sub-frame 7.
  • the frame 44 may be adjusted so that upon illumination of the HRI 42(a) by light source 48, the representational image stored in the HRI 42(a), including the holographic 3- dimensional image of the sub-frame 7 and a single component or plurality of components, is superimposed with the actual sub-frame 7.
  • the frame 44 is then adjusted, if necessary, using one or both of a first positioning device 50 and a second positioning device 52, until the holographic representational image presented by the HRI 42(a) is substantially in or near register with and appears to overlap the actual sub-frame 7.
  • the first positioning device 50 and the second positioning device 52 may then be fixed in position.
  • the HRIs 42 are then alternated such that each is positioned in correlation to sub-frame 7 in assessment position 46, illuminated by light source 48 and assessed to determine if assembly was performed properly.
  • a 2DRI, multiple 2DRIs or a compound 2DRI may be used in place of HRIs 42.
  • Fig. 5 there is shown a quality control/quality assurance procedure utilizing a compound HRI, according to an embodiment of the present invention.
  • a compound HRI 60 may be used which contains some or all of the information contained in each or some of the HRIs 42.
  • the compound HRI 60 is adjustably (or fixedly) positioned in a fixed or adjustable frame 62.
  • the compound HRI 60 includes a plurality of representational images, each of a single component or a plurality of components in its or their proper location(s) on the sub-frame 7.
  • the sub-frame 7, which is located in an assessment position 46, is positioned in correlation to compound HRI 60.
  • the frame 62 may be adjusted so that upon illumination of the compound HRI 60 by a first light source 64, a first representational image of three-dimensional information stored in the compound HRI 60, including the holographic three-dimensional image of the sub-frame 7 and a single component or plurality of components, is superimposed with the actual sub-frame 7.
  • the frame 62 is then adjusted, if necessary, using one or both of a first positioning device 66 and a second positioning device 68, until the first representational image presented by the compound HRI 60 is substantially in or near register with and appears to overlap the actual sub-frame 7.
  • the first positioning device 66 and the second positioning device 68 may then be fixed in position.
  • a compound 2DRI may be used in place of compound HRI 60.
  • the sub-frame 7 When assessing the assembly of a product, the sub-frame 7 is positioned in assessment position 46 the compound HRI 60 in frame 62 is illuminated using the first light source 64 to present a first representational image of three-dimensional information stored in the compound HRI 60, including the holographic three-dimensional image of the sub-frame 7 and a single component or plurality of components, with the sub-frame 7 for assessing the assembly of a first component 70, or any number of components.
  • the assessment may be accomplished by human review or by review using an autonated detection device, such as, for example, a machine vision system.
  • the first assessment includes a comparison of the superimposed first representational image to the first component 70 on the sub-frame 7 to determine if there is uniformity.
  • the compound HRI 60 is then illuminated by a second light source 72.
  • a second representational image of three-dimensional information stored in the compound HRI 60 including the holographic three-dimensional image of the sub-frame 7 and a single component or plurality of components, is superimposed with the actual sub-frame 7 for assessing the assembly of a second component 74, or any number of components.
  • the assessment may be accomplished by human review or by review using an automated detection device.
  • the second assessment includes a comparison of the superimposed second representational image to the second component 74 on the sub-frame 7 to determine if there is uniformity.
  • steps are repeated for as many representational images as desired, for example, as many as are included in the compound HRI 60 or in the product, each time using a different light source, and until an assessment has been made of the assembly of all or a selected number of the components.
  • a new light source is used to illuminate the compound HRI 60 and present a new representational image of three-dimensional information stored on the compound HRI 60.
  • FIGs. 6(a) and 6(b) which for all identical components utilize the numbering from Figs. 1(a) and 1(b)
  • Figs. 6(a) and 6(b) show a manufacturing assembly line 1 , where an operator 3 at a station 80 of the manufacturing process is working on the assembly of a product.
  • the product is assembled using a sub-frame 7 and a number of components.
  • the operator 3 is responsible for the performance of a number of steps of the assembly, including the insertion and connection of a plurality of components onto the sub-frame 7.
  • a compound HRI 82 is created using V-3DTM techniques as described in U.S. Patent No. 5,748,347.
  • the information contained in the compound HRI 82 includes a plurality of representational images of the sub-frame 7 having the same shape, dimensions and physical structure as the actual sub-frame 7 when viewed in its proper position of assembly at station 80 of the manufacturing process.
  • the compound HRI 82 also includes representational images of the components that are to be added during a plurality of steps performed at station 80 in their proper positions of assembly. Once created, the compound HRI 82 is positioned on or in an adjustable frame 13 that is coupled to the work area adjacent to the operator 3.
  • the adjustable frame 13 may be positioned using a first positioning device 15 or a second positioning device 17, which may be, for example, a rotating knob or a lever connected to a mechanical gear or mechanism, a mechanical assembly, or an electronic switch connected to a motor.
  • a first positioning device 15 or a second positioning device 17 may be, for example, a rotating knob or a lever connected to a mechanical gear or mechanism, a mechanical assembly, or an electronic switch connected to a motor.
  • both the first positioning device 15 and the second positioning device 17 may be used to position the adjustable frame 13.
  • the sub-frame 7 is positioned in correlation to the compound HRI 82.
  • the compound HRI 82 Prior to adjusting the position of the adjustable frame 13, the compound HRI 82 is illuminated by a first light source 84. Upon illumination of the compound HRI 82 by the first light source 84, a first representational image stored in the compound HRI 82, including a holographic 3-dimensional image of the sub-frame 7 and a first component 86, is superimposed with the actual sub-frame 7. Once the first representational image contained in the compound HRI 82 is superimposed with the actual sub-frame 7, the adjustable frame 13 is then adjusted using one or both of the first positioning device 15 and the second positioning device 17, until the first representational image presented by the compound HRI 82 is substantially in or near register with and appears to overlap the actual sub-frame 7. The first positioning device 15 and the second positioning device 17 may then be fixed in position. Alternatively, a compound 2DRI may be used in place of compound HRI 82.
  • each sub-frame 7 is moved into position at station 80.
  • the compound HRI 82 is illuminated by a first light source 84.
  • a first representational image stored in the compound HRI 82 including a holographic 3- dimensional image of the sub-frame 7 and a first component 86, is superimposed with the actual sub-frame 7.
  • step 95 the operator 3 performs a first assembly operation by placing the first component 86 in the location corresponding to that indicated by the superimposed image of the first component 86 with sub-frame 7.
  • step 96 the first light source 84 is removed and compound HRI 82 is then illuminated by a second light source 88.
  • a second representational image stored in the compound HRI 82 including a holographic 3-dimensional image of the sub-frame 7 and a second component 90, is superimposed with the actual sub-frame 7.
  • step 97 the operator 3 performs a second assembly operation by placing the second component 90 in the location corresponding to that indicated by the superimposed image of the second component 90 with sub-frame 7.
  • steps 98 For each representational image a different light source is used to illuminate the compound HRI 82.
  • step 98 the sub-frame 7 is moved to a new station on the manufacturing assembly line 1 and these operations may be repeated.
  • the QC/QA process may be performed as described with reference to Fig. 5, or alternatively, the QC/QA process may be integrated with the assembly process as described above with respect to Fig. 6.
  • An integrated QC/QA process may be accomplished using the representational images stored in the compound HRI 82.
  • the compound HRI 82 In addition to the information included in each representational image contained in the compound HRI 82, i.e., a holographic 3-dimensional image of the sub-frame 7 and the first component 86, as described above, the compound HRI 82 must also include the component or components from the prior assembly step or steps of the manufacturing assembly line 1. Each step of the manufacturing assembly line 1 can check the assembly from the prior step or from any number of prior steps.
  • the representational image for the second step in the compound HRI 82 would include a holographic 3-dimensional image of the sub-frame 7, the first component 86, and the second component 90.
  • the second component 90 would be included for the purposes of assembly and the first component 86 would be included for the purposes of QC/QA assessment.
  • the operator 3 viewing the actual sub-frame 7 would be able to assess whether the assembly from the prior step was performed properly by comparing the 3-dimensional image of first component 86 to the actual first component 86. If they are substantially superimposed one with the other, then the prior assembly step has passed inspection, and if not then the sub-frame 7 may be sent for rework.
  • each step of the manufacturing assembly line 1 incorporates a QC/QA inspection of the assembly performed at all prior steps
  • the representational image for each step in the compound HRI 82 would include a holographic 3-dimensional image of the sub-frame 7, the component currently being assembled, and all components from all prior assembly steps.
  • assembly step 95 is the third assembly step of the manufacturing assembly line 1
  • the representational image contained in the compound HRI 82 for assembly step 95 would include a holographic 3-dimensional image of the sub-frame 7, component 86 and the components assembled during the two prior steps.
  • the operator 3 viewing the actual sub-frame 7 would be able to assess whether the assembly from the prior step was performed properly by comparing the 3-dimensional image of component 86 to the actual component 86. If they are substantially superimposed one with the other, then the prior assembly step has passed inspection, and if not then the sub-frame 7 may be sent for rework.
  • step 5 was the fourth step of the manufacturing assembly line 1
  • the representational image contained in HRI 11 would include a 3-dimensional image of the sub-frame 7, component 9 and the components assembled during the three prior steps.
  • the operator 3 viewing the actual sub-frame 7 would be able to assess whether the assembly from the prior step was performed properly by comparing the 3-dimensional image of component 9 to the actual component 9. If they are substantially superimposed one with the other, then the prior assembly step has passed inspection, and if not then the sub-frame 7 may be sent for rework.
  • Figs. 8(a) and 8(b) there are shown positions for the sub-frame when a compound HRI is used according to an embodiment of the present invention.
  • the sub-frame 7 may be positioned such that side 30, which is located furthest from the operator 3, is raised with respect to side 32, which is located nearest the operator 3.
  • the sub-frame 7 may be positioned on a plane parallel to the plane on which the compound HRI 82 is positioned.
  • the sub- frame 7 may be positioned in or on an adjustable device 33, whereby the position of the sub- frame 7 may be adjusted, for example, using one or more of positioning devices 35, relative to the compound HRI 82.
  • the manufacturing assembly line 1 may be operated.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Factory Administration (AREA)

Abstract

La présente invention se rapporte à un procédé et un appareil (figure 1) permettant d'effectuer des activités commerciales et analogues au moyen d'une ou de plusieurs images représentationnelles à deux ou trois dimensions (figure 1b, 11). Ledit procédé consiste à superposer une image représentationnelle à deux ou trois dimensions, qui contient une image de la pièce à travailler dans un état avancé de l'assemblage, sur une surface ou directement sur la pièce à travailler, et à utiliser l'image représentationnelle superposée pour faciliter l'assemblage de la pièce à travailler. Une ou plusieurs images représentationnelles à deux ou trois dimensions sont créées, par exemple par photographie normale, holographie ou imagerie informatique, et sont placées dans un cadre intégré à la chaîne d'assemblage de l'équipement de fabrication. La pièce à travailler est positionnée relativement à l'emplacement de l'image représentationnelle de sorte que cette dernière puisse être superposée à la pièce à travailler. Une opération d'assemblage est ensuite effectuée au moyen de l'image représentationnelle superposée qui est utilisée en tant que modèle.
PCT/US2001/046711 2001-10-18 2001-10-18 Procede et appareil d'utilisation d'images representationnelles dans des activites commerciales et analogues WO2003034318A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US24130401P 2001-10-18 2001-10-18
US60/241,304 2001-10-18

Publications (1)

Publication Number Publication Date
WO2003034318A1 true WO2003034318A1 (fr) 2003-04-24

Family

ID=22910132

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/046711 WO2003034318A1 (fr) 2001-10-18 2001-10-18 Procede et appareil d'utilisation d'images representationnelles dans des activites commerciales et analogues

Country Status (1)

Country Link
WO (1) WO2003034318A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4871252A (en) * 1986-10-30 1989-10-03 The Regents Of The University Of California Method and apparatus for object positioning
US5589980A (en) * 1989-02-27 1996-12-31 Bass; Robert Three dimensional optical viewing system
US5796500A (en) * 1992-11-27 1998-08-18 Voxel Methods and apparatus for making holograms

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4871252A (en) * 1986-10-30 1989-10-03 The Regents Of The University Of California Method and apparatus for object positioning
US5589980A (en) * 1989-02-27 1996-12-31 Bass; Robert Three dimensional optical viewing system
US5796500A (en) * 1992-11-27 1998-08-18 Voxel Methods and apparatus for making holograms

Similar Documents

Publication Publication Date Title
US7929750B2 (en) Method and apparatus for utilizing representational images in commercial and other activities
EP2575147B1 (fr) Établi pour la fabrication ou la vérification de faisceaux de câbles électriques
EP2524329B1 (fr) Agencement et procédé pour vérifier un modèle réel en utilisant un modèle virtuel et utilisation associée dans la construction aéronautique
US8269970B2 (en) Optical comparator with digital gage
CN103547884A (zh) 利用多重格子条纹的目视检查装置
US10579890B2 (en) Automatic alignment of a 3D model to a test object
JP3077054U (ja) レンズへの仕上げブロックの自動取り付けのための装置
Álvarez et al. Augmented reality system to guide operators in the setup of die cutters
CN104168414A (zh) 拍摄并拼接物件影像的方法
CN101897196A (zh) 确定多组件显示器的空隙漫射器的位置
JPH09189539A (ja) 物品の製造エラー検出方法
Pottier et al. Developing digital twins of multi-camera metrology systems in Blender
WO2003034318A1 (fr) Procede et appareil d'utilisation d'images representationnelles dans des activites commerciales et analogues
Krotova et al. Development of a trajectory planning algorithm for moving measuring instrument for binding a basic coordinate system based on a machine vision system
JP4377782B2 (ja) 実装基板の検査方法および同装置
WO2020229793A1 (fr) Procédés et appareil d'étalonnage de système de visiocasque de réalité virtuelle
KR100624024B1 (ko) 액정패널 에지면의 회귀라인 도입에 의한 에지면 결함의검사방법
Tyris et al. Interactive view planning exploiting standard machine vision in structured light scanning of engineering parts
CN213245476U (zh) 一种艺术品信息采集点交装置
US20210299809A1 (en) Assembly comprising a cnc machining system and an augmented reality display device
TWI406117B (zh) 電腦數值控制之輔助系統及其輔助方法
JP2005267404A (ja) ワーク加工システム及びワーク加工方法
JPH03166046A (ja) 生産計画作成装置
TW202009505A (zh) 協助陣列排版之電路板辨識且記錄缺陷位置的系統
JP2006086187A (ja) 実装基板の検査用データ作成方法、実装基板の検査方法および同装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BY BZ CA CH CN CO CR CU CZ DE DM DZ EC EE ES FI GB GD GE GH HR HU ID IL IN IS JP KE KG KP KR LC LK LR LS LT LU LV MA MD MG MN MW MX MZ NO NZ PH PL PT RO SD SE SG SI SK SL TJ TM TR TT TZ UG UZ VN YU ZA

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ UG ZW AM AZ BY KG KZ MD TJ TM AT BE CH CY DE DK ES FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP