CN112734588A - Augmented reality processing auxiliary system and use method thereof - Google Patents

Augmented reality processing auxiliary system and use method thereof Download PDF

Info

Publication number
CN112734588A
CN112734588A CN202110000884.0A CN202110000884A CN112734588A CN 112734588 A CN112734588 A CN 112734588A CN 202110000884 A CN202110000884 A CN 202110000884A CN 112734588 A CN112734588 A CN 112734588A
Authority
CN
China
Prior art keywords
processing
workpiece
augmented reality
data
auxiliary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110000884.0A
Other languages
Chinese (zh)
Inventor
张晏诚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Syntec Technology Suzhou Co Ltd
Original Assignee
Syntec Technology Suzhou Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Syntec Technology Suzhou Co Ltd filed Critical Syntec Technology Suzhou Co Ltd
Priority to CN202110000884.0A priority Critical patent/CN112734588A/en
Publication of CN112734588A publication Critical patent/CN112734588A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/04Manufacturing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/10Geometric CAD
    • G06F30/12Geometric CAD characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Architecture (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Human Resources & Organizations (AREA)
  • General Health & Medical Sciences (AREA)
  • Economics (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Manufacturing & Machinery (AREA)
  • Human Computer Interaction (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses an augmented reality processing auxiliary system which comprises a workpiece processing database, an operation module and augmented reality equipment, wherein the workpiece processing database is used for storing a plurality of workpiece processing original data, the operation module is electrically connected with the workpiece processing database and used for calculating auxiliary processing data of a workpiece, the augmented reality equipment is electrically connected with the workpiece processing database and the operation module, an inductor is arranged on the augmented reality equipment and used for sensing an identification pattern on the workpiece, the identification pattern is analyzed and calculated to obtain an identification code and is transmitted to the workpiece processing database, the workpiece processing database transmits the corresponding workpiece processing original data to the operation module after receiving the identification code so as to calculate the auxiliary processing data, and the operation module transmits the auxiliary processing data to the augmented reality equipment for display.

Description

Augmented reality processing auxiliary system and use method thereof
Technical Field
The invention relates to the field of processing auxiliary systems, in particular to a processing auxiliary system for assisting an operator to operate a processing machine by utilizing an augmented reality technology and a use method thereof.
Background
In order to deal with the manufacture of various workpieces of different shapes or materials, such as wood, metal materials, semiconductors, ceramics, composite materials, or other various workpieces capable of being processed, the types of tools used on existing processing machines and machines are various, and the operation of the processing machines is relatively complicated. In order to meet the size and shape requirements of various workpieces, an operator of a machining machine often needs to compare the workpiece being machined with a design drawing at any time, and manually measure the size of a part to be machined on the workpiece before and after each machining process is performed to confirm that the machining process is correct.
For example, in the prior art, when drilling a plate-shaped workpiece, an operator needs to measure the size of the mother plate first, and if the size is not the same, the mother plate needs to be cut into a correct size, and then the size of the plate-shaped workpiece is measured again. And then an operator needs to compare the design drawing or the CAD drawing file to confirm that the dimension of the plate-shaped workpiece is correct, and then the plate-shaped workpiece is arranged on the drilling processing machine to prepare for drilling processing operation, wherein in order to match the drilling position of the plate-shaped workpiece, the operator needs to manually install a special tool on the drilling processing machine according to CAM software or a tool installation mode which is planned in advance, then the machine table is mechanically positioned on the installed tools, and the drilling processing operation can be formally carried out after the positioning is finished.
Therefore, the operator in the whole process flow needs to compare the design drawing, the workpiece and the machine configuration back and forth, and the more complicated the process flow is, the more easily the error is caused for the machine operator. If the cutting dimension error, the processing procedure omission or the cutter installation error happens carelessly in the process, not only the whole process needs to be corrected from the beginning, but also the workpiece with the previous processing error needs to be scrapped to cause waste, and the whole processing production progress is also easy to delay. In addition, in a production line of a processing plant, it is often necessary to deal with the change of the type of the workpiece to be produced, and when the same machine is changed to process different types of workpieces, all the above processes may need to be modified greatly, which may also cause the reduction of the production efficiency.
Disclosure of Invention
According to the shortcomings and problems encountered in the prior art, the present invention provides a method for processing a production line by using augmented reality real-time imaging technology, wherein the imaging source is original workpiece processing data, the augmented reality real-time imaging technology is combined with CAD/CAM software, that is, the original workpiece processing data is obtained after scanning the processed workpiece, and the model drawn by the CAD software and the result of the planned path of the CAM software are calculated in real time, and then projected imaging is performed, so that the conventional design drawing can be replaced, and the processing efficiency and convenience on the production line can be increased.
Taking the quality detection of the production line of the carpentry panel furniture as an example, in the prior art, when verifying whether the processing result or the precision of the workpiece meets the standard, an operator needs to measure the relative coordinates and the dimensions of the process implemented on the workpiece by himself, and the process is interactively compared with a design drawing or a CAD drawing file, which is time-consuming and labor-consuming. In addition, taking the mass production machine model of carpentry panel furniture as "numerical control multi-gang drill", each different workpiece needs to plan the machining path and machine configuration by the CAM software, and the operator can start machining after installing the tool on the machine according to the prompt provided by the program. If the number of processes to be performed is large, the operator must print out the drawings for configuring the tool or check whether the tool configuration on the tool is consistent with the configuration planned by the CAM software, which is also time-consuming and laborious.
In addition, before the workpieces are scanned by using or augmented reality equipment, each workpiece must be given a unique identification barcode, which may be a one-dimensional Code, a two-dimensional Code, a QR Code, an RFID Code or other equivalent object identification codes, for recording the geometric information and the processing information of the workpiece. And then, by utilizing a Mark-Based technology in the augmented reality technology, taking the exclusive identification bar code of the workpiece as an identification object, and after the identification bar code is scanned by a lens, obtaining the workpiece information recorded by the identification bar code to generate a virtual model or a description of CAD or CAM. And calculating the proportion of the virtual model according to the deformation of the identification bar code in the actual space, projecting a virtual workpiece or machine configuration with the same size, and marking related positions, sizes and prompt information for operators to refer to.
If the augmented reality real-time imaging technology can be combined with CAD/CAM software, when the workpiece is machined, the exclusive identification bar code of the workpiece is scanned, the model drawn by the CAD software is imaged according to the original workpiece machining data, and the model is applied to quality detection, an operator can compare the difference between the actual machining result and the virtual image at a glance, and the detection flow becomes more intuitive and rapid. Moreover, before processing, the exclusive identification bar code of the workpiece is scanned, the processing path is calculated immediately through the CAM software, and the result after the CAM software is planned is projected, so that an operator can install and verify the machine according to the imaging result, and the pre-processing operation becomes more efficient.
Accordingly, in order to achieve the above object, the present invention provides an augmented reality processing support system for supporting a processing machine to process a workpiece, the augmented reality processing support system comprising: a workpiece processing database for storing a plurality of workpiece processing raw data; the calculation module is electrically connected with the workpiece processing database and is used for calculating auxiliary processing data of the workpiece; the augmented reality equipment is electrically connected with the workpiece processing database and the calculation module and is provided with a sensor for sensing the identification pattern on the workpiece; the identification pattern is analyzed and calculated to obtain an identification code and is transmitted to a workpiece processing database, the workpiece processing database receives the identification code and transmits workpiece processing original data corresponding to the workpiece, the calculation module calculates auxiliary processing data of the workpiece, the calculation module transmits the auxiliary processing data to augmented reality equipment, and the augmented reality equipment displays the auxiliary processing data on a display of the augmented reality equipment.
In a preferred embodiment, the workpiece processing raw data is a text file.
In a preferred embodiment, the auxiliary processing data includes a virtual graphic file of the workpiece, and the calculation module further includes a drawing module for drawing the virtual graphic file through the workpiece processing raw data.
In a preferred embodiment, the auxiliary processing data includes an operation flow of the processing machine, and the calculation module further includes a computer-aided manufacturing calculation module for calculating the operation flow through the workpiece processing raw data.
In a preferred embodiment, the calculation module is disposed in the augmented reality device.
In a preferred embodiment, the analysis algorithm is executed by the processor of the augmented reality device to obtain the identification code, and the augmented reality device transmits the identification code to the workpiece processing database.
In a preferred embodiment, the identification pattern is transmitted from the augmented reality device to the operation module, the analysis operation is executed by the operation module to obtain the identification code, and the operation module transmits the identification code to the workpiece processing database.
To achieve the above object, the present invention provides a method for using an augmented reality processing support system for supporting a processing machine to process a workpiece, the augmented reality processing support system comprising a workpiece processing database, an operation module and augmented reality equipment, wherein the workpiece processing database is used for storing a plurality of workpiece processing raw data, the augmented reality equipment has a sensor, and the method comprises the following steps: sensing the identification pattern on the workpiece through a sensor; analyzing the identification pattern to obtain an identification code; transmitting the identification code to a workpiece processing database; according to the identification code, the workpiece processing database transmits the workpiece processing original data of the corresponding workpiece to the calculation module; according to the original data of the workpiece processing, the calculation module calculates the auxiliary processing data of the workpiece and transmits the auxiliary processing data to the augmented reality equipment; and displaying the auxiliary processing data on a display of the augmented reality device.
In a preferred embodiment, the method of using the augmented reality processing assistance system further comprises the steps of: analyzing the identification pattern through a processor of the augmented reality device to obtain an identification code; and
the identification code is transmitted to the workpiece processing database through the augmented reality device.
In a preferred embodiment, the method of using the augmented reality processing assistance system further comprises the steps of: sensing the identification pattern on the workpiece through a sensor to obtain an identification pattern image and transmitting the identification pattern image to an arithmetic module; analyzing the image of the identification pattern through an arithmetic module to obtain an identification code; and transmitting the identification code to a workpiece processing database through the operation module.
According to the above, the embodiment of the invention senses the identification pattern on the workpiece through the sensor of the augmented reality device, receives the workpiece processing raw data from the workpiece processing database after analyzing the identification pattern to obtain the identification code, calculates the auxiliary processing data of the workpiece according to the workpiece processing raw data and displays the auxiliary processing data on the display of the augmented reality device, so that the method can display the appropriate operation flow corresponding to different types of workpieces in real time and can also greatly reduce the operation errors of the processing machine operator.
Drawings
FIG. 1 is a system architecture diagram illustrating an augmented reality processing assistance system, according to an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating a workpiece and an identification pattern on the workpiece according to the embodiment of FIG. 1;
FIG. 3 is a schematic diagram showing a display state of the augmented reality processing assistance system for an operator to view according to the embodiment of FIGS. 1 and 2;
FIG. 4 is a system architecture diagram illustrating an augmented reality processing assistance system, according to another embodiment of the present invention;
FIG. 5 is a system architecture diagram illustrating an augmented reality processing assistance system, according to yet another embodiment of the present invention;
FIG. 6 is a diagram illustrating a method of using an augmented reality processing assistance system, according to yet another embodiment of the present invention;
FIG. 7A is a diagram illustrating a method of using the augmented reality processing assistance system according to the embodiment of FIG. 6; and
FIG. 7B is a diagram illustrating a method of using the augmented reality processing assistance system according to the embodiment of FIG. 6.
Description of the symbols:
10. 20, 30 augmented reality processing auxiliary system
11 workpiece machining database
111 original data of workpiece processing
112. 113 auxiliary processing data
12. 22, 32 calculation module
121 drawing module
122 computer aided manufacturing calculation module
13 augmented reality device
131 sensor
132 processor
133 display
15 workpiece
15' virtual workpiece
151 identification pattern
152 feature
Post-processing pattern of 152' features
321 processor of calculation module
A. B, C data transmission path
S101 to S106, S202 to S203, and S301 to S303
Detailed Description
The foregoing and other features and advantages of the invention will be apparent from the following, more particular description of a preferred embodiment, as illustrated in the accompanying drawings. Directional terms as referred to in the following examples, for example: up, down, left, right, front or rear, etc., are referred to only in the direction of the attached drawings. Accordingly, the directional terminology is used for purposes of illustration and is in no way limiting.
FIG. 1 is a schematic diagram of an augmented reality processing assistance system according to an embodiment of the present invention. Referring to fig. 1, the augmented reality processing auxiliary system 10 includes a workpiece processing database 11, an operation module 12 and augmented reality equipment 13. The workpiece processing database 11 is used to store a plurality of workpiece processing raw data 111, and the workpiece processing database 11 is located in a storage device (not shown), such as a hard disk in a computer or other readable recording medium, wherein the workpiece processing raw data 111 may be the size, shape, thickness, processing manner, etc. of various processed workpiece products or features on the workpieces, and the features may be protrusions or depressions, etc. on various workpieces, without limitation.
Fig. 2 is a schematic diagram illustrating a workpiece and an identification pattern on the workpiece according to the embodiment of fig. 1, and is also described with reference to fig. 1. The operation module 12 is electrically connected to the workpiece processing database 11, the operation module 12 is used for calculating auxiliary processing data of the workpiece 15, and the augmented reality device 13 is electrically connected to the workpiece processing database 11 and the operation module 12, wherein the augmented reality device 13 has a sensor 131 for sensing the identification pattern 151 on the workpiece 15. In this embodiment, the workpiece 15 is a flat plate, but not limited thereto, the sensor 131 may be a laser barcode scanner, a Charge Coupled Device (CCD) scanner, a 2D camera, a 3D camera, or other suitable sensing device, the identification pattern 151 is formed on the workpiece 15 by, for example, sticker attachment, laser processing, or other suitable methods, the identification pattern 151 can record an identification code (not shown) of the workpiece 15, the workpieces 15 in different processing flows or different types respectively have different identification codes, wherein the identification pattern 151 may be a one-dimensional barcode, a two-dimensional barcode, an RFID, or other suitable types, which is not limited by the present invention.
Referring to fig. 1 and fig. 2, when the sensor 131 senses the identification pattern 151 on the workpiece 15, the identification pattern 151 is analyzed and calculated to obtain an identification code, and the identification code is transmitted to the workpiece processing database 11. Specifically, the augmented reality device 13 of the embodiment further includes a processor 132, the processor 132 can perform the analysis operation on the identification pattern 151 to obtain the identification code, and the augmented reality device 13 transmits the identification code to the workpiece processing database 11 through the data transmission path a. In this embodiment, the processor 132 may be a single-core or multi-core Central Processing Unit (CPU), other programmable general-purpose or special-purpose Microprocessor (Microprocessor), other similar devices, or a combination thereof, which can be installed in the augmented reality device 13 and can perform analysis and calculation in the prior art. The analysis and calculation may be performed by converting the identification pattern 151 sensed by the sensor 131 into an electrical signal, and then performing the processes of calculating a deformation ratio, decoding, image processing, etc. to obtain an identification code, wherein the identification code is, for example, a string of characters, symbols, numbers or a combination thereof specific to the workpiece 15. The data transmission path a may be a wired or wireless data transmission method, such as a physical cable, Wi-Fi, bluetooth, Zigbee or other suitable data transmission methods. In addition, since the analysis and calculation of pattern recognition belongs to the prior art in the field of augmented reality technology, the present invention does not need to describe the calculation principle and details thereof.
With continued reference to fig. 1 and 2, when the workpiece processing database 11 receives the identification code, the workpiece processing raw data 111 corresponding to the workpiece 15 is transmitted. For example, each piece of workpiece processing original data 111 stored in the workpiece processing database 11 corresponds to a specific identification code, and when the workpiece processing database 11 receives the identification code specific to the workpiece 15 from the data transmission path a, the workpiece processing original data 111 corresponding to the workpiece 15 is transmitted to the operation module 12 through another data transmission path B, where the data transmission path B is similar to the data transmission path a in shape, and an existing wired or wireless data transmission manner may be adopted, which is not repeated herein.
After receiving the workpiece processing raw data 111 corresponding to the workpiece 15, the operation module 12 calculates the auxiliary processing data 112 of the workpiece 15, and transmits the auxiliary processing data 112 to the augmented reality device 13 through the data transmission path C, and the augmented reality device 13 displays the auxiliary processing data 112 on the display 133. Specifically, the operation module 12 is, for example, a single-core or multi-core CPU and gpu (graphics Processing unit) PC, tablet computer or other suitable electronic device, the operation module 12 includes a drawing module 121 and a computer-aided calculation module 122, the workpiece Processing original data 111 is a text file, and the data transmission path C is similar to the data transmission path A, B and can be a conventional wired or wireless data transmission manner. Because the original workpiece processing data 111 only records the text information of the finished product or feature such as size, shape, thickness, or processing mode after the workpiece 15 is processed, compared with the image file or the picture file, the data transmission rate between the workpiece processing database 11 and the operation module 12 can be greatly increased, and the drawing module 121 can also make the auxiliary processing data 112 of the workpiece 15 in real time according to various data in the original workpiece processing data 111, thereby increasing the processing efficiency of the operation module 12. In this embodiment, the drawing module 121 may be implemented by Computer Aided Design (CAD) software or other suitable drawing software, the auxiliary processing data 112 may be a virtual model after the workpiece 15 is processed, and the augmented reality device 13 may be a head-mounted display device, a mobile phone, a tablet Computer, a notebook Computer or other electronic display device with augmented reality function, so that an operator only needs to wear or hold the augmented reality device 13, and can view the virtual model after the workpiece 15 is processed on the display 133 of the augmented reality device 13, and can determine whether the operation of the processing machine is correct in real time, thereby greatly reducing the operation errors of the operator of the processing machine.
In this embodiment, the Computer-Aided calculation module 122 of the calculation module 12 may be implemented by Computer-Aided Manufacturing (CAM) software or other suitable processing and Manufacturing planning software, and the Computer-Aided calculation module 122 may calculate, in real time, the auxiliary processing data 113 and display the auxiliary processing data on the display 133 of the augmented reality device 13 according to the content of the workpiece processing raw data 111, where the auxiliary processing data 113 may be an operation flow of a processing machine corresponding to the workpiece 15, and the operation flow includes, for example, the type, installation position and number of tools on the processing machine, or an operation sequence of the processing machine when performing the processing operation of the workpiece 15. In this way, the operator of the machining tool can compare the operation modes of the machining tool, such as tool mounting, in real time to greatly reduce the operation errors, and the augmented reality machining support system 10 can also modify the support machining data 112 and 113 in real time by scanning the identification bar codes 151 of different workpieces 15 when the type of the workpiece 15 is changed, so that the appropriate operation flow or virtual model of the finished workpiece can be displayed corresponding to different types of workpieces 15.
FIG. 3 is a schematic diagram showing a display state of the augmented reality processing assistance system for an operator to view according to the embodiment of FIGS. 1 and 2. Referring to fig. 1, fig. 2 and fig. 3, it should be noted that the present invention does not limit the file format of the auxiliary processing data 112 or 113, nor limit the display 133 to display only one of the auxiliary processing data 112 or 113, and the display 133 can also display the modified auxiliary processing data 112 and 113 at the same time when the hardware capabilities of the operation module 12 and the augmented reality device 13 are sufficient. Specifically, the augmented reality device 13 can simultaneously display the actual workpiece 15 and the auxiliary processing data 112 and 113 in the display 133 through the existing augmented reality display technology, wherein the auxiliary processing data 112 includes the virtual model 15 'of the workpiece 15 and the processed pattern 152' of the feature 152 on the workpiece 15, and the auxiliary processing data 113 includes the operation flow, for example, the information required to be known by the operator, such as the installation position and the operation steps of the tool in the processing machine, is displayed in a pure text manner. In addition, the auxiliary processing data 112 may further include graphic characters or symbols such as dimension marks, process types, etc. besides the virtual model 15 'and the processed pattern 152' of the feature, and the information included in the auxiliary processing data 113 may be in a schematic form or a graphic and text form, such as a schematic diagram of the tool types and installation positions of the processing tools, etc., so that the operator of the processing tools can understand the operation flow of the tools more easily and the work efficiency can be increased.
In the present embodiment, the auxiliary processing data 112 includes a virtual model of the workpiece 15 after processing, and the auxiliary processing data 113 includes an operation flow of the processing machine corresponding to the workpiece 15, however, in other embodiments, the auxiliary processing data may include a drawing capability of the computer aided calculation module 122 itself, or a simulation process film for drawing the workpiece 15 according to the processing raw data 111 by the drawing module 121. In addition, when the auxiliary processing data is calculated and an error is found by the computer-aided calculation module 122, for example, the tool specification of the processing machine fails to meet the processing requirement of the workpiece 15 or another error occurs, the computer-aided calculation module 122 may also add a prompt of the failure of the processing path planning and/or the reason of the error to the auxiliary processing data and display the prompt on the display 133 of the augmented reality device 13.
FIG. 4 is a system architecture diagram illustrating an augmented reality processing assistance system, according to another embodiment of the present invention. Referring to fig. 4, the augmented reality processing auxiliary system 20 is similar to the augmented reality processing auxiliary system 10 of fig. 1, and the same elements are denoted by the same element numbers and are not repeated herein. The augmented reality processing support system 20 is different from the augmented reality processing support system 10 of fig. 1 in that the operation module 22 is disposed in the augmented reality device 13. That is, when the hardware computing capability of the augmented reality device 13 is sufficient, the operation module 22 can be directly installed in the augmented reality device 13 and perform computing by using the hardware resources of the augmented reality device 13, so as to reduce the hardware configuration related to the operation module 22 and reduce the volume of the whole augmented reality processing auxiliary system 20. In addition, since the operation module 22 is directly installed in the augmented reality device 13, after the identification code is transmitted from the augmented reality device 13 to the workpiece processing database 11 through the data transmission path a, the workpiece processing raw data 111 is also transmitted back to the augmented reality device 13 through the data transmission path a for the operation module 22 to calculate, thereby simplifying the data transmission path and flow.
FIG. 5 is a system architecture diagram illustrating an augmented reality processing assistance system, according to yet another embodiment of the present invention. Referring to fig. 2 and 5, the augmented reality processing auxiliary system 30 is similar to the augmented reality processing auxiliary system 10 of fig. 1 and the augmented reality processing auxiliary system 20 of fig. 4, and the same elements are denoted by the same element numbers and are not described again. The difference between the augmented reality processing support system 30 and the augmented reality processing support systems 10 and 20 is that when the sensor 131 of the augmented reality device 13 senses the identification pattern 151, an identification pattern image (not shown) is obtained, the augmented reality device 13 transmits the identification pattern image to the operation module 32, the operation module 32 performs analysis and operation on the identification pattern image to obtain an identification code, and the operation module 32 transmits the identification code to the workpiece processing database 11. In detail, the augmented reality device 13 can transmit the sensed identification pattern 151 in the form of an image file, that is, an identification pattern image, to the operation module 32 through the data transmission path C, and then the processor 321 of the operation module 32 performs analysis and operation on the identification pattern image to obtain the identification code, wherein the processor 321 may include a single core or a multi-core Central Processing Unit (CPU) capable of performing analysis and operation in the prior art, other programmable general purpose or special purpose microprocessors (microprocessors) or other similar elements or a combination of the above elements, which is not repeated herein. Then, the operation module 32 transmits the identification code to the workpiece processing database 11 through the data transmission path B, the workpiece processing database 11 transmits the corresponding workpiece processing raw data 111 to the operation module 32 through the data transmission path B according to the identification code to calculate the auxiliary processing data 112, 113, finally the operation module 32 transmits the calculated auxiliary processing data 112, 113 to the augmented reality device 13 through the data transmission path C, and the display 133 displays the auxiliary processing data 112, 113. In this way, since the augmented reality device 13 only needs to transmit the identification pattern image to the operation module 32, a part of the hardware load can be reduced, and an excessive hardware capability is relatively unnecessary, thereby achieving a light weight of the augmented reality device 13. In addition, since the augmented reality device 13 of the embodiment does not need to directly perform data transmission connection with the workpiece processing database 11, that is, the workpiece processing database 11 only needs to verify the security of the data transmission path B between the verification module and the operation module 32 and does not need the data transmission path a, the information security of the workpiece processing database 11 can be improved. In addition, in the embodiment, the operation module 32 performs analysis and operation on the image of the identification pattern through the processor 321, and performs calculation of the auxiliary processing data 112 and 113 through the drawing module 121 and the computer aided manufacturing calculation module 122, respectively, however, the processor 321 can also perform or support calculation work of the drawing module 121 and the computer aided manufacturing calculation module 122, and details of the invention are not repeated herein.
In the augmented reality processing auxiliary system 10 disclosed in the embodiment of fig. 1, the workpiece processing database 11, the operation module 12 and the augmented reality device 13 are respectively independent electronic devices or are disposed in different devices; in the augmented reality processing support system 20 disclosed in the embodiment of fig. 4, the operation module 22 is disposed in the augmented reality device 13; in the augmented reality processing support system 30 disclosed in fig. 5, the augmented reality device 13 transmits the recognition pattern image to the processor 321 of the operation module 32 to perform analysis and operation on the recognition pattern image. However, in other embodiments, the workpiece processing database may be disposed in the augmented reality device, for example, the augmented reality device may be an electronic device such as a notebook computer or a tablet computer that can be provided with a large-capacity storage device, and the workpiece processing database may be disposed in the storage device of the electronic device, so that the augmented reality processing auxiliary system only needs to be disposed with a connection line between the augmented reality device and the operation module, thereby improving the operation efficiency of the entire augmented reality processing auxiliary system. In addition, if the hardware capability of the augmented reality device is sufficient, the workpiece processing database and the operation module can be arranged in the augmented reality device at the same time, so that the occupied space or volume of the augmented reality processing auxiliary system can be greatly reduced. In this embodiment, the operation of the augmented reality processing auxiliary system is substantially the same as that of the previous embodiment, and is not described herein again.
FIG. 6 is a diagram illustrating a method of using an augmented reality processing assistance system according to still another embodiment of the present invention. The embodiment of fig. 6 can be applied to the augmented reality processing auxiliary systems 10, 20, and 30, please refer to fig. 6 in combination with fig. 1, fig. 2, fig. 4, and fig. 5. The augmented reality processing support system 10, 20, 30 is used for assisting a processing machine to process a workpiece 15, the augmented reality processing support system 10, 20, 30 includes a workpiece processing database 11, an operation module 12 (or 22, 32) and an augmented reality device 13, the workpiece processing database 11 is used for storing a plurality of workpiece processing raw data 111, the augmented reality device 13 has a sensor 131, and the using method of the augmented reality processing support system further includes the following steps.
Step S101: the identification pattern on the workpiece is sensed by a sensor. In this step, the sensor 131 of the augmented reality device 13 is used to sense the identification pattern 151 on the workpiece 15, wherein the identification pattern 151 is capable of recording the identification code of the workpiece 15.
Step S102: the identification pattern is analyzed to obtain an identification code. In this step, the identification pattern 151 is analyzed and calculated to obtain the identification code, wherein the analysis and calculation is performed by converting the identification pattern 151 sensed by the sensor 131 into an electrical signal, and then calculating a deformation ratio, decoding and the like to obtain the identification code.
Step S103: and transmitting the identification code to a workpiece processing database. In this step, the identification code is transmitted from the augmented reality device 13 to the workpiece processing database 11 through the data transmission path a in the augmented reality processing support system 10, 20. In addition, in the augmented reality processing support system 30, the processor 321 of the operation module 32 performs analysis and calculation to obtain the identification code, so the operation module 32 transmits the identification code to the workpiece processing database 11 through the data transmission path B.
Step S104: according to the identification code, the workpiece processing database transmits the workpiece processing original data of the corresponding workpiece to the calculation module. In this step, the workpiece processing database 11 of the augmented reality processing auxiliary systems 10 and 30 transmits the workpiece processing raw data 111 to the operation modules 12 and 32 through the data transmission path B, and in the augmented reality processing auxiliary system 20, the workpiece processing database 11 transmits the workpiece processing raw data 111 to the operation module 22 in the augmented reality device 13 through the data transmission path a.
Step S105: according to the original data of the workpiece processing, the calculation module calculates the auxiliary processing data of the workpiece and transmits the auxiliary processing data to the augmented reality device. In this step, the operation modules 12, 22, 32 calculate the auxiliary processing data 112, 113 of the workpiece 15 according to the workpiece processing raw data 111, the operation modules 12, 32 transmit the auxiliary processing data 112, 113 to the augmented reality device 13 through the data transmission path C, and the operation module 12 is disposed in the augmented reality device 13, so that the auxiliary processing data 112, 113 can be transmitted only through the internal circuit of the augmented reality device 13. The auxiliary processing data 112 may be a virtual model of the workpiece 15 after processing is completed, and the auxiliary processing data 113 may be an operation flow of the processing machine corresponding to the workpiece 15.
Step S106: displaying the auxiliary processing data on a display of the augmented reality device. In this step, the augmented reality device 13 displays the received auxiliary processing data 112, 113 on the display 133, wherein the augmented reality device 13 can selectively display only the auxiliary processing data 112 or 113 on the display 133, or can simultaneously display the auxiliary processing data 112 and 113 on the display 133.
FIG. 7A is a diagram illustrating a method of using the augmented reality processing support system according to the embodiment of FIG. 6. The embodiment of fig. 7A can be applied to the augmented reality processing auxiliary systems 10 and 20, please refer to fig. 7A in combination with fig. 1, fig. 2 and fig. 4, wherein the same steps are denoted by the same reference numerals and are not repeated herein. The embodiment of fig. 7 is similar to that of fig. 6, except that the following steps are also included. Step S202: the identification pattern is analyzed by the processor of the augmented reality device to obtain the identification code. In this step, the analysis algorithm is executed by the processor 132 of the augmented reality device 13 to obtain the identification code.
Step S203: the identification code is transmitted to the workpiece processing database through the augmented reality device. In this step, the identification code is transmitted from the augmented reality device 13 to the workpiece processing database 11 through the data transmission path A.
FIG. 7B is a diagram illustrating a method of using the augmented reality processing assistance system according to the embodiment of FIG. 6. The embodiment of fig. 7A can be applied to the augmented reality processing auxiliary system 30, please refer to fig. 7B in combination with fig. 2 and fig. 5, wherein the same steps are denoted by the same reference numerals and are not repeated herein. The embodiment of fig. 7B is similar to that of fig. 6 and 7A, except that the following steps are also included. Step S301: the recognition pattern on the workpiece is sensed through the sensor to obtain a recognition pattern image, and the recognition pattern image is transmitted to the operation module. In this step, after the augmented reality device 13 senses the identification pattern 151 through the sensor 133, an image of the identification pattern is formed and transmitted to the operation module 32 through the data transmission path C.
Step S302: the image of the identification pattern is analyzed by an arithmetic module to obtain an identification code. In this step, the operation module 32 performs analysis and operation on the identification pattern image transmitted by the augmented reality device 13 through the processor 321 to obtain the identification code.
Step S303: the identification code is transmitted to the workpiece processing database through the operation module. In this step, after the operation module 32 performs analysis and calculation to obtain the identification code of the workpiece 15, the operation module 32 transmits the identification code to the workpiece processing database 11 through the data transmission path B.
In summary, the embodiment of the invention senses the identification pattern on the workpiece through the sensor of the augmented reality device, obtains the original workpiece processing data from the workpiece processing database after analyzing the identification pattern to obtain the identification code, and calculates the auxiliary processing data of the workpiece according to the original workpiece processing data by the operation module and displays the auxiliary processing data on the display of the augmented reality device.
However, the above description is only a preferred embodiment of the present invention, and the scope of the present invention should not be limited thereby, and all the simple equivalent changes and modifications made according to the claims and the description of the present invention are still within the scope of the present invention.

Claims (10)

1. An augmented reality processing assistance system for assisting a processing machine to process a workpiece, the augmented reality processing assistance system comprising:
a workpiece processing database for storing a plurality of workpiece processing raw data;
the calculation module is electrically connected with the workpiece processing database and is used for calculating auxiliary processing data of the workpiece; and
the augmented reality equipment is electrically connected with the workpiece processing database and the calculation module and is provided with a sensor for sensing an identification pattern on the workpiece;
the identification pattern is analyzed and calculated to obtain an identification code and is transmitted to the workpiece processing database, the workpiece processing database receives the identification code and transmits the workpiece processing original data corresponding to the workpiece to the calculation module to calculate auxiliary processing data of the workpiece, the calculation module transmits the auxiliary processing data to the augmented reality device, and the augmented reality device displays the auxiliary processing data on a display of the augmented reality device.
2. The augmented reality processing-aided system of claim 1, wherein the raw data of the workpiece processing is a text file.
3. The augmented reality processing-aided system of claim 1, wherein the auxiliary processing data comprises a virtual graphics file of the workpiece, and the algorithm module further comprises a drawing module for drawing the virtual graphics file through the workpiece processing raw data.
4. The augmented reality processing support system of claim 1, wherein the auxiliary processing data comprises an operation flow of the processing tool, the algorithm module further comprising a computer aided manufacturing calculation module, the computer aided manufacturing calculation module calculating the operation flow from the workpiece processing raw data.
5. The augmented reality processing auxiliary system of claim 1, wherein the algorithm module is disposed in the augmented reality device.
6. The system of claim 1, wherein the analysis algorithm is executed by a processor of the augmented reality device to obtain the identification code, and the augmented reality device transmits the identification code to the workpiece processing database.
7. The augmented reality processing support system of claim 1, wherein the identification pattern is transmitted from the augmented reality device to the algorithm module, the analysis algorithm is executed by the algorithm module to obtain the identification code, and the algorithm module transmits the identification code to the workpiece processing database.
8. The method for using the augmented reality processing auxiliary system is used for assisting a processing machine to process a workpiece, and is characterized in that the augmented reality processing auxiliary system comprises a workpiece processing database, an arithmetic module and augmented reality equipment, wherein the workpiece processing database is used for storing a plurality of workpiece processing original data, the augmented reality equipment is provided with a sensor, and the using method comprises the following steps:
sensing an identification pattern on the workpiece through the sensor;
analyzing the identification pattern to obtain an identification code;
transmitting the identification code to the workpiece processing database;
according to the identification code, the workpiece processing database transmits the workpiece processing original data corresponding to the workpiece to the calculation module;
according to the original workpiece processing data, the calculation module calculates an auxiliary processing data of the workpiece and transmits the auxiliary processing data to the augmented reality device; and
displaying the auxiliary processing data on a display of the augmented reality device.
9. The method of using the augmented reality processing-assistance system of claim 8, further comprising the steps of:
analyzing the identification pattern through a processor of the augmented reality device to obtain the identification code; and
the identification code is transmitted to the workpiece processing database through the augmented reality device.
10. The method of using the augmented reality processing-assistance system of claim 8, further comprising the steps of:
sensing the identification pattern on the workpiece through the sensor to obtain an identification pattern image and transmitting the identification pattern image to the calculation module;
analyzing the identification pattern image through the calculation module to obtain the identification code; and
the identification code is transmitted to the workpiece processing database through the operation module.
CN202110000884.0A 2021-01-05 2021-01-05 Augmented reality processing auxiliary system and use method thereof Pending CN112734588A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110000884.0A CN112734588A (en) 2021-01-05 2021-01-05 Augmented reality processing auxiliary system and use method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110000884.0A CN112734588A (en) 2021-01-05 2021-01-05 Augmented reality processing auxiliary system and use method thereof

Publications (1)

Publication Number Publication Date
CN112734588A true CN112734588A (en) 2021-04-30

Family

ID=75609468

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110000884.0A Pending CN112734588A (en) 2021-01-05 2021-01-05 Augmented reality processing auxiliary system and use method thereof

Country Status (1)

Country Link
CN (1) CN112734588A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005267404A (en) * 2004-03-19 2005-09-29 Toshiba Corp Work processing system and work processing method
KR101563722B1 (en) * 2014-06-12 2015-10-27 서울과학기술대학교 산학협력단 Ar based i/o device for machine center
WO2016065492A1 (en) * 2014-10-31 2016-05-06 Cloudbased Industry 4.0 Technologies Ag A computer-implemented method for part analytics of a workpiece machined by at least one cnc machine
US20180108178A1 (en) * 2016-10-13 2018-04-19 General Electric Company System and method for measurement based quality inspection
CN109032348A (en) * 2018-06-26 2018-12-18 亮风台(上海)信息科技有限公司 Intelligence manufacture method and apparatus based on augmented reality
CN109643098A (en) * 2016-08-19 2019-04-16 整形工具股份有限公司 For sharing system, the method and apparatus of tool manufacture and design data
WO2020010373A1 (en) * 2018-07-11 2020-01-16 Felder Kg Assembly comprising a cnc machining system and an augmented reality display device
CN111602167A (en) * 2017-11-10 2020-08-28 利勃海尔工厂比伯拉赫股份有限公司 Method and apparatus for providing a representation of a workpiece at a manufacturing station
US20200387824A1 (en) * 2019-06-10 2020-12-10 The Boeing Company Laminate Nonconformance Management System

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005267404A (en) * 2004-03-19 2005-09-29 Toshiba Corp Work processing system and work processing method
KR101563722B1 (en) * 2014-06-12 2015-10-27 서울과학기술대학교 산학협력단 Ar based i/o device for machine center
WO2016065492A1 (en) * 2014-10-31 2016-05-06 Cloudbased Industry 4.0 Technologies Ag A computer-implemented method for part analytics of a workpiece machined by at least one cnc machine
CN109643098A (en) * 2016-08-19 2019-04-16 整形工具股份有限公司 For sharing system, the method and apparatus of tool manufacture and design data
US20180108178A1 (en) * 2016-10-13 2018-04-19 General Electric Company System and method for measurement based quality inspection
CN111602167A (en) * 2017-11-10 2020-08-28 利勃海尔工厂比伯拉赫股份有限公司 Method and apparatus for providing a representation of a workpiece at a manufacturing station
CN109032348A (en) * 2018-06-26 2018-12-18 亮风台(上海)信息科技有限公司 Intelligence manufacture method and apparatus based on augmented reality
WO2020010373A1 (en) * 2018-07-11 2020-01-16 Felder Kg Assembly comprising a cnc machining system and an augmented reality display device
US20200387824A1 (en) * 2019-06-10 2020-12-10 The Boeing Company Laminate Nonconformance Management System

Similar Documents

Publication Publication Date Title
US7630539B2 (en) Image processing apparatus
JP3338373B2 (en) Sheet metal processing integrated support system
EP1901059B1 (en) Method for forming master data for inspecting protruding and recessed figure
EP1315056A2 (en) Simulation apparatus for working machine
EP1286309A2 (en) An automated CAD guided sensor planning process
de Araujo et al. Computer vision system for workpiece referencing in three-axis machining centers
CN110705199B (en) Intelligent electric fitting system and method based on wearable equipment
CN116068959A (en) Processing method based on tool path compensation, electronic equipment and storage medium
TWM613073U (en) Augmented reality processing auxiliary system
US8249733B2 (en) System and method for analyzing performance of an industrial robot
CN112734588A (en) Augmented reality processing auxiliary system and use method thereof
EP3761256B1 (en) Component management database, component management system, and component management method
TWI773075B (en) Augmented reality processing auxiliary system and the usage method thereof
JP4753612B2 (en) Sheet metal 3D-CAD system and sheet metal development drawing creation method
JP2001005507A (en) Working condition evaluating and verifying method, and its device
US20200218756A1 (en) System and Method for Generating Digital Information and Altering Digital Models of Components With Same
KR101717597B1 (en) The dimensional control system based on mobile
WO2020065854A1 (en) Workpiece position detecting method and machine tool
JP2006059014A (en) Device for calculating distance of three-dimensional cad data and measured three-dimensional data, distance calculating method, and its program
TWI591463B (en) Control system of manufacturing machine implemented by electronic billboard, and control method for using the same
JP2002063219A (en) Design device, method for detecting/displaying thin part and storage medium
CN1612141A (en) Bending process making system and method
CN1622082A (en) Forming abridged general view generating system and method
WO2020241676A1 (en) Three-dimensional model recovery system, three-dimensional model recovery method, inspection device, and program
CN100376863C (en) Image measuring system and method for section difference of heat radiator

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination