CN112764406A - Intelligent auxiliary assembly system and method - Google Patents

Intelligent auxiliary assembly system and method Download PDF

Info

Publication number
CN112764406A
CN112764406A CN202110107037.4A CN202110107037A CN112764406A CN 112764406 A CN112764406 A CN 112764406A CN 202110107037 A CN202110107037 A CN 202110107037A CN 112764406 A CN112764406 A CN 112764406A
Authority
CN
China
Prior art keywords
assembly
server
platform
mechanical equipment
virtual scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110107037.4A
Other languages
Chinese (zh)
Inventor
陈俊涛
杨晓雨
高月玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sany Heavy Machinery Ltd
Original Assignee
Sany Heavy Machinery Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sany Heavy Machinery Ltd filed Critical Sany Heavy Machinery Ltd
Priority to CN202110107037.4A priority Critical patent/CN112764406A/en
Publication of CN112764406A publication Critical patent/CN112764406A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G05B19/4189—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by the transport system
    • G05B19/41895—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by the transport system using automatic guided vehicles [AGV]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/04—Manufacturing
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/31—From computer integrated manufacturing till monitoring
    • G05B2219/31002—Computer controlled agv conveys workpieces between buffer and cell
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30—Computing systems specially adapted for manufacturing

Abstract

The invention provides an intelligent auxiliary assembly system and method, which relate to the technical field of engineering machinery, wherein the intelligent auxiliary assembly system comprises an assembly platform, a design release client, integrated head-mounted equipment and a server, wherein the design release client, the integrated head-mounted equipment and the server are respectively in communication connection with the assembly platform; the server is connected with the automatic material distribution navigation device; the design and release client is used for releasing the three-dimensional model and the assembly process data of the mechanical equipment; the integrated head-wearing equipment is used for displaying a virtual scene of prototype assembly of the mechanical equipment; the server is used for storing the assembly process data and receiving the feedback information, and performing fusion calculation on the virtual scene and the real scene; the material distribution automatic navigation device is used for distributing materials to the assembly platform under the control of the server. The invention reduces the degree of dependence on the experience of workers in field assembly when trial production and small-batch production of a prototype are carried out, greatly saves time cost, improves assembly efficiency and avoids long-time field guidance of designers.

Description

Intelligent auxiliary assembly system and method
Technical Field
The invention relates to the technical field of engineering machinery, in particular to an intelligent auxiliary assembly system and method.
Background
At present, the intelligent manufacturing industry develops rapidly, when traditional manufacturing enterprises assemble products at present, the technical experience of workers is often relied on, such as heavy complex engineering machinery of hydraulic mechanical equipment and the like, under the environment of trial production and small-batch customization of a new product prototype, the quality and the efficiency of the whole machine assembly are greatly relied on the technical experience level of the assembly workers, especially the complex pipe arrangement and wiring operation of a hydraulic system and an electrical system, due to the problem of the experience of the workers, the quality problems of wrong assembly and neglected assembly often occur, and the assembly field needs to be researched and developed and the long-time field guidance of process personnel, so that a large amount of time cost is generated, and the speed of new product development and upgrading and updating is further reduced.
Disclosure of Invention
The invention aims to provide an intelligent auxiliary assembly system and method, which reduce the dependence degree of field assembly on the experience level of workers and field support of technicians during trial production and small-batch customization of a prototype, greatly reduce the time cost, improve the assembly efficiency and avoid long-time field technical guidance of research and development personnel.
In a first aspect, an embodiment of the present invention provides an intelligent auxiliary assembly system, including: the system comprises an assembly platform, a design release client, integrated head-mounted equipment and a server, wherein the design release client, the integrated head-mounted equipment and the server are respectively in communication connection with the assembly platform; the server is connected with an automatic material distribution navigation device; the design and release client, the server and the automatic material distribution navigation device are connected in sequence; the design and release client is used for releasing the three-dimensional model and the assembly process data of the mechanical equipment; the integrated head-mounted device is used for displaying a virtual scene when the mechanical device is assembled; the server is used for carrying out fusion calculation on a virtual scene and a real scene on the received three-dimensional model of the mechanical equipment and the assembling process data so as to command the automatic material distribution navigation device according to the assembling condition of the assembling platform; the material distribution automatic navigation device is used for distributing materials to the assembly platform under the control of the server; the assembling platform is used for providing assembling space for mechanical equipment prototype assembling for the materials.
In an alternative embodiment, an integrated head-mounted device comprises a helmet body, AR glasses, and a high-definition camera; the AR glasses are used for displaying a virtual scene of current operation of mechanical equipment prototype assembly; the high-definition camera is used for recognizing the gesture of a worker; the server is further configured to update the virtual scene upon receiving the worker gesture, such that the AR glasses display the virtual scene for a next operation of the mechanical device prototyping.
In an alternative embodiment, the integrated headset further comprises: displaying a switch button; and the display switching button is used for switching and replaying the virtual scene operated last.
In an alternative embodiment, the integrated headset further comprises: a focusing knob; the focusing knob is used for adjusting the focal length of the AR glasses so as to adapt to users with different myopia degrees.
In an alternative embodiment, the assembly platform comprises specific lights, an on-site monitoring device and a positioning and tracking device; wherein, the specific light is used for meeting the specific lighting condition required by the AR glasses; the field monitoring equipment is used for monitoring and managing the operation condition of the assembly platform; the location tracking device is used to identify the assembly area where the worker is located at the assembly platform and the exact location of the integrated headset.
In an alternative embodiment, the assembly area includes a component sub-assembly area and a complete machine assembly area.
In an alternative embodiment, the design publishing client comprises: the system comprises a lightweight three-dimensional model input interface, a component split charging setting module, a three-dimensional assembly animation setting module and a virtual process operation card establishing module; the lightweight three-dimensional model input interface is used for uploading the lightweight three-dimensional model of the mechanical equipment to the server.
In an optional embodiment, the design and release client further includes a multi-person cooperation setting module; the multi-person cooperation setting module is used for carrying out task allocation on multi-person cooperation during assembly of parts and the whole machine; the server is also used for analyzing the multi-person cooperation in real time and distributing and displaying corresponding task scenes aiming at the roles of the integrated head-mounted equipment.
In an optional embodiment, the design release client further comprises a remote technical support module; the high-definition camera is also used for acquiring real-time video data of an assembly site; the remote technical support module is used for carrying out remote technical support according to real-time video data when an emergency or a troublesome problem occurs in an assembly field.
In a second aspect, an embodiment of the present invention provides an intelligent auxiliary assembly method, where the method applies a server, and includes: acquiring a three-dimensional model and assembly process data of mechanical equipment released by a design and release client and real-time pose information of integrated head-mounted equipment; the real-time pose information comprises position information and posture information of the integrated head-mounted equipment; performing fusion calculation of a virtual scene and a real scene according to the received three-dimensional model of the mechanical equipment and the assembly process data, and commanding the automatic material distribution navigation device according to the assembly progress of the assembly platform; the material distribution automatic navigation device distributes materials to the assembly platform so as to assemble the materials on the assembly platform.
The invention provides an intelligent auxiliary assembly system and a method, wherein the intelligent auxiliary assembly system comprises: the system comprises an assembly platform, a design and release client, an integrated head-mounted device and a server which are respectively in communication connection with the assembly platform, wherein the server is also connected with an automatic material distribution navigation device, and the design and release client, the server and the automatic material distribution navigation device are sequentially connected. The design and release client is used for releasing a three-dimensional model and assembly process data of mechanical equipment, the integrated head-mounted equipment is used for displaying a virtual scene during assembly of a mechanical equipment sample machine, the server is used for performing virtual scene and real scene fusion calculation on the received three-dimensional model and assembly process data of the mechanical equipment so as to command the material distribution automatic navigation device according to the assembly condition of the assembly platform, the material distribution automatic navigation device is used for distributing materials to the assembly platform under the control of the server, and the assembly platform is used for providing an assembly space for the assembly of the mechanical equipment sample machine for the materials. According to the auxiliary assembly system and the auxiliary assembly method executed by the auxiliary assembly system, the three-dimensional model of the mechanical equipment and the assembly process data can be designed and issued through the design and issue client, so that the server combines the real scene of the assembly and the virtual scene displayed by the integrated head-mounted equipment according to the three-dimensional model of the mechanical equipment and the assembly process data, the server controls the material distribution automatic navigation device to distribute the materials to the assembly platform, the materials are assembled on the assembly platform, the dependence degree of field assembly on the experience level of early designers and workers during trial production and small-batch customization of a prototype is reduced, the assembly efficiency is greatly improved, the time cost is saved, and long-time field technical guidance of research and development personnel is avoided.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic structural diagram of an intelligent auxiliary assembly system according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an integrated headset according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an assembly platform according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of another intelligent auxiliary assembling system provided by the embodiment of the invention;
fig. 5 is a schematic flow chart of an intelligent auxiliary assembly method according to an embodiment of the present invention.
Icon: 10-assembling the platform; 101-a tool device; 102-specific lighting; 103-a field monitoring device; 104-a location tracking device; 105-a communication device; 20-designing a publishing client; 30-an integrated headset; 301-helmet body; 302-a battery; 303-AR glasses; 304-high definition camera; 305-display switch button; 306-a sensor; 307-a microprocessor; 308-a wireless communication module; 309-headset; 310-focus knobs; 40-a server; 50-automatic material distribution navigation device.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings or the orientations or positional relationships that the products of the present invention are conventionally placed in use, and are only used for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the devices or elements referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
Furthermore, the terms "horizontal", "vertical", "overhang" and the like do not imply that the components are required to be absolutely horizontal or overhang, but may be slightly inclined. For example, "horizontal" merely means that the direction is more horizontal than "vertical" and does not mean that the structure must be perfectly horizontal, but may be slightly inclined.
In the description of the present invention, it should also be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
Some embodiments of the invention are described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Considering that most domestic products are manufactured and produced by using two-dimensional engineering drawings at present, but the expression of two-dimensional assembly icons is not clear and intuitive enough, the requirement on workers is higher, a few enterprises gradually realize a three-dimensional assembly process taking an MBD technology as a core, PADs are mostly adopted on the site to display assembly animations and process information, but the workers need to operate the PADs and carry out assembly operation, so that the seamless connection of three-dimensional design and three-dimensional assembly cannot be realized. At present, related technologies propose to acquire an assembly site of a worker by using an image recognition technology and combine an AI (artificial intelligence) technology and an AR (augmented reality) technology to perform part assembly demonstration or production line guidance, but for large-scale complex hydraulic engineering machinery, the application of the image recognition technology and the AI technology is particularly difficult under the unstructured assembly environment caused by new prototype and customized requirements. Based on the problems, the embodiment of the invention provides an intelligent auxiliary assembly system and method, which reduce the dependence degree of product assembly on workers during trial production and batch customization of a prototype, greatly save time cost and avoid long-time field technical guidance of research personnel.
For convenience of understanding, first, an intelligent auxiliary assembling system provided by an embodiment of the present invention is described in detail, referring to a schematic structural diagram of an intelligent auxiliary assembling system shown in fig. 1, where the intelligent auxiliary assembling system mainly includes: the system comprises an assembly platform 10, a design and release client 20, an integrated headset 30 and a server 40 which are respectively in communication connection with the assembly platform 10, wherein the server 40 is further connected with an automatic material distribution navigation device 50 (AGV), and the design and release client 20, the server 40 and the automatic material distribution navigation device 50 are sequentially connected. The assembly platform 10 is a specific three-dimensional space for mechanical equipment prototyping and provides an assembly space for mechanical equipment prototyping for materials. In one embodiment, the mounting platform 10 is communicatively coupled to the communication device 105 of the integrated headset 30, and the design issue client 20 and the server 40 are also communicatively coupled to the communication device 105 for real-time wireless communication with the integrated headset 30.
When the mechanical equipment needs to be assembled, research and development personnel can set the three-dimensional model and the assembling process data of the mechanical equipment in advance through the design and distribution client 20 and distribute the three-dimensional model and the assembling process data of the mechanical equipment, and it can be understood that the three-dimensional model and the assembling process data of the mechanical equipment can be sent to the assembling platform 10 through the communication equipment or sent to the server 40, and the server 40 processes information and sends data. The integrated headset 30 is used to display a virtual scene during the assembly of the mechanical equipment sample, such as a virtual scene during the assembly of the mechanical equipment sample, which can be displayed through an Augmented Reality (AR) technology. When the three-dimensional model of the mechanical equipment and the assembling process data are received by the server 40 after being issued, the server 40 performs fusion calculation of a virtual scene, namely a scene displayed by the integrated head-mounted device 30 through AR technology, and a real scene, namely a real assembling scene of the assembling platform 10, on the received three-dimensional model of the mechanical equipment and the assembling process data, and after the fusion calculation is performed by the server 40, the virtual scene and the real scene are fused, so that the assembling condition of the current assembling platform 10 can be obtained, the assembling condition can include, for example, an assembling progress, a current quantity of assembling materials, and the like, so as to command the automatic material distribution navigation device 50 (namely, the material distribution AGV) according to the assembling condition of the assembling platform 10, and the material distribution AGV distributes the materials to the assembling platform 10 under the control of the server 40, wherein the distribution materials are determined according to the current assembling progress, after the material delivery AGV delivers the material to the mounting platform 10, the worker may perform prototype assembly or batch customization of the machine at the mounting platform 10. In one embodiment, the mechanical device may comprise a large complex construction machine such as an excavator, loader, rotary drilling rig, or the like.
The intelligent auxiliary assembly system provided by the embodiment can design and issue the three-dimensional model of the mechanical equipment and the assembly process data through the design and issue client 20, so that the server 40 combines the real scene of the assembly and the virtual scene displayed by the integrated head-mounted equipment 30 according to the three-dimensional model of the mechanical equipment and the assembly process data, the server 40 controls the material distribution automatic navigation device 50 to distribute the materials to the assembly platform 10, so that the materials are assembled on the assembly platform 10, the dependence degree of product assembly on workers during trial production and batch customization of a prototype is reduced, the time cost is greatly reduced, and the assembly efficiency is improved.
The above components of the integrated headset 30 can be specifically referred to a structural schematic diagram of an integrated headset 30 shown in fig. 2, where the integrated headset 30 includes a helmet body 301 (i.e., a helmet engineering material body), a storage battery 302, AR glasses 303, a high-definition camera 304, a display switching button 305, a sensor 306, a microprocessor 307, a wireless communication module 308, an ear microphone 309, and a focusing knob 310, and for understanding, functions implemented by the components of the integrated headset 30 are specifically described below: the safety helmet body 301 is worn by a worker, the storage battery 302 is used for providing a power supply for the integrated head-wearing device 30, the sensor 306 is used for being matched with the positioning and tracking device 104 to detect real-time pose information of the integrated head-wearing device, and the AR glasses 303 are used for displaying a virtual scene of current operation of mechanical device prototype assembly, wherein the virtual scene is displayed according to the three-dimensional model of the mechanical device and the assembly process data.
In one embodiment, the high-definition camera 304 included in the integrated headset 30 may be used to recognize a gesture of the worker, such as a gesture of putting OK to indicate that the worker performs the assembly of the current step according to the virtual scene displayed by the AR glasses 303, or other gestures that may indicate that the operation is completed may be adopted in the actual application, which is only indicated here and is not particularly limited. After acquiring the worker gesture, the high-definition camera 304 transmits the gesture to the server 40 through the wireless communication module 308 of the integrated headset 30, and when receiving the worker gesture, the server 40 updates a virtual scene, such as a virtual scene which may be a next step of assembly, and then displays a virtual scene of a next operation of mechanical prototype assembly through the AR glasses 303, so that the worker can perform further assembly according to the updated virtual scene of the next step.
In another embodiment, the high-definition camera 304 included in the integrated headset 30 may be further configured to capture video data, such as video data of the entire assembly, such as when a preview of the assembly process is required or a playback of the assembly process is required, which may be controlled by the display switch button 305 of the integrated headset 30, and after the display switch button 305 is triggered, the last operated virtual scene may be switched for playback according to actual requirements.
In addition, considering that different workers have different eyesight, the integrated headset 30 may further include a focusing knob 310, and when the worker rotates the teaching button, the focal length of the AR glasses 303 may be adjusted, so as to adapt to users with different degrees of myopia, and enable the user to more clearly acquire a virtual scene displayed by the AR glasses 303. Also, in order to facilitate interaction by workers at the time of assembly, such as communication with the eyes of a background research and development person or communication between workers, the integrated headset 30 further includes a headset 309 through which the workers can implement the communication requirements.
In one embodiment, the assembly platform 10 may further include a tool device 101 for assembly, a specific light 102, a field monitoring device 103 and a positioning and tracking device 104, as shown in fig. 3, wherein the specific light 102 is used to satisfy a specific lighting condition required when the AR glasses 303 display a virtual scene, the field monitoring device 103 is used to monitor and manage the operation condition of the assembly platform 10, and the positioning and tracking device 104 is used to identify an assembly area where a worker is located on the assembly platform 10 and an accurate location where an integrated headset is located, such as a component-split area and a complete machine assembly area, where the integrated headset is located, such as an accurate location where the worker wearing the integrated headset is located. Based on this, the embodiment of the present invention provides another intelligent auxiliary assembling system as shown in fig. 4.
In an embodiment, the design issuing client 20 may include a lightweight three-dimensional model input interface, a component split setting module, a three-dimensional assembly animation setting module, and a virtual process operation card creation module, where the lightweight three-dimensional model input interface is used to upload a lightweight three-dimensional model of a mechanical device to the server 40, which may effectively improve the uploading efficiency of the three-dimensional model of the mechanical device, the component split setting module may be used to set split of an assembly component, and the three-dimensional assembly animation setting module is used to generate a three-dimensional assembly animation, which may be displayed through the AR glasses 303 of the integrated headset 30 after the assembly animation is issued to the server 40, so that a worker knows the assembly process. The virtual process operation card creation module may be used to define and standardize the operation procedures and process requirements, for example.
In addition, considering that some mechanical devices cannot be assembled by a single person, the design and release client 20 may further include a multi-person cooperation setting module, which may be used to perform task allocation for multiple persons during assembly of components and the whole machine, and the server 40 may be further used to perform real-time analysis for the multi-person cooperation, display a corresponding task scene for role allocation of the integrated headset 30, and further send an analysis result to the integrated headset 30 of a worker responsible for assembly of the respective component, and display the analysis result on the AR glasses 303 of the corresponding worker.
The design and distribution client 20 may further include a remote technical support module, when a complex situation or a troublesome problem occurs in an assembly site (i.e., the assembly platform 10), an assembly worker uses the wireless communication module 308 and the headset 309 on the integrated headset 30 to connect a research and development designer, collects a first view scene (i.e., second video data) of the field worker through the high-definition camera 304 and sends the first view scene to the design and distribution client 20, the research and development technician analyzes a field situation and marks or controls a virtual model in the client, and the server 40 updates display content of the AR glasses 303 in real time, so that the technician can remotely support the assembly site.
In summary, the intelligent auxiliary assembly system provided by the embodiment of the invention can reduce the degree of dependence of product assembly on workers during trial production and batch customization of a prototype, greatly save time cost, and avoid long-time field technical guidance of research personnel.
An embodiment of the present invention provides an intelligent auxiliary assembly method, referring to a flow diagram of the intelligent auxiliary assembly method shown in fig. 5, the method is applied to a server of an intelligent auxiliary assembly system, and the method mainly includes the following steps S502 to S506:
step S502, acquiring a three-dimensional model and assembly process data of mechanical equipment issued by a design and issue client and real-time pose information of integrated head-mounted equipment; the real-time pose information comprises position information and posture information of the integrated head-mounted equipment;
step S504, performing fusion calculation of a virtual scene and a real scene according to the received three-dimensional model of the mechanical equipment and the assembly process data, and commanding the automatic material distribution navigation device according to the assembly progress of the assembly platform;
in step S506, the material distribution automatic navigation device distributes the material to the assembly platform so as to assemble the material on the assembly platform.
According to the intelligent auxiliary assembly method provided by the embodiment of the invention, the three-dimensional model and the assembly process data of the mechanical equipment can be designed and issued through the design and issue client 20, so that the real scene of the assembly of the three-dimensional model and the assembly process data of the mechanical equipment is combined with the real-time pose information of the integrated head-mounted equipment 30 by the server 40, the server 40 controls the material distribution automatic navigation device 50 to distribute the materials to the assembly platform 10, and the materials are assembled on the assembly platform 10, so that the dependence degree of product assembly workers during trial production and batch customization of a prototype is reduced, the time cost is greatly reduced, and the assembly efficiency is improved.
The method provided by the embodiment of the present invention has the same implementation principle and technical effect as the system embodiment, and for the sake of brief description, reference may be made to the corresponding contents in the system embodiment for the parts that are not mentioned in the method embodiment.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. An intelligent assistive assembly system, comprising: the system comprises an assembly platform, a design release client, integrated head-mounted equipment and a server, wherein the design release client, the integrated head-mounted equipment and the server are respectively in communication connection with the assembly platform; the server is connected with an automatic material distribution navigation device; the design release client, the server and the automatic material distribution navigation device are sequentially connected;
the design issuing client is used for issuing a three-dimensional model and assembly process data of the mechanical equipment;
the integrated head-mounted device is used for displaying a virtual scene when the mechanical equipment sample machine is assembled;
the server is used for storing assembly process data and receiving feedback information, and performing fusion calculation of a virtual scene and a real scene so as to command the automatic material distribution navigation device according to the assembly condition of the assembly platform;
the material distribution automatic navigation device is used for distributing materials to the assembling platform under the control of the server;
the assembling platform is used for providing assembling space for mechanical equipment prototype assembling for the materials.
2. The intelligent assistive fit system of claim 1, wherein the integrated headset device comprises a headgear body, AR glasses, a high-definition camera; wherein the content of the first and second substances,
the AR glasses are used for displaying a virtual scene of current operation of mechanical equipment prototype assembly;
the high-definition camera is used for recognizing the gesture of a worker;
the server is further used for updating the virtual scene when the worker gesture is received, so that the AR glasses can display the virtual scene of the next operation of mechanical equipment prototype assembly.
3. The intelligent assistive fit system of claim 2, wherein the integrated headset further comprises: displaying a switch button;
the display switching button is used for switching and replaying the virtual scene operated last.
4. The intelligent assistive fit system of claim 2, wherein the integrated headset further comprises: a focusing knob;
the focusing knob is used for adjusting the focal length of the AR glasses so as to adapt to users with different myopia degrees.
5. The intelligent auxiliary assembly system according to claim 2, wherein the assembly platform comprises specific lights, on-site monitoring equipment and positioning and tracking equipment;
wherein the content of the first and second substances,
the specific light is used for meeting specific lighting conditions required by the AR glasses;
the field monitoring equipment is used for monitoring and managing the operation condition of the assembly platform;
a location tracking device is used to identify the assembly area where the worker is located at the assembly platform and the exact location of the integrated headset.
6. The intelligent auxiliary assembly system according to claim 5, wherein the assembly area comprises a component sub-assembly area and a complete machine assembly area.
7. The intelligent assistive assembly system of claim 1, wherein the design release client comprises: the system comprises a lightweight three-dimensional model input interface, a component split charging setting module, a three-dimensional assembly animation setting module and a virtual process operation card establishing module;
the lightweight three-dimensional model input interface is used for uploading the lightweight three-dimensional model of the mechanical equipment to the server.
8. The intelligent assisted assembly system of claim 1, wherein the design release client further comprises a multi-person collaborative setup module;
the multi-person cooperation setting module is used for carrying out task allocation on parts and multi-person cooperation during whole machine assembly;
the server is further used for analyzing the multi-person cooperation in real time and displaying corresponding task scenes according to the role allocation of the integrated head-mounted device.
9. The intelligent assistive assembly system of claim 1, wherein the design release client further comprises a remote technical support module;
the high-definition camera is also used for acquiring real-time video data of an assembly site;
and the remote technical support module is used for carrying out remote technical support according to the real-time video data when an emergency or a troublesome problem occurs in an assembly field.
10. An intelligent assisted assembly method, characterized in that the method applies a server, the method comprising:
acquiring a three-dimensional model and assembly process data of mechanical equipment released by a design and release client and real-time pose information of integrated head-mounted equipment; wherein the real-time pose information comprises position information and pose information of the integrated head-mounted device;
performing fusion calculation of a virtual scene and a real scene according to the received three-dimensional model of the mechanical equipment and the assembling process data, and commanding the automatic material distribution navigation device according to the assembling progress of an assembling platform;
the material distribution automatic navigation device distributes materials to an assembly platform so as to assemble the materials on the assembly platform.
CN202110107037.4A 2021-01-26 2021-01-26 Intelligent auxiliary assembly system and method Pending CN112764406A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110107037.4A CN112764406A (en) 2021-01-26 2021-01-26 Intelligent auxiliary assembly system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110107037.4A CN112764406A (en) 2021-01-26 2021-01-26 Intelligent auxiliary assembly system and method

Publications (1)

Publication Number Publication Date
CN112764406A true CN112764406A (en) 2021-05-07

Family

ID=75705908

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110107037.4A Pending CN112764406A (en) 2021-01-26 2021-01-26 Intelligent auxiliary assembly system and method

Country Status (1)

Country Link
CN (1) CN112764406A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113673894A (en) * 2021-08-27 2021-11-19 东华大学 Multi-person cooperation AR assembly method and system based on digital twin
CN115826510A (en) * 2022-10-27 2023-03-21 银河航天科技(南通)有限公司 Remote assembly system
CN115847428A (en) * 2023-02-20 2023-03-28 中国信息通信研究院 AR technology-based mechanical assembly auxiliary guide system and method

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113673894A (en) * 2021-08-27 2021-11-19 东华大学 Multi-person cooperation AR assembly method and system based on digital twin
CN113673894B (en) * 2021-08-27 2024-02-02 东华大学 Multi-person cooperation AR assembly method and system based on digital twinning
CN115826510A (en) * 2022-10-27 2023-03-21 银河航天科技(南通)有限公司 Remote assembly system
CN115847428A (en) * 2023-02-20 2023-03-28 中国信息通信研究院 AR technology-based mechanical assembly auxiliary guide system and method

Similar Documents

Publication Publication Date Title
CN112764406A (en) Intelligent auxiliary assembly system and method
CN107168537B (en) Cooperative augmented reality wearable operation guidance method and system
CN108089696B (en) Virtual reality and augmented reality for industrial automation
EP3629134B1 (en) Augmented reality interaction techniques
EP3063587B1 (en) Apparatus and method for head mounted display indicating process of 3d printing
WO2021179399A1 (en) Mixed reality-based remote operation guidance system and method
EP2140316B1 (en) Robot operator control unit configuration system and method
CN113703569A (en) System and method for virtual reality and augmented reality for industrial automation
CN106794581A (en) For the system and method for flexible man-machine collaboration
WO2009036782A1 (en) Information processing apparatus and method for remote technical assistance
WO2022166264A1 (en) Simulation training system, method and apparatus for work machine, and electronic device
CN103213125A (en) Roboter einstellvorrichtung mit 3-D display
CN107656505A (en) Use the methods, devices and systems of augmented reality equipment control man-machine collaboration
CN109240507A (en) Wearing-on-head type computer is as the secondary monitor inputted with automatic speech recognition and head-tracking
CN109901713B (en) Multi-person cooperative assembly system and method
CN107452119A (en) virtual reality real-time navigation method and system
US20190317490A1 (en) Control method, device, and remote control for vr apparatus
CN202975721U (en) Intelligent stage control system based on intelligent visual positioning technology
CN104731578B (en) To may be programmed the remote accessory of metering system generation customization and synchronous reference note
CN214042108U (en) Intelligent auxiliary assembly system
WO2020206679A1 (en) Method and device for controlling remote-controlled movable platform and computer-readable storage medium
CN109584361B (en) Equipment cable virtual preassembling and track measuring method and system
CN113673894A (en) Multi-person cooperation AR assembly method and system based on digital twin
CN109857258B (en) Virtual remote control method, device and system
CN110489894B (en) Hydraulic power plant three-dimensional scene simulation system and method based on virtual reality technology

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination