WO2018040334A1 - Error proofing system for assembly line electric screwing gun - Google Patents

Error proofing system for assembly line electric screwing gun Download PDF

Info

Publication number
WO2018040334A1
WO2018040334A1 PCT/CN2016/107991 CN2016107991W WO2018040334A1 WO 2018040334 A1 WO2018040334 A1 WO 2018040334A1 CN 2016107991 W CN2016107991 W CN 2016107991W WO 2018040334 A1 WO2018040334 A1 WO 2018040334A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
tightening
processed
vehicle
assembly line
Prior art date
Application number
PCT/CN2016/107991
Other languages
French (fr)
Chinese (zh)
Inventor
凌兴宏
李�杰
Original Assignee
苏州大学张家港工业技术研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 苏州大学张家港工业技术研究院 filed Critical 苏州大学张家港工业技术研究院
Publication of WO2018040334A1 publication Critical patent/WO2018040334A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
    • B23P—METAL-WORKING NOT OTHERWISE PROVIDED FOR; COMBINED OPERATIONS; UNIVERSAL MACHINE TOOLS
    • B23P19/00—Machines for simply fitting together or separating metal parts or objects, or metal and non-metal parts, whether or not involving some deformation; Tools or devices therefor so far as not provided for in other classes
    • B23P19/04—Machines for simply fitting together or separating metal parts or objects, or metal and non-metal parts, whether or not involving some deformation; Tools or devices therefor so far as not provided for in other classes for assembling or disassembling parts
    • B23P19/06—Screw or nut setting or loosening machines

Definitions

  • the present invention relates to the field of information technology, and more particularly to an assembly line electric tightening gun error proofing system.
  • Threaded coupling is one of the most common methods of combining machine components.
  • An electric tightening gun is a device that is often used in assembly operations to tighten a nut to a screw with a set torque. Fixed effect. More common in automotive assembly lines, such as the fixing of automotive engine end caps, the fixing of car tires, etc. Because of its high reliability and good repeatability, it can guarantee the tightening process requirements and can reduce the labor intensity of workers, so it is widely used in production.
  • electric tightening guns often require employee operations, which can result in some unavoidable human error. For example, the screw is leaked, or the same part of the screw is repeatedly twisted and the screwing sequence is wrong. After the line is removed, it needs to be repaired and rectified, increasing the workload and affecting the production efficiency.
  • the object of the present invention is to provide an error-proofing system for an assembly line electric tightening gun, so as to solve the problem that the assembly tightening process has many errors and the real-time monitoring of the assembly line assembly cannot be performed.
  • the present invention provides the following technical solutions:
  • An assembly line electric tightening gun error proofing system comprising:
  • a host computer configured to obtain vehicle to-be-processed information from a preset product processing database, and send the vehicle to-be-processed information to a tightening gun control module;
  • the tightening gun control module is configured to receive the information to be processed of the vehicle, and send corresponding tightening data information to the tightening gun according to the information to be processed of the vehicle, so that the worker controls the tightening gun according to the tightening data information ;
  • a video monitoring and analysis module configured to capture an operation video of a worker operating the tightening gun on the spot; obtaining a preset time interval video frame from the operation video, and performing image template analysis on the video frame and the pre-stored operation flow picture In contrast, when the video frame is inconsistent with the operation flow picture, an alarm is triggered to start.
  • the video monitoring and analysis module is specifically configured to:
  • the video frame and the operation flow picture are analyzed and compared according to an image template matching algorithm based on a contour feature.
  • the tightening gun control module is further configured to record actual tightening data information of the tightening gun during operation and send to the upper computer;
  • the upper computer is further configured to receive the actual tightening data information and send the information to the MES system for the MES system to perform analysis and statistics.
  • the method further comprises:
  • the RFID automatically identifies the car number module, and is used for identifying product model information of the vehicle to be processed on the station, and transmitting the product model information to the host computer;
  • the upper computer is further configured to acquire the vehicle to-be-processed information from a preset product processing database according to the product model information.
  • the upper computer is further configured to:
  • the tightening point and the tightening sequence required for the current job are displayed on the display screen of the own according to the information to be processed.
  • the assembly line electric screwing gun error proofing system obtained by the invention obtains the vehicle to be processed information from the preset product processing database through the upper computer, and sends the vehicle to be processed information to the tightening gun control module, and the tightening gun control module is processed according to the vehicle.
  • the information sends the corresponding tightening data information to the tightening gun, and the worker can perform the work according to the tightening data information.
  • the video monitoring and analyzing module is used to photograph the operation video of the worker's site, and obtain a preset time interval video frame from the operation video, and the video is obtained. The frame is compared with the pre-stored operation flow picture for image template analysis.
  • the assembly line electric tightening gun error proofing system provided by the invention can monitor the assembly line in real time.
  • FIG. 1 is a schematic structural view of an assembly line electric tightening gun error proofing system according to an embodiment of the present invention.
  • the embodiment of the invention discloses an error-proofing system for the assembly line electric tightening gun, so as to solve the problem that the assembly tightening process has many errors and the real-time monitoring of the assembly line assembly cannot be performed.
  • the invention provides an assembly line electric tightening gun error proofing system, wherein a communication connection between the upper computer, the tightening gun control module and the video monitoring and analysis module is provided.
  • FIG. 1 is a structural schematic diagram of an error-proofing system for an electric tightening gun of an assembly line according to the present invention.
  • the system includes:
  • the upper computer is configured to obtain vehicle waiting information from a preset product processing database, and send the vehicle to be processed information to the tightening gun control module;
  • the vehicle to be processed information includes the product process route, the visualized machining map, the defined operation sequence, the tightening torque information, and the like, and information related to the product during the operation, and the vehicle to be processed information is sent to the tightening gun control module.
  • the upper computer may be an industrial tablet PC.
  • other devices may be used as long as the same technical effect can be achieved.
  • the form of implementation of the body is not limited and is within the scope of the present invention.
  • the tightening gun control module is configured to receive information about the vehicle to be processed, and send corresponding tightening data information to the tightening gun according to the information to be processed of the vehicle, so that the worker controls the tightening gun to perform the operation according to the tightening data information;
  • the information to be processed carries the tightening data information, and the tightening gun control module sends the tightening data information to the tightening gun.
  • the tightening gun can be parameterized according to the corresponding tightening data information, and the worker uses the tightening gun to assemble the bolts to be processed to realize Intelligent tightening.
  • the video monitoring and analysis module is used for photographing the operation video of the worker on-site operation of the tightening gun; obtaining a preset time interval video frame from the operation video, and comparing the video frame with the pre-stored operation flow picture for image template analysis, when the video When the frame is inconsistent with the operation flow picture, the alarm is triggered to start.
  • the video monitoring and analysis module is used for photographing the operation video of the worker's scene; obtaining a preset time interval video frame from the operation video, and comparing the video frame with the pre-stored operation flow image for image template analysis, when the video frame and operation When the process pictures are inconsistent, the alarm is triggered to start.
  • the specific time interval can be set according to actual needs.
  • the assembly line electric screwing gun error proofing system obtained by the invention obtains the vehicle to be processed information from the preset product processing database through the upper computer, and sends the vehicle to be processed information to the tightening gun control module, and the tightening gun control module is processed according to the vehicle.
  • the information sends the corresponding tightening data information to the tightening gun, and the worker can perform the work according to the tightening data information.
  • the video monitoring and analyzing module is used to photograph the operation video of the worker's site, and obtain a preset time interval video frame from the operation video, and the video is obtained. The frame is compared with the pre-stored operation flow picture for image template analysis.
  • the assembly line electric tightening gun error proofing system provided by the invention can monitor the assembly line in real time.
  • the video monitoring and analysis module is specifically configured to:
  • the video frame and the operation flow picture are analyzed and compared according to the image template matching algorithm based on the contour feature.
  • Image template matching algorithm is one of the key technologies in the fields of image understanding, target recognition, artificial intelligence, etc. Different application fields have different requirements for image template matching algorithms.
  • the present invention adopts contour-based features.
  • the template matching algorithm uses the contour feature of the binarized image as the matching feature, and uses the similarity function of the binary image to perform similar matching.
  • the outline of the whole image is extracted as a template, and the operation flow picture is globally matched and passed. Similarity is used for authentication.
  • the tightening gun control module is further configured to record the actual tightening data information of the tightening gun during the operation and send it to the upper computer;
  • the upper computer is also used to receive the actual tightening data information and send it to the MES system for analysis and statistics of the MES system.
  • RFID automatically recognizes the car number module for identifying the product model information of the vehicle to be processed at the station, and transmitting the product model information to the host computer;
  • the upper computer is also used to obtain the vehicle to be processed information from the preset product processing database according to the product model information.
  • the chassis module is brushed with RFID on the upper line, and the PLC is positioned to slide the sled.
  • the RFID automatic identification car number module automatically reads and writes the product model information according to the positioning of the PLC and sends it to the upper computer.
  • the upper computer selects the product model according to the product model information.
  • the vehicle processing information is obtained in the set product processing database.
  • the host computer is also used to:
  • the tightening point and tightening sequence required for the current job are displayed on the display screen of the job according to the information to be processed.
  • the host computer graphically displays the tightening points to be performed on its own screen, as well as the tightening list that has been completed or not completed, the tightening sequence and the parts to be followed, and the state of the tightening points according to the actual operation, such as the current blue light flashing, To be tightened, the display is gray, the tightening is completed, the display is green, the screwing is incorrect, and the red light is displayed. Specifically, it can be set according to actual needs, and all of them are within the protection scope of the present invention.
  • the operator can log in through the on-site industrial tablet PC to unlock the tightening gun, and the upper computer can control the opening and closing of the intelligent material frame door according to the received information of the vehicle to be processed.
  • the lamp can be picked up by the operator according to the indicator light, and the confirmation button is triggered after the picking is completed.
  • the invention applies the video analysis technology to the assembly line electric tightening gun error proofing system, can realize the real-time active monitoring of the tightening gun assembly process, can detect the abnormal situation in time when the problem occurs during the tightening operation, remind the operator, and remind the operator
  • the actual torque data of the tightening operation is managed, the torque data is statistically analyzed, and the report is generated according to the user's demand, and the abnormal reminder information report and the equipment maintenance information report can be performed. Automated control of the assembly process, providing reliable assembly and complete data tracking.
  • the steps of the method or algorithm described in connection with the embodiments disclosed herein may be directly applied to the hard Implemented by a piece of software, a software module executed by a processor, or a combination of both.
  • the software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Automobile Manufacture Line, Endless Track Vehicle, Trailer (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

An error proofing system for an assembly line electric screwing gun, comprising an upper computer (12) used for obtaining information on a vehicle to be processed from a preset product processing database and sending the information on the vehicle to be processed to a screwing gun control module (11); the screwing gun control module (11) used for receiving the information on the vehicle to be processed and sending corresponding screwing data information to a screwing gun according to the information on the vehicle to be processed, such that a worker controls, according to the screwing data information, the screwing gun to work; and a video monitoring and analyzing module (13) used for taking an operation video of the worker operating the screwing gun on site, obtaining a video frame at a preset time interval from the operation video, performing image template analysis and comparison on the video frame and a pre-stored operation process picture, and triggering an alarm to start if the video frame is inconsistent with the operation process picture. By means of monitoring an assembly line in real time, the error proofing system for an assembly line electric screwing gun can remind a worker of an abnormal operation and thus has an alarming and correcting function to the worker.

Description

一种装配线电动拧紧枪防错系统Assembly line electric tightening gun error proofing system
本申请要求于2016年08月29日提交中国专利局、申请号为201610750450.1、发明名称为“一种装配线电动拧紧枪防错系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims priority to Chinese Patent Application No. 201610750450.1, entitled "An Assembly Line Electric Screwdriver Error Prevention System", filed on August 29, 2016, the entire contents of which are incorporated herein by reference. In the application.
技术领域Technical field
本发明涉及信息技术领域，更具体地说，涉及一种装配线电动拧紧枪防错系统。The present invention relates to the field of information technology, and more particularly to an assembly line electric tightening gun error proofing system.
背景技术Background technique
螺纹联接是机器零部件之间结合的最常用的方法之一，电动拧紧枪是一种在装配作业中经常使用的设备，它可将螺母以某一设定扭矩旋紧于螺杆上，起到固定作用。多见于汽车装配生产线上，如汽车发动机端盖的固定，汽车轮胎的固定等。由于其可靠性高，重复性好，能保证拧紧工艺要求，且能减轻工人的劳动强度，因而在生产中得到广泛应用。但是电动拧紧枪往往需要员工操作，从而会产生一些不可避免的人为操作失误。比如螺钉的漏拧，或者重复多次拧了同一个部位螺丝以及拧紧次序错误，下线后需返修和整改，增加工作量、影响生产效率。Threaded coupling is one of the most common methods of combining machine components. An electric tightening gun is a device that is often used in assembly operations to tighten a nut to a screw with a set torque. Fixed effect. More common in automotive assembly lines, such as the fixing of automotive engine end caps, the fixing of car tires, etc. Because of its high reliability and good repeatability, it can guarantee the tightening process requirements and can reduce the labor intensity of workers, so it is widely used in production. However, electric tightening guns often require employee operations, which can result in some unavoidable human error. For example, the screw is leaked, or the same part of the screw is repeatedly twisted and the screwing sequence is wrong. After the line is removed, it needs to be repaired and rectified, increasing the workload and affecting the production efficiency.
综上所述，如何有效地解决装配拧紧过程失误较多、无法对整机流水线装配进行实时监测的问题，是目前本领域技术人员急需解决的问题。In summary, how to effectively solve the problem of many errors in the assembly tightening process and the inability to monitor the assembly line assembly in real time is an urgent problem to be solved by those skilled in the art.
发明内容Summary of the invention
有鉴于此，本发明的目的在于提供一种装配线电动拧紧枪防错系统，以解决装配拧紧过程失误较多、无法对整机流水线装配进行实时监测的问题。In view of this, the object of the present invention is to provide an error-proofing system for an assembly line electric tightening gun, so as to solve the problem that the assembly tightening process has many errors and the real-time monitoring of the assembly line assembly cannot be performed.
为了达到上述目的，本发明提供如下技术方案：In order to achieve the above object, the present invention provides the following technical solutions:
一种装配线电动拧紧枪防错系统，包括：An assembly line electric tightening gun error proofing system, comprising:
上位机，用于从预先设置的产品加工数据库中获取车辆待加工信息，并将所述车辆待加工信息发送至拧紧枪控制模块； a host computer, configured to obtain vehicle to-be-processed information from a preset product processing database, and send the vehicle to-be-processed information to a tightening gun control module;
所述拧紧枪控制模块，用于接收所述车辆待加工信息，并根据所述车辆待加工信息向拧紧枪发送相应的拧紧数据信息以使工人根据所述拧紧数据信息控制所述拧紧枪进行作业；The tightening gun control module is configured to receive the information to be processed of the vehicle, and send corresponding tightening data information to the tightening gun according to the information to be processed of the vehicle, so that the worker controls the tightening gun according to the tightening data information ;
视频监控与分析模块，用于拍摄工人现场操作拧紧枪的操作视频；从所述操作视频中获取预设的时间间隔的视频帧，将所述视频帧与预先存储的操作流程图片进行图像模板分析对比，当所述视频帧与所述操作流程图片不一致时，则触发报警器启动。a video monitoring and analysis module, configured to capture an operation video of a worker operating the tightening gun on the spot; obtaining a preset time interval video frame from the operation video, and performing image template analysis on the video frame and the pre-stored operation flow picture In contrast, when the video frame is inconsistent with the operation flow picture, an alarm is triggered to start.
优选地，所述视频监控分析模块具体用于：Preferably, the video monitoring and analysis module is specifically configured to:
根据基于轮廓特征的图像模板匹配算法对所述视频帧和所述操作流程图片进行分析对比。The video frame and the operation flow picture are analyzed and compared according to an image template matching algorithm based on a contour feature.
优选地，所述拧紧枪控制模块还用于记录拧紧枪在操作过程中实际的拧紧数据信息并发送至所述上位机；Preferably, the tightening gun control module is further configured to record actual tightening data information of the tightening gun during operation and send to the upper computer;
所述上位机还用于接收所述实际的拧紧数据信息，并发送至MES系统以便于所述MES系统进行分析统计。The upper computer is further configured to receive the actual tightening data information and send the information to the MES system for the MES system to perform analysis and statistics.
优选地，还包括：Preferably, the method further comprises:
RFID自动识别车号模块，用于识别工位上的待加工车辆的产品型号信息，并将所述产品型号信息发送至所述上位机；The RFID automatically identifies the car number module, and is used for identifying product model information of the vehicle to be processed on the station, and transmitting the product model information to the host computer;
所述上位机还用于根据所述产品型号信息从预先设置的产品加工数据库中获取所述车辆待加工信息。The upper computer is further configured to acquire the vehicle to-be-processed information from a preset product processing database according to the product model information.
优选地，所述上位机还用于：Preferably, the upper computer is further configured to:
根据所述待加工信息在自身的显示屏幕上显示当前作业所需的拧紧点和拧紧顺序。The tightening point and the tightening sequence required for the current job are displayed on the display screen of the own according to the information to be processed.
本发明提供的装配线电动拧紧枪防错系统，通过上位机从预先设置的产品加工数据库中获取车辆待加工信息，并将车辆待加工信息发送至拧紧枪控制模块，拧紧枪控制模块根据车辆待加工信息向拧紧枪发送相应的拧紧数据信息，工人可根据拧紧数据信息进行作业，视频监控与分析模块用于拍摄工人现场的操作视频，从操作视频中获取预设的时间间隔的视频帧，将视频帧与预先存储的操作流程图片进行图像模板分析对比，当视频帧与操作流程图片不一致时，触发报警器启动，提醒工人操作异常，对工人起 到警示纠错的作用。应用本发明提供的装配线电动拧紧枪防错系统，能够对装配流水线进行实时监控。The assembly line electric screwing gun error proofing system provided by the invention obtains the vehicle to be processed information from the preset product processing database through the upper computer, and sends the vehicle to be processed information to the tightening gun control module, and the tightening gun control module is processed according to the vehicle. The information sends the corresponding tightening data information to the tightening gun, and the worker can perform the work according to the tightening data information. The video monitoring and analyzing module is used to photograph the operation video of the worker's site, and obtain a preset time interval video frame from the operation video, and the video is obtained. The frame is compared with the pre-stored operation flow picture for image template analysis. When the video frame is inconsistent with the operation flow picture, the alarm is triggered to start, reminding the worker to operate abnormally, starting from the worker. To warn of the role of correction. The assembly line electric tightening gun error proofing system provided by the invention can monitor the assembly line in real time.
附图说明DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.
图1为本发明实施例提供的装配线电动拧紧枪防错系统的结构示意图。FIG. 1 is a schematic structural view of an assembly line electric tightening gun error proofing system according to an embodiment of the present invention.
具体实施方式detailed description
本发明实施例公开了一种装配线电动拧紧枪防错系统，以解决装配拧紧过程失误较多、无法对整机流水线装配进行实时监测的问题。The embodiment of the invention discloses an error-proofing system for the assembly line electric tightening gun, so as to solve the problem that the assembly tightening process has many errors and the real-time monitoring of the assembly line assembly cannot be performed.
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
本发明提供了一种装配线电动拧紧枪防错系统，其中，上位机、拧紧枪控制模块和视频监控与分析模块间通信连接。The invention provides an assembly line electric tightening gun error proofing system, wherein a communication connection between the upper computer, the tightening gun control module and the video monitoring and analysis module is provided.
请参阅图1，为本发明提供您的装配线电动拧紧枪防错系统的结构示意图。该系统包括：Please refer to FIG. 1 , which is a structural schematic diagram of an error-proofing system for an electric tightening gun of an assembly line according to the present invention. The system includes:
上位机，用于从预先设置的产品加工数据库中获取车辆待加工信息，并将车辆待加工信息发送至拧紧枪控制模块；The upper computer is configured to obtain vehicle waiting information from a preset product processing database, and send the vehicle to be processed information to the tightening gun control module;
车辆待加工信息包括产品工艺路线、可视化加工图以及定义好的操作顺序、拧紧扭矩信息等在作业过程中与产品有关的信息，将车辆待加工信息发送至拧紧枪控制模块。上位机具体可以为工业平板PC，当然，在其他实施例中，也可以为其他装置，只要能够达到相同的技术效果即可，对具 体的实现形式不作限定，均在本发明的保护范围内。The vehicle to be processed information includes the product process route, the visualized machining map, the defined operation sequence, the tightening torque information, and the like, and information related to the product during the operation, and the vehicle to be processed information is sent to the tightening gun control module. The upper computer may be an industrial tablet PC. Of course, in other embodiments, other devices may be used as long as the same technical effect can be achieved. The form of implementation of the body is not limited and is within the scope of the present invention.
拧紧枪控制模块，用于接收车辆待加工信息，并根据车辆待加工信息向拧紧枪发送相应的拧紧数据信息以使工人根据拧紧数据信息控制拧紧枪进行作业；The tightening gun control module is configured to receive information about the vehicle to be processed, and send corresponding tightening data information to the tightening gun according to the information to be processed of the vehicle, so that the worker controls the tightening gun to perform the operation according to the tightening data information;
车辆待加工信息中携带拧紧数据信息，拧紧枪控制模块将拧紧数据信息发送给拧紧枪，拧紧枪可根据相应的拧紧数据信息进行参数设置，工人使用拧紧枪对待加工零部件螺栓进行装配，以实现智能化拧紧。The information to be processed carries the tightening data information, and the tightening gun control module sends the tightening data information to the tightening gun. The tightening gun can be parameterized according to the corresponding tightening data information, and the worker uses the tightening gun to assemble the bolts to be processed to realize Intelligent tightening.
视频监控与分析模块，用于拍摄工人现场操作拧紧枪的操作视频；从操作视频中获取预设的时间间隔的视频帧，将视频帧与预先存储的操作流程图片进行图像模板分析对比，当视频帧与操作流程图片不一致时，则触发报警器启动。The video monitoring and analysis module is used for photographing the operation video of the worker on-site operation of the tightening gun; obtaining a preset time interval video frame from the operation video, and comparing the video frame with the pre-stored operation flow picture for image template analysis, when the video When the frame is inconsistent with the operation flow picture, the alarm is triggered to start.
视频监控与分析模块，用于拍摄工人现场的操作视频；从操作视频中获取预设的时间间隔的视频帧，将视频帧与预先存储的操作流程图片进行图像模板分析对比，当视频帧与操作流程图片不一致时，则触发报警器启动。The video monitoring and analysis module is used for photographing the operation video of the worker's scene; obtaining a preset time interval video frame from the operation video, and comparing the video frame with the pre-stored operation flow image for image template analysis, when the video frame and operation When the process pictures are inconsistent, the alarm is triggered to start.
具体的时间间隔，可根据实际的需要自行进行设置。The specific time interval can be set according to actual needs.
对工人的拧紧作业进行拍摄视频，并且从操作视频中获取预设时间间隔的视频帧，并将其与预先存储的操作流程图片进行图像模板分析对比，当视频帧与操作流程图片不一致时，触发报警器启动，以提示工人检查拧紧作业。Shooting video of the worker's tightening operation, and obtaining a video frame of a preset time interval from the operation video, and comparing it with the pre-stored operation flow picture for image template analysis, when the video frame is inconsistent with the operation flow picture, triggering The alarm is activated to prompt the worker to check the tightening operation.
本发明提供的装配线电动拧紧枪防错系统，通过上位机从预先设置的产品加工数据库中获取车辆待加工信息，并将车辆待加工信息发送至拧紧枪控制模块，拧紧枪控制模块根据车辆待加工信息向拧紧枪发送相应的拧紧数据信息，工人可根据拧紧数据信息进行作业，视频监控与分析模块用于拍摄工人现场的操作视频，从操作视频中获取预设的时间间隔的视频帧，将视频帧与预先存储的操作流程图片进行图像模板分析对比，当视频帧与操作流程图片不一致时，触发报警器启动，提醒工人操作异常，对工人起 到警示纠错的作用。应用本发明提供的装配线电动拧紧枪防错系统，能够对装配流水线进行实时监控。The assembly line electric screwing gun error proofing system provided by the invention obtains the vehicle to be processed information from the preset product processing database through the upper computer, and sends the vehicle to be processed information to the tightening gun control module, and the tightening gun control module is processed according to the vehicle. The information sends the corresponding tightening data information to the tightening gun, and the worker can perform the work according to the tightening data information. The video monitoring and analyzing module is used to photograph the operation video of the worker's site, and obtain a preset time interval video frame from the operation video, and the video is obtained. The frame is compared with the pre-stored operation flow picture for image template analysis. When the video frame is inconsistent with the operation flow picture, the alarm is triggered to start, reminding the worker to operate abnormally, starting from the worker. To warn of the role of correction. The assembly line electric tightening gun error proofing system provided by the invention can monitor the assembly line in real time.
具体的，视频监控分析模块具体用于：Specifically, the video monitoring and analysis module is specifically configured to:
根据基于轮廓特征的图像模板匹配算法对视频帧和操作流程图片进行分析对比。The video frame and the operation flow picture are analyzed and compared according to the image template matching algorithm based on the contour feature.
图像模板匹配算法是图像理解、目标识别、人工智能等领域中关键的技术之一，不同的应用领域对图像模板匹配算法具有不同的需求，为了达到最好的匹配效果，本发明采用基于轮廓特征的模板匹配算法，将二值化图像的轮廓特征作为匹配特征，采用二值图像相似匹配的距离函数进行相似匹配，将整个图像的轮廓提取出来作为模板，与操作流程图片进行全局匹配，并通过相似度来进行认证。Image template matching algorithm is one of the key technologies in the fields of image understanding, target recognition, artificial intelligence, etc. Different application fields have different requirements for image template matching algorithms. In order to achieve the best matching effect, the present invention adopts contour-based features. The template matching algorithm uses the contour feature of the binarized image as the matching feature, and uses the similarity function of the binary image to perform similar matching. The outline of the whole image is extracted as a template, and the operation flow picture is globally matched and passed. Similarity is used for authentication.
进一步地，拧紧枪控制模块还用于记录拧紧枪在操作过程中实际的拧紧数据信息并发送至上位机；Further, the tightening gun control module is further configured to record the actual tightening data information of the tightening gun during the operation and send it to the upper computer;
上位机还用于接收实际的拧紧数据信息，并发送至MES系统以便于MES系统进行分析统计。The upper computer is also used to receive the actual tightening data information and send it to the MES system for analysis and statistics of the MES system.
将拧紧枪中实际操作的拧紧数据信息传送给上位机，拧紧数据信息包括实际操作的扭矩数据信息，通过上位机解析扭矩数据信息并将数据插入到预设的相应的车辆拧紧表中，同时将实际的拧紧数据信息传送给MES系统进行分析统计，以便追踪质量和纠错。Transfer the tightening data information of the actual operation in the tightening gun to the upper computer, tighten the data information including the actual operating torque data information, analyze the torque data information through the upper computer and insert the data into the preset corresponding vehicle tightening table, and at the same time The actual tightening data information is transmitted to the MES system for analysis and statistics in order to track quality and error correction.
更进一步地，还包括：Further, it also includes:
RFID自动识别车号模块，用于识别工位上的待加工车辆的产品型号信息，并将产品型号信息发送至上位机；RFID automatically recognizes the car number module for identifying the product model information of the vehicle to be processed at the station, and transmitting the product model information to the host computer;
上位机还用于根据产品型号信息从预先设置的产品加工数据库中获取车辆待加工信息。The upper computer is also used to obtain the vehicle to be processed information from the preset product processing database according to the product model information.
一般的，底盘模组上线刷上RFID，连接线体PLC定位滑橇，RFID自动识别车号模块根据PLC的定位，自动读写产品型号信息并发送至上位机，上位机根据产品型号信息从预先设置的产品加工数据库中获取车辆待加工信息。Generally, the chassis module is brushed with RFID on the upper line, and the PLC is positioned to slide the sled. The RFID automatic identification car number module automatically reads and writes the product model information according to the positioning of the PLC and sends it to the upper computer. The upper computer selects the product model according to the product model information. The vehicle processing information is obtained in the set product processing database.
具体的，上位机还用于： Specifically, the host computer is also used to:
根据待加工信息在自身的显示屏幕上显示当前作业所需的拧紧点和拧紧顺序。The tightening point and tightening sequence required for the current job are displayed on the display screen of the job according to the information to be processed.
上位机在自身屏幕上图形化显示将要进行的拧紧点，以及已经完成或尚未完成的拧紧清单，拧紧顺序以及要按照的零件，并根据实际操作显示拧紧点的状态，如当前拧紧闪烁蓝灯，待拧紧显示灰色、拧紧完成显示绿色、拧紧错误显示红灯等，具体的，可根据实际的需要自行进行设置，均在本发明的保护范围内。The host computer graphically displays the tightening points to be performed on its own screen, as well as the tightening list that has been completed or not completed, the tightening sequence and the parts to be followed, and the state of the tightening points according to the actual operation, such as the current blue light flashing, To be tightened, the display is gray, the tightening is completed, the display is green, the screwing is incorrect, and the red light is displayed. Specifically, it can be set according to actual needs, and all of them are within the protection scope of the present invention.
本发明的一种具体的实施例中，操作者可通过现场工业平板PC进行系统登录，解锁拧紧枪，且上位机可根据收到的车辆待加工信息，控制智能料架门的开闭及指示灯，操作者可根据指示灯进行拣料，拣料完成后触发确认按钮。In a specific embodiment of the present invention, the operator can log in through the on-site industrial tablet PC to unlock the tightening gun, and the upper computer can control the opening and closing of the intelligent material frame door according to the received information of the vehicle to be processed. The lamp can be picked up by the operator according to the indicator light, and the confirmation button is triggered after the picking is completed.
本发明将视频分析技术应用到装配线电动拧紧枪防错系统中，可以实现对拧紧枪装配过程的实时主动监测，可以在拧紧操作过程出现问题时，及时检测到异常情况，提醒操作者，并对拧紧操作的实际扭矩数据进行管理，对扭矩数据进行统计分析，根据用户需求生成报表，可以做到对异常提醒信息报送、设备保养信息报送等。可自动化控制装配工艺，提供可靠的装配及完整的数据追踪。The invention applies the video analysis technology to the assembly line electric tightening gun error proofing system, can realize the real-time active monitoring of the tightening gun assembly process, can detect the abnormal situation in time when the problem occurs during the tightening operation, remind the operator, and remind the operator The actual torque data of the tightening operation is managed, the torque data is statistically analyzed, and the report is generated according to the user's demand, and the abnormal reminder information report and the equipment maintenance information report can be performed. Automated control of the assembly process, providing reliable assembly and complete data tracking.
本说明书中各个实施例采用递进的方式描述，每个实施例重点说明的都是与其它实施例的不同之处，各个实施例之间相同或相似部分互相参见即可。对于实施例公开的装置而言，由于其与实施例公开的方法相对应，所以描述的比较简单，相关之处参见方法部分说明即可。The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same or similar parts of the respective embodiments may be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.
专业人员还可以进一步意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、计算机软件或者二者的结合来实现，为了清楚地说明硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。A person skilled in the art will further appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software or a combination of both, in order to clearly illustrate the hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.
结合本文中所公开的实施例描述的方法或算法的步骤可以直接用硬 件、处理器执行的软件模块，或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。The steps of the method or algorithm described in connection with the embodiments disclosed herein may be directly applied to the hard Implemented by a piece of software, a software module executed by a processor, or a combination of both. The software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.
以上对本发明所提供的一种装配线电动拧紧枪防错系统进行了详细介绍。本文中应用了具体个例对本发明的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本发明的方法及其核心思想。应当指出，对于本技术领域的普通技术人员来说，在不脱离本发明原理的前提下，还可以对本发明进行若干改进和修饰，这些改进和修饰也落入本发明权利要求的保护范围内。 The above is an outline of an assembly line electric tightening gun error proofing system provided by the present invention. The principles and embodiments of the present invention have been described herein with reference to specific examples, and the description of the above embodiments is only to assist in understanding the method of the present invention and its core idea. It should be noted that those skilled in the art can make various modifications and changes to the present invention without departing from the spirit and scope of the invention.

Claims (5)

  1. 一种装配线电动拧紧枪防错系统，其特征在于，包括：An assembly line electric tightening gun error proofing system, comprising:
    上位机，用于从预先设置的产品加工数据库中获取车辆待加工信息，并将所述车辆待加工信息发送至拧紧枪控制模块；a host computer, configured to obtain vehicle to-be-processed information from a preset product processing database, and send the vehicle to-be-processed information to a tightening gun control module;
    所述拧紧枪控制模块，用于接收所述车辆待加工信息，并根据所述车辆待加工信息向拧紧枪发送相应的拧紧数据信息以使工人根据所述拧紧数据信息控制所述拧紧枪进行作业；The tightening gun control module is configured to receive the information to be processed of the vehicle, and send corresponding tightening data information to the tightening gun according to the information to be processed of the vehicle, so that the worker controls the tightening gun according to the tightening data information ;
    视频监控与分析模块，用于拍摄工人现场操作拧紧枪的操作视频；从所述操作视频中获取预设的时间间隔的视频帧，将所述视频帧与预先存储的操作流程图片进行图像模板分析对比，当所述视频帧与所述操作流程图片不一致时，则触发报警器启动。a video monitoring and analysis module, configured to capture an operation video of a worker operating the tightening gun on the spot; obtaining a preset time interval video frame from the operation video, and performing image template analysis on the video frame and the pre-stored operation flow picture In contrast, when the video frame is inconsistent with the operation flow picture, an alarm is triggered to start.
  2. 根据权利要求1所述的装配线电动拧紧枪防错系统，其特征在于，所述视频监控分析模块具体用于：The assembly line electric tightening gun error proofing system according to claim 1, wherein the video monitoring and analysis module is specifically configured to:
    根据基于轮廓特征的图像模板匹配算法对所述视频帧和所述操作流程图片进行分析对比。The video frame and the operation flow picture are analyzed and compared according to an image template matching algorithm based on a contour feature.
  3. 根据权利要求2所述的装配线电动拧紧枪防错系统，其特征在于，所述拧紧枪控制模块还用于记录拧紧枪在操作过程中实际的拧紧数据信息并发送至所述上位机；The assembly line electric tightening gun error proofing system according to claim 2, wherein the tightening gun control module is further configured to record actual tightening data information of the tightening gun during operation and send to the upper computer;
    所述上位机还用于接收所述实际的拧紧数据信息，并发送至MES系统以便于所述MES系统进行分析统计。The upper computer is further configured to receive the actual tightening data information and send the information to the MES system for the MES system to perform analysis and statistics.
  4. 根据权利要求3所述的装配线电动拧紧枪防错系统，其特征在于，还包括：The assembly line electric tightening gun error proofing system according to claim 3, further comprising:
    RFID自动识别车号模块，用于识别工位上的待加工车辆的产品型号信息，并将所述产品型号信息发送至所述上位机；The RFID automatically identifies the car number module, and is used for identifying product model information of the vehicle to be processed on the station, and transmitting the product model information to the host computer;
    所述上位机还用于根据所述产品型号信息从预先设置的产品加工数据库中获取所述车辆待加工信息。The upper computer is further configured to acquire the vehicle to-be-processed information from a preset product processing database according to the product model information.
  5. 根据权利要求4所述的装配线电动拧紧枪防错系统，其特征在于，所述上位机还用于：The assembly line electric tightening gun error proofing system according to claim 4, wherein the upper computer is further configured to:
    根据所述待加工信息在自身的显示屏幕上显示当前作业所需的拧紧点 和拧紧顺序。 Displaying the tightening point required for the current job on its own display screen according to the information to be processed And tighten the order.
PCT/CN2016/107991 2016-08-29 2016-11-30 Error proofing system for assembly line electric screwing gun WO2018040334A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610750450.1 2016-08-29
CN201610750450.1A CN106228744A (en) 2016-08-29 2016-08-29 A kind of assembly line electric tightening rifle fail-safe system

Publications (1)

Publication Number Publication Date
WO2018040334A1 true WO2018040334A1 (en) 2018-03-08

Family

ID=57556116

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/107991 WO2018040334A1 (en) 2016-08-29 2016-11-30 Error proofing system for assembly line electric screwing gun

Country Status (2)

Country Link
CN (1) CN106228744A (en)
WO (1) WO2018040334A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109992684A (en) * 2019-04-12 2019-07-09 中民筑友智能装备科技有限公司 Prefabricated components production line automatic projection method, apparatus, equipment, system and medium
CN111862094A (en) * 2020-08-17 2020-10-30 中车成都机车车辆有限公司 Assembled data acquisition and analysis system
CN114444632A (en) * 2022-01-27 2022-05-06 中铁第四勘察设计院集团有限公司 Visual material error-proofing method and system for overhauling of parts to be inspected in rail transit
CN115235153A (en) * 2022-06-23 2022-10-25 珠海格力电器股份有限公司 Refrigerant filling control method and system of air conditioner and storage medium
US11538247B2 (en) 2020-09-29 2022-12-27 Wipro Limited Method and system for manufacturing operations workflow monitoring using structural similarity index based activity detection
CN115780938A (en) * 2022-12-05 2023-03-14 北京天科合达半导体股份有限公司 Cutting line monitoring method and device of wire cutting machine

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108608200A (en) * 2018-04-17 2018-10-02 广州汽车集团乘用车有限公司 Tightening control manages system and tightening control method
CN108549347A (en) * 2018-05-16 2018-09-18 上汽通用五菱汽车股份有限公司 The accurate management-control method of manufacturing process tightened using electric rifle
CN110312207B (en) * 2019-06-27 2021-07-27 上海递缇智能系统有限公司 Method for applying intelligent cross-station error-proofing wireless positioning technology of tightening tool
CN110202362A (en) * 2019-06-27 2019-09-06 上海递缇智能系统有限公司 The bolt of vision auxiliary positioning tightens error-preventing method
CN110687877A (en) * 2019-09-12 2020-01-14 深圳市铭华航电工艺技术有限公司 Monitoring method, device, terminal and storage medium based on visual network
CN111263091A (en) * 2019-12-20 2020-06-09 中译语通文娱科技(青岛)有限公司 Intelligent verification method for video content
CN112131170B (en) * 2020-10-14 2022-08-19 山东中车同力达智能装备有限公司 Screwing machine visualization method and system based on RS485 serial port communication
CN112935775A (en) * 2021-01-27 2021-06-11 青岛海尔工业智能研究院有限公司 Intelligent visual full-automatic screw locking method and device
CN113222080B (en) * 2021-04-08 2023-04-18 埃夫特智能装备股份有限公司 Wood furniture auxiliary polishing system based on RFID and computer vision and use method thereof
CN114347073A (en) * 2021-12-20 2022-04-15 昆山青眼自动化技术有限公司 Multi-machine cooperation control system based on UR robot
CN116765788B (en) * 2023-08-24 2023-10-13 山东罗科尔德消防科技有限公司 Gas alarm shell equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080208380A1 (en) * 2007-02-22 2008-08-28 Taylor Samir K Manufacturing station with improved controller
CN102622002A (en) * 2012-04-01 2012-08-01 广州信邦汽车装备制造有限公司 Wireless intelligent torque management system
CN203045261U (en) * 2013-01-16 2013-07-10 上海汽车集团股份有限公司 Motor-driven tightening gun anti-error system
CN104029003A (en) * 2013-10-22 2014-09-10 延锋伟世通(北京)汽车饰件系统有限公司 Error-proofing method and device for screws in assembly production line
CN204295589U (en) * 2014-12-08 2015-04-29 江苏悦达延锋江森汽车座椅有限公司 A kind of pneumatic gun tightens fail-safe system
CN104820986A (en) * 2015-04-28 2015-08-05 电子科技大学 Machine vision-based cable on-line detection method
CN104935879A (en) * 2014-03-19 2015-09-23 通用汽车环球科技运作有限责任公司 Multi-View Human Detection Using Semi-Exhaustive Search

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8860385B2 (en) * 2011-01-30 2014-10-14 The Boeing Company Voltage controlled current source for voltage regulation

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080208380A1 (en) * 2007-02-22 2008-08-28 Taylor Samir K Manufacturing station with improved controller
CN102622002A (en) * 2012-04-01 2012-08-01 广州信邦汽车装备制造有限公司 Wireless intelligent torque management system
CN203045261U (en) * 2013-01-16 2013-07-10 上海汽车集团股份有限公司 Motor-driven tightening gun anti-error system
CN104029003A (en) * 2013-10-22 2014-09-10 延锋伟世通(北京)汽车饰件系统有限公司 Error-proofing method and device for screws in assembly production line
CN104935879A (en) * 2014-03-19 2015-09-23 通用汽车环球科技运作有限责任公司 Multi-View Human Detection Using Semi-Exhaustive Search
CN204295589U (en) * 2014-12-08 2015-04-29 江苏悦达延锋江森汽车座椅有限公司 A kind of pneumatic gun tightens fail-safe system
CN104820986A (en) * 2015-04-28 2015-08-05 电子科技大学 Machine vision-based cable on-line detection method

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109992684A (en) * 2019-04-12 2019-07-09 中民筑友智能装备科技有限公司 Prefabricated components production line automatic projection method, apparatus, equipment, system and medium
CN111862094A (en) * 2020-08-17 2020-10-30 中车成都机车车辆有限公司 Assembled data acquisition and analysis system
US11538247B2 (en) 2020-09-29 2022-12-27 Wipro Limited Method and system for manufacturing operations workflow monitoring using structural similarity index based activity detection
CN114444632A (en) * 2022-01-27 2022-05-06 中铁第四勘察设计院集团有限公司 Visual material error-proofing method and system for overhauling of parts to be inspected in rail transit
CN114444632B (en) * 2022-01-27 2024-05-07 中铁第四勘察设计院集团有限公司 Visual material error prevention method and system for overhauling parts to be inspected in rail transit
CN115235153A (en) * 2022-06-23 2022-10-25 珠海格力电器股份有限公司 Refrigerant filling control method and system of air conditioner and storage medium
CN115235153B (en) * 2022-06-23 2023-09-12 珠海格力电器股份有限公司 Refrigerant filling control method, system and storage medium of air conditioner
CN115780938A (en) * 2022-12-05 2023-03-14 北京天科合达半导体股份有限公司 Cutting line monitoring method and device of wire cutting machine

Also Published As

Publication number Publication date
CN106228744A (en) 2016-12-14

Similar Documents

Publication Publication Date Title
WO2018040334A1 (en) Error proofing system for assembly line electric screwing gun
US10037023B2 (en) Dynamic repair system
CN107576435B (en) The online fault locator of tightening technique and its method of Kernel-based methods data analysis
CN105334827A (en) Equipment supervision manufacture and quality real-time control system
CN110889339A (en) Head and shoulder detection-based dangerous area grading early warning method and system
JP2020169680A (en) Device, method and program for detecting bolt fastening condition
CN111126217A (en) Intelligent operation and maintenance management system for power transmission line based on intelligent identification
CN112115927A (en) Intelligent machine room equipment identification method and system based on deep learning
CN111126196A (en) Equipment oil leakage detection method
CN113724240A (en) Refrigerator caster detection method, system and device based on visual identification
CN112702570A (en) Security protection management system based on multi-dimensional behavior recognition
CN212460612U (en) Assembled data acquisition and analysis system
CN113888024A (en) Operation monitoring method and device, electronic equipment and storage medium
CN110928305A (en) Patrol method and system for railway passenger station patrol robot
CN213457742U (en) Welding operation monitoring system
JP2006252364A (en) Inspection work management system
Rusli et al. Fastener identification and assembly verification via machine vision
CN112542022A (en) Automatic inspection system for intelligent production
CN111070694A (en) Pipeline welding quality monitoring method and system based on big data
CN111062932A (en) Monitoring method of network service program
CN111582149A (en) Production safety management and control system based on machine vision
CN116297452A (en) Workpiece testing method and system based on machine vision technology
CN116682034A (en) Dangerous behavior detection method under complex production operation scene
CN111862094A (en) Assembled data acquisition and analysis system
CN112580832A (en) Inspection method and device and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16914896

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16914896

Country of ref document: EP

Kind code of ref document: A1