CN108526834A - Assembling process intelligent monitor system, assembly system and its monitoring method - Google Patents
Assembling process intelligent monitor system, assembly system and its monitoring method Download PDFInfo
- Publication number
- CN108526834A CN108526834A CN201810209594.5A CN201810209594A CN108526834A CN 108526834 A CN108526834 A CN 108526834A CN 201810209594 A CN201810209594 A CN 201810209594A CN 108526834 A CN108526834 A CN 108526834A
- Authority
- CN
- China
- Prior art keywords
- module
- data
- assembling process
- intelligent monitor
- assembly
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23P—METAL-WORKING NOT OTHERWISE PROVIDED FOR; COMBINED OPERATIONS; UNIVERSAL MACHINE TOOLS
- B23P19/00—Machines for simply fitting together or separating metal parts or objects, or metal and non-metal parts, whether or not involving some deformation; Tools or devices therefor so far as not provided for in other classes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/0006—Industrial image inspection using a design-rule based approach
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30164—Workpiece; Machine component
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Factory Administration (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses assembling process intelligent monitor system, assembly system and its monitoring method, the assembling process intelligent monitor system includes photographic device, picture recognition module, data memory module, monitoring modular, alarm module.Assembly manipulation is carried out using the operation instrument of zero refraction materials in assembly system, image sampling is carried out to assembly technology by photographic device, and wrong identification and monitoring statisticss are carried out to technique by picture recognition module, mistake is found according to described image identification module judging result, and it sends and corrects miscue to the alarm module, using present system and its method, have assembling process whole process it is recordable, it is recognizable, can error correction, digitization, for assembly producing line data feedback closed loop is provided the advantages that.
Description
Technical field
The present invention relates to assembling process technique fields, and in particular to a kind of assembling process intelligent monitor system, assembly system
And its monitoring method.
Background technology
Existing workshop assemble electronic product, it is often necessary to electronic component hand-manipulated, but each installation step whether
Correctly, it is to be realized by the artificial judgment of operating personnel, lacks monitoring, judgement and the data acquisition of whole information.
Invention content
It is an object of the invention to overcome prior art problem, a kind of assembling process intelligent monitor system, assembly system are proposed
System and its monitoring method.
The present invention designs a set of assembly intelligent monitor system, installation step key element is standardized, using zero refractive index
Meta Materials, image recognition technology, big data analysis technology can monitor each step of assembly, specifically include such as lower section in real time
Case.The present invention provides a kind of assembling process intelligent monitor systems, including photographic device (2), picture recognition module (3), data
Memory module (4), monitoring modular (5), alarm module (6)；
The photographic device (2) is used to carry out realtime graphic sampling to operating process, and feeds back to described image identification mould
Block (3)；
The input terminal of described image identification module (3) is connected to the photographic device (2), described image identification module (3)
Output end be respectively connected to the data memory module (4), the monitoring modular (5), described image identification module (3) is used for
Judgement is identified in the image that the photographic device (2) obtains；
The data memory module (4) includes any one following or more than one for storing dress data, the data
Categorical data：When graphic pattern discrimination data, product operation image data, product operation form identification data and other correlations
Between data, error statistics data；
The monitoring modular (5) finds mistake according to described image identification module (3) judging result, and sends correction mistake
It prompts to the alarm module (6).
Further, the assembling process intelligent monitor system of the invention is including further including display module (7), the exhibition
Show module (7) for real-time exhibition chart data and/or report data, the display module (7) is following any one for showing
Kind or more than one information：Each operating procedure of manufacturing schedule, product take, product error rate, producing line error rate.
Preferably, the alarm module (6) of the invention is display screen prompt, sound alarm or light hazard.
Corresponding above-mentioned assembling process intelligent monitor system, the present invention provides a kind of assembly systems, including smooth work
Make platform (1) and above-mentioned assembling process intelligent monitor system；The workbench (1) is provided with fixed operating groove position, operation
It is provided with hollow frame above slot position, is equipped with the photographic device (2) below the hollow frame, is used for direct shooting operation slot
Position.
Further, the photographic device (2) is one or more camera, can be configured according to actual demand
The number of corresponding camera.
Preferably, the hollow frame of the invention is toroidal frame, and multiple light bulbs are additionally provided with below the toroidal frame.
Further, assembly system is equipped with operation instrument, the operation element realize it is following any one or it is a kind of with
On operation：Gripping viscous take, overturns, elapsing, pressing.
Further, the embodiment of the present invention, it is preferred that operation instrument is the operation instrument of zero refraction materials or is coated with glimmering
The operation instrument of light.
Correspondingly, the present invention also provides a kind of monitoring method of assembly system, include the following steps：
Step S1, assembling process intelligent monitor system train the image model of each installation step in advance；
Step S2, photographic device carry out Image Acquisition to assembly technology in real time；
Step S3, picture recognition module identify the boundary line of operation instrument, ignore boundary line image and identify operation shape
State and/or violation operation；
Step S4, the monitoring modular find mistake according to described image identification module judging result, and it is wrong to send correction
It accidentally prompts to the alarm module；
Step S5, by display module be used for real-time exhibition chart data and/or report data, including it is following any one
Or more than one information：Each operating procedure of manufacturing schedule, product take, product error rate, producing line error rate.
Further, the monitoring method of assembly system of the present invention further includes when worker's both hands are in direct contact product in step
And/or product leaves imaging area and belongs to violation operation, the monitoring modular, which is sent, corrects miscue to the alarm module.
Assembling process intelligent monitor system, assembly system and its monitoring method through the invention may be implemented following to have
Beneficial effect：
(1) by image recognition technology, automatically by the image during Product Assembly, be converted into can compare, can be with
The data of quantization provide data feedback closed loop for Assembling Production；
(2) by image recognition technology, violation operation during Assembling Production, faulty operation and super can be found in real time
When situation, timely error correction and intervention；
(3) by zero refraction materials tool and working specification, image can be effectively reduced and blocked, image recognition is improved
Accuracy.
Description of the drawings
Attached drawing described herein is used for providing further understanding invention, constitutes the part of the present invention, the present invention
Illustrative embodiments and their description for explaining the present invention, do not constitute improper limitations of the present invention.In the accompanying drawings：
Fig. 1 is the structural schematic diagram of assembling process intelligent monitor system of the present invention.
Specific implementation mode
In order to keep technical problems, technical solutions and advantages to be solved clearer, clear, tie below
Drawings and examples are closed, the present invention will be described in further detail.It should be appreciated that specific embodiment described herein is only used
To explain the present invention, it is not intended to limit the present invention.
An embodiment of the present invention provides a kind of assembly systems, including smooth workbench 1 and assembling process intellectual monitoring system
System.The assembling process intelligent monitor system includes photographic device 2, picture recognition module 3, data memory module 4, monitoring modular
5, alarm module 6, display module 7.
Workbench is provided with fixed operating groove position, is a hollow frame above operating groove position, it is preferred that described hollow
Frame is hollow toroidal frame.Above-mentioned photographic device 2 is equipped with below toroidal frame, the photographic device 2 arrives multiple camera shootings for 1
Head is used for direct shooting operation slot position.Hollow region is broad enough, facilitates producing line worker by toroidal frame hollow region, uses
The operation instrument of zero refraction materials operates product to be assembled.
It should be noted that the hollow frame of the present invention is not limited to toroidal frame structure, it is the hand of people, ring above toroidal frame
Shape frame hollow position is the place that zero refraction materials enter, and is camera below toroidal frame.The benefit of toroidal frame is exactly to separate
Hand and camera, ensure that the shooting of camera is not blocked by hand.
The fixed operating groove position of the present invention refers to that the placement position of assembly product will be in the region of the shooting of camera.
In order to which photographic device 2 clearly can carry out realtime graphic sampling to operating groove position, it is also provided with below toroidal frame
Multiple light bulbs illuminate operating groove position.
Picture recognition module 3 can ignore tool edge lines according to the continuity that tool moves from programmed algorithm
The subtle shooting brought influences.Specifically, picture recognition module 3 is by comparing adjacent two images in changing, it is relatively more current
The difference of moment image and last moment image is that the boundary line of operation instrument is changing, to identify the boundary of tool
Line, ignores the parts of images, is not included in the identification of identification and/or the violation operation of product operation form.
Data memory module 4, for storing graphic pattern discrimination data, product operation image data, product operation form
Identify the data such as data and other correlation times, error statistics.
Monitoring modular 5, was used in the first time for finding mistake, gave producing line worker transmission to correct by alarm module 6 wrong
It accidentally prompts (as using display screen, auditory tone cues), error correction of checking on, while sending the details of the mistake to administrative staff.
Monitoring modular 5, should monitoring operation process, if has violation operation；Then monitoring operation step completion morphology is wanted,
Whether correct images pattern is met.
Display module 7, in a manner of chart data, report data etc., showing each producing line manufacturing schedule, each product in real time
The important informations such as each step takes, the error rate of product and producing line, provide qualitative data for enterprise and feed back, worker provides for producing line
Depth quality examination foundation.
The working specification for formulating strict standard, prevents producing line worker's both hands and is in direct contact product, prevent product and leave camera shooting
Region operates.If one unworkable step, can be executed with the double above handheld tool cooperation.It should be noted that this
The hand for the worker that the working specification for inventing signified formulation strict standard is not limited to meaning of the invention is in direct contact product and/or production
Product leave the operating groove position of imaging area.
Using image recognition, the image model of each installation step is trained in advance, the photo that can be photographed from camera
In, the form of correct installation step is recognized in real time.
It should be noted that in the embodiment of the present invention, it is preferred that operation instrument uses the operative employee of zero refraction materials
Tool, the operation instrument of zero refraction materials can ensure that camera takes product operation form original appearance as much as possible, it is ensured that
In operating process, the appearance of big shelter is not had.Operation instrument is made using zero refraction materials, substitutes manual large area
Block operation, realization includes gripping, viscous any basic operation such as takes, overturns, elapsing, pressing act.
It is certainly contemplated that arriving cost problem, zero refraction materials current price is higher, and the operation instrument for being coated with fluorescence can be taken to replace
The operation instrument of zero refraction materials of generation, picture recognition module ignore the variation of its region according to fluorescence occlusion area,
It has been able to recognise whether that violation stick shift operates.
The refractive index of all known materials is just in nature.It is lost by the nanostructure to artificial sub-wavelength
It carves, realizes the control to light propagation, make occur a negative index in the medium.Then it is that negative medium is same by the refractive index
One refractive index is that positive medium is cascaded so that it is zero that finally obtained nanostructure, which shows like its refractive index,.
Including one kind with SiO2 substrates, silicon column array is embedded in SU-8 waveguides, wraps golden film known zero refraction materials
Planar structure material.The hardness of SiO2 is enough to be used for making some producing line operation instruments.
Corresponding above-mentioned assembling process intelligent monitor system, a kind of monitoring method of assembly system of the present invention, including
Following steps,
Step S1, assembling process intelligent monitor system train the image model of each installation step in advance；
Step S2, photographic device carry out Image Acquisition to assembly technology in real time；
Step S3, picture recognition module identify the boundary line of operation instrument, ignore boundary line image and identify operation shape
State and/or violation operation；Picture recognition module can ignore tool side according to the continuity that tool moves from programmed algorithm
The subtle shooting that edge lines are brought influences；
Step S4, the monitoring modular find mistake according to described image identification module judging result, and it is wrong to send correction
It accidentally prompts to the alarm module；
Step S5, by display module be used for real-time exhibition chart data and/or report data, including it is following any one
Or more than one information：Each operating procedure of manufacturing schedule, product take, product error rate, producing line error rate.
Further, the monitoring method of the assembly system further includes, when worker's both hands are in direct contact product or product
Imaging area is left, the monitoring modular, which is sent, corrects miscue to the alarm module.
Description above describe the preferred embodiment of the present invention, it is to be understood that the present invention is not limited to above-mentioned implementation
Example, and excluding other embodiments should not be regarded as.Enlightenment through the invention, those skilled in the art combine known or existing
The change that technology, knowledge are carried out also should be regarded as within the scope of the present invention.
Claims (10)
1. a kind of assembling process intelligent monitor system, which is characterized in that
The assembling process intelligent monitor system include photographic device (2), picture recognition module (3), data memory module (4),
Monitoring modular (5), alarm module (6)；
The photographic device (2) is used to carry out realtime graphic sampling to operating process, and feeds back to described image identification module
(3)；
The input terminal of described image identification module (3) is connected to the photographic device (2), described image identification module (3) it is defeated
Outlet is respectively connected to the data memory module (4), the monitoring modular (5), and described image identification module (3) is for described
Judgement is identified in the image that photographic device (2) obtains；
The data memory module (4) includes any one following or more than one types for storing dress data, the data
Data：Graphic pattern discrimination data, product operation image data, product operation form identification data and other correlation time numbers
According to, error statistics data；
The monitoring modular (5) finds mistake according to described image identification module (3) judging result, and sends correction miscue
To the alarm module (6).
2. assembling process intelligent monitor system according to claim 1, which is characterized in that
For the assembling process intelligent monitor system including further including display module (7), the display module (7) is used for real-time exhibition
Chart data and/or report data, the display module (7) is for showing following any one or more than one information：Production
Each operating procedure of progress, product take, product error rate, producing line error rate.
3. assembling process intelligent monitor system according to claim 1, which is characterized in that
The alarm module (6) is display screen prompt, sound alarm or light hazard.
4. a kind of assembly system, which is characterized in that
Including smooth workbench (1) and using the assembling process intellectual monitoring system described in the arbitrary claim of claims 1 to 3
System；
The workbench (1) is provided with fixed operating groove position, and hollow frame, the hollow frame are provided with above operating groove position
Lower section is equipped with the photographic device (2), is used for direct shooting operation slot position.
5. assembly system according to claim 4, which is characterized in that
The photographic device (2) is one or more camera.
6. assembly system according to claim 4, which is characterized in that
The hollow frame is toroidal frame, and multiple light bulbs are additionally provided with below the toroidal frame.
7. assembly system according to claim 4, which is characterized in that
For assembly system equipped with operation instrument, the operation element realizes following any one or more than one operation：Folder
It takes, viscous take, overturns, elapsing, pressing.
8. assembly system according to claim 7, which is characterized in that
The operation instrument is the operation instrument of zero refraction materials or the operation instrument for being coated with fluorescence.
9. a kind of monitoring method of assembly system, which is characterized in that include the following steps：
Step S1, assembling process intelligent monitor system train the image model of each installation step in advance；
Step S2, photographic device carry out Image Acquisition to assembly technology in real time；
Step S3, picture recognition module identify the boundary line of operation instrument, ignore boundary line image identify operation form and/
Or violation operation；
Step S4, the monitoring modular find mistake according to described image identification module judging result, and send correction mistake and carry
Show to the alarm module；
Step S5, by display module be used for real-time exhibition chart data and/or report data, including it is following any one or one
Kind information above：Each operating procedure of manufacturing schedule, product take, product error rate, producing line error rate.
10. the monitoring method of assembly system according to claim 9, which is characterized in that
Further include when worker's both hands are in direct contact product and/or product leaves imaging area and belongs to violation operation, the monitoring mould
Block, which is sent, corrects miscue to the alarm module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810209594.5A CN108526834B (en) | 2018-03-14 | 2018-03-14 | Assembling process intelligent monitor system, assembly system and its monitoring method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810209594.5A CN108526834B (en) | 2018-03-14 | 2018-03-14 | Assembling process intelligent monitor system, assembly system and its monitoring method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108526834A true CN108526834A (en) | 2018-09-14 |
| CN108526834B CN108526834B (en) | 2019-10-11 |
Family
ID=63483948
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810209594.5A Active CN108526834B (en) | 2018-03-14 | 2018-03-14 | Assembling process intelligent monitor system, assembly system and its monitoring method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108526834B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110097735A (en) * | 2019-06-04 | 2019-08-06 | 江苏巨龙线缆有限公司 | A kind of cable production safety method for early warning and system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10232938A (en) * | 1996-12-17 | 1998-09-02 | Honda Motor Co Ltd | Image recognizing method |
| CN202887408U (en) * | 2012-07-25 | 2013-04-17 | 三一重机有限公司 | Alarm device and engineering machine provided with the alarm device |
| CN105513061A (en) * | 2015-12-02 | 2016-04-20 | 上海海事大学 | Method for automatically searching and rescuing person in distress on sea through employing unmanned plane |
| CN105631893A (en) * | 2016-03-09 | 2016-06-01 | 中国矿业大学 | Method and device for detecting whether capacitor is correctly mounted through photographing |
| CN106231238A (en) * | 2015-12-31 | 2016-12-14 | 天津天地伟业物联网技术有限公司 | Intellectual analysis early warning The Cloud Terrace |
| CN106571009A (en) * | 2015-10-10 | 2017-04-19 | 重庆卡兴机械厂 | Automobile assembly system dangerous action recognition alarm processing system |
| CN107053170A (en) * | 2016-12-23 | 2017-08-18 | 江苏唯侓机器人科技有限公司 | Mobile phone HOME keys automatic setup system and assembly method |
| CN206472203U (en) * | 2017-03-03 | 2017-09-05 | 天津天地伟业信息系统集成有限公司 | Intelligent high-definition network monitoring all-in-one machine based on acousto-optic warning function |
-
2018
- 2018-03-14 CN CN201810209594.5A patent/CN108526834B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10232938A (en) * | 1996-12-17 | 1998-09-02 | Honda Motor Co Ltd | Image recognizing method |
| CN202887408U (en) * | 2012-07-25 | 2013-04-17 | 三一重机有限公司 | Alarm device and engineering machine provided with the alarm device |
| CN106571009A (en) * | 2015-10-10 | 2017-04-19 | 重庆卡兴机械厂 | Automobile assembly system dangerous action recognition alarm processing system |
| CN105513061A (en) * | 2015-12-02 | 2016-04-20 | 上海海事大学 | Method for automatically searching and rescuing person in distress on sea through employing unmanned plane |
| CN106231238A (en) * | 2015-12-31 | 2016-12-14 | 天津天地伟业物联网技术有限公司 | Intellectual analysis early warning The Cloud Terrace |
| CN105631893A (en) * | 2016-03-09 | 2016-06-01 | 中国矿业大学 | Method and device for detecting whether capacitor is correctly mounted through photographing |
| CN107053170A (en) * | 2016-12-23 | 2017-08-18 | 江苏唯侓机器人科技有限公司 | Mobile phone HOME keys automatic setup system and assembly method |
| CN206472203U (en) * | 2017-03-03 | 2017-09-05 | 天津天地伟业信息系统集成有限公司 | Intelligent high-definition network monitoring all-in-one machine based on acousto-optic warning function |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110097735A (en) * | 2019-06-04 | 2019-08-06 | 江苏巨龙线缆有限公司 | A kind of cable production safety method for early warning and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108526834B (en) | 2019-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110322147A (en) | A kind of Project Supervision approaches to IM and system | |
| CN105051781B (en) | NI Vision Builder for Automated Inspection and the method for the long-range quality inspection for product | |
| CN105874473A (en) | Apparatus and method for acquiring image for iris recognition using distance of facial feature | |
| US8237838B2 (en) | Image sensing apparatus and control method thereof | |
| JP2005057782A (en) | System and method for improving image capturing capability | |
| CN101409826A (en) | Information processing apparatus and remote indication system | |
| WO2021072949A1 (en) | Method and device for automatically checking pressing plates | |
| CN109858809A (en) | Learning quality appraisal procedure and system based on the analysis of classroom students ' behavior | |
| CN110972519B (en) | Information providing system and information providing method | |
| CN109849008A (en) | A kind of robot checking method and system based on national treasury | |
| CN108526834B (en) | Assembling process intelligent monitor system, assembly system and its monitoring method | |
| EP3443514A1 (en) | System and method for liquid handling quality assurance | |
| CN105979152A (en) | Smart shooting system | |
| CN107065808A (en) | Accessories of a product method for posting, quality detecting method and production line system | |
| US10574979B2 (en) | Image sensor having a processing part for reading and/or writing information from/to the memory of each of modularized components | |
| WO2015141871A1 (en) | Method for managing active multi-dimensional construction process | |
| CN107346224B (en) | Display window control method, system and the device of tiled display equipment | |
| CN113012141B (en) | Wire color recognition and automatic sequencing system and method | |
| CN106846302A (en) | The detection method and the examination platform based on the method for a kind of correct pickup of instrument | |
| CN100454978C (en) | Imaging apparatus and method for controlling display device | |
| CN109492899A (en) | A kind of service management for production equipment | |
| CN107656623A (en) | AR systems for power transformation inspection | |
| CN109741422B (en) | Intelligent wiring auxiliary method and intelligent wiring auxiliary system | |
| CN111209320A (en) | Method and system for collecting education information data | |
| CN108718532A (en) | Information processing unit, information processing method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |