CN108526834B - Assembling process intelligent monitor system, assembly system and its monitoring method - Google Patents
Assembling process intelligent monitor system, assembly system and its monitoring method Download PDFInfo
- Publication number
- CN108526834B CN108526834B CN201810209594.5A CN201810209594A CN108526834B CN 108526834 B CN108526834 B CN 108526834B CN 201810209594 A CN201810209594 A CN 201810209594A CN 108526834 B CN108526834 B CN 108526834B
- Authority
- CN
- China
- Prior art keywords
- module
- data
- assembling process
- assembly
- product
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23P—METAL-WORKING NOT OTHERWISE PROVIDED FOR; COMBINED OPERATIONS; UNIVERSAL MACHINE TOOLS
- B23P19/00—Machines for simply fitting together or separating metal parts or objects, or metal and non-metal parts, whether or not involving some deformation; Tools or devices therefor so far as not provided for in other classes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/0006—Industrial image inspection using a design-rule based approach
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30164—Workpiece; Machine component
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
Abstract
The invention discloses assembling process intelligent monitor system, assembly system and its monitoring method, the assembling process intelligent monitor system includes photographic device, picture recognition module, data memory module, monitoring modular, alarm module.Assembly manipulation is carried out using the operational instrument of zero refraction materials in assembly system, image sampling is carried out to assembly technology by photographic device, and wrong identification and monitoring statisticss are carried out to technique by picture recognition module, mistake is found according to described image identification module judging result, and it sends and corrects miscue to the alarm module, using present system and its method, have assembling process whole process it is recordable, it is recognizable, can error correction, digitization, for assembly producing line data feedback closed loop is provided the advantages that.
Description
Technical field
The present invention relates to assembling process technique fields, and in particular to a kind of assembling process intelligent monitor system, assembly system
And its monitoring method.
Background technique
Existing workshop assemble electronic product, it is often necessary to electronic component hand-manipulated, but each installation step whether
Correctly, it is to be realized by the artificial judgment of operator, lacks monitoring, judgement and the data acquisition of whole information.
Summary of the invention
It is an object of the invention to overcome prior art problem, a kind of assembling process intelligent monitor system, assembly system are proposed
System and its monitoring method.
The present invention designs a set of assembly intelligent monitor system, installation step key element is standardized, using zero refractive index
Meta Materials, image recognition technology, big data analysis technology can be monitored in real time each step of assembly, specifically include such as lower section
Case.The present invention provides a kind of assembling process intelligent monitor systems, including photographic device (2), picture recognition module (3), data
Memory module (4), monitoring modular (5), alarm module (6)；
The photographic device (2) is used to carry out realtime graphic sampling to operating process, and feeds back to described image identification mould
Block (3)；
The input terminal of described image identification module (3) is connected to the photographic device (2), described image identification module (3)
Output end be respectively connected to the data memory module (4), the monitoring modular (5), described image identification module (3) is used for
The image that the photographic device (2) obtains carries out identification judgement；
For the data memory module (4) for storing dress data, the data include following any one or more than one
Categorical data: when graphic pattern discrimination data, product operation image data, product operation form identification data and other correlations
Between data, error statistics data；
The monitoring modular (5) finds mistake according to described image identification module (3) judging result, and sends correction mistake
It prompts to the alarm module (6).
Further, the assembling process intelligent monitor system of the invention is including further including display module (7), the exhibition
Show module (7) for real-time exhibition chart data and/or report data, the display module (7) is following any one for showing
Kind or more than one information: each operating procedure time-consuming of manufacturing schedule, product, product error rate, producing line error rate.
Preferably, the alarm module (6) of the invention is display screen prompt, sound alarm or light hazard.
Corresponding above-mentioned assembling process intelligent monitor system, the present invention provides a kind of assembly systems, including smooth work
Make platform (1) and above-mentioned assembling process intelligent monitor system；The workbench (1) is provided with fixed operation slot position, operation
It is provided with hollow frame above slot position, is equipped with the photographic device (2) below the hollow frame, is used for direct shooting operation slot
Position.
Further, the photographic device (2) is one or more camera, can be configured according to actual needs
The number of corresponding camera.
Preferably, the hollow frame of the invention is toroidal frame, is additionally provided with multiple light bulbs below the toroidal frame.
Further, assembly system is equipped with operational instrument, the operation element realize it is following any one or it is a kind of with
On operation: clamping viscous take, overturns, elapsing, pressing.
Further, the embodiment of the present invention, it is preferred that operational instrument is the operational instrument of zero refraction materials or is coated with glimmering
The operational instrument of light.
Correspondingly, including the following steps: the present invention also provides a kind of monitoring method of assembly system
Step S1, assembling process intelligent monitor system train the image model of each installation step in advance；
Step S2, photographic device carry out Image Acquisition to assembly technology in real time；
Step S3, picture recognition module identify the boundary line of operational instrument, ignore boundary line image and identify operation shape
State and/or violation operation；
Step S4, the monitoring modular find mistake according to described image identification module judging result, and it is wrong to send correction
It accidentally prompts to the alarm module；
Step S5 is used for real-time exhibition chart data and/or report data by display module, includes any of the following
Or more than one information: each operating procedure time-consuming of manufacturing schedule, product, product error rate, producing line error rate.
Further, the monitoring method of assembly system of the present invention further includes when the direct contact product of worker's both hands in step
And/or product leaves imaging area and belongs to violation operation, the monitoring modular, which is sent, corrects miscue to the alarm module.
Assembling process intelligent monitor system, assembly system and its monitoring method through the invention may be implemented following to have
Beneficial effect:
(1) by image recognition technology, automatically by the image during Product Assembly, be converted into can compare, can be with
The data of quantization provide data feedback closed loop for Assembling Production；
(2) by image recognition technology, violation operation during Assembling Production, faulty operation and super can be found in real time
When situation, timely error correction and intervention；
(3) by zero refraction materials tool and working specification, image can be effectively reduced and blocked, image recognition is improved
Accuracy.
Detailed description of the invention
Attached drawing described herein is used to provide to further understand invention, constitutes a part of the invention, the present invention
Illustrative embodiments and their description be used to explain the present invention, do not constitute improper limitations of the present invention.In the accompanying drawings:
Fig. 1 is the structural schematic diagram of assembling process intelligent monitor system of the present invention.
Specific embodiment
In order to be clearer and more clear technical problems, technical solutions and advantages to be solved, tie below
Drawings and examples are closed, the present invention will be described in further detail.It should be appreciated that specific embodiment described herein is only used
To explain the present invention, it is not intended to limit the present invention.
The embodiment of the invention provides a kind of assembly systems, including smooth workbench 1 and assembling process intellectual monitoring system
System.The assembling process intelligent monitor system includes photographic device 2, picture recognition module 3, data memory module 4, monitoring modular
5, alarm module 6, display module 7.
Workbench is provided with fixed operation slot position, is a hollow frame above operation slot position, it is preferred that described hollow
Frame is hollow toroidal frame.Above-mentioned photographic device 2 is equipped with below toroidal frame, the photographic device 2 arrives multiple camera shootings for 1
Head is used for direct shooting operation slot position.Hollow region is broad enough, facilitates producing line worker by toroidal frame hollow region, uses
The operational instrument of zero refraction materials operates product to be assembled.
It should be noted that hollow frame of the invention is not limited to toroidal frame structure, it is the hand of people, ring above toroidal frame
Shape frame hollow position is the place that zero refraction materials enter, and is camera below toroidal frame.The benefit of toroidal frame is exactly to separate
Hand and camera, guarantee that the shooting of camera is not blocked by hand.
The fixed operation slot position of the present invention refers to that the placement position of assembly product will be in the region of the shooting of camera.
In order to which photographic device 2 clearly can carry out realtime graphic sampling to operation slot position, it is also provided with below toroidal frame
Multiple light bulbs illuminate operation slot position.
Picture recognition module 3 can ignore tool edge lines from programmed algorithm according to the mobile continuity of tool
The subtle shooting of bring influences.Specifically, picture recognition module 3 is by comparing adjacent two images in variation, it is relatively more current
The difference of moment image and last moment image is that the boundary line of operational instrument is changing, to identify the boundary of tool
Line, ignores the parts of images, is not included in the identification of identification and/or the violation operation of product operation form.
Data memory module 4, for storing graphic pattern discrimination data, product operation image data, product operation form
Identify the data such as data and other correlation times, error statistics.
Monitoring modular 5, for giving producing line worker to send correction by alarm module 6 wrong in the first time of discovery mistake
The error correction of checking on (as used display screen, auditory tone cues) is accidentally prompted, while sending the details of the mistake to administrative staff.
Monitoring modular 5, should monitoring operation process, if has violation operation；Then monitoring operation step completion morphology is wanted,
Whether correct images mode is met.
Display module 7, in a manner of chart data, report data etc., showing each producing line manufacturing schedule, each product in real time
The important informations such as the error rate of each step time-consuming, product and producing line provide qualitative data feedback for enterprise, and for producing line, worker is provided
Depth quality examination foundation.
The working specification for formulating strict standard, prevents the direct contact product of producing line worker's both hands, prevents product and leave camera shooting
Region operation.If one unworkable step, can be executed with the double above handheld tool cooperation.It should be noted that this
The working specification for inventing signified formulation strict standard is not limited to the direct contact product of hand and/or the production of signified worker of the invention
Product leave the operation slot position of imaging area.
Using image recognition, the image model of each installation step is trained in advance, the photo that can be photographed from camera
In, the form of correct installation step is recognized in real time.
It should be noted that in the embodiment of the present invention, it is preferred that operational instrument uses the operative employee of zero refraction materials
Tool, the operational instrument of zero refraction materials can guarantee that camera takes product operation form original appearance as much as possible, it is ensured that
In operating process, the appearance of big shelter is not had.Operational instrument is made using zero refraction materials, substitutes manual large area
Operation is blocked, realizes and any basic operation movement such as takes, overturns, elapsing, pressing including clamping, gluing.
It is certainly contemplated that arriving cost problem, zero refraction materials current price is higher, and the operational instrument for being coated with fluorescence can be taken to replace
The operational instrument of zero refraction materials of generation, picture recognition module ignore the variation of its region according to fluorescence occlusion area,
It has been able to recognise whether that violation stick shift operates.
The refractive index of all known materials is positive in nature.It is lost by the nanostructure to artificial sub-wavelength
It carves, realizes the control to light propagation, make occur a negative index in the medium.Then the medium refractive index being negative is same
The medium that one refractive index is positive is cascaded, so that it is zero that finally obtained nanostructure, which shows like its refractive index,.
Known zero refraction materials include one kind with SiO2 substrate, and silicon column array is embedded in SU-8 waveguide, wraps golden film
Planar structure material.The hardness of SiO2 is enough to be used to make some producing line operational instrument.
Corresponding above-mentioned assembling process intelligent monitor system, a kind of monitoring method of assembly system of the present invention, including
Following steps,
Step S1, assembling process intelligent monitor system train the image model of each installation step in advance；
Step S2, photographic device carry out Image Acquisition to assembly technology in real time；
Step S3, picture recognition module identify the boundary line of operational instrument, ignore boundary line image and identify operation shape
State and/or violation operation；Picture recognition module can ignore tool side from programmed algorithm according to the mobile continuity of tool
The subtle shooting of edge lines bring influences；
Step S4, the monitoring modular find mistake according to described image identification module judging result, and it is wrong to send correction
It accidentally prompts to the alarm module；
Step S5 is used for real-time exhibition chart data and/or report data by display module, includes any of the following
Or more than one information: each operating procedure time-consuming of manufacturing schedule, product, product error rate, producing line error rate.
Further, the monitoring method of the assembly system further includes, when the direct contact product of worker's both hands or product
Imaging area is left, the monitoring modular, which is sent, corrects miscue to the alarm module.
Description above describe the preferred embodiment of the present invention, it is to be understood that the present invention is not limited to above-mentioned implementation
Example, and excluding other embodiments should not be regarded as.Enlightenment through the invention, those skilled in the art combine known or existing
The change that technology, knowledge are carried out also should be regarded as within the scope of the present invention.
Claims (10)
1. a kind of assembling process intelligent monitor system, which is characterized in that
The assembling process intelligent monitor system include photographic device (2), picture recognition module (3), data memory module (4),
Monitoring modular (5), alarm module (6)；
The photographic device (2) is used to carry out realtime graphic sampling to operating process, and feeds back to described image identification module
(3)；
The input terminal of described image identification module (3) is connected to the photographic device (2), described image identification module (3) it is defeated
Outlet is respectively connected to the data memory module (4), the monitoring modular (5), and described image identification module (3) is for described
The image that photographic device (2) obtains carries out identification judgement；
For the data memory module (4) for storing dress data, the data include following any one or more than one type
Data: graphic pattern discrimination data, product operation image data, product operation form identification data and other correlation time numbers
According to, error statistics data；
It is subtle that described image identification module (3) according to the mobile continuity of operational instrument ignores operational instrument edge line bring
Shooting influences, and the operational instrument is assembly manipulation tool；
The monitoring modular (5) finds mistake according to described image identification module (3) judging result, and sends correction miscue
To the alarm module (6)；
Whether the monitoring modular (5) has violation operation and monitoring operation step completion morphology for monitoring operation process, is
It is no to meet correct images mode.
2. assembling process intelligent monitor system according to claim 1, which is characterized in that
Described image identification module (3) compared current time image and upper a period of time by comparing adjacent two images in variation
The difference of needle drawing picture is that the boundary line of operational instrument is changing, to identify the boundary line of operational instrument, ignores the portion
Partial image is not included in the identification of identification and/or the violation operation of product operation form；
For the assembling process intelligent monitor system including further including display module (7), the display module (7) is used for real-time exhibition
Chart data and/or report data, the display module (7) is for showing following any one or more than one information: production
Each operating procedure time-consuming of progress, product, product error rate, producing line error rate.
3. assembling process intelligent monitor system according to claim 1, which is characterized in that
The alarm module (6) is display screen prompt, sound alarm or light hazard.
4. a kind of assembly system, which is characterized in that
Including smooth workbench (1) and using assembling process intellectual monitoring system described in any claim of claims 1 to 3
System；
The workbench (1) is provided with fixed operation slot position, is provided with hollow frame, the hollow frame above operation slot position
Lower section is equipped with the photographic device (2), is used for direct shooting operation slot position.
5. assembly system according to claim 4, which is characterized in that
The photographic device (2) is one or more camera.
6. assembly system according to claim 4, which is characterized in that
The hollow frame is toroidal frame, is additionally provided with multiple light bulbs below the toroidal frame.
7. assembly system according to claim 4, which is characterized in that
For assembly system equipped with operational instrument, the operation element realizes the operation of following any one or more than one: folder
It takes, viscous take, overturns, elapsing, pressing.
8. assembly system according to claim 7, which is characterized in that
The operational instrument is the operational instrument of zero refraction materials or the operational instrument for being coated with fluorescence.
9. a kind of monitoring method of assembly system, which comprises the steps of:
Step S1, assembling process intelligent monitor system train the image model of each installation step in advance；
Step S2, photographic device carry out Image Acquisition to assembly technology in real time；
Step S3, picture recognition module identify the boundary line of operational instrument, ignore boundary line image identify operation form and/
Or violation operation；
Step S4, monitoring modular find mistake according to described image identification module judging result, and send and correct miscue extremely
Alarm module；
Step S5 is used for real-time exhibition chart data and/or report data by display module, includes any of the following or one
Kind information above: each operating procedure time-consuming of manufacturing schedule, product, product error rate, producing line error rate.
10. the monitoring method of assembly system according to claim 9, which is characterized in that
It further include when the direct contact product of worker's both hands and/or product leave imaging area and belong to violation operation, the monitoring mould
Block, which is sent, corrects miscue to the alarm module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810209594.5A CN108526834B (en) | 2018-03-14 | 2018-03-14 | Assembling process intelligent monitor system, assembly system and its monitoring method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810209594.5A CN108526834B (en) | 2018-03-14 | 2018-03-14 | Assembling process intelligent monitor system, assembly system and its monitoring method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108526834A CN108526834A (en) | 2018-09-14 |
| CN108526834B true CN108526834B (en) | 2019-10-11 |
Family
ID=63483948
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810209594.5A Active CN108526834B (en) | 2018-03-14 | 2018-03-14 | Assembling process intelligent monitor system, assembly system and its monitoring method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108526834B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110097735A (en) * | 2019-06-04 | 2019-08-06 | 江苏巨龙线缆有限公司 | A kind of cable production safety method for early warning and system |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3894522B2 (en) * | 1996-12-17 | 2007-03-22 | 本田技研工業株式会社 | Image recognition method |
| CN202887408U (en) * | 2012-07-25 | 2013-04-17 | 三一重机有限公司 | Alarm device and engineering machine provided with the alarm device |
| CN106571009A (en) * | 2015-10-10 | 2017-04-19 | 重庆卡兴机械厂 | Automobile assembly system dangerous action recognition alarm processing system |
| CN105513061B (en) * | 2015-12-02 | 2018-06-19 | 上海海事大学 | It is a kind of to carry out the automatic rescue method of maritime peril personnel using unmanned plane |
| CN106231238A (en) * | 2015-12-31 | 2016-12-14 | 天津天地伟业物联网技术有限公司 | Intellectual analysis early warning The Cloud Terrace |
| CN105631893A (en) * | 2016-03-09 | 2016-06-01 | 中国矿业大学 | Method and device for detecting whether capacitor is correctly mounted through photographing |
| CN107053170A (en) * | 2016-12-23 | 2017-08-18 | 江苏唯侓机器人科技有限公司 | Mobile phone HOME keys automatic setup system and assembly method |
| CN206472203U (en) * | 2017-03-03 | 2017-09-05 | 天津天地伟业信息系统集成有限公司 | Intelligent high definition network monitoring all-in-one based on acousto-optic function |
-
2018
- 2018-03-14 CN CN201810209594.5A patent/CN108526834B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN108526834A (en) | 2018-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102110332B (en) | Book registering and managing device based on computer vision and radio frequency identification technology | |
| CN105051781B (en) | NI Vision Builder for Automated Inspection and the method for the long-range quality inspection for product | |
| CN101409826B (en) | Information processing apparatus and remote indication system | |
| JP4288215B2 (en) | System and method for improving image capture capability | |
| CN111260325A (en) | Bridge construction progress management system based on BIM | |
| US8237838B2 (en) | Image sensing apparatus and control method thereof | |
| CN105335828A (en) | Operation method of production management | |
| CN108526834B (en) | Assembling process intelligent monitor system, assembly system and its monitoring method | |
| JP2017069963A (en) | Data collection system of display panel and operation panel, device, method, program and recording medium | |
| EP3443514A1 (en) | System and method for liquid handling quality assurance | |
| CN109849008A (en) | A kind of robot checking method and system based on national treasury | |
| CN105979152A (en) | Smart shooting system | |
| CN110459128A (en) | A kind of control method of electronics class board and electronics class board | |
| CN108549840A (en) | A kind of method and device that analog instrument simultaneously and rapidly identifies | |
| CN107065808A (en) | Accessories of a product method for posting, quality detecting method and production line system | |
| KR102485816B1 (en) | Crop growth analysis system using image collection device | |
| CN109814288A (en) | A kind of method and system of automatic detection panel backlight | |
| CN109492899A (en) | A kind of service management for production equipment | |
| CN114898358A (en) | Product identification system | |
| CN108769536A (en) | Patterning process, patterning apparatus and the computer readable storage medium of photograph taking | |
| CN107346224A (en) | Display window control method, system and the device of tiled display equipment | |
| CN100454978C (en) | Imaging apparatus and method for controlling display device | |
| CN114444856A (en) | Auxiliary assembly system | |
| CN106846302A (en) | The detection method and the examination platform based on the method for a kind of correct pickup of instrument | |
| US20240112466A1 (en) | System and method for analyzing periodic task |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |