CN105844281A - Automatic form set parameter acquiring system and method - Google Patents
Automatic form set parameter acquiring system and method Download PDFInfo
- Publication number
- CN105844281A CN105844281A CN201610333734.0A CN201610333734A CN105844281A CN 105844281 A CN105844281 A CN 105844281A CN 201610333734 A CN201610333734 A CN 201610333734A CN 105844281 A CN105844281 A CN 105844281A
- Authority
- CN
- China
- Prior art keywords
- forms
- module
- picture
- software
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Abstract
The invention discloses an automatic form set parameter acquiring system and method. A form characteristic module is recorded to record the number of software forms, and numbering is carried out. Each form characteristic and the pixel position of the characteristic in a software form are determined, so that the number of a currently displayed form is determined through the characteristic. An interested region is marked for each form, and the pixel position of the region in the software form is recorded. A video acquisition module acquires a display picture. A picture comparison module compares a currently acquired picture and a picture acquired last time to determine whether window switching is carried out. A character recognition module carries out character recognition on the acquired interested region image. A recognition result is a part with a changed software parameter. The system carries out form characteristic recognition and interested region marking on control software for the first time, which consumes a certain amount of manpower cost. Taking into account rapid production and large-scale production of manufacturing industry, the method is a simple, economical and effective technical scheme.
Description
Technical field
The present invention relates to the whole process order in large-scale industrial production flow process, follow-up of quality field, belong to
Automatically monitoring and the acquisition of machining parameter, particularly relates to a kind of automatically acquisition on forms and arranges system of parameters
System and method.
Background technology
Nowadays, many domestic and international conventionally manufactured enterprises all production under exploring " industry 4.0 " framework,
Supply the digitized with distribution chain and networking, it is achieved material source, the record of machining information to product
Become the most requisite link.Although new-type processing machine mostly achieves digitized and net
Network, but in the workshop of current conventionally manufactured enterprise, still it is flooded with the most old-fashioned, the processing of non-network
Machine, the many in these machines is not because the reason such as the technical know-how of producer and guarantee production safety all has
Opening interface, even also has many to be encrypted the data within machine.How to realize this
A little the rapid automatized of older machines machined parameters have obtained into the production line number that these are contained older machines
Word and the emphasis of network transformation and difficult point.
Summary of the invention
It is an object of the invention to overcome the shortcoming and defect of above-mentioned prior art, it is provided that a kind of simple and effective
Automatically obtain on forms, parameter system and method be set.Thus realize digitized and the net of traditional manufacture
Networkization is transformed.
The present invention is achieved through the following technical solutions:
A kind of automatically acquisition on forms arranges parameter system, the record forms feature connected including telecommunication successively
Module, labelling area-of-interest module, video acquiring module, picture comparison module and character recognition module；
Described record forms characteristic module；For the number of logging software forms and be numbered, determine every
The feature of individual forms and this feature location of pixels in software forms so that can be sentenced by this this feature
The numbering of the forms of display on disconnected present displays；
Described labelling area-of-interest module；For region interested in each forms labelling, and record
This region location of pixels in software forms；
Described video acquiring module；For obtaining display picture；
Described picture comparison module；For the relatively more current picture obtained and the last picture obtained, sentence
Break and whether carried out the switching of forms；
Described character recognition module；For the image of the area-of-interest obtained is carried out character recognition,
The result identified is i.e. the part that software parameter has changed.
Described picture comparison module includes picture comparison module A, picture comparison module B；Without entering
Row forms switch, and described picture comparison module A then judges whether area-of-interest changes, if sent out
Changing then carries out image segmentation according to its location of pixels, obtains the image in the region changed；If window
Body is switched, and the picture that described picture comparison module B more currently obtains is worked as with last acquisition
The picture of front forms, it is judged that whether area-of-interest changes, if it occur that change is then according to its pixel
Position carries out image segmentation, obtains the image in the region changed.
A kind of method arranging parameter on automatic acquisition forms is as follows:
Step S1: by recording the number of forms characteristic module logging software forms and being numbered, determine
The feature of each forms and this feature location of pixels in software forms so that this this feature can be passed through
Judge the numbering of the forms of display on present displays；
Step S2: the region that labelling area-of-interest module is interested in each forms labelling, and record should
Region location of pixels in software forms；
Step S3: video acquiring module obtains display picture；
Step S4: the picture that picture comparison module more currently obtains and the last picture obtained, it is judged that
Whether carry out the switching of forms；
Step S5: the image of the character recognition module area-of-interest to obtaining carries out character recognition, knows
Other result is i.e. the part that software parameter has changed.
Judge whether to the switching of forms described in above-mentioned steps S4, realized especially by following steps:
Identified currently by the forms feature of record forms characteristic module record location of pixels in software forms
Window number；The relatively forms of last acquisition, it may be judged whether carried out the switching of forms.
Video acquiring module described in above-mentioned steps S3 obtains the mode of display picture, is divided into following three kinds of sides
In formula, any one mode obtains:
A uses operating system API to intercept display picture；
B uses fixed cameras to take pictures indicator screen；
C carries out signals collecting to the data wire connecting display, obtains display picture.
The image of the area-of-interest to obtaining of the character recognition module described in above-mentioned steps S5 carries out character knowledge
Not, specifically refer to: only intercept software parameter changing unit and carry out character recognition, and not to whole software
Forms are identified.
The image of the area-of-interest to obtaining of the character recognition module described in above-mentioned steps S5 carries out character knowledge
Not, specifically: using three layers of BP neural net method, the process that will identify is divided into input layer, hidden layer
And output layer.
The image of the area-of-interest to obtaining of the character recognition module described in step S5 carries out character recognition,
Comprise the steps:
Step S5-1, Image semantic classification: image is carried out binaryzation, smoothing processing and edge and strengthens；
Step S5-2, image is split: image goes segmentation, column split successively, obtains single character；
Step S5-3, BP neural network recognization: each character is identified；
Step S5-4, obtains result: each character splicing after identifying obtains final parameter.
The present invention, relative to prior art, has such advantages as and effect:
The present invention is in the case of being not related to the storage inside data of processing machine, it is achieved that to controlling software
The rapid automatized extraction of parameter is set, an above-mentioned difficult problem can be efficiently solved.Meanwhile, directly with add
Work machine contacts, it is ensured that the safety in production process.
The present invention catches the software design patterns parameter controlling software by the way of obtaining display picture.
The present invention obtains display picture and following three kinds of method: A can be used to use operating system API to intercept
Display picture；B uses fixed cameras to take pictures indicator screen；The C data wire to connecting display
Carry out signals collecting, obtain display picture.
Owing to the present invention can realize the customization to all control softwares, so being applicable to all containing aobvious
Show the processing machine of device and Industrial Control Computer.
Although the labelling needs of the forms feature identification and area-of-interest that control software are disappeared by this method first
Consume certain human cost, but, the feature of big volume of production quick in view of manufacturing industry volume of production, this side
Method is economical and effective.
Accompanying drawing explanation
Fig. 1 is that the present invention automatically obtains and arranges parameter system block diagram on forms.
Fig. 2 is three layers of BP neural network model figure.
Detailed description of the invention
Below in conjunction with specific embodiment, the present invention is more specifically described in detail.
Embodiment
As shown in Figure 1, 2.The invention discloses a kind of automatically acquisition on forms and parameter system is set, including
Successively telecommunication connect record forms characteristic module, labelling area-of-interest module, video acquiring module,
Picture comparison module and character recognition module；
Described record forms characteristic module；For the number of logging software forms and be numbered, determine every
The feature of individual forms and this feature location of pixels in software forms so that can be sentenced by this this feature
The numbering of the forms of display on disconnected present displays；
Described labelling area-of-interest module；For region interested in each forms labelling, and record
This region location of pixels in software forms；
Described video acquiring module；For obtaining display with certain frequency (a time 1 second～10 seconds)
Device picture；
Described picture comparison module；For the relatively more current picture obtained and the last picture obtained, sentence
Break and whether carried out the switching of forms；
Described character recognition module；For the image of the area-of-interest obtained is carried out character recognition,
The result identified is i.e. the part that software parameter has changed.
Described picture comparison module includes picture comparison module A, picture comparison module B；Without entering
Row forms switch, and described picture comparison module A then judges whether area-of-interest changes, if sent out
Changing then carries out image segmentation according to its location of pixels, obtains the image in the region changed；If window
Body is switched, and the picture that described picture comparison module B more currently obtains is worked as with last acquisition
The picture of front forms, it is judged that whether area-of-interest changes, if it occur that change is then according to its pixel
Position carries out image segmentation, obtains the image in the region changed.
Automatically obtain the method that parameter is set on forms, can be achieved through the following technical solutions:
Step S1: by recording the number of forms characteristic module logging software forms and being numbered, determine
The feature of each forms and this feature location of pixels in software forms so that this this feature can be passed through
Judge the numbering of the forms of display on present displays；
Step S2: the region that labelling area-of-interest module is interested in each forms labelling, and record should
Region location of pixels in software forms；
Step S3: video acquiring module obtains display picture；
Step S4: the picture that picture comparison module more currently obtains and the last picture obtained, it is judged that
Whether carry out the switching of forms；
Step S5: the image of the character recognition module area-of-interest to obtaining carries out character recognition, knows
Other result is i.e. the part that software parameter has changed.
Judge whether to the switching of forms described in above-mentioned steps S4, realized especially by following steps:
Identified by the forms feature of record forms characteristic module record location of pixels in software forms
Current window is numbered；
The relatively forms of last acquisition, it may be judged whether carried out the switching of forms.
Video acquiring module described in above-mentioned steps S3 obtains the mode of display picture, is divided into following three kinds of sides
In formula, any one mode obtains:
A uses operating system API to intercept display picture；
B uses fixed cameras to take pictures indicator screen；
C carries out signals collecting to the data wire connecting display, obtains display picture.
The image of the area-of-interest to obtaining of the character recognition module described in above-mentioned steps S5 carries out character knowledge
Not, specifically refer to: only intercept software parameter changing unit and carry out character recognition, and not to whole software
Forms are identified.
The image of the area-of-interest to obtaining of the character recognition module described in above-mentioned steps S5 carries out character knowledge
Not, specifically: using three layers of BP neural net method, the process that will identify is divided into input layer, hidden layer
And output layer.
The image of the area-of-interest to obtaining of the character recognition module described in step S5 carries out character recognition,
Comprise the steps:
Step S5-1, Image semantic classification: image is carried out binaryzation, smoothing processing and edge and strengthens；
Step S5-2, image is split: image goes segmentation, column split successively, obtains single character；
Step S5-3, BP neural network recognization: each character is identified；
Step S5-4, obtains result: each character splicing after identifying obtains final parameter.
As it has been described above, just can preferably realize the present invention.
Embodiments of the present invention are also not restricted to the described embodiments, and other are any without departing from the present invention's
The change made under spirit and principle, modify, substitute, combine, simplify, all should be putting of equivalence
Change mode, within being included in protection scope of the present invention.
Claims (8)
1. on automatic acquisition forms, parameter system is set, it is characterised in that include what telecommunication successively connected
Record forms characteristic module, labelling area-of-interest module, video acquiring module, picture comparison module and
Character recognition module；
Described record forms characteristic module；For the number of logging software forms and be numbered, determine every
The feature of individual forms and this feature location of pixels in software forms so that can be sentenced by this this feature
The numbering of the forms of display on disconnected present displays；
Described labelling area-of-interest module；For region interested in each forms labelling, and record
This region location of pixels in software forms；
Described video acquiring module；For obtaining display picture；
Described picture comparison module；For the relatively more current picture obtained and the last picture obtained, sentence
Break and whether carried out the switching of forms；
Described character recognition module；For the image of the area-of-interest obtained is carried out character recognition,
The result identified is i.e. the part that software parameter has changed.
The most automatically obtain on forms and parameter system is set, it is characterised in that be described
Picture comparison module includes picture comparison module A, picture comparison module B；
Switching if not done by forms, described picture comparison module A then judges whether area-of-interest is sent out
Changing, if it occur that change then carries out image segmentation according to its location of pixels, obtains the region changed
Image；
If forms are switched, the picture and upper that described picture comparison module B more currently obtains
The picture of the current form of secondary acquisition, it is judged that whether area-of-interest changes, if it occur that change is then
Carry out image segmentation according to its location of pixels, obtain the image in the region changed.
3. the method that parameter is set on automatic acquisition forms, it is characterised in that use claim 1 or
Automatically obtain described in 2 and on forms, parameter system realization is set, comprise the steps:
Step S1: by recording the number of forms characteristic module logging software forms and being numbered, determine
The feature of each forms and this feature location of pixels in software forms so that this this feature can be passed through
Judge the numbering of the forms of display on present displays；
Step S2: the region that labelling area-of-interest module is interested in each forms labelling, and record should
Region location of pixels in software forms；
Step S3: video acquiring module obtains display picture；
Step S4: the picture that picture comparison module more currently obtains and the last picture obtained, it is judged that
Whether carry out the switching of forms；
Step S5: the image of the character recognition module area-of-interest to obtaining carries out character recognition, knows
Other result is i.e. the part that software parameter has changed.
The most automatically the method that parameter is set on forms is obtained, it is characterised in that step
Judge whether to the switching of forms described in rapid S4, realized especially by following steps:
Identified by the forms feature of record forms characteristic module record location of pixels in software forms
Current window is numbered；
The relatively forms of last acquisition, it may be judged whether carried out the switching of forms.
The most automatically the method that parameter is set on forms is obtained, it is characterised in that step
Video acquiring module described in rapid S3 obtains the mode of display picture, is divided in following three kinds of modes any one
The mode of kind obtains:
A uses operating system API to intercept display picture；
B uses fixed cameras to take pictures indicator screen；
C carries out signals collecting to the data wire connecting display, obtains display picture.
The most automatically the method that parameter is set on forms is obtained, it is characterised in that step
Described in rapid S5, the image of the character recognition module area-of-interest to obtaining carries out character recognition, specifically
Refer to: only intercept software parameter changing unit and carry out character recognition, and the forms of whole software are not known
Not.
The most automatically the method that parameter is set on forms is obtained, it is characterised in that
The image of the area-of-interest to obtaining of the character recognition module described in step S5 carries out character recognition, specifically
It is: using three layers of BP neural net method, the process that will identify is divided into input layer, hidden layer and output layer.
The most automatically the method that parameter is set on forms is obtained, it is characterised in that
The image of the area-of-interest to obtaining of the character recognition module described in step S5 carries out character recognition,
Comprise the steps:
Step S5-1, Image semantic classification: image is carried out binaryzation, smoothing processing and edge and strengthens；
Step S5-2, image is split: image goes segmentation, column split successively, obtains single character；
Step S5-3, BP neural network recognization: each character is identified；
Step S5-4, obtains result: each character splicing after identifying obtains final parameter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610333734.0A CN105844281A (en) | 2016-05-19 | 2016-05-19 | Automatic form set parameter acquiring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610333734.0A CN105844281A (en) | 2016-05-19 | 2016-05-19 | Automatic form set parameter acquiring system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105844281A true CN105844281A (en) | 2016-08-10 |
Family
ID=56593763
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610333734.0A Pending CN105844281A (en) | 2016-05-19 | 2016-05-19 | Automatic form set parameter acquiring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105844281A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107995444A (en) * | 2017-12-12 | 2018-05-04 | 华南理工大学 | It is a kind of towards industrial general isomeric data harvester and method |
| CN109445388A (en) * | 2018-10-29 | 2019-03-08 | 黄莹 | Industrial control system data analysis processing device and method based on image recognition |
| CN114553528A (en) * | 2022-02-22 | 2022-05-27 | 成都睿智兴华信息技术有限公司 | Internal and external network data safety transmission system and transmission method thereof |
| CN115243098A (en) * | 2022-07-19 | 2022-10-25 | 上海联影医疗科技股份有限公司 | Screen recording method and device, computer equipment and storage medium |
| CN116170704A (en) * | 2023-02-28 | 2023-05-26 | 武汉极动智能科技有限公司 | Timing control system, method, device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103390155A (en) * | 2012-05-11 | 2013-11-13 | 腾讯科技（深圳）有限公司 | Picture and text identification method and picture and text identification device |
| CN103942212A (en) * | 2013-01-21 | 2014-07-23 | 腾讯科技（深圳）有限公司 | User interface character detecting method and device |
| CN104272322A (en) * | 2012-05-17 | 2015-01-07 | 夏普株式会社 | Display control device, control program and display device control method |
-
2016
- 2016-05-19 CN CN201610333734.0A patent/CN105844281A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103390155A (en) * | 2012-05-11 | 2013-11-13 | 腾讯科技（深圳）有限公司 | Picture and text identification method and picture and text identification device |
| CN104272322A (en) * | 2012-05-17 | 2015-01-07 | 夏普株式会社 | Display control device, control program and display device control method |
| CN103942212A (en) * | 2013-01-21 | 2014-07-23 | 腾讯科技（深圳）有限公司 | User interface character detecting method and device |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107995444A (en) * | 2017-12-12 | 2018-05-04 | 华南理工大学 | It is a kind of towards industrial general isomeric data harvester and method |
| CN109445388A (en) * | 2018-10-29 | 2019-03-08 | 黄莹 | Industrial control system data analysis processing device and method based on image recognition |
| CN109445388B (en) * | 2018-10-29 | 2020-01-07 | 黄莹 | Industrial control system data analysis processing device and method based on image recognition |
| CN114553528A (en) * | 2022-02-22 | 2022-05-27 | 成都睿智兴华信息技术有限公司 | Internal and external network data safety transmission system and transmission method thereof |
| CN114553528B (en) * | 2022-02-22 | 2024-04-19 | 成都睿智兴华信息技术有限公司 | Internal and external network data safety transmission system and transmission method thereof |
| CN115243098A (en) * | 2022-07-19 | 2022-10-25 | 上海联影医疗科技股份有限公司 | Screen recording method and device, computer equipment and storage medium |
| CN116170704A (en) * | 2023-02-28 | 2023-05-26 | 武汉极动智能科技有限公司 | Timing control system, method, device, electronic equipment and storage medium |
| CN116170704B (en) * | 2023-02-28 | 2023-11-07 | 武汉极动智能科技有限公司 | Timing control system, method, device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105844281A (en) | Automatic form set parameter acquiring system and method | |
| CN105740402A (en) | Method and device for acquiring semantic labels of digital images | |
| US20140189576A1 (en) | System and method for visual matching of application screenshots | |
| US20140218385A1 (en) | System and method for visual segmentation of application screenshots | |
| US10303495B2 (en) | Robot system including CNC and robot controller connected through communication network | |
| CN102012919B (en) | Method and device for searching association of image screenshots from televisions and digital television terminal | |
| WO2018170663A1 (en) | Method and device for annotating image, and electronic apparatus | |
| US10296552B1 (en) | System and method for automated identification of internet advertising and creating rules for blocking of internet advertising | |
| CN102096822A (en) | Color discrimination method and device | |
| CN108229323A (en) | Supervision method and device, electronic equipment, computer storage media | |
| CN109344864B (en) | Image processing method and device for dense object | |
| CN108629319B (en) | Image detection method and system | |
| CN109151500A (en) | A kind of main broadcaster's recommended method, system and computer equipment for net cast | |
| US11657599B2 (en) | Method for detecting appearance of six sides of chip multi-layer ceramic capacitor based on artificial intelligence | |
| US20190065911A1 (en) | Media Intelligence Automation System | |
| JP2023515520A (en) | Computer program, method, and apparatus for generating virtual defect images using artificial intelligence models generated based on user input | |
| CN112330594A (en) | Paper tube defect detection method and device, electronic equipment and storage medium | |
| Li et al. | A detection and configuration method for welding completeness in the automotive body-in-white panel based on digital twin | |
| CN113286196B (en) | Vehicle-mounted video playing system and video split-screen display method and device | |
| CN113128368B (en) | Method, device and system for detecting character interaction relationship | |
| CN108665769B (en) | Network teaching method and device based on convolutional neural network | |
| US20170013309A1 (en) | System and method for product placement | |
| CN106372106A (en) | Method and apparatus for providing video content assistance information | |
| CN113568833A (en) | Test case determination method and device, computer equipment and readable storage medium | |
| CN115546824B (en) | Taboo picture identification method, apparatus and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160810 |
|
| WD01 | Invention patent application deemed withdrawn after publication |