CN110910369A - Production line supervision method and device and storage medium - Google Patents
Production line supervision method and device and storage medium Download PDFInfo
- Publication number
- CN110910369A CN110910369A CN201911144840.4A CN201911144840A CN110910369A CN 110910369 A CN110910369 A CN 110910369A CN 201911144840 A CN201911144840 A CN 201911144840A CN 110910369 A CN110910369 A CN 110910369A
- Authority
- CN
- China
- Prior art keywords
- production line
- product image
- matching degree
- image
- line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004519 manufacturing process Methods 0.000 title claims abstract description 197
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000003860 storage Methods 0.000 title claims abstract description 9
- 230000008569 process Effects 0.000 claims abstract description 13
- 239000000463 material Substances 0.000 claims description 29
- 230000002159 abnormal effect Effects 0.000 claims description 20
- 238000012545 processing Methods 0.000 claims description 15
- 238000012423 maintenance Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 10
- 239000002994 raw material Substances 0.000 claims description 9
- 230000009467 reduction Effects 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000012544 monitoring process Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 9
- 238000007726 management method Methods 0.000 description 8
- 230000001276 controlling effect Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000008439 repair process Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000009960 carding Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000035484 reaction time Effects 0.000 description 2
- 230000001105 regulatory effect Effects 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 1
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 238000003754 machining Methods 0.000 description 1
- 230000000877 morphologic effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/04—Manufacturing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Tourism & Hospitality (AREA)
- Quality & Reliability (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- Manufacturing & Machinery (AREA)
- Development Economics (AREA)
- Educational Administration (AREA)
- General Health & Medical Sciences (AREA)
- Game Theory and Decision Science (AREA)
- Operations Research (AREA)
- General Factory Administration (AREA)
Abstract
The disclosure relates to the technical field of production line safety, in particular to a production line supervision method, a production line supervision device and a storage medium, which are used for solving the technical problems of low accuracy and efficiency caused by adopting an artificial emergency stop mode on a production line in the related technology. The method comprises the following steps: acquiring a field product image in the running process of a production line; comparing the field product image with a planning product image, and determining the matching degree of the field product image and the planning product image; and judging whether the matching degree is lower than a preset matching degree, and if the matching degree is lower than the preset matching degree, adjusting at least one operation parameter in the driving signals corresponding to the production line so as to perform emergency stop operation on the production line.
Description
Technical Field
The present disclosure relates to the field of production line safety technologies, and in particular, to a method, an apparatus, and a storage medium for production line supervision.
Background
The production line is a multi-variety production organization form which takes a certain type of part groups as object organizations. It has the necessary machinery and equipment to accomplish the task of machining these kinds of parts, and these equipment and working places are arranged and configured according to the ratio of the technological route and working procedure labor of most parts or main parts on the production line.
At present, most of common production lines adopt artificial emergency stop devices, but the artificial emergency stop devices are needed to be realized, and a period of reaction time always exists in artificial control, so that unnecessary loss is caused, resources are not greatly saved, and the investment of manpower is reduced; in addition, in the process of technological production, the process flow is possibly artificially suddenly stopped, and misjudgment exists, so that the existing production line still depends on the artificial sudden stop operation, not only is the manpower resource consumed, but also a certain degree of economic loss is brought.
Disclosure of Invention
The present disclosure provides a method, an apparatus, and a storage medium for monitoring a production line, so as to solve the technical problem of low accuracy and efficiency caused by an emergency stop mode adopted on the production line in the related art.
To achieve the above object, in a first aspect of the embodiments of the present disclosure, a method for line supervision is provided, where the method includes:
acquiring a field product image in the running process of a production line;
comparing the field product image with a planning product image, and determining the matching degree of the field product image and the planning product image;
judging whether the matching degree is lower than a preset matching degree;
and if the matching degree is lower than the preset matching degree, adjusting at least one operation parameter in the driving signals corresponding to the production line so as to perform emergency stop operation on the production line.
With reference to the first aspect, in a first possible implementation manner of the first aspect, comparing the field product image with a planned product image, and determining a matching degree between the field product image and the planned product image includes:
respectively carrying out recognition processing on the field product image and the planning product image, and determining the pasting positions and/or part positions of the label identifications in the field product image and the planning product image;
and calculating the matching degree between the field product image and the planning product image according to the pasting position of the label identifier and/or the part position.
With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the adjusting at least one operating parameter in a driving signal corresponding to the production line includes:
determining abnormal components in the field product corresponding to the field product image according to the field product image and the planning product image;
determining an emergency stop mode corresponding to the abnormal component; the emergency stop mode comprises a direct emergency stop mode, a point interruption mode and a reduction of the production line speed;
and adjusting the voltage and/or power parameters in the corresponding driving signals of the production line according to the determined emergency stop mode.
With reference to the second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the method further includes:
determining a corresponding position of the abnormal part in the production line;
and generating and outputting alarm information according to the position of the abnormal component.
With reference to the first aspect or the first, second, or third possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, the method further includes:
collecting raw material images on the production line;
carrying out image recognition processing on the raw material image to determine the current material quantity on the production line;
judging whether the material quantity is within a preset material quantity range or not;
and if the material quantity is not in the preset material quantity range, controlling the production line to output early warning and task information.
With reference to the fourth possible implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect, the method further includes:
collecting images related to the production line, and generating an integral 3D model corresponding to the production line;
and comparing the whole 3D model with a standard 3D model of a production line to determine whether foreign matters exist in the production line.
With reference to the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner of the first aspect, after comparing the overall 3D model with a standard 3D model of a production line, the method further includes:
if the foreign matter is determined to exist in the production line, positioning the production line position of the foreign matter on the production line;
if the production line position indicates that the foreign matter is located at the edge of the production line, warning information is generated and output according to the production line; or if the production line position indicates that the foreign matter is in the production line, controlling the production line to suddenly stop.
With reference to the sixth possible implementation manner of the first aspect, in a seventh possible implementation manner of the first aspect, the method further includes:
acquiring the maintenance cycle of the equipment on the production line;
and generating maintenance information according to the maintenance period and sending the maintenance information to a preset receiving end.
In a second aspect of the embodiments of the present disclosure, there is provided an apparatus for line supervision, the apparatus for line supervision including:
a memory having a computer program stored thereon; and
a processor for executing the computer program in the memory to implement the steps of the method of line supervision of the first aspect.
In a third aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, which when executed by a processor implements the steps of the method of any one of the above first aspects.
By adopting the technical scheme, the following technical effects can be at least achieved:
in the embodiment of the invention, the production line is provided with the plurality of image acquisition devices, the production condition of the product is monitored in real time by the image acquisition devices in the production process of the production line, the acquired field product image is compared with the planning product image, the matching degree of the field product image and the planning product image is determined, if the matching degree is low, the product production has deviation, and at least one operation parameter of the production line can be regulated and controlled, so that the regulation and control of the motion of the production line, such as sudden stop or speed control and the like, can be realized without human beings, and the accuracy and the efficiency of regulating and controlling the production line are high.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure without limiting the disclosure. In the drawings:
FIG. 1 is a flow chart of a method of production line supervision according to an exemplary embodiment of the present disclosure.
FIG. 2 is a schematic diagram of one implementation environment shown in an exemplary embodiment of the present disclosure.
FIG. 3 is a flow chart of a method of line supervision according to an exemplary embodiment of the present disclosure.
Fig. 4 is a schematic structural diagram of an apparatus for line supervision according to an exemplary embodiment of the present disclosure.
Fig. 5 is a block diagram illustrating a structure of an apparatus for line supervision according to an exemplary embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in detail with reference to the accompanying drawings and examples, so that how to apply technical means to solve technical problems and achieve the corresponding technical effects can be fully understood and implemented. The embodiments and various features in the embodiments of the present application can be combined with each other without conflict, and the formed technical solutions are all within the protection scope of the present disclosure.
In the related technology, most common production lines use an artificial emergency stop mode, but the artificial control always has a certain reaction time, which causes unnecessary loss; in addition, in the process of production, there is a case that erroneous judgment may exist when the process flow is artificially stopped suddenly.
The inventor of the disclosure finds that the production condition can be monitored in real time through the sensing device in the motion of the production line, and the sensing data can reflect the condition of each node of the production line, so that the function of software for remotely controlling the interruption of hardware equipment in the production line can be increased by combining the sensing data and software and hardware of the production line, the management and control capability of a supervision system on the production line is improved, and the occurrence of emergency stop caused by misjudgment is avoided.
FIG. 2 is a schematic diagram of one implementation environment shown in an exemplary embodiment of the present disclosure. As shown in fig. 2, the implementation environment may include a mobile terminal 100 and a server 200. The mobile terminal 100 may be a device connected to the server in a wired or wireless manner, such as a user device, e.g., a smart phone, a tablet computer, a notebook computer, an acquisition device, etc. Fig. 2 is illustrated with the mobile terminal 100 being a smartphone.
Specifically, the terminal device 100 may be installed with various applications, such as a production line supervision system, and when accessing the network service, the applications initiate a network connection request, based on which the mobile terminal may connect to the mobile communication network to access the network service. Meanwhile, the mobile terminal 100 may be connected with a plurality of collecting devices, such as a camera device, a sensor, and the like, to collect data related to the production line.
Fig. 1 is a flowchart illustrating a production line monitoring method according to an exemplary embodiment of the present disclosure, so as to solve the technical problem of low accuracy and efficiency caused by an artificial emergency stop of a production line in the related art. The method shown in the embodiment can be applied to equipment provided with a production line supervision system, such as a mobile terminal shown in fig. 2. The method as shown in fig. 1 comprises the following steps:
and S11, acquiring the field product image in the production line running process.
And S12, comparing the field product image with the planning product image, and determining the matching degree of the field product image and the planning product image.
And S13, judging whether the matching degree is lower than the preset matching degree.
And S14, if the matching degree is lower than the preset matching degree, adjusting at least one operation parameter in the driving signals corresponding to the production line so as to carry out emergency stop operation on the production line.
In the embodiment of the invention, a production line is provided with a plurality of data acquisition devices to acquire various data of the production line in the operation process. The data acquisition device comprises an image acquisition device (such as an image sensor and the like), an environment temperature acquisition device and the like; the image acquisition device can comprise components with an image acquisition function, such as an image sensor; the ambient temperature acquisition device may include a temperature/humidity sensor, a light intensity sensor, and the like.
In practical application, the whole production line and the key production line can be provided with corresponding acquisition devices to acquire the sensing data related to the production line. Of course, the sensing data can also be acquired in real time or periodically according to different monitoring requirements of the system on different production line positions on the production line. For example, the sensing data of the critical production line position can be monitored in real time by the sensing device and transmitted to the system (such as a data processing module), or a plurality of sensors can be arranged on the whole production line according to corresponding intervals, and the plurality of sensors can acquire various sensing data during the operation of the production line in real time or at intervals, such as field product image data, feeding hole image data, production line environment temperature data and the like. In the embodiment of the present invention, an image acquisition device in a data acquisition device is mainly taken as an example for description.
Therefore, in step S11, the image capturing device can capture the on-site product image of the corresponding product, such as an air conditioner product image, a fan product image, etc., produced in the operation of the production line. Furthermore, the acquired sensing data can be transmitted to a database of the supervisory system to be stored so as to be called in subsequent data processing.
In the embodiment of the invention, the database in the production line supervision system can be used for storing the sensing data transmitted by the acquisition device, and meanwhile, the database can also be used for storing standard images, 3D models and the like of production lines or products of various specifications preset in the system. In step S12, when comparing the field product image collected by the image collecting device with the planned product image, the matching degree between the field product image and the planned product image can be determined by an image recognition technique. The matching degree can represent whether the products produced on site on the production line are consistent with the planned products. In order to limit the difference within a certain range, a preset matching degree can be set within an allowable range, whether the matching degree is lower than the preset matching degree can be judged in S13, and if the matching degree is lower than the preset matching degree, the difference between the actually produced product and the planned product is too large, and the product condition is not met; if the matching degree is not lower than the preset matching degree, the production is normal.
In practical application, the placement position of each part in a produced product, the sticking position of a label and the like are specified by standards. When the product is produced on the production line, the morphological structure of the product on the production line is generally continuously changed and updated along with the operation of the production line until the whole air-conditioning product is completed. Therefore, the field product images of different positions/angles (or time points) on the production line acquired by the sensing device can represent the whole structure of the air conditioner or the change of local parts until a whole machine is formed; accordingly, the database stores standard air conditioner images corresponding to the sensing devices in each production line position (or production time stage) on the production line. That is, the field product image collected by each collecting device on the production line has a corresponding standard image (planning product image).
Then, in step S12, when comparing the field product image and the planning product image, the monitoring system may perform recognition processing on the field product image and the planning product image (i.e., the standard product image) to determine the pasting position and/or the part position of the label identifier in the field product image and the planning product image, respectively; furthermore, according to the pasting position of the label mark and/or the position of the part, the matching degree between the field product image and the planning product image can be calculated. The calculation process of the image feature matching degree may refer to an existing image processing algorithm, which is not particularly limited in the present invention.
Therefore, in the embodiment of the invention, when each product (such as an air conditioner) runs on the production line, the system compares the air conditioner image returned by the camera with the standard air conditioner image in the database, and the product is released within an acceptable difference range to allow the production line to run normally; if the difference between the standard position and the production line is larger, the corresponding position can be alarmed in time, and the production line speed is reduced by controlling hardware through software.
Furthermore, in order to better monitor the condition of the field product on the production line, when the field product image is compared with the product planning image, the supervision system can also generate a 3D model of the field product according to the field product image returned by the image sensor, and know the structures of the whole part and the local part of the field product in time; meanwhile, based on the sensor (or the production line position) of the returned field product image, calling a standard 3D model corresponding to the sensor (or the production line position) in a database; furthermore, the matching degree of the 3D model of the field product and the corresponding standard 3D model can be determined by comparing the two models. Wherein, the standard 3D model can be established according to the specified content of the product (such as the part installation position, the label pasting position, etc.), which can be saved in the background database in advance.
If the matching degree of the two is lower than the preset matching degree, the difference between the field product and the planned product is larger, and in S14, the monitoring system can determine an abnormal component in the field product according to the unmatched place in the field product image, so as to determine an emergency stop mode corresponding to the abnormal component. For example, if the abnormal component is easy to operate, the speed can be reduced, and the abnormal component can be automatically or manually corrected through equipment, such as automatic re-pasting or manual correction; or if the abnormal part is complex in operation and cannot be solved in a short time, the whole process can be finished. Furthermore, the supervisory system adjusts the motion parameters, such as current, power and the like, in the driving signals corresponding to the production line according to the determined emergency stop mode, so that the system can perform full-flow interruption (namely, cutting off the power supply to directly perform emergency stop), point interruption or control for reducing the speed of the production line by adjusting the voltage and/or the power and the like.
In practical application, if the matching degree of the field product and the planned product on the production line is determined to be low through the acquisition device, or the production line equipment has faults/foreign matters, the position of the production line with the state or even the abnormal equipment can be further positioned based on the sensor for feeding back the abnormal data. For example, if the system monitors that the position of the tag appearing on the production line c is greatly different through the sensor, the system can locate the tag at the position c and transmit information to the sensor at the position c, and at this time, the hardware can control the emergency stop mode of the production line through reducing voltage or power, such as direct emergency stop, terminal or reducing the speed of the production line. Meanwhile, corresponding alarm information can be generated and output according to the position of the production line and/or abnormal components on the production line, and even sent to terminals of related personnel, so that the related personnel can be prompted to maintain the production line.
Fig. 3 is a schematic diagram illustrating a monitoring process of the monitoring system on the production line according to an embodiment of the present invention.
In a possible embodiment, since the placement position of each component of the air conditioner, the sticking position of the label, and the like are specified, the standard graph, that is, the 3D model of the standard air conditioner can be established according to the specified content. In the production process, the sticking position of the label is fixed for the label of the air conditioner on the production line, and if the deviation is too large, the label does not meet the standard. Therefore, when the air conditioner product running on the production line is at the label pasting station, the air conditioner model at the moment can be generated according to the collected label pasting air conditioner image, and then the air conditioner 3D model is compared with the standard air conditioner 3D model. Assuming that the allowable error of the label sticking position is 0.3-0.5, but the actual error obtained after comparison is 0.8, at this time, an alarm operation is required to be carried out, and meanwhile, a corresponding emergency stop operation can be carried out, for example, the speed of a production line is reduced, so that time is reserved for replacing the label needing to be changed in time; if the matching degree of the two is higher and the actual error is in the allowable range after comparison, the next procedure can be carried out.
Because the work done at each position of the production line is different and each part installed is different, the air conditioner can be scanned/shot in real time at the place where errors easily occur to obtain corresponding images. Assuming that the air conditioner arrives at a screw-driving station, the scanned 3D model of the product is compared with the standard 3D model, and all the procedures and the installed parts which are completed before need to be scanned and compared. For example, if the first station on the air conditioner production line is a compressor and the second station is a discharger box, the sensor scans the compressor mainly at the first station, and the second station scans whether the installation position of the electrical box is qualified or not and detects whether the position of the compressor is reasonable or not.
Meanwhile, when a certain position is found to be wrong in the moving process of the production line, real-time alarming and/or sudden stop operation is required. For example, in the assembly process of the air conditioner in the production line, the third station is used for carding the radiating fins, but the radiating fins of the air conditioner are mostly turned to one side by the seventh station, so that the later sale is influenced, and the carding of the radiating fins is carried out at the station.
In practical application, the line stop caused by the failure of equipment is inevitable during the operation of the production line. In order to reduce the loss caused by the situation, on one hand, a maintenance period can be set at a software end corresponding to the production line to periodically maintain the equipment, each period can automatically push the mail to a preset receiving end, the preset receiving end comprises user terminal equipment or a client, and the user terminal equipment comprises: the system comprises a handheld mobile communication terminal of a user, a tablet personal computer of the user with a wired or wireless communication function, a vehicle-mounted display communication device of the user or an intelligent wearable electronic device of the user, wherein a client comprises an application program and the like running on the terminal device of the user, so that a message can be timely notified to related personnel for overhauling; on the other hand, after the equipment breaks down (for example, the equipment is detected by the sensing device), the monitoring end can also alarm the relative position in time and inform related personnel to rush to the site for repair, so that huge economic loss caused by line stop is reduced.
In one possible embodiment, the supervisory system may also monitor the raw materials on the production line. Specifically, the system can acquire a raw material image corresponding to the production line acquired by the image acquisition device, for example, an image of the material inlet is acquired, the material quantity is determined by an image recognition technology and the like, and then whether the current material quantity is within a preset material quantity range can be judged. If the material quantity is in the normal range, continuing monitoring; if the material quantity is not within the preset material quantity range, the production line can be controlled to output early warning and corresponding task information so as to prompt related personnel to add materials.
For example, when the production line runs normally under the condition of sufficient materials, the camera takes pictures once at intervals, raw material pictures obtained by taking pictures are returned to the background database, and then the image sensor and the image algorithm are used for judging the material quantity. If the situation that materials are possibly short of materials in a certain period of time exists, tasks are automatically distributed to relevant personnel through remote monitoring, the personnel are reminded of adding the materials in time, and normal operation of a production line is guaranteed.
In another possible embodiment, the image acquisition device can also detect whether foreign objects are stuck in the production line. Generally, a foreign matter is inevitably stuck into a production line during a production process. In this embodiment, after the sensor is installed on the production line, the entire model and the three-dimensional structure of the production line may be transmitted to the software end (which may be installed in the mobile terminal or the server) and monitored in real time, for example, updated in units of s (time unit seconds), according to the model of the three-dimensional structure, if there is a foreign object entering the initial time point of the production line, an alarm operation is performed and a warning instruction is given, if the foreign object has entered the production line, an emergency stop operation is directly performed, thereby reducing the injury of personnel.
Therefore, in the embodiment of the invention, the 3D model of the air conditioner and the position of each part are drawn in the background, then the air conditioner product is shot/scanned in real time on the production line, and the 3D model of the on-site air conditioner product is compared with the background standard 3D model. If the production specification is not in accordance with the standard, the product can be quickly repaired to be in accordance with the standard, and if the production specification is not in accordance with the standard within a certain range, a voice alarm is directly given at the position to remind that specific elements at the current position are not in accordance with the standard, so that production line personnel can repair the products in time; and for the defects that the standard is not met and the repair cannot be carried out in time, the alarm is given in real time monitoring, the offline processing is reminded, and the production efficiency is improved. The product subjected to offline treatment can be further repaired, then the product is put into a production line for testing again, if the product cannot be repaired, the device which cannot be repaired is positioned, and the product is put on the production line again after the corresponding parts are replaced, so that the waste of materials is reduced.
It should be noted that, for the sake of simplicity, the embodiment of the line supervision method shown in fig. 1 is described as a series of action combinations, but those skilled in the art should understand that the disclosure is not limited by the described action sequence. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required in order to implement the disclosure.
Fig. 4 is an apparatus for line supervision according to an exemplary embodiment of the present disclosure. As shown in fig. 4, the apparatus 300 for line supervision includes:
an acquisition module 310 configured to acquire an image of an on-site product during operation of a production line;
the processing module 320 is configured to compare the field product image with the planning product image and determine the matching degree of the field product image and the planning product image;
the determining module 330 is configured to determine whether the matching degree is lower than a preset matching degree.
The management and control module 340 is configured to adjust at least one operation parameter in the driving signal corresponding to the production line if the matching degree is lower than the preset matching degree, so as to perform an emergency stop operation on the production line.
Optionally, the processing module 320 is specifically configured to: respectively carrying out recognition processing on the field product image and the planning product image, and determining the pasting positions and/or part positions of the label identifications in the field product image and the planning product image; and calculating the matching degree between the field product image and the planning product image according to the pasting position of the label identifier and/or the part position.
Optionally, the management and control module 340 is specifically configured to:
determining abnormal components in the field product corresponding to the field product image according to the field product image and the planning product image;
determining an emergency stop mode corresponding to the abnormal component; the emergency stop mode comprises a direct emergency stop mode, a point interruption mode and a reduction of the production line speed;
and adjusting the voltage and/or power parameters in the corresponding driving signals of the production line according to the determined emergency stop mode.
Optionally, the management module 340 is further configured to:
determining a corresponding position of the abnormal part in the production line;
and generating and outputting alarm information according to the position of the abnormal component.
Optionally, the management module 340 is further configured to:
collecting raw material images on the production line;
carrying out image recognition processing on the raw material image to determine the current material quantity on the production line;
judging whether the material quantity is within a preset material quantity range or not;
and if the material quantity is not in the preset material quantity range, controlling the production line to output early warning and task information.
Optionally, the management module 330 is further configured to:
collecting images related to a production line, and generating an integral 3D model corresponding to the production line;
and comparing the whole 3D model with a standard 3D model of a production line to determine whether foreign matters exist in the production line.
Optionally, the management and control module 330 is further configured to, after comparing the entire 3D model with a standard 3D model of a production line, if it is determined that a foreign object exists in the production line, locate a production line position of the foreign object on the production line; if the production line position indicates that the foreign matter is located at the edge of the production line, alarming according to the production line position; or if the production line position indicates that the foreign matter is in the production line, the production line is suddenly stopped.
Optionally, the management module 330 is further configured to:
and according to a preset maintenance period of the equipment on the production line, maintaining the corresponding equipment on the production line.
And sending a maintenance task to a corresponding terminal according to the maintenance period.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
The present disclosure also provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of the method for supervising a production line according to any of the above-mentioned alternative embodiments.
The method implemented when the computer program running on the processor is executed may refer to a specific embodiment of the production line supervision method disclosed herein, and details are not described here.
The processor may be an integrated circuit chip having information processing capabilities. The processor may be a general-purpose processor including a Central Processing Unit (CPU), a Network Processor (NP), and the like.
The present disclosure also provides a device for production line supervision, including:
a memory having a computer program stored thereon; and
a processor for executing said computer program in said memory to perform the method steps of any of the above alternative embodiment line monitoring.
FIG. 5 is a block diagram illustrating an apparatus 400 for line supervision according to one exemplary embodiment. As shown in fig. 5, the apparatus 400 may include: a processor 401, a memory 402, a multimedia component 403, an input/output (I/O) interface 404, and a communication component 405.
Wherein, the processor 401 is used for controlling the overall operation of the apparatus 400 to complete all or part of the steps of the above-mentioned method for line supervision. The memory 402 is used to store various types of data to support operation of the apparatus 400, and such data may include, for example, instructions for any application or method operating on the apparatus 400, as well as application-related data. The Memory 402 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk or optical disk. The multimedia components 403 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may further be stored in the memory 402 or transmitted through the communication component 405. The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 404 provides an interface between the processor 401 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 405 is used for wired or wireless communication between the apparatus 400 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, Near Field Communication (NFC), 2G, 3G, or 4G, or a combination of one or more of them, so that the corresponding Communication component 405 may include: Wi-Fi module, bluetooth module, NFC module.
In an exemplary embodiment, the apparatus 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above-described method of line supervision.
In another exemplary embodiment, a computer readable storage medium comprising program instructions, such as the memory 402 comprising program instructions, executable by the processor 401 of the apparatus 400 to perform the above-described method of line supervision is also provided.
The preferred embodiments of the present disclosure are described in detail with reference to the accompanying drawings, however, the present disclosure is not limited to the specific details of the above embodiments, and various simple modifications may be made to the technical solution of the present disclosure within the technical idea of the present disclosure, and these simple modifications all belong to the protection scope of the present disclosure.
It should be noted that the various features described in the above embodiments may be combined in any suitable manner without departing from the scope of the invention. In order to avoid unnecessary repetition, various possible combinations will not be separately described in this disclosure.
In addition, any combination of various embodiments of the present disclosure may be made, and the same should be considered as the disclosure of the present disclosure, as long as it does not depart from the spirit of the present disclosure.
Claims (10)
1. A method of line supervision, the method comprising:
acquiring a field product image in the running process of a production line;
comparing the field product image with a planning product image, and determining the matching degree of the field product image and the planning product image;
judging whether the matching degree is lower than a preset matching degree;
and if the matching degree is lower than the preset matching degree, adjusting at least one operation parameter in the driving signals corresponding to the production line so as to perform emergency stop operation on the production line.
2. A method of line supervision according to claim 1, wherein comparing the field product image with a planned product image to determine a match between the two comprises:
respectively carrying out recognition processing on the field product image and the planning product image, and determining the pasting positions and/or part positions of the label identifications in the field product image and the planning product image;
and calculating the matching degree between the field product image and the planning product image according to the pasting position of the label identifier and/or the part position.
3. A method of line supervision according to claim 2, wherein adjusting at least one operating parameter in the corresponding drive signal of the production line comprises:
determining abnormal components in the field product corresponding to the field product image according to the field product image and the planning product image;
determining an emergency stop mode corresponding to the abnormal component; the emergency stop mode comprises a direct emergency stop mode, a point interruption mode and a reduction of the production line speed;
and adjusting the voltage and/or power parameters in the corresponding driving signals of the production line according to the determined emergency stop mode.
4. A method of line supervision according to claim 3, characterised in that the method further comprises:
determining corresponding position information of the abnormal part in the production line;
and generating and outputting alarm information according to the position information of the abnormal component.
5. Method of line supervision according to any of the claims 1-4, characterized in that the method further comprises:
collecting raw material images on the production line;
carrying out image recognition processing on the raw material image to determine the current material quantity on the production line;
judging whether the material quantity is within a preset material quantity range or not;
and if the material quantity is not in the preset material quantity range, controlling the production line to output early warning and task information.
6. The method of line supervision according to claim 5, further comprising:
collecting images related to the production line, and generating an integral 3D model corresponding to the production line;
and comparing the whole 3D model with a standard 3D model of a production line to determine whether foreign matters exist in the production line.
7. The method of production line oversight according to claim 6, characterized in that after comparing said overall 3D model with a standard 3D model of a production line, said method further comprises:
if the foreign matter is determined to exist in the production line, positioning the production line position of the foreign matter on the production line;
if the production line position indicates that the foreign matter is located at the edge of the production line, warning information is generated and output according to the production line; or if the production line position indicates that the foreign matter is in the production line, controlling the production line to suddenly stop.
8. The method of line supervision according to claim 7, further comprising:
acquiring the maintenance cycle of each device on the production line;
and generating maintenance information according to the maintenance period and sending the maintenance information to a preset receiving end.
9. An apparatus for production line supervision, comprising:
a memory having a computer program stored thereon; and
a processor for executing the computer program in the memory to implement the steps of the method of line supervision according to any of claims 1 to 8.
10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out the steps of the method of production line supervision according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911144840.4A CN110910369A (en) | 2019-11-19 | 2019-11-19 | Production line supervision method and device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911144840.4A CN110910369A (en) | 2019-11-19 | 2019-11-19 | Production line supervision method and device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110910369A true CN110910369A (en) | 2020-03-24 |
Family
ID=69818089
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911144840.4A Pending CN110910369A (en) | 2019-11-19 | 2019-11-19 | Production line supervision method and device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110910369A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113096660A (en) * | 2021-04-28 | 2021-07-09 | 三一汽车制造有限公司 | Personnel safety protection method and device, electronic equipment and storage medium |
| CN113762163A (en) * | 2021-09-09 | 2021-12-07 | 杭州澳亚生物技术股份有限公司 | GMP workshop intelligent monitoring management method and system |
| CN113867246A (en) * | 2020-06-30 | 2021-12-31 | 北京福田康明斯发动机有限公司 | Processing line mistake proofing system, processing line mistake proofing method, storage medium, electronic device and production line |
| CN114488979A (en) * | 2022-01-21 | 2022-05-13 | 珠海格力电器股份有限公司 | Detection method, detection device, electronic equipment and storage medium |
| CN115115271A (en) * | 2022-07-26 | 2022-09-27 | 广州中平智能科技有限公司 | Product production process management method, management platform, equipment and medium |
| CN115278179A (en) * | 2022-07-29 | 2022-11-01 | 广域铭岛数字科技有限公司 | Production line safety monitoring method, system, equipment and medium |
| CN115373308A (en) * | 2022-08-11 | 2022-11-22 | 马鞍山恒精新能源科技有限公司 | Material identification system of continuous furnace |
| CN117742224A (en) * | 2024-02-20 | 2024-03-22 | 瑞熙(苏州)智能科技有限公司 | PAD terminal real-time abnormality monitoring and intelligent processing method |
| CN117875539A (en) * | 2023-12-04 | 2024-04-12 | 中食安信（北京）信息咨询有限公司 | Intelligent production supervision system and method thereof |
| CN115278179B (en) * | 2022-07-29 | 2024-09-03 | 广域铭岛数字科技有限公司 | Production line safety monitoring method, system, equipment and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000331162A (en) * | 1999-05-24 | 2000-11-30 | Sharp Corp | Image processor |
| CN102968133A (en) * | 2012-11-14 | 2013-03-13 | 中联重科股份有限公司 | Control method, equipment and system for material supplementing |
| CN107220969A (en) * | 2017-05-23 | 2017-09-29 | 太仓市同维电子有限公司 | The method of testing and detecting system of product lamp position |
| CN107682662A (en) * | 2017-09-01 | 2018-02-09 | 中车青岛四方机车车辆股份有限公司 | A kind of acquisition system for manufacturing data |
| CN108021084A (en) * | 2017-12-11 | 2018-05-11 | 中国兵器装备集团自动化研究所 | The production line three-dimension monitoring system that a kind of actual situation combines |
| CN110032971A (en) * | 2019-04-12 | 2019-07-19 | 南京理工大学 | Mobile platform foreign bodies detection detection method and detection system based on monocular cam |
-
2019
- 2019-11-19 CN CN201911144840.4A patent/CN110910369A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000331162A (en) * | 1999-05-24 | 2000-11-30 | Sharp Corp | Image processor |
| CN102968133A (en) * | 2012-11-14 | 2013-03-13 | 中联重科股份有限公司 | Control method, equipment and system for material supplementing |
| CN107220969A (en) * | 2017-05-23 | 2017-09-29 | 太仓市同维电子有限公司 | The method of testing and detecting system of product lamp position |
| CN107682662A (en) * | 2017-09-01 | 2018-02-09 | 中车青岛四方机车车辆股份有限公司 | A kind of acquisition system for manufacturing data |
| CN108021084A (en) * | 2017-12-11 | 2018-05-11 | 中国兵器装备集团自动化研究所 | The production line three-dimension monitoring system that a kind of actual situation combines |
| CN110032971A (en) * | 2019-04-12 | 2019-07-19 | 南京理工大学 | Mobile platform foreign bodies detection detection method and detection system based on monocular cam |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113867246A (en) * | 2020-06-30 | 2021-12-31 | 北京福田康明斯发动机有限公司 | Processing line mistake proofing system, processing line mistake proofing method, storage medium, electronic device and production line |
| CN113096660A (en) * | 2021-04-28 | 2021-07-09 | 三一汽车制造有限公司 | Personnel safety protection method and device, electronic equipment and storage medium |
| CN113762163A (en) * | 2021-09-09 | 2021-12-07 | 杭州澳亚生物技术股份有限公司 | GMP workshop intelligent monitoring management method and system |
| CN114488979A (en) * | 2022-01-21 | 2022-05-13 | 珠海格力电器股份有限公司 | Detection method, detection device, electronic equipment and storage medium |
| CN115115271A (en) * | 2022-07-26 | 2022-09-27 | 广州中平智能科技有限公司 | Product production process management method, management platform, equipment and medium |
| CN115278179A (en) * | 2022-07-29 | 2022-11-01 | 广域铭岛数字科技有限公司 | Production line safety monitoring method, system, equipment and medium |
| CN115278179B (en) * | 2022-07-29 | 2024-09-03 | 广域铭岛数字科技有限公司 | Production line safety monitoring method, system, equipment and medium |
| CN115373308A (en) * | 2022-08-11 | 2022-11-22 | 马鞍山恒精新能源科技有限公司 | Material identification system of continuous furnace |
| CN117875539A (en) * | 2023-12-04 | 2024-04-12 | 中食安信（北京）信息咨询有限公司 | Intelligent production supervision system and method thereof |
| CN117875539B (en) * | 2023-12-04 | 2024-06-07 | 中食安信（北京）信息咨询有限公司 | Intelligent production supervision system and method thereof |
| CN117742224A (en) * | 2024-02-20 | 2024-03-22 | 瑞熙(苏州)智能科技有限公司 | PAD terminal real-time abnormality monitoring and intelligent processing method |
| CN117742224B (en) * | 2024-02-20 | 2024-05-07 | 瑞熙(苏州)智能科技有限公司 | PAD terminal real-time abnormality monitoring and intelligent processing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110910369A (en) | Production line supervision method and device and storage medium | |
| JP6647824B2 (en) | Error diagnosis system and error diagnosis method | |
| US10573421B2 (en) | Plant operation system and plant operation method | |
| CN111882833B (en) | Equipment fault early warning method, device, equipment and medium based on outlier parameters | |
| CN114862288B (en) | Intelligent water affair secondary pressurization management system | |
| CN102937802B (en) | System and method for monitoring operating state of device | |
| CN101582195A (en) | Method for generating alarm in dynamic environment monitoring system | |
| CN106121981A (en) | A kind of air compressor machine fault remote processing method based on Internet of Things and system | |
| CN106014947A (en) | Method and system for monitoring air compressor on basis of Internet of Things | |
| CN115909203A (en) | Construction safety panoramic monitoring system and method | |
| CN108748936A (en) | A kind of injection workshop Intelligent Production Management System and its method | |
| CN102736545A (en) | Foolproof monitoring method and device for automated device | |
| CN114378862B (en) | Cloud platform-based automatic robot abnormality repairing method and device and robot | |
| CN117370848B (en) | Equipment fault prediction method, device, computer equipment and storage medium | |
| CN113759765B (en) | FFU intelligent group control system and maintenance method thereof | |
| CN108120475A (en) | The data monitoring method and device of a kind of piping lane | |
| WO2022056867A1 (en) | Production management and control system and method | |
| CN115239227B (en) | Production station monitoring method and system | |
| CN109681207A (en) | Mine management method and device | |
| CN115220405A (en) | Equipment safety point inspection system and equipment safety point inspection method | |
| CN115890026A (en) | Laser cutting monitoring method and device and computer readable storage medium | |
| CN112862120A (en) | Power maintenance and repair supervision system and method | |
| CN112583876A (en) | Station management method, station management device, electronic equipment and storage medium | |
| CN116614085A (en) | Building photovoltaic three-dimensional monitoring system, building photovoltaic three-dimensional monitoring method, storage medium and electronic equipment | |
| CN109424530A (en) | A kind of air compressor machine fault remote processing method and system based on Internet of Things |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200324 |
|
| RJ01 | Rejection of invention patent application after publication |