CN117876970A - Workshop intelligent management method and system based on image processing and electronic equipment - Google Patents
Workshop intelligent management method and system based on image processing and electronic equipment Download PDFInfo
- Publication number
- CN117876970A CN117876970A CN202410269842.0A CN202410269842A CN117876970A CN 117876970 A CN117876970 A CN 117876970A CN 202410269842 A CN202410269842 A CN 202410269842A CN 117876970 A CN117876970 A CN 117876970A
- Authority
- CN
- China
- Prior art keywords
- target
- frame
- thermal imaging
- infrared thermal
- similarity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 title claims abstract description 39
- 238000012545 processing Methods 0.000 title claims abstract description 29
- 238000001931 thermography Methods 0.000 claims abstract description 65
- 206010000117 Abnormal behaviour Diseases 0.000 claims description 78
- 238000000034 method Methods 0.000 claims description 29
- 238000012544 monitoring process Methods 0.000 abstract description 15
- 238000004422 calculation algorithm Methods 0.000 abstract description 12
- 238000004590 computer program Methods 0.000 description 6
- 230000006399 behavior Effects 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003245 coal Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06V10/225—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on a marking or identifier characterising the area
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/761—Proximity, similarity or dissimilarity measures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention relates to the technical field of general image processing or generation, in particular to an intelligent workshop management method and system based on image processing, and electronic equipment. The continuous monitoring of the behavior of the same target in the monitored area can be realized only by the infrared thermal imaging device, and the video tracking algorithm and the workshop management are organically combined to realize the efficient, high-universality and high-safety workshop management.
Description
Technical Field
The invention relates to the technical field of general image processing or generation, in particular to an intelligent workshop management method and system based on image processing and electronic equipment.
Background
Video tracking is one of the most important research areas in computer vision and has many widespread applications. The tracking algorithm in the prior art comprises: the method comprises the steps of supporting a support vector tracking algorithm of a vector machine, combining target tracking with target detection, so as to realize tracking, learning and detection, wherein in the prior art, workshop management is usually carried out through monitoring cameras, the defects of low monitoring efficiency, large manual workload and high labor cost exist, in the existing workshop production, the shooting of a conventional monitoring camera can be influenced due to a special production environment such as a dust environment, a light-shielding environment and the like, in the existing intelligent monitoring scheme, the conventional monitoring camera is usually used, the conventional monitoring camera can be greatly influenced by environmental factors, when illumination equipment is damaged, the conventional monitoring camera cannot continuously carry out monitoring tasks, and the situation of a production area cannot be clearly shot, so that certain potential safety hazards exist. Under the demand of rapid development of current intelligent workshops, high-efficiency and real-time intelligent workshop management monitoring work cannot be met, and deep learning is adopted to conduct coal mine safety production monitoring, so that the development trend is new, but the prior art can only track targets, and how to organically combine a video tracking algorithm with workshop management to achieve efficient, high-universality and high-safety workshop management is a problem to be solved in the prior art.
Thus, the prior art is still to be further developed.
Disclosure of Invention
The invention aims to overcome the technical defects and provide an intelligent workshop management method and system based on image processing and electronic equipment so as to solve the problems in the prior art.
To achieve the above technical object, according to a first aspect of the present invention, there is provided an intelligent workshop management method based on image processing, the method comprising:
s100, acquiring infrared thermal imaging images of a workshop target area according to a preset time interval by using an infrared thermal imaging device arranged above a workshop, judging whether pixel points with gray values larger than or equal to a first preset threshold exist in infrared thermal imaging image data, if so, determining the pixel points as target points, establishing a first target search frame in the infrared thermal imaging image of a current frame according to all the target points, and establishing a second target search frame in the infrared thermal imaging image of a next frame;
s200, generating a first background selection frame with preset size and closely arranged around a first target search frame, determining a background search range according to the first background selection frame, establishing the first background search frame according to the background search range, judging whether pixel points positioned in the first background search frame exist in all pixel points on the boundary of a second target search frame, if so, establishing a prediction target frame with preset size by taking the pixel points as the center, calculating first similarity between the prediction target frame and the first background selection frame, calculating second similarity between the prediction target frame and a corresponding area of the first target search frame, judging whether the first similarity is larger than the second similarity, and judging whether a target is blocked according to a judgment result;
and S300, if the target is blocked, the control counter is increased by 1, the first total number of the infrared thermal imaging images with blocked targets in the continuous shooting process is calculated, whether abnormal behaviors exist or not is judged according to the first total number, and whether an alarm signal about the abnormal behaviors is output or not is judged according to a judgment result.
Specifically, the determining whether the first similarity is greater than the second similarity, and determining whether the target is blocked according to the determination result includes:
if the first similarity is greater than the second similarity, judging that the target is shielded;
if the first similarity is smaller than or equal to the second similarity, the target is judged not to be blocked.
Specifically, the determining whether abnormal behavior exists according to the first total number includes:
judging whether the first total number is larger than or equal to a second preset threshold value, and judging whether abnormal behaviors exist according to a judging result.
Specifically, the determining whether the first total number is greater than or equal to the second preset threshold, and determining whether the abnormal behavior exists according to the determination result includes:
if the first total number is greater than or equal to a second preset threshold value, judging that abnormal behaviors exist;
and if the first total number is smaller than the second preset threshold value, judging that no abnormal behavior exists.
Specifically, the determining whether to output the alarm signal related to the abnormal behavior according to the determination result includes:
if the abnormal behavior is judged to exist, outputting an alarm signal related to the abnormal behavior;
if it is determined that the abnormal behavior does not exist, a prompt signal related to the fact that the abnormal behavior does not occur is output.
Specifically, the method further comprises the following steps:
the method comprises the steps of respectively obtaining coordinates of four vertexes of a first target search frame and a second search frame, calculating first coordinates of centers of mass of a target of the first target search frame according to the coordinates of the four vertexes of the first target search frame and the second search frame, calculating second coordinates of centers of mass of the target of the second target search frame, calculating first Euclidean distance between the first coordinates and the second coordinates, judging whether the first Euclidean distance is smaller than a third preset threshold value, if yes, adding 1 to a control counter, calculating second total quantity of infrared thermal imaging images with the first Euclidean distance smaller than the third preset threshold value, judging whether abnormal behaviors exist according to the second total quantity, and judging whether alarm signals related to abnormal behaviors are output according to judgment results.
Specifically, the determining whether the abnormal behavior exists according to the second total number, and determining whether to output the alarm signal related to the occurrence of the abnormal behavior according to the determination result includes:
judging whether the second total number is larger than or equal to a fourth preset threshold value, and judging whether abnormal behaviors exist according to the judging result.
Specifically, the determining whether the second total number is greater than or equal to a fourth preset threshold, and determining whether the abnormal behavior exists according to the determination result includes:
if the second total number is greater than or equal to a fourth preset threshold value, judging that abnormal behaviors exist;
and if the second total number is smaller than a fourth preset threshold value, judging that no abnormal behavior exists.
According to a second aspect of the present invention, there is provided an image processing-based shop intelligent management system, comprising:
the acquisition module comprises an infrared thermal imaging device arranged above the workshop and is used for acquiring an infrared thermal imaging image of a target area of the workshop;
the control module is used for acquiring infrared thermal imaging images of a workshop target area according to a preset time interval by using an infrared thermal imaging device arranged above a workshop, judging whether pixel points with gray values larger than or equal to a first preset threshold exist in infrared thermal imaging image data, if so, determining the pixel points as target points, establishing a first target search frame in the infrared thermal imaging image of the current frame according to all the target points, and establishing a second target search frame in the infrared thermal imaging image of the next frame;
or a first background selection frame which is used for generating a preset size around the first target search frame and is closely arranged, determining a background search range according to the first background selection frame, establishing the first background search frame according to the background search range, judging whether pixel points positioned in the first background search frame exist in all pixel points on the boundary of the second target search frame, if so, establishing a prediction target frame with the preset size by taking the pixel points as the center, calculating the first similarity of the prediction target frame and the first background selection frame, calculating the second similarity of the prediction target frame and the corresponding area of the first target search frame, judging whether the first similarity is larger than the second similarity, and judging whether the target is blocked according to the judgment result;
or when the target is blocked, the counter is controlled to be increased by 1, the first total number of the infrared thermal imaging images blocked by the target in the continuous shooting process is calculated, whether abnormal behaviors exist is judged according to the first total number, and whether an alarm signal about the abnormal behaviors is output is judged according to the judgment result.
According to a third aspect of the present invention, there is provided an electronic device comprising: a memory; and the processor is used for storing computer readable instructions on the memory, and the computer readable instructions realize the workshop intelligent management method based on image processing when being executed by the processor.
The beneficial effects are that:
according to the invention, the continuous monitoring of the behavior of the same target in the monitored area can be realized only through the infrared thermal imaging device, the alarm is given in time when the abnormal behavior is monitored, and the video tracking algorithm and the workshop management are organically combined, so that the high-efficiency, high-universality and high-safety workshop management is realized, the hardware system is simplified to a great extent, the modeling of a complex algorithm is not needed, the intelligent degree and usability of the invention are improved to a great extent, and the application scene of the invention is greatly expanded.
Drawings
FIG. 1 is a flow chart of a method for intelligent management of an image processing-based plant provided in an embodiment of the present invention;
fig. 2 is a schematic diagram of a system composition of an intelligent workshop management system based on image processing according to an embodiment of the present invention.
Detailed Description
In order to make the technical solution of the present invention better understood by those skilled in the art, the technical solution of the present invention will be clearly and completely described below with reference to the accompanying drawings, and based on the embodiments in the present application, other similar embodiments obtained by those skilled in the art without making creative efforts should fall within the scope of protection of the present application. In addition, directional words such as "upper", "lower", "left", "right", and the like, as used in the following embodiments are merely directions with reference to the drawings, and thus, the directional words used are intended to illustrate, not to limit, the invention.
The invention will be further described with reference to the drawings and preferred embodiments.
Referring to fig. 1, the present invention provides a workshop intelligent management method based on image processing, which includes:
s100, acquiring infrared thermal imaging images of a workshop target area according to a preset time interval by using an infrared thermal imaging device arranged above a workshop, judging whether pixel points with gray values larger than or equal to a first preset threshold exist in infrared thermal imaging image data, if so, determining the pixel points as target points, establishing a first target search frame in the infrared thermal imaging image of a current frame according to all the target points, and establishing a second target search frame in the infrared thermal imaging image of a next frame.
Specifically, the establishing a first target search frame in the current frame of infrared thermal imaging image and establishing a second target search frame in the next frame of infrared thermal imaging image according to all target points includes:
determining a first target range and a second target range according to all target points in the current frame of infrared thermal imaging image and the next frame of infrared thermal imaging image respectively, wherein the first target range needs to comprise all target points in the current frame of infrared thermal imaging image data, the second target range needs to comprise all target points in the next frame of infrared thermal imaging image data, a first target search frame is established in the current frame of infrared thermal imaging image according to the first target range and the second target range respectively, and a second target search frame is established in the next frame of infrared thermal imaging image.
It will be appreciated that the shop target area may be provided as a hazardous area inside the shop where long stay is prohibited, for example a surrounding area of a large lifting device.
Here, the step S100 includes:
the method comprises the steps of presetting a first preset threshold value, a second preset threshold value, a third preset threshold value, a fourth preset threshold value, a preset time interval and a preset size.
It can be understood that the first preset threshold, the second preset threshold, the third preset threshold, the fourth preset threshold, the preset time interval and the preset size can be specifically set according to actual situations, and specific values of the first preset threshold, the second preset threshold, the third preset threshold, the fourth preset threshold, the preset time interval and the preset size are not required by the invention, so long as the method is suitable for the intelligent workshop management method based on image processing.
Preferably, since the heat radiation of the living body is high, the gray value of the pixel point corresponding to the living body is high, and the invention does not require the data of the first preset threshold value, so long as the distinction of whether the pixel point refers to the living body can be realized.
Preferably, the second preset threshold is set to 600, the preset time interval is set to 1 second, and the setting is that the technician of the invention obtains through a large number of experiments that when the first total number is greater than or equal to the second preset threshold, the duration of the target being blocked is greater than or equal to 600 seconds, and the target is proved to be forbidden to stay in a dangerous area in a workshop for a long time, and the stay time is longer.
Preferably, the third preset threshold value of the invention can be specifically set according to the size of an actual infrared thermal imaging image, preferably, the third preset threshold value is set to 30 pixels, and the third preset threshold value is set to 30 pixels, so that whether the target can be determined as not moving can be better judged, thereby further realizing the judgment of abnormal behaviors and further improving the intelligent degree and reliability of the invention.
Preferably, the fourth preset threshold value is set to 300, and the above setting is obtained by a plurality of experiments by the technician of the present invention, when the second total number is greater than or equal to the fourth preset threshold value, the time that the target is not moved is greater than or equal to 300 seconds, which proves that the target is in a dangerous area where long-time stay in the workshop is forbidden, and the stay time is longer.
S200, generating a first background selection frame with preset size and closely arranged around a first target search frame, determining a background search range according to the first background selection frame, establishing the first background search frame according to the background search range, judging whether pixel points positioned in the first background search frame exist in all pixel points on the boundary of a second target search frame, if so, establishing a prediction target frame with preset size by taking the pixel points as the center, calculating first similarity between the prediction target frame and the first background selection frame, calculating second similarity between the prediction target frame and a corresponding area of the first target search frame, judging whether the first similarity is larger than the second similarity, and judging whether a target is blocked according to a judgment result.
It may be appreciated that the determining the background search range according to the first background selection frame includes:
the background searching range is twice the range of the first background selecting frames, the area similar to each first background selecting frame is searched in the next frame of infrared thermal imaging image, and the range of the first background searching frame is recorded as the background searching range.
Here, the method further includes:
a mask with the same size scale as the target is preset, the mask is used for subsequent target image updating and position prediction, all values in the mask are set to be 1, after shielding detection is carried out, elements corresponding to a predicted target frame shielded in the mask are set to be 0, and the mask is used for subsequent target image updating and position prediction.
It can be understood that the method classifies the predicted target frames, belongs to the target area, namely the area with higher second similarity which is not blocked, belongs to the background area, namely the area with higher first similarity which is blocked, judges the possible positions of all the first background selection frames in the next frame, overcomes the problem of tracking offset by using KCF, and simultaneously does not use a predefined criterion, so that the method can detect the target in various image sequences.
Here, the formula of similarity calculation is as follows:
wherein,representing the feature extractor, the directionGradient histogram (Histogram of Oriented Gradient) features and Color Name (Color Name) feature sets. r1, r2 represent the image blocks, the terms represent modulo, mean (·) represents the mean and ρ represents the similarity. The same predicted target frame is compared with a plurality of first background selection frames, and the maximum similarity is taken as the probability that the predicted target frame is background.
When calculating the similarity between the predicted target frame and the target image, considering that the target may rotate in two adjacent frames and other gesture changes, sliding the predicted target frame on the target image, calculating the similarity respectively, and taking the maximum similarity as the probability that the predicted target frame is the target. After obtaining the probability that the predicted target frame belongs to the background and the target, making a judgment, if the probability that the predicted target frame belongs to the background is larger than the probability that the predicted target frame belongs to the target, the predicted target frame is shielded, otherwise, the predicted target frame is not shielded. After all the prediction target frames are judged, setting a template updating mask with the same size as the target scale, wherein elements corresponding to the non-shielded areas are set to be 1, and elements corresponding to the shielded areas are set to be 0. The mask is used for local updating of the target image. In general, the target in the video tracking test sequence does not move to a greater extent in two adjacent frames, so that the tracker search range is generally smaller; when the target is severely occluded, the output result may deviate from the target, which may cause the target to be out of the search range after the target is out of the occlusion. When initializing a target tracker, training n related filters with different scales, and when detecting that the target is seriously shielded, expanding the search range of the tracker by the target predictor, and performing related operation on the filters with the same scale trained during initialization; after the target is out of the shielding, the target predictor reduces the searching range, and excessive sampling of useless background information is avoided.
And S300, if the target is blocked, the control counter is increased by 1, the first total number of the infrared thermal imaging images with blocked targets in the continuous shooting process is calculated, whether abnormal behaviors exist or not is judged according to the first total number, and whether an alarm signal about the abnormal behaviors is output or not is judged according to a judgment result.
Specifically, the determining whether the first similarity is greater than the second similarity, and determining whether the target is blocked according to the determination result includes:
if the first similarity is greater than the second similarity, judging that the target is shielded;
if the first similarity is smaller than or equal to the second similarity, the target is judged not to be blocked.
Specifically, the determining whether abnormal behavior exists according to the first total number includes:
judging whether the first total number is larger than or equal to a second preset threshold value, and judging whether abnormal behaviors exist according to a judging result.
Specifically, the determining whether the first total number is greater than or equal to the second preset threshold, and determining whether the abnormal behavior exists according to the determination result includes:
if the first total number is greater than or equal to a second preset threshold value, judging that abnormal behaviors exist;
and if the first total number is smaller than the second preset threshold value, judging that no abnormal behavior exists.
When the first total number is greater than or equal to the second preset threshold value, the duration of the target being blocked is greater than or equal to 600 seconds, and the target is proved to be in a dangerous area where the target is forbidden to stay for a long time in a workshop, the stay time is long, abnormal behaviors can be judged to exist, a certain potential safety hazard exists, at the moment, an alarm signal related to the abnormal behaviors is output, otherwise, the abnormal behaviors are judged to not exist, and a certain potential safety hazard does not exist, and at the moment, a prompt signal related to the abnormal behaviors is output.
It can be understood that the invention further avoids losing the target caused by the shielding of the target by judging whether the target is shielded or not, thereby further improving the safety degree, the intelligent degree and the reliability of the invention.
Specifically, the determining whether to output the alarm signal related to the abnormal behavior according to the determination result includes:
if the abnormal behavior is judged to exist, outputting an alarm signal related to the abnormal behavior;
if it is determined that the abnormal behavior does not exist, a prompt signal related to the fact that the abnormal behavior does not occur is output.
Specifically, the method further comprises the following steps:
the method comprises the steps of respectively obtaining coordinates of four vertexes of a first target search frame and a second search frame, calculating first coordinates of centers of mass of a target of the first target search frame according to the coordinates of the four vertexes of the first target search frame and the second search frame, calculating second coordinates of centers of mass of the target of the second target search frame, calculating first Euclidean distance between the first coordinates and the second coordinates, judging whether the first Euclidean distance is smaller than a third preset threshold value, if yes, adding 1 to a control counter, calculating second total quantity of infrared thermal imaging images with the first Euclidean distance smaller than the third preset threshold value, judging whether abnormal behaviors exist according to the second total quantity, and judging whether alarm signals related to abnormal behaviors are output according to judgment results.
Here, the calculating includes:
and carrying out piecewise linear change on the gray values of the infrared thermal imaging images of the current frame according to the mean value and standard deviation of the gray values of the infrared thermal imaging images of the current frame to obtain the gray values of each point of the 8-bit single-channel images of the current frame, and calculating according to the gray values of each point of the 8-bit single-channel images of the infrared thermal imaging images of the current frame to obtain the coordinates of the target mass center.
The piecewise linear variation formula is:
wherein mu and sigma are respectively the mean value and standard deviation of gray values of the infrared thermal imaging image of the current frame, x is the gray value of each point of the infrared thermal imaging image of the current frame, y is the gray value of each point of the 8-bit single-channel image obtained after linear transformation, and downward rounding operation is performed.
The centroid positioning calculation formula is as follows:
wherein M and N respectively represent the width and the height of the second anchor frame, (Mmin, nmin) and (Xmax, ymax) respectively represent the upper left corner coordinate and the lower right corner coordinate of the target search frame, iij is the gray value of the pixel point in the rectangular area of the second anchor frame, i is the row position of the pixel point, j is the column position of the pixel point, and (Xc, yc) represents the target centroid coordinate.
Specifically, the determining whether the abnormal behavior exists according to the second total number, and determining whether to output the alarm signal related to the occurrence of the abnormal behavior according to the determination result includes:
judging whether the second total number is larger than or equal to a fourth preset threshold value, and judging whether abnormal behaviors exist according to the judging result.
Specifically, the determining whether the second total number is greater than or equal to a fourth preset threshold, and determining whether the abnormal behavior exists according to the determination result includes:
if the second total number is greater than or equal to a fourth preset threshold value, judging that abnormal behaviors exist;
and if the second total number is smaller than a fourth preset threshold value, judging that no abnormal behavior exists.
It should be noted that, in the present invention, the fourth preset threshold is set to 300, and the foregoing setting is obtained by a technician according to a large number of experiments, when the second total number is greater than or equal to the fourth preset threshold, the time that the target does not move is greater than or equal to 300 seconds, which proves that the target is in a dangerous area where long-time stay is forbidden in a workshop, the stay time is longer, a certain potential safety hazard exists, at this time, an alarm signal related to abnormal behavior is output, otherwise, it is determined that no abnormal behavior exists, and at this time, a prompt signal related to no abnormal behavior is output.
It can be understood that the invention can realize continuous monitoring of the behavior of the same target in the monitored area only by the infrared thermal imaging device, alarms in time when abnormal behavior is monitored, organically combines the video tracking algorithm with workshop management, realizes high-efficiency, high-universality and high-safety workshop management, greatly simplifies the hardware system, does not need complex algorithm modeling, greatly improves the intelligent degree and usability of the invention, and greatly expands the application scene of the invention.
Referring to fig. 2, another embodiment of the present invention provides an intelligent management system for a workshop based on image processing, where the intelligent management system for a workshop based on image processing includes:
an acquisition module 100, including an infrared thermal imaging device disposed above the shop floor, for acquiring an infrared thermal imaging image of a target area of the shop floor;
the control module 200 is configured to obtain an infrared thermal imaging image of a target area of the workshop according to a preset time interval by using an infrared thermal imaging device disposed above the workshop, determine whether a pixel point with a gray value greater than or equal to a first preset threshold exists in the infrared thermal imaging image data, determine the pixel point as a target point if the pixel point exists, and establish a first target search frame in the infrared thermal imaging image of the current frame and establish a second target search frame in the infrared thermal imaging image of the next frame according to all the target points;
or a first background selection frame which is used for generating a preset size around the first target search frame and is closely arranged, determining a background search range according to the first background selection frame, establishing the first background search frame according to the background search range, judging whether pixel points positioned in the first background search frame exist in all pixel points on the boundary of the second target search frame, if so, establishing a prediction target frame with the preset size by taking the pixel points as the center, calculating the first similarity of the prediction target frame and the first background selection frame, calculating the second similarity of the prediction target frame and the corresponding area of the first target search frame, judging whether the first similarity is larger than the second similarity, and judging whether the target is blocked according to the judgment result;
or when the target is blocked, the counter is controlled to be increased by 1, the first total number of the infrared thermal imaging images blocked by the target in the continuous shooting process is calculated, whether abnormal behaviors exist is judged according to the first total number, and whether an alarm signal about the abnormal behaviors is output is judged according to the judgment result.
The invention can realize continuous monitoring of the behavior of the same target in the monitored area only through the infrared thermal imaging device, alarms in time when abnormal behavior is monitored, organically combines a video tracking algorithm with workshop management, realizes high-efficiency, high-universality and high-safety workshop management, greatly simplifies a hardware system, does not need complex algorithm modeling, greatly improves the intelligent degree and usability of the invention, and greatly expands the application scene of the invention.
In a preferred embodiment, the present application further provides an electronic device, including:
a memory; and the processor is used for storing computer readable instructions on the memory, and the computer readable instructions realize the workshop intelligent management method based on image processing when being executed by the processor. The computer device may be broadly a server, a terminal, or any other electronic device having the necessary computing and/or processing capabilities. In one embodiment, the computer device may include a processor, memory, network interface, communication interface, etc. connected by a system bus. The processor of the computer device may be used to provide the necessary computing, processing and/or control capabilities. The memory of the computer device may include a non-volatile storage medium and an internal memory. The non-volatile storage medium may have an operating system, computer programs, etc. stored therein or thereon. The internal memory may provide an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface and communication interface of the computer device may be used to connect and communicate with external devices via a network. Which when executed by a processor performs the steps of the method of the invention.
The present invention may be implemented as a computer readable storage medium having stored thereon a computer program which, when executed by a processor, causes steps of a method of an embodiment of the present invention to be performed. In one embodiment, the computer program is distributed over a plurality of computer devices or processors coupled by a network such that the computer program is stored, accessed, and executed by one or more computer devices or processors in a distributed fashion. A single method step/operation, or two or more method steps/operations, may be performed by a single computer device or processor, or by two or more computer devices or processors. One or more method steps/operations may be performed by one or more computer devices or processors, and one or more other method steps/operations may be performed by one or more other computer devices or processors. One or more computer devices or processors may perform a single method step/operation or two or more method steps/operations.
Those of ordinary skill in the art will appreciate that the method steps of the present invention may be implemented by a computer program, which may be stored on a non-transitory computer readable storage medium, to instruct related hardware such as a computer device or a processor, which when executed causes the steps of the present invention to be performed. Any reference herein to memory, storage, database, or other medium may include non-volatile and/or volatile memory, as the case may be. Examples of nonvolatile memory include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), flash memory, magnetic tape, floppy disk, magneto-optical data storage, hard disk, solid state disk, and the like. Examples of volatile memory include Random Access Memory (RAM), external cache memory, and the like.
It can be understood that the invention can realize continuous monitoring of the behavior of the same target in the monitored area only by the infrared thermal imaging device, alarms in time when abnormal behavior is monitored, organically combines the video tracking algorithm with workshop management, realizes high-efficiency, high-universality and high-safety workshop management, greatly simplifies the hardware system, does not need complex algorithm modeling, greatly improves the intelligent degree and usability of the invention, and greatly expands the application scene of the invention.
The technical features described above may be arbitrarily combined. Although not all possible combinations of features are described, any combination of features should be considered to be covered by the description provided that such combinations are not inconsistent.
The above-described embodiments of the present invention do not limit the scope of the present invention. Any other corresponding changes and modifications made in accordance with the technical idea of the present invention shall be included in the scope of the claims of the present invention.
Claims (10)
1. An intelligent workshop management method based on image processing, which is characterized by comprising the following steps:
s100, acquiring infrared thermal imaging images of a workshop target area according to a preset time interval by using an infrared thermal imaging device arranged above a workshop, judging whether pixel points with gray values larger than or equal to a first preset threshold exist in infrared thermal imaging image data, if so, determining the pixel points as target points, establishing a first target search frame in the infrared thermal imaging image of a current frame according to all the target points, and establishing a second target search frame in the infrared thermal imaging image of a next frame;
s200, generating a first background selection frame with preset size and closely arranged around a first target search frame, determining a background search range according to the first background selection frame, establishing the first background search frame according to the background search range, judging whether pixel points positioned in the first background search frame exist in all pixel points on the boundary of a second target search frame, if so, establishing a prediction target frame with preset size by taking the pixel points as the center, calculating first similarity between the prediction target frame and the first background selection frame, calculating second similarity between the prediction target frame and a corresponding area of the first target search frame, judging whether the first similarity is larger than the second similarity, and judging whether a target is blocked according to a judgment result;
and S300, if the target is blocked, the control counter is increased by 1, the first total number of the infrared thermal imaging images with blocked targets in the continuous shooting process is calculated, whether abnormal behaviors exist or not is judged according to the first total number, and whether an alarm signal about the abnormal behaviors is output or not is judged according to a judgment result.
2. The intelligent workshop management method based on image processing according to claim 1, wherein the determining whether the first similarity is greater than the second similarity, and determining whether the target is blocked according to the determination result, comprises:
if the first similarity is greater than the second similarity, judging that the target is shielded;
if the first similarity is smaller than or equal to the second similarity, the target is judged not to be blocked.
3. The intelligent workshop management method based on image processing according to claim 2, wherein the determining whether there is abnormal behavior according to the first total number includes:
judging whether the first total number is larger than or equal to a second preset threshold value, and judging whether abnormal behaviors exist according to a judging result.
4. The intelligent workshop management method based on image processing according to claim 3, wherein the determining whether the first total number is greater than or equal to a second preset threshold and determining whether abnormal behavior exists according to the determination result comprises:
if the first total number is greater than or equal to a second preset threshold value, judging that abnormal behaviors exist;
and if the first total number is smaller than the second preset threshold value, judging that no abnormal behavior exists.
5. The intelligent workshop management method based on image processing according to claim 4, wherein the determining whether to output an alarm signal regarding occurrence of abnormal behavior according to the determination result comprises:
if the abnormal behavior is judged to exist, outputting an alarm signal related to the abnormal behavior;
if it is determined that the abnormal behavior does not exist, a prompt signal related to the fact that the abnormal behavior does not occur is output.
6. The image processing-based shop intelligent management method according to claim 1, wherein the method further comprises:
the method comprises the steps of respectively obtaining coordinates of four vertexes of a first target search frame and a second search frame, calculating first coordinates of centers of mass of a target of the first target search frame according to the coordinates of the four vertexes of the first target search frame and the second search frame, calculating second coordinates of centers of mass of the target of the second target search frame, calculating first Euclidean distance between the first coordinates and the second coordinates, judging whether the first Euclidean distance is smaller than a third preset threshold value, if yes, adding 1 to a control counter, calculating second total quantity of infrared thermal imaging images with the first Euclidean distance smaller than the third preset threshold value, judging whether abnormal behaviors exist according to the second total quantity, and judging whether alarm signals related to abnormal behaviors are output according to judgment results.
7. The intelligent workshop management method based on image processing according to claim 6, wherein the determining whether there is abnormal behavior based on the second total number and determining whether to output an alarm signal regarding occurrence of abnormal behavior based on the determination result includes:
judging whether the second total number is larger than or equal to a fourth preset threshold value, and judging whether abnormal behaviors exist according to the judging result.
8. The intelligent workshop management method based on image processing according to claim 7, wherein the determining whether the second total number is greater than or equal to a fourth preset threshold and determining whether abnormal behavior exists according to the determination result includes:
if the second total number is greater than or equal to a fourth preset threshold value, judging that abnormal behaviors exist;
and if the second total number is smaller than a fourth preset threshold value, judging that no abnormal behavior exists.
9. An intelligent workshop management system based on image processing, which is characterized by comprising:
the acquisition module comprises an infrared thermal imaging device arranged above the workshop and is used for acquiring an infrared thermal imaging image of a target area of the workshop;
the control module is used for acquiring infrared thermal imaging images of a workshop target area according to a preset time interval by using an infrared thermal imaging device arranged above a workshop, judging whether pixel points with gray values larger than or equal to a first preset threshold exist in infrared thermal imaging image data, if so, determining the pixel points as target points, establishing a first target search frame in the infrared thermal imaging image of the current frame according to all the target points, and establishing a second target search frame in the infrared thermal imaging image of the next frame;
or a first background selection frame which is used for generating a preset size around the first target search frame and is closely arranged, determining a background search range according to the first background selection frame, establishing the first background search frame according to the background search range, judging whether pixel points positioned in the first background search frame exist in all pixel points on the boundary of the second target search frame, if so, establishing a prediction target frame with the preset size by taking the pixel points as the center, calculating the first similarity of the prediction target frame and the first background selection frame, calculating the second similarity of the prediction target frame and the corresponding area of the first target search frame, judging whether the first similarity is larger than the second similarity, and judging whether the target is blocked according to the judgment result;
or when the target is blocked, the counter is controlled to be increased by 1, the first total number of the infrared thermal imaging images blocked by the target in the continuous shooting process is calculated, whether abnormal behaviors exist is judged according to the first total number, and whether an alarm signal about the abnormal behaviors is output is judged according to the judgment result.
10. An electronic device, comprising:
a memory; and a processor having stored thereon computer readable instructions which when executed by the processor implement the image processing based shop intelligent management method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410269842.0A CN117876970A (en) | 2024-03-11 | 2024-03-11 | Workshop intelligent management method and system based on image processing and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410269842.0A CN117876970A (en) | 2024-03-11 | 2024-03-11 | Workshop intelligent management method and system based on image processing and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117876970A true CN117876970A (en) | 2024-04-12 |
Family
ID=90595160
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410269842.0A Pending CN117876970A (en) | 2024-03-11 | 2024-03-11 | Workshop intelligent management method and system based on image processing and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117876970A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111539987A (en) * | 2020-04-01 | 2020-08-14 | 上海交通大学 | Occlusion detection system and method based on discrimination model |
| CN115880229A (en) * | 2022-11-17 | 2023-03-31 | 国网山西省电力公司运城供电公司 | Intelligent monitoring method and system for partial discharge of transformer |
| WO2023072290A1 (en) * | 2021-10-29 | 2023-05-04 | 中移(成都)信息通信科技有限公司 | Tracking target occlusion determination method and apparatus, device and storage medium |
| CN117576778A (en) * | 2023-10-27 | 2024-02-20 | 青岛鹏海软件有限公司 | Factory abnormal behavior monitoring method and system based on video stream and electronic equipment |
-
2024
- 2024-03-11 CN CN202410269842.0A patent/CN117876970A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111539987A (en) * | 2020-04-01 | 2020-08-14 | 上海交通大学 | Occlusion detection system and method based on discrimination model |
| WO2023072290A1 (en) * | 2021-10-29 | 2023-05-04 | 中移(成都)信息通信科技有限公司 | Tracking target occlusion determination method and apparatus, device and storage medium |
| CN115880229A (en) * | 2022-11-17 | 2023-03-31 | 国网山西省电力公司运城供电公司 | Intelligent monitoring method and system for partial discharge of transformer |
| CN117576778A (en) * | 2023-10-27 | 2024-02-20 | 青岛鹏海软件有限公司 | Factory abnormal behavior monitoring method and system based on video stream and electronic equipment |
Non-Patent Citations (1)
| Title |
|---|
| 闫钧华;姜惠华;杨勇;谢天夏;: "DSP实现基于改进压缩跟踪算法的目标实时跟踪", 电子设计工程, no. 20, 20 October 2016 (2016-10-20) * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100481938C (en) | Moving-object tracking control system, and moving-object tracking control device and method | |
| CN110610150A (en) | Tracking method, device, computing equipment and medium of target moving object | |
| CN113808162B (en) | Target tracking method, device, electronic equipment and storage medium | |
| JP2019186955A (en) | Information processing system, information processing method, and program | |
| CN110555377A (en) | pedestrian detection and tracking method based on fisheye camera overlook shooting | |
| CN112785628A (en) | Track prediction method and system based on panoramic view angle detection and tracking | |
| CN117576778A (en) | Factory abnormal behavior monitoring method and system based on video stream and electronic equipment | |
| CN111652314A (en) | Temperature detection method and device, computer equipment and storage medium | |
| CN110910445A (en) | Object size detection method and device, detection equipment and storage medium | |
| CN114092720A (en) | Target tracking method and device, computer equipment and storage medium | |
| JP5177068B2 (en) | Target tracking device, target tracking method | |
| CN116993785B (en) | Target object visual tracking method and device, electronic equipment and storage medium | |
| CN110930436B (en) | Target tracking method and device | |
| CN116168345B (en) | Fire detection method and related equipment | |
| CN117876970A (en) | Workshop intelligent management method and system based on image processing and electronic equipment | |
| CN111768427A (en) | Multi-moving-target tracking method and device and storage medium | |
| CN116152471A (en) | Factory safety production supervision method and system based on video stream and electronic equipment | |
| US20220148198A1 (en) | Image processing apparatus, method, and medium using degrees of reliability and similarity in motion vectors | |
| CN113762017B (en) | Action recognition method, device, equipment and storage medium | |
| CN114359166A (en) | Screen color detection method, device, equipment and storage medium | |
| CN112465850A (en) | Peripheral boundary modeling method, intelligent monitoring method and device | |
| CN117823232A (en) | Coal mine production safety monitoring method and system and electronic equipment | |
| AU2009230796A1 (en) | Location-based brightness transfer function | |
| CN114066927B (en) | Occlusion prediction method, device, equipment and storage medium for moving target | |
| CN113364968A (en) | Focusing method and device, camera and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |