CN112422849A - Welding abnormal data acquisition method and device, electronic equipment and storage medium - Google Patents
Welding abnormal data acquisition method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112422849A CN112422849A CN202011348179.1A CN202011348179A CN112422849A CN 112422849 A CN112422849 A CN 112422849A CN 202011348179 A CN202011348179 A CN 202011348179A CN 112422849 A CN112422849 A CN 112422849A
- Authority
- CN
- China
- Prior art keywords
- welding
- video
- welding process
- monitoring
- alarm signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23K—SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- B23K20/00—Non-electric welding by applying impact or other pressure, with or without the application of heat, e.g. cladding or plating
- B23K20/10—Non-electric welding by applying impact or other pressure, with or without the application of heat, e.g. cladding or plating making use of vibrations, e.g. ultrasonic welding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mechanical Engineering (AREA)
- General Factory Administration (AREA)
Abstract
The invention discloses a welding abnormal data acquisition method, a welding abnormal data acquisition device, electronic equipment and a storage medium, wherein the method comprises the following steps: receiving an alarm signal and determining alarm time corresponding to the alarm signal; acquiring a first monitoring video before the alarm time and a second monitoring video after the alarm time in the continuous monitoring video of the welding process; splicing the first monitoring video and the second monitoring video to obtain a first target video; acquiring welding process information in a time period corresponding to the first target video; and fusing the first target video and the welding process information to obtain welding abnormal data corresponding to the alarm signal. The technical scheme of the embodiment of the invention can realize the acquisition of welding abnormity data in the welding process, so that when the welding abnormity occurs in the welding process, a user is assisted to analyze the welding, and the reason of the welding abnormity is found out.
Description
Technical Field
The embodiment of the invention relates to the technical field of welding machines, in particular to a welding abnormal data acquisition method and device, electronic equipment and a storage medium.
Background
The development of advanced science and technology is rapid, the ultrasonic welding technology is mature day by day, the ultrasonic welding technology is applied to various fields, and when welding abnormity occurs, the reason of the welding abnormity needs to be traced. In the prior art, a welding process is continuously monitored by a traditional video monitoring method. Because the number of welded parts is large, massive monitoring video data are generated in the monitoring process, and video data of abnormal welding of the parts are searched from the monitoring video data, so that the workload of workers is increased. By adopting an externally triggered video monitoring method, when an abnormal event occurs during welding of the parts, the monitoring video is intercepted, the monitoring video between the abnormal parts is lost, and thus the monitoring video needs to be manually checked, and the workload of workers is increased. Therefore, a method for monitoring the ultrasonic welding process in real time and acquiring abnormal welding data is urgently needed.
Disclosure of Invention
The invention provides a method and a device for acquiring welding abnormal data, electronic equipment and a storage medium, which are used for tracing the welding abnormal data such as monitoring and welding process data in an ultrasonic welding process.
In a first aspect, an embodiment of the present invention provides a welding anomaly data acquisition method, including:
receiving an alarm signal and determining alarm time corresponding to the alarm signal;
acquiring a first monitoring video before the alarm time and a second monitoring video after the alarm time in the continuous monitoring video of the welding process;
splicing the first monitoring video and the second monitoring video to obtain a first target video;
acquiring welding process information in a time period corresponding to the first target video;
and fusing the first target video and the welding process information to obtain welding abnormal data corresponding to the alarm signal.
In a second aspect, an embodiment of the present invention further provides a welding anomaly data obtaining apparatus, where the apparatus includes:
the alarm time determining module is used for receiving an alarm signal and determining the alarm time corresponding to the alarm signal;
the monitoring video acquisition module is used for acquiring a first monitoring video before the alarm time and a second monitoring video after the alarm time from the continuous monitoring video in the welding process;
the first target video acquisition module is used for splicing the first monitoring video and the second monitoring video to obtain a first target video;
the welding process information acquisition module is used for acquiring the welding process information in the time period corresponding to the first target video;
and the welding abnormal data acquisition module is used for fusing the first target video and the welding process information to obtain welding abnormal data corresponding to the alarm signal.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a welding anomaly data acquisition method according to any one of the embodiments of the present invention.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the welding anomaly data acquisition method according to any one of the embodiments of the present invention may be implemented.
According to the technical scheme of the embodiment of the invention, the alarm time corresponding to the alarm signal is determined by receiving the alarm signal, the first monitoring video before the alarm time and the second monitoring video after the alarm are coupled in the continuous monitoring video in the welding process, the first monitoring video and the second monitoring video are spliced to obtain the first target video, the welding process information of the corresponding time period is obtained in the first target video, and the first target video and the welding process information are fused to obtain the welding abnormal data corresponding to the alarm signal. The technical scheme provided by the embodiment of the invention can realize the acquisition of welding abnormity data in the welding process, so that when the welding abnormity occurs in the welding process, a user is assisted to analyze the welding, and the reason of the welding abnormity is found out.
Drawings
In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present invention, a brief description is given below of the drawings used in describing the embodiments. It should be clear that the described figures are only views of some of the embodiments of the invention to be described, not all, and that for a person skilled in the art, other figures can be derived from these figures without inventive effort.
Fig. 1 is a schematic flowchart of a welding anomaly data acquisition method according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a welding anomaly data acquisition method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a welding anomaly data acquisition device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a schematic flow chart of a welding abnormal data acquisition method according to an embodiment of the present invention, where the embodiment is applicable to a case of acquiring welding abnormal data in an ultrasonic welding process, the method may be executed by a welding abnormal data acquisition device, and the system may be implemented in a form of software and/or hardware.
As shown in fig. 1, the method of this embodiment includes the following steps:
and S110, receiving an alarm signal and determining alarm time corresponding to the alarm signal.
The alarm signal refers to an alarm signal triggered when an abnormal condition occurs in the ultrasonic welding process, and exemplarily includes at least one of a parameter overrun alarm signal, a welding equipment overload alarm signal, a process monitoring system alarm signal, and an abnormal alarm signal in a monitoring video. The parameter overrun alarm signal includes, but is not limited to, an alarm signal sent when any one parameter of output power, output energy, welding time, amplitude and the like of the welding equipment in the welding process is greater than an upper limit or less than a lower limit corresponding to the parameter. The welding equipment overload warning signal includes, but is not limited to, a warning signal issued when the position deviation of the welding equipment is greater than an upper limit or less than a lower limit, or the position of a part is greater than the upper limit or less than the lower limit. Process monitoring system alarms include, but are not limited to, alarms that are issued when any one of the output voltage, output current, output power, output energy, amplitude, gas pressure, welding time, etc. of the welding device is greater than an upper limit or less than a lower limit. The abnormal alarm signal in the monitoring video includes, but is not limited to, an alarm signal sent when the matching degree of the image frame in the current video and the preset welding abnormal image is greater than a preset value. When the alarm signal is received, the alarm time when the alarm signal is triggered is determined.
And S120, acquiring a first monitoring video before the alarm time and a second monitoring video after the alarm time for the continuous monitoring video in the welding process.
Wherein, set up camera device in the welding scene, in the welding process, will continuously shoot the surveillance video of welding process. And after receiving the alarm signal and acquiring the alarm time corresponding to the alarm signal, intercepting a first monitoring video before the alarm time and a second monitoring video after the alarm time from the continuous monitoring video. When the alarm signal is triggered, the welding process is abnormal, the specific welding process abnormity can be known by acquiring the second monitoring video, and the welding process abnormity can be known by the first monitoring video before the alarm signal is triggered, so that a user can conveniently check the welding process.
Before acquiring a first monitoring video before the alarm time and a second monitoring video after the alarm time, the method illustratively comprises the following steps: and determining the time lengths of the first monitoring video and the second monitoring video according to the type of the alarm signal.
In different types of abnormal situations, the durations of abnormal operations causing abnormal problems are different, for example, when the abnormal operation a is performed for a first duration, the abnormal problem may occur, when the abnormal operation B is performed for a second duration, the abnormal problem may occur, and the results caused by different abnormal situations may be different. When the alarm signal is received, the alarm time and the alarm signal type corresponding to the alarm signal are obtained, the duration of the first monitoring video and the duration of the second monitoring video are determined according to the alarm signal type, and then the first monitoring video and the second monitoring video are obtained according to the alarm time and the corresponding duration.
S130, splicing the first monitoring video and the second monitoring video to obtain a first target video.
Specifically, the first surveillance video and the second surveillance video are spliced in a time sequence to form a complete video, namely the first target video, so that a user can conveniently view the first surveillance video and the second surveillance video integrally.
And S140, acquiring welding process information in a time period corresponding to the first target video.
The welding process information includes information of welding time, output power, output energy, amplitude, humidity and the like of the welding equipment in the welding process. And acquiring the welding process information in the time period corresponding to the first target video aiming at the acquired first target video, so that the working condition and the self condition of the welding equipment in the time period can be known.
S150, fusing the first target video and the welding process information to obtain welding abnormal data corresponding to the alarm signal.
The method for fusing the first target video and the welding process information includes, but is not limited to, displaying the welding process information in a text or graph form at a certain fixed position in each image frame of the first target video, embedding the welding process information in the first target video in a voice manner, embedding the welding process information in the first target video in a subtitle manner, and the like. In this embodiment, the form, time, and location of the occurrence of the welding process information in the first target video are not limited.
Therefore, the first target video and the welding process information are fused to obtain welding abnormal data corresponding to the alarm signal, so that a user can conveniently check the abnormal condition of the welding process, the analysis of the user on the welding abnormality is assisted, and the analysis efficiency and accuracy are improved.
According to the technical scheme of the embodiment of the invention, the alarm time corresponding to the alarm signal is determined by receiving the alarm signal, the first monitoring video before the alarm time and the second monitoring video after the alarm are coupled in the continuous monitoring video in the welding process, the first monitoring video and the second monitoring video are spliced to obtain the first target video, the welding process information of the corresponding time period is obtained in the first target video, and the first target video and the welding process information are fused to obtain the welding abnormal data corresponding to the alarm signal. The technical scheme provided by the embodiment of the invention can realize the acquisition of welding abnormity data in the welding process, so that when welding abnormity occurs in the welding process, a user is assisted in analyzing the welding, the reason of the welding abnormity is found out, and the analysis efficiency and accuracy are improved.
On the basis of the above technical solution, the step 150 is further optimized to embed the welding process information into the image frame of the first target video in a watermark manner, so as to obtain welding abnormal data corresponding to the alarm signal.
The welding process information is embedded into the image frame of each first target video in a watermark mode, and illustratively, the position of embedding the watermark welding process information into each image frame is the same, so that the welding process information can be clearly seen compared with a user when the first target video is played. Due to the watermark mode, the user can not be disturbed to view the content in the first target video. And the analysis of welding abnormal data by a user is facilitated.
The embedding the welding process information into the image frame of the first target video by means of watermarking comprises the following steps: and embedding each data into the image frame corresponding to the time stamp in a watermark-based mode according to the time stamp of each data in the welding process information.
The welding process information comprises all welding process information in a time period corresponding to the first target video. The welding process information may include welding process information at each time point, and the data is embedded into the image frame corresponding to the time stamp by applying the watermark according to the time stamp of the data corresponding to the welding process information. So, the user can look over the welding process information of watermark on the image frame and the image frame that every timestamp corresponds when looking over first target video, make the user just can know the welding process information in corresponding timestamp when looking over first target video, need not go to look over welding process information again, improve the efficiency of user work, also reduce because when looking over welding process information, the welding process information of having looked over other timestamps, cause the result of the analysis welding anomaly in the back left to make mistakes, improve the accuracy of user to the analysis of welding anomaly.
Example two
Fig. 2 is a schematic flow chart of a welding process abnormal data acquisition method according to an embodiment of the present invention, which is optimized based on the above embodiment, and adds a second target video obtained by acquiring a surveillance video of a welding process and a surveillance video before welding, and performs abnormality detection on the second target video to determine an abnormality analysis result. The technical terms that are the same as or similar to those of the above embodiments will not be described again. The method for acquiring the abnormal data in the welding process comprises the following steps:
s210, when a welding start instruction is received, acquiring a third monitoring video before the receiving moment of the welding start instruction from the continuous monitoring video in the welding process.
It should be noted that the monitoring video is recorded before the welding is started. And when the welding is started, sending a welding starting instruction, and when the welding starting instruction is received, acquiring a third monitoring video before the receiving moment of the welding starting instruction from the continuous monitoring video in the welding process, so as to prepare for subsequently acquiring the third monitoring video.
And S220, when a welding ending instruction is received, acquiring a monitoring video of the welding process from the continuous monitoring video of the welding process.
The monitoring video of the welding process refers to the monitoring video between the welding start command and the welding receiving command. When one welding link is finished, a welding finishing instruction is sent out, and when the welding finishing instruction is received, a monitoring video of the welding process is obtained, wherein the monitoring video comprises the welding process of the whole welding equipment to the part.
And S230, splicing the monitoring video of the welding process and the third monitoring video to obtain a second target video.
Wherein, the splicing is performed according to the time sequence. And splicing the third monitoring video and the monitoring video in the welding process to obtain a second target video, wherein the second target video comprises the monitoring video before the welding and the monitoring video in the whole welding process, and the second target video is prepared for subsequent user inspection.
S240, carrying out anomaly detection on the second target video and determining an anomaly analysis result.
And the abnormity detection is that the image frames in the monitoring video are matched with preset abnormal images, and the matching is successful, which indicates that the welding in the current monitoring video is abnormal. For example, according to different types of welding processes, each welding process may be provided with different nodes, and an abnormal image may be provided for each node. The abnormal analysis result refers to the result of abnormal welding process in the monitoring video obtained after abnormal image comparison is carried out on the image frames in the monitoring video. And carrying out image matching on each image frame in the second target video based on the abnormal image frame, and determining an abnormal analysis result.
And S250, acquiring monitoring information of the process monitoring system to the welding equipment.
The process monitoring system monitors the state information of the welding equipment during welding, including but not limited to the output voltage, output current, output power, output energy, amplitude, gas pressure, welding time, etc. of the welding equipment. For example, the process monitoring system may also monitor status information of the welding object including, but not limited to, a current welding status of the welding object, a current welding completion of the welding object, and the like. For example, the process monitoring system may only obtain parameters such as output current, output voltage, etc. of the welding device, while the welding device itself obtains parameters such as output power, output energy, amplitude, etc. And acquiring monitoring information of the process monitoring system on the welding equipment, and preparing for subsequent analysis on whether the welding process is abnormal or not.
S260, judging whether the welding process is abnormal or not based on the monitoring information of the welding equipment and the abnormal analysis result of the second target video; if yes, generating an alarm signal.
When the welding process is determined to be abnormal based on the monitoring information of the welding equipment or the abnormality analysis result of the second target video displays that the welding process is abnormal, the welding process is determined to be abnormal, and an alarm signal is generated.
Also included after step 260 is: and performing data fusion on the monitoring information of the welding equipment and the second target video to obtain fusion welding data.
The data fusion method includes, but is not limited to, embedding monitoring information of the welding device into each image frame of the second target video, and the embedding method includes, but is not limited to, watermarking, subtitles, images and the like. For example, a time stamp, which may be acquired from monitoring information of the welding device, is embedded in the image frame of the second target video corresponding to the time stamp. And fusing the monitoring information of the welding equipment and the data of the second target video to obtain fused welding data, so that the user can conveniently check the fused welding data subsequently.
The technical scheme provided by the embodiment of the invention can realize the integral monitoring of the welding process and determine whether the welding process has abnormity or not according to the monitoring video and the monitoring information of the welding equipment by acquiring a third monitoring video before the receiving moment of the welding starting instruction in the continuous monitoring of the welding process when the welding starting instruction is received, acquiring the monitoring video of the welding process in the continuous monitoring of the welding process when the welding ending instruction is received, splicing the monitoring video of the welding process and the third monitoring video to obtain a second target video, carrying out abnormity detection on the second target video, determining an abnormity analysis result, acquiring the monitoring information of the welding equipment by a process monitoring system, and determining whether the welding process has abnormity or not according to the abnormity analysis result and the monitoring information, the accuracy of welding process anomaly detection is improved.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a welding abnormal data acquisition device according to an embodiment of the present invention, where the welding abnormal data acquisition device according to the embodiment of the present invention implements the welding abnormal data acquisition method according to any one of the embodiments, and the welding abnormal data acquisition device according to the embodiment of the present invention includes: an alarm time determination module 310, a surveillance video acquisition module 320, a first target video acquisition module 330, a welding process information acquisition module 340, and a welding anomaly data acquisition module 350.
An alarm time determining module 310, configured to receive an alarm signal and determine an alarm time corresponding to the alarm signal;
the monitoring video acquiring module 320 is configured to acquire, in a continuous monitoring video of a welding process, a first monitoring video before the alarm time and a second monitoring video after the alarm time;
a first target video obtaining module 330, configured to splice the first surveillance video and the second surveillance video to obtain a first target video;
a welding process information obtaining module 340, configured to obtain welding process information in a time period corresponding to the first target video;
and a welding abnormal data obtaining module 350, configured to fuse the first target video and the welding process information to obtain welding abnormal data corresponding to the alarm signal.
Further, the welding anomaly data acquisition module 350 includes:
and the first welding abnormal data acquisition submodule is used for embedding the welding process information into the image frame of the first target video in a watermark mode so as to acquire welding abnormal data corresponding to the alarm signal.
Further, the first welding anomaly data acquisition submodule includes:
and the first welding abnormal data acquisition unit is used for embedding each data into the image frame corresponding to the time stamp in a watermark-based mode according to the time stamp of each data in the welding process information.
Further, the apparatus further comprises:
and the monitoring video time length determining module is used for determining the time lengths of the first monitoring video and the second monitoring video according to the type of the alarm signal.
In one embodiment, the apparatus further comprises:
and the third monitoring video acquisition module is used for acquiring a third monitoring video before the receiving moment of the welding starting instruction from the continuous monitoring video in the welding process when the welding starting instruction is received.
Further, the apparatus further comprises:
and the welding process monitoring video acquisition module is used for acquiring the monitoring video of the welding process from the continuous monitoring video of the welding process when receiving the welding end instruction.
Further, the apparatus further comprises:
and the second target video acquisition module is used for splicing the monitoring video of the welding process and the third monitoring video to acquire a second target video.
Further, the apparatus further comprises:
and the anomaly analysis result determining module is used for carrying out anomaly detection on the second target video and determining an anomaly analysis result.
Further, the apparatus further comprises:
the alarm signal generating module is used for acquiring monitoring information of the process monitoring system to the welding equipment; judging whether the welding process is abnormal or not based on the monitoring information of the welding equipment and the abnormal analysis result of the second target video; if yes, generating an alarm signal.
Further, the apparatus further comprises:
and the fusion welding data acquisition module is used for carrying out data fusion on the monitoring information of the welding equipment and the second target video to obtain fusion welding data.
According to the technical scheme of the embodiment of the invention, the alarm time corresponding to the alarm signal is determined by receiving the alarm signal, the first monitoring video before the alarm time and the second monitoring video after the alarm are coupled in the continuous monitoring video in the welding process, the first monitoring video and the second monitoring video are spliced to obtain the first target video, the welding process information of the corresponding time period is obtained in the first target video, and the first target video and the welding process information are fused to obtain the welding abnormal data corresponding to the alarm signal. The technical scheme provided by the embodiment of the invention can realize the acquisition of welding abnormity data in the welding process, so that when the welding abnormity occurs in the welding process, a user is assisted to analyze the welding, and the reason of the welding abnormity is found out.
The welding abnormal data acquisition device provided by the embodiment of the invention can execute the welding abnormal data acquisition method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
It should be noted that, the units and modules included in the system are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the embodiment of the invention.
Example four
Fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. FIG. 4 illustrates a block diagram of an exemplary electronic device 40 suitable for use in implementing embodiments of the present invention. The electronic device 40 shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiment of the present invention.
As shown in fig. 4, electronic device 40 is embodied in the form of a general purpose computing device. The components of electronic device 40 may include, but are not limited to: one or more processors or processing units 401, a system memory 402, and a bus 403 that couples the various system components (including the system memory 402 and the processing unit 401).
The system memory 402 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)404 and/or cache memory 405. The electronic device 40 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 406 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, and commonly referred to as a "hard drive"). Although not shown in FIG. 4, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 403 by one or more data media interfaces. Memory 402 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 408 having a set (at least one) of program modules 407 may be stored, for example, in memory 402, such program modules 407 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 407 generally perform the functions and/or methods of the described embodiments of the invention.
The electronic device 40 may also communicate with one or more external devices 409 (e.g., keyboard, pointing device, display 410, etc.), with one or more devices that enable a user to interact with the electronic device 40, and/or with any devices (e.g., network card, modem, etc.) that enable the electronic device 40 to communicate with one or more other computing devices. Such communication may be through input/output (I/O) interface 411. Also, the electronic device 40 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 412. As shown, the network adapter 412 communicates with the other modules of the electronic device 40 over the bus 403. It should be appreciated that although not shown in FIG. 4, other hardware and/or software modules may be used in conjunction with electronic device 40, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 401 executes various functional applications and data processing by running a program stored in the system memory 402, for example, to implement the welding anomaly data acquisition method provided by the embodiment of the present invention.
EXAMPLE five
Embodiments of the present invention also provide a storage medium containing computer-executable instructions for performing a method of weld anomaly data acquisition when executed by a computer processor.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (11)
1. A welding anomaly data acquisition method is characterized by comprising the following steps:
receiving an alarm signal and determining alarm time corresponding to the alarm signal;
in the continuous monitoring video of the welding process, acquiring a first monitoring video before the alarm time and a second monitoring video after the alarm time;
splicing the first monitoring video and the second monitoring video to obtain a first target video;
acquiring welding process information in a time period corresponding to the first target video;
and fusing the first target video and the welding process information to obtain welding abnormal data corresponding to the alarm signal.
2. The method of claim 1, wherein the alarm signal comprises at least one of a parameter overrun alarm signal, a welding equipment overload alarm signal, a process monitoring system alarm signal, an anomaly alarm signal in a surveillance video.
3. The method of claim 1, wherein fusing the first target video with the welding process information to obtain welding anomaly data corresponding to an alarm signal comprises:
and embedding the welding process information into an image frame of a first target video in a watermark mode so as to obtain welding abnormal data corresponding to the alarm signal.
4. The method of claim 3, wherein the embedding the welding process information into image frames of a first target video by way of a watermark comprises:
and embedding each data into the image frame corresponding to the time stamp in a watermark-based mode according to the time stamp of each data in the welding process information.
5. The method of claim 1, wherein prior to obtaining a first surveillance video prior to the alarm time and a second surveillance video subsequent to the alarm time, comprising:
and determining the time lengths of the first monitoring video and the second monitoring video according to the type of the alarm signal.
6. The method of claim 1, wherein prior to receiving the alarm signal, further comprising:
when a welding start instruction is received, acquiring a third monitoring video before the receiving moment of the welding start instruction from a continuous monitoring video of a welding process;
when a welding ending instruction is received, acquiring a monitoring video of the welding process from the continuous monitoring video of the welding process;
and splicing the monitoring video of the welding process and the third monitoring video to obtain a second target video.
7. The method of claim 6, wherein after the obtaining the second target video, further comprising:
performing anomaly detection on the second target video to determine an anomaly analysis result;
acquiring monitoring information of a process monitoring system on welding equipment;
judging whether the welding process is abnormal or not based on the monitoring information of the welding equipment and the abnormal analysis result of the second target video;
if yes, generating an alarm signal.
8. The method of claim 7, after determining whether there is an abnormality in the welding process based on the monitoring information of the welding equipment and the abnormality analysis result of the second target video, further comprising:
and performing data fusion on the monitoring information of the welding equipment and the second target video to obtain fusion welding data.
9. A welding anomaly data acquisition device, comprising:
the alarm time determining module is used for receiving an alarm signal and determining the alarm time corresponding to the alarm signal;
the monitoring video acquisition module is used for acquiring a first monitoring video before the alarm time and a second monitoring video after the alarm time from the continuous monitoring video in the welding process;
the first target video acquisition module is used for splicing the first monitoring video and the second monitoring video to obtain a first target video;
the welding process information acquisition module is used for acquiring the welding process information in the time period corresponding to the first target video;
and the welding abnormal data acquisition module is used for fusing the first target video and the welding process information to obtain welding abnormal data corresponding to the alarm signal.
10. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the welding anomaly data acquisition method of any of claims 1-8.
11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, is adapted to carry out a welding anomaly data acquisition method according to any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011348179.1A CN112422849A (en) | 2020-11-26 | 2020-11-26 | Welding abnormal data acquisition method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011348179.1A CN112422849A (en) | 2020-11-26 | 2020-11-26 | Welding abnormal data acquisition method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112422849A true CN112422849A (en) | 2021-02-26 |
Family
ID=74843578
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011348179.1A Pending CN112422849A (en) | 2020-11-26 | 2020-11-26 | Welding abnormal data acquisition method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112422849A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113593074A (en) * | 2021-07-15 | 2021-11-02 | 盛景智能科技(嘉兴)有限公司 | Monitoring video generation method and device |
| CN114074339A (en) * | 2021-11-29 | 2022-02-22 | 合肥欣奕华智能机器有限公司 | Vibration detection device of robot |
| CN114309935A (en) * | 2021-12-31 | 2022-04-12 | 亚通汽车零部件(常熟)有限公司 | Data acquisition method and system in laser welding process |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05293647A (en) * | 1992-04-21 | 1993-11-09 | Kawasaki Steel Corp | Arc weld monitoring method |
| JP2003033873A (en) * | 2001-07-19 | 2003-02-04 | Toshiba Corp | Welding equipment |
| CN102625739A (en) * | 2009-09-11 | 2012-08-01 | 弗罗纽斯国际有限公司 | Monitoring module for monitoring a process with an electric arc |
| CN106041258A (en) * | 2016-08-17 | 2016-10-26 | 江苏北人机器人系统股份有限公司 | Intelligent robot welding system |
| US20180113077A1 (en) * | 2016-10-20 | 2018-04-26 | Hitachi, Ltd. | Welding monitoring system and welding monitoring method |
| US20180200819A1 (en) * | 2017-01-17 | 2018-07-19 | Hakko Corporation | Soldering apparatus and method |
| CN208398808U (en) * | 2018-07-12 | 2019-01-18 | 小原(南京)机电有限公司 | A kind of welding gun electrode adhesion monitoring device based on image recognition |
| CA3077548A1 (en) * | 2020-03-31 | 2020-05-31 | VeriPhase, Inc. | System and method for the improved analysis of ultrasonic weld data |
| CN111629165A (en) * | 2020-07-28 | 2020-09-04 | 天津中新智冠信息技术有限公司 | Alarm video processing method, device, equipment and storage medium |
-
2020
- 2020-11-26 CN CN202011348179.1A patent/CN112422849A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05293647A (en) * | 1992-04-21 | 1993-11-09 | Kawasaki Steel Corp | Arc weld monitoring method |
| JP2003033873A (en) * | 2001-07-19 | 2003-02-04 | Toshiba Corp | Welding equipment |
| CN102625739A (en) * | 2009-09-11 | 2012-08-01 | 弗罗纽斯国际有限公司 | Monitoring module for monitoring a process with an electric arc |
| CN106041258A (en) * | 2016-08-17 | 2016-10-26 | 江苏北人机器人系统股份有限公司 | Intelligent robot welding system |
| US20180113077A1 (en) * | 2016-10-20 | 2018-04-26 | Hitachi, Ltd. | Welding monitoring system and welding monitoring method |
| US20180200819A1 (en) * | 2017-01-17 | 2018-07-19 | Hakko Corporation | Soldering apparatus and method |
| CN208398808U (en) * | 2018-07-12 | 2019-01-18 | 小原(南京)机电有限公司 | A kind of welding gun electrode adhesion monitoring device based on image recognition |
| CA3077548A1 (en) * | 2020-03-31 | 2020-05-31 | VeriPhase, Inc. | System and method for the improved analysis of ultrasonic weld data |
| CN111629165A (en) * | 2020-07-28 | 2020-09-04 | 天津中新智冠信息技术有限公司 | Alarm video processing method, device, equipment and storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113593074A (en) * | 2021-07-15 | 2021-11-02 | 盛景智能科技(嘉兴)有限公司 | Monitoring video generation method and device |
| CN113593074B (en) * | 2021-07-15 | 2023-09-22 | 盛景智能科技(嘉兴)有限公司 | Method and device for generating monitoring video |
| CN114074339A (en) * | 2021-11-29 | 2022-02-22 | 合肥欣奕华智能机器有限公司 | Vibration detection device of robot |
| CN114309935A (en) * | 2021-12-31 | 2022-04-12 | 亚通汽车零部件(常熟)有限公司 | Data acquisition method and system in laser welding process |
| CN114309935B (en) * | 2021-12-31 | 2024-01-30 | 亚通汽车零部件(常熟)有限公司 | Data acquisition method and system in laser welding process |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112422849A (en) | Welding abnormal data acquisition method and device, electronic equipment and storage medium | |
| CN110516971B (en) | Anomaly detection method, device, medium and computing equipment | |
| US8489941B2 (en) | Automatic documentation of ticket execution | |
| CN111554219A (en) | Display equipment testing method and device, electronic product and storage medium | |
| WO2017148271A1 (en) | Linux system reset processing method and device, and computer storage medium | |
| CN111796978A (en) | Interface detection method, device, system, equipment and storage medium | |
| CN114003473A (en) | Page operation behavior backtracking method and device and electronic equipment | |
| CN115134562A (en) | Inspection method and device of monitoring device, electronic equipment and storage medium | |
| WO2022007299A1 (en) | Power grid fault diagnosis method based on micro-service architecture, and storage medium | |
| CN111784176A (en) | Data processing method, device, server and medium | |
| CN113886122B (en) | System operation exception handling method, device, equipment and storage medium | |
| CN116489336A (en) | Equipment monitoring method, device, equipment, medium and product based on virtual film production | |
| CN113055667B (en) | Video quality detection method and device, electronic equipment and storage medium | |
| CN115658500A (en) | Vue-based front-end error log uploading method and system in hybrid development | |
| CN114579342A (en) | Fault detection method and device, electronic equipment and storage medium | |
| CN114816670A (en) | Virtual machine detection method and device, electronic equipment and storage medium | |
| CN114760444A (en) | Video image processing and determining method and device, electronic equipment and storage medium | |
| CN114553725A (en) | Computer room monitoring and alarming method and device, electronic equipment and storage medium | |
| CN114553663A (en) | Abnormity detection method, device, equipment and storage medium | |
| CN112799957A (en) | User behavior based fault handling method, system, device and medium | |
| CN114510398A (en) | Anomaly monitoring method, apparatus, device, system and medium | |
| CN115499292B (en) | Alarm method, device, equipment and storage medium | |
| CN113448795B (en) | Method, apparatus and computer program product for obtaining system diagnostic information | |
| KR102372556B1 (en) | Mobile service control method and system based on mobile remote control technology | |
| CN115357442A (en) | System interface test method, system, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 200240 floor 3, building 2, No. 1488, Cangyuan Road, Minhang District, Shanghai Applicant after: Shanghai Jiaocheng Ultrasonic Technology Co.,Ltd. Address before: 200241 1st floor, building 3, 48 Lane 4916, Hongmei South Road, Minhang District, Shanghai Applicant before: SBT ENGINEERING SYSTEMS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210226 |
|
| RJ01 | Rejection of invention patent application after publication |