CN110718231A - Monitoring method, device, terminal and storage medium based on acoustic network - Google Patents
Monitoring method, device, terminal and storage medium based on acoustic network Download PDFInfo
- Publication number
- CN110718231A CN110718231A CN201910865618.7A CN201910865618A CN110718231A CN 110718231 A CN110718231 A CN 110718231A CN 201910865618 A CN201910865618 A CN 201910865618A CN 110718231 A CN110718231 A CN 110718231A
- Authority
- CN
- China
- Prior art keywords
- acoustic
- monitoring
- fault
- target sound
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 113
- 238000000034 method Methods 0.000 title claims abstract description 85
- 238000003860 storage Methods 0.000 title claims abstract description 14
- 230000005236 sound signal Effects 0.000 claims abstract description 106
- 238000012806 monitoring device Methods 0.000 claims abstract description 12
- 238000001514 detection method Methods 0.000 claims abstract description 6
- 238000004590 computer program Methods 0.000 claims description 10
- 230000004044 response Effects 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 description 12
- 230000000694 effects Effects 0.000 description 9
- 238000004519 manufacturing process Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000009776 industrial production Methods 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 210000005069 ears Anatomy 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000002411 adverse Effects 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000010687 lubricating oil Substances 0.000 description 1
- 238000005461 lubrication Methods 0.000 description 1
- 239000013502 plastic waste Substances 0.000 description 1
- 230000001020 rhythmical effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H17/00—Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves, not provided for in the preceding groups
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Quality & Reliability (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Abstract
The embodiment of the invention discloses a monitoring method, a device, a terminal and a storage medium based on an acoustic network, wherein the method is applied to fault detection of equipment and specifically comprises the following steps: collecting a target sound signal in the running process of equipment to be monitored, wherein the target sound signal comprises an intrinsic signal and a noise signal; converting the intrinsic signal to a preset time coordinate system according to a preset time reference; and analyzing and processing the intrinsic signal by adopting a preset acoustic processing algorithm, generating and outputting a monitoring result corresponding to the intrinsic signal, wherein the monitoring result comprises a judgment result of whether the equipment to be monitored has a fault and/or the type of the fault. In addition, the embodiment of the invention also discloses a monitoring device based on the acoustic network, a terminal and a computer readable medium. By adopting the invention, the fault can be responded in time, and the loss caused by the fault is reduced.
Description
Technical Field
The invention relates to the technical field of machine acoustics, in particular to a monitoring method, a monitoring device, a monitoring terminal and a monitoring storage medium based on an acoustic network.
Background
In the modern industrial production process, semi-automatic and automatic assembly line operation is generally adopted, a large amount of machine equipment is involved, in the operation process, the machine equipment is difficult to avoid faults, for example, some slight faults can influence the yield of the whole production, serious faults can cause that the production cannot be continuously carried out, the traditional problem solution to the faults is to carry out actual detection through manpower after the faults occur, so that the actual fault condition is obtained, and corresponding countermeasures are taken; however, with the continuous increase of labor cost and the increasingly complex structure of the machine equipment, the existing manual detection mode cannot timely and effectively detect the fault of the machine equipment.
Disclosure of Invention
In view of this, the present invention provides a monitoring method, apparatus, terminal and storage medium based on an acoustic network, which are used to solve the problem in the prior art that a machine device cannot be timely and effectively detected.
The specific technical scheme of the invention is as follows:
in a first aspect, an embodiment of the present invention provides a monitoring method based on an acoustic network, which is applied to fault detection of a device, and the method includes:
collecting a target sound signal in the running process of equipment to be monitored, wherein the target sound signal comprises an intrinsic signal and a noise signal;
converting the intrinsic signal to a preset time coordinate system according to a preset time reference;
and analyzing and processing the intrinsic signal by adopting a preset acoustic processing algorithm, generating and outputting a monitoring result corresponding to the intrinsic signal, wherein the monitoring result comprises a judgment result of whether the equipment to be monitored has a fault and/or the type of the fault.
Further, the collecting of the target sound signal in the operation process of the device to be monitored includes:
setting one or more acoustic collection nodes for collecting the target sound signal for each device to be monitored;
and collecting all the target sound signals inside and outside the hearing threshold of the human ear through the acoustic collection node.
Further, the collecting of the target sound signal in the operation process of the device to be monitored further includes:
and preprocessing the target sound signal to remove the noise signal existing in the target sound signal and obtain the intrinsic signal.
Further, the converting the intrinsic signal to a preset time coordinate system with a predetermined time reference includes:
all the acoustic collection nodes arranged in the same device to be monitored are subjected to unified time service;
and establishing the time coordinate system according to the time service, and determining the time reference of the time coordinate system.
Further, the unified time service for all the acoustic collection nodes arranged in the same device to be monitored includes:
automatically matching the time service with standard time, and judging whether the time service is matched with the standard time;
and if the time service is not matched with the standard time, adjusting the time service to be the same as the standard time.
Further, the analyzing and processing the intrinsic signal by using a preset acoustic processing algorithm includes:
extracting acoustic features of the intrinsic signals by adopting a preset acoustic processing algorithm;
determining whether the equipment to be monitored has a fault according to the acoustic characteristics;
and when the monitoring equipment has faults, determining the type of the faults according to the acoustic characteristics.
Further, the determining, according to the acoustic feature, whether the device to be monitored has a fault, and when the monitoring device has a fault, further determining, according to the acoustic feature, a type of the fault includes:
matching the acoustic features with preset standard features, wherein the standard features comprise standard fault features and standard operation features;
and if the acoustic characteristics are not matched with the standard operation characteristics, judging that the equipment to be monitored has a fault, and determining the type of the fault according to the matching result of the acoustic characteristics and the standard fault characteristics.
In a second aspect, an embodiment of the present invention provides a monitoring device based on an acoustic network, including:
the system comprises a sound acquisition module, a monitoring module and a monitoring module, wherein the sound acquisition module is used for acquiring a target sound signal in the running process of equipment to be monitored, and the target sound signal comprises an intrinsic signal and a noise signal;
the coordinate conversion module is used for converting the intrinsic signals to a preset time coordinate system according to a preset time reference;
the sound analysis module is used for analyzing and processing the intrinsic signal by a preset acoustic processing algorithm, generating and outputting a monitoring result corresponding to the intrinsic signal;
and the result response module is used for responding according to the monitoring result so as to remind the user.
In a third aspect, an embodiment of the present invention further provides a terminal, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the above monitoring method based on an acoustic network when executing the computer program.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, which includes computer instructions, when the computer instructions are executed on a computer, the computer is caused to execute the monitoring method based on the acoustic network as described above.
The embodiment of the invention has the following beneficial effects:
after the monitoring method, the monitoring device, the monitoring terminal and the storage medium based on the acoustic network are adopted, for the monitoring operation of equipment faults, specifically, a monitoring system based on the acoustic network is constructed, a plurality of acoustic acquisition nodes are arranged in the monitoring system, one or more than one acoustic acquisition node is arranged for each equipment to be monitored, different target sound signals are sent out by the equipment to be monitored based on different running states, all the target sound signals (including the inside and outside of the hearing threshold of a human ear) in the running process of the equipment to be monitored are acquired by the acoustic acquisition nodes, all the target sound signals are converted uniformly according to a preset time reference, the processing of all the target sound signals in the running process of the equipment to be monitored at the same time point is realized, and the fault conditions possibly existing in the equipment corresponding to the different preset target sound signals are met, therefore, the monitoring effect of the equipment to be monitored is realized, different responses are sent out according to different faults, so that a user is reminded to maintain or take corresponding measures in time, and the minimum loss or even no loss is generated under the condition of the faults. The monitoring method of the embodiment of the invention can be suitable for different equipment running conditions, improves the monitoring effect on the equipment running conditions and is beneficial to ensuring the safe running of the equipment.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Wherein:
FIG. 1 is a schematic diagram of the monitoring system in one embodiment;
FIG. 2 is a schematic flow chart of the acoustic network-based monitoring method according to an embodiment;
fig. 3 is a schematic flow chart illustrating an implementation of the setting of the acoustic collection node in one embodiment;
FIG. 4 is a flow diagram illustrating a process for determining a time reference in one embodiment;
FIG. 5 is a schematic diagram illustrating a process of analyzing intrinsic signals in a device to be monitored according to an embodiment;
FIG. 6 is a schematic diagram of an embodiment of an acoustic network based monitoring apparatus;
fig. 7 is a schematic internal structural diagram of a computer device for operating the above monitoring method based on the acoustic network in one embodiment.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to more effectively monitor the machine equipment and prevent the efficiency of production from being reduced or the production from being stopped more seriously due to faults under the condition that the structure of the machine equipment is more and more complicated, in the embodiment, a monitoring method based on an acoustic network is particularly provided and is applied to fault detection of the equipment, and the method can be realized by depending on a computer program which can run on a computer system comprising a microprocessor. The monitoring method based on the acoustic network is applied to a monitoring system for the operation of machine equipment, and in order to realize comprehensive monitoring operation, the monitoring system in the embodiment is at least provided with an acoustic acquisition node for acquiring target sound signal data in the operation process of the machine equipment; specifically, the monitoring system for the operation status of the machine equipment may include a plurality of acoustic collection nodes, a transmission network, and a processor as shown in fig. 1, where after the acoustic collection nodes collect target sound signal data corresponding to the equipment to be monitored, the target sound signal data are transmitted to the processor through the transmission network, and after the processor analyzes and processes the target sound signal data, corresponding monitoring results are output (for example, the equipment is effectively turned on, there is no fault in normal operation, and there is a device slip, etc.), and by reminding a user (a user of the machine equipment or a tester, etc., and specifically, the user may set in the processor), if there is a fault, the user adopts timely and effective measures to ensure normal operation of the machine equipment.
The acoustic acquisition node can specifically acquire target sound signal data through a precise sensor and other equipment/devices with the function of acquiring target sound signals; the transmission network can be a wired network, such as an Ethernet, an industrial bus local area network and the like, and can also be a wireless network and the like; the processor is a control device, such as a central server, which can run target sound signal analysis software, sound logic judgment software, user reminding and other functions.
Specifically, as shown in fig. 2, the monitoring method based on the acoustic network includes steps S102 to S106:
step S102: collecting a target sound signal in the running process of equipment to be monitored, wherein the target sound signal comprises an intrinsic signal and a noise signal;
in this embodiment, based on different operating states of the machine, the sound generated by the machine is different, for example, the sound of the rotation of the motor bearing is rhythmical and continuous if the bearing is operating normally, and if foreign matters (such as clean dust-free cloth, dust-free paper, plastic waste, useless wires and the like) are attached to the bearing, the foreign matters on the bearing can rub against adjacent parts in the machine to generate noise during the operation of the bearing, for example, if the transmission device slips, the sound generated by the transmission device is different from the normal sound, for example, if the screw falls off, the sound as " " can be generated, if the bearing lacks lubricating oil, the friction sound as "huguru" is obviously large, and the like; at the moment, whether a fault condition exists or a phenomenon about to occur is judged according to a target sound signal existing in the actual operation process of the machine equipment; therefore, the present embodiment judges whether the machine equipment has a fault or is about to have a fault by collecting the target sound signal in the operation process of the equipment to be monitored.
In addition, during the operation of the machine equipment, other sounds except the operation of the machine equipment may exist, and in order to ensure the monitoring effect, the present embodiment also collects other noise signals except the sounds generated by the operation of the machine equipment, so that the collection of the target sound signal in the present embodiment includes the collection of an intrinsic signal and the collection of other noise signals of the operation of the machine equipment, that is, the collection of all target sound signals of the environment where the machine equipment is located during the operation of the machine equipment. Of course, the noise signal needs to be removed to ensure the accuracy of judging whether the operation of the machine equipment has faults through the target sound signal.
The present embodiment can achieve more comprehensive monitoring operation of the machine device by the target sound signals including all the target sound signals within and outside the human ear hearing threshold, such as ultrasonic signals and infrasonic signals.
Step S104: converting the intrinsic signal to a preset time coordinate system according to a preset time reference;
in this embodiment, at a certain time during the operation of the machine equipment, since the machine equipment may have the operation of multiple components, several target sound signals may be collected at the same time, and at the same time, noise signals of the surrounding environment where the machine equipment is located are also included. In order to restore the actual operating state of the device to be monitored through the acquired target sound signal, the embodiment preprocesses the acquired target sound signal to remove unnecessary noise signals and acquire an intrinsic signal corresponding to the operating state of the device to be monitored. Then, all the acquired target sound signals are subjected to unified time sequence collection according to a preset time reference, namely all the intrinsic signals corresponding to the running state of the machine equipment are converted into a preset time coordinate system, so that the time sequence judgment of the acquired intrinsic signals is realized, and the time line of the occurrence of the fault is better restored.
The time reference can be set by adopting GPS accurate timing, specifically realized by a GPS calibration server, or by taking a processor as a reference and setting the time reference by calculating network delay. In actual operation, the collected target sound signal is within the hearing threshold of human ears or outside the hearing threshold of human ears (such as ultrasonic signals and the like)Low frequency signals, and therefore at least to the microsecond level, i.e. 10, when setting the time reference-6。
According to the embodiment, all intrinsic signals at the same moment are combined to monitor the machine equipment, so that the monitoring precision can be improved, and the fastest and effective counter measures can be taken according to the monitoring result in the follow-up process.
Step S106: and analyzing and processing the intrinsic signal by adopting a preset acoustic processing algorithm, generating and outputting a monitoring result corresponding to the intrinsic signal, wherein the monitoring result comprises a judgment result of whether the equipment to be monitored has a fault and/or the type of the fault.
In this embodiment, in the monitoring process of the machine device in the operation process, because different target sound signals (only the intrinsic signals are applied when determining whether the machine device has a fault in the operation process) correspond to different fault states, in order to reflect the different fault states through the intrinsic signals, a preset acoustic processing algorithm is used to analyze and process the actually acquired intrinsic signals in the operation process of the machine device and the preset target sound signals, and a monitoring result corresponding to the intrinsic signals is generated and output according to the analysis and processing result.
Specifically, the acoustic characteristics and the operation types corresponding to different sound signals under different operating conditions of the machine equipment are stored in a storage unit, such as a database, of the monitoring system in advance. The method comprises the steps of collecting a target sound signal in the actual operation process, converting the target sound signal into a time coordinate system according to a preset time reference, traversing and comparing an intrinsic signal obtained by preprocessing the target sound signal with acoustic features of sound signals corresponding to different operation states and prestored in a database, matching the intrinsic signal with the acoustic features to obtain acoustic features corresponding to the intrinsic signal, obtaining a judgment result of the operation state of equipment to be monitored according to the matching result, outputting the judgment result as a monitoring result, reminding a user whether a fault exists in the machine equipment and what the specific type of the fault exists, and taking corresponding measures to deal with the fault.
According to the monitoring method based on the acoustic network, the method can be used for monitoring the state of a single device; the system consisting of a plurality of devices can also be monitored, and the whole system can be restored in the operation process based on the fact that the intrinsic signals of the target sound signals acquired by the acoustic acquisition nodes and corresponding to the device operation states are converted into a time coordinate system with a uniform time reference; for example, if during the production process, a situation occurs in which combustible gas is gathered and an explosion is caused due to the stoppage of one fan; the specific cause of the accident may not be directly analyzed and deduced after the accident. However, if the acoustic collection nodes of the embodiment are arranged on all the devices on the whole production line such as the fan, the intrinsic signals obtained through actual collection can be analyzed and processed through the processor, and the time line data corresponding to the intrinsic signals are combined, so that the accident occurrence reasons can be judged intuitively and easily, namely, the accident rotation and stop time of the fan, the fan rotation and stop reasons and the like can be judged, the fundamental reason for the accident occurrence can be found, and maintenance is performed according to the fundamental reason, so that the similar accident can be prevented from occurring again.
According to the embodiment, the target sound signals are analyzed and processed by adopting the preset acoustic processing algorithm, whether the machine equipment has faults or not can be effectively judged, the specific type of the corresponding fault is obtained, the machine equipment is effectively monitored, corresponding counter measures are taken conveniently, loss caused by the fault is reduced, and the safety of industrial production is improved.
In this embodiment, as shown in fig. 3, the acquiring a target sound signal of a device to be monitored, specifically acquiring a target sound signal corresponding to an operation process of the device to be monitored, includes:
s1021: setting one or more acoustic collection nodes for collecting the target sound signal for each device to be monitored;
generally, at least one machine device is set to perform processing operation in, for example, an industrial production process, and therefore, in order to implement monitoring operation on all the machine devices, in the present embodiment, in order to implement monitoring operation on all the machine devices, a monitoring system for collecting a target sound signal in an operation process of a device to be detected is correspondingly constructed. In order to further realize the monitoring operation of a plurality of monitoring devices, an acoustic collection node corresponding to each device to be detected is arranged in the monitoring system and is used for collecting target sound signals of the machine device to realize the monitoring operation.
In the embodiment, one or more than one acoustic acquisition node is arranged for each device to be monitored, so that the comprehensive monitoring effect on the machine equipment can be realized, and the monitoring effectiveness is ensured.
S1022: and collecting all the sound signals inside and outside the hearing threshold of the human ear through the acoustic collection node.
In this embodiment, because each piece of machine equipment may have operations of different components during the operation process, and target sound signals generated by the operations of different components may have differences, in order to ensure that operation target sound signals of different components of the same piece of machine equipment at the same time are prevented from interfering with each other, different acoustic collection nodes may be set corresponding to different components, for example, one acoustic collection node is set within a distance range set by one component, or a plurality of acoustic collection nodes are set in a plurality of orientations of one component; meanwhile, for example, a set number of acoustic collection nodes can be arranged to collect target sound signals within the human ear hearing threshold range, and the same number of acoustic collection nodes can be set to collect target sound signals outside the human ear hearing threshold range; for the plurality of acoustic collection nodes arranged as described above, the target sound signals that can be collected by the plurality of acoustic collection nodes include all the target sound signals within a certain range of the device to be detected (the working range of the sensor arranged in the acoustic collection node) and the target sound signals within or outside the human ear hearing threshold, and here, it is only indicated that the plurality of acoustic collection nodes can be arranged at different positions, so as to realize more comprehensive collection operation of the target sound signals, because the collected target sound signals include a plurality of orientations, thereby improving the monitoring comprehensiveness of the machine device to a certain extent, and improving the monitoring efficiency.
In this embodiment, as shown in fig. 4, the converting the intrinsic signal to the preset time coordinate system according to the predetermined time reference includes:
s1041: all the acoustic collection nodes arranged in the same device to be monitored are subjected to unified time service;
in this embodiment, in order to perform a collection operation on target sound signals at the same time based on a predetermined time reference to restore a timeline in which a specified fault of a machine device occurs, the present embodiment needs to perform unified time service on the entire monitoring system, and specifically, performs unified time service on all acoustic collection nodes arranged in each device to be monitored, so as to ensure that all acoustic signals collected by the acoustic collection nodes at the same time in the device to be monitored can be uniformly analyzed and processed, thereby realizing a restoration operation of the fault timeline.
S1042: judging that the time service is matched with the standard time;
in an actual operation process, in order to ensure accuracy of time service, it is required to determine whether the time service matches a standard time, specifically, by using the GPS precision time calibration or the time of the processor as a reference, a time coordinate system preset by all acoustic signals according to a preset time reference conversion value is realized by network transmission delay, and the function of restoring the fault timeline in step S1041 is realized.
Specifically, if the time service to the acoustic collection node does not match the standard time, step S1043 shown in fig. 3 is executed: adjusting the time service and the standard time to be the same; otherwise, execute step S1044: and establishing a time coordinate system according to the time service, determining a time reference of the time coordinate system, and converting the target sound signals collected by all the acoustic collection nodes into the time coordinate system according to the determined time reference.
In the embodiment, all acoustic collection nodes are subjected to unified time service, so that all intrinsic signals corresponding to the equipment to be monitored can be converted into a preset time coordinate system according to a preset time reference, the analysis of the comprehensive running state of the equipment to be monitored at the same moment is realized, and the method is more favorable for taking the best maintenance measures when the machine equipment breaks down.
In this embodiment, as shown in fig. 5, the analyzing and processing the intrinsic signal by using the preset acoustic processing algorithm includes:
s1061: acquiring acoustic characteristics corresponding to the intrinsic signals by adopting a preset acoustic processing algorithm;
in the embodiment, in order to monitor the actual operation state of the device to be monitored according to the target sound signal in the operation process of the device to be monitored, that is, to judge whether the device to be monitored has a fault or not, and to judge the type of the fault that correspondingly exists, so that the fault can be maintained more quickly, and adverse effects such as loss caused by the fault are reduced, the embodiment processes the obtained different intrinsic signals through a preset acoustic processing algorithm to obtain corresponding acoustic characteristics.
Specifically, the intrinsic signals are analyzed and processed by a preset acoustic processing algorithm, and separation operations are realized by frequency domain analysis and time domain analysis of the intrinsic signals corresponding to different operating states, specifically, the intrinsic signals in different operating states are decomposed by fourier transform, wavelet analysis, pulse recognition, and the like, so as to obtain corresponding acoustic features.
In a specific embodiment, in order to implement an analysis processing process on an intrinsic signal, that is, to analyze and compare the intrinsic signal of the device to be monitored acquired each time with a preset target sound signal, the embodiment stores the intrinsic signal acquired each time into a preset storage unit, for example, a memory unit of a monitoring system; thus, on one hand, the analysis and comparison operation of the intrinsic signals can be realized; on the other hand, if the acquired intrinsic signal cannot be found in the database of the monitoring system, the newly acquired intrinsic signal and the corresponding fault state data of the machine equipment can be added to the original database, so that the quick monitoring operation can be realized next time if the machine equipment has a corresponding fault condition.
In the actual operation process of the machine equipment, the sound signals emitted by the machine equipment in different operation states are different, namely the intrinsic signals are different, the acoustic characteristics corresponding to the different intrinsic signals of the machine equipment are obtained through the embodiment, whether the machine equipment has faults or not can be judged according to the acoustic characteristics, and meanwhile, the specific fault type corresponding to the acoustic characteristics is judged. And realizing the monitoring operation of the equipment to be monitored.
S1062: and determining whether the equipment to be monitored has faults and the types of the faults according to the acoustic characteristics.
Specifically, based on different operating states of the machine device, the intrinsic signals generated during the operation of the machine device are different, and different intrinsic signals correspond to different acoustic features, and after different acoustic features corresponding to different intrinsic signals are obtained in step S1062, in order to determine whether the device to be monitored has a fault and what type of fault exists, the embodiment matches the different acoustic features obtained corresponding to different intrinsic signals with the standard features prestored in the database.
In order to realize the judgment of whether the fault exists or not and the fault type, the standard features pre-stored in the database of the embodiment comprise standard fault features and standard operation features; comparing different acoustic characteristics corresponding to different intrinsic signals with standard operation characteristics, namely judging whether the acoustic characteristics are matched with the standard operation characteristics, and if so, judging that the equipment to be monitored normally operates; otherwise, the device to be monitored can be judged to have a fault, and at the moment, the acoustic features are further compared with the standard fault features, namely, the acoustic features are judged to be matched with which standard fault features, so that the type of the fault is judged. For example, when a factory production system is started or closed daily, a corresponding support system, such as an air conditioner fan, should also be started or stopped according to a program, and the central server can easily identify the running state of the corresponding sound node according to the acoustic characteristics collected by the corresponding sound node, so as to judge whether an operation program is executed according to the regulation; the running state of the equipment can be more intuitively reflected by monitoring the target sound signal in the running process of the machine equipment, and compared with indexes such as current and voltage, the monitoring efficiency of acoustic monitoring under the specific condition of running of a motor is better; and the target sound signal with obvious acoustic signal characteristics generated by faults such as transmission slipping, motor overload or lubrication failure and the like can monitor the fault condition of the equipment to be monitored more accurately and effectively.
Therefore, whether a fault condition exists can be judged according to the characteristic identification result, and a corresponding monitoring result is output, so that whether the user machine equipment has the fault or not is reminded, and effective maintenance measures are taken in time under the condition that the fault exists.
In this embodiment, the target sound signal collection of the acoustic collection nodes can be specifically realized by the precision sensor, the analysis and processing of the target sound signal can be specifically realized by a processor such as a central server, and the transmission of the target sound signal collected by each acoustic collection node to the processor can be realized by a transmission network such as a wireless network and a wired network; in other preferred embodiments, each acoustic collection node in the corresponding transmission network may also be provided with a corresponding control processor and a corresponding network interface, and specifically, target sound signals collected by the acoustic collection nodes are directly analyzed by setting target sound signal processing software and the like in the control processor, and the analysis processing of the target sound signals are implemented in the same manner as the analysis and the processing of the processor, so that the processing speed of the target sound signals can be increased (the target sound signals do not need to be transmitted to the processor through the transmission network), and the monitoring efficiency is improved.
In addition, based on the same concept, as shown in fig. 6, the embodiment of the present invention provides a monitoring device based on an acoustic network.
Specifically, the monitoring device based on the acoustic network includes:
the system comprises a sound acquisition module 100, a monitoring module and a monitoring module, wherein the sound acquisition module is used for acquiring a target sound signal in the running process of equipment to be monitored, and the target sound signal comprises an intrinsic signal and a noise signal;
a coordinate conversion module 110, configured to convert the intrinsic signal to a preset time coordinate system based on a predetermined time reference;
the sound analysis module 120 analyzes and processes the intrinsic signal by a preset acoustic processing algorithm, generates and outputs a monitoring result corresponding to the intrinsic signal;
a result response module 130, configured to respond according to the monitoring result of the sound analysis module 120, so as to implement a prompt for the user; the specific response can be generated by generating sound to generate an alarm, or sending a short message notification, or directly triggering a control signal and the like; direct triggering of control signals such as power shut-off to malfunctioning machine equipment; and if the machine equipment fails and generates warning, carrying out timely fault treatment by a responsible person in the acoustic acquisition node area. In addition, if the same fault type as before is detected again after a certain preset time after warning, the fault may be a fault before a person in charge of the acoustic collection node area is not processed, and the same fault may also be continuously generated; at this time, in order to more effectively implement the processing of the fault, the present embodiment notifies the manager at the upper level in a form of a short message, and the manager at the upper level performs more effective processing management and command on the fault, and thus, the process is performed until the manager receives the short message notification of the corresponding fault, so as to ensure the safe production of the machine equipment and the working environment.
In addition, the monitoring device based on the acoustic network of this embodiment is further provided with a display device, and is configured to display a waveform diagram (obtained through frequency domain analysis or time domain analysis) corresponding to the target sound signal acquired by the sound acquisition module 100 for visual management, so that a user can intuitively know the state change condition of the operation process of the machine equipment according to the sound signal, and the monitoring effect is improved.
Corresponding to the monitoring method based on the acoustic network, the monitoring device based on the acoustic network of the embodiment first obtains target sound signals under different scenes through the sound collection module 100, and the target sound signals can be obtained through collection by, for example, a high-precision sensor; then, the target sound signal is transmitted to the coordinate conversion module 110, specifically, the target sound signal is converted into a preset time coordinate system, because in an actual operation, a certain time difference may exist in the obtained target sound signal data, for this embodiment, the target sound signal is converted into a preset unified time coordinate system by setting a time reference; finally, the target sound signal is transmitted to the sound analysis module 120 through the transmission network for analysis processing, so as to obtain monitoring results corresponding to different target sound signals, the sound analysis module 120 outputs the monitoring results to the result response module 130, the result response module 130 performs different response operations according to different monitoring results, as described above, a sound is generated to generate a warning, or a short message notification is sent, or a control signal is directly triggered, for example, a power supply of a faulty machine device is cut off, so that a good monitoring effect is achieved, the monitoring efficiency and accuracy are improved, and the production efficiency is improved.
It should be noted that, in this embodiment, the implementation of the monitoring apparatus based on the acoustic network is consistent with the implementation idea of the monitoring method based on the acoustic network, and specific implementation principles thereof are not described herein again, and reference may be made to corresponding contents in the above method.
After the monitoring method and the device based on the acoustic network are adopted, for the monitoring operation of equipment faults, specifically, a monitoring system based on the acoustic network is constructed, a plurality of acoustic acquisition nodes are arranged in the monitoring system, one or more acoustic acquisition nodes are arranged for each equipment to be monitored, different target sound signals are sent out by the equipment to be monitored based on different running states, all the target sound signals (including the inside and outside of the hearing threshold of a human ear) in the running process of the equipment to be monitored are acquired by the acoustic acquisition nodes, all the target sound signals are uniformly converted according to a preset time reference, the processing of all the target sound signals in the running process of the equipment to be monitored in the same time point is realized, and the monitoring effect of the equipment to be monitored is realized according to the possible fault conditions of the equipment corresponding to the preset different target sound signals, and different responses are sent out according to different faults to remind a user to maintain or take corresponding measures in time so as to ensure that the minimum loss or even no loss is generated under the fault condition. The monitoring method of the embodiment of the invention can be suitable for different equipment running conditions, improves the monitoring effect on the equipment running conditions and is beneficial to ensuring the safe running of the equipment.
FIG. 7 is a diagram illustrating an internal structure of a computer device in one embodiment. The computer device may specifically be a server or a terminal. As shown in fig. 7, the computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program which, when executed by the processor, causes the processor to implement the acoustic network based monitoring method. The internal memory may also have stored therein a computer program that, when executed by the processor, causes the processor to perform an acoustic network-based monitoring method. Those skilled in the art will appreciate that the architecture shown in fig. 7 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as a particular computing device may include more or less components than those shown in fig. 7, or may combine certain components, or have a different arrangement of components.
In one embodiment, the acoustic network-based monitoring method provided by the present application may be implemented in the form of a computer program, which may be run on a computer device as shown in fig. 7. The memory of the computer device may store various program modules that make up the acoustic network-based monitoring apparatus. Such as the sound collection module 100, etc.
In one embodiment, a computer device is proposed, comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of: collecting a target sound signal in the running process of equipment to be monitored, wherein the target sound signal comprises an intrinsic signal and a noise signal generated by the running of the equipment to be monitored; converting the intrinsic signal to a preset time coordinate system according to a preset time reference; and analyzing and processing the intrinsic signal by adopting a preset acoustic processing algorithm, generating and outputting a monitoring result corresponding to the intrinsic signal, and reminding a user according to the monitoring result.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.
Claims (10)
1. A monitoring method based on an acoustic network is applied to fault detection of equipment, and the method comprises the following steps:
collecting a target sound signal in the running process of equipment to be monitored, wherein the target sound signal comprises an intrinsic signal and a noise signal;
converting the intrinsic signal to a preset time coordinate system according to a preset time reference;
and analyzing and processing the intrinsic signal by adopting a preset acoustic processing algorithm, generating and outputting a monitoring result corresponding to the intrinsic signal, wherein the monitoring result comprises a judgment result of whether the equipment to be monitored has a fault and/or the type of the fault.
2. The monitoring method based on the acoustic network as claimed in claim 1, wherein the collecting the target sound signal during the operation of the device to be monitored comprises:
setting one or more acoustic collection nodes for collecting the target sound signal for each device to be monitored;
and collecting all the target sound signals inside and outside the hearing threshold of the human ear through the acoustic collection node.
3. The monitoring method based on the acoustic network as claimed in claim 2, wherein the collecting the target sound signal of the device to be monitored in the operation process further comprises:
and preprocessing the target sound signal to remove the noise signal existing in the target sound signal and obtain the intrinsic signal.
4. The acoustic network-based monitoring method of claim 2, wherein the scaling the intrinsic signal to a predetermined time coordinate system with a predetermined time reference comprises:
all the acoustic collection nodes arranged in the same device to be monitored are subjected to unified time service;
and establishing the time coordinate system according to the time service, and determining the time reference of the time coordinate system.
5. The monitoring method based on the acoustic network according to claim 4, wherein the unified time service for all the acoustic collection nodes arranged in the same device to be monitored includes:
automatically matching the time service with standard time, and judging whether the time service is matched with the standard time;
and if the time service is not matched with the standard time, adjusting the time service to be the same as the standard time.
6. The monitoring method based on the acoustic network as claimed in claim 2, wherein the analyzing and processing the intrinsic signal by using a preset acoustic processing algorithm comprises:
extracting acoustic features of the intrinsic signals by adopting a preset acoustic processing algorithm;
determining whether the equipment to be monitored has a fault according to the acoustic characteristics;
and when the monitoring equipment has faults, determining the type of the faults according to the acoustic characteristics.
7. The acoustic network-based monitoring method according to claim 6, wherein the determining whether the device to be monitored has a fault according to the acoustic characteristics, and when the monitoring device has a fault, further determining the type of the fault according to the acoustic characteristics comprises:
matching the acoustic features with preset standard features, wherein the standard features comprise standard fault features and standard operation features;
and if the acoustic characteristics are not matched with the standard operation characteristics, judging that the equipment to be monitored has a fault, and determining the type of the fault according to the matching result of the acoustic characteristics and the standard fault characteristics.
8. An acoustic network-based monitoring device, comprising:
the system comprises a sound acquisition module, a monitoring module and a monitoring module, wherein the sound acquisition module is used for acquiring a target sound signal in the running process of equipment to be monitored, and the target sound signal comprises an intrinsic signal and a noise signal;
the coordinate conversion module is used for converting the intrinsic signals to a preset time coordinate system according to a preset time reference;
the sound analysis module is used for analyzing and processing the intrinsic signal by a preset acoustic processing algorithm, generating and outputting a monitoring result corresponding to the intrinsic signal;
and the result response module is used for responding according to the monitoring result so as to remind the user.
9. A terminal comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method for acoustic network based monitoring according to any of claims 1-7 when executing the computer program.
10. A computer-readable storage medium comprising computer instructions which, when run on a computer, cause the computer to perform the acoustic network-based monitoring method of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910865618.7A CN110718231A (en) | 2019-09-12 | 2019-09-12 | Monitoring method, device, terminal and storage medium based on acoustic network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910865618.7A CN110718231A (en) | 2019-09-12 | 2019-09-12 | Monitoring method, device, terminal and storage medium based on acoustic network |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110718231A true CN110718231A (en) | 2020-01-21 |
Family
ID=69210463
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910865618.7A Pending CN110718231A (en) | 2019-09-12 | 2019-09-12 | Monitoring method, device, terminal and storage medium based on acoustic network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110718231A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112164207A (en) * | 2020-09-29 | 2021-01-01 | 封开低频时码授时台 | Time service signal warning system and method for low-frequency time code monitoring system |
| CN112164390A (en) * | 2020-09-16 | 2021-01-01 | 珠海格力电器股份有限公司 | Equipment fault identification method and system |
| CN113532631A (en) * | 2021-07-07 | 2021-10-22 | 璀璨智声(苏州)智能系统有限公司 | Intelligent manufactured product identification and detection method based on machine hearing |
| CN112164390B (en) * | 2020-09-16 | 2024-07-05 | 珠海格力电器股份有限公司 | Equipment fault recognition method and system |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005215833A (en) * | 2004-01-28 | 2005-08-11 | Hitachi Ltd | Status monitoring system and status monitoring method |
| US20080152094A1 (en) * | 2006-12-22 | 2008-06-26 | Perlmutter S Michael | Method for Selecting Interactive Voice Response Modes Using Human Voice Detection Analysis |
| US20110055669A1 (en) * | 2009-08-31 | 2011-03-03 | Dehaan Michael Paul | Systems and methods for detecting machine faults in network using acoustic monitoring |
| CN103250107A (en) * | 2010-12-31 | 2013-08-14 | 中国科学院自动化研究所 | Intelligent detecting system and detecting method for detecting fault of device |
| US20140072125A1 (en) * | 2012-09-07 | 2014-03-13 | International Business Machines Corporation | Acoustic diagnosis and correction system |
| KR20140118425A (en) * | 2013-03-29 | 2014-10-08 | 주식회사 케이디파워 | A distributing board comptising sound diagnostic equipment |
| US20160180687A1 (en) * | 2013-08-08 | 2016-06-23 | Schneider Electric USA, Inc. | Circuit protective device fault diagnostic translator |
| CN106596123A (en) * | 2016-11-22 | 2017-04-26 | 东软集团股份有限公司 | Device fault diagnosis method, device fault diagnosis device, and device fault diagnosis system |
| CN107424626A (en) * | 2017-08-04 | 2017-12-01 | 上海振华重工电气有限公司 | A kind of gantry crane trolley track sound monitoring and fault finding system |
| CN108469109A (en) * | 2018-03-01 | 2018-08-31 | 广东美的制冷设备有限公司 | Detection method, device, system, air conditioner and the storage medium of unit exception |
| CN109211548A (en) * | 2018-08-31 | 2019-01-15 | 沃德传动（天津）股份有限公司 | A kind of mechanical failure diagnostic method |
| CN109238713A (en) * | 2018-09-14 | 2019-01-18 | 联智科技（天津）有限责任公司 | A kind of device for railway truck bearing Incipient Fault Diagnosis |
-
2019
- 2019-09-12 CN CN201910865618.7A patent/CN110718231A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005215833A (en) * | 2004-01-28 | 2005-08-11 | Hitachi Ltd | Status monitoring system and status monitoring method |
| US20080152094A1 (en) * | 2006-12-22 | 2008-06-26 | Perlmutter S Michael | Method for Selecting Interactive Voice Response Modes Using Human Voice Detection Analysis |
| US20110055669A1 (en) * | 2009-08-31 | 2011-03-03 | Dehaan Michael Paul | Systems and methods for detecting machine faults in network using acoustic monitoring |
| CN103250107A (en) * | 2010-12-31 | 2013-08-14 | 中国科学院自动化研究所 | Intelligent detecting system and detecting method for detecting fault of device |
| US20140072125A1 (en) * | 2012-09-07 | 2014-03-13 | International Business Machines Corporation | Acoustic diagnosis and correction system |
| KR20140118425A (en) * | 2013-03-29 | 2014-10-08 | 주식회사 케이디파워 | A distributing board comptising sound diagnostic equipment |
| US20160180687A1 (en) * | 2013-08-08 | 2016-06-23 | Schneider Electric USA, Inc. | Circuit protective device fault diagnostic translator |
| CN106596123A (en) * | 2016-11-22 | 2017-04-26 | 东软集团股份有限公司 | Device fault diagnosis method, device fault diagnosis device, and device fault diagnosis system |
| CN107424626A (en) * | 2017-08-04 | 2017-12-01 | 上海振华重工电气有限公司 | A kind of gantry crane trolley track sound monitoring and fault finding system |
| CN108469109A (en) * | 2018-03-01 | 2018-08-31 | 广东美的制冷设备有限公司 | Detection method, device, system, air conditioner and the storage medium of unit exception |
| CN109211548A (en) * | 2018-08-31 | 2019-01-15 | 沃德传动（天津）股份有限公司 | A kind of mechanical failure diagnostic method |
| CN109238713A (en) * | 2018-09-14 | 2019-01-18 | 联智科技（天津）有限责任公司 | A kind of device for railway truck bearing Incipient Fault Diagnosis |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112164390A (en) * | 2020-09-16 | 2021-01-01 | 珠海格力电器股份有限公司 | Equipment fault identification method and system |
| CN112164390B (en) * | 2020-09-16 | 2024-07-05 | 珠海格力电器股份有限公司 | Equipment fault recognition method and system |
| CN112164207A (en) * | 2020-09-29 | 2021-01-01 | 封开低频时码授时台 | Time service signal warning system and method for low-frequency time code monitoring system |
| CN112164207B (en) * | 2020-09-29 | 2022-04-12 | 封开低频时码授时台 | Time service signal warning system and method for low-frequency time code monitoring system |
| CN113532631A (en) * | 2021-07-07 | 2021-10-22 | 璀璨智声(苏州)智能系统有限公司 | Intelligent manufactured product identification and detection method based on machine hearing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20150346066A1 (en) | Asset Condition Monitoring | |
| US10115298B2 (en) | Method of trend analysis and automatic tuning of alarm parameters | |
| CN108731921B (en) | Equipment connecting piece fault monitoring method and system | |
| CN107085153B (en) | Electricity abnormal fire early warning method and system | |
| CN111882833B (en) | Equipment fault early warning method, device, equipment and medium based on outlier parameters | |
| JP2013518543A5 (en) | ||
| CN110718231A (en) | Monitoring method, device, terminal and storage medium based on acoustic network | |
| GB2476246A (en) | Diagnosing an operation mode of a machine | |
| CN112461289A (en) | Ring main unit fault monitoring method, system, terminal and storage medium | |
| CN114155692A (en) | Equipment fault reporting method, device and storage medium | |
| CN111414999A (en) | Method and device for monitoring running state of equipment | |
| CN115018220A (en) | Household appliance fault prediction method and system based on knowledge graph | |
| CN114996090A (en) | Server abnormity detection method and device, electronic equipment and storage medium | |
| CN117267861A (en) | Air conditioner outdoor fan fault prediction system based on Internet of things | |
| CN109488473B (en) | Online prejudgment system and online prejudgment method of engine | |
| CN111983309A (en) | Method and device for detecting abnormality of sampling data | |
| CN116879788A (en) | Energy storage electric cabinet safety detection method, device, equipment and storage medium | |
| CN110990223A (en) | Monitoring alarm method and device based on system log | |
| CN114912495A (en) | Transformer fault monitoring method, device and storage medium | |
| CN112802313A (en) | Alarm method and device of equipment | |
| CN114279492A (en) | Method and device for determining cable fault information based on different fault parameter records | |
| CN112579665A (en) | Energy equipment control method and device and energy equipment | |
| CN112542029A (en) | Fan noise detection monitoring method and system, computer equipment and storage medium | |
| CN115202300B (en) | Method and control device for determining a shutdown failure of an air separation unit compressor | |
| CN118112359B (en) | Switch cabinet fault diagnosis method and system based on Internet of things |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220118 Address after: 518000 Room 201, building 2, building B7, Dongfang Jianfu Yijing industrial city, Tianliao community, Yutang street, Guangming District, Shenzhen, Guangdong Province Applicant after: Shenzhen Xiaoming industrial Internet Co.,Ltd. Address before: 518000 2nd and 3rd floors, building B7, Dongfang Jianfu Yijing industrial city, Tianliao community, Yutang street, Guangming District, Shenzhen, Guangdong Applicant before: Shenzhen Ming Hua Hang Electric Technology Technology Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200121 |