JP6840971B2 - Diagnostic equipment, diagnostic systems and programs - Google Patents

Description

The present invention relates to diagnostic devices, diagnostic systems and programs.

Patent Document 1 has a RAM or ROM for storing the normal operating sound of the image forming apparatus, and a microphone for detecting the operating sound generated from the image forming apparatus, which is stored in the RAM or ROM. A system for identifying an abnormal portion of an image forming apparatus based on the first sound information, the second sound information detected by the microphone, and the operation information of the image forming apparatus is disclosed.

Patent Document 2 describes a sound conversion unit that converts sound inside the device into an electric signal in an image processing device having an image forming unit that forms an image on the printing paper and a conveying unit that conveys the printing paper. An image processing device including a sound analysis unit that analyzes an electric signal converted by a sound conversion unit to obtain a component for each frequency and an output unit that outputs a component for each frequency obtained by the sound analysis unit is disclosed. There is.

JP-A-2007-079263 Japanese Unexamined Patent Publication No. 2008-290288

When an abnormal sound (abnormal sound) occurs in a certain device, the sound generated in the device to be analyzed is input to acquire a sound signal, and the acquired sound signal and the device equivalent to the device to be analyzed have generated in the past. In some cases, it is attempted to clarify the cause of the abnormal sound by comparing it with the sound signal of the abnormal sound.

However, it is not easy for an inexperienced user to determine whether or not the acquired sound signal contains an abnormal sound.

An object of the present invention is to provide a diagnostic device, a diagnostic system and a program capable of determining whether or not an acquired sound signal contains an abnormal sound.

[Diagnostic device]
The present invention according to claim 1 comprises an acquisition means for inputting generated sound and acquiring sound information.
An analysis means that performs frequency analysis of the sound information and generates a frequency analysis result waveform that represents a time change of the intensity distribution for each frequency.
In the frequency analysis result waveform generated by the analysis means, when the total area of the frequency components generated periodically is equal to or more than a preset value, it is determined that the acquired sound information includes abnormal sound. Judgment means and
It is a diagnostic apparatus provided with a display means for displaying the determination result when it is determined that the sound information acquired by the determination means contains an abnormal sound.

The present invention according to claim 2 includes a storage means for storing sound information acquired by the acquisition means and a storage means for storing the sound information.
Abnormal sound is a diagnostic apparatus according to claim 1, wherein the sound information determined in the determination means to be further provided with a control means for controlling so as to be stored in the storage means included.

The present invention according to claim 3 is a communication means for communicating with an external device and a communication means.
A transmission means for transmitting information obtained from the frequency analysis result waveform obtained by the analysis means to an external device via the communication means, and a transmission means.
Further provided with a receiving means for receiving the frequency analysis result waveform corresponding to the frequency analysis result waveform from the external device via the communication means.
The diagnosis according to claim 1 or 2 , wherein the transmitting means transmits information obtained from a frequency analysis result waveform of sound information determined by the determining means to include abnormal sounds to an external device via the communication means. It is a device.

[Diagnostic system]
According to the fourth aspect of the present invention, the acquisition means for inputting the generated sound to acquire the sound information and the frequency analysis of the sound information are performed to generate a frequency analysis result waveform representing a time change of the intensity distribution for each frequency. When the total area of the frequency components generated periodically in the analysis means and the frequency analysis result waveform generated by the analysis means is equal to or larger than a preset value, an abnormal sound is generated in the acquired sound information. When it is determined that the sound information acquired by the determination means includes an abnormal sound, communication is performed between the determination means for determining that the determination means is included, the display means for displaying the determination result, and the external device. The communication means, the first transmission means for transmitting the information obtained from the frequency analysis result waveform obtained by the analysis means to the external device via the communication means, and the frequency analysis result corresponding to the frequency analysis result waveform. A diagnostic device including a receiving means for receiving a waveform from an external device via the communication means, and a diagnostic device.
When the storage means for storing a plurality of frequency analysis result waveforms obtained by performing frequency analysis of the sound information of abnormal sounds and the information obtained from the frequency analysis result waveforms of the sound information acquired from the diagnostic device are received. A second transmission means for selecting a frequency analysis result waveform similar to the received frequency analysis result waveform from the plurality of frequency analysis result waveforms stored in the storage means and transmitting the frequency analysis result waveform to the diagnostic apparatus is provided. It is a diagnostic system equipped with a server device.

[program]
The present invention according to claim 5 includes an acquisition step of inputting generated sound and acquiring sound information.
A generation step of performing frequency analysis of the sound information and generating a frequency analysis result waveform showing a time change of the intensity distribution for each frequency.
In the frequency analysis result waveform generated in the generation step, when the total area of the frequency components generated periodically is equal to or more than a preset value, it is determined that the acquired sound information includes abnormal sound. Judgment step and
This is a program for causing a computer to execute a display step for displaying the determination result when it is determined that the sound information acquired in the determination step contains an abnormal sound.

According to the first aspect of the present invention, it is possible to provide a diagnostic device capable of determining whether or not the acquired sound information includes abnormal sounds.

According to the second aspect of the present invention, it is possible to provide a diagnostic device capable of storing only sound information including abnormal sounds.

According to the third aspect of the present invention, only the information obtained from the sound information including the abnormal sound is transmitted to the external device, and the frequency analysis result waveform stored in the external device and the frequency analysis of the acquired sound information are performed. It is possible to provide a diagnostic device capable of comparing with the result waveform.

According to the fourth aspect of the present invention, it is possible to provide a diagnostic system capable of determining whether or not the acquired sound information includes abnormal sounds.

According to the fifth aspect of the present invention, it is possible to provide a program capable of determining whether or not the acquired sound information includes abnormal sounds.

It is a system diagram which shows the structure of the abnormal noise diagnosis system of one Embodiment of this invention. It is a block diagram which shows the hardware structure of the abnormal noise diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the functional structure of the abnormal noise diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the functional structure of the server apparatus 50 in one Embodiment of this invention. It is a figure which shows an example of the information stored in the waveform data storage part 53 in FIG. It is a sequence chart for demonstrating the operation of the abnormal noise diagnosis system of one Embodiment of this invention. It is a figure which shows the display screen example of the abnormal noise diagnostic apparatus 10 when inputting various information such as a model name, a serial number, and an operating state. It is a figure for demonstrating the concept of STFT. It is a figure which shows the image example of the frequency spectrum waveform based on the analysis result obtained by the FTFT. It is a figure which shows the display screen example in the case where the obtained frequency spectrum waveform contains the abnormal sound of a periodic sound. It is a figure which shows an example of the selection area 80 selected by the user in the image example of the frequency spectrum waveform of FIG. It is a figure which shows the display screen example in the case where the obtained frequency spectrum waveform contains the abnormal sound of continuous sound. It is a figure which shows the example of the display screen when the obtained frequency spectrum waveform does not contain an abnormal sound. It is a figure which shows the analysis result example of the fast Fourier transform. It is a figure which shows the screen example of the abnormal sound diagnostic apparatus 10 which displayed two frequency spectrum waveforms. It is a figure which shows the image example in the case where another frequency spectrum waveform different from the cause of abnormal noise is displayed with respect to the screen example shown in FIG.

Next, an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a system diagram showing a configuration of an abnormal noise diagnosis system according to an embodiment of the present invention.

As shown in FIG. 1, the abnormal noise diagnostic system according to the embodiment of the present invention includes a portable abnormal noise diagnostic device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50. ..

The present invention can be applied to any device as long as the abnormal noise diagnostic device 10 can be connected to the server device 50 via a communication network. However, in the present embodiment, the case where the abnormal sound diagnostic device 10 is a device such as a microphone capable of acquiring an audio signal and a tablet terminal device provided with a touch panel capable of touch input will be described.

The abnormal sound diagnostic device 10 is carried by a serviceman (maintenance personnel) who performs maintenance management, repair, etc. of the image forming device 20 such as a printer used by the end user, and the abnormal noise (abnormality) generated in the image forming device 20 is carried. Sound) The signal is acquired and the acquired abnormal noise signal is frequency-analyzed, and the waveform of the frequency analysis result of the past abnormal noise signal acquired from the server device 50 and the frequency analysis result waveform of the acquired abnormal noise signal are displayed. Used to do.

The abnormal noise diagnosis device 10 and the server device 50 are connected to each other via a wireless LAN terminal 30 such as a Wi-Fi router or an Internet communication network 40 to transmit and receive information.

When the abnormal noise diagnostic device 10 is a mobile phone device, a smartphone, or the like, the abnormal noise diagnostic device 10 and the server device 50 are connected via the mobile phone network to transmit and receive defect information. It is also possible.

In the abnormal noise diagnosis system of the present embodiment, when an abnormal noise is generated in the image forming apparatus 20 which is a target electronic device installed at the end user's place, a serviceman carries the abnormal noise diagnostic apparatus 10 with the image forming apparatus. Go to 20 places. Then, the serviceman acquires the abnormal noise signal by recording the abnormal noise generated by using the abnormal noise diagnosis device 10, and performs the abnormal noise diagnosis to identify the cause of the abnormal noise.

Although it is technically possible to provide the image forming apparatus 20 with a microphone or the like to have a recording function and record the abnormal sound by the recording function when an abnormal sound is generated, the image forming apparatus 20 may provide a recording function. When installed in an end user's office or the like, it is not possible to provide the image forming apparatus 20 with a function of recording sound for security reasons.

Next, FIG. 2 shows the hardware configuration of the abnormal noise diagnosis device 10 in the abnormal noise diagnosis system of the present embodiment.

As shown in FIG. 2, the abnormal noise diagnostic device 10 performs wireless communication with the CPU 11, the memory 12 capable of temporarily storing data, the storage device 13 such as a flash memory, and the wireless LAN terminal 30 to perform data. It has a wireless LAN interface (IF) 14 for transmitting and receiving data, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. These components are connected to each other via a control bus 18.

The abnormal noise diagnostic device 10 of the present embodiment is provided with a touch panel provided as an input device 15 with a touch sensor for detecting a touch position on the display device 16, and the display is performed using the touch panel. Input from the user is performed.

The CPU 11 executes a predetermined process based on the control program stored in the memory 12 or the storage device 13 to control the operation of the abnormal noise diagnosis device 10. This control program can also be obtained by downloading via the Internet communication network 40 or the mobile phone line network and provided to the CPU 11, and the program is stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.

The abnormal noise diagnostic device 10 of the present embodiment performs the operations as described below when the above control program is executed, and assists the serviceman in the work of identifying the cause of the abnormal noise.

FIG. 3 is a block diagram showing a functional configuration of the abnormal noise diagnostic device 10 realized by executing the above control program.

As shown in FIG. 3, the abnormal noise diagnosis device 10 of the present embodiment includes a voice acquisition unit 31, a frequency analysis unit 32, a control unit 33, a voice data storage unit 34, a display unit 35, and a communication unit. 36 and a sound reproduction unit 37 are provided.

The display unit 35 displays various data based on the control by the control unit 33. The communication unit 36 communicates with the server device 50, which is an external device. The voice reproduction unit 37 reproduces the recorded voice data or the like and converts it into a voice signal based on the control by the control unit 33.

The voice acquisition unit 31 acquires a voice signal by inputting the voice of the abnormal sound generated in the image forming device 20 which is the device to be analyzed.

In the present embodiment, the voice acquisition unit 31 is described as inputting the voice of the abnormal sound generated in the image forming apparatus 20 to acquire the voice signal. However, the voice is an example of the sound, and the voice is used. The signal is an example of sound information.

The frequency analysis unit 32 performs time-frequency analysis (time-dependent frequency analysis) of the voice signal acquired by the voice acquisition unit 31, and represents the time change of the signal intensity distribution for each frequency of the acquired abnormal sound signal. Generate spectral waveform data. The frequency spectrum waveform data is a frequency analysis result obtained by performing frequency analysis.

Specifically, the frequency analysis unit 32 generates frequency spectrum waveform data by performing an STFT (Short time Fourier transform) on the voice signal acquired by the voice acquisition unit 31. The description of this FTFT will be described later.

The control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the voice data storage unit 34 together with the voice data.

Further, the control unit 33 performs a fast Fourier transform (1D-FFT) that performs frequency analysis in the time axis direction on a frequency component estimated to be an abnormal sound in the frequency spectrum waveform data obtained by the frequency analysis unit 32. (Fast Fourier Transform)) is instructed to the frequency analysis unit 32.

Here, the control unit 33 may extract a signal component having periodicity from the frequency spectrum waveform data and select the signal component as a signal component having a high possibility of being an abnormal sound. .. Further, the control unit 33 displays the obtained frequency spectrum waveform data on the display unit 35, and specifies a frequency component that is likely to be an abnormal sound by the user who sees the frequency spectrum waveform, thereby that frequency. The component may be selected as a signal component that is likely to be an abnormal sound.

Then, the frequency analysis unit 32 performs a fast Fourier transform in the time axis direction on the frequency component presumed to be an abnormal sound based on the instruction by the control unit 33.

Then, the control unit 33 acquires information on the period and frequency of the abnormal sound based on the analysis result of the fast Fourier transform in the frequency analysis unit 32.

Further, the control unit 33 uses the acquired information on the period and frequency of the abnormal noise together with the model information such as the model name and serial number of the image forming apparatus 20 and the operating state information indicating the operating state of the image forming apparatus 20 together with the communication unit 36. Is transmitted to the server device 50 via. Specifically, this operation status information includes information such as whether it is color printing or black-and-white printing, double-sided printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included. In this way, the control unit 33 transmits the information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server device 50 via the communication unit 36.

In the server device 50, the original audio data and the audio data were acquired from the spectral waveform data obtained by performing frequency analysis of the audio signal of the abnormal sound generated in the past in an apparatus equivalent to the apparatus of the image forming apparatus 20. It stores information such as the operating status of the device, the cause of abnormal noise, and how to deal with abnormal noise.

Then, the server device 50 obtains frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of frequency analysis by the frequency analysis unit 32 from the information on the period and frequency of the abnormal sound transmitted from the abnormal sound diagnostic device 10. The frequency spectrum waveform data found by searching is transmitted to the abnormal sound diagnostic device 10 together with information such as voice data stored as sample waveform data of abnormal sound.

As a result, the control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.

The control unit 33 displays the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the spectrum waveform received from the server device 50 in parallel on the display unit 35.

Then, the control unit 33 in the present embodiment determines whether or not the acquired sound signal contains abnormal sound based on the frequency analysis result waveform generated by the frequency analysis unit 32. Then, when the control unit 33 determines that the sound signal acquired by the voice acquisition unit 31 contains an abnormal sound, the control unit 33 displays the determination result on the display unit 35.

Specifically, in the frequency analysis result waveform generated by the frequency analysis unit 32, the control unit 33 differs from the acquired sound information when the component of the preset frequency or higher is equal to or higher than the preset intensity. It is determined that the sound is included.

Further, when the area of the frequency component periodically generated in the frequency analysis result waveform generated by the frequency analysis unit 32 is equal to or larger than a preset value, the control unit 33 is acquired by the voice acquisition unit 31. It is determined that the sound signal contains abnormal noise.

Further, the control unit 33 may control to store only the sound signal determined to contain abnormal noise in the voice data storage unit 34 when the sound signal acquired in the voice data storage unit 34 is stored. ..

Further, when the control unit 33 transmits the frequency and period information of the abnormal sound obtained from the acquired sound signal to the server device 50 via the communication unit 36, it is determined that the abnormal sound is included. Only the information obtained from the frequency analysis result waveform of the sound signal may be transmitted to the server device 50 via the communication unit 36.

Further, when there are a plurality of frequency spectrum waveform data transmitted from the server device 50, the control unit 33 may use the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 among the plurality of frequency spectrum waveform data. The ones having a high degree of similarity are displayed on the display unit 33 with priority.

Further, the control unit 33 has a waveform of either one of the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50. When one of the waveforms is enlarged or reduced, the other waveform is enlarged or reduced so as to have the same size.

Next, the functional configuration of the server device 50 in the abnormal noise analysis system of the present embodiment will be described with reference to the block diagram of FIG.

As shown in FIG. 4, the server device 50 of the present embodiment includes a communication unit 51, a control unit 52, and a waveform data storage unit 53.

The waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of an audio signal of an abnormal sound generated in the past in a device equivalent to the image forming device 20 which is a device to be analyzed.

Specifically, as shown in FIG. 5, the waveform data storage unit 53 includes frequency spectrum waveform data obtained by time-frequency analysis of previously acquired abnormal sound audio data, and original audio. Information such as data, the cause of abnormal noise, and how to deal with it is stored for each model.

Then, when the control unit 52 receives the information on the period and frequency of the abnormal sound from the abnormal sound diagnostic device 10, the received difference is obtained from the waveform data of the plurality of frequency spectra stored in the waveform data storage unit 53. Based on the sound cycle and frequency information, a waveform data similar to the frequency spectrum based on the abnormal sound acquired by the abnormal sound diagnostic device 10 is selected and transmitted to the abnormal sound diagnostic device 10 via the communication unit 51. To do.

In the present embodiment, it is described that the abnormal sound diagnostic device 10 performs the STFT and the fast Fourier transform of the abnormal sound voice data and transmits the information on the period and frequency of the abnormal sound to the server device 50. , Fast Fourier Transform or STFT, and both Fast Fourier Transform may be executed on the server device 50 side.

In this case, the abnormal sound diagnostic device 10 transmits the voice data as it is to the server device 50, or the frequency spectrum waveform data as a result of performing the FTFT on the voice data is transmitted, and the voice data is transmitted in the server device 50. SFTF and Fast Fourier Transform will be performed on the data.

Next, the operation of the abnormal noise diagnosis system of the present embodiment will be described with reference to the sequence chart of FIG.

When the abnormal noise diagnosis device 10 attempts to perform abnormal noise diagnosis to identify the cause of abnormal noise, an image as shown in FIG. 7 is displayed and various information such as a model name, serial number, and operating state is input. (Step S101).

Then, in the abnormal noise diagnosis device 10, the operation mode is set to the voice recording mode, the microphone 17 is brought close to the abnormal noise generation portion of the image forming device 20, and the abnormal sound is recorded to acquire the voice data (step S102).

Then, in the abnormal sound diagnostic apparatus 10, the acquired voice data is settled by the frequency analysis unit 32 to generate a frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency (step S103).

As shown in FIG. 8, this FTFT is obtained by performing a Fourier transform every short time and calculating the signal intensity for each frequency component according to the time change. FIG. 9 shows an example of a waveform when the analysis result obtained by this FTFT is used as an image of one frequency spectrum waveform.

In the frequency spectrum waveform example shown in FIG. 9, the horizontal axis represents time and the vertical axis represents frequency, and the intensity of each frequency is represented by color. In FIG. 9, this difference in color is represented by a hatching pattern. Further, although FIG. 9 illustrates a case where the intensity for each frequency is expressed by color, it is also possible to express this intensity by gradation.

In the frequency spectrum waveform example of FIG. 9, it can be seen that the frequency component 61 of the abnormal sound is periodically generated at a specific frequency. In the frequency spectrum waveform example shown in FIG. 9, the low frequency component is a normal operating sound and is not a frequency component of an abnormal sound.

When the frequency spectrum waveform as shown in FIG. 9 is obtained, the control unit 33 determines whether or not the obtained frequency spectrum waveform contains an abnormal frequency component (step S104).

Specifically, the control unit 33 detects the frequency component 61 of the abnormal sound that is periodically generated in the frequency spectrum waveform shown in FIG. 9, and the total area of the frequency component 61 of the abnormal sound is set in advance. If it is equal to or more than the set value, it is determined that the frequency spectrum waveform contains an abnormal frequency component.

Then, when the determination of the presence or absence of abnormal noise is completed, the control unit 33 displays the determination result of the presence or absence of abnormal noise on the display unit 35 together with the obtained frequency spectrum waveform.

For example, FIG. 10 shows an example of a display screen when the obtained frequency spectrum waveform contains an abnormal frequency component. In the display screen example shown in FIG. 10, the frequency spectrum waveform is displayed together with the determination result that "this sound signal seems to contain an abnormal sound."

Then, as shown in FIG. 10, since it was determined that the displayed frequency spectrum waveform contained an abnormal noise component, the control unit 33 "designate a region that seems to be an abnormal noise." Is displayed on the screen to encourage the user to specify the frequency component of abnormal noise.

Then, as shown in FIG. 11, the user presented with the frequency spectrum waveform identifies the frequency component 61 of the abnormal sound, and for example, by operating the touch panel, the region including the frequency component 61 of the abnormal sound is determined. select.

In the example shown in FIG. 11, by tracing the place where the frequency component 61 of the abnormal sound is displayed by the user with the finger 70, a rectangular area including a plurality of frequency components 61 of the abnormal sound is designated as the selection area 80. You can see that it is done. In the display screen example shown in FIG. 11, the search execution button 91 for transmitting the frequency and period information of the frequency component of the selection area 80 to the server device 50 and executing the search for a similar frequency spectrum waveform is provided. , A cancel button 92 for ending the process without transmitting the frequency and period of the abnormal sound to the server device 50 is displayed.

FIG. 12 shows an example of a display screen when the obtained frequency spectrum waveform contains a frequency component of an abnormal sound which is a continuous sound. Also in FIG. 12, the control unit 33 displays the characters "This sound signal seems to contain an abnormal sound" on the screen, so that the sound signal acquired by the user has an abnormal sound. It can be seen that it shows the judgment result that is included.

When the abnormal sound is a continuous sound, the control unit 33 performs a time-frequency analysis of the sound signal as shown in FIG. 12, and the time change of the signal intensity distribution for each frequency of the sound signal. In a general frequency analysis result showing a signal intensity distribution for each frequency instead of a frequency spectrum waveform representing, depending on whether or not a frequency component having a preset frequency or higher is equal to or higher than a preset signal intensity level. It is possible to determine whether or not an abnormal sound is included.

Further, FIG. 13 shows an example of a display screen when an abnormal noise is not included. In FIG. 13, since it is determined that no abnormal noise is included in the determination result of the presence or absence of abnormal noise, the characters "This sound signal does not seem to contain abnormal noise" are displayed on the screen. Is displayed, and a cancel button 92 for ending the process without transmitting the frequency and period of the abnormal noise to the server device 50 is displayed.

Then, as shown in FIG. 11, when the selection area 80 is designated and the search execution button 91 is operated, the fast Fourier transform (1D-FFT) for the frequency component included in the selection area 80 is executed by the frequency analysis unit 32. (Step S105). An example of the analysis result of the fast Fourier transform executed in this way is shown in FIG.

In FIG. 14, the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform. Since the abnormal sound contains harmonic components and the like, a plurality of cycles may be detected, but the cycle having the strongest signal strength is detected as the abnormal sound cycle.

Further, since a signal component having a long period of a predetermined period or longer is considered to be a normal operation sound or an indefinite period noise, such a long period signal component area is set as a judgment exclusion area 62 in the judgment exclusion area 62. The analysis result is ignored.

Further, since the low frequency signal component below the predetermined frequency is also indistinguishable from the normal operating sound, the region of such a low frequency signal component is set as the judgment exclusion region 63, and the analysis result in this judgment exclusion region 63 is It will be ignored.

Based on the analysis result of the fast Fourier transform, the abnormal sound diagnostic device 10 transmits the information on the frequency and period of the abnormal sound to the server device 50 together with the model information and the information on the operating state (step S106). For example, information such that the abnormal sound frequency is 4 kHz and the abnormal sound period is 2.0 seconds is transmitted to the server device 50.

Then, the server device 50 extracts the frequency spectrum waveform data corresponding to the received information by searching the waveform data storage unit 53 based on the received information (step S107).

Then, the server device 50 transmits the extracted frequency spectrum waveform data to the abnormal noise diagnostic device 10 together with information such as the original voice data, the cause of the abnormal noise, and the coping method thereof (step S108).

Then, the abnormal noise diagnostic device 10 receives the frequency spectrum waveform data transmitted from the server device 50 (step S109). Then, the control unit 33 of the abnormal noise diagnosis device 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by the FTFT on the display unit 35 (step S110).

FIG. 15 shows a screen example of the abnormal sound diagnostic apparatus 10 in which the two frequency spectrum waveforms are displayed in this way.

In the screen example shown in FIG. 15, the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as the "analysis result waveform of the abnormal sound recorded this time", and the frequency spectrum waveform transmitted from the server device 50. However, it can be seen that it is displayed as "past abnormal noise data" together with the abnormal noise cause of "wearing of the photoconductor drum".

A serviceman who intends to perform abnormal noise diagnosis identifies the cause of abnormal noise by comparing these two frequency spectrum waveforms and determining whether or not the abnormal noise components in the waveforms are similar.

When a plurality of frequency spectrum waveforms are transmitted from the server device 50, for example, by tracing the image of the frequency spectrum waveform displayed as "past abnormal sound data" in the horizontal direction by a touch operation. Another frequency spectrum waveform is displayed as shown in FIG.

FIG. 16 shows an example of an image when the frequency spectrum waveform of the abnormal noise is displayed when the cause of the abnormal noise is “defective drive system motor”.

When a plurality of frequency spectrum waveforms are transmitted in this way, the serviceman determines which frequency spectrum waveform the frequency spectrum waveform of the abnormal sound acquired this time is more similar to the abnormal sound. Identify the cause of. When identifying the cause of this abnormal noise, not only the shape of the frequency spectrum waveform and the period and frequency of the abnormal noise component are compared, but also the original audio data is reproduced by the audio reproduction unit 37 this time. The cause of the abnormal noise is identified by listening to and comparing the acquired abnormal noise with the voice corresponding to the frequency spectrum waveform transmitted from the server device 50.

In the above embodiment, the frequency analysis unit 32 is described as generating frequency spectrum waveform data by performing an STFT (Short time Fourier transform) on the voice signal acquired by the voice acquisition unit 31. did. However, the frequency analysis process in the frequency analysis unit 32 is not limited to the STFT, and the same applies even if other frequency conversion processes such as Wavelet Transform (WT), STFT + FFT (Fast Fourier Transform), and WT + FFT are used. It is feasible.

Further, when the sound of the image forming apparatus 20 is collected by using the microphone 17 of the abnormal sound diagnostic apparatus 10, the image forming apparatus 20 to be diagnosed prints and scans in order to reduce the amount of data of the acquired sound signal. Recording may be performed only during the operation such as. For example, the abnormal noise diagnostic device 10 may be wirelessly connected to the image forming device 20 and recording may be started when an operating signal from the image forming device 20 is received.

Further, the acquired sound signal can be reproduced in order to confirm whether or not the sound signal recorded by the abnormal sound diagnostic device 10 includes human voice information. If the recorded sound signal contains a human voice, it cannot be denied that a false diagnosis may occur and information leakage may occur. However, since the human voice is small when comparing the operating sounds of the devices, it may be difficult to determine whether or not the human voice is included. Therefore, when the recorded sound signal is reproduced and it is confirmed that the human voice is not included, the frequency may be adjusted so that the human voice becomes clear. For example, since the human voice is around 500 to 1,000 Hz, for example, frequency adjustment such as reducing the frequency component of 2,000 Hz or more and emphasizing the frequency component of less than 2,000 Hz should be performed. Just do it.

[Modification example]
In the above embodiment, the case where the abnormal noise diagnostic device 10 is a tablet terminal device has been described, but the present invention is not limited to this, and even when another device is used as the abnormal noise diagnostic device. The present invention can be applied. For example, when the operation panel of the image forming apparatus 20 is detachable from the main body and can communicate with the server apparatus 50 and has a built-in audio signal acquisition function, the operation panel makes an abnormal noise. It may be used as a diagnostic device.

Further, in the above embodiment, the case where the abnormal sound diagnostic device 10 has a built-in microphone 17 is described. However, if the abnormal sound diagnostic device 10 is provided with a voice recording function, a collection of microphones and the like is used. A voice signal acquisition means may be realized by connecting a sound device to the outside.

Further, in the above embodiment, the case where the target device for the abnormal sound analysis is an image forming device is described, but the device to be the target of the abnormal sound analysis is not limited to the image forming device and is not limited to the image forming device. The present invention can be similarly applied to other devices as long as they are devices that may generate abnormal noises.

10 Abnormal noise diagnostic device 11 CPU
12 Memory 13 Storage device 14 Wireless LAN interface (IF)
15 Input device 16 Display device 17 Microphone 18 Control bus 20 Image forming device 30 Wireless LAN terminal 31 Sound acquisition unit 32 Frequency analysis unit 33 Control unit 34 Voice data storage unit 35 Display unit 36 Communication unit 37 Sound playback unit 40 Internet communication network 50 Server device 51 Communication unit 52 Control unit 53 Waveform data storage unit 61 Abnormal noise frequency components 62, 63 Judgment exclusion area 70 Finger 80 Selection area 91 Search execution button 92 Cancel button

Claims (5)

An acquisition method for inputting the generated sound and acquiring sound information,
An analysis means that performs frequency analysis of the sound information and generates a frequency analysis result waveform that represents a time change of the intensity distribution for each frequency.
In the frequency analysis result waveform generated by the analysis means, when the total area of the frequency components generated periodically is equal to or more than a preset value, it is determined that the acquired sound information includes abnormal sound. Judgment means and
When it is determined that the sound information acquired by the determination means contains an abnormal sound, the display means for displaying the determination result and the display means.
Diagnostic device equipped with. A storage means for storing the sound information acquired by the acquisition means, and
Diagnostic apparatus according to claim 1, wherein the abnormal noise sound information determined in the determination means to be further provided with a control means for controlling so as to be stored in the storage means included. Communication means for communicating with external devices and
A transmission means for transmitting information obtained from the frequency analysis result waveform obtained by the analysis means to an external device via the communication means, and a transmission means.
Further provided with a receiving means for receiving the frequency analysis result waveform corresponding to the frequency analysis result waveform from the external device via the communication means.
The diagnosis according to claim 1 or 2 , wherein the transmitting means transmits information obtained from a frequency analysis result waveform of sound information determined by the determining means to include abnormal sounds to an external device via the communication means. apparatus. By the acquisition means for inputting the generated sound and acquiring the sound information, the analysis means for performing frequency analysis of the sound information and generating the frequency analysis result waveform representing the time change of the intensity distribution for each frequency, and the analysis means. In the generated frequency analysis result waveform, when the total area of the frequency components generated periodically is equal to or larger than a preset value, a determination means for determining that the acquired sound information includes abnormal sound, and When it is determined that the sound information acquired by the determination means contains an abnormal sound, it is obtained by the display means for displaying the determination result, the communication means for communicating with the external device, and the analysis means. The first transmission means for transmitting the information obtained from the obtained frequency analysis result waveform to the external device via the communication means, and the frequency analysis result waveform corresponding to the frequency analysis result waveform are externally transmitted via the communication means. A diagnostic device equipped with a receiving means for receiving from the device,
When the storage means for storing a plurality of frequency analysis result waveforms obtained by performing frequency analysis of the sound information of abnormal sound and the information obtained from the frequency analysis result waveforms of the sound information acquired from the diagnostic device are received. A second transmission means for selecting a frequency analysis result waveform similar to the received frequency analysis result waveform from the plurality of frequency analysis result waveforms stored in the storage means and transmitting the frequency analysis result waveform to the diagnostic apparatus is provided. Server device and
Diagnostic system with. The acquisition step of inputting the generated sound and acquiring the sound information,
A generation step of performing frequency analysis of the sound information and generating a frequency analysis result waveform showing a time change of the intensity distribution for each frequency.
In the frequency analysis result waveform generated in the generation step, when the total area of the frequency components generated periodically is equal to or more than a preset value, it is determined that the acquired sound information includes abnormal sound. Judgment step and
A program for causing a computer to execute a display step for displaying the determination result when it is determined that the sound information acquired in the determination step contains an abnormal sound.