WO2017094270A1

WO2017094270A1 - Diagnosis device, diagnosis system, diagnosis method and program

Info

Publication number: WO2017094270A1
Application number: PCT/JP2016/059523
Authority: WO
Inventors: 智之三ツ橋; 勉宇高
Original assignee: 富士ゼロックス株式会社
Priority date: 2015-12-04
Filing date: 2016-03-24
Publication date: 2017-06-08

Abstract

A sound acquisition unit (31) inputs sound of an unusual noise that has occurred in an image formation device (20) as a device to be analyzed, and acquires a sound signal. A frequency analysis unit (32) performs short time Fourier transform (STFT) on the sound signal acquired by the sound acquisition unit (31) to generate frequency spectrum waveform data. A control unit (33) displays the generated frequency spectrum waveform and a spectrum waveform received from a server device (50) in parallel on a display unit (35). On this occasion, the control unit (33) changes the display position in a time axis direction of at least one of the two frequency spectrum waveforms on the basis of a user's operation.

Description

Diagnostic device, diagnostic system, diagnostic method and program

The present invention relates to a diagnostic device, a diagnostic system, a diagnostic method, and a program.

Patent Document 1 includes a RAM (Random Access Memory) or ROM (Read Only Memory) that stores normal operation sound of the image forming apparatus, and a microphone that detects the operation sound generated from the image forming apparatus. A system is disclosed. This system identifies an abnormal portion of the image forming apparatus based on the first sound information stored in the RAM or ROM, the second sound information detected by the microphone, and the operation information of the image forming apparatus. To do.

Patent Document 2 discloses an image processing apparatus having an image forming unit that forms an image on a print sheet and a transport unit that transports the print sheet. The image processing apparatus includes a sound converter that converts sound inside the apparatus into an electric signal, a sound analyzer that analyzes the electric signal converted by the sound converter to obtain a component for each frequency, and the sound analyzer And an output unit that outputs a component for each obtained frequency.

Japanese Unexamined Patent Publication No. 2007-079263 Japanese Unexamined Patent Publication No. 2008-290288

When an abnormal sound (abnormal sound) occurs in a certain device, the sound generated in this device (the device to be analyzed) is input to obtain a sound signal, and the acquired sound signal is equivalent to the device to be analyzed In some cases, an attempt is made to elucidate the cause of the abnormal noise by comparing with an audio signal of the abnormal noise generated in the past.

In such a case, even if the waveforms of the frequency analysis results obtained by performing frequency analysis of the two audio signals are displayed side by side, if the time axis directions of the two waveforms are shifted, the two compared It is difficult to determine whether the audio signals are similar.

In at least one embodiment of the present invention, when two frequency analysis results are compared, the analysis result is compared with the case where two frequency analysis results are displayed in parallel without changing the display content in the time axis direction. To make comparison easier.

[Diagnostic equipment]
[1] In at least one embodiment of the present invention, an acquisition unit that inputs sound generated to acquire sound information;
A display unit for displaying in parallel a first analysis result obtained by performing frequency analysis of the acquired sound information and a second analysis result obtained by performing frequency analysis of sound information of abnormal sound;
It is a diagnostic apparatus provided with the change part which changes the display content of at least one of the displayed said 1st analysis result and said 2nd analysis result in a time-axis direction.

[2] In the diagnostic apparatus according to [1], the changing unit changes display contents in the time axis direction of at least one of the first analysis result and the second analysis result based on a user operation. May be.

[3] In the diagnostic apparatus according to [1], the changing unit may cause the first analysis result and the second analysis result so that periodic waveforms in the first analysis result and the second analysis result coincide with each other. The display content in at least one of the time axis directions may be changed.

[4] The diagnostic apparatus according to any one of [1] to [3], wherein the frequency analysis that performs time-frequency analysis of the sound information acquired by the acquisition unit and generates waveform data of the first analysis result A part may be further provided.

[5] The diagnostic device according to [4] includes a communication unit that performs communication with an external device;
A transmission unit for transmitting information obtained from the first analysis result obtained by the frequency analysis unit to the external device via the communication unit;
And a receiving unit that receives the second analysis result corresponding to the first analysis result from the external device via the communication unit.

[6] In the diagnostic apparatus according to any one of [1] to [5], either one of the first analysis result and the second analysis result is analyzed for a longer time than the other analysis result. You may set so that it may become a result.

[7] In the diagnostic apparatus according to any one of [1] to [6], either one of the first analysis result and the second analysis result displayed on the display unit is enlarged or reduced. In this case, the display unit may display the other analysis result enlarged or reduced so as to have the same size.

[8] In the diagnostic device according to any one of [1] to [7], when there are a plurality of the second analysis results corresponding to the first analysis result, the display unit includes a plurality of the second analysis results. Of the results, one having a high similarity to the first analysis result may be displayed with priority.

[9] In the diagnostic device according to any one of [1] to [8], the device to be analyzed is an image forming device,
The display unit is based on the image forming speed of the image forming apparatus when the first analysis result is acquired and the image forming speed of the image forming apparatus when the second analysis result is acquired. The length of the second analysis result in the time axis direction may be expanded or reduced for display.

[10] The diagnostic apparatus according to any one of [1] to [9] performs stereo reproduction of the sound information acquired from the first analysis result and the sound information acquired from the second analysis result, respectively. You may further provide the audio | voice reproducing part reproduced | regenerated as a left signal and a right signal.

[11] In the diagnostic apparatus according to any one of [1] to [10], the display unit includes an adjustable auxiliary line indicating the same frequency on the first analysis result and the second analysis result, respectively. It may be displayed in an overlapping manner.

[12] In the diagnostic device according to any one of [1] to [10], the display unit adjusts the time axis direction position on the first analysis result and the second analysis result. Possible common auxiliary lines may be superimposed and displayed.

[Diagnostic system]
[13] In at least one embodiment of the present invention, an acquisition unit that inputs sound generated to acquire sound information, a first analysis result obtained by performing frequency analysis of the acquired sound information, A display unit that displays in parallel the second analysis result obtained by performing frequency analysis of the sound information of the abnormal sound, and at least one display content of the displayed first analysis result and the second analysis result, A diagnostic device including a changing unit that changes in a time axis direction;
A storage unit that stores a plurality of second analysis results obtained by performing frequency analysis of sound information of abnormal sounds, and when the information obtained from the first analysis results is received from the diagnostic device, A server device comprising: a second transmission unit that selects an analysis result similar to the received first analysis result from the stored second analysis results and transmits the selected analysis result to the diagnostic device; This is a diagnostic system.

[Diagnosis method]
[14] In at least one embodiment of the present invention, an acquisition step of acquiring sound information by inputting a generated sound;
A display step of displaying in parallel a first analysis result obtained by performing frequency analysis of the acquired sound information and a second analysis result obtained by performing frequency analysis of sound information of abnormal sound;
It is a diagnostic method provided with the change step which changes the display content of at least one of the displayed said 1st analysis result and said 2nd analysis result in a time-axis direction.

[program]
[15] In at least one embodiment of the present invention, an acquisition step of acquiring sound information by inputting a generated sound;
A display step of displaying in parallel a first analysis result obtained by performing frequency analysis of the acquired sound information and a second analysis result obtained by performing frequency analysis of sound information of abnormal sound;
It is a program for causing a computer to execute a changing step of changing the display content of at least one of the displayed first analysis result and the second analysis result in a time axis direction.

According to the diagnostic device described in [1], when two frequency analysis results are compared, the analysis is performed in comparison with the case where two frequency analysis results are displayed in parallel without changing the display content in the time axis direction. Comparison of results can be facilitated.

According to the diagnostic apparatus described in [2], comparison of analysis results can be facilitated as compared with a case where display content in the time axis direction cannot be changed based on a user operation.

According to the diagnostic device described in [3], it is possible to match the periodic waveforms of the two analysis results without requiring user operation.

According to the diagnostic apparatus described in [4], waveform data for comparison display can be acquired from sound information.

According to the diagnostic device described in [5], it is possible to use the second analysis result stored in the external device.

According to the diagnostic device described in [6], the analysis time corresponding to the shorter analysis result time can be compared with the case where the time lengths of the two results are the same.

According to the diagnostic device described in [7], when one result is enlarged or reduced, the trouble of enlarging or reducing the other result at the same magnification can be saved.

According to the diagnostic device described in [8], it is possible to shorten the time until the cause can be identified as compared with the case where a plurality of second analysis results are simply displayed in order.

According to the diagnostic device of [9], when comparing two frequency analysis results, the comparison of the analysis results is compared with the case where the length in the time axis direction is not expanded or reduced based on the image forming speed. Can be made easier.

According to the diagnostic device described in [10], the two pieces of sound information can be easily compared with the case where the two pieces of sound information are reproduced separately.

According to the diagnostic device described in [11], the frequencies in the two analysis results can be compared.

According to the diagnostic device described in [12], the positions in the time axis direction in the two analysis results can be compared.

According to the diagnostic system of [13], when two frequency analysis results are compared, the analysis is performed in comparison with the case where two frequency analysis results are displayed in parallel without changing the display content in the time axis direction. Comparison of results can be facilitated.

According to the diagnostic method described in [14], when two frequency analysis results are compared, the analysis is performed in comparison with the case where two frequency analysis results are displayed in parallel without changing the display content in the time axis direction. Comparison of results can be facilitated.

According to the program described in [15], when two frequency analysis results are compared, the analysis result is compared with the case where two frequency analysis results are displayed in parallel without changing the display content in the time axis direction. Can be easily compared.

It is a system diagram showing a configuration of an abnormal sound diagnosis system of one embodiment of the present invention. It is a block diagram which shows the hardware constitutions of the abnormal sound diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the function structure of the abnormal sound diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the function structure of the server apparatus 50 in one Embodiment of this invention. It is a figure which shows an example of the information stored in the waveform data storage part 53 in FIG. It is a sequence chart for demonstrating operation | movement of the abnormal sound diagnostic system of one Embodiment of this invention. It is a figure which shows the example of a display screen of the abnormal sound diagnostic apparatus 10 at the time of inputting various information, such as a model name, a serial number, and an operation state. It is a figure for demonstrating the concept of STFT. It is a figure which shows the example of an image of the frequency spectrum waveform based on the analysis result obtained by STFT. It is a figure which shows an example of the selection area | region 80 selected by the user in the image example of the frequency spectrum waveform of FIG. It is a figure which shows the example of an analysis result of a fast Fourier transform. It is a figure which shows the example of a screen of the abnormal sound diagnostic apparatus 10 by which two frequency spectrum waveforms were displayed. It is a figure which shows the example of an image when another frequency spectrum waveform from which the cause of abnormal noise differs is displayed with respect to the example of a screen shown in FIG. It is a figure for demonstrating a mode that the user can move the image of the analysis result waveform of the unusual sound recorded this time with the finger | toe 70 to the left-right direction. FIG. 15 is a diagram showing an example of a display screen after moving an abnormal sound analysis result waveform recorded this time in the display screen example shown in FIG. 14. It is a figure which shows an example at the time of displaying two time-axis auxiliary lines 90 on the display screen shown in FIG. It is a figure which shows an example at the time of displaying the frequency

auxiliary lines

91 and 92 on the display screen shown in FIG. It is a figure which shows an example at the time of displaying two time-axis auxiliary lines 90 and frequency

auxiliary lines

91 and 92 on the display screen shown in FIG. It is a figure for demonstrating a mode that it expands or shrinks so that the other waveform may become an equivalent magnitude | size, when the waveform of either one of the displayed two frequency spectrum waveforms is expanded or reduced.

Next, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a system diagram showing a configuration of an abnormal sound diagnosis system according to an embodiment of the present invention.

As shown in FIG. 1, the abnormal sound diagnosis system according to an embodiment of the present invention includes a portable abnormal sound diagnosis device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50. .

Note that the present invention can be applied to any device as long as the abnormal sound diagnosis device 10 can be connected to the server device 50 via the communication network. However, in the present embodiment, a case where the abnormal sound diagnosis apparatus 10 is a tablet terminal apparatus including a device such as a microphone capable of acquiring an audio signal and a touch panel capable of touch input will be described.

The abnormal sound diagnosis apparatus 10 is carried by a service person (maintenance personnel) who performs maintenance management, repair, etc. of the image forming apparatus 20 such as a printer used by the end user. The abnormal sound diagnosis apparatus 10 acquires an abnormal sound (abnormal sound) signal generated in the image forming apparatus 20, analyzes the frequency of the acquired abnormal sound signal, and analyzes the frequency of the past abnormal sound signal acquired from the server apparatus 50. This is used to display the resulting waveform and the frequency analysis result waveform of the acquired abnormal sound signal.

The abnormal sound diagnosis apparatus 10 and the server apparatus 50 are connected via a wireless LAN (Local Area Network) terminal 30 such as a Wi-Fi router or the Internet communication network 40 to transmit and receive information.

In the case where the abnormal sound diagnosis device 10 is a mobile phone device, a smartphone, or the like, the abnormal sound diagnosis device 10 and the server device 50 are connected via a mobile phone line network to transmit / receive defect information. Also good.

In the abnormal sound diagnosis system of the present embodiment, when an abnormal sound occurs in the image forming apparatus 20 that is a target electronic device installed at the end user's location, a service person carries the abnormal sound diagnosis apparatus 10 and the image forming apparatus. It is envisaged to go to 20 locations. And this service person acquires the abnormal sound signal by recording the abnormal sound generated using the abnormal sound diagnosis apparatus 10, and performs the abnormal sound diagnosis for specifying the cause of the abnormal sound.

It should be noted that it is technically possible to provide a recording function by providing the image forming apparatus 20 with a microphone or the like, and when the abnormal sound is generated, the abnormal sound is recorded by the recording function. However, when the image forming apparatus 20 is installed in an end user's office or the like, it is difficult to provide the image forming apparatus 20 with a sound recording function for security reasons.

Next, FIG. 2 shows a hardware configuration of the abnormal sound diagnosis apparatus 10 in the abnormal sound diagnosis system of the present embodiment.

As shown in FIG. 2, the abnormal sound diagnosis apparatus 10 performs wireless communication with the CPU 11, a memory 12 that can temporarily store data, a storage device 13 such as a flash memory, and a wireless LAN terminal 30 to perform data communication. A wireless LAN interface (IF) 14 that performs transmission and reception, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. These components are connected to each other via a control bus 18.

The abnormal sound diagnosis apparatus 10 of the present embodiment includes a touch panel in which a touch sensor for detecting a touch position is provided on the display device 16 as the input device 15. Display is performed using this touch panel, and input from the user is performed.

The CPU 11 executes predetermined processing based on a control program stored in the memory 12 or the storage device 13 to control the operation of the abnormal sound diagnosis device 10. Note that this control program can be obtained by downloading it via the Internet communication network 40 or the mobile phone network and provided to the CPU 11, or the program can be stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.

The abnormal sound diagnosis apparatus 10 according to the present embodiment performs operations as described below by executing the control program described above, and assists the service person in identifying the cause of the abnormal noise.

FIG. 3 is a block diagram showing a functional configuration of the abnormal sound diagnosis apparatus 10 realized by executing the control program.

As shown in FIG. 3, the abnormal sound diagnosis apparatus 10 of the present embodiment includes an audio acquisition unit 31, a frequency analysis unit 32, a control unit 33, an audio data storage unit 34, a display unit 35, and a communication unit. 36 and an audio reproduction unit 37.

The display unit 35 displays various data based on the control by the control unit 33. The communication unit 36 communicates with the server device 50 that is an external device. Based on the control by the control unit 33, the audio reproduction unit 37 reproduces the recorded audio data and converts it into an audio signal.

The sound acquisition unit 31 inputs an abnormal sound generated in the image forming apparatus 20 that is an analysis target apparatus and acquires a sound signal.

In the present embodiment, the sound acquisition unit 31 has been described as acquiring an audio signal by inputting an abnormal sound generated in the image forming apparatus 20, but the sound is an example of a sound. The signal is an example of sound information.

The frequency analysis unit 32 performs time frequency analysis (time-dependent frequency analysis) of the audio signal acquired by the audio acquisition unit 31, and represents a time change of the signal intensity distribution for each frequency of the acquired abnormal sound signal. Spectral waveform data (first analysis result) is generated. The frequency spectrum waveform data is an analysis result obtained by performing frequency analysis.

Specifically, the frequency analysis unit 32 generates frequency spectrum waveform data by performing STFT (Short Time Fourier Transform) on the audio signal acquired by the audio acquisition unit 31. The STFT will be described later.

The control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the audio data storage unit 34 together with the audio data.

In addition, the control unit 33 performs fast Fourier transform (1D-FFT) that performs frequency analysis in the time axis direction on a frequency component estimated to be abnormal sound in the frequency spectrum waveform data obtained by the frequency analysis unit 32. (Fast Fourier Transform) is instructed to the frequency analysis unit 32.

Here, the control unit 33 may extract a signal component having periodicity from the frequency spectrum waveform data, and select the signal component as a signal component that is highly likely to be abnormal sound. . Moreover, the control part 33 displays the obtained frequency spectrum waveform data on the display part 35, and the user (user of the abnormal sound diagnostic apparatus 10) who looked at the frequency spectrum waveform has a high possibility of an abnormal sound. By designating a frequency component, the frequency component may be selected as a signal component that has a high possibility of being an abnormal sound.

Then, the frequency analysis unit 32 performs fast Fourier transform in the time axis direction on the frequency component estimated to be abnormal sound based on the instruction from the control unit 33.

Then, the control unit 33 acquires the period and frequency information of the abnormal sound based on the analysis result of the fast Fourier transform in the frequency analysis unit 32.

In addition, the control unit 33 uses the acquired period and frequency information of the abnormal sound as well as the model name of the image forming apparatus 20, model information such as a serial number, and operation state information indicating the operation state of the image forming apparatus 20. To the server device 50 via Specifically, the operation status information includes information such as color printing or monochrome printing, double-sided printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included. In this way, the control unit 33 transmits information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server device 50 via the communication unit 36.

The server device 50 obtains the original waveform data and the audio data from the spectral waveform data obtained by performing frequency analysis of the audio signal of the abnormal sound that has occurred in the past in an apparatus equivalent to the apparatus of the image forming apparatus 20. Together with information such as the operating state of the device, the cause of the abnormal noise, and how to deal with the abnormal noise.

The server device 50 uses the frequency spectrum waveform data (the first frequency spectrum waveform data) corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the information on the period and frequency of the abnormal sound transmitted from the abnormal sound diagnosis device 10. 2 analysis results). Then, the server device 50 transmits the found frequency spectrum waveform data to the abnormal sound diagnosis device 10 together with information such as audio data stored as abnormal sound sample waveform data.

As a result, the control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.

The control unit 33 displays the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the spectrum waveform received from the server device 50 on the display unit 35 in parallel.

At this time, the control unit 33 at least one of the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50. The display content is changed in the time axis direction based on a user operation.

Note that the control unit 33 matches the frequency waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 with the periodic waveform in the frequency spectrum waveform transmitted from the server device 50. In addition, the display content in the time axis direction of at least one of the two frequency spectrum waveforms may be changed.

Here, a specific example of changing the display content of the frequency spectrum waveform in the time axis direction is to change the display position of the frequency spectrum waveform in the time axis direction.

Note that one of the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50 is the other waveform. It is set to have a longer waveform.

As an example, in the present embodiment, the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 is data for about 10 seconds and is transmitted from the server device 50. The frequency spectrum waveform is about 8 seconds of data.

In addition, when there are a plurality of frequency spectrum waveform data transmitted from the server device 50, the control unit 33 includes the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 among the plurality of frequency spectrum waveform data. Are displayed on the display unit 35 with priority.

Furthermore, either the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 or the frequency spectrum waveform transmitted from the server device 50 is enlarged or reduced. There is a case. In this case, the control unit 33 displays the other waveform enlarged or reduced so as to have the same size.

Furthermore, the process speed (image forming speed) of the image forming apparatus 20 when the abnormal sound waveform is acquired may differ from the process speed of the image forming apparatus when the frequency spectrum waveform is received from the server device 50. In this case, the control unit 33 may display the length of the frequency spectrum waveform transmitted from the server device 50 in the time axis direction expanded or reduced based on the two process speeds.

This is because the period of abnormal noise that occurs when the process speed changes also changes, so that a correct comparison cannot be made if they are compared as they are. Also, acquiring and preparing abnormal sound data for each of a plurality of process speeds increases the amount of data and the trouble of acquiring abnormal sound data.

When the user instructs the reproduction of the audio data, the audio reproduction unit 37 and the frequency spectrum waveform transmitted from the server device 50 and the audio data acquired by the audio acquisition unit 31 based on the control from the control unit 33. Audio data corresponding to the above may be reproduced as a left signal and a right signal for stereo reproduction, respectively.

Further, in order to facilitate the comparison of the two frequency spectrum waveforms, the control unit 33 can adjust an adjustable frequency auxiliary line indicating the same frequency on the two frequency spectrum waveforms displayed in parallel or the time axis direction. An adjustable common time axis auxiliary line for comparing the positions may be displayed in an overlapping manner.

Next, the functional configuration of the server device 50 in the abnormal sound analysis system of this embodiment will be described with reference to the block diagram of FIG.

The server device 50 according to the present embodiment includes a communication unit 51, a control unit 52, and a waveform data storage unit 53, as shown in FIG.

The waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of audio signals of abnormal sounds that have occurred in the past in an apparatus equivalent to the image forming apparatus 20 that is an analysis target apparatus.

Specifically, as shown in FIG. 5, the waveform data storage unit 53 includes frequency spectrum waveform data obtained by analyzing time-frequency analysis of abnormal sound data acquired in advance and the original sound. Information such as data, causes of abnormal noise, and countermeasures are stored for each model.

When the control unit 52 receives the abnormal sound period and frequency information from the abnormal sound diagnosis apparatus 10, the control unit 52 receives the abnormal sound period from among the waveform data of a plurality of frequency spectra stored in the waveform data storage unit 53. Based on the information on the frequency and the frequency information, the one similar to the waveform data of the frequency spectrum based on the abnormal sound acquired in the abnormal sound diagnosis apparatus 10 is selected. Then, the control unit 52 transmits the selected waveform data to the abnormal sound diagnosis apparatus 10 via the communication unit 51.

In the present embodiment, the abnormal sound diagnosis apparatus 10 performs STFT and fast Fourier transform on abnormal sound data, and transmits the period and frequency information of the abnormal sound to the server device 50. The fast Fourier transform, or both the STFT and the fast Fourier transform may be executed on the server device 50 side.

In this case, the audio data is transmitted as it is from the abnormal sound diagnosis apparatus 10 to the server apparatus 50 or the frequency spectrum waveform data as a result of performing STFT on the audio data is transmitted to the server apparatus 50. The STFT or fast Fourier transform is performed on the audio data.

Next, the operation of the abnormal sound diagnosis system of this embodiment will be described with reference to the sequence chart of FIG.

When the abnormal sound diagnosis apparatus 10 performs an abnormal sound diagnosis for identifying the cause of the abnormal sound, an image as shown in FIG. 7 is displayed, and various types of information such as the model name, serial number, and operating state are input. (Step S101).

The abnormal sound diagnosis apparatus 10 sets the operation mode to the voice recording mode, records the abnormal sound with the microphone 17 that is brought close to the abnormal sound generation location of the image forming apparatus 20, and acquires the voice data (step S102).

In the abnormal sound diagnosis apparatus 10, the frequency analysis waveform is generated by performing the STFT in the frequency analysis unit 32 on the acquired voice data, thereby generating a frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency (step S103). .

As shown in FIG. 8, STFT is a process of performing a Fourier transform every short time and calculating a signal intensity for each frequency component according to a time change. FIG. 9 shows a waveform example when the analysis result obtained by this STFT is an image of one frequency spectrum waveform.

In the frequency spectrum waveform example shown in FIG. 9, the horizontal axis represents time, the vertical axis represents frequency, and the intensity for each frequency is represented by color. In FIG. 9, this color difference is expressed by a hatching pattern. Further, FIG. 9 illustrates the case where the intensity for each frequency is expressed by color, but this intensity can also be expressed by gradation.

In the frequency spectrum waveform example of FIG. 9, it can be seen that the abnormal frequency component 61 is periodically generated at a specific frequency. In the example of the frequency spectrum waveform shown in FIG. 9, the low frequency component is a normal operation sound and not an abnormal frequency component.

When the frequency spectrum waveform as shown in FIG. 9 is obtained, the control unit 33 displays the frequency spectrum waveform on the display unit 35. Then, the user who is presented with the frequency spectrum waveform specifies the abnormal frequency component 61, and selects a region including the abnormal frequency component 61 by operating the touch panel, for example.

FIG. 10 shows an example of the selection area 80 selected by the user in this way. In the example shown in FIG. 10, it can be seen that a rectangular region including a plurality of abnormal frequency components 61 is designated as the selection region 80.

When the selection area 80 is designated in this way, the fast Fourier transform (1D-FFT) for the frequency components included in the selection area 80 is executed by the frequency analysis unit 32 (step S104). FIG. 11 shows an example of analysis results of the fast Fourier transform executed in this way.

In FIG. 11, the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform. In addition, since an overtone component etc. are contained in abnormal sound, a some period may be detected, but the period with the strongest signal strength is detected as an abnormal sound period.

Further, since a signal component having a long period of a predetermined period or more is considered to be normal operation sound or indefinite period noise, the region of such a long period signal component is set as a determination exclusion region 62. The analysis result in the determination exclusion area 62 is ignored.

Furthermore, since a low-frequency signal component equal to or lower than a predetermined frequency cannot be distinguished from a normal operation sound, such a low-frequency signal component region is set as a determination exclusion region 63. The analysis result in the determination exclusion area 63 is ignored.

The abnormal sound diagnosis apparatus 10 transmits information on the frequency and period of the abnormal sound to the server apparatus 50 together with the model information and the operation state information based on the analysis result of the fast Fourier transform (step S105). For example, information such that the abnormal frequency is 4 kHz and the abnormal cycle is 2.0 seconds is transmitted to the server device 50.

Then, the server device 50 searches the waveform data storage unit 53 based on the received information, and extracts frequency spectrum waveform data corresponding to the received information (step S106).

Then, the server device 50 transmits the extracted frequency spectrum waveform data to the abnormal sound diagnosis device 10 together with information such as the original voice data, the cause of the abnormal noise, and a countermeasure method thereof (step S107).

Then, the abnormal sound diagnosis apparatus 10 receives the frequency spectrum waveform data transmitted from the server apparatus 50 (step S108). Then, the control unit 33 of the abnormal sound diagnosis apparatus 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by the STFT on the display unit 35 (step S109).

FIG. 12 shows a screen example of the abnormal sound diagnosis apparatus 10 on which two frequency spectrum waveforms are displayed in this way.

In the screen example shown in FIG. 12, the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as “analysis result waveform of abnormal sound recorded this time”, and the frequency spectrum waveform transmitted from the server device 50 is displayed. It can be seen that “Past abnormal noise data” is displayed together with the cause of abnormal noise “Wearing of the photosensitive drum”.

A serviceman who wants to perform an abnormal noise diagnosis compares the two frequency spectrum waveforms and determines whether or not the abnormal noise components in the waveforms are similar, thereby specifying the cause of the abnormal noise.

Further, when a plurality of frequency spectrum waveforms are transmitted from the server device 50, for example, by tracing a frequency spectrum waveform image displayed as “past abnormal sound data” in the horizontal direction by a touch operation, Another frequency spectrum waveform is displayed as shown in FIG.

FIG. 13 shows an example of an image on which the frequency spectrum waveform of abnormal noise is displayed when the abnormal noise is caused by “the drive system motor is defective”.

When a plurality of frequency spectrum waveforms are transmitted in this way, the service person determines whether the frequency spectrum waveform of the abnormal sound acquired this time is more similar to which frequency spectrum waveform is abnormal. Identify the cause of When identifying the cause of this abnormal noise, not only simply comparing the shape of the frequency spectrum waveform, the period or frequency of the abnormal noise component, but also reproducing the original audio data by the audio reproducing unit 37, and this time The cause of the abnormal noise may be specified by a serviceman listening and comparing the acquired abnormal noise and the voice corresponding to the frequency spectrum waveform transmitted from the server device 50.

In the abnormal sound diagnosis apparatus 10 of this embodiment, when comparing two frequency spectrum waveforms displayed in parallel on the display unit 35, the display position of the image of the frequency spectrum waveform of the recorded abnormal sound signal is changed. It can be changed in the time axis direction (left-right direction).

Specifically, as shown in FIG. 14, when the user performs a touch operation such as sliding the touch panel in the left-right direction with the finger 70, the image of the abnormal sound analysis result waveform recorded this time is moved in the left-right direction. Be able to.

FIG. 15 shows an example of the display screen after moving the abnormal sound analysis result waveform recorded this time in the display screen example shown in FIG.

The user can move the image of the frequency spectrum waveform of the abnormal sound in the time axis direction in this way, and perform comparison with the image of the frequency spectrum waveform to be compared transmitted from the server device 50. That is, it is possible to compare the period of the signal component that seems to be abnormal noise in the frequency spectrum waveform of the abnormal sound acquired this time with the period of the abnormal signal component in the frequency spectrum waveform transmitted from the server device 50.

FIG. 16 shows an example in which two time axis auxiliary lines 90 are displayed on the display screen shown in FIG. In FIG. 16, one time axis auxiliary line 90 is displayed in common on two frequency spectrum waveforms by operating the “time axis auxiliary line display” button. It can be moved to any position. When the “erase” button is operated, the displayed time axis auxiliary line 90 is erased from the display screen.

By using the time axis auxiliary line 90 after the positions of the two different frequency waveform waveforms of the abnormal sound wave are slid to the left and right, the interval between the frequency components of the periodic abnormal sound is two. It becomes easy to compare whether the frequency spectrum waveforms are the same or different.

FIG. 17 shows an example in which frequency

auxiliary lines

91 and 92 are displayed on the display screen shown in FIG. In FIG. 17, two frequency

auxiliary lines

91 and 92 are displayed at the positions indicating the same frequency on the respective frequency spectrum waveforms by operating the “frequency auxiliary line display” button, and the up and down buttons are used to move up and down. It can move to any position in the frequency direction. When the “erase” button is operated, the frequency

auxiliary lines

91 and 92 that have been displayed are erased from the display screen.

When comparing the frequency components of abnormal sounds in two frequency spectrum waveforms, by using such frequency

auxiliary lines

91 and 92, it is possible to determine whether the frequencies of the abnormal noise components on the respective frequency spectrum waveforms are the same or different. It becomes easy to compare.

It is also possible to display the time axis auxiliary line 90 and the frequency

auxiliary lines

91 and 92 as described above simultaneously. As shown in FIG. 18, by simultaneously displaying the time axis auxiliary line 90 and the frequency

auxiliary lines

91 and 92, it becomes easy to compare the frequency and period of the abnormal signal component in the two frequency spectrum waveforms.

Furthermore, in the abnormal sound diagnosis apparatus 10 of this embodiment, the displayed image of the frequency spectrum waveform can be enlarged or reduced by a touch operation. However, if only one of the two frequency spectrum waveforms is enlarged or reduced, the two frequency spectra cannot be compared. Therefore, in the abnormal sound diagnosis apparatus 10 of the present embodiment, as shown in FIG. 19, the frequency spectrum waveform obtained by performing the frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the server apparatus 50 are transmitted. When any one of the received frequency spectrum waveforms is enlarged or reduced, the control unit 33 displays the other waveform enlarged or reduced so as to have the same size.

In this way, after one frequency spectrum waveform is enlarged or reduced, the two frequency spectrum waveforms are not required to be operated to enlarge or reduce the other frequency spectrum waveform to have the same size. The image sizes of are the same.

[Modification]
In the above embodiment, the case where the abnormal sound diagnosis device 10 is a tablet terminal device has been described. However, the present invention is not limited to this, and even when another device is used as the abnormal sound diagnosis device. The present invention can be applied. For example, when the operation panel of the image forming apparatus 20 is detachable from the main body, and is configured to be able to communicate with the server apparatus 50 and incorporate an audio signal acquisition function, the operation panel is A diagnostic device may be used.

In the above embodiment, the case where the abnormal sound diagnosis apparatus 10 includes the microphone 17 is described. However, if the abnormal sound diagnosis apparatus 10 has a voice recording function, a collection of microphones and the like is possible. You may make it implement | achieve the acquisition part of an audio | voice signal by connecting a sound apparatus outside.

Furthermore, in the above embodiment, the case where the target device for abnormal noise analysis is an image forming apparatus has been described. However, the target device for abnormal noise analysis is not limited to an image forming apparatus. The present invention can be similarly applied to other devices as long as they are devices capable of generating periodic noise.

Although various embodiments have been described above, these embodiments may be combined.
Further, the present disclosure is not limited to the above-described embodiment, and can be implemented in various forms without departing from the gist of the present disclosure.
This application is based on a Japanese patent application filed on December 4, 2015 (Japanese Patent Application No. 2015-237281), the contents of which are incorporated herein by reference.

10 abnormal sound diagnosis device 11 CPU
12 Memory 13 Storage Device 14 Wireless LAN Interface (IF)
DESCRIPTION OF SYMBOLS 15 Input apparatus 16 Display apparatus 17 Microphone 18 Control bus 20 Image forming apparatus 30 Wireless LAN terminal 31 Audio | voice acquisition part 32 Frequency analysis part 33 Control part 34 Audio | voice data storage part 35 Display part 36 Communication part 37 Voice reproduction part 40 Internet communication network 50 Server device 51 Communication unit 52 Control unit 53 Waveform data storage unit 61 Frequency component of

abnormal sound

62, 63 Determination exclusion area 70 Finger 80 Selection area 90 Time axis

auxiliary line

91, 92 Frequency auxiliary line

Claims

An acquisition unit for inputting sound generated and acquiring sound information;
A display unit for displaying in parallel a first analysis result obtained by performing frequency analysis of the acquired sound information and a second analysis result obtained by performing frequency analysis of sound information of abnormal sound;
A change unit that changes the display content of at least one of the displayed first analysis result and the second analysis result in a time axis direction;
Diagnostic device with
The diagnostic device according to claim 1, wherein the changing unit changes the display content of at least one of the first analysis result and the second analysis result in the time axis direction based on a user operation.
The changing unit changes the display content of at least one of the first analysis result and the second analysis result in the time axis direction so that the periodic waveforms in the first analysis result and the second analysis result coincide with each other. The diagnostic device according to claim 1.
The diagnostic device according to any one of claims 1 to 3, further comprising a frequency analysis unit that performs time-frequency analysis of the sound information acquired by the acquisition unit to generate waveform data of the first analysis result.
A communication unit for communicating with an external device;
A transmission unit for transmitting information obtained from the first analysis result obtained by the frequency analysis unit to the external device via the communication unit;
The diagnostic apparatus according to claim 4, further comprising: a receiving unit that receives the second analysis result corresponding to the first analysis result from the external device via the communication unit.
The analysis result of any one of the said 1st analysis result and the said 2nd analysis result is set so that it may become an analysis result longer than the other analysis result. Diagnostic equipment.
When either one of the first analysis result and the second analysis result displayed on the display unit is enlarged or reduced, the display unit causes the other analysis result to have the same size. The diagnostic apparatus according to claim 1, wherein the diagnostic apparatus displays an enlarged or reduced image.
When there are a plurality of second analysis results corresponding to the first analysis result, the display unit preferentially displays a plurality of the second analysis results having a high similarity to the first analysis result. The diagnostic device according to any one of claims 1 to 7.
The device to be analyzed is an image forming device,
The display unit is based on the image forming speed of the image forming apparatus when the first analysis result is acquired and the image forming speed of the image forming apparatus when the second analysis result is acquired. The diagnostic device according to any one of claims 1 to 8, wherein the length of the second analysis result in the time axis direction is displayed by being expanded or reduced.
10. The audio reproduction unit further reproduces the sound information obtained from the first analysis result and the sound information obtained from the second analysis result as a left signal and a right signal of stereo reproduction, respectively. The diagnostic device according to any one of the above.
The diagnostic device according to any one of claims 1 to 10, wherein the display unit displays an adjustable auxiliary line indicating the same frequency in an overlapping manner on the first analysis result and the second analysis result.
11. The display unit according to claim 1, wherein an adjustable common auxiliary line for comparing positions in the time axis direction is superimposed and displayed on the first analysis result and the second analysis result. The diagnostic device according to item.
Obtained by obtaining the sound information by inputting the generated sound, the first analysis result obtained by performing the frequency analysis of the obtained sound information, and the frequency analysis of the sound information of the abnormal sound. A display unit that displays the second analysis result in parallel, and a change unit that changes the display content of at least one of the displayed first analysis result and the second analysis result in the time axis direction. Equipment,
A storage unit that stores a plurality of second analysis results obtained by performing frequency analysis of sound information of abnormal sounds, and when the information obtained from the first analysis results is received from the diagnostic device, A server device comprising: a second transmission unit that selects an analysis result similar to the received first analysis result from the plurality of second analysis results stored; and transmits the analysis result to the diagnostic device;
Diagnostic system with
An acquisition step of acquiring sound information by inputting the generated sound;
A display step of displaying in parallel a first analysis result obtained by performing frequency analysis of the acquired sound information and a second analysis result obtained by performing frequency analysis of sound information of abnormal sound;
A diagnostic method comprising: a changing step of changing display content of at least one of the displayed first analysis result and the second analysis result in a time axis direction.
An acquisition step of acquiring sound information by inputting the generated sound;
A display step of displaying in parallel a first analysis result obtained by performing frequency analysis of the acquired sound information and a second analysis result obtained by performing frequency analysis of sound information of abnormal sound;
The program for making a computer perform the change step which changes the display content of at least one of the displayed said 1st analysis result and said 2nd analysis result in a time-axis direction.