JP6834223B2 - Diagnostic equipment, diagnostic systems and programs - Google Patents

Description

The present invention relates to diagnostic devices, diagnostic systems and programs.

Patent Document 1 includes a RAM or ROM that stores a normal operating sound of the image forming apparatus, and a microphone that detects an operating sound generated by the image forming apparatus, and is stored in the RAM or ROM. A system for identifying an abnormal portion of an image forming apparatus based on a first sound information, a second sound information detected by a microphone, and an operation information of the image forming apparatus is disclosed.

Patent Document 2 describes a sound conversion unit that converts sound inside the device into an electric signal in an image processing device having an image forming unit that forms an image on the printing paper and a conveying unit that conveys the printing paper. An image processing device including a sound analysis unit that analyzes an electric signal converted by a sound conversion unit to obtain a component for each frequency and an output unit that outputs a component for each frequency obtained by the sound analysis unit is disclosed. There is.

JP-A-2007-079263 Japanese Unexamined Patent Publication No. 2008-290288

When an abnormal sound (abnormal sound) occurs in a certain device, the sound generated in the device to be analyzed is input to acquire an audio signal, and the acquired audio signal and the device equivalent to the device to be analyzed have generated in the past. In some cases, it is attempted to clarify the cause of the abnormal noise by comparing it with the audio signal of the abnormal noise.

In such a case, even if the waveforms of the frequency analysis results obtained by performing frequency analysis of the two audio signals are displayed side by side, the two audio signals compared with the fact that the time axis direction is deviated are similar. It is difficult to judge whether or not it is.

An object of the present invention is a diagnostic apparatus and diagnosis capable of facilitating comparison of analysis results when comparing waveforms of two frequency analysis results, as compared with the case where each waveform is displayed side by side separately. To provide systems and programs.

[Diagnostic device]
The present invention according to claim 1 comprises an acquisition means for inputting generated sound and acquiring sound information.
A waveform of the first analysis result is the frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result The waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, and the two waveforms with one of the waveforms transmitted through. It is a diagnostic device provided with a display means for displaying on top of each other.

The present invention according to claim 2 comprises an acquisition means for inputting generated sound and acquiring sound information.
The first analysis result of the waveform is a frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result Only the image of the abnormal sound region in the waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, is displayed in an overlapping state. It is a diagnostic device provided with a display means for displaying.

The present invention according to claim 3 comprises an acquisition means for inputting generated sound and acquiring sound information.
The first analysis result of the waveform is a frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result An image showing the shape of the edge part of the abnormal sound region in the waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, is superimposed and displayed. It is a diagnostic device provided with a display means for displaying.

The present invention according to claim 4 comprises an acquisition means for inputting generated sound and acquiring sound information.
The first analysis result of the waveform is a frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result A display means for superimposing and displaying an image showing the position of the abnormal sound region in the waveform of the second analysis result, which is a past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound. It is a diagnostic device equipped with.

According to the fifth aspect of the present invention, the display means superimposes an image obtained from the waveform of the second analysis result on the waveform of the first analysis result in a state of blinking at preset intervals. The diagnostic device according to any one of claims 1 to 4 to be displayed.

The present invention according to claim 6 claims that the display means superimposes an image obtained from the waveform of the second analysis result on the waveform of the first analysis result based on an operation of the user. The diagnostic apparatus according to any one of 1 to 4.

The present invention according to claim 7 comprises an acquisition means for inputting generated sound and acquiring sound information.
A waveform of the first analysis result is the frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result A display means for switching and displaying the waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, at preset intervals. It is a diagnostic device equipped with.

The present invention according to claim 8 is an acquisition means for inputting generated sound to acquire sound information, and
A waveform of the first analysis result is the frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result A display means for switching and displaying the waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, based on the operation of the user. It is a diagnostic device equipped with.

The present invention according to claim 9 is the diagnostic apparatus according to claim 1 or 2, further comprising a setting means for setting at least one of transparency, color, and density of an image displayed in a transparent state.

In the present invention according to claim 10, the display means sets the color of the region where the abnormal sound region of the waveform of the first analysis result and the abnormal sound region of the waveform of the second analysis result overlap. The diagnostic apparatus according to claim 2, wherein the color of the waveform of the second analysis result is displayed as a color different from the color of the abnormal sound region.

The present invention according to claim 11 further includes a setting means for setting the color of the region where the abnormal noise region of the waveform of the first analysis result and the abnormal noise region of the waveform of the second analysis result overlap. The diagnostic device described.

The present invention according to claim 12 changes the display position of either the displayed waveform of the first analysis result or the image obtained from the waveform of the second analysis result in the time axis direction or the frequency axis direction. The diagnostic device according to any one of claims 1 to 11, further comprising a changing means.

According to the thirteenth aspect of the present invention, when the changing means is a waveform of the cause of the abnormal noise in which the frequency of the generated abnormal noise does not change, the display position in the frequency axis direction is displayed. The diagnostic device according to claim 12, which does not change.

In the present invention according to claim 14, when the changing means is a waveform caused by an abnormal sound in which the frequency of the generated abnormal sound changes, the frequency of the generated abnormal sound changes. The diagnostic device according to claim 12, wherein the display position is changed within the range to be used.

The present invention according to claim 15 is the case where the display means is enlarged or reduced in either one of the first analysis result and the image obtained from the second analysis result displayed on the display means. The diagnostic device according to any one of claims 1 to 14, wherein the other waveform or image is enlarged or reduced so as to have the same size.

The present invention according to claim 16 comprises a frequency analysis means for generating frequency spectrum waveform data of the first analysis result by performing time-time frequency analysis of sound information acquired by the acquisition means.
Communication means for communicating with external devices and
Information on the period and frequency of a frequency component that seems to be an abnormal sound extracted based on the frequency spectrum waveform of the first analysis result obtained by the frequency analysis means is transmitted to an external device via the communication means. Transmission means and
The diagnostic device according to any one of claims 1 to 15 , further comprising a receiving means for receiving the second analysis result corresponding to the first analysis result from an external device via the communication means.

[Diagnostic system]
The present invention according to claim 17 represents an acquisition means for inputting generated sound to acquire sound information, and a time change of intensity distribution for each frequency obtained by performing time- frequency analysis of the acquired sound information. The past frequency spectrum corresponding to the period and frequency information of the frequency component which seems to be an abnormal sound extracted based on the frequency spectrum waveform of the first analysis result which is the frequency spectrum waveform and the frequency spectrum waveform of the first analysis result. A diagnostic device provided with a display means for displaying the waveform of the second analysis result, which is a waveform, by superimposing two waveforms in a state where one waveform is transmitted.
A storage means for storing a plurality of second analysis results obtained by frequency analysis of past abnormal noise sound information, and an abnormal sound extracted from the diagnostic apparatus based on the frequency spectrum waveform of the first analysis result. When information on the period and frequency of a frequency component that seems to exist is received, an analysis result similar to the received first analysis result is selected from the plurality of second analysis results stored in the storage means. It is a diagnostic system including a server device including a second transmission means for transmitting to the diagnostic device.

[program]
The present invention according to claim 18 includes an acquisition step of inputting generated sound and acquiring sound information.
A waveform of the first analysis result is the frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result The waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, and the two waveforms with one of the waveforms transmitted through. It is a program for causing a computer to execute a display step to be displayed in layers.

According to the present invention according to claims 1 to 4, when comparing the waveforms of two frequency analysis results, it is easy to compare the analysis results as compared with the case where the waveforms are displayed side by side separately. Can provide a diagnostic device capable of.

According to the fifth aspect of the present invention, there are a state in which an image obtained from the waveform of the second analysis result is superimposed on the waveform of the first analysis result and a state in which only the waveform of the first analysis result is displayed. It is possible to provide a diagnostic device capable of automatically switching between.

According to the sixth aspect of the present invention, there are a state in which an image obtained from the waveform of the second analysis result is superimposed on the waveform of the first analysis result and a state in which only the waveform of the first analysis result is displayed. Can be provided as a diagnostic device capable of switching based on the operation of the user.

According to the seventh aspect of the present invention, it is possible to provide a diagnostic apparatus capable of automatically switching and displaying the waveform of the first analysis result and the waveform of the second analysis result.

According to the eighth aspect of the present invention, it is possible to provide a diagnostic device capable of switching and displaying the waveform of the first analysis result and the waveform of the second analysis result based on the operation of the user.

According to the ninth aspect of the present invention, it is possible to provide a diagnostic apparatus capable of making it easier to understand the difference between the image displayed in a transparent state and the image to be compared.

According to the tenth aspect of the present invention, even when the cycles of the two abnormal sound regions are slightly different, it is possible to easily grasp that the cycle shift gradually occurs.

According to the eleventh aspect of the present invention, it is possible to provide a diagnostic device capable of making it easier to understand the difference between the region where two abnormal noise regions overlap and the region where the two abnormal noise regions do not overlap.

According to the twelfth aspect of the present invention, it is possible to provide a diagnostic apparatus capable of facilitating comparison of two analysis results as compared with the case where the display position in the time axis direction or the frequency axis direction cannot be changed. Can be done.

According to the thirteenth aspect of the present invention, it is possible to prevent the display position of the waveform of the second analysis result of the cause of the abnormal noise in which the frequency of the generated abnormal noise does not change from being changed in the frequency axis direction. A diagnostic device can be provided.

According to the fourth aspect of the present invention, even if the waveform is the result of the second analysis of the cause of the abnormal noise in which the frequency of the generated abnormal noise changes, the display position exceeds the range in which the frequency of the generated abnormal noise changes. It is possible to provide a diagnostic device capable of preventing the frequency from being changed.

According to the fifteenth aspect of the present invention, there is a diagnostic device capable of saving the trouble of enlarging or reducing the other image at the same magnification when the image obtained from one analysis result is enlarged or reduced. Can be provided.

According to the 16th aspect of the present invention, it is possible to provide a diagnostic device capable of using the second analysis result stored in the external device.

According to the present invention according to claim 17, when comparing the waveforms of two frequency analysis results, it is possible to facilitate the comparison of the analysis results as compared with the case where the waveforms are displayed side by side separately. Diagnostic system can be provided.

According to the present invention according to claim 18, when comparing the waveforms of two frequency analysis results, it is possible to facilitate the comparison of the analysis results as compared with the case where the waveforms are displayed side by side separately. Program can be provided.

It is a system diagram which shows the structure of the abnormal noise diagnosis system of one Embodiment of this invention. It is a block diagram which shows the hardware structure of the abnormal noise diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the functional structure of the abnormal noise diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the functional structure of the server apparatus 50 in one Embodiment of this invention. It is a figure which shows an example of the information stored in the waveform data storage part 53 in FIG. It is a sequence chart for demonstrating the operation of the abnormal noise diagnosis system of one Embodiment of this invention. It is a figure which shows the display screen example of the abnormal noise diagnostic apparatus 10 when inputting various information such as a model name, a serial number, and an operating state. It is a figure for demonstrating the concept of STFT. It is a figure which shows the image example of the frequency spectrum waveform based on the analysis result obtained by the FTFT. It is a figure which shows an example of the selection area 80 selected by the user in the image example of the frequency spectrum waveform of FIG. It is a figure which shows the analysis result example of the fast Fourier transform. It is a figure which shows the screen example of the abnormal sound diagnostic apparatus 10 which displayed two frequency spectrum waveforms in parallel. It is a figure which shows the display screen example at the time of superimposing the two frequency spectrum waveforms in the state where one waveform is transmitted. It is a figure for demonstrating how the display position of the waveform of the frequency analysis result of the past abnormal sound displayed on the upper side is changed by the swipe operation of the user when two frequency spectrum waveforms are displayed superimposed. .. It is a figure which shows the screen example at the time of superimposing the image of the abnormal sound region in the waveform of the frequency analysis result of the past abnormal sound on the waveform of the frequency analysis result of the abnormal sound acquired this time in a transparent state. When displaying the color of the area where the abnormal sound area of the waveform of the frequency analysis result of the past abnormal sound and the abnormal sound area of the waveform of the frequency analysis result of the abnormal sound acquired this time overlap with the color of the other area. It is a figure for demonstrating. It is a figure which shows the screen example in the case where the shape of the edge part of the abnormal noise region in the waveform of the frequency analysis result of the past abnormal sound is superposed on the waveform of the frequency analysis result of the abnormal sound acquired this time. It is a figure which shows the screen example in the case where the rectangular image which shows the position of the abnormal sound region in the waveform of the frequency analysis result of the past abnormal sound is superposed on the waveform of the frequency analysis result of the abnormal sound acquired this time. It is a figure which shows the screen example at the time of switching and displaying the waveform of the frequency analysis result of the abnormal sound acquired this time, and the waveform of the frequency analysis result of the abnormal sound of this time in the past at a preset interval. It is a figure which shows the screen example at the time of switching and displaying the waveform of the frequency analysis result of the abnormal sound acquired this time, and the waveform of the frequency analysis result of the abnormal sound of this time in the past based on the operation of a user.

Next, an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a system diagram showing a configuration of an abnormal noise diagnosis system according to an embodiment of the present invention.

As shown in FIG. 1, the abnormal noise diagnostic system according to the embodiment of the present invention includes a portable abnormal noise diagnostic device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50. ..

The present invention can be applied to any device as long as the abnormal noise diagnostic device 10 can be connected to the server device 50 via a communication network. However, in the present embodiment, the case where the abnormal sound diagnostic device 10 is a device such as a microphone capable of acquiring an audio signal and a tablet terminal device provided with a touch panel capable of touch input will be described.

The abnormal noise diagnostic device 10 is carried by a serviceman (maintenance personnel) who performs maintenance management, repair, etc. of the image forming device 20 such as a printer used by the end user, and the abnormal noise (abnormality) generated in the image forming device 20. Sound) The signal is acquired and the acquired abnormal noise signal is frequency-analyzed, and the waveform of the frequency analysis result of the past abnormal noise signal acquired from the server device 50 and the frequency analysis result waveform of the acquired abnormal noise signal are displayed. Used to do.

The abnormal noise diagnosis device 10 and the server device 50 are connected to each other via a wireless LAN terminal 30 such as a Wi-Fi router or an Internet communication network 40 to transmit and receive information.

When the abnormal noise diagnostic device 10 is a mobile phone device, a smartphone, or the like, the abnormal noise diagnostic device 10 and the server device 50 are connected to each other via a mobile phone network to transmit and receive defect information. It is also possible.

In the abnormal noise diagnosis system of the present embodiment, when an abnormal noise is generated in the image forming apparatus 20 which is a target electronic device installed at the end user's place, a serviceman carries the abnormal noise diagnostic apparatus 10 with the image forming apparatus. Go to 20 places. Then, the serviceman acquires the abnormal noise signal by recording the abnormal noise generated by using the abnormal noise diagnosis device 10, and performs the abnormal noise diagnosis to identify the cause of the abnormal noise.

Although it is technically possible to provide the image forming apparatus 20 with a microphone or the like to have a recording function and record the abnormal sound by the recording function when an abnormal sound is generated, the image forming apparatus 20 When installed in an end user's office or the like, it is not possible to provide the image forming apparatus 20 with a function of recording sound for security reasons.

Next, FIG. 2 shows the hardware configuration of the abnormal noise diagnosis device 10 in the abnormal noise diagnosis system of the present embodiment.

As shown in FIG. 2, the abnormal noise diagnostic device 10 performs wireless communication with the CPU 11, the memory 12 capable of temporarily storing data, the storage device 13 such as a flash memory, and the wireless LAN terminal 30 to perform data. It has a wireless LAN interface (IF) 14 for transmitting and receiving data, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. These components are connected to each other via a control bus 18.

The abnormal noise diagnosis device 10 of the present embodiment is provided with a touch panel provided as an input device 15 with a touch sensor for detecting a touch position on the display device 16, and the display is performed using the touch panel. Input from the user is performed.

The CPU 11 executes a predetermined process based on the control program stored in the memory 12 or the storage device 13 to control the operation of the abnormal noise diagnosis device 10. This control program can be obtained by downloading via the Internet communication network 40 or the mobile phone line network and provided to the CPU 11, and the program is stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.

The abnormal noise diagnostic device 10 of the present embodiment performs the operations as described below when the above control program is executed, and assists the serviceman in the work of identifying the cause of the abnormal noise.

FIG. 3 is a block diagram showing a functional configuration of the abnormal noise diagnostic device 10 realized by executing the above control program.

As shown in FIG. 3, the abnormal noise diagnosis device 10 of the present embodiment includes a voice acquisition unit 31, a frequency analysis unit 32, a control unit 33, a voice data storage unit 34, a display unit 35, and a communication unit. 36 and a voice reproduction unit 37 are provided.

The display unit 35 displays various data based on the control by the control unit 33. The communication unit 36 communicates with the server device 50, which is an external device. The voice reproduction unit 37 reproduces the recorded voice data or the like and converts it into a voice signal based on the control by the control unit 33.

The voice acquisition unit 31 acquires a voice signal by inputting the sound of abnormal noise generated in the image forming device 20 which is the device to be analyzed.

In the present embodiment, the voice acquisition unit 31 is described as inputting the voice of the abnormal sound generated in the image forming apparatus 20 to acquire the voice signal. However, the voice is an example of the sound, and the voice is used. The signal is an example of sound information.

The frequency analysis unit 32 performs time-frequency analysis (time-dependent frequency analysis) of the voice signal acquired by the voice acquisition unit 31, and represents the time change of the signal intensity distribution for each frequency of the acquired abnormal sound signal. Generates spectral waveform data (first analysis result). The frequency spectrum waveform data (waveform data of the frequency analysis result) is an analysis result obtained by performing the frequency analysis.

Specifically, the frequency analysis unit 32 generates frequency spectrum waveform data by performing an STFT (Short time Fourier transform) on the voice signal acquired by the voice acquisition unit 31. The description of this FTFT will be described later.

The control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the voice data storage unit 34 together with the voice data.

Further, the control unit 33 performs a fast Fourier transform (1D-FFT) that performs frequency analysis in the time axis direction for a frequency component estimated to be an abnormal sound in the frequency spectrum waveform data obtained by the frequency analysis unit 32. (Fast Fourier Transform)) is instructed to the frequency analysis unit 32.

Here, the control unit 33 may extract a signal component having periodicity from the frequency spectrum waveform data and select the signal component as a signal component having a high possibility of being an abnormal sound. .. Further, the control unit 33 displays the obtained frequency spectrum waveform data on the display unit 35, and specifies a frequency component that is likely to be an abnormal sound by the user who sees the frequency spectrum waveform, thereby that frequency. The component may be selected as a signal component that is likely to be an abnormal sound.

Then, the frequency analysis unit 32 performs a fast Fourier transform in the time axis direction on the frequency component presumed to be an abnormal sound based on the instruction by the control unit 33.

Then, the control unit 33 acquires information on the period and frequency of the abnormal sound based on the analysis result of the fast Fourier transform in the frequency analysis unit 32.

Further, the control unit 33 uses the acquired abnormal noise cycle and frequency information together with the model information such as the model name and serial number of the image forming apparatus 20 and the operating state information indicating the operating state of the image forming apparatus 20 together with the communication unit 36. Is transmitted to the server device 50 via. Specifically, this operation status information includes information such as whether it is color printing or black-and-white printing, double-sided printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included. In this way, the control unit 33 transmits the information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server device 50 via the communication unit 36.

In the server device 50, the original voice data and the voice data were acquired from the spectral waveform data obtained by performing frequency analysis of the voice signal of the abnormal sound generated in the past in a device equivalent to the device of the image forming device 20. It stores information such as the operating status of the device, the cause of abnormal noise, and how to deal with abnormal noise.

Then, the server device 50 receives frequency spectrum waveform data (corresponding to the frequency spectrum waveform data obtained as a result of frequency analysis by the frequency analysis unit 32 from the information on the period and frequency of the abnormal sound transmitted from the abnormal sound diagnostic device 10. The second analysis result) is searched, and the found frequency spectrum waveform data is transmitted to the abnormal sound diagnostic device 10 together with information such as voice data stored as sample waveform data of abnormal sound.

As a result, the control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.

The control unit 33 displays the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the spectrum waveform received from the server device 50 in parallel on the display unit 35.

Further, the control unit 33 of the present embodiment obtains, for example, one of the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the spectrum waveform received from the server device 50. The waveforms are superimposed and displayed on the display unit 35 in a transparent state. The details of various display variations when displaying two frequency spectrum waveforms in an overlapping manner will be described later.

Next, the functional configuration of the server device 50 in the abnormal noise analysis system of the present embodiment will be described with reference to the block diagram of FIG.

As shown in FIG. 4, the server device 50 of the present embodiment includes a communication unit 51, a control unit 52, and a waveform data storage unit 53.

The waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of a voice signal of an abnormal sound generated in the past in a device equivalent to the image forming device 20 which is a device to be analyzed.

Specifically, as shown in FIG. 5, the waveform data storage unit 53 includes frequency spectrum waveform data obtained by time-frequency analysis of previously acquired abnormal sound audio data, and the original audio. Information such as data, the cause of abnormal noise, and how to deal with it is stored for each model.

Then, when the control unit 52 receives the information on the period and frequency of the abnormal sound from the abnormal sound diagnostic device 10, the received difference is obtained from the waveform data of the plurality of frequency spectra stored in the waveform data storage unit 53. Based on the sound cycle and frequency information, a waveform data similar to the frequency spectrum based on the abnormal sound acquired by the abnormal sound diagnostic device 10 is selected and transmitted to the abnormal sound diagnostic device 10 via the communication unit 51. To do.

In the present embodiment, it is described that the abnormal sound diagnostic device 10 performs the STFT and the fast Fourier transform of the abnormal sound voice data and transmits the information on the period and frequency of the abnormal sound to the server device 50. , Fast Fourier Transform or STFT, Fast Fourier Transform may be executed on the server device 50 side.

In this case, the abnormal sound diagnostic device 10 transmits the voice data as it is to the server device 50, or the frequency spectrum waveform data as a result of performing the FTFT on the voice data is transmitted, and the voice data is transmitted in the server device 50. SFTF and fast Fourier transform will be performed on the data.

Next, the operation of the abnormal noise diagnosis system of the present embodiment will be described with reference to the sequence chart of FIG.

When the abnormal noise diagnosis device 10 attempts to perform abnormal noise diagnosis to identify the cause of abnormal noise, an image as shown in FIG. 7 is displayed and various information such as a model name, serial number, and operating state are input. (Step S101).

Then, in the abnormal noise diagnosis device 10, the operation mode is set to the voice recording mode, the microphone 17 is brought close to the abnormal noise generation portion of the image forming device 20, and the abnormal sound is recorded to acquire the voice data (step S102).

Then, in the abnormal sound diagnostic apparatus 10, the acquired voice data is settled by the frequency analysis unit 32 to generate a frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency (step S103).

As shown in FIG. 8, this FTFT is obtained by performing a Fourier transform every short time and calculating the signal intensity for each frequency component according to the time change. FIG. 9 shows an example of a waveform when the analysis result obtained by this FTFT is used as an image of one frequency spectrum waveform.

In the frequency spectrum waveform example shown in FIG. 9, the horizontal axis represents time and the vertical axis represents frequency, and the intensity of each frequency is represented by color. In FIG. 9, this difference in color is represented by a hatching pattern. Further, although FIG. 9 illustrates a case where the intensity for each frequency is expressed by color, it is also possible to express this intensity by gradation.

In the frequency spectrum waveform example of FIG. 9, it can be seen that the frequency component 61 of the abnormal sound is periodically generated at a specific frequency. In the frequency spectrum waveform example shown in FIG. 9, the low frequency component is a normal operating sound and is not a frequency component of an abnormal sound.

When the frequency spectrum waveform as shown in FIG. 9 is obtained, the control unit 33 displays the frequency spectrum waveform on the display unit 35. Then, the user who is presented with the frequency spectrum waveform identifies the frequency component 61 of the abnormal sound, and selects a region including the frequency component 61 of the abnormal sound by, for example, operating the touch panel.

An example of the selection area 80 selected by the user in this way is shown in FIG. In the example shown in FIG. 10, it can be seen that a rectangular region including a plurality of abnormal sound frequency components 61 is designated as the selection region 80.

Then, when the selection region 80 is designated in this way, the fast Fourier transform (1D-FFT) for the frequency component included in the selection region 80 is executed by the frequency analysis unit 32 (step S104). FIG. 11 shows an example of the analysis result of the fast Fourier transform executed in this way.

In FIG. 11, the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform. Since the abnormal sound contains harmonic components and the like, a plurality of cycles may be detected, but the cycle having the strongest signal strength is detected as the abnormal sound cycle.

Further, since a signal component having a long period of a predetermined period or longer is considered to be a normal operation sound or an indefinite period noise, such a long period signal component area is set as a judgment exclusion area 62 in the judgment exclusion area 62. The analysis result is ignored.

Further, since it is indistinguishable from the normal operating sound even for a low frequency signal component below a predetermined frequency, the region of such a low frequency signal component is set as a judgment exclusion region 63, and the analysis result in this judgment exclusion region 63 is It will be ignored.

Based on the analysis result of the fast Fourier transform, the abnormal noise diagnostic device 10 transmits the information on the frequency and period of the abnormal sound to the server device 50 together with the model information and the operating state information (step S105). For example, information such that the abnormal sound frequency is 4 kHz and the abnormal sound period is 2.0 seconds is transmitted to the server device 50.

Then, the server device 50 extracts the frequency spectrum waveform data corresponding to the received information by searching the waveform data storage unit 53 based on the received information (step S106).

Then, the server device 50 transmits the extracted frequency spectrum waveform data to the abnormal noise diagnostic device 10 together with information such as the original voice data, the cause of the abnormal noise, and the coping method thereof (step S107).

Then, the abnormal noise diagnostic device 10 receives the frequency spectrum waveform data transmitted from the server device 50 (step S108). Then, the control unit 33 of the abnormal noise diagnosis device 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by the FTFT on the display unit 35 (step S109).

FIG. 12 shows a screen example of the abnormal sound diagnostic apparatus 10 in which the two frequency spectrum waveforms are displayed in this way.

In the screen example shown in FIG. 12, the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as the "analysis result waveform of the abnormal sound recorded this time", and the frequency spectrum waveform transmitted from the server device 50. However, it can be seen that it is displayed as "past abnormal noise data" together with the abnormal noise cause of "wearing of the photoconductor drum".

A serviceman who intends to perform an abnormal noise diagnosis identifies the cause of the abnormal noise by comparing the two frequency spectrum waveforms and determining whether or not the abnormal noise components in the waveform are similar.

Then, in the display example shown in FIG. 12, a button "display two different sound wave shapes in an overlapping manner" is provided in the screen. Then, when the user (user) operates this button, the control unit 33 performs frequency analysis of the voice signal acquired by the voice acquisition unit 31 to obtain a frequency spectrum waveform (of the abnormal sound recorded this time). The analysis result waveform) and the frequency spectrum waveform (waveform of the past abnormal sound data) transmitted from the server device 50 are displayed by superimposing the two waveforms in a state where one of the display waveforms is transmitted.

FIG. 13 shows an example of a display screen when the two waveforms are superimposed and displayed in a state where one of the display waveforms is transmitted in this way.

In FIG. 13, in a state where the frequency spectrum waveform transmitted from the server device 50 is transmitted, the frequency spectrum waveform obtained by frequency analysis of the voice signal acquired by the voice acquisition unit 31 is superimposed on the frequency spectrum waveform. The case where it is displayed in the state is shown.

Then, in the display screen example shown in FIG. 13, it can be seen that the past different sound wave type transparency displayed in the transparent state can be specified. Further, in the display screen example shown in FIG. 13, it is possible to specify the color tone and the density when displaying the abnormal sound wave type recorded this time and the abnormal sound wave type in the past.

Based on such a designation by the user, the control unit 33 sets and displays at least one of the transparency, color, and density of the image to be displayed in the transparent state.

Further, the control unit 33 displays the display position of either the waveform of the frequency analysis result of the abnormal sound recorded this time or the waveform of the frequency analysis result of the abnormal sound acquired in the past in the time axis direction (horizontal axis direction). ) Or the frequency axis direction (vertical axis direction).

In the display screen example shown in FIG. 13, a triangle for instructing the movement in the vertical direction and the horizontal direction is displayed, and by operating this triangle, the abnormal sound displayed on the lower side and acquired this time is generated. The display position of the frequency analysis result waveform in the time axis direction or the frequency axis direction can be adjusted.

At this time, if the waveform of the frequency analysis result of the abnormal noise acquired in the past is the waveform of the abnormal noise cause in which the frequency of the generated abnormal noise does not change, the control unit 33 may display the position by the user. Even if an operation such as changing the frequency axis is performed, the display position may not be changed in the frequency axis direction.

For example, the dial tone of the charging roll, the resonance sound of the circuit board, and the like are abnormal sounds in which the frequency of the generated abnormal sound is constant and the frequency does not change. On the contrary, the abnormal noise due to self-excited vibration due to scratches on the bearing is an abnormal noise whose frequency changes because the frequency changes due to the variation in the force applied to the bearing.

It should be noted that the control unit 33 has the control unit 33, even if the waveform of the frequency analysis result of the abnormal sound acquired in the past is the waveform of the abnormal sound cause in which the frequency of the generated abnormal sound does not change. The display position may be changed only within the maximum range in which the frequency changes.

For example, when the abnormal noise caused by a certain abnormal noise cause can change only within the range of ± 2 kHz, the control unit 33 moves the waveform of the frequency analysis result to the frequency method by the operation by the user. However, the waveform of the frequency analysis result should be moved only within the range of ± 2 kHz, which is the maximum movable range.

Further, as shown in FIG. 14, the control unit 33 displays the waveform of the frequency analysis result of the past abnormal sound displayed on the upper side in the time axis direction and the frequency time direction by swiping with the user's finger 70. May be changed.

Further, the control unit 33 is a waveform of either one of the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50. When is enlarged or reduced, the other waveform is displayed enlarged or reduced so that it has the same size.

If only one of the two frequency spectrum waveforms is enlarged or reduced, it becomes impossible to compare the two frequency spectra. Therefore, in the abnormal sound diagnostic device 10 of the present embodiment, the control unit 33 has transmitted the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the server device 50. When one of the frequency spectrum waveforms is enlarged or reduced, the other waveform is enlarged or reduced so as to have the same size.

By doing so, it is not necessary to enlarge or reduce one frequency spectrum waveform and then enlarge or reduce the other frequency spectrum waveform so as to have the same size. The size of the image is the same.

Further, as shown in FIG. 15, the control unit 33 does not superimpose and display the entire waveform of the frequency analysis result of the past abnormal sound, but an image of the abnormal sound region in the waveform of the frequency analysis result of the past abnormal sound. Only the sound is extracted, and the frequency analysis result waveform obtained by frequency analysis of the sound information acquired by the sound acquisition unit 31 is transparent to the image of the abnormal sound region in the frequency analysis result waveform of the past abnormal sound. It is also possible to display them in an overlapping state.

In the display screen example shown in FIG. 15, only the image of the elliptical abnormal noise region is extracted from the waveform of the past abnormal noise analysis result, and is displayed superimposed on the waveform of the abnormal noise frequency analysis result acquired this time. The case is shown.

Here, the control unit 33 sets the color of the region where the abnormal noise region of the waveform of the frequency analysis result of the past abnormal noise and the abnormal noise region of the waveform of the frequency analysis result of the abnormal noise acquired this time overlap with another region. It may be displayed in a different color from.

For example, as shown in FIG. 16, the color of the region 93 in which the abnormal sound region 91 of the waveform of the frequency analysis result of the past abnormal sound and the abnormal sound region 92 of the waveform of the frequency analysis result of the abnormal sound acquired this time overlap is displayed. , It is displayed as a color different from the colors of the abnormal sound regions 91, 92 and the like. Specifically, when the abnormal sound region 91 of the waveform of the frequency analysis result of the past abnormal sound is yellow and the abnormal sound region 92 of the waveform of the frequency analysis result of the abnormal sound acquired this time is red, the two abnormal sound regions The color of the overlapping region 93 in which 91 and 92 overlap is displayed as blue. Further, the control unit 33 may set the color of the overlapping region 93 in which the two abnormal noise regions 91 and 92 overlap, based on the designation by the user.

By doing so, even when the cycles of the two abnormal sound regions 91 and 92 are slightly different, it is possible to easily grasp that the cycle shift gradually occurs.

Further, as shown in FIG. 17, the control unit 33 extracts the shape of the edge portion of the abnormal sound region in the waveform of the frequency analysis result of the abnormal sound in the past, and the waveform of the frequency analysis result of the abnormal sound acquired this time. In addition, an image showing the shape of the edge portion of the abnormal sound region in the waveform of the frequency analysis result of the past abnormal sound may be superimposed and displayed.

Further, as shown in FIG. 18, the control unit 33 previously generates an image showing the position of the abnormal sound region in the waveform of the frequency analysis result of the abnormal sound in the past, and the frequency analysis result of the abnormal sound acquired this time. An image showing the position of the abnormal sound region in the waveform of the frequency analysis result of the past abnormal sound may be superimposed and displayed on the waveform of.

In FIG. 18, a rectangular image with a dotted line is generated in advance as an image showing the position of the abnormal sound region in the waveform of the frequency analysis result of the past abnormal sound, and the image in the long direction by the dotted line was acquired this time. The case where it is displayed on the image of the waveform of the frequency analysis result of the abnormal sound is shown.

In addition, the control unit 33 has, in addition to the waveform of the frequency analysis result of the abnormal sound acquired this time, an image of the transmitted state obtained from the waveform of the frequency analysis result of the past abnormal sound, an image of only the abnormal sound region, A rectangular image or the like indicating the position of the abnormal sound region may be superimposed and displayed in a state of blinking at a preset time interval.

Further, as shown in FIG. 19, the control unit 33 switches between the waveform of the frequency analysis result of the abnormal noise acquired this time and the waveform of the frequency analysis result of the abnormal noise of the past this time at preset intervals. May be displayed.

In the display screen example shown in FIG. 19, the waveform of the frequency analysis result of the abnormal noise acquired this time and the waveform of the frequency analysis result of the abnormal noise of the past this time are automatically switched at 1 second intervals. Is shown when it is displayed.

In the display screen example shown in FIG. 19, the time interval for switching the display waveform can be changed by the user's operation.

In addition, the control unit 33 uses the waveform of the frequency analysis result of the abnormal sound acquired this time as an image of the transmitted state obtained from the waveform of the frequency analysis result of the past abnormal sound, an image of only the abnormal sound region, and the like. When displaying a rectangular image or the like indicating the position of the abnormal sound region in an overlapping manner, it may be displayed on the display unit 31 by switching whether or not to display in an overlapping manner based on the user's operation.

Further, as shown in FIG. 20, the control unit 33 switches between the waveform of the frequency analysis result of the abnormal noise acquired this time and the waveform of the frequency analysis result of the abnormal noise of the past this time based on the user's operation. May be displayed.

In the display screen example shown in FIG. 20, each time the user touches the button "display switching", the waveform of the frequency analysis result of the abnormal sound acquired this time and the frequency analysis result of the abnormal sound of the past this time are displayed. The case where the waveform and the waveform are alternately switched and displayed is shown.

[Modification example]
In the above embodiment, the case where the abnormal noise diagnostic device 10 is a tablet terminal device has been described, but the present invention is not limited to this, and even when another device is used as the abnormal noise diagnostic device. The present invention can be applied. For example, when the operation panel of the image forming apparatus 20 is detachable from the main body and can communicate with the server apparatus 50 and has a built-in voice signal acquisition function, the operation panel makes an abnormal noise. It may be used as a diagnostic device.

Further, in the above embodiment, the case where the abnormal sound diagnostic device 10 has a built-in microphone 17 is described. However, if the abnormal sound diagnostic device 10 is provided with a voice recording function, a collection of microphones and the like is used. A voice signal acquisition means may be realized by connecting a sound device to the outside.

Further, in the above embodiment, the case where the target device for the abnormal noise analysis is an image forming device is described, but the device to be the target of the abnormal sound analysis is not limited to the image forming device, and the period. The present invention can be similarly applied to other devices as long as they are devices that may generate abnormal noises.

10 Abnormal noise diagnostic device 11 CPU
12 Memory 13 Storage device 14 Wireless LAN interface (IF)
15 Input device 16 Display device 17 Microphone 18 Control bus 20 Image forming device 30 Wireless LAN terminal 31 Voice acquisition unit 32 Frequency analysis unit 33 Control unit 34 Voice data storage unit 35 Display unit 36 Communication unit 37 Voice playback unit 40 Internet communication network 50 Server device 51 Communication unit 52 Control unit 53 Waveform data storage unit 61 Abnormal sound frequency component 62, 63 Judgment exclusion area 70 Finger 80 Selection area 91, 92 Abnormal sound area 93 Overlapping area

Claims (18)

An acquisition method for inputting the generated sound and acquiring sound information,
A waveform of the first analysis result is the frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result The waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, and the two waveforms with one waveform transmitted. Display means to display in layers and
Diagnostic device equipped with. An acquisition method for inputting the generated sound and acquiring sound information,
The first analysis result of the waveform is a frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result Only the image of the abnormal sound region in the waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, is displayed in an overlapping state. Display means to be
Diagnostic device equipped with. An acquisition method for inputting the generated sound and acquiring sound information,
The first analysis result of the waveform is a frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result An image showing the shape of the edge part of the abnormal sound region in the waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, is superimposed and displayed. Display means to be
Diagnostic device equipped with. An acquisition method for inputting the generated sound and acquiring sound information,
The first analysis result of the waveform is a frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result A display means for superimposing and displaying an image showing the position of the abnormal sound region in the waveform of the second analysis result, which is a past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound. When,
Diagnostic device equipped with. Any of claims 1 to 4, wherein the display means superimposes an image obtained from the waveform of the second analysis result on the waveform of the first analysis result in a state of blinking at preset intervals. The diagnostic device described. The diagnosis according to any one of claims 1 to 4, wherein the display means superimposes an image obtained from the waveform of the second analysis result on the waveform of the first analysis result based on the operation of the user. apparatus. An acquisition method for inputting the generated sound and acquiring sound information,
A waveform of the first analysis result is the frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result A display means for switching and displaying the waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, at preset intervals. ,
Diagnostic device equipped with. An acquisition method for inputting the generated sound and acquiring sound information,
A waveform of the first analysis result is the frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result A display means for switching and displaying the waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, based on the operation of the user. When,
Diagnostic device equipped with. The diagnostic apparatus according to claim 1 or 2, further comprising a setting means for setting at least one of transparency, color, and density of an image to be displayed in a transparent state. The display means sets the color of the region where the abnormal sound region of the waveform of the first analysis result and the abnormal sound region of the waveform of the second analysis result overlap, and the abnormal sound of the waveform of the first and second analysis results. The diagnostic device according to claim 2, wherein the color is displayed as a color different from the color of the area. The diagnostic apparatus according to claim 10, further comprising a setting means for setting a color of a region where the abnormal noise region of the waveform of the first analysis result and the abnormal noise region of the waveform of the second analysis result overlap. Claim 1 further provided with a changing means for changing the display position of either the displayed waveform of the first analysis result or the image obtained from the waveform of the second analysis result in the time axis direction or the frequency axis direction. The diagnostic apparatus according to any one of. 12. The change means according to claim 12, wherein when the waveform of the second analysis result is a waveform of the cause of abnormal noise in which the frequency of the generated abnormal noise does not change, the display position is not changed in the frequency axis direction. Diagnostic device. When the waveform of the second analysis result is a waveform causing abnormal noise in which the frequency of the generated abnormal noise changes, the changing means requests that the display position be changed within the range in which the frequency of the generated abnormal noise changes. Item 12. The diagnostic device according to item 12. When either one of the first analysis result and the image obtained from the second analysis result displayed on the display means is enlarged or reduced, the display means makes the other waveform or image equivalent. The diagnostic device according to any one of claims 1 to 14, which is enlarged or reduced so as to have a large size. A frequency analysis means that performs time-frequency analysis of the sound information acquired by the acquisition means and generates frequency spectrum waveform data of the first analysis result.
Communication means for communicating with external devices and
Information on the period and frequency of a frequency component that seems to be an abnormal sound extracted based on the frequency spectrum waveform of the first analysis result obtained by the frequency analysis means is transmitted to an external device via the communication means. Transmission means and
The diagnostic apparatus according to any one of claims 1 to 15, further comprising a receiving means for receiving the second analysis result corresponding to the first analysis result from an external device via the communication means. A first analysis result which is a frequency spectrum waveform representing a time change of an intensity distribution for each frequency obtained by performing a time- frequency analysis of the acquired sound information and an acquisition means for inputting the generated sound and acquiring sound information. And the waveform of the second analysis result which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component which seems to be an abnormal sound extracted based on the frequency spectrum waveform of the first analysis result. A diagnostic device equipped with a display means for displaying two waveforms in an overlapping state with one waveform transmitted through, and
A storage means for storing a plurality of second analysis results obtained by performing frequency analysis of past abnormal sound sound information, and an abnormal sound extracted from the diagnostic apparatus based on the frequency spectrum waveform of the first analysis result. When information on the period and frequency of a frequency component that seems to exist is received, an analysis result similar to the received first analysis result is selected from the plurality of second analysis results stored in the storage means. A server device including a second transmission means for transmitting to the diagnostic device, and
Diagnostic system with. The acquisition step of inputting the generated sound and acquiring the sound information,
A waveform of the first analysis result is the frequency spectrum waveform representing a time change in the intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information, based on the frequency spectrum waveform of the first analysis result The waveform of the second analysis result, which is the past frequency spectrum waveform corresponding to the period and frequency information of the frequency component that seems to be the extracted abnormal sound, and the two waveforms with one of the waveforms transmitted through. A program that allows a computer to perform overlapping display steps.