JP2018048885A - Diagnostic device, diagnostic system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display, in acquiring sound information, performing frequency analysis, and determining a sound included in the information, while switching between analysis result screens on which the sound included in the information can be easily determined according to the type of the sound.SOLUTION: A frequency analysis part 32 performs time-frequency analysis of sound information acquired by a sound acquisition part 31 to create a frequency spectrum waveform (STFT analysis result), and performs frequency analysis again on a frequency component included in an area designated by a user in the frequency spectrum waveform to obtain an analysis result indicating information on the cycle and frequency of an abnormal noise (1D-FFT analysis result). A control part 33 displays, while switching between, an STFT analysis result screen and a 1D-FFT analysis result screen according to the user's operation.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a diagnostic device, a diagnostic system, and a program.

  Patent Document 1 has a RAM or ROM that stores a normal operation sound of the image forming apparatus and a microphone that detects an operation sound generated from the image forming apparatus, and is stored in the RAM or ROM. A system is disclosed that identifies an abnormal part of an image forming apparatus based on first sound information, second sound information detected by a microphone, and operation information of the image forming apparatus.

  In Patent Document 2, in an image processing apparatus having an image forming unit that forms an image on printing paper and a transport unit that transports the printing paper, a sound conversion unit that converts sound inside the device into an electrical signal, An image processing apparatus including a sound analysis unit that analyzes an electrical signal converted by a sound conversion unit to obtain a component for each frequency and an output unit that outputs a component for each frequency obtained by the sound analysis unit is disclosed. Yes.

JP 2007-079263 A1 JP 2008-290288 A

  When an abnormal sound (abnormal sound) occurs in a certain device, the sound generated in the device to be analyzed is input to obtain a sound signal, and the sound signal and the device that is equivalent to the device to be analyzed are generated in the past There is a case where the cause of the abnormal noise is clarified by comparing with the abnormal audio signal.

  In such a case, by performing a time-frequency analysis of the acquired sound information, a frequency spectrum waveform representing a time change of the signal intensity distribution for each frequency is obtained, and an area including abnormal sounds in the frequency spectrum waveform is obtained. By performing frequency analysis again, information on the period and frequency of the abnormal sound included in the frequency spectrum waveform is obtained. Then, based on the information on the period and frequency of the obtained abnormal sound, the frequency spectrum waveform of the sound information acquired this time is compared with the frequency spectrum waveform of the abnormal sound that has occurred in the past. We are elucidating.

  However, for an inexperienced user, when the abnormal sound is a periodic sound, it is difficult to determine which region in the frequency spectrum waveform contains the abnormal sound. Even in such a case, if the abnormal sound is a periodic sound, it is relatively easy to determine the abnormal sound on a screen that displays information on the period and frequency of the abnormal sound.

  Conversely, when the abnormal sound is a continuous sound, it is relatively easy to determine in which region the abnormal sound is included on the frequency spectrum waveform. However, if the abnormal sound is a continuous sound, it is difficult to distinguish it from normal operation sound and non-periodic noise on the screen displaying the period and frequency information of the abnormal sound. Is difficult.

  An object of the present invention is to provide a diagnostic apparatus capable of switching and displaying an analysis result screen that is easy to discriminate according to the type of sound when obtaining sound information and performing frequency analysis to discriminate the included sound, To provide a diagnostic system and program.

[Diagnostic equipment]
The present invention according to claim 1 is an acquisition means for acquiring sound information by inputting a generated sound;
A first screen displaying a frequency spectrum waveform representing a time change of a signal intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information; and the frequency by analyzing the frequency spectrum waveform. It is a diagnostic apparatus provided with the display means which switches and displays the 2nd screen which showed the information of the period and frequency of the sound contained in a spectrum waveform according to a user's operation.

  The present invention according to claim 2 is the diagnostic apparatus according to claim 1, wherein the display unit displays the first screen when the user selects to refer to the analysis result of the continuous sound.

  The present invention according to claim 3 is the diagnostic apparatus according to claim 1, wherein the display unit displays the second screen when the user selects to refer to the analysis result of the periodic sound.

  According to a fourth aspect of the present invention, the display means displays the first and second screens in parallel, and when any of the first and second screens displayed in parallel is selected. The diagnostic device according to any one of claims 1 to 3, wherein the selected screen is displayed.

  The present invention according to claim 5 generates a frequency spectrum waveform by performing time-frequency analysis of the sound information acquired by the acquisition means, and includes frequency components included in a region designated by a user in the frequency spectrum waveform. The diagnostic apparatus according to any one of claims 1 to 4, further comprising a frequency analysis unit that performs a frequency analysis on the frequency.

  According to a sixth aspect of the present invention, when the display means designates a plurality of regions in the frequency spectrum waveform, the period and frequency obtained by performing frequency analysis on frequency components included in each region. The diagnostic apparatus according to claim 5, wherein the information is displayed on the second screen by different methods.

  In the present invention according to claim 7, when the display means repeatedly designates a plurality of regions in the frequency spectrum waveform, the period obtained by performing frequency analysis on the frequency component included in each region and 6. The diagnostic apparatus according to claim 5, wherein the frequency information is displayed on the second screen so that a designated order can be understood.

The present invention according to claim 8 includes communication means for communicating with an external device;
Transmitting means for transmitting information on the period and frequency selected by the user from the plurality of periods and frequency information displayed on the second screen to the external device via the communication means;
Receiving means for receiving a registered frequency spectrum waveform corresponding to the period and frequency information transmitted by the transmitting means from the external device via the communication means;
The diagnostic device according to claim 6 or 7, wherein the display unit displays the registered frequency spectrum waveform received by the receiving unit and the frequency spectrum waveform generated by the frequency analyzing unit side by side.

According to a ninth aspect of the present invention, there is provided an acquisition means for acquiring sound information by inputting a generated sound, and a time change of a signal intensity distribution for each frequency obtained by performing a time-frequency analysis of the acquired sound information. The first screen displaying the represented frequency spectrum waveform and the second screen showing information on the period and frequency of the sound included in the frequency spectrum waveform by performing frequency analysis on the frequency spectrum waveform are operated by the user. Display means for switching according to the time, and the time spectrum analysis of the sound information acquired by the acquisition means is performed to generate the frequency spectrum waveform, which is included in the region specified by the user in the frequency spectrum waveform A frequency analysis means for performing frequency analysis on the frequency component, a communication means for performing communication with an external device, and a copy displayed on the second screen. The first transmission means for transmitting the period and frequency information selected by the user to the external device via the communication means and the first transmission means A diagnostic device comprising receiving means for receiving a registered frequency spectrum waveform corresponding to the period and frequency information from an external device via the communication means;
Storage means for storing a plurality of frequency spectrum waveforms obtained by performing frequency analysis of sound information of abnormal sound, and when receiving information on sound period and frequency from the diagnostic device, the storage means stores the information Diagnosis comprising a server device comprising: a second transmission means for selecting a frequency spectrum waveform corresponding to the received sound period and frequency information from a plurality of frequency spectrum waveforms and transmitting the selected waveform to the diagnosis device System.

[program]
The present invention according to claim 10 is an acquisition step of acquiring sound information by inputting the generated sound;
A first screen displaying a frequency spectrum waveform representing a time change of a signal intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information; and the frequency by analyzing the frequency spectrum waveform. It is a program for causing a computer to execute a display step of switching and displaying a second screen showing information on the period and frequency of a sound included in a spectrum waveform in accordance with a user operation.

  According to the first to third aspects of the present invention, when sound information is acquired and frequency analysis is performed to determine a sound to be included, an analysis result screen that can be easily determined according to the type of sound is switched and displayed. It is possible to provide a diagnostic apparatus that can

  According to the present invention of claim 4, the display screen is switched between the parallel display of two types of analysis result screens and the display of only one of the analysis result screens, and sound information is acquired to perform frequency analysis. Therefore, it is possible to provide a diagnostic device capable of switching and displaying an analysis result screen that can be easily discriminated in accordance with the type of sound when discriminating included sounds.

  According to the fifth aspect of the present invention, it is possible to provide a diagnostic apparatus that can acquire two types of analysis results from the acquired sound information.

  According to the sixth aspect of the present invention, in the frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency, a plurality of regions are designated, and the period and frequency analysis of the frequency components included in each region are performed. A diagnostic apparatus capable of acquiring the result can be provided.

  According to the present invention of claim 7, in the frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency, the designation of the region is repeated a plurality of times, and the period and frequency of the frequency component contained in each region are repeated. It is possible to provide a diagnostic apparatus capable of acquiring an analysis result.

  According to the present invention of claim 8, there is provided a diagnostic device capable of acquiring a registered frequency spectrum waveform corresponding to the acquired sound information and displaying it side by side with the frequency waveform of the acquired sound information. be able to.

  According to the present invention of claim 9, when sound information is acquired and frequency analysis is performed to determine a sound to be included, an analysis result screen that can be easily determined according to the type of sound can be switched and displayed. Possible diagnostic systems can be provided.

  According to the tenth aspect of the present invention, when sound information is acquired and frequency analysis is performed to determine a sound to be included, an analysis result screen that can be easily determined according to the type of sound can be switched and displayed. Possible programs can be provided.

It is a system diagram showing a configuration of an abnormal sound diagnosis system of one embodiment of the present invention. It is a block diagram which shows the hardware constitutions of the abnormal sound diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the function structure of the abnormal sound diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the function structure of the server apparatus 50 in one Embodiment of this invention. It is a figure which shows an example of the information stored in the waveform data storage part 53 in FIG. It is a sequence chart for demonstrating operation | movement of the abnormal sound diagnostic system of one Embodiment of this invention. It is a figure which shows the example of a display screen of the abnormal sound diagnostic apparatus 10 at the time of inputting various information, such as a model name, a serial number, and an operation state. It is a figure for demonstrating the concept of STFT. It is a figure which shows the example of an image of the frequency spectrum waveform based on the analysis result obtained by STFT. It is a figure which shows an example of the selection area | region 80 selected by the user in the image example of the frequency spectrum waveform of FIG. It is a figure which shows the example of an analysis result of a fast Fourier transform. It is a figure which shows the example of a screen of the abnormal sound diagnostic apparatus 10 by which two frequency spectrum waveforms were displayed. It is a figure which shows the example of an image of the frequency spectrum waveform at the time of actually performing the frequency analysis result of unusual sound. It is a figure which shows the example of a STFT analysis result screen in case an unusual sound is a continuous sound. It is a figure which shows the example of a 1D-FFT analysis result screen in case an unusual sound is a periodic sound. It is a figure which shows the example of a 1D-FFT analysis result screen in case an unusual sound is a continuous sound. It is a figure which shows the example of a screen at the time of displaying a STFT analysis result screen and a 1D-FFT analysis result screen in parallel. It is a figure which shows the case where a STFT analysis result screen is displayed. It is a figure which shows the case where a 1D-FFT analysis result screen is displayed. It is a figure for demonstrating a mode that display switching is performed between three display modes. It is a figure for demonstrating a mode that the analysis result with respect to the selection area | region 80 and the analysis result with respect to another area | region are displayed with a different display method. It is a figure for demonstrating a mode that the analysis result in the 1st selection area | region 81 and the analysis result in the 2nd selection area | region 82 are each displayed by a different display method in a STFT analysis result screen. It is a figure for demonstrating a mode that the analysis result in each area | region is displayed with a different display method, when a some area | region is designated in the STFT analysis result screen.

  Next, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a system diagram showing a configuration of an abnormal sound diagnosis system according to an embodiment of the present invention.

  As shown in FIG. 1, the abnormal sound diagnosis system according to an embodiment of the present invention includes a portable abnormal sound diagnosis device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50. .

  The present invention is applicable to any abnormal sound diagnosis apparatus 10 as long as it is an apparatus that can be connected to the server apparatus 50 via a communication network. However, in the present embodiment, the abnormal sound diagnosis device 10 will be described using a case of a tablet terminal device including a device such as a microphone capable of acquiring an audio signal and a touch panel capable of touch input.

  The abnormal sound diagnosis apparatus 10 is carried by a service person (maintenance personnel) who performs maintenance management, repair, etc. of the image forming apparatus 20 such as a printer used by an end user, and generates abnormal noise (abnormality) generated in the image forming apparatus 20. Sound) signal and frequency analysis of the acquired abnormal noise signal, or a waveform of the frequency analysis result of the past abnormal noise signal acquired from the server device 50 and the frequency analysis result of the acquired abnormal noise signal. Used to display waveforms.

  The abnormal sound diagnosis apparatus 10 and the server apparatus 50 are connected via a wireless LAN terminal 30 such as a Wi-Fi router or the Internet communication network 40 to transmit and receive information.

  When the abnormal sound diagnosis device 10 is a mobile phone device, a smartphone, or the like, the abnormal sound diagnosis device 10 and the server device 50 are connected via a mobile phone line network to transmit / receive defect information. It is also possible.

  In the abnormal sound diagnosis system of the present embodiment, when an abnormal sound occurs in the image forming apparatus 20 that is a target electronic device installed at the end user's location, a service person carries the abnormal sound diagnosis apparatus 10 and the image forming apparatus. Go to 20 places. And this service person acquires the abnormal sound signal by recording the abnormal sound generated using the abnormal sound diagnosis apparatus 10, and performs the abnormal sound diagnosis for specifying the cause of the abnormal sound.

  Although it is technically possible to provide a recording function by providing a microphone or the like in the image forming apparatus 20 and when the abnormal sound is generated, the abnormal sound is recorded by the recording function. When installed in an end user's office or the like, it is impossible to provide the image forming apparatus 20 with a sound recording function for security reasons.

  Next, FIG. 2 shows a hardware configuration of the abnormal sound diagnosis apparatus 10 in the abnormal sound diagnosis system of the present embodiment.

  As shown in FIG. 2, the abnormal sound diagnosis apparatus 10 performs wireless communication with the CPU 11, a memory 12 that can temporarily store data, a storage device 13 such as a flash memory, and a wireless LAN terminal 30 to perform data communication. A wireless LAN interface (IF) 14 that performs transmission and reception, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. These components are connected to each other via a control bus 18.

  In the abnormal sound diagnosis apparatus 10 of the present embodiment, a touch panel provided with a touch sensor for detecting a touch position as the input device 15 is provided on the display device 16, and display is performed using this touch panel. Input from the user is made.

  The CPU 11 executes a predetermined process based on a control program stored in the memory 12 or the storage device 13 to control the operation of the abnormal sound diagnosis apparatus 10. The control program can be obtained by downloading via the Internet communication network 40 or the mobile phone network and provided to the CPU 11, or the program can be stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.

  The abnormal sound diagnosis apparatus 10 of the present embodiment performs an operation as described below by executing the above control program, thereby assisting a service person in identifying the cause of the abnormal sound.

  FIG. 3 is a block diagram showing a functional configuration of the abnormal sound diagnosis apparatus 10 realized by executing the control program.

  As shown in FIG. 3, the abnormal sound diagnosis apparatus 10 of the present embodiment includes an audio acquisition unit 31, a frequency analysis unit 32, a control unit 33, an audio data storage unit 34, a display unit 35, and a communication unit. 36 and an audio reproduction unit 37.

  The display unit 35 displays various data based on the control by the control unit 33. The communication unit 36 communicates with the server device 50 that is an external device. Based on the control by the control unit 33, the audio reproduction unit 37 reproduces the recorded audio data and converts it into an audio signal.

  The sound acquisition unit 31 inputs an abnormal sound generated in the image forming apparatus 20 which is an analysis target apparatus and acquires a sound signal.

  In the present embodiment, the sound acquisition unit 31 has been described as acquiring an audio signal by inputting an abnormal sound generated in the image forming apparatus 20, but the sound is an example of a sound. The signal is an example of sound information.

  The frequency analysis unit 32 performs time frequency analysis (time-dependent frequency analysis) of the audio signal acquired by the audio acquisition unit 31, and represents a time change of the signal intensity distribution for each frequency of the acquired abnormal sound signal. Spectral waveform data (first analysis result) is generated. The frequency spectrum waveform data is an analysis result obtained by performing frequency analysis.

  Specifically, the frequency analysis unit 32 generates frequency spectrum waveform data by performing STFT (Short time Fourier transform) on the audio signal acquired by the audio acquisition unit 31. The description of this STFT will be described later.

  The control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the audio data storage unit 34 together with the audio data.

  In addition, the control unit 33 performs fast Fourier transform (1D-FFT) that performs frequency analysis in the time axis direction on a frequency component estimated to be abnormal sound in the frequency spectrum waveform data obtained by the frequency analysis unit 32. (Fast Fourier Transform)) is instructed to the frequency analysis unit 32.

  Here, the control unit 33 may extract a signal component having periodicity from the frequency spectrum waveform data, and select the signal component as a signal component that is highly likely to be abnormal sound. . In addition, the control unit 33 displays the obtained frequency spectrum waveform data on the display unit 35, and designates a frequency component that is highly likely to be abnormal by the user who viewed the frequency spectrum waveform. The component may be selected as a signal component that is highly likely to be an abnormal sound.

  Then, the frequency analysis unit 32 performs fast Fourier transform in the time axis direction on the frequency component estimated to be abnormal sound based on the instruction from the control unit 33.

  Then, the control unit 33 acquires the period and frequency information of the abnormal sound based on the analysis result of the fast Fourier transform in the frequency analysis unit 32.

  In addition, the control unit 33 uses the acquired period and frequency information of the abnormal sound as well as the model name of the image forming apparatus 20, model information such as a serial number, and operation state information indicating the operation state of the image forming apparatus 20. To the server device 50 via Specifically, this operation status information includes information such as color printing or monochrome printing, duplex printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included. In this way, the control unit 33 transmits information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server device 50 via the communication unit 36.

  In the server device 50, the original sound data and the sound data are acquired from the spectrum waveform data obtained by performing frequency analysis of the sound signal of the abnormal sound that has occurred in the past in the same device as the image forming device 20. Together with information such as the operating state of the device, the cause of the abnormal noise, and how to deal with the abnormal noise.

  And the server apparatus 50 uses the frequency spectrum waveform data (corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 based on the period and frequency information of the abnormal sound transmitted from the abnormal sound diagnosis apparatus 10. The second analysis result) is searched, and the found frequency spectrum waveform data is transmitted to the abnormal sound diagnosis apparatus 10 together with information such as sound data stored as abnormal sample waveform data.

  As a result, the control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.

  The control unit 33 displays the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the spectrum waveform received from the server device 50 on the display unit 35 in parallel.

  At this time, the control unit 33 at least one of the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50. The display content is changed in the time axis direction indication based on the operation of the user (user).

  Note that the control unit 33 matches the frequency waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 with the periodic waveform in the frequency spectrum waveform transmitted from the server device 50. In addition, the display content in the time axis direction of at least one of the two frequency spectrum waveforms may be changed.

  Here, a specific example of changing the display content of the frequency spectrum waveform in the time axis direction is to change the display position of the frequency spectrum waveform in the time axis direction.

  Note that one of the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50 is the other waveform. It is set to have a longer waveform.

  As an example, in the present embodiment, the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 is data for about 10 seconds and is transmitted from the server device 50. The frequency spectrum waveform is about 8 seconds of data.

  In addition, when there are a plurality of frequency spectrum waveform data transmitted from the server device 50, the control unit 33 includes the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 among the plurality of frequency spectrum waveform data. Are displayed on the display unit 33 with priority.

  Further, the control unit 33 is one of the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50. When one of the waveforms is enlarged or reduced, the other waveform is enlarged or reduced so as to have the same size.

  Further, the control unit 33 acquires the process speed (image forming speed) of the image forming apparatus 20 when the abnormal sound waveform is acquired and the image forming apparatus when the frequency spectrum waveform transmitted from the server apparatus 50 is acquired. If the process speeds are different from each other, the length of the frequency spectrum waveform transmitted from the server device 50 in the time axis direction may be expanded or reduced based on the two process speeds.

  This is because when the process speed changes, the period of the generated abnormal noise also changes. Also, acquiring and preparing abnormal sound data for each of a plurality of process speeds increases the amount of data and the trouble of acquiring abnormal sound data.

  In addition, when the user instructs the reproduction of the audio data, the audio reproduction unit 37 performs the audio data acquired by the audio acquisition unit 31 and the frequency transmitted from the server device 50 based on the control from the control unit 33. Audio data corresponding to the spectrum waveform may be reproduced as a stereo reproduction left signal and right signal, respectively.

  Further, in order to facilitate the comparison of the two frequency spectrum waveforms, the control unit 33 can adjust an adjustable frequency auxiliary line indicating the same frequency on the two frequency spectrum waveforms displayed in parallel or the time axis direction. An adjustable common time axis auxiliary line for comparing the positions may be displayed in an overlapping manner.

  Next, the functional configuration of the server device 50 in the abnormal sound analysis system of this embodiment will be described with reference to the block diagram of FIG.

  As shown in FIG. 4, the server device 50 according to the present embodiment includes a communication unit 51, a control unit 52, and a waveform data storage unit 53.

  The waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of an audio signal of abnormal sound that has occurred in the past in an apparatus equivalent to the image forming apparatus 20 that is an analysis target apparatus.

  Specifically, as shown in FIG. 5, the waveform data storage unit 53 includes frequency spectrum waveform data obtained by analyzing time-frequency analysis of abnormal sound data acquired in advance and the original sound. Information such as data, causes of abnormal noise, and countermeasures are stored for each model.

  Then, when the control unit 52 receives the abnormal sound period or frequency information from the abnormal sound diagnosis apparatus 10, the control unit 52 receives the received abnormal noise data from the waveform data of the plurality of frequency spectra stored in the waveform data storage unit 53. Based on the information of the sound period and frequency, the one similar to the waveform data of the frequency spectrum based on the abnormal sound acquired in the abnormal sound diagnosis apparatus 10 is selected and transmitted to the abnormal sound diagnosis apparatus 10 via the communication unit 51. To do.

  In the present embodiment, the abnormal sound diagnosis apparatus 10 performs STFT and fast Fourier transform on abnormal sound data, and transmits the period and frequency information of the abnormal sound to the server device 50. The fast Fourier transform, STFT, or fast Fourier transform may be executed on the server device 50 side.

  In this case, the audio data is transmitted as it is from the abnormal sound diagnosis apparatus 10 to the server apparatus 50, or the frequency spectrum waveform data obtained as a result of performing STFT on the audio data is transmitted. STFT or fast Fourier transform is performed on the.

  Next, the operation of the abnormal sound diagnosis system of this embodiment will be described with reference to the sequence chart of FIG.

  When the abnormal sound diagnosis apparatus 10 performs an abnormal sound diagnosis for specifying the cause of the abnormal sound, an image as shown in FIG. 7 is displayed and various types of information such as the model name, serial number, and operating state are input. (Step S101).

  Then, the abnormal sound diagnosis apparatus 10 sets the operation mode to the voice recording mode, records the abnormal sound by bringing the microphone 17 close to the abnormal sound generation location of the image forming apparatus 20, and acquires the voice data (step S102).

  Then, in the abnormal sound diagnosis apparatus 10, the acquired voice data is subjected to STFT in the frequency analysis unit 32, thereby generating a frequency spectrum waveform representing a time change of the signal intensity distribution for each frequency (step S103).

  As shown in FIG. 8, the STFT is obtained by performing Fourier transform every short time and calculating the signal intensity for each frequency component according to the time change. FIG. 9 shows a waveform example when the analysis result obtained by this STFT is an image of one frequency spectrum waveform.

  In the frequency spectrum waveform example shown in FIG. 9, the horizontal axis represents time, the vertical axis represents frequency, and the intensity for each frequency is represented by color. In FIG. 9, this color difference is expressed by a hatching pattern. Further, FIG. 9 illustrates the case where the intensity for each frequency is expressed by color, but it is also possible to express this intensity by gradation.

  In the frequency spectrum waveform example of FIG. 9, it can be seen that the abnormal frequency component 61 is periodically generated at a specific frequency. In the example of the frequency spectrum waveform shown in FIG. 9, the low frequency component is a normal operation sound and not an abnormal frequency component.

  When the frequency spectrum waveform as shown in FIG. 9 is obtained, the control unit 33 displays the frequency spectrum waveform on the display unit 35. Then, the user who is presented with the frequency spectrum waveform specifies the abnormal frequency component 61, and selects a region including the abnormal frequency component 61 by operating the touch panel, for example.

  An example of the selection area 80 selected by the user in this way is shown in FIG. In the example shown in FIG. 10, it can be seen that a rectangular region including a plurality of abnormal frequency components 61 is designated as the selection region 80.

  When the selection area 80 is designated in this way, the fast Fourier transform (1D-FFT) for the frequency components included in the selection area 80 is executed by the frequency analysis unit 32 (step S104). FIG. 11 shows an analysis result example (1D-FFT analysis result screen example) of the fast Fourier transform executed as described above.

  In FIG. 11, the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform. In addition, since an overtone component etc. are contained in abnormal sound, a some period may be detected, but the period with the strongest signal strength is detected as an abnormal sound period.

  In addition, since a signal component having a long period of a predetermined period or more is considered to be normal operation sound or indefinite period noise, such a long-cycle signal component region is set as a determination exclusion region 62 in the determination exclusion region 62. Analysis results are ignored.

  Furthermore, since the low frequency signal component below the predetermined frequency cannot be distinguished from the normal operation sound, such a low frequency signal component region is set as the determination exclusion region 63, and the analysis result in the determination exclusion region 63 is as follows. It will be ignored.

  The abnormal sound diagnosis apparatus 10 transmits the frequency and period information of the abnormal sound together with the model information and the operation state information to the server apparatus 50 based on the analysis result of the fast Fourier transform (step S105). For example, information such as the abnormal sound frequency of 4 kHz and the abnormal sound period of 2.0 seconds is transmitted to the server device 50.

  Then, the server apparatus 50 extracts the data of the frequency spectrum waveform corresponding to the received information by searching the waveform data storage unit 53 based on the received information (step S106).

  Then, the server device 50 transmits the extracted frequency spectrum waveform data to the abnormal sound diagnosis device 10 together with information such as the original voice data, the cause of abnormal noise, and a countermeasure method thereof (step S107).

  Then, the abnormal sound diagnosis apparatus 10 receives the frequency spectrum waveform data transmitted from the server apparatus 50 (step S108). Then, the control unit 33 of the abnormal sound diagnosis apparatus 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by the STFT on the display unit 35 (step S109).

  FIG. 12 shows a screen example of the abnormal sound diagnosis apparatus 10 on which two frequency spectrum waveforms are displayed in this way.

  In the screen example shown in FIG. 12, the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as “analysis result waveform of unusual sound recorded this time” and transmitted from the server device 50. However, it can be seen that “Past abnormal noise data” is displayed together with the cause of abnormal noise “Abrasion of photosensitive drum”.

  A serviceman who wants to perform abnormal noise diagnosis compares the two frequency spectrum waveforms and determines whether or not the abnormal noise components in the waveforms are similar, thereby identifying the cause of the abnormal noise.

  Further, when a plurality of frequency spectrum waveforms are transmitted from the server device 50, for example, by tracing a frequency spectrum waveform image displayed as “past abnormal sound data” in the horizontal direction by a touch operation, Another frequency spectrum waveform is displayed.

  When a plurality of frequency spectrum waveforms are transmitted in this way, the service person determines whether the frequency spectrum waveform of the abnormal sound acquired this time is more similar to which frequency spectrum waveform is abnormal. Identify the cause of When identifying the cause of this abnormal noise, not only simply comparing the shape of the frequency spectrum waveform, the period or frequency of the abnormal noise component, but also reproducing the original audio data by the audio reproducing unit 37 The cause of the abnormal noise is identified by comparing the acquired abnormal noise with the voice corresponding to the frequency spectrum waveform transmitted from the server device 50.

  However, there are various types of abnormal sounds generated in the image forming apparatus 20, and when an actually generated abnormal sound is recorded and analyzed, it is determined which frequency component is abnormal on the analysis result screen. It may be difficult to do. In particular, in the case of a user who has little experience in determining the cause of abnormal noise, it may not be possible to determine in which region the abnormal noise is contained even if the frequency spectrum screen is referred to.

  Specifically, in FIG. 9 and FIG. 10, for simplification of explanation, the case where the frequency component 61 of abnormal noise is clearly distinguishable with a color different from other frequency components is shown as an example. When an abnormal sound frequency analysis result is actually performed, for example, as shown in FIG. 13, it is often difficult to distinguish from other frequency components.

  In the STFT analysis result screen as shown in FIG. 13, the signal intensity level is indicated by color. When the abnormal sound component and the sound component other than the abnormal sound are displayed in the same color, the frequency of the abnormal sound is displayed. In some cases, it is difficult to distinguish the component 91 from the frequency components of sounds other than abnormal sounds.

  Note that FIG. 13 shows an example of a display screen when the abnormal sound is a periodic sound that occurs at a constant period, but FIG. 14 shows an example of a display screen when the abnormal sound is a continuous sound.

  FIG. 14 shows a case where an abnormal sound frequency component 92 which is a continuous sound is displayed on the STFT analysis result screen. As shown in FIG. 14, when the abnormal sound is a continuous sound, it is often easier to distinguish it from the frequency components of other sounds than when the abnormal sound is a periodic sound.

  Next, FIG. 15 and FIG. 16 show examples of 1D-FFT analysis result screens when the abnormal sound is a periodic sound and when it is a continuous sound.

  FIG. 15 is an example of a 1D-FFT analysis result screen when the abnormal sound is a periodic sound, and it can be seen that it is easier to discriminate compared to the STFT screen when the frequency component 93 of the periodic abnormal sound is present. .

  FIG. 16 is an example of a 1D-FFT analysis result screen when the abnormal sound is a continuous sound. The frequency component 94 of the abnormal sound that is a continuous sound is shown by one point, and the analysis result is expressed by a normal operation sound or indefinite period noise. It can be seen that it is included in the determination exclusion area 62 that cannot be referred to. That is, when the sound is actually recorded and analyzed, it is difficult to determine the abnormal sound component of the continuous sound on the 1D-FFT analysis result screen.

  Therefore, in the abnormal sound diagnosis apparatus 10 of the present embodiment, the control unit 33 displays the STFT analysis result screen and the 1D-FFT analysis result screen in parallel as shown in FIG.

  Then, the control unit 33 displays the selected analysis result screen when one of the STFT analysis result screen and the 1D-FFT analysis result screen displayed in parallel is selected.

  For example, FIG. 17 shows a case where the STFT analysis result screen is selected by the finger 70. In such a case, the STFT analysis result screen is displayed as shown in FIG.

  When the button “go to continuous sound analysis screen” is selected with the finger 70 on the STFT analysis result screen shown in FIG. 18, a 1D-FFT analysis result screen is displayed as shown in FIG.

  In addition, when the button “go to periodic sound analysis screen” is selected with the finger 70 on the 1D-FFT analysis result screen shown in FIG. 19, an STFT analysis result screen as shown in FIG. 18 is displayed.

  As described above, in the abnormal sound diagnosis apparatus 10 of the present embodiment, the control unit 33 generates a frequency spectrum waveform representing a time change of the signal intensity distribution for each frequency obtained by performing the time-frequency analysis of the acquired sound information. Switching between the STFT analysis result screen to be displayed and the 1D-FFT analysis result screen showing the frequency and frequency information of the sound included in the frequency spectrum waveform by frequency analysis of the frequency spectrum waveform according to the operation of the user To display.

  That is, the control unit 33 displays the STFT analysis result screen on the display unit 35 when the user selects to refer to the continuous sound analysis result. Then, the control unit 33 displays a 1D-FFT analysis result screen when the user selects to refer to the periodic sound analysis result.

  Here, the case where the user selects that he / she wants to refer to the analysis result of continuous sound is not only the case where the expression “continuous sound” is explicitly expressed, but also other expressions such as “continuous sound”, It also includes the case where an onomatopoeia expression such as “Bee” or “Boo” is selected. That is, the case where the expression similar to the continuous sound other than the expression “continuous sound” is selected is included.

  Similarly, the case where the user selects that he / she wants to refer to the analysis result of the periodic sound is not only the case where the expression “periodic sound” is explicitly expressed, but also other expressions such as “intermittent sound”, “ It also includes cases in which onomatopoeic expressions such as “Gongongon” and “Tonton” are selected. That is, the case where the expression similar to the periodic sound other than the expression “periodic sound” is selected is included.

  Further, in either of the screens of FIG. 18 and FIG. 19, when the button “Return to 2-screen display” is selected, a screen in which two analysis results are arranged in parallel as shown in FIG. Will be displayed.

  That is, as shown in FIG. 20, a two-screen display mode in which two analysis results are displayed in parallel, a STFT analysis result screen display mode in which an STFT analysis result screen is displayed, and a 1D-FFT analysis result screen in 1D- The display is switched between three display modes called the FFT analysis result screen display mode.

  The frequency analysis unit 32 performs time-frequency analysis of the sound information acquired by the sound acquisition unit 31 to generate a frequency spectrum waveform (STFT analysis result), and is included in the region specified by the user in the frequency spectrum waveform. The frequency analysis is performed again on the frequency components to be obtained to obtain information on the period and frequency of the abnormal sound. Then, the control unit 33 displays the obtained abnormal sound period and frequency information on the display unit 35 as a 1D-FFT analysis result screen.

  At that time, in FIGS. 10 and 11, the 1D-FFT analysis is performed only on the frequency components included in the selection region 80, but 1D is also performed on the frequency components included in regions other than the selection region 80. -FFT analysis may be performed.

  In such a case, as shown in FIG. 21, the analysis results for the selected area 80 and the analysis results for other areas are displayed by different display methods.

  In addition, when a plurality of areas are repeatedly specified in the STFT analysis result, the control unit 33 uses the 1D-FFT analysis for the frequency component included in each area to obtain the period and frequency information obtained from 1D -The FFT analysis result screen may be displayed so that the specified order can be understood.

  An example of a display screen when such processing is performed is shown in FIG. In the display screen shown in FIG. 22, it can be seen that in the STFT analysis result screen, the analysis result in the first selection area 81 and the analysis result in the second selection area 82 are the first time and the second time, respectively. Is displayed.

  In addition, a plurality of regions may be specified simultaneously in the STFT analysis result. Thus, when a plurality of regions are specified in the STFT analysis result, as shown in FIG. 23, the control unit 33 performs a period obtained by performing 1D-FFT analysis on the frequency components included in each region. And frequency information are displayed on the 1D-FFT analysis result screen by different display methods.

  In any case of FIGS. 21 to 23, by selecting an analysis result determined by the user to be abnormal sound from among a plurality of analysis results and transmitting it to the server device 50, the transmitted analysis results (period and The registered past abnormal waveform corresponding to (frequency) is searched.

[Modification]
In the above embodiment, the case where the abnormal sound diagnosis device 10 is a tablet terminal device has been described. However, the present invention is not limited to this, and even when another device is used as the abnormal sound diagnosis device. The present invention can be applied. For example, when the operation panel of the image forming apparatus 20 is detachable from the main body, and is configured to be able to communicate with the server apparatus 50 and incorporate an audio signal acquisition function, the operation panel is A diagnostic device may be used.

  In the above embodiment, the case where the abnormal sound diagnosis apparatus 10 includes the microphone 17 is described. However, if the abnormal sound diagnosis apparatus 10 has a voice recording function, a collection of microphones and the like is possible. You may make it implement | achieve the acquisition means of an audio | voice signal by connecting a sound apparatus outside.

  Furthermore, in the above-described embodiment, the case where the target device for abnormal noise analysis is an image forming device has been described. However, the target device for abnormal noise analysis is not limited to the image forming device, and the period The present invention can be similarly applied to other devices as long as they are devices that can generate abnormal noise with the same characteristics.

10 abnormal sound diagnosis device 11 CPU
12 Memory 13 Storage Device 14 Wireless LAN Interface (IF)
DESCRIPTION OF SYMBOLS 15 Input apparatus 16 Display apparatus 17 Microphone 18 Control bus 20 Image forming apparatus 30 Wireless LAN terminal 31 Audio | voice acquisition part 32 Frequency analysis part 33 Control part 34 Audio | voice data storage part 35 Display part 36 Communication part 37 Voice reproduction part 40 Internet communication network 50 Server device 51 Communication unit 52 Control unit 53 Waveform data storage unit 61 Abnormal frequency component 62, 63 Determination exclusion region 70 Finger 80-82 Selection region 91-94 Abnormal frequency component

Claims (10)

An acquisition means for acquiring sound information by inputting the generated sound;
A first screen displaying a frequency spectrum waveform representing a time change of a signal intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information; and the frequency by analyzing the frequency spectrum waveform. Display means for switching and displaying a second screen showing information on the period and frequency of the sound included in the spectrum waveform according to the operation of the user;
Diagnostic device with   The diagnostic apparatus according to claim 1, wherein the display unit displays the first screen when a user selects to refer to a continuous sound analysis result.   The diagnostic device according to claim 1, wherein the display means displays the second screen when the user selects to refer to the analysis result of the periodic sound.   The display means displays the first screen and the second screen in parallel, and displays the selected screen when one of the first and second screens displayed in parallel is selected. The diagnostic apparatus according to any one of 1 to 3.   Frequency analysis that performs time-frequency analysis of sound information acquired by the acquisition means to generate the frequency spectrum waveform, and performs frequency analysis on frequency components included in a region specified by a user in the frequency spectrum waveform The diagnostic apparatus according to any one of claims 1 to 4, further comprising means.   When a plurality of regions are specified in the frequency spectrum waveform, the display means displays the period and frequency information obtained by performing frequency analysis on the frequency component included in each region on the second screen. 6. The diagnostic apparatus according to claim 5, wherein the display is performed by different methods.   When a plurality of regions are repeatedly specified in the frequency spectrum waveform, the display means displays the period and frequency information obtained by performing frequency analysis on the frequency components included in each region. The diagnostic apparatus according to claim 5, wherein a display is made so that the designated order can be understood on the screen. A communication means for communicating with an external device;
Transmitting means for transmitting information on the period and frequency selected by the user from the plurality of periods and frequency information displayed on the second screen to the external device via the communication means;
Receiving means for receiving a registered frequency spectrum waveform corresponding to the period and frequency information transmitted by the transmitting means from the external device via the communication means;
The diagnostic device according to claim 6 or 7, wherein the display unit displays the registered frequency spectrum waveform received by the receiving unit and the frequency spectrum waveform generated by the frequency analyzing unit side by side. An acquisition means for acquiring sound information by inputting the generated sound, and a frequency spectrum waveform representing a time change of the signal intensity distribution for each frequency obtained by performing time frequency analysis of the acquired sound information. Display means for switching and displaying one screen and a second screen showing information on the period and frequency of the sound included in the frequency spectrum waveform by performing frequency analysis on the frequency spectrum waveform. And the time spectrum analysis of the sound information acquired by the acquisition means to generate the frequency spectrum waveform, and the frequency analysis is performed on the frequency components included in the region specified by the user in the frequency spectrum waveform. A frequency analysis means, a communication means for communicating with an external device, and information on a plurality of periods and frequencies displayed on the second screen. The first transmission means for transmitting the information on the period and frequency selected by the user to the external device via the communication means, and the information on the period and frequency transmitted by the first transmission means. A diagnostic device comprising a receiving means for receiving a corresponding registered frequency spectrum waveform from an external device via the communication means;
Storage means for storing a plurality of frequency spectrum waveforms obtained by performing frequency analysis of sound information of abnormal sound, and when receiving information on sound period and frequency from the diagnostic device, the storage means stores the information A server device comprising: a second transmission unit that selects a frequency spectrum waveform corresponding to the received sound period and frequency information from a plurality of frequency spectrum waveforms and transmits the selected waveform to the diagnostic device;
Diagnostic system with An acquisition step of acquiring sound information by inputting the generated sound;
A first screen displaying a frequency spectrum waveform representing a time change of a signal intensity distribution for each frequency obtained by performing time-frequency analysis of the acquired sound information; and the frequency by analyzing the frequency spectrum waveform. A program for causing a computer to execute a display step of switching and displaying a second screen showing information on the period and frequency of a sound included in a spectrum waveform in accordance with a user operation.