AU2016370880A1 - Diagnostic device, diagnostic system, diagnostic method, and program - Google Patents
Diagnostic device, diagnostic system, diagnostic method, and program Download PDFInfo
- Publication number
- AU2016370880A1 AU2016370880A1 AU2016370880A AU2016370880A AU2016370880A1 AU 2016370880 A1 AU2016370880 A1 AU 2016370880A1 AU 2016370880 A AU2016370880 A AU 2016370880A AU 2016370880 A AU2016370880 A AU 2016370880A AU 2016370880 A1 AU2016370880 A1 AU 2016370880A1
- Authority
- AU
- Australia
- Prior art keywords
- frequency
- sound
- analysis result
- unit
- analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H3/00—Measuring characteristics of vibrations by using a detector in a fluid
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Abstract
A sound acquisition unit (31) accepts input of an abnormal sound produced in an image formation device (20) to acquire a sound signal. A frequency analysis unit (32) performs a STFT (short-time Fourier transform) of the acquired sound signal to generate frequency spectrum waveform data. A control unit (33) displays this frequency spectrum waveform on a touch panel, and on the basis of a touch operation by a user, receives a designation of the region containing the signal component of the abnormal sound in the frequency spectrum waveform that is displayed. The frequency analysis unit (32) performs a fast Fourier transform in the time-axis direction with respect to the frequency component included in the designated region. The control unit (33) extracts information of the period and frequency of the abnormal sound from an analysis result of the fast Fourier transform in the frequency analysis unit (32).
Description
TECHNICAL FIELD [0001] The present invention relates to a diagnostic device, a diagnostic system, a diagnostic method, and a program.
BACKGROUND ART [0002] Patent Document 1 discloses a system including a RAM (Random Access Memory) or a ROM (Read Only Memory) in which an operating sound upon normal operation of an image forming apparatus is stored, and a microphone configured to detect an operating sound to be generated from the image forming apparatus. The system is configured to specify an abnormal place of the image forming apparatus, based on first sound information stored in the RAM or the ROM, second sound information detected by the microphone, and operation information of the image forming apparatus.
[0003] Patent Document 2 discloses an image processing apparatus including an image forming unit configured to form an image on a printing sheet and a conveyor unit configured to convey the printing sheet. The image processing apparatus further includes a sound conversion unit configured to convert a sound in the apparatus into an electric signal, a sound analysis unit configured to analyze the electric signal converted by the sound conversion unit and to obtain a component for each frequency, and an output unit configured to output the component for each frequency obtained by the sound analysis unit.
Prior Art Documents
Patent Documents [0004] Patent Document 1: JP-A-2007-079263
Patent Document 2: JP-A-2008-290288
SUMMARY OF THE INVENTION
Problems To Be Solved By the Invention [0005] At least one exemplary embodiment of the present invention is to extract information of a frequency and a period of a sound to be extracted, from a frequency analysis result indicative of a temporal change of an intensity distribution for each frequency obtained by a frequency analysis on sound information.
Means for Solving the Problems [0006] [Diagnostic device] [1] At least one exemplary embodiment of the present invention is a diagnostic device comprising an acquisition unit configured to acquire sound information, a first analysis unit configured to perform a time-frequency analysis on the sound information and to generate frequency analysis result waveform data indicative of a temporal change of an intensity distribution for each frequency, a display configured to display the frequency analysis result waveform data, a reception unit configured to receive a designation of a region including a frequency component from the displayed frequency analysis result waveform data, a second analysis unit configured to analyze the frequency component included in the region, and an extraction unit configured to extract information of a period and a frequency of the frequency component from an analysis result made by the second analysis unit.
[0007] [2] With regard to the diagnostic device described in the above [1], when a region of a preset frequency or lower is designated as the region including the frequency component, the reception unit may not receive the designation.
[0008] [3] With regard to the diagnostic device described in the above [1], when a region of a preset frequency or lower is designated as the region including the frequency component, the reception unit may not perform the analysis by the second analysis unit or may ignore the analysis result made by the second analysis unit.
[0009] [4] With regard to the diagnostic device described in any one of [1] to [3], the display may configure to display the frequency analysis result waveform data generated by the first analysis unit on a touch panel, and the reception unit may configure to receive the designation of the region including the frequency component, based on a user’s touch operation on the touch panel.
[0010] [5] The diagnostic device described in any one of [1] to [4] may further comprise a communication unit configured to perform communication with an external apparatus, a transmission unit configured to transmit the information of the period and the frequency of the frequency component extracted by the extraction unit to the external apparatus via the communication unit, and a receiving unit configured to receive data of a frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analysis unit, from the external apparatus via the communication unit, wherein the display may be configured to display the frequency analysis result waveform data generated by the first analysis unit and the frequency analysis result received by the receiving unit.
[0011 ] [Diagnostic system] [6] At least one exemplary embodiment of the present invention is a diagnostic system comprising a diagnostic device comprising an acquisition unit configured to acquire sound information, a first analysis unit configured to perform a time-frequency analysis on the sound information and to generate frequency analysis result waveform data indicative of a temporal change of an intensity distribution for each frequency, a display configured to display the frequency analysis result waveform data, a reception unit configured to receive a designation of a region including a frequency component from the displayed frequency analysis result waveform data, a second analysis unit configured to analyze the frequency component included in the region, an extraction unit configured to extract information of a period and a frequency of the frequency component from an analysis result made by the second analysis unit, a communication unit configured to perform communication with an external apparatus, a first transmission unit configured to transmit the information of the period and the frequency of the frequency component extracted by the extraction unit to the external apparatus via the communication unit, and a receiving unit configured to receive data of a frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analysis unit, from the external apparatus via the communication unit, and a server apparatus comprising a storage configured to store therein data of plural frequency analysis results obtained by performing a frequency analysis on sound information of an abnormal sound, and a second transmission unit that, when the information of the period and the frequency of the frequency component is received from the diagnostic device, selects data corresponding to the received information of the period and the frequency of the frequency component, from the data of the plural frequency analysis results stored in the storage, and transmits the selected data to the diagnostic device.
[0012] [Diagnostic method] [7] At least one exemplary embodiment of the present invention is a diagnostic method comprising an acquisition step of acquiring sound information, a first analysis step of performing a time-frequency analysis on the sound information and generating frequency analysis result waveform data indicative of a temporal change of an intensity distribution for each frequency, a display step of displaying the frequency analysis result waveform data, a reception step of receiving a designation of a region including a frequency component from the displayed frequency analysis result waveform data, a second analysis step of analyzing the frequency component included in the region, and an extraction step of extracting information of a period and a frequency of the frequency component from an analysis result made by the second analysis step.
[0013] [Program] [8] At least one exemplary embodiment of the present invention is a program configured to enable a computer to execute an acquisition step of acquiring sound information, a first analysis step of performing a time-frequency analysis on the sound information and generating frequency analysis result waveform data indicative of a temporal change of an intensity distribution for each frequency, a display step of displaying the frequency analysis result waveform data, a reception step of receiving a designation of a region including a frequency component from the displayed frequency analysis result waveform data, a second analysis step of analyzing the frequency component included in the region, and an extraction step of extracting information of a period and a frequency of the frequency component from an analysis result made by the second analysis step.
Effects of the Invention [0014] According to the diagnostic device described in the above [1], it is possible to extract the information of the frequency and the period of the sound to be extracted, from the frequency analysis result indicative of the temporal change of the intensity distribution for each frequency obtained by the frequency analysis on the sound information.
[0015] According to the diagnostic device described in the above [2], it is possible to prevent extraction accuracy of the information of the frequency and the period of the sound to be extracted from being deteriorated even when the region of the preset frequency or lower is erroneously designated.
[0016] According to the diagnostic device described in the above [3], it is possible to prevent the extraction accuracy of the information of the frequency and the period of the sound to be extracted from being deteriorated even when the region of the preset frequency or lower is erroneously designated.
[0017] According to the diagnostic device described in the above [4], it is possible to designate the region including the frequency component of the sound to be extracted by the user’s touch operation.
[0018] According to the diagnostic device described in the above [5], the user can estimate a cause of the generated sound by comparing the obtained frequency analysis result of the acquired sound information and the frequency analysis result of the sound information recorded in the external apparatus with respect to an apparatus equivalent to an analysis target apparatus.
[0019] According to the diagnostic system described in the above [6], it is possible to extract the information of the frequency and the period of the sound to be extracted, from the frequency analysis result indicative of the temporal change of the intensity distribution for each frequency obtained by the frequency analysis on the sound information.
[0020] According to the diagnostic method described in the above [7], it is possible to extract the information of the frequency and the period of the sound to be extracted, from the frequency analysis result indicative of the temporal change of the intensity distribution for each frequency obtained by the frequency analysis on the sound information.
[0021] According to the program described in the above [8], it is possible to extract the information of the frequency and the period of the sound to be extracted, from the frequency analysis result indicative of the temporal change of the intensity distribution for each frequency obtained by the frequency analysis on the sound information.
BRIEF DESCRIPTION OF THE DRAWINGS [0022] Fig. 1 is a system view depicting a configuration of an abnormal sound diagnostic system of an exemplary embodiment of the present invention.
Fig. 2 is a block diagram depicting a hardware configuration of an abnormal sound diagnostic device 10 of the exemplary embodiment of the present invention.
Fig. 3 is a block diagram depicting a functional configuration of the abnormal sound diagnostic device 10 of the exemplary embodiment of the present invention.
Fig. 4 is a block diagram depicting a functional configuration of a server apparatus 50 of the exemplary embodiment of the present invention.
Fig. 5 depicts an example of information that is to be stored in a waveform data storage 53 of Fig. 4.
Fig. 6 is a sequence chart for illustrating an operation of the abnormal sound diagnostic system of the exemplary embodiment of the present invention.
Fig. 7 depicts an example of a screen of the abnormal sound diagnostic device 10, which is displayed when inputting a variety of information such as a model name, a serial number, an operating state and the like.
Fig. 8 illustrates a concept of an STFT.
Fig. 9 depicts an example of an image of a frequency spectrum waveform based on an analysis result obtained by the STFT.
Fig. 10 depicts an example of a display for urging a user to designate a region estimated as an abnormal sound when presenting a frequency spectrum waveform to the user.
Fig. 11 depicts an example of a selected region 80 selected by the user in the image example of the frequency spectrum waveform shown in Fig. 10.
Fig. 12 depicts an analysis result example of fast Fourier transform.
Fig. 13 depicts a screen example of the abnormal sound diagnostic device 10 in which two frequency spectrum waveforms are displayed.
Fig. 14 depicts an image example where a separate frequency spectrum waveform having a different abnormal sound cause is displayed with respect to the screen example shown in Fig. 13.
EMBODIMENTS FOR CARRYING OUT THE INVENTION [0023] Hereinafter, an exemplary embodiment of the present invention will be described in detail with reference to the drawings.
[0024] Fig. 1 is a system view depicting a configuration of an abnormal sound diagnostic system of an exemplary embodiment of the present invention.
[0025] As shown in Fig. 1, the abnormal sound diagnostic system of the exemplary embodiment of the present invention includes a portable abnormal sound diagnostic device 10 such as a personal computer, a smart phone, a tablet terminal device and the like, and a server apparatus 50.
[0026] In the meantime, the present invention can be applied to any device, as the abnormal sound diagnostic device 10, inasmuch as the device can be connected to the server apparatus 50 via a communication network. In the exemplary embodiment, an example where the abnormal sound diagnostic device 10 is a tablet terminal device including a device such as a microphone capable of acquiring a sound signal and a touch panel by which a touch input can be performed is described.
[0027] The abnormal sound diagnostic device 10 is carried by a service man (maintenance personnel) who manages and repairs an image forming apparatus 20 such as a printer, which is used by an end user, for example. The abnormal sound diagnostic device 10 is used to acquire an abnormal sound (unusual sound) signal generated in the image forming apparatus 20, to perform a frequency analysis on the acquired abnormal sound signal, and to display a frequency analysis result waveform of a past abnormal sound signal acquired from the server apparatus 50 and a frequency analysis result waveform of the acquired abnormal sound signal.
[0028] The abnormal sound diagnostic device 10 and the server apparatus 50 are connected to each other via a wireless LAN (Local Area Network) terminal 30 such as a Wi-Fi router and an Internet communication network 40 and are configured to transmit and receive information.
[0029] In the meantime, when the abnormal sound diagnostic device 10 is a portable phone device, a smart phone or the like, the abnormal sound diagnostic device 10 and the server apparatus 50 may be connected to each other via a portable phone network and configured to transmit and receive frequency analysis result waveform data.
[0030] In the abnormal sound diagnostic system of the exemplary embodiment, it is assumed that when an abnormal sound is generated in the image forming apparatus 20, which is a target electronic device provided at a place of the end user, the service man goes to the place of the image forming apparatus 20 with carrying the abnormal sound diagnostic device 10. The service man performs an abnormal sound diagnosis of recording the generated abnormal sound to acquire an abnormal sound signal by using the abnormal sound diagnostic device 10 and specifying a cause of the abnormal sound. [0031] In the meantime, it is technically viable to provide the image forming apparatus 20 with a microphone and the like for a recording function and to record the abnormal sound by the recording function when the abnormal sound is generated. However, when the image forming apparatus 20 is provided in an office or the like of the end user, it is difficult to provide the image forming apparatus 20 with a sound recording function due to security reasons.
[0032] Subsequently, a hardware configuration of the abnormal sound diagnostic device 10 of the abnormal sound diagnostic system of the exemplary embodiment is shown in Fig. 2.
[0033] As shown in Fig. 2, the abnormal sound diagnostic device 10 includes a CPU 11, a memory 12 that can temporarily store data, a storage device 13 such as a flash memory, a wireless LAN interface (IF) 14 configured to transmit and receive data through wireless communication with the wireless LAN terminal 30, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. The constitutional elements are connected to each other via a control bus 18.
[0034] The abnormal sound diagnostic device 10 of the exemplary embodiment is provided with a touch panel in which a touch sensor for detecting a touch position is provided as the input device 15 on the display device 16. A display and an input from a user are performed through the touch panel.
[0035] The CPU 11 is configured to execute predetermined processing on the basis of a control program stored in the memory 12 or the storage device 13, thereby controlling an operation of the abnormal sound diagnostic device 10. In the meantime, the control program may be downloaded and provided to the CPU 11 through the Internet communication network 40 or portable phone network. Alternatively, the program may be provided to the CPU 11 with being stored in a storage medium such as a CDROM.
[0036] The control program is executed, so that the abnormal sound diagnostic device 10 of the exemplary embodiment performs operations as described later, thereby helping the service man to specify the cause of the abnormal sound.
[0037] Fig. 3 is a block diagram depicting a functional configuration of the abnormal sound diagnostic device 10 that is implemented as the above control program is executed.
[0038] As shown in Fig. 3, the abnormal sound diagnostic device 10 of the exemplary embodiment includes a sound acquisition unit 31, a frequency analysis unit 32, a controller 33, a sound data storage 34, a display 35, a communication unit 36, and a sound playback unit 37.
[0039] The display 35 is configured to display a variety of data under control of the controller 33. The communication unit 36 is configured to perform communication with the server apparatus 50, which is an external apparatus. The sound playback unit 37 is configured to play back recorded sound data and the like and to convert the same into a sound signal under control of the controller 33.
[0040] The sound acquisition unit 31 is configured to input therein a sound of the abnormal sound generated in the image forming apparatus 20, which is an analysis target apparatus, and to acquire a sound signal.
[0041] In the exemplary embodiment, the sound acquisition unit 31 is described as configuring to input therein a sound of the abnormal sound generated in the image forming apparatus 20 and to acquire a sound signal. However, the sound is an example of a sound, and the sound signal is an example of the sound information.
[0042] The frequency analysis unit 32 is configured to perform a time-frequency analysis (time-dependent frequency analysis) on the sound signal acquired by the sound acquisition unit 31 and to generate frequency spectrum waveform (frequency analysis result) data indicative of a temporal change of a signal intensity distribution for each frequency of the acquired abnormal sound signal.
[0043] Specifically, the frequency analysis unit 32 is configured to perform STFT (Short time Fourier transform: Short time Fourier transform) on the sound signal acquired by the sound acquisition unit 31 and thereby to generate frequency spectrum waveform data. The STFT will be described later.
[0044] The controller 33 is configured to store the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the sound data storage 34, together with the sound data. The controller 33 is configured to display a frequency spectrum waveform obtained by a result of the STFT on the display 35, which is a touch panel. [0045] Thereafter, when a user performs a touch operation of tracing a region, which is estimated as a signal component of the abnormal sound, of the frequency spectrum waveform displayed on the display 35 that is a touch panel by a finger, for example, the controller 33 receives a designation of the region, in which the signal component of the abnormal sound is included, of the displayed frequency spectrum waveform on the basis of the user’s touch operation.
[0046] Then, the controller 33 is configured to instruct the frequency analysis unit 32 to execute fast Fourier transform (1D-FFT (Fast Fourier Transform)) of performing the frequency analysis in a time-axis direction with respect to the frequency component of the region designated as the region, in which the signal component of the abnormal sound is included, of the frequency spectrum waveform data obtained by the frequency analysis unit 32. For this reason, the frequency analysis unit 32 is configured to perform the fast Fourier transform in the time-axis direction with respect to the frequency component included in the instructed region.
[0047] Then, the controller 33 is configured to extract information of a period and a frequency of the abnormal sound from an analysis result of the fast Fourier transform in the frequency analysis unit 32.
[0048] In the meantime, even when the abnormal sound is not generated, a signal component of a usual operating sound is always included in a low-frequency region of a preset frequency or lower. For this reason, even when the region of the preset frequency or lower is designated as the region in which the signal component of the abnormal sound is included, the controller 33 may not receive the designation.
[0049] Also, the controller 33 is configured to transmit the obtained information of the period and the frequency of the abnormal sound to the server apparatus 50 via the communication unit 36, together with model information such as a model name and a serial number of the image forming apparatus 20 and operating state information indicative of an operating state of the image forming apparatus 20. The operating state information may specifically include information as to whether a color printing or a monochrome printing, whether a duplex printing or one-side printing, whether an operation mode is a scan mode, a print mode or a copy mode, and a type of a sheet to be used. In this way, the controller 33 is configured to transmit the information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server apparatus 50 via the communication unit 36.
[0050] The server apparatus 50 is configured to store therein spectrum waveform data, which is obtained by performing a frequency analysis on a sound signal of an abnormal sound previously generated in an apparatus equivalent to the image forming apparatus 20, together with information of original sound data, an operating state of the apparatus upon acquisition of the sound data, a cause of the abnormal sound, a method of coping with the abnormal sound, and the like.
[0051] The server apparatus 50 is configured to search for a frequency spectrum waveform (waveform of a second frequency analysis result) data, which corresponds to the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32, from the information of the period and the frequency of the abnormal sound transmitted from the abnormal sound diagnostic device 10. The server apparatus 50 is configured to transmit the found frequency spectrum waveform data to the abnormal sound diagnostic device 10, together with information of sound data and the like stored as abnormal sound sample waveform data.
[0052] As a result, the controller 33 is configured to receive the frequency spectrum waveform data, which corresponds to the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32, from the server apparatus via the communication unit 36.
[0053] The controller 33 is configured to display, on the display 35, the frequency spectrum waveform obtained by performing the frequency analysis on the sound signal acquired by the sound acquisition unit 31 and the spectrum waveform received from the server apparatus 50 in parallel.
[0054] In the meantime, when there exist plural frequency spectrum waveform data transmitted from the server apparatus 50, the controller 33 preferentially displays data, which is highly similar to the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32, of the plural frequency spectrum waveform data, on the display 35.
[0055] Subsequently, a functional configuration of the server apparatus 50 in the abnormal sound analysis system of the exemplary embodiment is described with reference to a block diagram of Fig. 4.
[0056] As shown in Fig. 4, the server apparatus 50 of the exemplary embodiment includes a communication unit 51, a controller 52, and a waveform data storage 53. [0057] The waveform data storage 53 is configured to store therein plural frequency spectrum waveform data, which is obtained by performing a frequency analysis on a sound signal of an abnormal sound previously generated in an apparatus equivalent to the image forming apparatus 20, which is an analysis target apparatus.
[0058] Specifically, as shown in Fig. 5, the waveform data storage 53 is configured to store therein information of frequency spectrum waveform data obtained by performing a time-frequency analysis on sound data of an abnormal sound acquired in advance, original sound data, a cause of the abnormal sound, a method of coping with the abnormal sound, and the like, for each model.
[0059] When the information of the period and the frequency of the abnormal sound is received from the abnormal sound diagnostic device 10, the controller 52 selects waveform data, which is similar to the frequency spectrum waveform data based on the abnormal sound acquired with the abnormal sound diagnostic device 10, from the plural frequency spectrum waveform data stored in the waveform data storage 53 on the basis of the received information of the period and the frequency of the abnormal sound. Then, the controller 52 is configured to transmit the selected waveform data to the abnormal sound diagnostic device 10 via the communication unit 51.
[0060] Subsequently, an operation of the abnormal sound diagnostic system of the exemplary embodiment is described with reference to a sequence chart of Fig. 6.
[0061] When diagnosing the abnormal sound so as to specify a cause of the abnormal sound with the abnormal sound diagnostic device 10, an image as shown in Fig. 7 is displayed, and a variety of information such as a model name, a serial number, an operating state and the like is input (step S101).
[0062] The abnormal sound diagnostic device 10 sets an operation mode to a sound recording mode to record the abnormal sound by the microphone 17 close to a place of the image forming apparatus 20, at which the abnormal sound has been generated, thereby acquiring the sound data (step SI02).
[0063] In the abnormal sound diagnostic device 10, the acquired sound data is subjected to the STFT by the frequency analysis unit 32, so that a frequency spectrum waveform indicative of a temporal change of a signal intensity distribution for each frequency is generated (step SI03).
[0064] As shown in Fig. 8, the STFT is processing of performing Fourier transform every short time to calculate a signal intensity for each frequency component in accordance with the temporal change. Fig. 9 depicts a waveform example where an analysis result obtained by the STFT is shown by one frequency spectrum waveform image.
[0065] In the example of the frequency spectrum waveform shown in Fig. 9, a horizontal axis indicates time, a vertical axis indicates a frequency and an intensity for each frequency is expressed by a color. Meanwhile, in Fig. 9, a difference of colors is expressed by a hatching pattern. Also, Fig. 9 exemplifies a case where the intensity for each frequency is expressed by a color. However, the intensity may also be expressed by a gradation.
[0066] In the example of the frequency spectrum waveform shown in Fig. 9, it can be seen that a frequency component 61 of the abnormal sound is periodically generated at a specific frequency. Meanwhile, in the example of the frequency spectrum waveform shown in Fig. 9, a low-frequency component is a usual operating sound and is not the frequency component of the abnormal sound.
[0067] When the frequency spectrum waveform as shown in Fig. 9 is obtained, the controller 33 displays the frequency spectrum waveform on the display 35. Then, as shown in Fig. 10, the controller 33 presents a display for urging the user to designate a region, which is estimated as the abnormal sound, to the displayed frequency spectrum waveform. In the example of Fig. 10, it can be seen that the characters “Please designate a region that is thought as the abnormal sound” are displayed, so that the user is urged to designate a region that is estimated as the abnormal sound.
[0068] By referring to the above display, the user presented with the frequency spectrum waveform specifies the frequency component 61 of the abnormal sound, for example, operates the touch panel to select a region in which the frequency component of the abnormal sound is included.
[0069] Fig. 11 depicts an example of a selected region 80 selected in this way by the user. In the example of Fig. 11, it can be seen that the user operates the touch panel with a finger 70 to designate a rectangular region including plural frequency components 61 of the abnormal sound, as the selected region 80.
[0070] When the selected region 80 is designated in this way, the fast Fourier transform (1D-FFT) is executed for the frequency components included in the selected region 80 by the frequency analysis unit 32 (step S104). Fig. 12 depicts an analysis result example of the fast Fourier transform executed in this way.
[0071] In Fig. 12, the period and the frequency of the signal of the frequency component for which the fast Fourier transform has been performed are detected to specify the period and the frequency of the abnormal sound. In the meantime, since the abnormal sound includes an overtone component and the like, plural periods may be detected. However, a period in which the signal intensity is strongest is detected as the period of the abnormal sound.
[0072] Also, a signal component of a long period equal to or longer than a predetermined period is considered as a usual operating sound or a noise of an irregular period. Therefore, a region including the signal component of the long period is set as a determination exclusion region 62 and an analysis result in the determination exclusion region 62 is ignored. Alternatively, the region including the signal component of the long period may not be analyzed by the frequency analysis unit 32. [0073] Also, since a low-frequency signal component of a predetermined frequency or lower is not also distinguished from a usual operating sound, a region including the lowfrequency signal component is set as a determination exclusion region 63 and an analysis result in the determination exclusion region 63 is ignored. Alternatively, the region including the low-frequency signal component may not be analyzed by the frequency analysis unit 32.
[0074] The abnormal sound diagnostic device 10 transmits the information of the frequency and the period of the abnormal sound obtained by the analysis result of the fast Fourier transform to the server apparatus 50, together with the model information and the information of the operating state (step SI05). For example, the information that a frequency of the abnormal sound is 4 kHz and a period of the abnormal sound is 2.0 seconds is transmitted to the server apparatus 50.
[0075] Then, the server apparatus 50 searches the waveform data storage 53 on the basis of the received information, thereby extracting the frequency spectrum waveform data corresponding to the received information (step SI06).
[0076] Then, the server apparatus 50 transmits the extracted frequency spectrum waveform data to the abnormal sound diagnostic device 10, together with the information of the original sound data, the cause of the abnormal sound, the coping method thereof and the like (step SI 07).
[0077] The abnormal sound diagnostic device 10 receives the frequency spectrum waveform data transmitted from the server apparatus 50 (step SI08). Then, the controller 33 of the abnormal sound diagnostic device 10 displays, on the display 35, the received frequency spectrum waveform and the frequency spectrum waveform obtained by the STFT (step S109).
[0078] Fig. 13 depicts a screen example of the abnormal sound diagnostic device 10, in which the two frequency spectrum waveforms are displayed in this way.
[0079] In the screen example of Fig. 13, it can be seen that the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as “the analysis result waveform of the abnormal sound recorded this time” and the frequency spectrum waveform transmitted from the server apparatus 50 is displayed as “the past abnormal sound data” together with the cause of the abnormal sound “abrasion of the photosensitive drum”.
[0080] The service man who intends to perform the abnormal sound diagnosis compares the two frequency spectrum waveforms and determines whether the abnormal sound components in the waveforms are similar, thereby specifying the cause of the abnormal sound.
[0081] Also, when plural frequency spectrum waveforms is transmitted from the server apparatus 50, the user traces an image of the frequency spectrum waveform displayed as “the past abnormal sound data” in the horizontal direction by a touch operation, so that a separate frequency spectrum waveform is displayed, as shown in Fig. 14.
[0082] Fig. 14 depicts an image example where the frequency spectrum waveform of the abnormal sound is displayed when the cause of the abnormal sound is “a trouble of the drive system motor”.
[0083] Like this, when the plural frequency spectrum waveforms is transmitted, the service man determines to which frequency spectrum waveform the frequency spectrum waveform of the abnormal sound acquired this time is more similar, thereby specifying the cause of the abnormal sound. In the meantime, when specifying the cause of the abnormal sound, the service man may hear and compare the abnormal sound acquired this time and the sound corresponding to the frequency spectrum waveform transmitted from the server apparatus 50 by playing back the original sound data with the sound playback unit 37, in addition to the comparison of the shapes of the frequency spectrum waveforms, the period and the frequency of the abnormal sound component, and the like, and then specify the cause of the abnormal sound.
[0084] [Modified Embodiments]
The exemplary embodiment has been described using the case where the abnormal sound diagnostic device 10 is a tablet terminal device. However, the present invention is not limited thereto, and can also be applied to a case where other device is used as the abnormal sound diagnostic device. For example, the operation panel of the image forming apparatus 20 may be used as the abnormal sound diagnostic device if the operation panel is detachably mounted to a main body and has embedded functions of performing communication with the server apparatus 50 and acquiring the sound signal. [0085] Also, the exemplary embodiment has been described using the case where the abnormal sound diagnostic device 10 has the microphone 17 embedded therein. However, when the abnormal sound diagnostic device 10 has a sound recording function, the acquisition unit of the sound signal may be implemented by connecting a sound collection device such as the microphone to an outside.
[0086] Also, the exemplary embodiment has been described using the case where the region that is estimated as the abnormal sound is designated by the user’s touch operation. However, the present invention is not limited thereto. When the region that is estimated as the abnormal sound is designated by other methods such as a method of directly inputting a frequency that is estimated as the abnormal sound by numbers, which is a case where the region is designated by a pen input, a method of designating the region by a mouse operation, and the like, the present invention can also be applied.
[0087] Also, the exemplary embodiment has been described using the case where the target apparatus of the abnormal sound analysis is the image forming apparatus. However, the target apparatus of the abnormal sound analysis is not limited to the image forming apparatus. The present invention can be applied to other apparatus inasmuch as the apparatus may cause the abnormal sound having periodicity.
[0088] In the above, the diverse exemplary embodiments have been described.
However, the exemplary embodiments may be combined.
Also, the present disclosure is not limited to the exemplary embodiment and can be implemented in diverse forms without departing from the gist of the present disclosure.
The present application is based on Japanese Patent Application No. 2015243112 filed on December 14, 2015, the contents of which are incorporated herein by reference.
Description of Reference Numerals [0089] 10: abnormal sound diagnostic device
11: CPU
12: memory
13: storage device
14: wireless LAN interface (IF)
15: input device 16: display device 17: microphone
18: control bus
20: image forming apparatus
30: wireless LAN terminal
31: sound acquisition unit 32: frequency analysis unit
33: controller
34: sound data storage
35: display
36: communication unit
37: sound playback unit
40: Internet communication network
50: server apparatus
51: communication unit
52: controller
53: waveform data storage
61: frequency component of abnormal sound 62, 63: determination exclusion region 70: finger
80: selected region
Claims (14)
1. A diagnostic device comprising:
an acquisition unit that acquires sound information;
a first analysis unit that performs a time-frequency analysis on the sound information and generates frequency analysis result waveform data indicative of a temporal change of an intensity distribution for each frequency;
a display that displays the frequency analysis result waveform data; a reception unit that receives a designation of a region including a frequency component from the displayed frequency analysis result waveform data;
a second analysis unit that analyzes the frequency component included in the region, and an extraction unit that extracts information of a period and a frequency of the frequency component from an analysis result made by the second analysis unit.
2. The diagnostic device according to claim 1, wherein when a region of a preset frequency or lower is designated as the region including the frequency component, the reception unit does not receive the designation.
3. The diagnostic device according to claim 1, wherein when a region of a preset frequency or lower is designated as the region including the frequency component, the reception unit does not perform the analysis by the second analysis unit or ignores the analysis result made by the second analysis unit.
4. The diagnostic device according to any one of claims 1 to 3, wherein the display displays the frequency analysis result waveform data generated by the first analysis unit on a touch panel, and wherein the reception unit receives the designation of the region including the frequency component, based on a user’s touch operation on the touch panel.
5. The diagnostic device according to any one of claims 1 to 4, further comprising:
a communication unit that performs communication with an external apparatus, a transmission unit that transmits the information of the period and the frequency of the frequency component extracted by the extraction unit to the external apparatus via the communication unit, and a receiving unit that receives data of a frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analysis unit, from the external apparatus via the communication unit, wherein the display displays the frequency analysis result waveform data generated by the first analysis unit and the frequency analysis result received by the receiving unit.
6. A diagnostic system comprising: a diagnostic device comprising:
an acquisition unit that acquires sound information; a first analysis unit that performs a time-frequency analysis on the sound information and generates frequency analysis result waveform data indicative of a temporal change of an intensity distribution for each frequency;
a display that displays the frequency analysis result waveform data;
a reception unit that receives a designation of a region including a frequency component from the displayed frequency analysis result waveform data;
a second analysis unit that analyzes the frequency component included in the region;
an extraction unit that extracts information of a period and a frequency of the frequency component from an analysis result made by the second analysis unit;
a communication unit that performs communication with an external apparatus, a first transmission unit that transmits the information of the period and the frequency of the frequency component extracted by the extraction unit to the external apparatus via the communication unit, and a receiving unit that receives data of a frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analysis unit, from the external apparatus via the communication unit, a server apparatus comprising:
a storage that stores therein data of a plurality of frequency analysis results obtained by performing a frequency analysis on sound information of an abnormal sound, and a second transmission unit that, when the information of the period and the frequency of the frequency component is received from the diagnostic device, selects data corresponding to the received information of the period and the frequency of the frequency component, from the data of the plurality of frequency analysis results stored in the storage, and transmits the selected data to the diagnostic device.
7. A diagnostic method comprising:
an acquisition step of acquiring sound information;
a first analysis step of performing a time-frequency analysis on the sound information and generating frequency analysis result waveform data indicative of a temporal change of an intensity distribution for each frequency;
a display step of displaying the frequency analysis result waveform data; a reception step of receiving a designation of a region including a frequency component from the displayed frequency analysis result waveform data;
a second analysis step of analyzing the frequency component included in the region, and an extraction step of extracting information of a period and a frequency of the frequency component from an analysis result made by the second analysis step.
8. A program that enables a computer to execute: an acquisition step of acquiring sound information;
a first analysis step of performing a time-frequency analysis on the sound information and generating frequency analysis result waveform data indicative of a temporal change of an intensity distribution for each frequency;
a display step of displaying the frequency analysis result waveform data;
a reception step of receiving a designation of a region including a frequency component from the displayed frequency analysis result waveform data;
a second analysis step of analyzing the frequency component included in the region, and an extraction step of extracting information of a period and a frequency of the frequency component from an analysis result made by the second analysis step.
FIG. 1 internet communication network
1/14
FIG. 2 abnormal sound diagnostic device
2/14
FIG. 3 abnormal sound diagnostic device
3/14
FIG. 4 server apparatus 50
4/14
FIG. 5
5/14
6/14
FIG. 6 abnormal sound diagnostic device 10
SERVER APPARATUS 50
FIG. 7 abnormal sound diagnostic device
PLEASE INPUT A MODEL NAME AND A SERIAL NUMBER OF A PRINTER FOR WHICH THE ABNORMAL SOUND ANALYSIS IS TO BE PERFORMED
7/14
17: MICROPHONE
FIG. 8 illustration of stft concept intensity
8/14
FIG. 9 example of frequency spectrum waveform
61: frequency component of ABNORMAL SOUNDE
TIME (SECOND)
9/14
FIG. 10
PLEASE DESIGNATE A REGION THAT IS THOUGHT AS THE ABNORMAL SOUND
10/14
FIG. 11
PLEASE DESIGNATE A REGION THAT IS THOUGHT AS THEABNORMAL SOUND
SELECTED REGION 80
FREQUENCY COMPONENT OF ABNORMAL
20000
18000
16000
14000
FREQUENCY 12000 (Hz) «XX»
TIME (SECOND)
11/14
FIG. 12 example of analysis result of fast fourier transform long period short period
12/14 period (SECOND)
FIG. 13
PAST ABNORMAL SOUND DATA (CAUSE OF ABNORMAL SOUND: ABRASION OF PHOTOSENSITIVE DRUM)
FREQUENCY (Hz)
20000
16000
12000
8000
4000
2.0
4.0 6.0
TIME (SECOND)
13/14
ANALYSIS RESULT WAVEFORM OF ABNORMAL SOUND RECORDED THIS TIME
FIG. 14
Λ
PAST ABNORMAL SOUND DATA (CAUSE OF ABNORMAL SOUND: TROUBLE OF DRIVE SYSTEM MOTOR)
A
20000
16000
FREQUENCY i2OOo (Hz)
8000
4000 _____
4.0
6.0
8.0
TIME (SECOND)
2.0
14/14
ANALYSIS RESULT WAVEFORM OF ABNORMAL SOUND RECORDED THIS TIME
16000
FREQUENCY 12000 (Hz)
20000
DISPLAY OF FREQUENCY ANALYSIS RESULT WAVEFORM OF OTHER ABNORMAL SOUND CAUSE
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015243112A JP5954604B1 (en) | 2015-12-14 | 2015-12-14 | Diagnostic device, diagnostic system and program |
| JP2015-243112 | 2015-12-14 | ||
| PCT/JP2016/059524 WO2017104146A1 (en) | 2015-12-14 | 2016-03-24 | Diagnostic device, diagnostic system, diagnostic method, and program |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| AU2016370880A1 true AU2016370880A1 (en) | 2018-05-10 |
Family
ID=56418752
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| AU2016370880A Abandoned AU2016370880A1 (en) | 2015-12-14 | 2016-03-24 | Diagnostic device, diagnostic system, diagnostic method, and program |
Country Status (4)
| Country | Link |
|---|---|
| JP (1) | JP5954604B1 (en) |
| CN (1) | CN108351248B (en) |
| AU (1) | AU2016370880A1 (en) |
| WO (1) | WO2017104146A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11353860B2 (en) | 2018-08-03 | 2022-06-07 | Mitsubishi Electric Corporation | Data analysis device, system, method, and recording medium storing program |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6834223B2 (en) * | 2016-07-29 | 2021-02-24 | 富士ゼロックス株式会社 | Diagnostic equipment, diagnostic systems and programs |
| JP6840971B2 (en) * | 2016-09-21 | 2021-03-10 | 富士ゼロックス株式会社 | Diagnostic equipment, diagnostic systems and programs |
| JP6822036B2 (en) * | 2016-09-21 | 2021-01-27 | 富士ゼロックス株式会社 | Diagnostic equipment, diagnostic systems and programs |
| US11158315B2 (en) | 2019-08-07 | 2021-10-26 | International Business Machines Corporation | Secure speech recognition |
| JP2023033848A (en) | 2021-08-30 | 2023-03-13 | トヨタ自動車株式会社 | Abnormal noise specification device, abnormal noise specification method and abnormal noise specification program |
Family Cites Families (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06318424A (en) * | 1993-03-12 | 1994-11-15 | Kitagawa Ind Co Ltd | Sound sensitive operating switch and emergency electric light and remote control holder using it |
| JP3742677B2 (en) * | 1995-11-13 | 2006-02-08 | 株式会社日立ビルシステム | Damage detection device for elevator rotary bearings |
| JP4592123B2 (en) * | 1996-09-13 | 2010-12-01 | 東芝エレベータ株式会社 | Unsteady signal analyzer and medium on which unsteady signal analysis program is recorded |
| MY118297A (en) * | 1996-09-13 | 2004-09-30 | Toshiba Kk | Unsteady signal analyzer and medium for recording unsteady signal analyzer program |
| US6192490B1 (en) * | 1998-04-10 | 2001-02-20 | International Business Machines Corporation | Method and system for monitoring computer performance utilizing sound diagnostics |
| JP3908555B2 (en) * | 2002-02-08 | 2007-04-25 | 株式会社東芝 | Ultrasonic diagnostic equipment |
| JP2006025281A (en) * | 2004-07-09 | 2006-01-26 | Hitachi Ltd | Information source selection system, and method |
| JP2006113002A (en) * | 2004-10-18 | 2006-04-27 | Nsk Ltd | Anomaly diagnosis system for mechanical equipment |
| CN101206548B (en) * | 2006-12-19 | 2012-01-11 | 北京汇冠新技术股份有限公司 | Infrared touch panel triggered using touch force and detecting method thereof |
| CN101354485B (en) * | 2007-07-23 | 2011-04-06 | 奇美电子股份有限公司 | System and method for testing display apparatus |
| JP5207074B2 (en) * | 2009-06-05 | 2013-06-12 | 清水建設株式会社 | Wind turbine blade abnormality determination method, abnormality determination device, and abnormality determination program |
| JP5725833B2 (en) * | 2010-01-04 | 2015-05-27 | Ntn株式会社 | Rolling bearing abnormality diagnosis device, wind power generation device and abnormality diagnosis system |
| JP2012208043A (en) * | 2011-03-30 | 2012-10-25 | Railway Technical Research Institute | Method and device for identifying vibration characteristic of railroad structure |
| JP5783808B2 (en) * | 2011-06-02 | 2015-09-24 | 三菱電機株式会社 | Abnormal sound diagnosis device |
| EA201400150A1 (en) * | 2011-07-23 | 2014-11-28 | Нексовейшн, Инк. | DEVICE, METHOD AND SYSTEM FOR MUSICATION |
| CN102779398A (en) * | 2012-07-09 | 2012-11-14 | 深圳市同洲电子股份有限公司 | Control method, device and system for smart appliance |
| JP6236282B2 (en) * | 2013-10-21 | 2017-11-22 | 株式会社日立ハイテクノロジーズ | Abnormality detection apparatus, abnormality detection method, and computer-readable storage medium |
| JP2015173369A (en) * | 2014-03-12 | 2015-10-01 | ソニー株式会社 | Signal processor, signal processing method and program |
-
2015
- 2015-12-14 JP JP2015243112A patent/JP5954604B1/en active Active
-
2016
- 2016-03-24 CN CN201680066037.1A patent/CN108351248B/en active Active
- 2016-03-24 AU AU2016370880A patent/AU2016370880A1/en not_active Abandoned
- 2016-03-24 WO PCT/JP2016/059524 patent/WO2017104146A1/en active Application Filing
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11353860B2 (en) | 2018-08-03 | 2022-06-07 | Mitsubishi Electric Corporation | Data analysis device, system, method, and recording medium storing program |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017104146A1 (en) | 2017-06-22 |
| JP2017110919A (en) | 2017-06-22 |
| JP5954604B1 (en) | 2016-07-20 |
| CN108351248B (en) | 2020-10-23 |
| CN108351248A (en) | 2018-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2016370880A1 (en) | Diagnostic device, diagnostic system, diagnostic method, and program | |
| AU2016378005B2 (en) | Terminal device, diagnosis system, diagnosis method, and program | |
| US10911607B2 (en) | Diagnosing an image forming apparatus based on sound signal analysis | |
| CN106961514B (en) | Terminal device and information output method | |
| US9992355B2 (en) | Diagnostic apparatus, diagnostic system, and non-transitory computer readable medium | |
| US10352820B2 (en) | Diagnostic device, diagnostic system, diagnostic method, and non-transitory computer-readable medium | |
| US10412234B2 (en) | Diagnostic device and diagnostic method | |
| US10089397B2 (en) | Diagnostic device, diagnostic system, diagnostic method, and non-transitory computer-readable medium | |
| JP6840971B2 (en) | Diagnostic equipment, diagnostic systems and programs | |
| US10230853B2 (en) | Terminal device, diagnosis system and information output method for outputting information comprising an instruction regarding how to record a sound from a target apparatus | |
| JP6868176B2 (en) | Diagnostic equipment, diagnostic systems and programs | |
| WO2017094270A1 (en) | Diagnosis device, diagnosis system, diagnosis method and program | |
| JP2018048886A (en) | Diagnostic device, diagnostic system, and program | |
| JP6763255B2 (en) | Diagnostic equipment, diagnostic systems and programs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MK5 | Application lapsed section 142(2)(e) - patent request and compl. specification not accepted |