WO2017104146A1 - Diagnostic device, diagnostic system, diagnostic method, and program - Google Patents

Diagnostic device, diagnostic system, diagnostic method, and program Download PDF

Info

Publication number
WO2017104146A1
WO2017104146A1 PCT/JP2016/059524 JP2016059524W WO2017104146A1 WO 2017104146 A1 WO2017104146 A1 WO 2017104146A1 JP 2016059524 W JP2016059524 W JP 2016059524W WO 2017104146 A1 WO2017104146 A1 WO 2017104146A1
Authority
WO
WIPO (PCT)
Prior art keywords
frequency
unit
analysis result
analysis
waveform data
Prior art date
Application number
PCT/JP2016/059524
Other languages
French (fr)
Japanese (ja)
Inventor
智之 三ツ橋
勉 宇高
Original Assignee
富士ゼロックス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士ゼロックス株式会社 filed Critical 富士ゼロックス株式会社
Priority to AU2016370880A priority Critical patent/AU2016370880A1/en
Priority to CN201680066037.1A priority patent/CN108351248B/en
Publication of WO2017104146A1 publication Critical patent/WO2017104146A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01HMEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
    • G01H3/00Measuring characteristics of vibrations by using a detector in a fluid

Definitions

  • the present invention relates to a diagnostic device, a diagnostic system, a diagnostic method, and a program.
  • Patent Document 1 includes a RAM (Random Access Memory) or ROM (Read Only Memory) that stores normal operation sound of the image forming apparatus, and a microphone that detects the operation sound generated from the image forming apparatus.
  • RAM Random Access Memory
  • ROM Read Only Memory
  • a system is disclosed. This system identifies an abnormal portion of the image forming apparatus based on the first sound information stored in the RAM or ROM, the second sound information detected by the microphone, and the operation information of the image forming apparatus. To do.
  • Patent Document 2 discloses an image processing apparatus having an image forming unit that forms an image on a print sheet and a transport unit that transports the print sheet.
  • the image processing apparatus includes a sound converter that converts sound inside the apparatus into an electric signal, a sound analyzer that analyzes the electric signal converted by the sound converter to obtain a component for each frequency, and the sound analyzer And an output unit that outputs a component for each obtained frequency.
  • At least one embodiment of the present invention extracts frequency and period information of a sound to be extracted from a frequency analysis result representing a temporal change in intensity distribution for each frequency obtained by frequency analysis of sound information. To be able to.
  • At least one embodiment of the present invention includes an acquisition unit that acquires sound information; A first analysis unit that performs time-frequency analysis of the sound information and generates frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency; A display for displaying the frequency analysis result waveform data; A reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data; A second analysis unit for analyzing the frequency component included in the region; It is a diagnostic apparatus provided with the extraction part which extracts the period and frequency information of the said frequency component from the analysis result by a said 2nd analysis part.
  • the reception unit when the reception unit is specified as the region including the frequency component for a region below a preset frequency, the reception unit may not receive the specification. .
  • the reception unit when the reception unit is designated as the region including the frequency component for a region below a preset frequency, the reception unit analyzes the region. The analysis result by the second analysis unit may be ignored.
  • the display unit displays the frequency analysis result waveform data generated by the first analysis unit on a touch panel
  • the accepting unit may accept designation of the region including the frequency component based on a user's touch operation on the touch panel.
  • the diagnostic device includes a communication unit that communicates with an external device; A transmission unit that transmits the information on the frequency and the frequency of the frequency component extracted by the extraction unit to the external device via the communication unit; A receiver that receives data of a frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analyzer from the external device via the communication unit; The display unit may display the frequency analysis result waveform data generated by the first analysis unit and the frequency analysis result received by the reception unit.
  • an acquisition unit that acquires sound information and time-frequency analysis of the sound information are performed, and frequency analysis result waveform data representing a time change of an intensity distribution for each frequency is generated.
  • a first analysis unit a display unit that displays the frequency analysis result waveform data; a reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data; and the frequency component included in the region
  • a second analysis unit that analyzes the frequency component, an extraction unit that extracts information on the frequency component frequency and frequency from the analysis result of the second analysis unit, a communication unit that communicates with an external device, and the extraction unit
  • a first transmission unit that transmits the information on the period and the frequency of the frequency component extracted by the information to the external device via the communication unit, and the first transmission unit generated by the first analysis unit
  • a diagnostic device comprising a receiving unit for receiving data of a frequency analysis result corresponding to the frequency analysis result waveform data from the external device via the communication unit;
  • a storage unit that stores data of
  • At least one embodiment of the present invention includes an acquisition step of acquiring sound information; A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency; A display step for displaying the frequency analysis result waveform data; An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data; A second analysis step of analyzing the frequency component included in the region; And an extraction step for extracting information on the period and frequency of the frequency component from the analysis result in the second analysis step.
  • At least one embodiment of the present invention includes an acquisition step of acquiring sound information; A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency; A display step for displaying the frequency analysis result waveform data; An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data; A second analysis step of analyzing the frequency component included in the region; It is a program for causing a computer to execute an extraction step of extracting information on the period and frequency of the frequency component from the analysis result in the second analysis step.
  • information on the frequency and period of the sound to be extracted is obtained from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. Can be extracted.
  • the user obtains the frequency analysis result of the acquired sound information and the frequency analysis result of the sound information recorded in the external device in a device equivalent to the device to be analyzed. In comparison, the cause of the generated sound can be estimated.
  • the frequency and period information of the sound to be extracted is obtained from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. Can be extracted.
  • the frequency and period information of the sound to be extracted is obtained from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. Can be extracted.
  • the frequency and period information of the sound to be extracted is extracted from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. can do.
  • FIG. 1 is a system diagram showing a configuration of an abnormal sound diagnosis system according to an embodiment of the present invention.
  • the abnormal sound diagnosis system includes a portable abnormal sound diagnosis device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50. .
  • the present invention can be applied to any device as long as the abnormal sound diagnosis device 10 can be connected to the server device 50 via the communication network.
  • the abnormal sound diagnosis device 10 will be described using a case of a tablet terminal device including a device such as a microphone capable of acquiring an audio signal and a touch panel capable of touch input.
  • the abnormal sound diagnosis apparatus 10 is carried by a service person (maintenance personnel) who performs maintenance management, repair, etc. of the image forming apparatus 20 such as a printer used by the end user.
  • the abnormal sound diagnosis apparatus 10 acquires an abnormal sound (abnormal sound) signal generated in the image forming apparatus 20, analyzes the frequency of the acquired abnormal sound signal, and analyzes the frequency of the past abnormal sound signal acquired from the server apparatus 50. This is used to display the resulting waveform and the frequency analysis result waveform of the acquired abnormal sound signal.
  • the abnormal sound diagnosis apparatus 10 and the server apparatus 50 are connected via a wireless LAN (Local Area Network) terminal 30 such as a Wi-Fi router or the Internet communication network 40 to transmit and receive information.
  • a wireless LAN (Local Area Network) terminal 30 such as a Wi-Fi router or the Internet communication network 40 to transmit and receive information.
  • the abnormal sound diagnosis device 10 is a mobile phone device, a smartphone, or the like
  • the abnormal sound diagnosis device 10 and the server device 50 are connected via a mobile phone network to transmit / receive frequency analysis result waveform data. You may do it.
  • a service person when an abnormal sound occurs in the image forming apparatus 20 that is a target electronic device installed at the end user's location, a service person carries the abnormal sound diagnosis apparatus 10 and the image forming apparatus. It is envisaged to go to 20 locations. And this service person acquires the abnormal sound signal by recording the abnormal sound generated using the abnormal sound diagnosis apparatus 10, and performs the abnormal sound diagnosis for specifying the cause of the abnormal sound.
  • FIG. 2 shows a hardware configuration of the abnormal sound diagnosis apparatus 10 in the abnormal sound diagnosis system of the present embodiment.
  • the abnormal sound diagnosis apparatus 10 performs wireless communication with the CPU 11, a memory 12 that can temporarily store data, a storage device 13 such as a flash memory, and a wireless LAN terminal 30 to perform data communication.
  • a wireless LAN interface (IF) 14 that performs transmission and reception, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. These components are connected to each other via a control bus 18.
  • the abnormal sound diagnosis apparatus 10 of the present embodiment includes a touch panel in which a touch sensor for detecting a touch position is provided on the display device 16 as the input device 15. Display is performed using this touch panel, and input from the user is performed.
  • the CPU 11 executes predetermined processing based on a control program stored in the memory 12 or the storage device 13 to control the operation of the abnormal sound diagnosis device 10.
  • this control program can be obtained by downloading it via the Internet communication network 40 or the mobile phone network and provided to the CPU 11, or the program can be stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.
  • the abnormal sound diagnosis apparatus 10 performs the operation described below by executing the control program described above, and assists the service person in identifying the cause of the abnormal sound.
  • FIG. 3 is a block diagram showing a functional configuration of the abnormal sound diagnosis apparatus 10 realized by executing the control program.
  • the abnormal sound diagnosis apparatus 10 of the present embodiment includes an audio acquisition unit 31, a frequency analysis unit 32, a control unit 33, an audio data storage unit 34, a display unit 35, and a communication unit. 36 and an audio reproduction unit 37.
  • the display unit 35 displays various data based on the control by the control unit 33.
  • the communication unit 36 communicates with the server device 50 that is an external device.
  • the audio reproduction unit 37 reproduces the recorded audio data and converts it into an audio signal.
  • the sound acquisition unit 31 inputs an abnormal sound generated in the image forming apparatus 20 that is an analysis target apparatus and acquires a sound signal.
  • the sound acquisition unit 31 has been described as acquiring an audio signal by inputting an abnormal sound generated in the image forming apparatus 20, but the sound is an example of a sound.
  • the signal is an example of sound information.
  • the frequency analysis unit 32 performs time-frequency analysis (time-dependent frequency analysis) of the audio signal acquired by the audio acquisition unit 31, and represents a frequency spectrum representing a time change of the signal intensity distribution for each frequency of the acquired abnormal sound signal. Waveform (frequency analysis result) data is generated.
  • the frequency analysis unit 32 generates frequency spectrum waveform data by performing STFT (Short Time Fourier Transform) on the audio signal acquired by the audio acquisition unit 31.
  • STFT Short Time Fourier Transform
  • the control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the audio data storage unit 34 together with the audio data. And the control part 33 displays the frequency spectrum waveform obtained by the result of STFT on the display part 35 which is a touch panel.
  • the control unit 33 Based on the user's touch operation, the designation of the region including the abnormal signal component in the displayed frequency spectrum waveform is accepted.
  • the control unit 33 performs frequency analysis in the time axis direction on the frequency components in the region designated as the region including the abnormal sound signal component in the frequency spectrum waveform data obtained by the frequency analysis unit 32.
  • the frequency analysis unit 32 is instructed to execute a fast Fourier transform (1D-FFT (Fast Fourier Transform)). Therefore, the frequency analysis unit 32 performs fast Fourier transform in the time axis direction on the frequency component included in the designated region.
  • 1D-FFT Fast Fourier Transform
  • control unit 33 extracts the period and frequency information of the abnormal sound from the analysis result of the fast Fourier transform in the frequency analysis unit 32.
  • control unit 33 may not accept the designation of a region having a frequency equal to or lower than a preset frequency even when the region is designated as a region including an abnormal sound signal component.
  • control unit 33 uses the acquired period and frequency information of the abnormal sound as well as the model name of the image forming apparatus 20, model information such as a serial number, and operation state information indicating the operation state of the image forming apparatus 20.
  • the operation status information includes information such as color printing or monochrome printing, double-sided printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included.
  • the control unit 33 transmits information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server device 50 via the communication unit 36.
  • the server device 50 obtains the original sound data and the sound data from the spectral waveform data obtained by performing frequency analysis of the sound signal of the abnormal sound generated in the past in a device equivalent to the device of the image forming device 20. Together with information such as the operating state of the device, the cause of the abnormal noise, and how to deal with the abnormal noise.
  • the server device 50 uses the frequency spectrum waveform (second waveform) corresponding to the frequency spectrum waveform data obtained as a result of frequency analysis by the frequency analysis unit 32 based on the period and frequency information of the abnormal sound transmitted from the abnormal sound diagnosis device 10. Search the frequency analysis result waveform) data. Then, the server device 50 transmits the found frequency spectrum waveform data to the abnormal sound diagnosis device 10 together with information such as audio data stored as abnormal sound sample waveform data.
  • control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.
  • the control unit 33 displays the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the spectrum waveform received from the server device 50 on the display unit 35 in parallel.
  • control unit 33 when there are a plurality of frequency spectrum waveform data transmitted from the server device 50, the control unit 33 includes the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 among the plurality of frequency spectrum waveform data. Are displayed on the display unit 35 with priority.
  • the server device 50 includes a communication unit 51, a control unit 52, and a waveform data storage unit 53, as shown in FIG.
  • the waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of abnormal sound signals generated in the past in an apparatus equivalent to the image forming apparatus 20 that is an analysis target apparatus.
  • the waveform data storage unit 53 includes frequency spectrum waveform data obtained by analyzing time-frequency analysis of abnormal sound data acquired in advance and the original sound. Information such as data, causes of abnormal noise, and countermeasures are stored for each model.
  • the control unit 52 receives the abnormal sound period or frequency information from the abnormal sound diagnosis apparatus 10
  • the control unit 52 receives the received abnormal noise data from the waveform data of the plurality of frequency spectra stored in the waveform data storage unit 53. Based on the information on the sound period and frequency, the one similar to the waveform data of the frequency spectrum based on the abnormal sound acquired in the abnormal sound diagnosis apparatus 10 is selected. Then, the control unit 52 transmits the selected waveform data to the abnormal sound diagnosis apparatus 10 via the communication unit 51.
  • Step S101 When the abnormal sound diagnosis apparatus 10 performs an abnormal sound diagnosis for identifying the cause of the abnormal sound, an image as shown in FIG. 7 is displayed, and various types of information such as the model name, serial number, and operating state are input. (Step S101).
  • the abnormal sound diagnosis apparatus 10 sets the operation mode to the voice recording mode, records the abnormal sound with the microphone 17 that is brought close to the abnormal sound generation location of the image forming apparatus 20, and acquires the voice data (step S102).
  • the acquired voice data is subjected to STFT in the frequency analysis unit 32, thereby generating a frequency spectrum waveform representing a time change of the signal intensity distribution for each frequency (step S 103).
  • STFT is a process of performing a Fourier transform every short time and calculating a signal intensity for each frequency component according to a time change.
  • FIG. 9 shows a waveform example when the analysis result obtained by this STFT is an image of one frequency spectrum waveform.
  • the horizontal axis represents time
  • the vertical axis represents frequency
  • the intensity for each frequency is represented by color.
  • this color difference is expressed by a hatching pattern.
  • FIG. 9 illustrates the case where the intensity for each frequency is expressed by color, but this intensity can also be expressed by gradation.
  • the abnormal frequency component 61 is periodically generated at a specific frequency.
  • the low frequency component is a normal operation sound and not an abnormal frequency component.
  • the control unit 33 displays the frequency spectrum waveform on the display unit 35. Then, as shown in FIG. 10, the control unit 33 performs a display that prompts the user to designate a region that is estimated to be abnormal sound, with respect to the displayed frequency spectrum waveform.
  • the text “Please specify the area that seems to be abnormal noise.” Is displayed, and the user is prompted to specify the area that is estimated to be abnormal noise. I understand.
  • the user who is presented with the frequency spectrum waveform specifies the abnormal frequency component 61, and the abnormal frequency component 61 is included by operating the touch panel, for example. Select an area.
  • FIG. 11 shows an example of the selection area 80 selected by the user in this way.
  • a rectangular region including a plurality of abnormal frequency frequency components 61 is designated as the selection region 80 when the user operates the touch panel with the finger 70.
  • the fast Fourier transform (1D-FFT) for the frequency components included in the selection area 80 is executed by the frequency analysis unit 32 (step S104).
  • FIG. 12 shows an example of analysis results of the fast Fourier transform executed in this way.
  • the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform.
  • a some period may be detected, but the period with the strongest signal strength is detected as an abnormal sound period.
  • a signal component having a long period of a predetermined period or more is considered to be normal operation sound or indefinite period noise
  • such a long-cycle signal component region is set as a determination exclusion region 62 in the determination exclusion region 62. Analysis results are ignored.
  • such a long-cycle signal component region may not be analyzed by the frequency analysis unit 32.
  • such a low frequency signal component region is set as the determination exclusion region 63, and the analysis result in the determination exclusion region 63 is as follows. It will be ignored.
  • such a low-frequency signal component region may not be analyzed by the frequency analysis unit 32.
  • the abnormal sound diagnosis apparatus 10 transmits the frequency and period information of the abnormal sound together with the model information and the operation state information to the server apparatus 50 based on the analysis result of the fast Fourier transform (step S105). For example, information such that the abnormal frequency is 4 kHz and the abnormal cycle is 2.0 seconds is transmitted to the server device 50.
  • the server device 50 searches the waveform data storage unit 53 based on the received information, thereby extracting frequency spectrum waveform data corresponding to the received information (step S106).
  • the server device 50 transmits the extracted frequency spectrum waveform data to the abnormal sound diagnosis device 10 together with information such as the original voice data, the cause of the abnormal noise, and a countermeasure method thereof (step S107).
  • the abnormal sound diagnosis apparatus 10 receives the frequency spectrum waveform data transmitted from the server apparatus 50 (step S108). Then, the control unit 33 of the abnormal sound diagnosis apparatus 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by the STFT on the display unit 35 (step S109).
  • FIG. 13 shows a screen example of the abnormal sound diagnosis apparatus 10 in which two frequency spectrum waveforms are displayed in this way.
  • the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as “analysis result waveform of abnormal sound recorded this time”, and the frequency spectrum waveform transmitted from the server device 50 is displayed. It can be seen that “Past abnormal noise data” is displayed together with the cause of abnormal noise “Wearing of the photosensitive drum”.
  • a serviceman who wants to perform an abnormal noise diagnosis compares the two frequency spectrum waveforms and determines whether or not the abnormal noise components in the waveforms are similar, thereby specifying the cause of the abnormal noise.
  • FIG. 14 shows an example of an image when an abnormal noise frequency spectrum waveform is displayed when the abnormal noise is caused by a “drive system motor failure”.
  • the service person determines whether the frequency spectrum waveform of the abnormal sound acquired this time is more similar to which frequency spectrum waveform is abnormal. Identify the cause of When identifying the cause of this abnormal noise, not only simply comparing the shape of the frequency spectrum waveform, the period or frequency of the abnormal noise component, but also reproducing the original audio data by the audio reproducing unit 37
  • the cause of the abnormal sound may be specified by listening to and comparing the acquired abnormal sound with the sound corresponding to the frequency spectrum waveform transmitted from the server device 50.
  • the abnormal sound diagnosis device 10 is a tablet terminal device.
  • the present invention is not limited to this, and even when another device is used as the abnormal sound diagnosis device.
  • the present invention can be applied.
  • the operation panel of the image forming apparatus 20 is detachable from the main body, and is configured to be able to communicate with the server apparatus 50 and incorporate an audio signal acquisition function, the operation panel is A diagnostic device may be used.
  • the abnormal sound diagnosis apparatus 10 includes the microphone 17 .
  • the abnormal sound diagnosis apparatus 10 has a voice recording function, a collection of microphones and the like is possible. You may make it implement
  • this invention is not limited to such a structure.
  • the noise is generated by other methods, such as when the frequency that is estimated to be abnormal is directly input by numbers, or when the area is specified by mouse operation.
  • the present invention can be applied in the same manner even when an area that is estimated to be designated.
  • the target device for abnormal noise analysis is an image forming apparatus.
  • the target device for abnormal noise analysis is not limited to an image forming apparatus.
  • the present invention can be similarly applied to other devices as long as they are devices capable of generating periodic noise.

Abstract

A sound acquisition unit (31) accepts input of an abnormal sound produced in an image formation device (20) to acquire a sound signal. A frequency analysis unit (32) performs a STFT (short-time Fourier transform) of the acquired sound signal to generate frequency spectrum waveform data. A control unit (33) displays this frequency spectrum waveform on a touch panel, and on the basis of a touch operation by a user, receives a designation of the region containing the signal component of the abnormal sound in the frequency spectrum waveform that is displayed. The frequency analysis unit (32) performs a fast Fourier transform in the time-axis direction with respect to the frequency component included in the designated region. The control unit (33) extracts information of the period and frequency of the abnormal sound from an analysis result of the fast Fourier transform in the frequency analysis unit (32).

Description

診断装置、診断システム、診断方法およびプログラムDiagnostic device, diagnostic system, diagnostic method and program
 本発明は、診断装置、診断システム、診断方法およびプログラムに関する。 The present invention relates to a diagnostic device, a diagnostic system, a diagnostic method, and a program.
 特許文献1には、画像形成装置の正常時の動作音を記憶しているRAM(Random Access Memory)またはROM(Read Only Memory)と、画像形成装置から発生する動作音を検知するマイクロフォンとを有するシステムが開示されている。このシステムは、RAMまたはROMに記憶されている第1の音情報と、マイクロフォンにより検知された第2の音情報と、画像形成装置の動作情報とに基づいて、画像形成装置の異常箇所を特定する。 Patent Document 1 includes a RAM (Random Access Memory) or ROM (Read Only Memory) that stores normal operation sound of the image forming apparatus, and a microphone that detects the operation sound generated from the image forming apparatus. A system is disclosed. This system identifies an abnormal portion of the image forming apparatus based on the first sound information stored in the RAM or ROM, the second sound information detected by the microphone, and the operation information of the image forming apparatus. To do.
 特許文献2には、印刷用紙上に画像を形成する画像形成部と前記印刷用紙を搬送する搬送部とを有する画像処理装置が開示されている。この画像処理装置は、装置内部の音を電気信号に変換する音変換部と、この音変換部が変換した電気信号を解析して周波数ごとの成分を求める音解析部と、この音解析部が求めた周波数ごとの成分を出力する出力部とをさらに備えている。 Patent Document 2 discloses an image processing apparatus having an image forming unit that forms an image on a print sheet and a transport unit that transports the print sheet. The image processing apparatus includes a sound converter that converts sound inside the apparatus into an electric signal, a sound analyzer that analyzes the electric signal converted by the sound converter to obtain a component for each frequency, and the sound analyzer And an output unit that outputs a component for each obtained frequency.
日本国特開2007-079263号公報Japanese Unexamined Patent Publication No. 2007-079263 日本国特開2008-290288号公報Japanese Unexamined Patent Publication No. 2008-290288
 本発明の少なくとも一の実施形態は、音情報を周波数解析することにより得られた、周波数毎の強度分布の時間変化を表した周波数解析結果から、抽出すべき音の周波数および周期の情報を抽出することができるようにする。 At least one embodiment of the present invention extracts frequency and period information of a sound to be extracted from a frequency analysis result representing a temporal change in intensity distribution for each frequency obtained by frequency analysis of sound information. To be able to.
[診断装置]
 [1] 本発明の少なくとも一の実施形態は、音情報を取得する取得部と、
 前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析部と、
 前記周波数解析結果波形データを表示する表示部と、
 表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付部と、
 前記領域に含まれる前記周波数成分を解析する第2解析部と、
 前記第2解析部による解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出部と、を備えた診断装置である。
[Diagnostic equipment]
[1] At least one embodiment of the present invention includes an acquisition unit that acquires sound information;
A first analysis unit that performs time-frequency analysis of the sound information and generates frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
A display for displaying the frequency analysis result waveform data;
A reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data;
A second analysis unit for analyzing the frequency component included in the region;
It is a diagnostic apparatus provided with the extraction part which extracts the period and frequency information of the said frequency component from the analysis result by a said 2nd analysis part.
 [2] [1]に記載の診断装置において、前記受付部は、予め設定された周波数以下の領域について前記周波数成分を含む前記領域として指定された場合には、当該指定を受付けなくてもよい。 [2] In the diagnostic device according to [1], when the reception unit is specified as the region including the frequency component for a region below a preset frequency, the reception unit may not receive the specification. .
 [3] [1]に記載の診断装置において、前記受付部は、予め設定された周波数以下の領域について前記周波数成分を含む前記領域として指定された場合には、前記第2解析部によって解析しなくてもよい、又は前記第2解析部による解析結果を無視してもよい。 [3] In the diagnostic apparatus according to [1], when the reception unit is designated as the region including the frequency component for a region below a preset frequency, the reception unit analyzes the region. The analysis result by the second analysis unit may be ignored.
 [4] [1]から[3]のいずれかに記載の診断装置において、前記表示部が、前記第1解析部により生成された前記周波数解析結果波形データをタッチパネル上に表示し、
 前記受付部は、前記タッチパネル上における使用者のタッチ操作に基づいて、前記周波数成分を含む前記領域の指定を受付けてもよい。
[4] In the diagnostic apparatus according to any one of [1] to [3], the display unit displays the frequency analysis result waveform data generated by the first analysis unit on a touch panel,
The accepting unit may accept designation of the region including the frequency component based on a user's touch operation on the touch panel.
 [5] [1]から[4]のいずれかに記載の診断装置は、外部装置との間で通信を行う通信部と、
 前記抽出部により抽出された前記周波数成分の前記周期および前記周波数の前記情報を前記通信部を介して前記外部装置に送信する送信部と、
 前記第1解析部により生成された前記周波数解析結果波形データに対応する周波数解析結果のデータを前記通信部を介して前記外部装置から受信する受信部とをさらに備えていてよく、
 前記表示部は、前記第1解析部により生成された前記周波数解析結果波形データと、前記受信部により受信された前記周波数解析結果とを表示してもよい。
[5] The diagnostic device according to any one of [1] to [4] includes a communication unit that communicates with an external device;
A transmission unit that transmits the information on the frequency and the frequency of the frequency component extracted by the extraction unit to the external device via the communication unit;
A receiver that receives data of a frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analyzer from the external device via the communication unit;
The display unit may display the frequency analysis result waveform data generated by the first analysis unit and the frequency analysis result received by the reception unit.
[診断システム]
 [6] 本発明の少なくとも一の実施形態は、音情報を取得する取得部と、前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析部と、前記周波数解析結果波形データを表示する表示部と、表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付部と、前記領域に含まれる前記周波数成分を解析する第2解析部と、前記第2解析部による解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出部と、外部装置との間で通信を行う通信部と、前記抽出部により抽出された前記周波数成分の前記周期および前記周波数の前記情報を前記通信部を介して前記外部装置に送信する第1の送信部と、前記第1解析部により生成された前記周波数解析結果波形データに対応する周波数解析結果のデータを前記通信部を介して前記外部装置から受信する受信部とを備えた診断装置と、
 異音の音情報の周波数解析を行って得られた複数の周波数解析結果のデータを格納する格納部と、前記診断装置から前記周波数成分の前記周期および前記周波数の前記情報を受信した場合、前記格納部に格納されている前記複数の周波数解析結果のデータの中から、受信した前記周波数成分の前記周期および前記周波数の前記情報に対応するものを選択して前記診断装置に送信する第2の送信部とを備えたサーバ装置と、を備えた診断システムである。
[Diagnostic system]
[6] In at least one embodiment of the present invention, an acquisition unit that acquires sound information and time-frequency analysis of the sound information are performed, and frequency analysis result waveform data representing a time change of an intensity distribution for each frequency is generated. A first analysis unit; a display unit that displays the frequency analysis result waveform data; a reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data; and the frequency component included in the region A second analysis unit that analyzes the frequency component, an extraction unit that extracts information on the frequency component frequency and frequency from the analysis result of the second analysis unit, a communication unit that communicates with an external device, and the extraction unit A first transmission unit that transmits the information on the period and the frequency of the frequency component extracted by the information to the external device via the communication unit, and the first transmission unit generated by the first analysis unit A diagnostic device comprising a receiving unit for receiving data of a frequency analysis result corresponding to the frequency analysis result waveform data from the external device via the communication unit;
A storage unit that stores data of a plurality of frequency analysis results obtained by performing frequency analysis of abnormal sound information, and when the information on the period and the frequency of the frequency component is received from the diagnostic device, The second frequency analysis result data stored in the storage unit is selected from the received frequency component corresponding to the period and the information of the frequency, and transmitted to the diagnostic device. And a server device including a transmission unit.
[診断方法]
 [7] 本発明の少なくとも一の実施形態は、音情報を取得する取得ステップと、
 前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析ステップと、
 前記周波数解析結果波形データを表示する表示ステップと、
 表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付ステップと、
 前記領域に含まれる前記周波数成分を解析する第2解析ステップと、
 前記第2解析ステップにおける解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出ステップと、を備えた診断方法である。
[Diagnosis method]
[7] At least one embodiment of the present invention includes an acquisition step of acquiring sound information;
A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
A display step for displaying the frequency analysis result waveform data;
An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data;
A second analysis step of analyzing the frequency component included in the region;
And an extraction step for extracting information on the period and frequency of the frequency component from the analysis result in the second analysis step.
[プログラム]
 [8] 本発明の少なくとも一の実施形態は、音情報を取得する取得ステップと、
 前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析ステップと、
 前記周波数解析結果波形データを表示する表示ステップと、
 表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付ステップと、
 前記領域に含まれる前記周波数成分を解析する第2解析ステップと、
 前記第2解析ステップにおける解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出ステップと、をコンピュータに実行させるためのプログラムである。
[program]
[8] At least one embodiment of the present invention includes an acquisition step of acquiring sound information;
A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
A display step for displaying the frequency analysis result waveform data;
An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data;
A second analysis step of analyzing the frequency component included in the region;
It is a program for causing a computer to execute an extraction step of extracting information on the period and frequency of the frequency component from the analysis result in the second analysis step.
 [1]に記載の診断装置によれば、音情報を周波数解析することにより得られた周波数毎の強度分布の時間変化を表した周波数解析結果から、抽出すべき音の周波数および周期の情報を抽出することができる。 According to the diagnostic device described in [1], information on the frequency and period of the sound to be extracted is obtained from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. Can be extracted.
 [2]に記載の診断装置によれば、予め設定された周波数以下の領域が誤って指定された場合でも、抽出すべき音の周波数および周期の情報の抽出精度が悪化することを防ぐことができる。 According to the diagnostic device described in [2], it is possible to prevent deterioration in the extraction accuracy of the information on the frequency and period of the sound to be extracted even when a region below a preset frequency is erroneously designated. it can.
 [3]に記載の診断装置によれば、予め設定された周波数以下の領域が誤って指定された場合でも、抽出すべき音の周波数および周期の情報の抽出精度が悪化することを防ぐことができる。 According to the diagnostic device described in [3], even when a region below a preset frequency is erroneously designated, it is possible to prevent deterioration in the extraction accuracy of information on the frequency and period of the sound to be extracted. it can.
 [4]に記載の診断装置によれば、使用者によるタッチ操作で抽出すべき音の周波数成分が含まれる領域の指定を行うことができる。 According to the diagnostic device described in [4], it is possible to specify a region including a frequency component of a sound to be extracted by a user's touch operation.
 [5]に記載の診断装置によれば、使用者は、取得した音情報の周波数解析結果と、解析対象の装置と同等の装置において外部装置に記録されている音情報の周波数解析結果とを比較して、発生した音の原因を推定することができる。 According to the diagnostic device described in [5], the user obtains the frequency analysis result of the acquired sound information and the frequency analysis result of the sound information recorded in the external device in a device equivalent to the device to be analyzed. In comparison, the cause of the generated sound can be estimated.
 [6]に記載の診断システムによれば、音情報を周波数解析することにより得られた周波数毎の強度分布の時間変化を表した周波数解析結果から、抽出すべき音の周波数および周期の情報を抽出することができる。 According to the diagnostic system described in [6], the frequency and period information of the sound to be extracted is obtained from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. Can be extracted.
 [7]に記載の診断方法によれば、音情報を周波数解析することにより得られた周波数毎の強度分布の時間変化を表した周波数解析結果から、抽出すべき音の周波数および周期の情報を抽出することができる。 According to the diagnostic method described in [7], the frequency and period information of the sound to be extracted is obtained from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. Can be extracted.
 [8]に記載のプログラムによれば、音情報を周波数解析することにより得られた周波数毎の強度分布の時間変化を表した周波数解析結果から、抽出すべき音の周波数および周期の情報を抽出することができる。 According to the program described in [8], the frequency and period information of the sound to be extracted is extracted from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. can do.
本発明の一実施形態の異音診断システムの構成を示すシステム図である。It is a system diagram showing a configuration of an abnormal sound diagnosis system of one embodiment of the present invention. 本発明の一実施形態における異音診断装置10のハードウェア構成を示すブロック図である。It is a block diagram which shows the hardware constitutions of the abnormal sound diagnostic apparatus 10 in one Embodiment of this invention. 本発明の一実施形態における異音診断装置10の機能構成を示すブロック図である。It is a block diagram which shows the function structure of the abnormal sound diagnostic apparatus 10 in one Embodiment of this invention. 本発明の一実施形態におけるサーバ装置50の機能構成を示すブロック図である。It is a block diagram which shows the function structure of the server apparatus 50 in one Embodiment of this invention. 図4中の波形データ格納部53に格納される情報の一例を示す図である。It is a figure which shows an example of the information stored in the waveform data storage part 53 in FIG. 本発明の一実施形態の異音診断システムの動作を説明するためのシーケンスチャートである。It is a sequence chart for demonstrating operation | movement of the abnormal sound diagnostic system of one Embodiment of this invention. 機種名、シリアル番号、動作状態等の各種情報を入力する際の異音診断装置10の表示画面例を示す図である。It is a figure which shows the example of a display screen of the abnormal sound diagnostic apparatus 10 at the time of inputting various information, such as a model name, a serial number, and an operation state. STFTの概念を説明するための図である。It is a figure for demonstrating the concept of STFT. STFTにより得られた解析結果に基づく周波数スペクトラム波形の画像例を示す図である。It is a figure which shows the example of an image of the frequency spectrum waveform based on the analysis result obtained by STFT. 周波数スペクトル波形をユーザに提示する際に、異音であると推定される領域を指定するようユーザに促すような表示を行った場合の一例を示す図である。It is a figure which shows an example at the time of showing to a user to designate the area | region estimated to be abnormal sound when showing a frequency spectrum waveform to a user. 図10の周波数スペクトラム波形の画像例において、ユーザにより選択された選択領域80の一例を示す図である。It is a figure which shows an example of the selection area | region 80 selected by the user in the image example of the frequency spectrum waveform of FIG. 高速フーリエ変換の解析結果例を示す図である。It is a figure which shows the example of an analysis result of a fast Fourier transform. 2つの周波数スペクトル波形が表示された異音診断装置10の画面例を示す図である。It is a figure which shows the example of a screen of the abnormal sound diagnostic apparatus 10 by which two frequency spectrum waveforms were displayed. 図13に示した画面例に対して、異音原因が異なる別の周波数スペクトル波形が表示された場合の画像例を示す図である。It is a figure which shows the example of an image when another frequency spectrum waveform from which the cause of abnormal noise differs is displayed with respect to the example of a screen shown in FIG.
 次に、本発明の実施の形態について図面を参照して詳細に説明する。 Next, embodiments of the present invention will be described in detail with reference to the drawings.
 図1は本発明の一実施形態の異音診断システムの構成を示すシステム図である。 FIG. 1 is a system diagram showing a configuration of an abnormal sound diagnosis system according to an embodiment of the present invention.
 本発明の一実施形態の異音診断システムは、図1に示されるように、パーソナルコンピュータ、スマートフォン、タブレット端末装置等の携帯可能な異音診断装置10と、サーバ装置50とから構成されている。 As shown in FIG. 1, the abnormal sound diagnosis system according to an embodiment of the present invention includes a portable abnormal sound diagnosis device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50. .
 なお、異音診断装置10は、通信ネットワークを介してサーバ装置50に接続可能な装置であれば、どのような装置であっても、本発明を適用可能である。ただし、本実施形態では、異音診断装置10が、音声信号を取得可能なマイク等の装置および、タッチ入力が可能なタッチパネルを備えたタブレット端末装置の場合を用いて説明する。 Note that the present invention can be applied to any device as long as the abnormal sound diagnosis device 10 can be connected to the server device 50 via the communication network. However, in the present embodiment, the abnormal sound diagnosis device 10 will be described using a case of a tablet terminal device including a device such as a microphone capable of acquiring an audio signal and a touch panel capable of touch input.
 異音診断装置10は、例えば、エンドユーザが使用しているプリンタ等の画像形成装置20の保守管理、修理等を行うサービスマン(保守要員)により携帯される。異音診断装置10は、画像形成装置20において発生した異音(異常音)信号を取得して、取得した異音信号を周波数解析し、サーバ装置50から取得した過去の異音信号の周波数解析結果の波形と取得した異音信号の周波数解析結果波形とを表示するために使用される。 The abnormal sound diagnosis apparatus 10 is carried by a service person (maintenance personnel) who performs maintenance management, repair, etc. of the image forming apparatus 20 such as a printer used by the end user. The abnormal sound diagnosis apparatus 10 acquires an abnormal sound (abnormal sound) signal generated in the image forming apparatus 20, analyzes the frequency of the acquired abnormal sound signal, and analyzes the frequency of the past abnormal sound signal acquired from the server apparatus 50. This is used to display the resulting waveform and the frequency analysis result waveform of the acquired abnormal sound signal.
 異音診断装置10と、サーバ装置50とは、Wi-Fiルータ等の無線LAN(Local Area Network)ターミナル30や、インターネット通信網40を介して接続され情報の送受信を行っている。 The abnormal sound diagnosis apparatus 10 and the server apparatus 50 are connected via a wireless LAN (Local Area Network) terminal 30 such as a Wi-Fi router or the Internet communication network 40 to transmit and receive information.
 なお、異音診断装置10が携帯電話装置やスマートフォン等の場合には、異音診断装置10とサーバ装置50とを携帯電話回線網を介して接続して、周波数解析結果波形データの送受信を行うようにしてもよい。 When the abnormal sound diagnosis device 10 is a mobile phone device, a smartphone, or the like, the abnormal sound diagnosis device 10 and the server device 50 are connected via a mobile phone network to transmit / receive frequency analysis result waveform data. You may do it.
 本実施形態の異音診断システムでは、エンドユーザの場所に設置された対象電子機器である画像形成装置20に異音が発生した場合、サービスマンが異音診断装置10を携帯して画像形成装置20の場所に出向くことが想定されている。そして、このサービスマンが、異音診断装置10を用いて発生している異音を録音することにより異音信号を取得して、異音の原因を特定する異音診断を行う。 In the abnormal sound diagnosis system of the present embodiment, when an abnormal sound occurs in the image forming apparatus 20 that is a target electronic device installed at the end user's location, a service person carries the abnormal sound diagnosis apparatus 10 and the image forming apparatus. It is envisaged to go to 20 locations. And this service person acquires the abnormal sound signal by recording the abnormal sound generated using the abnormal sound diagnosis apparatus 10, and performs the abnormal sound diagnosis for specifying the cause of the abnormal sound.
 なお、画像形成装置20にマイク等を設けて録音機能を持たせて、異音が発生した場合にその録音機能により異音を録音させることも技術的には可能である。しかしながら、画像形成装置20がエンドユーザのオフィス等に設置される場合、この画像形成装置20に音声を録音する機能を設けることはセキュリティ上の理由により実現することが困難である。 It should be noted that it is technically possible to provide a recording function by providing a microphone or the like in the image forming apparatus 20 and to record the abnormal sound using the recording function when the abnormal sound occurs. However, when the image forming apparatus 20 is installed in an end user's office or the like, it is difficult to provide the image forming apparatus 20 with a sound recording function for security reasons.
 次に、本実施形態の異音診断システムにおける異音診断装置10のハードウェア構成を図2に示す。 Next, FIG. 2 shows a hardware configuration of the abnormal sound diagnosis apparatus 10 in the abnormal sound diagnosis system of the present embodiment.
 異音診断装置10は、図2に示されるように、CPU11、一時的にデータを保存可能なメモリ12、フラッシュメモリ等の記憶装置13、無線LANターミナル30との間で無線通信を行ってデータの送信及び受信を行う無線LANインタフェース(IF)14、タッチセンサ等の入力装置15、表示装置16、マイク17を有する。これらの構成要素は、制御バス18を介して互いに接続されている。 As shown in FIG. 2, the abnormal sound diagnosis apparatus 10 performs wireless communication with the CPU 11, a memory 12 that can temporarily store data, a storage device 13 such as a flash memory, and a wireless LAN terminal 30 to perform data communication. A wireless LAN interface (IF) 14 that performs transmission and reception, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. These components are connected to each other via a control bus 18.
 本実施形態の異音診断装置10では、表示装置16上にタッチ位置を検出するためのタッチセンサが入力装置15として設けられたタッチパネルが備えられている。このタッチパネルを用いて表示が行われるとともにユーザからの入力が行われる。 The abnormal sound diagnosis apparatus 10 of the present embodiment includes a touch panel in which a touch sensor for detecting a touch position is provided on the display device 16 as the input device 15. Display is performed using this touch panel, and input from the user is performed.
 CPU11は、メモリ12または記憶装置13に格納された制御プログラムに基づいて所定の処理を実行して、異音診断装置10の動作を制御する。なお、この制御プログラムは、インターネット通信網40や携帯電話回線網を介してダウンロードすることにより入手してCPU11に提供することも可能であるし、当該プログラムをCD-ROM等の記憶媒体に格納してCPU11に提供することも可能である。 The CPU 11 executes predetermined processing based on a control program stored in the memory 12 or the storage device 13 to control the operation of the abnormal sound diagnosis device 10. Note that this control program can be obtained by downloading it via the Internet communication network 40 or the mobile phone network and provided to the CPU 11, or the program can be stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.
 本実施形態の異音診断装置10は、上記の制御プログラムが実行されることにより以下に説明するような動作を行って、サービスマンが異音の原因を特定する業務の手助けを行う。 The abnormal sound diagnosis apparatus 10 according to the present embodiment performs the operation described below by executing the control program described above, and assists the service person in identifying the cause of the abnormal sound.
 図3は、上記の制御プログラムが実行されることにより実現される異音診断装置10の機能構成を示すブロック図である。 FIG. 3 is a block diagram showing a functional configuration of the abnormal sound diagnosis apparatus 10 realized by executing the control program.
 本実施形態の異音診断装置10は、図3に示されるように、音声取得部31と、周波数解析部32と、制御部33と、音声データ格納部34と、表示部35と、通信部36と、音声再生部37とを備えている。 As shown in FIG. 3, the abnormal sound diagnosis apparatus 10 of the present embodiment includes an audio acquisition unit 31, a frequency analysis unit 32, a control unit 33, an audio data storage unit 34, a display unit 35, and a communication unit. 36 and an audio reproduction unit 37.
 表示部35は、制御部33による制御に基づいて各種データの表示を行う。通信部36は、外部装置であるサーバ装置50との間で通信を行う。音声再生部37は制御部33による制御に基づいて、録音された音声データ等を再生して音声信号に変換する。 The display unit 35 displays various data based on the control by the control unit 33. The communication unit 36 communicates with the server device 50 that is an external device. Based on the control by the control unit 33, the audio reproduction unit 37 reproduces the recorded audio data and converts it into an audio signal.
 音声取得部31は、解析対象の装置である画像形成装置20において発生した異音の音声を入力して音声信号を取得する。 The sound acquisition unit 31 inputs an abnormal sound generated in the image forming apparatus 20 that is an analysis target apparatus and acquires a sound signal.
 なお、本実施形態では、音声取得部31が、画像形成装置20において発生した異音の音声を入力して音声信号を取得するものとして説明しているが、音声は音の一例であり、音声信号は音情報の一例である。 In the present embodiment, the sound acquisition unit 31 has been described as acquiring an audio signal by inputting an abnormal sound generated in the image forming apparatus 20, but the sound is an example of a sound. The signal is an example of sound information.
 周波数解析部32は、音声取得部31により取得された音声信号の時間周波数解析(時間依存周波数解析)を行って、取得された異音信号の周波数毎の信号強度分布の時間変化を表す周波数スペクトル波形(周波数解析結果)データを生成する。 The frequency analysis unit 32 performs time-frequency analysis (time-dependent frequency analysis) of the audio signal acquired by the audio acquisition unit 31, and represents a frequency spectrum representing a time change of the signal intensity distribution for each frequency of the acquired abnormal sound signal. Waveform (frequency analysis result) data is generated.
 具体的には、周波数解析部32は、音声取得部31により取得された音声信号に対してSTFT(Short time Fourier transform:短時間フーリエ変換)を行うことにより周波数スペクトル波形データを生成する。STFTについては後で説明する。 Specifically, the frequency analysis unit 32 generates frequency spectrum waveform data by performing STFT (Short Time Fourier Transform) on the audio signal acquired by the audio acquisition unit 31. The STFT will be described later.
 制御部33は、周波数解析部32により得られた周波数スペクトル波形データを音声データとともに音声データ格納部34に格納する。そして、制御部33は、STFTの結果により得られた周波数スペクトル波形を、タッチパネルである表示部35上に表示する。 The control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the audio data storage unit 34 together with the audio data. And the control part 33 displays the frequency spectrum waveform obtained by the result of STFT on the display part 35 which is a touch panel.
 その後、ユーザがタッチパネルである表示部35上に表示された周波数スペクトル波形において、異音の信号成分であると推測される領域を指でなぞる等のタッチ操作を行うと、制御部33は、このユーザのタッチ操作に基づいて、表示された周波数スペクトル波形における異音の信号成分が含まれる領域の指定を受付ける。 Thereafter, when the user performs a touch operation such as tracing a region that is assumed to be an abnormal signal component in the frequency spectrum waveform displayed on the display unit 35 that is a touch panel, the control unit 33 Based on the user's touch operation, the designation of the region including the abnormal signal component in the displayed frequency spectrum waveform is accepted.
 すると、制御部33は、周波数解析部32により得られた周波数スペクトル波形データのうち、異音の信号成分が含まれる領域として指定された領域の周波数成分に対して時間軸方向に周波数解析を行う高速フーリエ変換(1D-FFT(Fast Fourier Transform))の実行を周波数解析部32に指示する。そのため、周波数解析部32は、指示された領域に含まれる周波数成分に対して時間軸方向に高速フーリエ変換を行う。 Then, the control unit 33 performs frequency analysis in the time axis direction on the frequency components in the region designated as the region including the abnormal sound signal component in the frequency spectrum waveform data obtained by the frequency analysis unit 32. The frequency analysis unit 32 is instructed to execute a fast Fourier transform (1D-FFT (Fast Fourier Transform)). Therefore, the frequency analysis unit 32 performs fast Fourier transform in the time axis direction on the frequency component included in the designated region.
 そして、制御部33は、周波数解析部32における高速フーリエ変換の解析結果から異音の周期および周波数の情報を抽出する。 Then, the control unit 33 extracts the period and frequency information of the abnormal sound from the analysis result of the fast Fourier transform in the frequency analysis unit 32.
 なお、異音が発生していない場合でも予め設定された周波数以下の低周波数の領域には、通常動作音の信号成分が常に含まれている。そのため、制御部33は、予め設定された周波数以下の領域については、異音の信号成分が含まれる領域として指定された場合でも、その指定を受付けないようにしても良い。 It should be noted that even when no abnormal noise is generated, the signal component of the normal operation sound is always included in the low frequency region below the preset frequency. For this reason, the control unit 33 may not accept the designation of a region having a frequency equal to or lower than a preset frequency even when the region is designated as a region including an abnormal sound signal component.
 また、制御部33は、取得した異音の周期および周波数の情報を、画像形成装置20の機種名、シリアル番号等の機種情報、画像形成装置20の動作状態を示す動作状態情報とともに通信部36を介してサーバ装置50に送信する。この動作状態情報は、具体的には、カラー印刷なのか白黒印刷なのか、両面印刷なのか片面印刷なのか、動作モードはスキャン、プリント、複写のいずれなのか、使用用紙の種類等の情報を含むことができる。このようにして、制御部33は、周波数解析部32により得られた周波数スペクトル波形データから得られた情報を、通信部36を介してサーバ装置50に送信する。 In addition, the control unit 33 uses the acquired period and frequency information of the abnormal sound as well as the model name of the image forming apparatus 20, model information such as a serial number, and operation state information indicating the operation state of the image forming apparatus 20. To the server device 50 via Specifically, the operation status information includes information such as color printing or monochrome printing, double-sided printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included. In this way, the control unit 33 transmits information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server device 50 via the communication unit 36.
 サーバ装置50は、画像形成装置20の装置と同等の装置において過去に発生した異音の音声信号の周波数解析を行って得られるスペクトル波形データを、元の音声データ、その音声データが取得された際の装置の動作状態、異音原因、異音への対処方法等の情報とともに格納している。 The server device 50 obtains the original sound data and the sound data from the spectral waveform data obtained by performing frequency analysis of the sound signal of the abnormal sound generated in the past in a device equivalent to the device of the image forming device 20. Together with information such as the operating state of the device, the cause of the abnormal noise, and how to deal with the abnormal noise.
 サーバ装置50は、異音診断装置10から送信されてきた異音の周期および周波数の情報から、周波数解析部32による周波数解析の結果得られた周波数スペクトル波形データに対応する周波数スペクトル波形(第2の周波数解析結果の波形)データを検索する。そしてサーバ装置50は、見つかった周波数スペクトル波形データを異音のサンプル波形データとして格納している音声データ等の情報等とともに異音診断装置10に送信する。 The server device 50 uses the frequency spectrum waveform (second waveform) corresponding to the frequency spectrum waveform data obtained as a result of frequency analysis by the frequency analysis unit 32 based on the period and frequency information of the abnormal sound transmitted from the abnormal sound diagnosis device 10. Search the frequency analysis result waveform) data. Then, the server device 50 transmits the found frequency spectrum waveform data to the abnormal sound diagnosis device 10 together with information such as audio data stored as abnormal sound sample waveform data.
 この結果、制御部33は、周波数解析部32による周波数解析の結果得られた周波数スペクトル波形データに対応する周波数スペクトル波形データを通信部36を介してサーバ装置50から受信する。 As a result, the control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.
 制御部33は、音声取得部31により取得された音声信号の周波数解析を行って得られた周波数スペクトル波形と、サーバ装置50から受信したスペクトル波形とを、表示部35に並列に表示する。 The control unit 33 displays the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the spectrum waveform received from the server device 50 on the display unit 35 in parallel.
 なお、制御部33は、サーバ装置50から送信されてきた周波数スペクトル波形データが複数存在する場合、複数の周波数スペクトル波形データのうち、周波数解析部32の周波数解析によって得られた周波数スペクトル波形データとの類似度が高いものを優先して表示部35に表示する。 In addition, when there are a plurality of frequency spectrum waveform data transmitted from the server device 50, the control unit 33 includes the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 among the plurality of frequency spectrum waveform data. Are displayed on the display unit 35 with priority.
 次に、本実施形態の異音解析システムにおけるサーバ装置50の機能構成を図4のブロック図を参照して説明する。 Next, the functional configuration of the server device 50 in the abnormal sound analysis system of this embodiment will be described with reference to the block diagram of FIG.
 本実施形態のサーバ装置50は、図4に示されるように、通信部51と、制御部52と、波形データ格納部53とを備えている。 The server device 50 according to the present embodiment includes a communication unit 51, a control unit 52, and a waveform data storage unit 53, as shown in FIG.
 波形データ格納部53は、解析対象の装置である画像形成装置20と同等の装置において過去に発生した異音の音声信号の周波数解析を行って得られる複数の周波数スペクトル波形データを格納する。 The waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of abnormal sound signals generated in the past in an apparatus equivalent to the image forming apparatus 20 that is an analysis target apparatus.
 具体的には、波形データ格納部53は、図5に示されるように、予め取得された異音の音声データを時間周波数解析することにより得られた周波数スペクトル波形データと、元となった音声データと、異音の原因と、その対処方法等の情報が機種毎に格納している。 Specifically, as shown in FIG. 5, the waveform data storage unit 53 includes frequency spectrum waveform data obtained by analyzing time-frequency analysis of abnormal sound data acquired in advance and the original sound. Information such as data, causes of abnormal noise, and countermeasures are stored for each model.
 そして、制御部52は、異音診断装置10から異音の周期や周波数の情報を受信した場合、波形データ格納部53に格納されている複数の周波数スペクトルの波形データの中から、受信した異音周期や周波数の情報に基づいて、異音診断装置10において取得された異音に基づく周波数スペクトルの波形データに類似するものを選択する。そして、制御部52は、選択した波形データを通信部51を介して異音診断装置10に送信する。 Then, when the control unit 52 receives the abnormal sound period or frequency information from the abnormal sound diagnosis apparatus 10, the control unit 52 receives the received abnormal noise data from the waveform data of the plurality of frequency spectra stored in the waveform data storage unit 53. Based on the information on the sound period and frequency, the one similar to the waveform data of the frequency spectrum based on the abnormal sound acquired in the abnormal sound diagnosis apparatus 10 is selected. Then, the control unit 52 transmits the selected waveform data to the abnormal sound diagnosis apparatus 10 via the communication unit 51.
 次に、本実施形態の異音診断システムの動作を図6のシーケンスチャートを参照して説明する。 Next, the operation of the abnormal sound diagnosis system of this embodiment will be described with reference to the sequence chart of FIG.
 異音診断装置10において異音の原因を特定するための異音診断を行おうとする場合、図7に示すような画像が表示されて、機種名、シリアル番号、動作状態等の各種情報が入力される(ステップS101)。 When the abnormal sound diagnosis apparatus 10 performs an abnormal sound diagnosis for identifying the cause of the abnormal sound, an image as shown in FIG. 7 is displayed, and various types of information such as the model name, serial number, and operating state are input. (Step S101).
 異音診断装置10は、動作モードを音声録音モードにして、画像形成装置20の異音発生個所に近づけられたマイク17により異音の録音を行って、音声データを取得する(ステップS102)。 The abnormal sound diagnosis apparatus 10 sets the operation mode to the voice recording mode, records the abnormal sound with the microphone 17 that is brought close to the abnormal sound generation location of the image forming apparatus 20, and acquires the voice data (step S102).
 異音診断装置10では、取得された音声データが周波数解析部32においてSTFTが行われることにより、周波数毎の信号強度分布の時間変化を表した周波数スペクトル波形が生成される(ステップS103)。 In the abnormal sound diagnosis apparatus 10, the acquired voice data is subjected to STFT in the frequency analysis unit 32, thereby generating a frequency spectrum waveform representing a time change of the signal intensity distribution for each frequency (step S 103).
 STFTは、図8に示されるように、短時間毎にフーリエ変換を行って周波数成分毎の信号強度を時間変化に応じて演算する処理である。そして、図9は、このSTFTにより得られた解析結果を1つの周波数スペクトル波形の画像とした場合の波形例を示す。 As shown in FIG. 8, STFT is a process of performing a Fourier transform every short time and calculating a signal intensity for each frequency component according to a time change. FIG. 9 shows a waveform example when the analysis result obtained by this STFT is an image of one frequency spectrum waveform.
 図9に示した周波数スペクトル波形例では、横軸が時間、縦軸が周波数を表していて、周波数毎の強度は色によって表現されている。なお、図9では、この色の違いをハッチングパターンにより表現している。また、図9は周波数毎の強度が色によって表現される場合を例示しているが、この強度を階調により表現することも可能である。 In the frequency spectrum waveform example shown in FIG. 9, the horizontal axis represents time, the vertical axis represents frequency, and the intensity for each frequency is represented by color. In FIG. 9, this color difference is expressed by a hatching pattern. Further, FIG. 9 illustrates the case where the intensity for each frequency is expressed by color, but this intensity can also be expressed by gradation.
 この図9の周波数スペクトル波形例では、異音の周波数成分61が特定の周波数に周期的に発生しているのが表示されているのが分かる。なお、この図9に示した周波数スペクトル波形例において、低い周波数成分は通常の動作音であり異音の周波数成分ではない。 In the frequency spectrum waveform example of FIG. 9, it can be seen that the abnormal frequency component 61 is periodically generated at a specific frequency. In the example of the frequency spectrum waveform shown in FIG. 9, the low frequency component is a normal operation sound and not an abnormal frequency component.
 この図9に示したような周波数スペクトル波形が得られると、制御部33は、この周波数スペクトル波形を表示部35に表示する。すると、制御部33は、図10に示すように、表示された周波数スペクトル波形に対して、異音であると推定される領域を指定するようユーザに促すような表示を行う。図10に示した例では、「異音であると思われる領域を指定して下さい。」という文字が表示されて、ユーザに異音であると推定される領域を指定するよう促されているのが分かる。 When the frequency spectrum waveform as shown in FIG. 9 is obtained, the control unit 33 displays the frequency spectrum waveform on the display unit 35. Then, as shown in FIG. 10, the control unit 33 performs a display that prompts the user to designate a region that is estimated to be abnormal sound, with respect to the displayed frequency spectrum waveform. In the example shown in FIG. 10, the text “Please specify the area that seems to be abnormal noise.” Is displayed, and the user is prompted to specify the area that is estimated to be abnormal noise. I understand.
 そして、このような表示を参照することにより、周波数スペクトル波形を提示されたユーザが、異音の周波数成分61を特定して、例えばタッチパネルを操作することによりこの異音の周波数成分61が含まれる領域を選択する。 Then, by referring to such a display, the user who is presented with the frequency spectrum waveform specifies the abnormal frequency component 61, and the abnormal frequency component 61 is included by operating the touch panel, for example. Select an area.
 図11は、このようにしてユーザにより選択された選択領域80の一例を示す。図11に示した例では、ユーザが指70でタッチパネルを操作することにより、複数の異音の周波数成分61を含むような長方形の領域が選択領域80として指定されているのが分かる。 FIG. 11 shows an example of the selection area 80 selected by the user in this way. In the example shown in FIG. 11, it can be seen that a rectangular region including a plurality of abnormal frequency frequency components 61 is designated as the selection region 80 when the user operates the touch panel with the finger 70.
 そして、このように選択領域80が指定されると、選択領域80に含まれる周波数成分に対する高速フーリエ変換(1D-FFT)が周波数解析部32により実行される(ステップS104)。図12は、このようにして実行された高速フーリエ変換の解析結果例を示す。 When the selection area 80 is designated in this way, the fast Fourier transform (1D-FFT) for the frequency components included in the selection area 80 is executed by the frequency analysis unit 32 (step S104). FIG. 12 shows an example of analysis results of the fast Fourier transform executed in this way.
 なお、この図12では、高速フーリエ変換を行った周波数成分の信号の周期および周波数が検出されることにより異音の周期および周波数が特定されることになる。なお、異音には倍音成分等が含まれるため、複数の周期が検出される場合があるが最も信号強度が強い周期が異音周期として検出される。 In FIG. 12, the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform. In addition, since an overtone component etc. are contained in abnormal sound, a some period may be detected, but the period with the strongest signal strength is detected as an abnormal sound period.
 また、所定の周期以上の長周期の信号成分は通常動作音や不定周期雑音であると考えられるため、このような長周期の信号成分の領域は判定除外領域62として、この判定除外領域62における解析結果は無視される。あるいは、このような長周期の信号成分の領域について、周波数解析部32による解析の対象としなくてもよい。 In addition, since a signal component having a long period of a predetermined period or more is considered to be normal operation sound or indefinite period noise, such a long-cycle signal component region is set as a determination exclusion region 62 in the determination exclusion region 62. Analysis results are ignored. Alternatively, such a long-cycle signal component region may not be analyzed by the frequency analysis unit 32.
 さらに、所定の周波数以下の低周波の信号成分についても通常動作音と区別が付かないため、このような低周波の信号成分の領域は判定除外領域63として、この判定除外領域63における解析結果は無視される。あるいは、このような低周波の信号成分の領域について、周波数解析部32による解析の対象としなくてもよい。 Furthermore, since the low frequency signal component below the predetermined frequency cannot be distinguished from the normal operation sound, such a low frequency signal component region is set as the determination exclusion region 63, and the analysis result in the determination exclusion region 63 is as follows. It will be ignored. Alternatively, such a low-frequency signal component region may not be analyzed by the frequency analysis unit 32.
 異音診断装置10では、この高速フーリエ変換の解析結果により、異音の周波数および周期の情報を機種情報や動作状態の情報とともにサーバ装置50に送信する(ステップS105)。例えば、異音周波数は4kHz、異音周期は2.0秒というような情報がサーバ装置50に送信される。 The abnormal sound diagnosis apparatus 10 transmits the frequency and period information of the abnormal sound together with the model information and the operation state information to the server apparatus 50 based on the analysis result of the fast Fourier transform (step S105). For example, information such that the abnormal frequency is 4 kHz and the abnormal cycle is 2.0 seconds is transmitted to the server device 50.
 すると、サーバ装置50では、受信した情報に基づいて、波形データ格納部53を検索することにより、受信した情報に対応する周波数スペクトル波形のデータを抽出する(ステップS106)。 Then, the server device 50 searches the waveform data storage unit 53 based on the received information, thereby extracting frequency spectrum waveform data corresponding to the received information (step S106).
 そして、サーバ装置50は、抽出した周波数スペクトル波形データを、元の音声データ、異音原因、その対処方法等の情報とともに異音診断装置10に送信する(ステップS107)。 Then, the server device 50 transmits the extracted frequency spectrum waveform data to the abnormal sound diagnosis device 10 together with information such as the original voice data, the cause of the abnormal noise, and a countermeasure method thereof (step S107).
 すると、異音診断装置10では、サーバ装置50から送信されてきた周波数スペクトル波形データを受信する(ステップS108)。そして、異音診断装置10の制御部33は、受信した周波数スペクトル波形と、STFTで得られた周波数スペクトル波形を表示部35に表示させる(ステップS109)。 Then, the abnormal sound diagnosis apparatus 10 receives the frequency spectrum waveform data transmitted from the server apparatus 50 (step S108). Then, the control unit 33 of the abnormal sound diagnosis apparatus 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by the STFT on the display unit 35 (step S109).
 図13は、このようにして2つの周波数スペクトル波形が表示された異音診断装置10の画面例を示す。 FIG. 13 shows a screen example of the abnormal sound diagnosis apparatus 10 in which two frequency spectrum waveforms are displayed in this way.
 図13に示した画面例では、周波数解析部32におけるSTFTにより得られた周波数スペクトル波形が「今回録音した異音の解析結果波形」として表示され、サーバ装置50から送信されてきた周波数スペクトル波形が「過去の異音データ」として「感光体ドラムの摩耗」という異音原因とともに表示されているのが分かる。 In the screen example shown in FIG. 13, the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as “analysis result waveform of abnormal sound recorded this time”, and the frequency spectrum waveform transmitted from the server device 50 is displayed. It can be seen that “Past abnormal noise data” is displayed together with the cause of abnormal noise “Wearing of the photosensitive drum”.
 異音診断を行おうとするサービスマンは、この2つの周波数スペクトル波形を比較して、波形中の異音成分が類似しているか否かを判定することにより異音の原因を特定する。 A serviceman who wants to perform an abnormal noise diagnosis compares the two frequency spectrum waveforms and determines whether or not the abnormal noise components in the waveforms are similar, thereby specifying the cause of the abnormal noise.
 また、サーバ装置50から複数の周波数スペクトル波形が送信されてきた場合には、例えば、「過去の異音データ」として表示されている周波数スペクトル波形の画像をタッチ操作により横方向になぞることにより、図14のように別の周波数スペクトル波形が表示される。 Further, when a plurality of frequency spectrum waveforms are transmitted from the server device 50, for example, by tracing a frequency spectrum waveform image displayed as “past abnormal sound data” in the horizontal direction by a touch operation, Another frequency spectrum waveform is displayed as shown in FIG.
 図14は、異音原因が「駆動系モータの不良」である場合の異音の周波数スペクトル波形が表示された場合の画像例を示している。 FIG. 14 shows an example of an image when an abnormal noise frequency spectrum waveform is displayed when the abnormal noise is caused by a “drive system motor failure”.
 このように複数の周波数スペクトル波形が送信されてきた場合には、サービスマンは、今回取得した異音の周波数スペクトル波形が、いずれの周波数スペクトル波形とより類似しているかを判定することにより異音の原因を特定する。なお、この異音の原因の特定の際には、単に周波数スペクトル波形の形状や異音成分の周期や周波数等を比較するだけでなく、元の音声データを音声再生部37により再生して今回取得した異音とサーバ装置50から送信されてきた周波数スペクトル波形に対応した音声とを聴き比べて異音の原因を特定してもよい。 When a plurality of frequency spectrum waveforms are transmitted in this way, the service person determines whether the frequency spectrum waveform of the abnormal sound acquired this time is more similar to which frequency spectrum waveform is abnormal. Identify the cause of When identifying the cause of this abnormal noise, not only simply comparing the shape of the frequency spectrum waveform, the period or frequency of the abnormal noise component, but also reproducing the original audio data by the audio reproducing unit 37 The cause of the abnormal sound may be specified by listening to and comparing the acquired abnormal sound with the sound corresponding to the frequency spectrum waveform transmitted from the server device 50.
 [変形例]
 上記実施形態では、異音診断装置10がタブレット端末装置である場合を用いて説明したが、本発明はこれに限定されるものではなく、他の装置を異音診断装置とするような場合でも本発明を適用することができるものである。例えば、画像形成装置20の操作パネルが本体から脱着可能な構成であって、サーバ装置50と通信可能であり音声信号の取得機能を内蔵しているような構成の場合、この操作パネルを異音診断装置とするようにしても良い。
[Modification]
In the above embodiment, the case where the abnormal sound diagnosis device 10 is a tablet terminal device has been described. However, the present invention is not limited to this, and even when another device is used as the abnormal sound diagnosis device. The present invention can be applied. For example, when the operation panel of the image forming apparatus 20 is detachable from the main body, and is configured to be able to communicate with the server apparatus 50 and incorporate an audio signal acquisition function, the operation panel is A diagnostic device may be used.
 また、上記実施形態では、異音診断装置10がマイク17を内蔵している場合を用いて説明しているが、異音診断装置10に音声録音機能が備えられていれば、マイク等の集音装置を外部に接続することにより音声信号の取得部を実現するようにしても良い。 In the above embodiment, the case where the abnormal sound diagnosis apparatus 10 includes the microphone 17 is described. However, if the abnormal sound diagnosis apparatus 10 has a voice recording function, a collection of microphones and the like is possible. You may make it implement | achieve the acquisition part of an audio | voice signal by connecting a sound apparatus outside.
 また、上記実施形態では、異音であると推定される領域の指定がユーザのタッチ操作により行われる場合を用いて説明しているが、本発明はこのような構成に限定されるものではない。この領域の指定をペン入力で行う場合であって、異音であると推定される周波数を数字により直接入力する場合や、マウス操作により領域を指定する場合等の他の方法により異音であると推定される領域を指定する場合でも、本発明は同様に適用可能である。 Moreover, although the said embodiment demonstrated using the case where designation | designated of the area | region estimated to be unusual sound is performed by a user's touch operation, this invention is not limited to such a structure. . When this area is specified by pen input, the noise is generated by other methods, such as when the frequency that is estimated to be abnormal is directly input by numbers, or when the area is specified by mouse operation. The present invention can be applied in the same manner even when an area that is estimated to be designated.
 さらに、上記実施形態では、異音解析の対象装置が画像形成装置である場合を用いて説明しているが、異音解析の対象となる装置は画像形成装置に限定されるものではない。周期性を持った異音を発生させる可能性がある装置であれば他の装置を対象としても、本発明は同様に適用可能である。 Furthermore, in the above embodiment, the case where the target device for abnormal noise analysis is an image forming apparatus has been described. However, the target device for abnormal noise analysis is not limited to an image forming apparatus. The present invention can be similarly applied to other devices as long as they are devices capable of generating periodic noise.
 上記では種々の実施の形態を説明したが、これらの実施の形態を組み合わせて構成してもよい。
 また、本開示は上記の実施の形態に何ら限定されるものではなく、本開示の要旨を逸脱しない範囲で種々の形態で実施することができる。
 本出願は、2015年12月14日出願の日本特許出願(特願2015-243112)に基づくものであり、その内容はここに参照として取り込まれる。
Although various embodiments have been described above, these embodiments may be combined.
Further, the present disclosure is not limited to the above-described embodiment, and can be implemented in various forms without departing from the gist of the present disclosure.
This application is based on a Japanese patent application filed on December 14, 2015 (Japanese Patent Application No. 2015-243112), the contents of which are incorporated herein by reference.
  10  異音診断装置
  11  CPU
  12  メモリ
  13  記憶装置
  14  無線LANインタフェース(IF)
  15  入力装置
  16  表示装置
  17  マイク
  18  制御バス
  20  画像形成装置
  30  無線LANターミナル
  31  音声取得部
  32  周波数解析部
  33  制御部
  34  音声データ格納部
  35  表示部
  36  通信部
  37  音声再生部
  40  インターネット通信網
  50  サーバ装置
  51  通信部
  52  制御部
  53  波形データ格納部
  61  異音の周波数成分
  62、63  判定除外領域
  70  指
  80  選択領域
10 abnormal sound diagnosis device 11 CPU
12 Memory 13 Storage Device 14 Wireless LAN Interface (IF)
DESCRIPTION OF SYMBOLS 15 Input apparatus 16 Display apparatus 17 Microphone 18 Control bus 20 Image forming apparatus 30 Wireless LAN terminal 31 Audio | voice acquisition part 32 Frequency analysis part 33 Control part 34 Audio | voice data storage part 35 Display part 36 Communication part 37 Voice reproduction part 40 Internet communication network 50 Server device 51 Communication unit 52 Control unit 53 Waveform data storage unit 61 Frequency component of abnormal sound 62, 63 Determination exclusion region 70 Finger 80 Selection region

Claims (8)

  1.  音情報を取得する取得部と、
     前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析部と、
     前記周波数解析結果波形データを表示する表示部と、
     表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付部と、
     前記領域に含まれる前記周波数成分を解析する第2解析部と、
     前記第2解析部による解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出部と、
     を備えた診断装置。
    An acquisition unit for acquiring sound information;
    A first analysis unit that performs time-frequency analysis of the sound information and generates frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
    A display for displaying the frequency analysis result waveform data;
    A reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data;
    A second analysis unit for analyzing the frequency component included in the region;
    An extraction unit for extracting information on the period and frequency of the frequency component from the analysis result by the second analysis unit;
    Diagnostic device with
  2.  前記受付部は、予め設定された周波数以下の領域について前記周波数成分を含む前記領域として指定された場合には、当該指定を受付けない請求項1記載の診断装置。 The diagnostic device according to claim 1, wherein when the reception unit is designated as the region including the frequency component for a region below a preset frequency, the designation is not accepted.
  3.  前記受付部は、予め設定された周波数以下の領域について前記周波数成分を含む前記領域として指定された場合には、前記第2解析部によって解析しない又は前記第2解析部による解析結果を無視する請求項1記載の診断装置。 When the reception unit is designated as the region including the frequency component for a region below a preset frequency, the reception unit does not analyze by the second analysis unit or ignores the analysis result by the second analysis unit. Item 2. The diagnostic device according to Item 1.
  4.  前記表示部は、前記第1解析部により生成された前記周波数解析結果波形データをタッチパネル上に表示し、
     前記受付部は、前記タッチパネル上における使用者のタッチ操作に基づいて、前記周波数成分を含む前記領域の指定を受付ける請求項1から3のいずれか1項記載の診断装置。
    The display unit displays the frequency analysis result waveform data generated by the first analysis unit on a touch panel,
    The diagnostic device according to claim 1, wherein the reception unit receives designation of the region including the frequency component based on a user's touch operation on the touch panel.
  5.  外部装置との間で通信を行う通信部と、
     前記抽出部により抽出された前記周波数成分の前記周期および前記周波数の前記情報を前記通信部を介して前記外部装置に送信する送信部と、
     前記第1解析部により生成された前記周波数解析結果波形データに対応する周波数解析結果のデータを前記通信部を介して前記外部装置から受信する受信部とをさらに備え、
     前記表示部は、前記第1解析部により生成された前記周波数解析結果波形データと、前記受信部により受信された前記周波数解析結果とを表示する請求項1から4のいずれか1項記載の診断装置。
    A communication unit for communicating with an external device;
    A transmission unit that transmits the information on the frequency and the frequency of the frequency component extracted by the extraction unit to the external device via the communication unit;
    A reception unit that receives data of the frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analysis unit from the external device via the communication unit;
    The diagnosis according to any one of claims 1 to 4, wherein the display unit displays the frequency analysis result waveform data generated by the first analysis unit and the frequency analysis result received by the reception unit. apparatus.
  6.  音情報を取得する取得部と、前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析部と、前記周波数解析結果波形データを表示する表示部と、表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付部と、前記領域に含まれる前記周波数成分を解析する第2解析部と、前記第2解析部による解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出部と、外部装置との間で通信を行う通信部と、前記抽出部により抽出された前記周波数成分の前記周期および前記周波数の前記情報を前記通信部を介して前記外部装置に送信する第1の送信部と、前記第1解析部により生成された前記周波数解析結果波形データに対応する周波数解析結果のデータを前記通信部を介して前記外部装置から受信する受信部とを備えた診断装置と、
     異音の音情報の周波数解析を行って得られた複数の周波数解析結果のデータを格納する格納部と、前記診断装置から前記周波数成分の前記周期および前記周波数の前記情報を受信した場合、前記格納部に格納されている前記複数の周波数解析結果のデータの中から、受信した前記周波数成分の前記周期および前記周波数の前記情報に対応するものを選択して前記診断装置に送信する第2の送信部とを備えたサーバ装置と、
     を備えた診断システム。
    An acquisition unit that acquires sound information, a first analysis unit that performs time-frequency analysis of the sound information, and generates frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency, and the frequency analysis result waveform data A display unit for displaying; a receiving unit for receiving designation of a region including a frequency component from the displayed frequency analysis result waveform data; a second analyzing unit for analyzing the frequency component included in the region; and the second analysis An extraction unit that extracts information on the period and frequency of the frequency component from the analysis result by the unit, a communication unit that communicates with an external device, and the period and the frequency of the frequency component extracted by the extraction unit A first transmitter that transmits the information to the external device via the communication unit; and a frequency corresponding to the frequency analysis result waveform data generated by the first analyzer A diagnostic device that includes a receiving unit for the data of the analysis result via the communication unit received from the external device,
    A storage unit that stores data of a plurality of frequency analysis results obtained by performing frequency analysis of abnormal sound information, and when the information on the period and the frequency of the frequency component is received from the diagnostic device, The second frequency analysis result data stored in the storage unit is selected from the received frequency component corresponding to the period and the information of the frequency, and transmitted to the diagnostic device. A server device comprising a transmission unit;
    Diagnostic system with
  7.  音情報を取得する取得ステップと、
     前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析ステップと、
     前記周波数解析結果波形データを表示する表示ステップと、
     表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付ステップと、
     前記領域に含まれる周波数成分を解析する第2解析ステップと、
     前記第2解析ステップにおける解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出ステップと、を備えた診断方法。
    An acquisition step for acquiring sound information;
    A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
    A display step for displaying the frequency analysis result waveform data;
    An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data;
    A second analysis step of analyzing a frequency component included in the region;
    A diagnostic method comprising: an extraction step for extracting information on a period and frequency of the frequency component from the analysis result in the second analysis step.
  8.  音情報を取得する取得ステップと、
     前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析ステップと、
     前記周波数解析結果波形データを表示する表示ステップと、
     表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付ステップと、
     前記領域に含まれる周波数成分を解析する第2解析ステップと、
     前記第2解析ステップにおける解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出ステップと、をコンピュータに実行させるためのプログラム。
     
    An acquisition step for acquiring sound information;
    A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
    A display step for displaying the frequency analysis result waveform data;
    An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data;
    A second analysis step of analyzing a frequency component included in the region;
    A program for causing a computer to execute an extraction step of extracting information on a period and frequency of the frequency component from an analysis result in the second analysis step.
PCT/JP2016/059524 2015-12-14 2016-03-24 Diagnostic device, diagnostic system, diagnostic method, and program WO2017104146A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2016370880A AU2016370880A1 (en) 2015-12-14 2016-03-24 Diagnostic device, diagnostic system, diagnostic method, and program
CN201680066037.1A CN108351248B (en) 2015-12-14 2016-03-24 Diagnostic device, diagnostic system, diagnostic method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015243112A JP5954604B1 (en) 2015-12-14 2015-12-14 Diagnostic device, diagnostic system and program
JP2015-243112 2015-12-14

Publications (1)

Publication Number Publication Date
WO2017104146A1 true WO2017104146A1 (en) 2017-06-22

Family

ID=56418752

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/059524 WO2017104146A1 (en) 2015-12-14 2016-03-24 Diagnostic device, diagnostic system, diagnostic method, and program

Country Status (4)

Country Link
JP (1) JP5954604B1 (en)
CN (1) CN108351248B (en)
AU (1) AU2016370880A1 (en)
WO (1) WO2017104146A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11158315B2 (en) 2019-08-07 2021-10-26 International Business Machines Corporation Secure speech recognition

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6834223B2 (en) * 2016-07-29 2021-02-24 富士ゼロックス株式会社 Diagnostic equipment, diagnostic systems and programs
JP6840971B2 (en) * 2016-09-21 2021-03-10 富士ゼロックス株式会社 Diagnostic equipment, diagnostic systems and programs
JP6822036B2 (en) * 2016-09-21 2021-01-27 富士ゼロックス株式会社 Diagnostic equipment, diagnostic systems and programs
CN112513893B (en) * 2018-08-03 2022-09-23 三菱电机株式会社 Data analysis device, system, method, and program

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09136776A (en) * 1995-11-13 1997-05-27 Hitachi Building Syst Co Ltd Rotary bearing damage detecting device for elevator
JPH10258974A (en) * 1996-09-13 1998-09-29 Toshiba Corp Unsteady signal analyzer and medium recording unsteady signal analysis program

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06318424A (en) * 1993-03-12 1994-11-15 Kitagawa Ind Co Ltd Sound sensitive operating switch and emergency electric light and remote control holder using it
MY118297A (en) * 1996-09-13 2004-09-30 Toshiba Kk Unsteady signal analyzer and medium for recording unsteady signal analyzer program
US6192490B1 (en) * 1998-04-10 2001-02-20 International Business Machines Corporation Method and system for monitoring computer performance utilizing sound diagnostics
JP3908555B2 (en) * 2002-02-08 2007-04-25 株式会社東芝 Ultrasonic diagnostic equipment
JP2006025281A (en) * 2004-07-09 2006-01-26 Hitachi Ltd Information source selection system, and method
JP2006113002A (en) * 2004-10-18 2006-04-27 Nsk Ltd Anomaly diagnosis system for mechanical equipment
CN101206548B (en) * 2006-12-19 2012-01-11 北京汇冠新技术股份有限公司 Infrared touch panel triggered using touch force and detecting method thereof
CN101354485B (en) * 2007-07-23 2011-04-06 奇美电子股份有限公司 System and method for testing display apparatus
JP5207074B2 (en) * 2009-06-05 2013-06-12 清水建設株式会社 Wind turbine blade abnormality determination method, abnormality determination device, and abnormality determination program
JP5725833B2 (en) * 2010-01-04 2015-05-27 Ntn株式会社 Rolling bearing abnormality diagnosis device, wind power generation device and abnormality diagnosis system
JP2012208043A (en) * 2011-03-30 2012-10-25 Railway Technical Research Institute Method and device for identifying vibration characteristic of railroad structure
JP5783808B2 (en) * 2011-06-02 2015-09-24 三菱電機株式会社 Abnormal sound diagnosis device
CN104094090A (en) * 2011-07-23 2014-10-08 奈克维斯森股份有限公司 Device, method and system for making music
CN102779398A (en) * 2012-07-09 2012-11-14 深圳市同洲电子股份有限公司 Control method, device and system for smart appliance
JP6236282B2 (en) * 2013-10-21 2017-11-22 株式会社日立ハイテクノロジーズ Abnormality detection apparatus, abnormality detection method, and computer-readable storage medium
JP2015173369A (en) * 2014-03-12 2015-10-01 ソニー株式会社 Signal processor, signal processing method and program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09136776A (en) * 1995-11-13 1997-05-27 Hitachi Building Syst Co Ltd Rotary bearing damage detecting device for elevator
JPH10258974A (en) * 1996-09-13 1998-09-29 Toshiba Corp Unsteady signal analyzer and medium recording unsteady signal analysis program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11158315B2 (en) 2019-08-07 2021-10-26 International Business Machines Corporation Secure speech recognition

Also Published As

Publication number Publication date
CN108351248B (en) 2020-10-23
AU2016370880A1 (en) 2018-05-10
CN108351248A (en) 2018-07-31
JP5954604B1 (en) 2016-07-20
JP2017110919A (en) 2017-06-22

Similar Documents

Publication Publication Date Title
US10911607B2 (en) Diagnosing an image forming apparatus based on sound signal analysis
JP5954648B1 (en) Terminal device, diagnostic system, and program
WO2017104146A1 (en) Diagnostic device, diagnostic system, diagnostic method, and program
WO2017110111A1 (en) Terminal device, diagnosis system, diagnosis method, and program
JP6540962B2 (en) Diagnostic device, diagnostic system and program
JP5954605B1 (en) Diagnostic device, diagnostic system and program
US10412234B2 (en) Diagnostic device and diagnostic method
CN106915166B (en) Diagnostic device, diagnostic system, and diagnostic method
JP6840971B2 (en) Diagnostic equipment, diagnostic systems and programs
WO2017094270A1 (en) Diagnosis device, diagnosis system, diagnosis method and program
JP6016149B1 (en) Terminal device, diagnostic system, and program
JP6834223B2 (en) Diagnostic equipment, diagnostic systems and programs
JP6763255B2 (en) Diagnostic equipment, diagnostic systems and programs
JP6822036B2 (en) Diagnostic equipment, diagnostic systems and programs

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16875134

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2016370880

Country of ref document: AU

Date of ref document: 20160324

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16875134

Country of ref document: EP

Kind code of ref document: A1