WO2017104146A1 - Diagnostic device, diagnostic system, diagnostic method, and program - Google Patents
Diagnostic device, diagnostic system, diagnostic method, and program Download PDFInfo
- Publication number
- WO2017104146A1 WO2017104146A1 PCT/JP2016/059524 JP2016059524W WO2017104146A1 WO 2017104146 A1 WO2017104146 A1 WO 2017104146A1 JP 2016059524 W JP2016059524 W JP 2016059524W WO 2017104146 A1 WO2017104146 A1 WO 2017104146A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- frequency
- unit
- analysis result
- analysis
- waveform data
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H3/00—Measuring characteristics of vibrations by using a detector in a fluid
Definitions
- the present invention relates to a diagnostic device, a diagnostic system, a diagnostic method, and a program.
- Patent Document 1 includes a RAM (Random Access Memory) or ROM (Read Only Memory) that stores normal operation sound of the image forming apparatus, and a microphone that detects the operation sound generated from the image forming apparatus.
- RAM Random Access Memory
- ROM Read Only Memory
- a system is disclosed. This system identifies an abnormal portion of the image forming apparatus based on the first sound information stored in the RAM or ROM, the second sound information detected by the microphone, and the operation information of the image forming apparatus. To do.
- Patent Document 2 discloses an image processing apparatus having an image forming unit that forms an image on a print sheet and a transport unit that transports the print sheet.
- the image processing apparatus includes a sound converter that converts sound inside the apparatus into an electric signal, a sound analyzer that analyzes the electric signal converted by the sound converter to obtain a component for each frequency, and the sound analyzer And an output unit that outputs a component for each obtained frequency.
- At least one embodiment of the present invention extracts frequency and period information of a sound to be extracted from a frequency analysis result representing a temporal change in intensity distribution for each frequency obtained by frequency analysis of sound information. To be able to.
- At least one embodiment of the present invention includes an acquisition unit that acquires sound information; A first analysis unit that performs time-frequency analysis of the sound information and generates frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency; A display for displaying the frequency analysis result waveform data; A reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data; A second analysis unit for analyzing the frequency component included in the region; It is a diagnostic apparatus provided with the extraction part which extracts the period and frequency information of the said frequency component from the analysis result by a said 2nd analysis part.
- the reception unit when the reception unit is specified as the region including the frequency component for a region below a preset frequency, the reception unit may not receive the specification. .
- the reception unit when the reception unit is designated as the region including the frequency component for a region below a preset frequency, the reception unit analyzes the region. The analysis result by the second analysis unit may be ignored.
- the display unit displays the frequency analysis result waveform data generated by the first analysis unit on a touch panel
- the accepting unit may accept designation of the region including the frequency component based on a user's touch operation on the touch panel.
- the diagnostic device includes a communication unit that communicates with an external device; A transmission unit that transmits the information on the frequency and the frequency of the frequency component extracted by the extraction unit to the external device via the communication unit; A receiver that receives data of a frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analyzer from the external device via the communication unit; The display unit may display the frequency analysis result waveform data generated by the first analysis unit and the frequency analysis result received by the reception unit.
- an acquisition unit that acquires sound information and time-frequency analysis of the sound information are performed, and frequency analysis result waveform data representing a time change of an intensity distribution for each frequency is generated.
- a first analysis unit a display unit that displays the frequency analysis result waveform data; a reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data; and the frequency component included in the region
- a second analysis unit that analyzes the frequency component, an extraction unit that extracts information on the frequency component frequency and frequency from the analysis result of the second analysis unit, a communication unit that communicates with an external device, and the extraction unit
- a first transmission unit that transmits the information on the period and the frequency of the frequency component extracted by the information to the external device via the communication unit, and the first transmission unit generated by the first analysis unit
- a diagnostic device comprising a receiving unit for receiving data of a frequency analysis result corresponding to the frequency analysis result waveform data from the external device via the communication unit;
- a storage unit that stores data of
- At least one embodiment of the present invention includes an acquisition step of acquiring sound information; A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency; A display step for displaying the frequency analysis result waveform data; An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data; A second analysis step of analyzing the frequency component included in the region; And an extraction step for extracting information on the period and frequency of the frequency component from the analysis result in the second analysis step.
- At least one embodiment of the present invention includes an acquisition step of acquiring sound information; A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency; A display step for displaying the frequency analysis result waveform data; An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data; A second analysis step of analyzing the frequency component included in the region; It is a program for causing a computer to execute an extraction step of extracting information on the period and frequency of the frequency component from the analysis result in the second analysis step.
- information on the frequency and period of the sound to be extracted is obtained from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. Can be extracted.
- the user obtains the frequency analysis result of the acquired sound information and the frequency analysis result of the sound information recorded in the external device in a device equivalent to the device to be analyzed. In comparison, the cause of the generated sound can be estimated.
- the frequency and period information of the sound to be extracted is obtained from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. Can be extracted.
- the frequency and period information of the sound to be extracted is obtained from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. Can be extracted.
- the frequency and period information of the sound to be extracted is extracted from the frequency analysis result representing the time change of the intensity distribution for each frequency obtained by frequency analysis of the sound information. can do.
- FIG. 1 is a system diagram showing a configuration of an abnormal sound diagnosis system according to an embodiment of the present invention.
- the abnormal sound diagnosis system includes a portable abnormal sound diagnosis device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50. .
- the present invention can be applied to any device as long as the abnormal sound diagnosis device 10 can be connected to the server device 50 via the communication network.
- the abnormal sound diagnosis device 10 will be described using a case of a tablet terminal device including a device such as a microphone capable of acquiring an audio signal and a touch panel capable of touch input.
- the abnormal sound diagnosis apparatus 10 is carried by a service person (maintenance personnel) who performs maintenance management, repair, etc. of the image forming apparatus 20 such as a printer used by the end user.
- the abnormal sound diagnosis apparatus 10 acquires an abnormal sound (abnormal sound) signal generated in the image forming apparatus 20, analyzes the frequency of the acquired abnormal sound signal, and analyzes the frequency of the past abnormal sound signal acquired from the server apparatus 50. This is used to display the resulting waveform and the frequency analysis result waveform of the acquired abnormal sound signal.
- the abnormal sound diagnosis apparatus 10 and the server apparatus 50 are connected via a wireless LAN (Local Area Network) terminal 30 such as a Wi-Fi router or the Internet communication network 40 to transmit and receive information.
- a wireless LAN (Local Area Network) terminal 30 such as a Wi-Fi router or the Internet communication network 40 to transmit and receive information.
- the abnormal sound diagnosis device 10 is a mobile phone device, a smartphone, or the like
- the abnormal sound diagnosis device 10 and the server device 50 are connected via a mobile phone network to transmit / receive frequency analysis result waveform data. You may do it.
- a service person when an abnormal sound occurs in the image forming apparatus 20 that is a target electronic device installed at the end user's location, a service person carries the abnormal sound diagnosis apparatus 10 and the image forming apparatus. It is envisaged to go to 20 locations. And this service person acquires the abnormal sound signal by recording the abnormal sound generated using the abnormal sound diagnosis apparatus 10, and performs the abnormal sound diagnosis for specifying the cause of the abnormal sound.
- FIG. 2 shows a hardware configuration of the abnormal sound diagnosis apparatus 10 in the abnormal sound diagnosis system of the present embodiment.
- the abnormal sound diagnosis apparatus 10 performs wireless communication with the CPU 11, a memory 12 that can temporarily store data, a storage device 13 such as a flash memory, and a wireless LAN terminal 30 to perform data communication.
- a wireless LAN interface (IF) 14 that performs transmission and reception, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. These components are connected to each other via a control bus 18.
- the abnormal sound diagnosis apparatus 10 of the present embodiment includes a touch panel in which a touch sensor for detecting a touch position is provided on the display device 16 as the input device 15. Display is performed using this touch panel, and input from the user is performed.
- the CPU 11 executes predetermined processing based on a control program stored in the memory 12 or the storage device 13 to control the operation of the abnormal sound diagnosis device 10.
- this control program can be obtained by downloading it via the Internet communication network 40 or the mobile phone network and provided to the CPU 11, or the program can be stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.
- the abnormal sound diagnosis apparatus 10 performs the operation described below by executing the control program described above, and assists the service person in identifying the cause of the abnormal sound.
- FIG. 3 is a block diagram showing a functional configuration of the abnormal sound diagnosis apparatus 10 realized by executing the control program.
- the abnormal sound diagnosis apparatus 10 of the present embodiment includes an audio acquisition unit 31, a frequency analysis unit 32, a control unit 33, an audio data storage unit 34, a display unit 35, and a communication unit. 36 and an audio reproduction unit 37.
- the display unit 35 displays various data based on the control by the control unit 33.
- the communication unit 36 communicates with the server device 50 that is an external device.
- the audio reproduction unit 37 reproduces the recorded audio data and converts it into an audio signal.
- the sound acquisition unit 31 inputs an abnormal sound generated in the image forming apparatus 20 that is an analysis target apparatus and acquires a sound signal.
- the sound acquisition unit 31 has been described as acquiring an audio signal by inputting an abnormal sound generated in the image forming apparatus 20, but the sound is an example of a sound.
- the signal is an example of sound information.
- the frequency analysis unit 32 performs time-frequency analysis (time-dependent frequency analysis) of the audio signal acquired by the audio acquisition unit 31, and represents a frequency spectrum representing a time change of the signal intensity distribution for each frequency of the acquired abnormal sound signal. Waveform (frequency analysis result) data is generated.
- the frequency analysis unit 32 generates frequency spectrum waveform data by performing STFT (Short Time Fourier Transform) on the audio signal acquired by the audio acquisition unit 31.
- STFT Short Time Fourier Transform
- the control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the audio data storage unit 34 together with the audio data. And the control part 33 displays the frequency spectrum waveform obtained by the result of STFT on the display part 35 which is a touch panel.
- the control unit 33 Based on the user's touch operation, the designation of the region including the abnormal signal component in the displayed frequency spectrum waveform is accepted.
- the control unit 33 performs frequency analysis in the time axis direction on the frequency components in the region designated as the region including the abnormal sound signal component in the frequency spectrum waveform data obtained by the frequency analysis unit 32.
- the frequency analysis unit 32 is instructed to execute a fast Fourier transform (1D-FFT (Fast Fourier Transform)). Therefore, the frequency analysis unit 32 performs fast Fourier transform in the time axis direction on the frequency component included in the designated region.
- 1D-FFT Fast Fourier Transform
- control unit 33 extracts the period and frequency information of the abnormal sound from the analysis result of the fast Fourier transform in the frequency analysis unit 32.
- control unit 33 may not accept the designation of a region having a frequency equal to or lower than a preset frequency even when the region is designated as a region including an abnormal sound signal component.
- control unit 33 uses the acquired period and frequency information of the abnormal sound as well as the model name of the image forming apparatus 20, model information such as a serial number, and operation state information indicating the operation state of the image forming apparatus 20.
- the operation status information includes information such as color printing or monochrome printing, double-sided printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included.
- the control unit 33 transmits information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server device 50 via the communication unit 36.
- the server device 50 obtains the original sound data and the sound data from the spectral waveform data obtained by performing frequency analysis of the sound signal of the abnormal sound generated in the past in a device equivalent to the device of the image forming device 20. Together with information such as the operating state of the device, the cause of the abnormal noise, and how to deal with the abnormal noise.
- the server device 50 uses the frequency spectrum waveform (second waveform) corresponding to the frequency spectrum waveform data obtained as a result of frequency analysis by the frequency analysis unit 32 based on the period and frequency information of the abnormal sound transmitted from the abnormal sound diagnosis device 10. Search the frequency analysis result waveform) data. Then, the server device 50 transmits the found frequency spectrum waveform data to the abnormal sound diagnosis device 10 together with information such as audio data stored as abnormal sound sample waveform data.
- control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.
- the control unit 33 displays the frequency spectrum waveform obtained by performing frequency analysis of the audio signal acquired by the audio acquisition unit 31 and the spectrum waveform received from the server device 50 on the display unit 35 in parallel.
- control unit 33 when there are a plurality of frequency spectrum waveform data transmitted from the server device 50, the control unit 33 includes the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 among the plurality of frequency spectrum waveform data. Are displayed on the display unit 35 with priority.
- the server device 50 includes a communication unit 51, a control unit 52, and a waveform data storage unit 53, as shown in FIG.
- the waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of abnormal sound signals generated in the past in an apparatus equivalent to the image forming apparatus 20 that is an analysis target apparatus.
- the waveform data storage unit 53 includes frequency spectrum waveform data obtained by analyzing time-frequency analysis of abnormal sound data acquired in advance and the original sound. Information such as data, causes of abnormal noise, and countermeasures are stored for each model.
- the control unit 52 receives the abnormal sound period or frequency information from the abnormal sound diagnosis apparatus 10
- the control unit 52 receives the received abnormal noise data from the waveform data of the plurality of frequency spectra stored in the waveform data storage unit 53. Based on the information on the sound period and frequency, the one similar to the waveform data of the frequency spectrum based on the abnormal sound acquired in the abnormal sound diagnosis apparatus 10 is selected. Then, the control unit 52 transmits the selected waveform data to the abnormal sound diagnosis apparatus 10 via the communication unit 51.
- Step S101 When the abnormal sound diagnosis apparatus 10 performs an abnormal sound diagnosis for identifying the cause of the abnormal sound, an image as shown in FIG. 7 is displayed, and various types of information such as the model name, serial number, and operating state are input. (Step S101).
- the abnormal sound diagnosis apparatus 10 sets the operation mode to the voice recording mode, records the abnormal sound with the microphone 17 that is brought close to the abnormal sound generation location of the image forming apparatus 20, and acquires the voice data (step S102).
- the acquired voice data is subjected to STFT in the frequency analysis unit 32, thereby generating a frequency spectrum waveform representing a time change of the signal intensity distribution for each frequency (step S 103).
- STFT is a process of performing a Fourier transform every short time and calculating a signal intensity for each frequency component according to a time change.
- FIG. 9 shows a waveform example when the analysis result obtained by this STFT is an image of one frequency spectrum waveform.
- the horizontal axis represents time
- the vertical axis represents frequency
- the intensity for each frequency is represented by color.
- this color difference is expressed by a hatching pattern.
- FIG. 9 illustrates the case where the intensity for each frequency is expressed by color, but this intensity can also be expressed by gradation.
- the abnormal frequency component 61 is periodically generated at a specific frequency.
- the low frequency component is a normal operation sound and not an abnormal frequency component.
- the control unit 33 displays the frequency spectrum waveform on the display unit 35. Then, as shown in FIG. 10, the control unit 33 performs a display that prompts the user to designate a region that is estimated to be abnormal sound, with respect to the displayed frequency spectrum waveform.
- the text “Please specify the area that seems to be abnormal noise.” Is displayed, and the user is prompted to specify the area that is estimated to be abnormal noise. I understand.
- the user who is presented with the frequency spectrum waveform specifies the abnormal frequency component 61, and the abnormal frequency component 61 is included by operating the touch panel, for example. Select an area.
- FIG. 11 shows an example of the selection area 80 selected by the user in this way.
- a rectangular region including a plurality of abnormal frequency frequency components 61 is designated as the selection region 80 when the user operates the touch panel with the finger 70.
- the fast Fourier transform (1D-FFT) for the frequency components included in the selection area 80 is executed by the frequency analysis unit 32 (step S104).
- FIG. 12 shows an example of analysis results of the fast Fourier transform executed in this way.
- the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform.
- a some period may be detected, but the period with the strongest signal strength is detected as an abnormal sound period.
- a signal component having a long period of a predetermined period or more is considered to be normal operation sound or indefinite period noise
- such a long-cycle signal component region is set as a determination exclusion region 62 in the determination exclusion region 62. Analysis results are ignored.
- such a long-cycle signal component region may not be analyzed by the frequency analysis unit 32.
- such a low frequency signal component region is set as the determination exclusion region 63, and the analysis result in the determination exclusion region 63 is as follows. It will be ignored.
- such a low-frequency signal component region may not be analyzed by the frequency analysis unit 32.
- the abnormal sound diagnosis apparatus 10 transmits the frequency and period information of the abnormal sound together with the model information and the operation state information to the server apparatus 50 based on the analysis result of the fast Fourier transform (step S105). For example, information such that the abnormal frequency is 4 kHz and the abnormal cycle is 2.0 seconds is transmitted to the server device 50.
- the server device 50 searches the waveform data storage unit 53 based on the received information, thereby extracting frequency spectrum waveform data corresponding to the received information (step S106).
- the server device 50 transmits the extracted frequency spectrum waveform data to the abnormal sound diagnosis device 10 together with information such as the original voice data, the cause of the abnormal noise, and a countermeasure method thereof (step S107).
- the abnormal sound diagnosis apparatus 10 receives the frequency spectrum waveform data transmitted from the server apparatus 50 (step S108). Then, the control unit 33 of the abnormal sound diagnosis apparatus 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by the STFT on the display unit 35 (step S109).
- FIG. 13 shows a screen example of the abnormal sound diagnosis apparatus 10 in which two frequency spectrum waveforms are displayed in this way.
- the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as “analysis result waveform of abnormal sound recorded this time”, and the frequency spectrum waveform transmitted from the server device 50 is displayed. It can be seen that “Past abnormal noise data” is displayed together with the cause of abnormal noise “Wearing of the photosensitive drum”.
- a serviceman who wants to perform an abnormal noise diagnosis compares the two frequency spectrum waveforms and determines whether or not the abnormal noise components in the waveforms are similar, thereby specifying the cause of the abnormal noise.
- FIG. 14 shows an example of an image when an abnormal noise frequency spectrum waveform is displayed when the abnormal noise is caused by a “drive system motor failure”.
- the service person determines whether the frequency spectrum waveform of the abnormal sound acquired this time is more similar to which frequency spectrum waveform is abnormal. Identify the cause of When identifying the cause of this abnormal noise, not only simply comparing the shape of the frequency spectrum waveform, the period or frequency of the abnormal noise component, but also reproducing the original audio data by the audio reproducing unit 37
- the cause of the abnormal sound may be specified by listening to and comparing the acquired abnormal sound with the sound corresponding to the frequency spectrum waveform transmitted from the server device 50.
- the abnormal sound diagnosis device 10 is a tablet terminal device.
- the present invention is not limited to this, and even when another device is used as the abnormal sound diagnosis device.
- the present invention can be applied.
- the operation panel of the image forming apparatus 20 is detachable from the main body, and is configured to be able to communicate with the server apparatus 50 and incorporate an audio signal acquisition function, the operation panel is A diagnostic device may be used.
- the abnormal sound diagnosis apparatus 10 includes the microphone 17 .
- the abnormal sound diagnosis apparatus 10 has a voice recording function, a collection of microphones and the like is possible. You may make it implement
- this invention is not limited to such a structure.
- the noise is generated by other methods, such as when the frequency that is estimated to be abnormal is directly input by numbers, or when the area is specified by mouse operation.
- the present invention can be applied in the same manner even when an area that is estimated to be designated.
- the target device for abnormal noise analysis is an image forming apparatus.
- the target device for abnormal noise analysis is not limited to an image forming apparatus.
- the present invention can be similarly applied to other devices as long as they are devices capable of generating periodic noise.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Abstract
Description
[1] 本発明の少なくとも一の実施形態は、音情報を取得する取得部と、
前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析部と、
前記周波数解析結果波形データを表示する表示部と、
表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付部と、
前記領域に含まれる前記周波数成分を解析する第2解析部と、
前記第2解析部による解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出部と、を備えた診断装置である。 [Diagnostic equipment]
[1] At least one embodiment of the present invention includes an acquisition unit that acquires sound information;
A first analysis unit that performs time-frequency analysis of the sound information and generates frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
A display for displaying the frequency analysis result waveform data;
A reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data;
A second analysis unit for analyzing the frequency component included in the region;
It is a diagnostic apparatus provided with the extraction part which extracts the period and frequency information of the said frequency component from the analysis result by a said 2nd analysis part.
前記受付部は、前記タッチパネル上における使用者のタッチ操作に基づいて、前記周波数成分を含む前記領域の指定を受付けてもよい。 [4] In the diagnostic apparatus according to any one of [1] to [3], the display unit displays the frequency analysis result waveform data generated by the first analysis unit on a touch panel,
The accepting unit may accept designation of the region including the frequency component based on a user's touch operation on the touch panel.
前記抽出部により抽出された前記周波数成分の前記周期および前記周波数の前記情報を前記通信部を介して前記外部装置に送信する送信部と、
前記第1解析部により生成された前記周波数解析結果波形データに対応する周波数解析結果のデータを前記通信部を介して前記外部装置から受信する受信部とをさらに備えていてよく、
前記表示部は、前記第1解析部により生成された前記周波数解析結果波形データと、前記受信部により受信された前記周波数解析結果とを表示してもよい。 [5] The diagnostic device according to any one of [1] to [4] includes a communication unit that communicates with an external device;
A transmission unit that transmits the information on the frequency and the frequency of the frequency component extracted by the extraction unit to the external device via the communication unit;
A receiver that receives data of a frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analyzer from the external device via the communication unit;
The display unit may display the frequency analysis result waveform data generated by the first analysis unit and the frequency analysis result received by the reception unit.
[6] 本発明の少なくとも一の実施形態は、音情報を取得する取得部と、前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析部と、前記周波数解析結果波形データを表示する表示部と、表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付部と、前記領域に含まれる前記周波数成分を解析する第2解析部と、前記第2解析部による解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出部と、外部装置との間で通信を行う通信部と、前記抽出部により抽出された前記周波数成分の前記周期および前記周波数の前記情報を前記通信部を介して前記外部装置に送信する第1の送信部と、前記第1解析部により生成された前記周波数解析結果波形データに対応する周波数解析結果のデータを前記通信部を介して前記外部装置から受信する受信部とを備えた診断装置と、
異音の音情報の周波数解析を行って得られた複数の周波数解析結果のデータを格納する格納部と、前記診断装置から前記周波数成分の前記周期および前記周波数の前記情報を受信した場合、前記格納部に格納されている前記複数の周波数解析結果のデータの中から、受信した前記周波数成分の前記周期および前記周波数の前記情報に対応するものを選択して前記診断装置に送信する第2の送信部とを備えたサーバ装置と、を備えた診断システムである。 [Diagnostic system]
[6] In at least one embodiment of the present invention, an acquisition unit that acquires sound information and time-frequency analysis of the sound information are performed, and frequency analysis result waveform data representing a time change of an intensity distribution for each frequency is generated. A first analysis unit; a display unit that displays the frequency analysis result waveform data; a reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data; and the frequency component included in the region A second analysis unit that analyzes the frequency component, an extraction unit that extracts information on the frequency component frequency and frequency from the analysis result of the second analysis unit, a communication unit that communicates with an external device, and the extraction unit A first transmission unit that transmits the information on the period and the frequency of the frequency component extracted by the information to the external device via the communication unit, and the first transmission unit generated by the first analysis unit A diagnostic device comprising a receiving unit for receiving data of a frequency analysis result corresponding to the frequency analysis result waveform data from the external device via the communication unit;
A storage unit that stores data of a plurality of frequency analysis results obtained by performing frequency analysis of abnormal sound information, and when the information on the period and the frequency of the frequency component is received from the diagnostic device, The second frequency analysis result data stored in the storage unit is selected from the received frequency component corresponding to the period and the information of the frequency, and transmitted to the diagnostic device. And a server device including a transmission unit.
[7] 本発明の少なくとも一の実施形態は、音情報を取得する取得ステップと、
前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析ステップと、
前記周波数解析結果波形データを表示する表示ステップと、
表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付ステップと、
前記領域に含まれる前記周波数成分を解析する第2解析ステップと、
前記第2解析ステップにおける解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出ステップと、を備えた診断方法である。 [Diagnosis method]
[7] At least one embodiment of the present invention includes an acquisition step of acquiring sound information;
A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
A display step for displaying the frequency analysis result waveform data;
An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data;
A second analysis step of analyzing the frequency component included in the region;
And an extraction step for extracting information on the period and frequency of the frequency component from the analysis result in the second analysis step.
[8] 本発明の少なくとも一の実施形態は、音情報を取得する取得ステップと、
前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析ステップと、
前記周波数解析結果波形データを表示する表示ステップと、
表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付ステップと、
前記領域に含まれる前記周波数成分を解析する第2解析ステップと、
前記第2解析ステップにおける解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出ステップと、をコンピュータに実行させるためのプログラムである。 [program]
[8] At least one embodiment of the present invention includes an acquisition step of acquiring sound information;
A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
A display step for displaying the frequency analysis result waveform data;
An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data;
A second analysis step of analyzing the frequency component included in the region;
It is a program for causing a computer to execute an extraction step of extracting information on the period and frequency of the frequency component from the analysis result in the second analysis step.
上記実施形態では、異音診断装置10がタブレット端末装置である場合を用いて説明したが、本発明はこれに限定されるものではなく、他の装置を異音診断装置とするような場合でも本発明を適用することができるものである。例えば、画像形成装置20の操作パネルが本体から脱着可能な構成であって、サーバ装置50と通信可能であり音声信号の取得機能を内蔵しているような構成の場合、この操作パネルを異音診断装置とするようにしても良い。 [Modification]
In the above embodiment, the case where the abnormal
また、本開示は上記の実施の形態に何ら限定されるものではなく、本開示の要旨を逸脱しない範囲で種々の形態で実施することができる。
本出願は、2015年12月14日出願の日本特許出願(特願2015-243112)に基づくものであり、その内容はここに参照として取り込まれる。 Although various embodiments have been described above, these embodiments may be combined.
Further, the present disclosure is not limited to the above-described embodiment, and can be implemented in various forms without departing from the gist of the present disclosure.
This application is based on a Japanese patent application filed on December 14, 2015 (Japanese Patent Application No. 2015-243112), the contents of which are incorporated herein by reference.
11 CPU
12 メモリ
13 記憶装置
14 無線LANインタフェース(IF)
15 入力装置
16 表示装置
17 マイク
18 制御バス
20 画像形成装置
30 無線LANターミナル
31 音声取得部
32 周波数解析部
33 制御部
34 音声データ格納部
35 表示部
36 通信部
37 音声再生部
40 インターネット通信網
50 サーバ装置
51 通信部
52 制御部
53 波形データ格納部
61 異音の周波数成分
62、63 判定除外領域
70 指
80 選択領域 10 abnormal
12
DESCRIPTION OF
Claims (8)
- 音情報を取得する取得部と、
前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析部と、
前記周波数解析結果波形データを表示する表示部と、
表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付部と、
前記領域に含まれる前記周波数成分を解析する第2解析部と、
前記第2解析部による解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出部と、
を備えた診断装置。 An acquisition unit for acquiring sound information;
A first analysis unit that performs time-frequency analysis of the sound information and generates frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
A display for displaying the frequency analysis result waveform data;
A reception unit that receives designation of a region including a frequency component from the displayed frequency analysis result waveform data;
A second analysis unit for analyzing the frequency component included in the region;
An extraction unit for extracting information on the period and frequency of the frequency component from the analysis result by the second analysis unit;
Diagnostic device with - 前記受付部は、予め設定された周波数以下の領域について前記周波数成分を含む前記領域として指定された場合には、当該指定を受付けない請求項1記載の診断装置。 The diagnostic device according to claim 1, wherein when the reception unit is designated as the region including the frequency component for a region below a preset frequency, the designation is not accepted.
- 前記受付部は、予め設定された周波数以下の領域について前記周波数成分を含む前記領域として指定された場合には、前記第2解析部によって解析しない又は前記第2解析部による解析結果を無視する請求項1記載の診断装置。 When the reception unit is designated as the region including the frequency component for a region below a preset frequency, the reception unit does not analyze by the second analysis unit or ignores the analysis result by the second analysis unit. Item 2. The diagnostic device according to Item 1.
- 前記表示部は、前記第1解析部により生成された前記周波数解析結果波形データをタッチパネル上に表示し、
前記受付部は、前記タッチパネル上における使用者のタッチ操作に基づいて、前記周波数成分を含む前記領域の指定を受付ける請求項1から3のいずれか1項記載の診断装置。 The display unit displays the frequency analysis result waveform data generated by the first analysis unit on a touch panel,
The diagnostic device according to claim 1, wherein the reception unit receives designation of the region including the frequency component based on a user's touch operation on the touch panel. - 外部装置との間で通信を行う通信部と、
前記抽出部により抽出された前記周波数成分の前記周期および前記周波数の前記情報を前記通信部を介して前記外部装置に送信する送信部と、
前記第1解析部により生成された前記周波数解析結果波形データに対応する周波数解析結果のデータを前記通信部を介して前記外部装置から受信する受信部とをさらに備え、
前記表示部は、前記第1解析部により生成された前記周波数解析結果波形データと、前記受信部により受信された前記周波数解析結果とを表示する請求項1から4のいずれか1項記載の診断装置。 A communication unit for communicating with an external device;
A transmission unit that transmits the information on the frequency and the frequency of the frequency component extracted by the extraction unit to the external device via the communication unit;
A reception unit that receives data of the frequency analysis result corresponding to the frequency analysis result waveform data generated by the first analysis unit from the external device via the communication unit;
The diagnosis according to any one of claims 1 to 4, wherein the display unit displays the frequency analysis result waveform data generated by the first analysis unit and the frequency analysis result received by the reception unit. apparatus. - 音情報を取得する取得部と、前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析部と、前記周波数解析結果波形データを表示する表示部と、表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付部と、前記領域に含まれる前記周波数成分を解析する第2解析部と、前記第2解析部による解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出部と、外部装置との間で通信を行う通信部と、前記抽出部により抽出された前記周波数成分の前記周期および前記周波数の前記情報を前記通信部を介して前記外部装置に送信する第1の送信部と、前記第1解析部により生成された前記周波数解析結果波形データに対応する周波数解析結果のデータを前記通信部を介して前記外部装置から受信する受信部とを備えた診断装置と、
異音の音情報の周波数解析を行って得られた複数の周波数解析結果のデータを格納する格納部と、前記診断装置から前記周波数成分の前記周期および前記周波数の前記情報を受信した場合、前記格納部に格納されている前記複数の周波数解析結果のデータの中から、受信した前記周波数成分の前記周期および前記周波数の前記情報に対応するものを選択して前記診断装置に送信する第2の送信部とを備えたサーバ装置と、
を備えた診断システム。 An acquisition unit that acquires sound information, a first analysis unit that performs time-frequency analysis of the sound information, and generates frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency, and the frequency analysis result waveform data A display unit for displaying; a receiving unit for receiving designation of a region including a frequency component from the displayed frequency analysis result waveform data; a second analyzing unit for analyzing the frequency component included in the region; and the second analysis An extraction unit that extracts information on the period and frequency of the frequency component from the analysis result by the unit, a communication unit that communicates with an external device, and the period and the frequency of the frequency component extracted by the extraction unit A first transmitter that transmits the information to the external device via the communication unit; and a frequency corresponding to the frequency analysis result waveform data generated by the first analyzer A diagnostic device that includes a receiving unit for the data of the analysis result via the communication unit received from the external device,
A storage unit that stores data of a plurality of frequency analysis results obtained by performing frequency analysis of abnormal sound information, and when the information on the period and the frequency of the frequency component is received from the diagnostic device, The second frequency analysis result data stored in the storage unit is selected from the received frequency component corresponding to the period and the information of the frequency, and transmitted to the diagnostic device. A server device comprising a transmission unit;
Diagnostic system with - 音情報を取得する取得ステップと、
前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析ステップと、
前記周波数解析結果波形データを表示する表示ステップと、
表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付ステップと、
前記領域に含まれる周波数成分を解析する第2解析ステップと、
前記第2解析ステップにおける解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出ステップと、を備えた診断方法。 An acquisition step for acquiring sound information;
A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
A display step for displaying the frequency analysis result waveform data;
An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data;
A second analysis step of analyzing a frequency component included in the region;
A diagnostic method comprising: an extraction step for extracting information on a period and frequency of the frequency component from the analysis result in the second analysis step. - 音情報を取得する取得ステップと、
前記音情報の時間周波数解析を行い、周波数毎の強度分布の時間変化を表す周波数解析結果波形データを生成する第1解析ステップと、
前記周波数解析結果波形データを表示する表示ステップと、
表示された前記周波数解析結果波形データから周波数成分を含む領域の指定を受付ける受付ステップと、
前記領域に含まれる周波数成分を解析する第2解析ステップと、
前記第2解析ステップにおける解析結果から前記周波数成分の周期および周波数の情報を抽出する抽出ステップと、をコンピュータに実行させるためのプログラム。
An acquisition step for acquiring sound information;
A first analysis step of performing time-frequency analysis of the sound information and generating frequency analysis result waveform data representing a temporal change in intensity distribution for each frequency;
A display step for displaying the frequency analysis result waveform data;
An accepting step of accepting designation of a region including a frequency component from the displayed frequency analysis result waveform data;
A second analysis step of analyzing a frequency component included in the region;
A program for causing a computer to execute an extraction step of extracting information on a period and frequency of the frequency component from an analysis result in the second analysis step.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2016370880A AU2016370880A1 (en) | 2015-12-14 | 2016-03-24 | Diagnostic device, diagnostic system, diagnostic method, and program |
CN201680066037.1A CN108351248B (en) | 2015-12-14 | 2016-03-24 | Diagnostic device, diagnostic system, diagnostic method, and program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015243112A JP5954604B1 (en) | 2015-12-14 | 2015-12-14 | Diagnostic device, diagnostic system and program |
JP2015-243112 | 2015-12-14 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017104146A1 true WO2017104146A1 (en) | 2017-06-22 |
Family
ID=56418752
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/059524 WO2017104146A1 (en) | 2015-12-14 | 2016-03-24 | Diagnostic device, diagnostic system, diagnostic method, and program |
Country Status (4)
Country | Link |
---|---|
JP (1) | JP5954604B1 (en) |
CN (1) | CN108351248B (en) |
AU (1) | AU2016370880A1 (en) |
WO (1) | WO2017104146A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11158315B2 (en) | 2019-08-07 | 2021-10-26 | International Business Machines Corporation | Secure speech recognition |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6834223B2 (en) * | 2016-07-29 | 2021-02-24 | 富士ゼロックス株式会社 | Diagnostic equipment, diagnostic systems and programs |
JP6840971B2 (en) * | 2016-09-21 | 2021-03-10 | 富士ゼロックス株式会社 | Diagnostic equipment, diagnostic systems and programs |
JP6822036B2 (en) * | 2016-09-21 | 2021-01-27 | 富士ゼロックス株式会社 | Diagnostic equipment, diagnostic systems and programs |
CN112513893B (en) * | 2018-08-03 | 2022-09-23 | 三菱电机株式会社 | Data analysis device, system, method, and program |
JP2023033848A (en) | 2021-08-30 | 2023-03-13 | トヨタ自動車株式会社 | Abnormal noise specification device, abnormal noise specification method and abnormal noise specification program |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09136776A (en) * | 1995-11-13 | 1997-05-27 | Hitachi Building Syst Co Ltd | Rotary bearing damage detecting device for elevator |
JPH10258974A (en) * | 1996-09-13 | 1998-09-29 | Toshiba Corp | Unsteady signal analyzer and medium recording unsteady signal analysis program |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH06318424A (en) * | 1993-03-12 | 1994-11-15 | Kitagawa Ind Co Ltd | Sound sensitive operating switch and emergency electric light and remote control holder using it |
CH693568A9 (en) * | 1996-09-13 | 2003-12-15 | Toshiba Kk | Analyzer for a varying signal and resulting media for an analysis program. |
US6192490B1 (en) * | 1998-04-10 | 2001-02-20 | International Business Machines Corporation | Method and system for monitoring computer performance utilizing sound diagnostics |
JP3908555B2 (en) * | 2002-02-08 | 2007-04-25 | 株式会社東芝 | Ultrasonic diagnostic equipment |
JP2006025281A (en) * | 2004-07-09 | 2006-01-26 | Hitachi Ltd | Information source selection system, and method |
JP2006113002A (en) * | 2004-10-18 | 2006-04-27 | Nsk Ltd | Anomaly diagnosis system for mechanical equipment |
CN101206548B (en) * | 2006-12-19 | 2012-01-11 | 北京汇冠新技术股份有限公司 | Infrared touch panel triggered using touch force and detecting method thereof |
CN101354485B (en) * | 2007-07-23 | 2011-04-06 | 奇美电子股份有限公司 | System and method for testing display apparatus |
JP5207074B2 (en) * | 2009-06-05 | 2013-06-12 | 清水建設株式会社 | Wind turbine blade abnormality determination method, abnormality determination device, and abnormality determination program |
JP5725833B2 (en) * | 2010-01-04 | 2015-05-27 | Ntn株式会社 | Rolling bearing abnormality diagnosis device, wind power generation device and abnormality diagnosis system |
JP2012208043A (en) * | 2011-03-30 | 2012-10-25 | Railway Technical Research Institute | Method and device for identifying vibration characteristic of railroad structure |
JP5783808B2 (en) * | 2011-06-02 | 2015-09-24 | 三菱電機株式会社 | Abnormal sound diagnosis device |
EA201400150A1 (en) * | 2011-07-23 | 2014-11-28 | Нексовейшн, Инк. | DEVICE, METHOD AND SYSTEM FOR MUSICATION |
CN102779398A (en) * | 2012-07-09 | 2012-11-14 | 深圳市同洲电子股份有限公司 | Control method, device and system for smart appliance |
JP6236282B2 (en) * | 2013-10-21 | 2017-11-22 | 株式会社日立ハイテクノロジーズ | Abnormality detection apparatus, abnormality detection method, and computer-readable storage medium |
JP2015173369A (en) * | 2014-03-12 | 2015-10-01 | ソニー株式会社 | Signal processor, signal processing method and program |
-
2015
- 2015-12-14 JP JP2015243112A patent/JP5954604B1/en active Active
-
2016
- 2016-03-24 AU AU2016370880A patent/AU2016370880A1/en not_active Abandoned
- 2016-03-24 WO PCT/JP2016/059524 patent/WO2017104146A1/en active Application Filing
- 2016-03-24 CN CN201680066037.1A patent/CN108351248B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09136776A (en) * | 1995-11-13 | 1997-05-27 | Hitachi Building Syst Co Ltd | Rotary bearing damage detecting device for elevator |
JPH10258974A (en) * | 1996-09-13 | 1998-09-29 | Toshiba Corp | Unsteady signal analyzer and medium recording unsteady signal analysis program |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11158315B2 (en) | 2019-08-07 | 2021-10-26 | International Business Machines Corporation | Secure speech recognition |
Also Published As
Publication number | Publication date |
---|---|
CN108351248A (en) | 2018-07-31 |
CN108351248B (en) | 2020-10-23 |
AU2016370880A1 (en) | 2018-05-10 |
JP5954604B1 (en) | 2016-07-20 |
JP2017110919A (en) | 2017-06-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017104146A1 (en) | Diagnostic device, diagnostic system, diagnostic method, and program | |
US10911607B2 (en) | Diagnosing an image forming apparatus based on sound signal analysis | |
JP5954648B1 (en) | Terminal device, diagnostic system, and program | |
WO2017110111A1 (en) | Terminal device, diagnosis system, diagnosis method, and program | |
JP6540962B2 (en) | Diagnostic device, diagnostic system and program | |
JP5954605B1 (en) | Diagnostic device, diagnostic system and program | |
JP2017111293A (en) | Diagnosis device, diagnosis system, device, and program | |
US10412234B2 (en) | Diagnostic device and diagnostic method | |
CN106915166B (en) | Diagnostic device, diagnostic system, and diagnostic method | |
JP6840971B2 (en) | Diagnostic equipment, diagnostic systems and programs | |
WO2017094270A1 (en) | Diagnosis device, diagnosis system, diagnosis method and program | |
JP6016149B1 (en) | Terminal device, diagnostic system, and program | |
JP6822036B2 (en) | Diagnostic equipment, diagnostic systems and programs | |
JP6834223B2 (en) | Diagnostic equipment, diagnostic systems and programs | |
JP6763255B2 (en) | Diagnostic equipment, diagnostic systems and programs |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16875134 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016370880 Country of ref document: AU Date of ref document: 20160324 Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16875134 Country of ref document: EP Kind code of ref document: A1 |