WO2017115474A1

WO2017115474A1 - Diagnosis device, diagnosis system, and program

Info

Publication number: WO2017115474A1
Application number: PCT/JP2016/062174
Authority: WO
Inventors: 伊藤　篤; 勉宇高; 小笠原　文彦; 智之三ツ橋; 慎也宮森; 河野　功幸
Original assignee: 富士ゼロックス株式会社
Priority date: 2015-12-28
Filing date: 2016-04-15
Publication date: 2017-07-06
Also published as: JP6868176B2; JP2017120199A

Abstract

This diagnosis device comprises: a sound recording unit which records a sound emitted from a diagnosis subject; a receiving unit which receives an operation from a user; an obtaining unit which, when the receiving unit receives the operation, obtains, as diagnosis data, sound data recorded during a predetermined time period between points in time before and after the reception; and a warning unit which warns that the sound recording unit has started sound recording before the receiving unit receives the operation.

Description

Diagnostic device, diagnostic system and program

The present invention relates to a diagnostic device, a diagnostic system, and a program.

In Patent Document 1, in an image forming apparatus that forms an image on a sheet, a storage unit that stores a normal operation sound of the image forming apparatus and a sound detection that detects an operation sound generated from the image forming apparatus Based on the first sound information stored in the storage means, the second sound information detected by the sound detection means, and the operation information of the image forming apparatus. There is disclosed an image forming apparatus characterized by comprising an identifying means for identifying an abnormal part.

Japanese Patent Application Laid-Open No. 2004-228561 discloses an image processing apparatus that includes an image forming unit that forms an image on a print sheet and a transport unit that conveys the print sheet, and that converts sound inside the image process apparatus into an electrical signal. An image processing apparatus comprising: a sound analysis unit that analyzes an electrical signal converted by the sound conversion unit; and an output unit that outputs a result of analysis performed by the sound analysis unit. Yes.

Patent Document 3 discloses normal set data acquired when a component or internal device is in a normal state with respect to set data composed of a combination of a plurality of types of information acquired from a test machine equipped with the component or internal device. Or a group data classification method for classifying whether the part or internal device is abnormal group data acquired when the component or the internal device is in an abnormal state, at least from a predetermined start time, A data construction step of acquiring and storing the set data from the inspection machine at a predetermined cycle and building time-series data of the set data during a period until a failure occurs, and a plurality of times in the time-series data A classification process for classifying which of the plurality of clusters corresponds to each of the set data by cluster analysis, and a failure based on the classification result A specific step for identifying a time point before the birth time point and when the appearance pattern of the cluster begins to change as a transition time point when the component or internal device has shifted from a normal state to an abnormal state, and a plurality of times in the time-series data Among the set data, the set data acquired from the transition time to immediately before the failure occurrence time is classified as abnormal set data, while the set data acquired from the start time to immediately before the transfer time is There is disclosed a group data sorting method characterized by performing a sorting step of sorting as normal group data.

Japanese Unexamined Patent Publication No. 2007-079263 Japanese Unexamined Patent Publication No. 2008-290288 Japanese Unexamined Patent Publication No. 2010-114701

When recording the sound emitted by the diagnostic object or acquiring it as diagnostic data, not only the sound emitted by the diagnostic object but also the sound around the diagnostic object may be recorded or acquired as diagnostic data Yes, there is a risk of confidentiality leaking.

At least one embodiment of the present invention can warn that recording is being performed or recording is possible even if the data is not acquired as diagnostic data.

The first aspect of the present invention includes a recording unit that records a sound emitted by a diagnosis target, a reception unit that receives an operation from a user, and a predetermined time before and after the time when the reception unit receives an operation. The diagnostic apparatus includes an acquisition unit that acquires time-recorded data as diagnostic data, and a warning unit that warns that the recording unit has started recording before receiving an operation by the receiving unit.

According to a second aspect of the present invention, there is a recording unit that records a sound emitted by a diagnosis target, a reception unit that receives an operation from a user, and a predetermined time before and after the time when the reception unit receives an operation. An acquisition unit that acquires time-recorded data as diagnostic data, a first warning unit that warns that the recording unit has started recording, and that the recording unit has started recording sound used as diagnostic data And a second warning unit for warning.

According to a third aspect of the present invention, there is provided a recording unit for recording a sound emitted from a diagnosis target, a receiving unit for receiving an operation from a user, and a recording for a predetermined time after receiving the operation when the receiving unit receives the operation. An acquisition unit that acquires data as diagnostic data, a first warning unit that warns that recording by the recording unit is possible, and recording of sound that the acquisition unit uses as diagnostic data has started. And a second warning unit that warns that.

A fourth aspect of the present invention is the diagnostic apparatus according to any one of the first to third aspects, wherein the second warning unit issues a warning by means different from the first warning unit.

According to a fifth aspect of the present invention, in any one of the first to fourth aspects, the first warning unit and the second warning unit give a warning by display on a display unit or vibration of a vibration unit. This is a diagnostic device.

According to a sixth aspect of the present invention, there is provided a recording unit that records a sound emitted by a diagnosis target, a reception unit that receives an operation from a user, and a predetermined time before and after the reception when the reception unit receives an operation. An acquisition unit that acquires time-recorded data as diagnostic data, a warning unit that warns that the recording unit has started recording before accepting an operation by the reception unit, and a diagnostic unit that is acquired by the acquisition unit An estimator that estimates the cause of sound generation based on data.

According to a seventh aspect of the present invention, there is provided a recording unit that records a sound emitted by a diagnosis target, a reception unit that receives an operation from a user, and a predetermined time before and after the reception when the reception unit receives an operation. An acquisition unit that acquires time-recorded data as diagnostic data, a first warning unit that warns that the recording unit has started recording, and that the recording unit has started recording sound used as diagnostic data Is a diagnostic system that includes a second warning unit that warns the sound and an estimation unit that estimates the cause of sound generation based on the diagnostic data acquired by the acquisition unit.

According to an eighth aspect of the present invention, there is provided a recording unit for recording a sound emitted from a diagnosis target, a receiving unit for receiving an operation from a user, and a recording for a predetermined time after receiving the operation when the receiving unit receives the operation. An acquisition unit that acquires data as diagnostic data, a first warning unit that warns that recording by the recording unit is possible, and recording of sound that the acquisition unit uses as diagnostic data has started. This is a diagnostic system having a second warning unit that warns of this, and an estimation unit that estimates the cause of sound generation based on the diagnostic data acquired by the acquisition unit.

According to a ninth aspect of the present invention, there is provided a step of recording a sound emitted by a diagnosis object, a step of accepting an operation from a user, and a predetermined time before and after the time when the operation is accepted in the accepting step. A program for causing a computer to execute a step of acquiring recording data as diagnostic data and a step of warning that recording is started in the recording step before receiving an operation in the receiving step.

According to a tenth aspect of the present invention, there is provided a step of recording a sound emitted from a diagnosis object, a step of receiving an operation from a user, and a predetermined time before and after the time when the operation is received in the receiving step. Obtaining recording data as diagnostic data, warning that recording has started in the recording step, and warning that recording of sound used as diagnostic data in the recording step has started. A program to be executed by a computer.

According to an eleventh aspect of the present invention, there is provided a step of recording a sound emitted from a diagnosis object, a step of accepting an operation from a user, and recording data for a predetermined time after being accepted when the operation is accepted in the accepting step. Obtaining as diagnostic data, warning that recording is possible in the recording step, and warning that recording of sound used as diagnostic data in the obtaining step is started. A program to be executed by a computer.

According to the first aspect, unlike the case of warning that the recording has been started only after the operation of the reception unit, the fact that the recording is being made is warned even if it is not acquired as diagnostic data. It is possible to provide a diagnostic apparatus capable of

According to the second aspect, unlike the case where a warning is given only for the recording of sound used as diagnostic data, a warning is given that the recording has been made even if it is not acquired as diagnostic data. It is possible to provide a diagnostic apparatus capable of

According to the third aspect, unlike the case where a warning is issued only for recording sound used as diagnostic data, a diagnostic device capable of warning that recording is possible is provided. With the goal.

According to the fourth aspect, it is possible to provide a diagnostic device that can distinguish the second warning from the first warning.

According to the fifth aspect, it is possible to provide a diagnostic device that can prevent the warning sound from being mixed into the diagnostic data that may occur when warning is given by the warning sound.

According to the sixth aspect, unlike the case of warning that the recording is started only after the operation of the reception unit, the warning that the recording is made is made even when the data is not acquired as diagnostic data. It is possible to provide a diagnostic system capable of

According to the seventh aspect, unlike the case where a warning is given only for the recording of sound used as diagnostic data, a warning is given that a recording has been made even if it is not acquired as diagnostic data. It is possible to provide a diagnostic system capable of

According to the eighth aspect, unlike the case where a warning is issued only for recording sound used as diagnostic data, a diagnostic system capable of warning that recording is possible is provided. With the goal.

According to the ninth aspect, unlike the case of warning that the recording is started only after the operation in the receiving step, the warning that the recording is made is made even if the data is not acquired as diagnostic data. It is possible to provide a program that can

According to the tenth aspect, unlike the case where a warning is given only for the recording of sound used as diagnostic data, a warning is given that recording has been made even if the data is not acquired as diagnostic data. It is possible to provide a program that can

According to the eleventh aspect, unlike the case where a warning is issued only for recording sound used as diagnostic data, a program capable of warning that recording is possible is provided. Objective.

1 is a system diagram illustrating a configuration of a diagnostic system according to a first embodiment of the present invention. It is sectional drawing of the image forming apparatus which is a diagnostic object diagnosed with the diagnostic system shown in FIG. It is a block diagram which shows the hardware constitutions of the diagnostic apparatus which the diagnostic system shown in FIG. 1 has. It is a block diagram which shows the function structure of the diagnostic apparatus shown in FIG. It is a block diagram which shows the function structure of the server apparatus which the diagnostic system shown in FIG. 1 has. It is a figure which shows an example of the information stored in the waveform data storage part which the server apparatus shown in FIG. 5 has. It is a sequence chart for demonstrating operation | movement of the diagnostic system shown in FIG. It is a figure for demonstrating the concept of STFT. It is a figure which shows the example of an image of the frequency spectrum waveform based on the analysis result obtained by STFT. FIG. 10 is a diagram illustrating an example of a selection region selected by a user in the image example of the frequency spectrum waveform of FIG. 9. It is a figure which shows the example of an analysis result of a fast Fourier transform. It is a figure which shows the state in which two frequency spectrum waveforms were displayed on the display apparatus which the diagnostic apparatus shown in FIG. 3 has. It is a flowchart which shows the operation | movement flow for acquiring the diagnostic data with the diagnostic system shown in FIG. It is a figure which shows the display in the recording mode of the display apparatus which the diagnostic apparatus shown in FIG. 3 has. It is a figure explaining the timing when the 1st warning is made, and the timing when the 2nd warning is made while explaining the recording time for acquiring diagnostic data in the diagnostic system shown in FIG. It is a figure which shows the relationship between recording time and analysis precision. It is a figure which shows the relationship between the analysis time with respect to recording time, and communication time. It is a flowchart which shows the operation | movement flow for acquiring the data for diagnosis with the diagnostic system which concerns on 2nd Embodiment. It is a figure which shows the display in the recording mode of the display apparatus which the diagnostic apparatus which concerns on 2nd Embodiment has. It is a figure explaining the timing when the 1st warning is made, and the timing when the 2nd warning is made while explaining the recording time for acquiring diagnostic data in the diagnostic system concerning a 2nd embodiment. .

Next, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a diagnostic system 1 according to a first embodiment of the present invention.

As shown in FIG. 1, the diagnostic system 1 includes a portable diagnostic device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50, and includes an image forming device 200 and the like. It is used for diagnosis of a diagnosis target.

The present invention is applicable to any device as long as the diagnostic device 10 can be connected to the server device 50 via a communication network. However, in the present embodiment, the diagnosis device 10 will be described using a case of a tablet terminal device including a device such as a microphone capable of acquiring a sound signal and a touch panel capable of touch input.

The diagnostic apparatus 10 is carried by a service person (maintenance personnel) who performs maintenance management, repair, etc. of the image forming apparatus 200 such as a printer used by the end user, and generates a sound signal generated in the image forming apparatus 200. Acquired and used to analyze the frequency of the acquired sound signal, or to display the frequency analysis result waveform of the past sound signal acquired from the server device 50 and the frequency analysis result waveform of the acquired sound signal. The

The diagnosis apparatus 10 and the server apparatus 50 are connected via a wireless LAN terminal 30 such as a Wi-Fi router, the Internet communication network 40, and the like, and transmit / receive information.

When the diagnostic device 10 is a mobile phone device, a smartphone, or the like, it is also possible to connect the diagnostic device 10 and the server device 50 via a mobile phone network so as to transmit / receive defect information.

In the diagnostic system 1, when an abnormal sound is generated in the image forming apparatus 200 that is the target electronic device installed at the end user's place and is a diagnosis target, the service person carries the diagnostic apparatus 10 and the image forming apparatus 200 Go to the place. Then, the service person obtains a sound signal by recording the sound generated by using the diagnostic device 10 and performs a diagnosis for identifying the cause of the abnormal sound. Here, the abnormal sound is a sound that is not generated when the diagnosis target of the image forming apparatus 200 or the like is in a normal state, but is generated when a failure such as a failure occurs in the diagnosis target.

Although it is technically possible to provide a recording function by providing a microphone or the like in the image forming apparatus 200 and when the abnormal sound is generated, the abnormal sound is recorded by the recording function. When installed in an end user's office or the like, it is impossible to provide the image forming apparatus 200 with a voice recording function for security reasons such as leakage of confidential information.

FIG. 2 is a schematic cross-sectional view showing the image forming apparatus 200. The image forming apparatus 200 includes a user interface (UI) apparatus 201, an image forming apparatus main body 202, and an image reading apparatus 203.

The UI device 201 is a device that includes a display device that displays information and an input reception device that receives an input made by an operator, and includes, for example, a touch panel. For example, an operator such as an end user or a service person can input operation setting information via the UI device 201.

The image forming apparatus main body 202 has, for example, a three-stage recording medium supply cassette 204, and each of these recording medium supply cassettes 204 is provided with a supply head 205.

When one of the recording medium supply cassettes 204 is selected, the supply head 205 is operated and supplied from the selected recording medium supply cassette 204 to the image forming unit 207 via the recording medium supply path 206.

The image forming unit 207 is provided with yellow, magenta, cyan, and black photoconductors 208 and an intermediate transfer belt 209.

In addition to the exposure device 210, a charging device, a developing device, a primary transfer device, a cleaning device, and the like (not shown) are arranged around each photoconductor 208, and a toner image formed on each photoconductor 208 is intermediate. The image is transferred to the transfer belt 209. The exposure device 210 is composed of an LED or a laser light emitting device, has an output resolution of, for example, 600 dpi, and can adjust the amount of light for each dot.

The toner image on the intermediate transfer belt 209 is transferred to the recording medium sent by the secondary transfer roll 211 and fixed by the fixing device 212. The recording medium on which the toner image is fixed passes through the recording medium discharge path 213. And discharged to the discharge unit 214.

When duplex printing is set, the recording medium whose surface is fixed by the fixing device 212 is sent from the recording medium discharge path 213 to the reversing device 215, reversed by the reversing device 215, and sent to the recording medium reversing path 216. Then, it is returned again to the recording medium supply path 206 and sent to the image forming unit 207 to print the back side.

The image reading device 203 includes a document supply unit 217 to which a document is supplied, a document image reading unit 218 that reads an original document, a document feeding device 219 that sends a document from the document supply unit 217 to the image reading unit 218, and a document A document discharge unit 220 that discharges the document whose image has been read by the image reading unit 218;

The image forming unit 207, the recording medium supply path 206, the recording medium discharge path 213, the recording medium reversing path 216, the fixing device 212, and the image reading apparatus 203 are provided with a large number of rotating bodies such as transport rollers.

In such an image forming apparatus 200, the sheet feeding speed is generally about 100 to 350 mm / sec. The largest diameter of the rotating body is the photoconductor 208, and the largest is about 30 mm.

FIG. 3 shows the hardware configuration of the diagnostic apparatus 10. As shown in FIG. 3, the diagnostic device 10 communicates wirelessly with a CPU 11, a memory 12 that can temporarily store data, a storage device 13 such as a flash memory, and a wireless LAN terminal 30 (see FIG. 1). Wireless LAN interface (IF) 14 for transmitting and receiving data, for example, an input device 15 such as a touch sensor, a display device 16, a microphone 17 used as a recording unit, and a sound generation unit that emits sound. And a vibration generating element 19 used as a vibration generating unit for generating vibration in the diagnostic apparatus 10. These components are connected to each other via a control bus 20.

The diagnostic device 10 includes a touch panel in which a touch sensor for detecting a touch position is provided as the input device 15 on the display device 16. The touch panel is used for display and input from the user. Is called.

The CPU 11 controls the operation of the diagnostic device 10 by executing a predetermined process based on a control program stored in the memory 12 or the storage device 13. The control program can be obtained by downloading it via the Internet communication network 40 or the mobile phone network and provided to the CPU 11, or the program can be stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.

The display device 16 displays various data, a frequency spectrum waveform described later, and the like, and displays various warnings, for example. The speaker 18 emits various sounds, for example, a warning sound. The vibration generating element 19 vibrates to issue a warning, for example.

The diagnostic device 10 according to the present embodiment performs an operation as described below by executing the above-described control program, thereby assisting a service person in identifying a cause of abnormal noise.

FIG. 4 is a block diagram showing a functional configuration of the diagnostic apparatus 10 realized by executing the above-described control program.

As shown in FIG. 4, the diagnostic device 10 of the present embodiment includes a diagnostic data acquisition unit 31, a frequency analysis unit 32, a control unit 33, a sound data storage unit 34, a display unit 35, and a communication unit. 36, a sound reproducing unit 37, a first warning unit 38, and a second warning unit 39.

The display unit 35 displays various data based on the control by the control unit 33. The communication unit 36 communicates with the server device 50 that is an external device. Based on the control by the control unit 33, the sound reproduction unit 37 reproduces the recorded sound data and converts it into a sound signal.

The diagnostic data acquisition unit 31 is used as an acquisition unit, and acquires sound data by inputting sound generated in the image forming apparatus 200 that is an analysis target apparatus. The diagnostic data acquisition unit 31 will be described in detail later.

The frequency analysis unit 32 performs time-frequency analysis (time-dependent frequency analysis) of the diagnostic signal acquired by the diagnostic data acquisition unit 31, and calculates a time change of the signal intensity distribution for each frequency of the acquired diagnostic signal. The represented frequency spectrum waveform (waveform of the first frequency analysis result) data is generated.

Specifically, the frequency analysis unit 32 generates frequency spectrum waveform data by performing STFT (Short Time Fourier Transform) on the sound signal acquired by the diagnostic data acquisition unit 31.

The control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the sound data storage unit 34 together with the sound data.

In addition, the control unit 33 performs fast Fourier transform (1D-FFT) that performs frequency analysis in the time axis direction on a frequency component estimated to be abnormal sound in the frequency spectrum waveform data obtained by the frequency analysis unit 32. (Fast Fourier Transform) is instructed to the frequency analysis unit 32. Fast Fourier transform is equivalent to autocorrelation transform, and fast Fourier transform can be replaced with autocorrelation transform.

Here, the control unit 33 may extract a signal component having periodicity from the frequency spectrum waveform data, and select the signal component as a signal component that is highly likely to be abnormal sound. . In addition, the control unit 33 displays the obtained frequency spectrum waveform data on the display unit 35, and designates a frequency component that is highly likely to be abnormal by the user who viewed the frequency spectrum waveform. The component may be selected as a signal component that is highly likely to be an abnormal sound.

Then, the frequency analysis unit 32 performs fast Fourier transform in the time axis direction on the frequency component estimated to be abnormal sound based on the instruction from the control unit 33.

And the control part 33 acquires the period and frequency information of an abnormal sound by the analysis result of a fast Fourier transform by the frequency analysis part 32. FIG.

In addition, the control unit 33 includes the acquired period and frequency information of the abnormal sound, the model name of the image forming apparatus 200, model information such as a serial number, and operation state information indicating the operation state of the image forming apparatus 200. To the server device 50 via Specifically, this operation status information includes information such as color printing or monochrome printing, duplex printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included. In this way, the control unit 33 transmits information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server device 50 via the communication unit 36.

The first warning unit 38 and the second warning unit 39 each issue a warning based on the control by the control unit 33. More specifically, the first warning unit 38 and the second warning unit 39 each display a warning on the display device 16 or cause the speaker 18 to emit a warning sound based on control by the control unit 33. The vibration generating element 19 is vibrated. Details of the first warning unit 38 and the second warning unit 39 will be described later.

The server apparatus 50 obtains the original sound data and the sound data from the spectral waveform data obtained by performing frequency analysis of the sound signal of the abnormal sound that occurred in the past in an apparatus equivalent to the apparatus of the image forming apparatus 200. Together with information such as the operating state of the device, the cause of the abnormal noise, and how to deal with the abnormal noise.

Then, the server device 50 uses the frequency spectrum waveform (second phase) corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the abnormal sound period and frequency information transmitted from the diagnostic device 10. (Frequency analysis result waveform) data is searched, and the found frequency spectrum waveform data is transmitted to the diagnosis apparatus 10 together with information such as sound data stored as sample waveform data of abnormal sound.

As a result, the control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.

The control unit 33 displays the frequency spectrum waveform obtained by performing the frequency analysis of the sound signal acquired by the diagnostic data acquisition unit 31 and the spectrum waveform received from the server device 50 on the display unit 35 in parallel. Control.

At this time, the control unit 33 includes at least a frequency spectrum waveform obtained by performing frequency analysis of the sound signal acquired by the diagnostic data acquisition unit 31 and a frequency spectrum waveform transmitted from the server device 50. The display position in the time axis direction on one side is changed based on a user (user) operation.

The control unit 33 includes a frequency spectrum waveform obtained by performing frequency analysis of the diagnostic data acquired by the diagnostic data acquisition unit 31 and a periodic waveform in the frequency spectrum waveform transmitted from the server device 50. You may make it change the display position of the time-axis direction in at least one of these two frequency spectrum waveforms so that a position may correspond.

In addition, any one of the frequency spectrum waveform obtained by performing the frequency analysis of the diagnostic data acquired by the diagnostic data acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50 is: The waveform is set to be longer than the other waveform.

As an example, in the present embodiment, the frequency spectrum waveform obtained by performing frequency analysis of the diagnostic data acquired by the diagnostic data acquisition unit 31 is data for about 4 seconds to 16 seconds, and the server The frequency spectrum waveform transmitted from the device 50 is data for about 8 seconds.

In addition, when there are a plurality of frequency spectrum waveform data transmitted from the server device 50, the control unit 33 includes the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 among the plurality of frequency spectrum waveform data. Are displayed on the display unit 35 with priority.

Furthermore, the control unit 33 is either one of the frequency spectrum waveform obtained by performing frequency analysis of the sound signal acquired by the diagnostic data acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50. When one of the waveforms is enlarged or reduced, the other waveform is enlarged or reduced so as to have the same size.

Further, the control unit 33 displays the process speed (image forming speed) of the image forming apparatus 200 when the sound waveform is acquired and the image forming apparatus when the frequency spectrum waveform transmitted from the server apparatus 50 is acquired. If the process speeds are different from each other, the length of the frequency spectrum waveform transmitted from the server device 50 in the time axis direction may be expanded or reduced based on the two process speeds.

This is because the period of abnormal noise that occurs when the process speed changes also changes, so that a correct comparison cannot be made if they are compared as they are. Also, acquiring and preparing diagnostic data for each of a plurality of process speeds increases the amount of data and the trouble of acquiring diagnostic data.

Further, when the user instructs the reproduction of the sound data, the sound reproduction unit 37 is transmitted from the server device 50 with the sound data acquired in the diagnostic data acquisition unit 31 based on the control from the control unit 33. The sound data corresponding to the frequency spectrum waveform may be reproduced as a stereo reproduction left signal and right signal, respectively.

Further, in order to facilitate the comparison of the two frequency spectrum waveforms, the control unit 33 can adjust an adjustable frequency auxiliary line indicating the same frequency on the two frequency spectrum waveforms displayed in parallel or the time axis direction. An adjustable common time axis auxiliary line for comparing the positions may be displayed in an overlapping manner.

FIG. 5 is a block diagram illustrating a functional configuration of the server device 50, and FIG. 6 is a diagram illustrating information stored in the waveform data storage unit 53 included in the server device 50. As shown in FIG. 5, the server device 50 of this embodiment includes a communication unit 51, a control unit 52, and a waveform data storage unit 53.

The waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of abnormal sounds generated in the past in an apparatus equivalent to the image forming apparatus 200 that is an analysis target apparatus.

Specifically, as shown in FIG. 6, the waveform data storage unit 53 includes frequency spectrum waveform data obtained by time-frequency analysis of previously acquired sound data, the original sound data, Information on the cause of abnormal noise and how to deal with it is stored for each model.

When the control unit 52 receives information on the period and frequency of abnormal noise from the diagnostic device 10, the control unit 52 receives the abnormal period received from the waveform data of a plurality of frequency spectra stored in the waveform data storage unit 53. On the basis of the frequency information, the data similar to the waveform data of the frequency spectrum based on the abnormal sound acquired in the diagnostic device 10 is selected and transmitted to the diagnostic device 10 via the communication unit 51.

In this embodiment, the diagnosis device 10 is described as performing the STFT and fast Fourier transform of abnormal sound data and transmitting the period and frequency information of the abnormal sound to the server device 50. Both Fourier transform, STFT, and fast Fourier transform may be executed on the server device 50 side.

In this case, sound data is transmitted as it is from the diagnostic device 10 to the server device 50, or frequency spectrum waveform data obtained as a result of performing STFT on the sound data is transmitted, and the server device 50 performs STFT on the sound data. Or fast Fourier transform.

FIG. 7 is a sequence chart showing the operation of the diagnostic system 1 of the present embodiment, FIG. 8 is a diagram for explaining the concept of STFT performed in the diagnostic system 1, for example, and FIG. It is a figure which shows the example of an image of the frequency spectrum waveform based on the analysis result obtained by STFT.

As shown in FIG. 7, when the diagnosis device 10 performs a diagnosis for specifying the cause of abnormal noise, various information such as a model name, a serial number, and an operation state are input (step S10).

Then, in the diagnostic device 10, the operation mode is set to the recording mode, and the microphone 17 is brought close to the abnormal sound generation portion of the image forming apparatus 200 to perform recording, thereby obtaining diagnostic data (step S100). Step S100 will be described in detail later.

In the diagnostic device 10, the acquired sound data is subjected to STFT in the frequency analysis unit 32, thereby generating a frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency (step S202).

Here, as shown in FIG. 8, the STFT is obtained by performing Fourier transform every short time and calculating the signal intensity for each frequency component according to the time change. FIG. 9 shows a waveform example when the analysis result obtained by the STFT is an image of one frequency spectrum waveform.

In the frequency spectrum waveform example shown in FIG. 9, the horizontal axis represents time, the vertical axis represents frequency, and the intensity for each frequency is represented by color. In FIG. 9, this color difference is expressed by a hatching pattern. Further, FIG. 9 illustrates the case where the intensity for each frequency is expressed by color, but it is also possible to express this intensity by gradation.

In the frequency spectrum waveform example of FIG. 9, it can be seen that the abnormal frequency component 61 is periodically generated at a specific frequency. In the frequency spectrum waveform example shown in FIG. 9, the low frequency component is a normal operation sound and not an abnormal frequency component.

When the frequency spectrum waveform as shown in FIG. 9 is obtained, the control unit 33 causes the display unit 35 to display the frequency spectrum waveform. Then, the user who is presented with the frequency spectrum waveform specifies the abnormal frequency component 61, and selects a region including the abnormal frequency component 61 by operating the touch panel, for example.

FIG. 10 shows an example of the selection area 80 selected by the user in this way. In the example shown in FIG. 10, it can be seen that a rectangular region including a plurality of abnormal frequency components 61 is designated as the selection region 80.

When the selection area 80 is designated in this way, the fast Fourier transform (1D-FFT) for the frequency component included in the selection area 80 is executed by the frequency analysis unit 32 (step S204). An example of the analysis result of the fast Fourier transform executed in this way is shown in FIG.

In FIG. 11, the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform. In addition, since an overtone component etc. are contained in an abnormal sound, a some period may be detected, but the period with the strongest signal strength is detected as an abnormal sound period.

In addition, since a signal component having a long period of a predetermined period or more is considered to be normal operation sound or indefinite period noise, such a long-cycle signal component region is set as a determination exclusion region 62 in the determination exclusion region 62. Analysis results are ignored.

Furthermore, since the low frequency signal component below the predetermined frequency cannot be distinguished from the normal operation sound, such a low frequency signal component region is set as the determination exclusion region 63, and the analysis result in the determination exclusion region 63 is as follows. It will be ignored.

The diagnostic device 10 transmits the frequency and period information of the abnormal sound together with the model information and the operating state information to the server device 50 based on the analysis result of the fast Fourier transform (step S206). For example, information such that the abnormal frequency is 4 kHz and the abnormal cycle is 2.0 seconds is transmitted to the server device 50.

Then, the server device 50 searches the waveform data storage unit 53 based on the received information to extract frequency spectrum waveform data corresponding to the received information (step S208).

Then, the server device 50 transmits the extracted frequency spectrum waveform data to the diagnostic device 10 together with information such as the original sound data, the cause of the abnormal sound, and a coping method thereof (step S210).

Then, the diagnostic device 10 receives the frequency spectrum waveform data transmitted from the server device 50 (step S212). And the control part 33 of the diagnostic apparatus 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by STFT on the display part 35 (step S214).

FIG. 12 shows a screen example of the diagnostic apparatus 10 on which two frequency spectrum waveforms are displayed in this way.

In the screen example shown in FIG. 12, the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as “analysis result waveform of unusual sound recorded this time” and transmitted from the server device 50. However, it can be seen that “past sound data” is displayed together with the cause of the abnormal sound “wear of the photosensitive drum”.

The serviceman who wants to perform diagnosis compares the two frequency spectrum waveforms and determines whether or not the abnormal sound components in the waveforms are similar, thereby specifying the cause of the abnormal sound.

Next, the operation of the diagnostic device 10 such as acquisition of diagnostic data (see step S100 in FIG. 7) will be described. FIG. 13 is a flowchart showing the operation of the diagnostic apparatus 10.

When the operator performs an operation for setting the diagnostic device 10 to the recording mode, the control unit 33 controls the display unit 35 to display the recording screen shown in FIG. 14 on the display device 16 in step S110. On the recording screen, as shown in FIG. 14, a sound display section 90 indicating the strength of sound to be recorded on the time axis, a recording start button 91, and a recording end button 92 are displayed.

The recording start button 91 is used as a reception unit that receives an operation from the user. When the recording start button 91 is operated by the operator, the control unit 33 starts recording with the microphone 17. The recording end button 92 is used as a reception unit that receives an operation from the user. When the recording end button 92 is operated by the operator, the control unit 33 ends the recording by the microphone 17. As will be described later, recording by the microphone 17 ends after the time T2 has elapsed since the recording end button 92 was operated (see FIG. 15).

When it is confirmed in the next step S112 that an operation for starting recording has been performed, in the next step S114, the control unit 33 controls the first warning unit 38 to record the first warning unit 38. Alert that it has started. More specifically, the control unit 33 controls the first warning unit 38 to cause the display device 16 to display a warning, cause the speaker 18 to emit a warning sound, or cause the vibration generating element 19 to perform a diagnostic device. 10 is vibrated.

In the next step S116, the control unit 33 records and records. That is, the control unit 33 records the sound from the microphone 17 in the memory 12 or the like.

After confirming that the predetermined time T1 has elapsed in the next step S118, in the next step S120, the control unit 33 erases the sound data recorded before the predetermined time T1. As described above, the control by the control unit 33 keeps the memory 12 and the like in a state in which sound data recorded after the time T1 determined in advance from the current time is recorded.

In the next step S122, the control unit 33 determines whether or not the recording end operation has been performed, that is, whether or not the recording end button 92 used as a reception unit that receives an operation from the user has been operated. The operation for ending the recording is performed by a serviceman who is going to perform diagnosis, for example, by pressing the recording end button 92 at the timing when an abnormal sound is generated while listening to the sound through the microphone 17.

As will be described later, when the recording end button 92 receives an operation to end recording, the diagnostic data acquisition unit 31 acquires the recorded sound as diagnostic data. For this reason, if it is determined in step S122 that an operation for ending recording has been received, in the next step S124, the control unit 33 adds the diagnostic data acquisition unit 31 to the second warning unit 39. Warning that the acquisition of diagnostic data by has started.

More specifically, the control unit 33 controls the second warning unit 39 to cause the display device 16 to display a warning, cause the speaker 18 to emit a warning sound, or cause the vibration generating element 19 to perform a diagnostic device. 10 is vibrated. The second warning in step S124 is different from the first warning in step S114, and can be distinguished from the first warning.

For example, when the warning is displayed on the display device 16 as the second warning, the display is different from the display in the first warning. When the speaker 18 emits a warning sound as the second warning, the warning sound is the first warning. This is different from the warning sound in the first warning. Further, a warning sound is generated on the speaker 18 as the first warning, the diagnostic device 10 is vibrated by the vibration generating element 19 as the second warning, or the diagnostic device 10 is vibrated by the vibration generating element 19 as the first warning. The warning may be displayed on the display device 16 as the second warning.

Further, if the first warning unit 38 and the second warning unit 39 warn by display on the display device 16 or vibration by the vibration generating element 19, it is not necessary to generate a warning sound and the sound is recorded. Warning sound is prevented from being added to diagnostic data.

In step S126, the control unit 33 terminates the first warning started in step S114. The first warning is stopped at the timing when it is determined in step S122 that the operation for ending the recording has been received, that is, simultaneously with the start of the second warning in step S124.

If it is determined in step S122 that an operation to end recording has been received, recording is not stopped immediately, and in step S128, the control unit 33 continues recording.

In the next step S130, the control unit 33 determines whether or not a predetermined time T2 has elapsed after accepting the recording end operation, and returns to step S128 until the predetermined time T2 elapses. When the recording is continued and it is determined that the predetermined time T2 has elapsed, the process proceeds to step S132, and the recording is terminated.

In the next step S134, the control unit 33 terminates the second warning started in step S124.

In the next step S136, the control unit 33 causes the diagnostic data acquisition unit 31 to acquire diagnostic data. More specifically, as shown in FIG. 15, the control unit 33 uses the total time T3 = T1 + T2 of the time T1 before receiving the recording end operation and the time T2 after receiving the recording end operation as diagnostic data. The acquisition part 31 is made to acquire. Since the service person hears the abnormal sound from the microphone 17 and immediately presses the recording end button 92, the abnormal sound heard by the service person is surely acquired by including the time T1 before the recording end signal. Further, by setting the total time T3 appropriately, periodic abnormal noise is acquired as diagnostic data. Here, T1 = T2 may be set, and T1 and T2 may be different from each other.

FIG. 15 shows the timing at which the first warning unit 38 gives the first warning together with the timing at which the diagnostic data acquisition unit 31 acquires the diagnostic data for the total time T3, and the second warning unit 39 The timing for giving the second warning is shown.

As described above, in the general image forming apparatus 200, the sheet feeding speed is about 100 to 350 mm / sec, and the photosensitive member 208 having the largest diameter among the rotating bodies is about φ30 mm. The period of abnormal noise is about 1 second at the maximum. Therefore, when recording unusual noise with periodicity, diagnostic data for the time required for the photoconductor 208 to rotate twice is required, and the total time T3 is 2 seconds or more.

Furthermore, in order to calculate the abnormal sound period by performing the time change analysis of the above-mentioned STFT etc. and applying the 1D-FFT of the time axis on the result screen, the diagnostic data for the time when the photoconductor 208 rotates four times is required. The total time T3 is 4 seconds or more. For example, T1 = 4 seconds and T2 = 4 seconds.

Here, as shown in FIG. 16, the analysis accuracy of the abnormal sound period increases rapidly while the recording time that is the basis of the diagnostic data is short, but approaches the saturation when the recording time becomes long to some extent.

On the other hand, as shown in FIG. 17, in proportion to the recording time, the time required for STFT analysis or the like becomes longer, and the communication time for transmission to an external server also becomes longer.

As described above, the recording time is preferably in the range of 4 to 16 seconds from the balance between analysis accuracy and work time.

In the above-described embodiment, the case where the diagnostic device 10 is a tablet terminal device has been described. However, the present invention is not limited to this, and the present invention is applicable even when another device is used as the diagnostic device. Can be applied. For example, when the operation panel of the image forming apparatus 200 is detachable from the main body, and is configured to be communicable with the server device 50 and incorporating a sound signal acquisition function, the operation panel is used as a diagnostic device. You may make it.

Moreover, although the said embodiment demonstrated using the case where the diagnostic apparatus 10 incorporated the microphone 17, if the diagnostic apparatus 10 is provided with the sound recording function, sound collection apparatuses, such as a microphone, will be outside. The sound signal acquisition unit may be realized by connecting to the.

Furthermore, in the above-described embodiment, the case where the target device for abnormal noise analysis is an image forming device has been described. However, the target device for abnormal noise analysis is not limited to the image forming device, and the period The present invention can be similarly applied to other devices as long as they are devices that can generate abnormal noise with the same characteristics.

According to the diagnostic system 1 according to the first embodiment described above, the second warning is that the first warning unit 38 warns that recording has started, and that acquisition of diagnostic data has started. Since warning is given by the warning unit 39, attention can be given to the operator and surrounding people, and conversations and the like are inadvertently recorded, and conversations and the like are inadvertently acquired as diagnostic data. It can be made difficult to cause leakage of confidential information.

In addition, according to the diagnostic system 1 according to the first embodiment described above, there is a case where the deletion is not performed immediately, and the confidential information is recorded more than the recording that is deleted after a predetermined time has elapsed. When the acquisition of diagnostic data that is likely to cause a leak is started, a second warning can be given separately from the first warning when recording is started.

Next, a diagnosis system 1 according to the second embodiment of the present invention will be described. In the first embodiment described above, when the recording start button 91 is operated, the diagnostic data acquisition unit 31 acquires recordings for a predetermined time before and after the recording start button 91 is operated as diagnostic data. In contrast, in the diagnostic system 1 according to the second embodiment, when the recording start button 91 is operated, the diagnostic data acquisition unit 31 records the recording for a predetermined time after the operation is performed. Get as.

In the diagnostic system 1 according to the first embodiment described above, the first warning unit 38 warns that recording with the microphone 17 has started. In contrast, in the diagnostic system 1 according to the second embodiment, the first warning unit 38 warns that recording with the microphone 17 is possible. In the following description, differences between the diagnostic system 1 according to the second embodiment and the diagnostic system 1 according to the first embodiment will be described, and the first of the diagnostic system 1 according to the second embodiment will be described. Description of the same part as the diagnostic system 1 according to the embodiment is omitted.

FIG. 18 is a flowchart showing the operation of the diagnostic apparatus 10 according to the second embodiment. As shown in FIG. 18, in step S150, the control unit 33 starts the recording mode in accordance with, for example, the operation of the operator, and puts the diagnostic apparatus 10 into a recordable state. More specifically, the display unit 35 is controlled so as to display the recording screen shown in FIG. In a state where the recording screen is displayed, recording can be performed at any time by the operator operating the recording start button 91. Here, the recording start button 91 is used as a reception unit that receives an operation for starting recording by the microphone 17 serving as a recording unit.

In the next step S152, the control unit 33 controls the first warning unit 38 to notify the first warning unit 38 that the recording mode has been established, that is, recording with the microphone 17 is possible. Alert. More specifically, the control unit 33 controls the first warning unit 38 to cause the display device 16 to display a warning, cause the speaker 18 to emit a warning sound, or cause the vibration generating element 19 to perform a diagnostic device. 10 is vibrated.

When confirming that the recording start operation has been performed in the next step S154, that is, confirming that the recording start button 91 has been operated by the operator, the control unit 33 controls the second warning unit 39 in step S156. Then, the second warning unit 39 is warned that the acquisition of diagnostic data by the diagnostic data acquisition unit 31 is started. More specifically, the control unit 33 controls the second warning unit 39 to cause the display device 16 to display a warning, cause the speaker 18 to emit a warning sound, or cause the vibration generating element 19 to perform a diagnostic device. 10 is vibrated.

The operation of starting recording in step S154 is performed by a serviceman who is going to perform a diagnosis, for example, by pressing the recording end button 92 at the timing when an abnormal sound is generated while listening to sound through the microphone 17. Further, the second warning in step S158 is different from the first warning in step S152, and can be distinguished from the first warning.

In the next step S158, the control unit 33 terminates the first warning started in step S152. The first warning is stopped at the timing when it is determined in step S154 that the recording start operation has been accepted, that is, simultaneously with the start of the second warning in step S156.

In the next step S160, the control unit 33 records and records. That is, the control unit 33 records the sound from the microphone 17 in the memory 12 or the like. The start of recording in step S160 is the timing when it is determined that the operation to start recording is accepted in step S154, that is, the second warning is started in step S156 and the first warning is stopped in step S158. At the same time.

In the next step S162, the control unit 33 determines whether or not a predetermined time T2 has elapsed since the reception of the recording start signal. If it is determined that the predetermined time T2 has elapsed, Proceeding to S164, recording ends.

In the next step S166, the control unit 33 terminates the second warning started in step S156.

In the next step S168, the control unit 33 causes the diagnostic data acquisition unit 31 to acquire diagnostic data. That is, as shown in FIG. 20, the control unit 33 causes the diagnostic data acquisition unit 31 to acquire the recording at time T <b> 2 after receiving the recording start operation as diagnostic data. Since the service person hears the abnormal sound from the microphone 17 and immediately presses the recording start button 91, periodic abnormal noise is acquired as diagnostic data by appropriately setting the time T2.

FIG. 20 shows the timing at which the first warning unit 38 gives the first warning together with the timing at which the diagnostic data acquisition unit 31 acquires the diagnostic data at time T2, and the second warning unit 39 The timing for warning 2 is shown.

According to the diagnostic system 1 according to the second embodiment described above, the first warning unit 38 warns that recording is possible and the diagnostic data is being acquired. 2 warning unit 39 can alert the operator and the surrounding people, and inadvertently recorded conversations, etc., and inadvertently acquired conversations as diagnostic data. It is possible to make it difficult to cause leakage of confidential information.

Although the present invention has been described in detail and with reference to specific embodiments, it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the invention.
This application is based on a Japanese patent application filed on Dec. 28, 2015 (Japanese Patent Application No. 2015-256175), the contents of which are incorporated herein by reference.

DESCRIPTION OF SYMBOLS 1 ... Diagnostic system 10 ... Diagnostic apparatus 13 ... Memory | storage device 15 ... Input device 17 ... Microphone 31 ... Diagnosis data acquisition part 33 ... Control part 34 ... Sound data Storage unit 38 ... first warning unit 39 ... second warning unit 50 ... server device 52 ... control unit 53 ... waveform data storage unit 91 ... recording start button 92 ...・ Recording end button 200 ... Image forming apparatus

Claims

A recording unit that records the sound emitted by the diagnostic object;
A reception unit that receives operations from the user;
When the accepting unit accepts an operation, an obtaining unit that obtains recording data for a predetermined time before and after the accepted time as diagnostic data;
Before accepting the operation by the reception unit, a warning unit that warns that the recording unit has started recording;
A diagnostic device.
A recording unit that records the sound emitted by the diagnostic object;
A reception unit that receives operations from the user;
When the accepting unit accepts an operation, an obtaining unit that obtains recording data for a predetermined time before and after the accepted time as diagnostic data;
A first warning section that warns that the recording section has started recording;
A second warning unit that warns that the recording unit has started recording sound used as diagnostic data;
A diagnostic device.
A recording unit that records the sound emitted by the diagnostic object;
A reception unit that receives operations from the user;
When the reception unit receives an operation, an acquisition unit that acquires recording data of a predetermined time after reception as diagnostic data;
A first warning section that warns that recording by the recording section is possible;
A second warning unit that warns that the acquisition unit has started recording sound used as diagnostic data;
A diagnostic device.
The diagnostic device according to any one of claims 1 to 3, wherein the second warning unit issues a warning by means different from the first warning unit.
The diagnostic device according to any one of claims 1 to 4, wherein the first warning unit and the second warning unit give a warning by display on a display unit or vibration of a vibration unit.
A recording unit that records the sound emitted by the diagnostic object;
A reception unit that receives operations from the user;
When the accepting unit accepts an operation, an obtaining unit that obtains recording data for a predetermined time before and after the accepted time as diagnostic data;
Before accepting the operation by the reception unit, a warning unit that warns that the recording unit has started recording;
An estimation unit that estimates the cause of sound generation based on the diagnostic data acquired by the acquisition unit;
A diagnostic system.
A recording unit that records the sound emitted by the diagnostic object;
A reception unit that receives operations from the user;
When the accepting unit accepts an operation, an obtaining unit that obtains recording data for a predetermined time before and after the accepted time as diagnostic data;
A first warning section that warns that the recording section has started recording;
A second warning unit that warns that the recording unit has started recording sound used as diagnostic data;
An estimation unit that estimates the cause of sound generation based on the diagnostic data acquired by the acquisition unit;
A diagnostic system.
A recording unit that records the sound emitted by the diagnostic object;
A reception unit that receives operations from the user;
When the reception unit receives an operation, an acquisition unit that acquires recording data of a predetermined time after reception as diagnostic data;
A first warning section that warns that recording by the recording section is possible;
A second warning unit that warns that the acquisition unit has started recording sound used as diagnostic data;
An estimation unit that estimates the cause of sound generation based on the diagnostic data acquired by the acquisition unit;
A diagnostic system.
Recording the sound produced by the diagnostic object;
A step of accepting an operation from a user;
When receiving an operation in the receiving step, acquiring recorded data of a predetermined time before and after the time of reception as diagnostic data;
Warning the start of recording in the recording step before accepting the operation in the accepting step;
A program that causes a computer to execute.
Recording the sound produced by the diagnostic object;
A step of accepting an operation from a user;
When receiving an operation in the receiving step, acquiring recorded data of a predetermined time before and after the time of reception as diagnostic data;
Warning the start of recording in the recording step;
Warning that the recording of sound used as diagnostic data in the recording step has started;
A program that causes a computer to execute.
Recording the sound produced by the diagnostic object;
A step of accepting an operation from a user;
When receiving an operation in the receiving step, obtaining recorded data for a predetermined time after the reception as diagnostic data;
Warning that recording is possible in the recording step;
Warning that the recording of sound used as diagnostic data in the obtaining step has started;
A program that causes a computer to execute.