WO2019069592A1

WO2019069592A1 - Operation sound comparison device

Info

Publication number: WO2019069592A1
Application number: PCT/JP2018/032021
Authority: WO
Inventors: 弘暁川口; 裕樹丸谷; 幸雄町田; 慶彦氏田; 翼鷲崎; 健吾松永
Original assignee: 東芝ライフスタイル株式会社
Priority date: 2017-10-03
Filing date: 2018-08-29
Publication date: 2019-04-11
Also published as: CN111183340A; JP2019066378A

Abstract

This operation sound comparison device may comprise a storage unit and result acquisition unit. The storage unit may store sound-related data about the operation sound produced by each of a plurality of types of household appliances. The result acquisition unit may acquire comparison results of comparing operation sound data specified from operation sound produced during the operation of a type of household appliance from among the plurality of types of household appliances and sound-related data that has been stored.

Description

Operating sound comparison device

The technology disclosed herein relates to an operating sound comparison device.

There is known a home appliance provided with a voice recognition unit and a failure diagnosis unit. The voice recognition unit recognizes the operation sound of the home appliance. The failure diagnosis unit identifies a failure point of the home appliance based on the recognized operation sound.

In a home, there may be cases where there are multiple types of home appliances. For example, there are home appliances such as a refrigerator, a washing machine, a self-propelled cleaner, and an air conditioner. Conventionally, it has not been assumed that the operation sounds of a plurality of types of home appliances are targeted.

The present specification provides a technology capable of processing operation sound data related to operation sounds generated from a plurality of types of home appliances.

This specification discloses an operation sound comparison device. The operation sound comparison apparatus may include a storage unit and a result acquisition unit. The storage unit may store sound related data related to operation sounds generated from each of a plurality of types of home appliances. The result acquisition unit compares the operation sound data specified from the operation sound generated while the home electric device of any of a plurality of types of home appliances is operating with the stored sound-related data The comparison result may be obtained.

It is a figure showing typically the composition of the household appliance system concerning a 1st example. It is a block diagram which shows the structure of the operation | movement sound comparison server which concerns on 1st Example. It is a block diagram which shows the structure of the detection apparatus which concerns on 1st Example. It is a sequence diagram which shows the normality judgment processing performed with the household appliance system which concerns on 1st Example. It is a sequence diagram which shows the position detection process performed with the household appliance system which concerns on 1st Example. It is a sequence diagram which shows the normality judgment processing performed with the household appliance system which concerns on 2nd Example. It is a figure which shows typically the structure of the household appliance system which concerns on 3rd Example. It is a block diagram which shows the structure of the operation | movement sound comparison apparatus which concerns on 3rd Example. It is a sequence diagram which shows the normality judgment processing performed with the household appliance system which concerns on 3rd Example.

[First embodiment]
An operation sound comparison server 10 according to an embodiment will be described with reference to the drawings. The operation sound comparison server 10 is disposed in the home appliance system 1. As shown in FIG. 1, the home appliance system 1 according to the first embodiment is disposed, for example, in a house 200 having a plurality of rooms. The home appliance system 1 includes, in addition to the operation sound comparison server 10, a plurality of detection devices 80 (80a, 80b) and a plurality of types of home appliances 50 (50a, 50b, 50c, 50d, 50e).

(Configuration of operation sound comparison server 10)
The operation sound comparison server 10 is connected to the Internet 100. The operation sound comparison server 10 is communicably connected to an external data server 30, a plurality of

detection devices

80a and 80b, and the like via the Internet 100. In addition, the operation sound comparison server 10 is communicably connected to the portable terminal 98 via the Internet 100. Furthermore, the operation sound comparison server 10 is communicably connected to detection devices installed in a plurality of houses other than the house 200. The operation sound comparison server 10 is installed by, for example, a manufacturer of the home appliance 50. As shown in FIG. 2, the operation sound comparison server 10 includes a control unit 20, a storage unit 12, and a communication module 14.

The storage unit 12 includes a hard disk drive and the like, and has a large-capacity storage area. The storage unit 12 stores a sound related database 16. The sound related database 16 is an operation in which model information indicating the type of the home electric appliance includes one or more normal operation sound data and one or more abnormal operation sound data for each of a large number of types of home electric appliances. It is recorded in association with sound data. Furthermore, each operation sound data is recorded in association with state information indicating an operation state of a home appliance that generates an operation sound related to the operation sound data.

The normal operation sound data relates to the operation sound generated from the home appliance in the normal operation state. Specifically, the normal operation sound data includes the feature amount of the operation sound generated in the state of normal operation. The operation information recorded in association with the normal operation sound data indicates that the home appliance is operating normally. The abnormal operation sound data relates to the operation sound generated from the home appliance in a state of not operating normally. Specifically, the abnormal operation sound data includes the feature amount of the operation sound generated in the state of not operating normally. The operation information recorded in association with the abnormal operation sound data indicates that the household electrical appliance is generating an operation sound related to the abnormal operation sound data. Note that the feature amount of the operation sound is specified for an actual speech, for example, using a speech recognition technology such as speech recognition using a statistical method, a hidden Markov model, or deep learning.

For example, when the home appliance is a washing machine, model information indicating the washing machine is normal operation sound data, for example, an operation sound generated when the washing machine is performing washing, rinsing, dewatering, and drying, respectively. It is associated with normal operation sound data related to each operation sound and the like generated when the water in the bathtub is pumped up and sent to the washing tank. In addition, model information indicating a washing machine is abnormal operation sound data, for example, an operation sound generated in a state where foreign matter is mixed in the washing tank when each of washing, rinsing, dewatering, and drying is performed. It is associated with abnormal operation sound data associated with each of operation sounds and the like that are generated when a pump that sucks up water in a bathtub is not properly sucking up water. Furthermore, while each of the normal operation sound data is associated with state information indicating that it is operating normally, each of the abnormal operation sound data is associated with state information indicating the state of the washing machine. There is. For example, if the operation sound related to abnormal operation sound data is generated in a state where the pump that pumps up water in the bathtub is not properly pumping water, status information indicating that the pump is not pumping water is associated There is.

The storage unit 12 can further store the address of an electronic mail set in an external terminal such as the portable terminal 98 or the like. The user transmits the address of the electronic mail and the identification information (for example, the serial number or the IP address) of the detection device 80 that the user has to the operation sound comparison server 10 via the Internet 100 using the external terminal. Can. When receiving the e-mail and the identification information, the control unit 20 combines the e-mail and the identification information and stores the combination in the storage unit 12.

The communication module 14 includes a communication interface for connecting the operation sound comparison server 10 and the Internet 100, for example, a LAN (abbreviation of Local Area Network) interface.

The control unit 20 includes a CPU and memories such as a RAM and a ROM. The control unit 20 implements the result acquisition unit 22, the storage unit 24, and the communication unit 26 by the CPU and the memory. The result acquisition unit 22 acquires operation sound data acquired from the detection device 80, and executes normality determination processing described later. The storage unit 24 stores a computer program for processing performed by the result acquisition unit 22. In addition, the storage unit 24 temporarily stores operation sound data acquired from the detection device 80 and data acquired from the result acquisition unit 22 and the communication unit 26. The communication unit 26 communicates with an external device via the communication module 14.

(Configuration of detection device 80)
As shown in FIG. 1, the detection devices 80 (80a, 80b) are respectively disposed in, for example, a kitchen, a dining room, a bedroom, a children's room, etc. in the house 200. Each of the

detection devices

80 a and 80 b is communicably connected to the external operation sound comparison server 10 via the wireless router 32, the modem 34 and the Internet 100. Each of the

detection devices

80 a and 80 b can communicate with the operation sound comparison server 10 or the like via the Internet 100. The wireless router 32 has an access point function.

As shown in FIG. 3, the detection device 80 includes a microphone 82, a speaker 83, a wireless communication module 84, and a control unit 90. The microphone 82 acquires the sound around the detection device 80 and converts it into an electrical signal. The microphone 82 can acquire, for example, sounds within a radius of 5 m from the detection device 80. The sound acquired by the microphone 82 is transmitted to the control unit 90.

The speaker 83 emits sound toward the periphery of the detection device 80. The speaker 83 reports information to the user of the home appliance system 1 by voice. For example, the speaker 83 gives a voice notification to the user around the detection device 80 regarding the information related to the home appliance 50. The user who is around the detection device 80 can recognize the information notified by the sound emitted by the speaker 83.

The wireless communication module 84 is provided to wirelessly communicate with the wireless router 32. Information is transmitted and received through the wireless communication module 84. The wireless communication module 84 can execute wireless communication in accordance with, for example, the Wi-Fi and Bluetooth (registered trademark) standards.

The control unit 90 includes a CPU and memories such as a RAM and a ROM. The control unit 90 executes the voice reception unit 91, the voice output unit 92, the storage unit 93, and the communication unit 94 by the CPU and the memory. The voice receiving unit 91 obtains an electrical signal of the sound acquired by the microphone 82 from the microphone 82. The audio output unit 92 outputs an electrical signal of sound to be emitted toward the periphery of the detection device 80 to the speaker 83. The communication unit 94 transmits and receives information via the wireless communication module 84. In addition, the storage unit 93 temporarily stores an electrical signal corresponding to the voice. Also, a program of processing executed by the control unit 90 is stored.

As shown in FIG. 1, the plurality of home appliances 50 in the home appliance system 1 are, for example, a refrigerator 50 a, a washing machine 50 b, a self-propelled cleaner 50 c, and

air conditioners

50 d and 50 e. Each home appliance 50 (50a, 50b, 50c, 50d, 50e) includes each control unit 60 (60a, 60b, 60c, 60d, 60e). The type of the home appliance 50 is not particularly limited, and may be, for example, a microwave oven, a rice cooker, a television, a Blu-ray disc player, a DVD player, a microwave oven, and the like. Generally, the home appliance 50 includes electricity and electronic devices used in the house 200, and the house 200 is generally used in the house 200 even when installed at a place other than the house 200 (for example, an office). The electrical and electronic devices to be used are included in the home appliance 50.

(Configuration of data server 30)
The data server 30 stores a sound related database similar to the sound related database 16 stored in the storage unit 12 of the operation sound comparison server 10. However, the sound related database of the data server 30 includes operation sound data of a home appliance (for example, a home appliance different in manufacturing company) different from the sound related database 16. The data server 30 is installed, for example, by a manufacturer of home appliances different from the operation sound comparison server 10. The data server 30 has the same configuration as the operation sound comparison server 10. In the present embodiment, in order to distinguish it from the operation sound comparison server 10, the data server 30 is called with a different name from the operation sound comparison server 10. The operation sound comparison server 10 may be communicably connected to a plurality of data servers 30.

(Normal judgment processing)
Next, with reference to FIG. 4, the normality determination process performed by the home appliance system 1 will be described. The normality determination process is started when the operation sound comparison server 10 receives a determination start request. For example, when the control unit 90 of the detection device 80 recognizes a predetermined keyword such as "Is there an abnormality?" Uttered by the user of the detection device 80, the control unit 90 generates an operation sound comparison server Send to 10 Alternatively, when the detection device 80 detects an operation sound of any home appliance 50, a determination start request may be sent to the operation sound comparison server 10. Alternatively, the user may transmit a determination start request to the operation sound comparison server 10 using the portable terminal 98. The normality determination process may be performed periodically.

When the normality determination process is executed, the result acquisition unit 22 of the operation sound comparison server 10 transmits an operation sound acquisition request to the detection device 80 in S102.

When the operation sound acquisition request is received, the control unit 90 of each of the

detection devices

80a and 80b causes the microphone 82 to detect the operation sound and converts the detected operation sound into an electrical signal in S802. Next, in S804, the control unit 90 transmits the converted electric signal and the identification information of the detection device 80 of the transmission source to the operation sound comparison server 10.

When the electric signal is received from the detection device 80, the result acquisition unit 22 of the operation sound comparison server 10 generates operation sound data by using the electric signal in S104. Thereby, the operation sound comparison server 10 can acquire the operation sound data of the home appliance 50 which does not exist nearby by using the microphone 82 of the detection device 80. The operation sound data includes the feature amount of the operation sound represented by the electrical signal. The method of generating the operation sound data is the same as the method of generating the normal operation sound data and the abnormal operation sound data described above.

Next, in S106, the result acquisition unit 22 compares the operation sound data generated in S104 with the normal operation sound data and the abnormal operation sound data recorded in the sound related database 16 already stored in the storage unit 12. Execute the process In the comparison process, the result acquiring unit 22 determines whether the feature amount of the generated operation sound data matches any one of the feature amounts of the normal operation sound data and the abnormal operation sound data. The result acquisition unit 22 specifies normal operation sound data or abnormal operation sound data of the feature amount that matches the feature amount of the generated operation sound data as a result of the comparison processing.

When normal operation sound data or abnormal operation sound data that matches the generated operation sound data is specified (YES in S106), the result acquisition unit 22 determines the specified normal operation sound data or abnormal operation sound data in S108. And the model information and the state information stored in the sound related database 16 in association with each other, and the process proceeds to S110. On the other hand, when normal operation sound data and abnormal operation sound data that match the generated operation sound data are not identified (NO in S106), the result acquisition unit 22 externally outputs a database request for requesting a sound related database in S107. To the data server 30 of FIG.

When the database request is received, the control unit of the data server 30 transmits the sound related database stored in the storage unit of the data server 30 to the operation sound comparison server 10 in S302.

When the sound related database is received from the data server 30, the result acquisition unit 22 of the operation sound comparison server 10 executes the processing of S106 and S108 using the received sound related database. Next, in S110, the model information and status information identified in S108 are transmitted to the detection device 80 identified by the identification information received in S804. According to this configuration, when the operation sound data can not be identified using the sound related database 16 of the operation sound comparison server 10, the sound related database of the data server 30 installed outside the operation sound comparison server 10 Model information and status information can be identified. For this reason, the data size of the sound related database stored in each

server

10, 30 can be suppressed.

When the model information and the state information are received, at S806, the control unit 90 of the detection device 80 notifies the model indicated by the model information and the state of the home appliance 50 indicated by the state information. Specifically, the control unit 90 generates an electrical signal of sound representing the model and the state of the home appliance 50, and supplies the electrical signal to the speaker 83. The speaker 83 outputs the sound represented by the electrical signal. According to this configuration, even if the user is away from the household electrical appliance 50 in which the abnormality has occurred, whether the household electrical appliance 50 is operating normally or an abnormality occurs by confirming the notification of the detection device 80 You can know if you

Subsequent to the process of S110, the result acquisition unit 22 of the operation sound comparison server 10 determines whether or not the identification information received from the detection device 80 in S804 is stored in combination with the e-mail in S112. If the identification information and the e-mail are stored in combination (YES in S112), the result acquisition unit 22 sets the e-mail as a transmission destination in S114, and the e-mail in which the model information and the state information are described Are transmitted to the external terminal (in the present embodiment, the portable terminal 98). According to this configuration, even if the user is not out of the vicinity of the detection device 80, for example, even if he is out, the home electric device 50 is operating normally or an abnormality occurs using the portable terminal 98. You can know what you are doing.

When electrical signals corresponding to a plurality of operation sounds are received from the detection device 80, the result acquisition unit 22 of the operation sound comparison server 10 performs S104 to S114 for each of the electrical signals corresponding to the plurality of operation sounds. Execute the process of

(Position detection process)
Next, with reference to FIG. 5, a position detection process performed by the home appliance system 1 will be described. The position detection process is a process for detecting the current position of a self-propelled home electric appliance such as a self-propelled cleaner 50 c. The position detection process is started when the operation sound comparison server 10 receives a detection start request. For example, when the control unit 90 of the detection device 80 recognizes a predetermined keyword such as "Where are you cleaning", which is pronounced by the user of the detection device 80, the detection start request generates an operation sound It transmits to the comparison server 10. The position detection process may be performed periodically.

When the position detection process is executed, the result acquisition unit 22 of the operation sound comparison server 10 transmits an operation sound acquisition request to each of the

detection devices

80a and 80b in S120.

detection devices

80a and 80b causes the microphone 82 to detect the operation sound in S820, and generates an electrical signal from the detected operation sound. Next, in S822, the control unit 90 transmits the generated electric signal and the identification information of the detection device 80 of the transmission source to the operation sound comparison server 10. The control unit 90 transmits the electrical signal of the sound detected by the microphone 82 to the operation sound comparison server 10 even if the operation sound of the home appliance 50 is not detected.

When the electric signal is received from the detection device 80, the result acquisition unit 22 of the operation sound comparison server 10 generates operation sound data by using the electric signal in S122, as in S104. Next, in S124, the result acquiring unit 22 specifies, in the sound related database 16, normal operation sound data and abnormal operation sound data associated with model information indicating the self-propelled cleaner 50c. Next, in S126, the result acquisition unit 22 compares the feature amount of the operation sound data generated in S122 with the feature amount of the operation sound data specified in S124. Then, the result acquisition unit 22 identifies the detection device 80 received in combination with the electrical signal that is the source of the operation sound data including the feature amount that matches the feature amount of any of the operation sound data specified in S124. Identify the information. Next, in S128, the result acquisition unit 22 specifies the position of the detection device 80 identified by the identified identification information. For example, the control unit 20 may store in advance a database in which the combination of the identification information and the installation position of the detection device 80 is registered. In this case, the result acquisition unit 22 may specify the installation position combined with the identified identification information using a database. Alternatively, in S822, the detection device 80 may transmit the installation position of itself to the operation sound comparison server 10.

Next, in S130, the result acquisition unit 22 transmits position information indicating a specified position to the

detection devices

80a and 80b. When receiving the position information, each of the

detection devices

80a and 80b announces the position indicated by the position information in S824. According to this configuration, the user can know the position of the self-propelled cleaner 50 c without moving and searching the house 200.

Second Embodiment
Points different from the first embodiment will be described. In the present embodiment, the detection device 80 and the home appliance 50 are communicably connected to each other. Specifically, the detection device 80 and the home appliance 50 are directly connected without an external device in accordance with, for example, the Bluetooth (registered trademark) standard.

The detection device 80 can remotely control the home appliance 50 via a wireless network. Specifically, the control unit 90 of the detection device 80 transmits control information indicating the control content of the home appliance 50 (for example, the washing machine 50b) via the wireless network. When receiving the control information, the control unit 60 of the home appliance 50 controls the home appliance 50 in accordance with the control information. The control information includes, for example, information for stopping the self-propelled cleaner 50c. Control information corresponding to the home appliance 50 is stored in the control unit 90 of the detection device 80. In addition, the home appliance 50 may acquire control information from an external device (for example, the operation sound comparison server 10) via the wireless router 32 and the Internet 100.

When the operation sound data is abnormal operation sound data, the sound related database 16 stores control information in association with model information, abnormal operation sound data, and state information. Control information is information for stopping or reducing a state which is not operating normally. For example, when the pump of the washing machine 50b is not pumped, the control information for stopping the pump of the washing machine 50b is associated.

(Normal judgment processing)
The normality determination process executed by the home appliance system 1 will be described with reference to FIG. The start condition of the normality determination process is the same as that of the first embodiment. When the normality determination process is started, the result acquisition unit 22 of the operation sound comparison server 10 executes the process of S102. Next, the control unit 90 of the detection apparatus 80 executes the processing of S802 and S804, the result acquisition unit 22 of the operation sound comparison server 10 executes the processing of S104 to S114, and the data server 30 requests information in S107. Is sent, the processing of S302 is executed. When abnormal operation sound data is specified in the comparison process of S106, the result acquisition unit 22 adds the type information and the status information in S108, and associates the specified abnormal operation sound data with the sound related database 16 Identify the control information stored in. In S110, when the control information is specified in S104, the control unit 20 further transmits the specified control information to the detection device 80.

The control unit 90 of the detection device 80 executes the process of S806. Further, when the specified control information is received from the operation sound comparison server 10, the control unit 90 transmits the control information to the home appliance 50 in S808. Thereby, when the home appliance 50 receives the control information, the control unit 60 can execute control (for example, stop the operation) to stop or reduce the abnormality of the home appliance 50. Thereby, the abnormality can be eliminated early.

In the modification, the operation sound comparison server 10 may be communicably connected to the home appliance 50 without the detection device 80. In this case, the operation sound comparison server 10 may transmit the control information identified in S108 to the home appliance 50 without passing through the detection device 80.

Third Embodiment
Points different from the first embodiment will be described. As shown in FIG. 7, in the present embodiment, the household electrical appliance system 1 is replaced with an operation sound comparison server 10 instead of the detection device 80 a of the plurality of

detection devices

80 a, 80 b of the first embodiment. A comparison device 300 is provided.

(Configuration of Operating Sound Comparison Device 300)
The operation sound comparison device 300 is connected to the Internet 100. The operation sound comparison apparatus 300 is connected to an external data server 30 via the Internet 100. In addition, the operation sound comparison apparatus 300 is connected to the portable terminal 98 via the Internet 100. As shown in FIG. 8, the control unit 320, the storage unit 312, the wireless communication module 384, the microphone 382, and the speaker 383 are provided.

The storage unit 312 has the same configuration as the storage unit 12 and stores a sound related database 316 similar to the sound related database 16. In addition, the storage unit 312 can store a combination of electronic mail and identification information of a portable terminal by the user.

The wireless communication module 384 has the same configuration as the wireless communication module 84. The operation sound comparison apparatus 300 is communicably connected to the wireless router 32 via the wireless communication module 384.

Each of the microphone 382 and the speaker 383 has the same configuration as that of the microphone 82 and the speaker 83, respectively.

Control unit 320 has a configuration similar to that of the combination of control unit 20 and control unit 90. That is, the control unit 320 includes a result acquisition unit 322 similar to the result acquisition unit 22, a storage unit 324 similar to the

storage units

24 and 93, an audio reception unit 391 similar to the audio reception unit 91, and an audio output unit 92. And a communication unit 394 similar to the communication unit 94.

The operation sound comparison device 300 is communicably connected to the home appliance 50 and the detection device 80b of the child device via the communication unit 394 and the wireless communication module 384.

(Normal judgment processing)
Next, with reference to FIG. 9, the normality determination process executed by the home appliance system 1 will be described. The control unit 60 of the home appliance 50 monitors that the operation of the home appliance 50 is started by the user. In S502, when the operation of the home appliance 50 is started, operation information indicating that the home appliance 50 is operating is transmitted to the operation sound comparison apparatus 300.

In S3002, when the operation information is received, the result acquisition unit 322 of the operation sound comparison apparatus 300 causes the microphone 382 to acquire the operation sound of the home appliance 50. Next, in S3004, the result acquisition unit 322 generates operation sound data using the electrical signal that has been converted from the operation sound by the microphone 382. The method of generating the operation sound data is the same as the process of S104. Next, in S3006, the result acquisition unit 322 executes the same comparison processing as in S106. When normal operation sound data and abnormal operation sound data that match the generated operation sound data are specified (YES in S3006), in S3008, the result acquisition unit 322 performs the normal operation specified in S3006 as in S108. The model information and the state information stored in the sound related database 316 in association with the sound data or the abnormal operation sound data are specified, and the process proceeds to S3010. On the other hand, when normal operation sound data and abnormal operation sound data that match the generated operation sound data are not identified (NO in S3006), in S3007, the result acquisition unit 322 externally outputs a database request for requesting a sound related database. To the data server 30 of FIG. As a result, when the database request is received, the control unit of the data server 30 executes the process of S301, and transmits the sound related database to the operation sound comparison apparatus 300.

When the sound related database is received from the data server 30, the result acquisition unit 322 of the operation sound comparison apparatus 300 executes the processing of S3006 and S3008, and proceeds to S3010. In S3010, the control unit 320 notifies of the model indicated by the model information and the state of the home appliance 50 indicated by the state information. Specifically, the control unit 320 generates an electrical signal of sound representing the model and the state of the home appliance 50, and supplies the electrical signal to the speaker 383. The speaker 383 outputs a sound represented by the electrical signal.

Next, in S3012, S3014, the control unit 320 executes the same processing as S112, S114.

According to this configuration, the operation sound comparison apparatus 300 can determine whether the home electric device 50 is operating normally without communicating with an external operation sound comparison server.

While certain embodiments of the present invention have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the invention. These embodiments can be implemented in other various forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention.

(1) In the first and second embodiments described above, the home appliance system 1 is provided with a plurality of detection devices 80. However, the number of detection devices 80 is not limited. For example, the home appliance system 1 may include one detection device 80.

(2) In each of the above-described embodiments, the sound related database 16 includes normal operation sound data and abnormal operation sound data. However, the sound related database 16 may include either normal operation sound data or abnormal operation sound data. For example, in the first embodiment, when the sound related database 16 includes normal operation sound data, but does not include abnormal operation sound data, the result acquisition unit 22 performs the operation already generated in S104 in S106 of FIG. 4. When the sound data matches the normal operation sound data of the sound related database 16, it is determined that the home appliance 50 is operating normally, and when it does not match, it is determined that the home appliance 50 is not operating normally. You may If it is determined that the home appliance 50 is operating normally, the result acquisition unit 22 may transmit, to the detection device 80, operation information indicating that the home appliance 50 is operating normally in S110. On the other hand, if it is determined that the device is operating abnormally, the result acquiring unit 22 may transmit to the detection device 80 operation information indicating that any home appliance 50 is not operating normally in S110. Good.

(3) In the first and second embodiments described above, the operation sound comparison server 10 transmits the specified model information and state information to the detection device 80. However, the operation sound comparison server 10 may not transmit the identified model information and state information to the detection device 80. In this case, the operation sound comparison server 10 may cumulatively store the identified model information and state information. According to this configuration, the administrator of the operation sound comparison server 10 generates an abnormality for each type of the home electric appliance 50 by checking the model information and the state information stored in the operation sound comparison server 10 cumulatively. I can understand the situation. The same applies to the operation sound comparison apparatus 300 of the third embodiment.

(4) In each of the above embodiments, the sound related

database

16, 316 stores model information, state information, etc. in association with the operation sound data. However, only the operation sound data may be recorded in the sound related

database

16, 316.

(5) In each of the above embodiments, the comparison process is executed using the sound related database already acquired from the data server 30, and when the matching operation sound data is not identified (S106, NO in S3006), the result acquisition The

units

22 and 322 may acquire sound related databases from other data servers and execute comparison processing. Even if the

result acquisition unit

22 or 322 acquires the sound related database from all the data servers that should acquire the sound related database, when the corresponding operation sound data is not found in the comparison process, the result may be informed. .

(6) In each of the above-described embodiments, model information is distinguished for each category of home appliances such as a washing machine, an air conditioner, and a refrigerator. However, model information may be distinguished into a plurality of types (for example, for each model) in home appliances (for example, washing machines) of the same classification.

(7) In each of the above embodiments, model information and status information are notified using the

speakers

83 and 383. However, the detection device 80 or the operation sound comparison device 300 may cause the display device to display the model information and the state information, and may transmit the information to an external device.

(8) The operation sound data may be data other than the feature amount, for example, data that can distinguish the operation sound such as the frequency of the operation sound, the sound range, and the like.

(9) In each of the above-described embodiments, when the corresponding operation sound data is not identified in the comparison process (S106, NO in S3006), the

result acquiring unit

22, 322 acquires the sound related database from the data server 30. However, when the coincident operation sound data is not identified (S106, NO in S3006), the

result acquiring unit

22, 322 may transmit the generated operation sound data to the data server 30. In this case, the control unit of the data server 30 executes the comparison process using the received operation sound data and the sound related database stored in the data server 30, and the comparison result is output to the operation sound comparison server 10, It may be transmitted to the operation sound comparison device 300.

(10) The

result acquisition unit

22, 322 may be mounted on any of the home appliances 50.

(11) The detection device 80 of the home appliance system 1 may be installed in an office, a store, or the like in addition to the house 200.

These embodiments and modifications thereof are included in the invention described in the claims and the equivalents thereof as well as included in the scope and the gist of the invention.

1: home appliance system 10: operation sound comparison server 12: storage unit 14: communication module 16: sound related database 20: control unit 22: result acquisition unit 24: storage unit 26: communication unit 30: data server 50: home appliance 60: Control unit 80: Detection device 82: Microphone 83: Speaker 84: Wireless communication module 90: Control unit 91: Voice reception unit 92: Voice output unit 93: Storage unit 94: Communication unit 98: Mobile terminal 100: Internet 200: House 300 : Operation sound comparison device 312: storage unit 316: sound related database 320: control unit 322: result acquisition unit 324: storage unit 382: microphone 383: speaker 384: wireless communication module 391: voice reception unit 392: voice output unit 394: Communication unit

Claims

A storage unit that stores sound related data related to operation sounds generated from each of a plurality of types of home appliances;
Comparison result of comparing the operation sound data specified from the operation sound generated while the home electric device of any of the plural types of the home electric devices is operating with the stored sound related data And a result acquisition unit for acquiring the operation sound comparison device.
The operation sound comparison device according to claim 1, wherein the result acquisition unit acquires the comparison result including information indicating a type of the home appliance that generates the operation sound related to the specified operation sound data.
The result acquisition unit acquires the comparison result including information indicating whether the home electric appliance that generates the operation sound related to the specified operation sound data is operating normally. The operation sound comparison device according to 2.
The operation sound comparison device is a microphone that converts the operation sound generated while the home electric device of any of the plurality of types of home electric devices is operating into an electric signal, It is communicably connected to the microphone disposed at a distance from the home appliance,
The operation according to any one of claims 1 to 3, wherein the result acquisition unit acquires the comparison result obtained by comparing the operation sound data obtained from the converted electrical signal with the stored sound related data. Sound comparison device.
The operation sound comparison device
It is disposed outside the house where the plurality of types of home electric appliances are installed,
It is communicably connected to the microphones installed in each of a plurality of houses.
The result acquiring unit acquires the comparison result obtained by comparing the operation sound data obtained from the converted electrical signal by each of the plurality of microphones with the stored sound related data. The operation | movement sound comparison apparatus of description.
The operation sound comparison apparatus according to any one of claims 1 to 5, wherein the result acquisition unit further acquires the sound related data from an external server.
The operation sound comparison device according to any one of claims 1 to 6, wherein the result acquisition unit further transmits the comparison result to an external device.
The result acquisition unit further includes
For each of the plurality of types of home appliances, operation information indicating that the home appliance is operating is acquired from other than the operation sound data,
The operation sound comparison apparatus according to any one of claims 1 to 7, wherein it is detected that the plurality of types of home electric appliances are operating using the acquired operation information.