CN111183340A - Action sound comparing device - Google Patents
Action sound comparing device Download PDFInfo
- Publication number
- CN111183340A CN111183340A CN201880062911.3A CN201880062911A CN111183340A CN 111183340 A CN111183340 A CN 111183340A CN 201880062911 A CN201880062911 A CN 201880062911A CN 111183340 A CN111183340 A CN 111183340A
- Authority
- CN
- China
- Prior art keywords
- sound
- operating
- data
- comparing
- home appliance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H3/00—Measuring characteristics of vibrations by using a detector in a fluid
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M99/00—Subject matter not provided for in other groups of this subclass
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Selective Calling Equipment (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
- Testing Of Devices, Machine Parts, Or Other Structures Thereof (AREA)
- Telephonic Communication Services (AREA)
Abstract
The operating sound comparing device may include a storage unit and a result acquiring unit. The storage unit may store sound-related data associated with operation sounds generated from each of a plurality of types of home appliances. The result acquiring unit may acquire a comparison result obtained by comparing operating sound data determined based on an operating sound generated during operation of any one of the plurality of types of home appliances with stored sound-related data.
Description
Technical Field
The technology disclosed in the present specification relates to an operating sound comparison device.
Background
A home appliance including a voice recognition unit and a failure diagnosis unit is known. The voice recognition unit recognizes an operation voice of the home appliance. The failure diagnosis unit specifies a failure location of the home appliance based on the recognized operation sound.
Disclosure of Invention
Problems to be solved by the invention
In a home, there are sometimes a plurality of kinds of home appliances. For example, there are household appliances such as refrigerators, washing machines, autonomous traveling cleaners, and air conditioners. Conventionally, it has not been assumed that operation sounds of a plurality of types of home appliances are targeted.
In the present specification, a technique is provided that can process operation sound data associated with operation sounds generated from a plurality of types of home appliances.
Means for solving the problems
The present specification discloses an operating sound comparing apparatus. The operating sound comparing device may include a storage unit and a result acquiring unit. The storage unit may store sound-related data associated with operation sounds generated from each of a plurality of types of home appliances. The result acquiring unit may acquire a comparison result obtained by comparing operation sound data determined based on an operation sound generated while any one of the plurality of types of home appliances is operating with stored sound-related data.
Drawings
Fig. 1 is a diagram schematically showing a configuration of a home appliance system according to a first embodiment.
Fig. 2 is a block diagram showing the configuration of the operating sound comparison server according to the first embodiment.
Fig. 3 is a block diagram showing the configuration of the sensing device of the first embodiment.
Fig. 4 is a sequence diagram showing a normal determination process executed in the home appliance system of the first embodiment.
Fig. 5 is a sequence diagram showing the position detection process executed in the home appliance system according to the first embodiment.
Fig. 6 is a sequence diagram showing a normal determination process executed in the home appliance system of the second embodiment.
Fig. 7 is a diagram schematically showing the configuration of a home appliance system according to a third embodiment.
Fig. 8 is a block diagram showing the configuration of the operating sound comparing apparatus according to the third embodiment.
Fig. 9 is a sequence diagram showing a normal determination process executed in the home appliance system of the third embodiment.
Detailed Description
[ first embodiment ]
The operation sound comparison server 10 according to the embodiment will be described with reference to the drawings. The operating sound comparison server 10 is disposed in the home appliance system 1. As shown in fig. 1, the home appliance system 1 according to the first embodiment is disposed in, for example, a house 200 having a plurality of rooms. The home appliance system 1 includes a plurality of sensing devices 80(80a, 80b) and a plurality of types of home appliances 50(50a, 50b, 50c, 50d, 50e) in addition to the operation sound comparison server 10.
(construction of action sound comparison Server 10)
The action sound comparison server 10 is connected to the internet 100. The operating sound comparison server 10 is connected to be communicable with an external data server 30, a plurality of sensing devices 80a and 80b, and the like via the internet 100. The operating sound comparison server 10 is connected to the mobile terminal 98 via the internet 100 so as to be able to communicate with the mobile terminal. Further, the operating sound comparison server 10 is also connected to be able to communicate with sensing devices provided in a plurality of houses other than the house 200. The operation sound comparison server 10 is provided by, for example, a manufacturing company of the home appliance 50. As shown in fig. 2, the operation sound comparison server 10 includes a control unit 20, a storage unit 12, and a communication module 14.
The storage unit 12 includes a hard disk drive and the like, and has a large-capacity storage area. The storage unit 12 stores a sound correlation database 16. In the sound correlation database 16, for each of a plurality of types of home appliances, model information indicating the type of the home appliance is recorded in association with operation sound data including one or more normal operation sound data and one or more abnormal operation sound data. The operation sound data is recorded in association with state information indicating an operation state of the home appliance that generates the operation sound associated with the operation sound data.
The normal operating sound data is associated with an operating sound generated from the home appliance in a state in which the home appliance is operating normally. Specifically, the normal operating sound data includes a feature amount of an operating sound generated in a state in which the operating sound is operating normally. The operation information recorded in association with the normal operation sound data indicates that the home appliance is operating normally. The abnormal operating sound data is associated with an operating sound generated from the home appliance in a state where the home appliance is not operating normally. Specifically, the abnormal operating sound data includes a feature amount of an operating sound generated in a state where the abnormal operating sound data is not operating normally. The operation information recorded in association with the abnormal operation sound data indicates a state in which the home appliance generates an operation sound associated with the abnormal operation sound data. The feature amount of the action sound is determined by using a sound recognition technique such as performing sound recognition by applying a statistical technique, a Hidden markov model (Hidden MarkovModel), or deep learning (deep learning) to an actual sound.
For example, when the home appliance is a washing machine, the model information indicating the washing machine is associated with normal operation sound data, for example, operation sounds generated when the washing machine performs washing, rinsing, spin-drying, and drying, operation sounds generated when water in a tub is pumped up by a pump and sent out to a washing tub, and the like. The model information indicating the washing machine is associated with abnormal operation sound data, which is associated with, for example, an operation sound generated when foreign matter is mixed into the washing tub when washing, rinsing, spin-drying, or an operation sound generated when the pump for pumping up the water in the tub fails to pump up the water properly. Further, the state information indicating the normal operation is associated with each normal operation sound data, and the state information indicating the state of the washing machine is associated with each abnormal operation sound data. For example, when an operation sound associated with abnormal operation sound data is generated in a state where a pump pumping up water in a bathtub is not drawing water properly, state information indicating that the pump is not drawing water is associated.
The storage unit 12 can also store an address of an electronic mail set by an external terminal such as the mobile terminal 98. The user can transmit the address of the e-mail and the identification information (for example, the manufacturing number and the IP address) of the sensing device 80 owned by the user to the operating sound comparison server 10 via the internet 100 using the external terminal. When receiving the e-mail and the identification information, the control unit 20 stores the e-mail and the identification information in the storage unit 12 in combination.
The communication module 14 includes a communication interface, for example, a LAN (Local Area Network) interface, for connecting the operating sound comparison server 10 to the internet 100.
The control section 20 includes a CPU and memories such as RAM and ROM. The control unit 20 realizes the result acquisition unit 22, the storage unit 24, and the communication unit 26 by a CPU and a memory. The result acquisition unit 22 acquires the operating sound data acquired from the sensing device 80, and executes a normal determination process described later. The storage unit 24 stores a computer program for processing executed by the result acquisition unit 22. The storage unit 24 temporarily stores the operating sound data acquired from the sensing device 80 and the data acquired from the result acquisition unit 22 and the communication unit 26. The communication unit 26 communicates with an external device via the communication module 14.
(constitution of sensing device 80)
As shown in fig. 1, the sensing devices 80(80a, 80b) are disposed in, for example, a kitchen, a restaurant, a bedroom, a child room, and the like in the house 200. The sensing devices 80a and 80b are connected to the external operating sound comparison server 10 via the wireless router 32, the modem 34, and the internet 100, respectively, so as to be able to communicate with each other. Each of the sensing devices 80a and 80b can communicate with the operating sound comparison server 10 and the like via the internet 100. In addition, the wireless router 32 has an access point function.
As shown in fig. 3, the sensing device 80 includes a microphone 82, a speaker 83, a wireless communication module 84, and a control unit 90. The microphone 82 takes sound around the sensing device 80 and converts the sound into an electrical signal. The microphone 82 can, for example, pick up sound within a range of radius 5m from the sensing device 80. The sound acquired by the microphone 82 is transmitted to the control unit 90.
The speaker 83 emits sound toward the periphery of the sensing device 80. The speaker 83 notifies the user of the home appliance system 1 of information by sound. For example, the speaker 83 informs the user in the vicinity of the sensing device 80 of information associated with the home appliance 50 by sound. A user in the vicinity of the sensing device 80 can recognize the information notified by the sound emitted from the speaker 83.
The wireless communication module 84 is provided for wireless communication with the wireless router 32. Information is transmitted and received through the wireless communication module 84. The wireless communication module 84 is capable of performing wireless communication conforming to specifications of Wi-Fi and Bluetooth (registered trademark), for example.
The control section 90 includes a CPU and memories such as RAM and ROM. The control unit 90 executes the audio receiving unit 91, the audio output unit 92, the storage unit 93, and the communication unit 94 by means of a CPU and a memory. The sound receiving unit 91 acquires an electric signal of the sound acquired by the microphone 82 from the microphone 82. The sound output section 92 outputs an electric signal for sound emitted toward the periphery of the sensing device 80 to the speaker 83. The communication unit 94 transmits and receives information via the wireless communication module 84. The storage unit 93 temporarily stores an electric signal corresponding to the sound. Further, a program of processing executed by the control unit 90 is stored.
As shown in fig. 1, the plurality of home appliances 50 of the home appliance system 1 are, for example, a refrigerator 50a, a washing machine 50b, an autonomous cleaner 50c, and air conditioners 50d and 50 e. Each of the home appliances 50(50a, 50b, 50c, 50d, 50e) includes a control unit 60(60a, 60b, 60c, 60d, 60 e). The type of the home appliance 50 is not particularly limited, and may be, for example, a microwave oven, a rice cooker, a television, a blu-ray player, a DVD player, an oven, or the like. In general, home electric device 50 includes electric and electronic devices used in house 200, and even when installed in a place other than house 200 (e.g., office), home electric device 50 includes any electric and electronic devices that are generally used in house 200.
(construction of the data Server 30)
The data server 30 stores a sound-related database similar to the sound-related database 16 stored in the storage unit 12 of the operating sound comparison server 10. However, the sound-related database of the data server 30 includes operation sound data of a home appliance (e.g., a home appliance different from the manufacturing company) different from the sound-related database 16. The data server 30 is provided by, for example, a home appliance manufacturing company different from the operating sound comparison server 10. The data server 30 has the same configuration as the operating sound comparison server 10. In the present embodiment, the data server 30 is called by a name different from the operating sound comparison server 10 in order to distinguish from the operating sound comparison server 10. The operating sound comparison server 10 may be connected to a plurality of data servers 30 so as to be able to communicate with each other.
(Normal judgment processing)
Next, the normality determination process executed by the home appliance system 1 will be described with reference to fig. 4. When the judgment start request is received by the operating sound comparison server 10, the normal judgment processing is started. For example, if the control unit 90 of the sensing device 80 recognizes that "there is an abnormality" spoken from the user of the sensing device 80. "or the like, the control unit 90 transmits a judgment start request to the operation sound comparison server 10. Alternatively, it may be: when the sensing device 80 senses the operation sound of any one of the home appliances 50, it transmits a judgment start request to the operation sound comparison server 10. Alternatively, the user may transmit a determination start request to the operating sound comparison server 10 using the mobile terminal 98. In addition, the normal determination process may be performed periodically.
If the normal determination process is executed, in S102, the result acquisition unit 22 of the operating sound comparison server 10 transmits an operating sound acquisition request to the sensing device 80.
Upon receiving the operation sound acquisition request, the control unit 90 of each of the sensing devices 80a and 80b causes the microphone 82 to sense the operation sound and converts the sensed operation sound into an electrical signal in S802. Next, in S804, the control section 90 transmits the converted electric signal and the identification information of the sensing device 80 of the transmission source to the operating sound comparison server 10.
When the result acquisition unit 22 of the operating sound comparison server 10 receives the electric signal from the sensing device 80, it generates operating sound data using the electric signal in S104. Thus, the operating sound comparison server 10 can acquire operating sound data of the home appliance 50 that is not present in the vicinity, by using the microphone 82 of the sensing device 80. The motion sound data includes a feature amount of a motion sound represented by an electric signal. The method of generating the operating sound data is the same as the method of generating the normal operating sound data and the abnormal operating sound data.
Next, in S106, the result acquisition unit 22 performs a comparison process of comparing the operating sound data generated in S104 with the normal operating sound data and the abnormal operating sound data recorded in the sound association database 16 stored in the storage unit 12. In the comparison process, the result acquisition unit 22 determines whether or not the feature amount of the generated operating sound data matches any of the feature amounts of the normal operating sound data and the abnormal operating sound data. As a result of the comparison process, the result acquisition unit 22 specifies normal operating sound data or abnormal operating sound data of a feature amount that matches the feature amount of the generated operating sound data.
If the normal operating sound data or the abnormal operating sound data that matches the generated operating sound data is specified (yes in S106), in S108, the result acquisition unit 22 specifies the model information and the state information that are stored in the sound association database 16 in association with the specified normal operating sound data or abnormal operating sound data, and advances to S110. On the other hand, if the normal operating sound data and the abnormal operating sound data that match the generated operating sound data are not specified (no in S106), the result acquisition unit 22 transmits a database request for the sound-related database to the external data server 30 in S107.
Upon receiving the database request, the control unit of the data server 30 transmits the sound-related database stored in the storage unit of the data server 30 to the operating sound comparison server 10 in S302.
Upon receiving the sound-related database from the data server 30, the result acquisition unit 22 of the operating sound comparison server 10 executes the processing of S106 and S108 using the received sound-related database. Next, in S110, the model information and the state information determined in S108 are transmitted to the sensing device 80 identified by the identification information received in S804. According to this configuration, when the operating sound data cannot be specified using the sound-related database 16 of the operating sound comparison server 10, the model information and the state information can be specified using the sound-related database of the data server 30 provided outside the operating sound comparison server 10. Therefore, the data size (data size) of the sound correlation database stored in each of the servers 10 and 30 can be suppressed.
Upon receiving the model information and the state information, in S806, the control unit 90 of the sensing device 80 notifies the model indicated by the model information and the state of the home appliance 50 indicated by the state information. Specifically, the control unit 90 generates an electric signal of a sound indicating the model and the state of the home appliance 50 and supplies the electric signal to the speaker 83. The speaker 83 outputs sound represented by an electric signal. According to this configuration, even if the user is away from the home appliance 50 in which the abnormality is occurring, it is possible to know whether the home appliance 50 is operating normally or the abnormality is occurring by checking the notification of the sensing device 80.
Following the processing of S110, in S112, the result acquisition unit 22 of the operating sound comparison server 10 determines whether or not the identification information received from the sensing device 80 in S804 is stored in combination with the e-mail. If the identification information is stored in combination with the electronic mail (yes in S112), in S114, the result acquisition unit 22 sets the electronic mail as a transmission destination and transmits the electronic mail in which the model information and the status information are described to the external terminal (the portable terminal 98 in the present embodiment). With this configuration, even if the user is not present in the vicinity of the sensing device 80, for example, even when the user is going out, the user can know whether the home appliance 50 is operating normally or an abnormality has occurred using the mobile terminal 98.
When the electric signals corresponding to the plurality of operation sounds are received from the sensing device 80, the result acquisition unit 22 of the operation sound comparison server 10 performs the processes of S104 to S114 on the electric signals corresponding to the plurality of operation sounds, respectively.
(position detection processing)
Next, the position detection process performed by the home appliance system 1 will be described with reference to fig. 5. The position detection process is a process for detecting the current position of the autonomous home appliance such as the autonomous vacuum cleaner 50 c. When the detection start request is received by the operating sound comparison server 10, the position detection process is started. For example, if the control section 90 of the sensing device 80 recognizes "where to clean" spoken from the user of the sensing device 80. "or the like, the control unit 90 transmits a detection start request to the operation sound comparison server 10. The position detection process may also be performed periodically.
When the position detection process is executed, in S120, the result acquisition unit 22 of the operating sound comparison server 10 transmits an operating sound acquisition request to each of the sensing devices 80a and 80 b.
Upon receiving the operation sound acquisition request, the control unit 90 of each of the sensing devices 80a and 80b causes the microphone 82 to sense the operation sound and generate an electric signal from the sensed operation sound in S820. Next, in S822, the control unit 90 transmits the generated electric signal and the identification information of the sensing device 80 of the transmission source to the operating sound comparison server 10. Further, even if the operating sound of the home appliance 50 is not sensed, the control unit 90 transmits the electric signal of the sound sensed by the microphone 82 to the operating sound comparison server 10.
When the result acquisition unit 22 of the operating sound comparison server 10 receives the electric signal from the sensing device 80, in S122, the operating sound data is generated using the electric signal, in the same manner as in S104. Next, in S124, the result acquisition unit 22 identifies normal operating sound data and abnormal operating sound data associated with the model information indicating the autonomous traveling cleaner 50c in the sound association database 16. Next, in S126, the result acquisition unit 22 compares the feature amount of the motion sound data generated in S122 with the feature amount of the motion sound data determined in S124. Then, the result acquisition unit 22 determines the identification information of the sensing device 80 received in combination with the electrical signal that is the source data of the motion sound data containing the feature amount that matches the feature amount of any of the motion sound data determined in S124. Next, in S128, the result acquisition portion 22 determines the position of the sensing device 80 identified by the determined identification information. For example, the control unit 20 may store a database in which a combination of the identification information and the installation position of the sensing device 80 is registered. In this case, the result acquisition section 22 may use the database to specify the setting position combined with the identified identification information. Alternatively, in S822, the sensing device 80 may transmit its installation position to the operation sound comparison server 10.
Next, in S130, the result acquisition unit 22 transmits position information indicating the determined position to each of the sensing devices 80a and 80 b. When receiving the position information, each of the sensing devices 80a and 80b notifies the position indicated by the position information in S824. With this configuration, the user can know the position of the autonomous traveling vacuum cleaner 50c without moving around the house 200 and searching for it.
[ second embodiment ]
Points different from the first embodiment will be explained. In the present embodiment, the sensing device 80 and the household electrical appliance 50 are connected to each other to be able to communicate. Specifically, the sensing device 80 and the home appliance 50 are directly connected to each other without an external device, for example, in accordance with the specification of Bluetooth (registered trademark).
The sensing device 80 is capable of remotely controlling the home appliance 50 via a wireless network. Specifically, control unit 90 of sensing device 80 transmits control information indicating the control content of home appliance 50 (e.g., washing machine 50b) via a wireless network. Upon receiving the control information, the control unit 60 of the home appliance 50 controls the home appliance 50 in accordance with the control information. The control information includes, for example, information for stopping the autonomous traveling vacuum cleaner 50 c. Control information corresponding to the home appliance 50 is stored in the control unit 90 of the sensing device 80. The home appliance 50 may acquire control information from an external device (for example, the operation sound comparison server 10) via the wireless router 32 and the internet 100.
When the operation sound data is abnormal operation sound data, the sound-related database 16 stores control information in association with the machine type information, abnormal operation sound data, and status information. The control information is information for stopping or alleviating a state in which the device is not operating normally. For example, control information for stopping the pump of the washing machine 50b when the pump of the washing machine 50b fails to pump water is associated.
(Normal judgment processing)
The normal determination process executed by the home appliance system 1 will be described with reference to fig. 6. The starting condition of the normal determination process is the same as that of the first embodiment. When the normality determination process is started, the result acquisition unit 22 of the operating sound comparison server 10 executes the process of S102. Next, the control unit 90 of the sensing device 80 executes the processes of S802 and S804, the result acquisition unit 22 of the operating sound comparison server 10 executes the processes of S104 to S114, and the data server 30 executes the process of S302 when the request information is transmitted in S107. In addition, if abnormal operating sound data is specified in the comparison processing in S106, in S108, the result acquisition unit 22 specifies control information stored in the sound association database 16 in association with the specified abnormal operating sound data in addition to the model information and the state information. Further, in S110, the control portion 20 further transmits the determined control information to the sensing device 80 in the case where the control information has been determined in S104.
The control section 90 of the sensing device 80 executes the process of S806. When the control unit 90 receives the determined control information from the motion-sound comparison server 10, it transmits the control information to the home appliance 50 in S808. Thus, when the home appliance 50 receives the control information, the control unit 60 can perform control (e.g., stop of operation) to stop or reduce an abnormality of the home appliance 50. Thus, the abnormality can be eliminated in advance.
In the modification, the operating sound comparison server 10 may be connected to the home appliance 50 so as to be communicable without passing through the sensing device 80. In this case, the operation sound comparison server 10 may transmit the control information determined in S108 to the home appliance 50 without passing through the sensing device 80.
[ third embodiment ]
Points different from the first embodiment will be explained. As shown in fig. 7, in the present embodiment, the home appliance system 1 includes an operating sound comparison device 300 instead of the operating sound comparison server 10 and one sensing device 80a of the plurality of sensing devices 80a and 80b of the first embodiment.
(construction of operating Sound comparing device 300)
The operating sound comparing device 300 is connected to the internet 100. The operation sound comparing device 300 is connected to an external data server 30 via the internet 100. Further, the operating sound comparing device 300 is connected to the mobile terminal 98 via the internet 100. As shown in fig. 8, the operating sound comparing apparatus 300 includes a control unit 320, a storage unit 312, a wireless communication module 384, a microphone 382, and a speaker 383.
The storage unit 312 has the same configuration as the storage unit 12, and stores a sound-related database 316 that is the same as the sound-related database 16. The storage unit 312 can store a combination of the electronic mail and the identification information of the mobile terminal according to the user.
The wireless communication module 384 has the same configuration as the wireless communication module 84. The operation sound comparing device 300 is connected to the wireless router 32 via the wireless communication module 384 so as to be able to communicate.
The microphone 382 and the speaker 383 have the same configuration as the microphone 82 and the speaker 83, respectively.
The control unit 320 has the same configuration as the combination of the control unit 20 and the control unit 90. That is, the controller 320 includes a result acquiring unit 322 similar to the result acquiring unit 22, a storage unit 324 similar to the storage units 24 and 93, a sound receiving unit 391 similar to the sound receiving unit 91, a sound output unit 392 similar to the sound output unit 92, and a communication unit 394 similar to the communication unit 94.
The operating sound comparing device 300 is connected to be able to communicate with the home appliance 50 and the sensing device 80b of the slave unit via the communication unit 394 and the wireless communication module 384.
(Normal judgment processing)
Next, the normality determination process executed by the home appliance system 1 will be described with reference to fig. 9. The control unit 60 of the home appliance 50 monitors the start of the operation of the home appliance 50 according to the user. In S502, when the operation of the home appliance 50 is started, operation information indicating that the home appliance 50 is operating is transmitted to the operation sound comparison device 300.
In S3002, upon receiving the operation information, the result acquisition unit 322 of the operation sound comparison device 300 causes the microphone 382 to acquire the operation sound of the home appliance 50. Next, in S3004, the result acquisition unit 322 generates operating sound data using the electric signal converted from the operating sound by the microphone 382. The method of generating the motion sound data is the same as the processing of S104. Next, in S3006, the result acquisition unit 322 executes the same comparison process as in S106. If the normal operating sound data and the abnormal operating sound data that match the generated operating sound data are specified (yes in S3006), in S3008, the result acquisition unit 322 specifies the model information and the state information stored in the sound association database 316 in association with the normal operating sound data or the abnormal operating sound data specified in S3006, in the same manner as in S108, and proceeds to S3010. On the other hand, if the normal operating sound data and the abnormal operating sound data that match the generated operating sound data are not specified (no in S3006), in S3007, the result acquisition unit 322 transmits a database request for the request sound-related database to the external data server 30. As a result, when the control unit of the data server 30 receives the database request, the process of S301 is executed, and the sound-related database is transmitted to the operating sound comparing device 300.
Upon receiving the sound-related database from the data server 30, the result acquisition unit 322 of the operating sound comparison device 300 executes the processing of S3006 and S3008, and proceeds to S3010. In S3010, control unit 320 notifies the model indicated by the model information and the state of home appliance 50 indicated by the state information. Specifically, the control unit 320 generates an electric signal of a sound indicating the model and the state of the home appliance 50 and transmits the electric signal to the speaker 383. The speaker 383 outputs sound represented by an electric signal.
Next, the control unit 320 executes the same processing as in S112 and S114 in S3012 and S3014.
With this configuration, the operating sound comparing device 300 can determine whether or not the home appliance 50 is operating normally without communicating with an external operating sound comparing server.
Several embodiments of the present invention have been described, but these embodiments are disclosed as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in other various manners, and various omissions, substitutions, and changes can be made without departing from the spirit of the invention.
(1) In the first and second embodiments described above, a plurality of sensing devices 80 are arranged in the home electrical system 1. However, the number of the sensing devices 80 is not limited. For example, the home appliance system 1 may include 1 sensing device 80.
(2) In each of the above embodiments, the sound correlation database 16 includes normal operating sound data and abnormal operating sound data. However, the sound correlation database 16 may include either the normal operating sound data or the abnormal operating sound data. For example, in the first embodiment, when the sound-related database 16 includes normal operating sound data but does not include abnormal operating sound data, the result acquiring unit 22 may determine that the home appliance 50 is operating normally in S106 of fig. 4 when the operating sound data generated in S104 matches the normal operating sound data of the sound-related database 16, and may determine that the home appliance 50 is not operating normally in a case where the operating sound data does not match the normal operating sound data. If it is determined that the home appliance 50 is operating normally, in S110, the result acquisition unit 22 may transmit operation information indicating that the home appliance 50 is operating normally to the sensing device 80. On the other hand, if it is determined that the home appliance 50 is operating abnormally, in S110, the result acquisition unit 22 may transmit operation information indicating that any home appliance 50 is not operating normally to the sensing device 80.
(3) In the first and second embodiments described above, the operation sound comparison server 10 transmits the determined model information and state information to the sensing device 80. However, the operating sound comparison server 10 may not transmit the determined model information and state information to the sensing device 80. In this case, the operating sound comparison server 10 can accumulate and store the determined model information and state information. With this configuration, the manager of the operating sound comparison server 10 can recognize the occurrence of an abnormality for each type of the home appliance 50 by checking the model information and the state information accumulated in the operating sound comparison server 10. The operating sound comparing apparatus 300 of the third embodiment is also the same.
(4) In each of the above embodiments, the sound-related database 16, 316 stores various information, status information, and the like in association with the operation sound data. However, only the motion sound data may be recorded in the sound correlation database 16 or 316.
(5) In each of the above embodiments, the comparison processing is executed using the sound-related database acquired from the data server 30, and when the matching operating sound data is not specified (no in S106 and S3006), the result acquisition units 22 and 322 may acquire the sound-related database from another data server and execute the comparison processing. Even if the result acquisition units 22 and 322 acquire the sound-related database from all the data servers from which the sound-related database should be acquired, if no matching operation sound data is found in the comparison process, the notification can be made.
(6) In the above embodiments, the model information is distinguished by the classification of home appliances such as washing machines, air conditioners, and refrigerators. However, the model information may be distinguished into a plurality of types (for example, by model) in the same category of home electric appliances (for example, washing machines).
(7) In the above embodiments, the speaker 83, 383 is used to notify the model information and the state information. However, the sensing device 80 or the operating sound comparing device 300 may cause the display device to display the model information and the state information, or may transmit the model information and the state information to the external device.
(8) The operating sound data may be data that can distinguish operating sounds, such as frequencies and ranges of operating sounds, in addition to the feature values.
(9) In the above-described embodiments, when the operating sound data matching in the comparison process is not specified (no in S106 and S3006), the result acquisition units 22 and 322 acquire the sound-related database from the data server 30. However, when the matching operation sound data is not specified (no in S106 and S3006), the result acquisition units 22 and 322 may transmit the generated operation sound data to the data server 30. In this case, the control unit of the data server 30 performs comparison processing using the received moving sound data and the sound-related database stored in the data server 30, and transmits the comparison result to the moving sound comparison server 10 and the moving sound comparison device 300.
(10) The result acquisition units 22 and 322 may be mounted on any of the home appliances 50.
(11) The sensing device 80 of the home appliance system 1 may be installed in offices, shops, and the like, in addition to the house 200.
These embodiments and modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalent scope thereof.
Description of the symbols
1: household appliance system
10: action sound comparison server
12: storage part
14: communication module
16: voice association database
20: control unit
22: result acquisition unit
24: storage unit
26: communication unit
30: data server
50: household appliance
60: control unit
80: sensing device
82: microphone (CN)
83: loudspeaker
84: wireless communication module
90: control unit
91: sound receiving unit
92: sound output unit
93: storage unit
94: communication unit
98: portable terminal
100: internet network
200: house
300: action sound comparing device
312: storage part
316: voice association database
320: control unit
322: result acquisition unit
324: storage unit
382: microphone (CN)
383: loudspeaker
384: wireless communication module
391: sound receiving unit
392: sound output unit
394: communication unit
Claims (8)
1. An operating sound comparison device is provided with:
a storage unit that stores sound-related data associated with operation sounds generated from each of a plurality of types of home appliances; and
and a result acquiring unit configured to acquire a comparison result of comparing operating sound data determined based on an operating sound generated while any one of the plurality of types of home appliances is operating with the stored sound-related data.
2. The action tone comparing apparatus according to claim 1,
the result acquisition unit acquires the comparison result including information indicating a type of the home appliance that generated the operation sound associated with the identified operation sound data.
3. The action tone comparing apparatus according to claim 1 or 2,
the result acquisition unit acquires the comparison result including information indicating whether or not the home appliance that generated the operation sound associated with the identified operation sound data is operating normally.
4. The action sound comparing device according to any one of claims 1 to 3,
the operating sound comparing device is connected to a microphone so as to be capable of communicating with the microphone, the microphone converting the operating sound generated while any one of the plurality of types of home electric appliances is operating into an electric signal, and the microphone is disposed separately from the plurality of types of home electric appliances,
the result acquiring unit acquires the comparison result obtained by comparing the operating sound data obtained from the converted electric signal with the stored sound-related data.
5. The action tone comparing apparatus according to claim 4,
the operating sound comparing device is disposed outside a house in which the plurality of types of home electric appliances are installed,
the operating sound comparing device is connected to the microphones respectively installed in the plurality of houses so as to be able to communicate with each other,
the result acquiring unit acquires the comparison result obtained by comparing the operating sound data obtained by completing the conversion of the electrical signal by each of the plurality of microphones with the stored sound-related data.
6. The action sound comparing device according to any one of claims 1 to 5,
the result acquiring unit further acquires the sound-related data from an external server.
7. The action sound comparing device according to any one of claims 1 to 6,
the result acquiring unit further transmits the comparison result to an external device.
8. The action sound comparing device according to any one of claims 1 to 7,
the result acquiring unit may further acquire, for each of the plurality of types of home appliances, operation information indicating that the home appliance is operating from the operation sound data,
the result acquisition unit also senses that the plurality of types of home appliances are operating, using the acquired operation information.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2017193541A JP2019066378A (en) | 2017-10-03 | 2017-10-03 | Operating sound comparison device |
| JP2017-193541 | 2017-10-03 | ||
| PCT/JP2018/032021 WO2019069592A1 (en) | 2017-10-03 | 2018-08-29 | Operation sound comparison device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111183340A true CN111183340A (en) | 2020-05-19 |
Family
ID=65994499
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201880062911.3A Pending CN111183340A (en) | 2017-10-03 | 2018-08-29 | Action sound comparing device |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JP2019066378A (en) |
| CN (1) | CN111183340A (en) |
| WO (1) | WO2019069592A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113382519B (en) * | 2021-07-08 | 2022-10-18 | 佛山市普星科技有限公司 | Ceiling lamp based on infrared induction |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000268265A (en) * | 1999-03-15 | 2000-09-29 | Chuo Joho Kaihatsu Kk | Monitoring device utilizing microphone |
| JP2010134367A (en) * | 2008-12-08 | 2010-06-17 | Mitsubishi Electric Corp | Electric equipment |
| CN102190239A (en) * | 2010-02-16 | 2011-09-21 | 株式会社东芝 | Operation sound collection system and method |
| CN103294906A (en) * | 2012-02-27 | 2013-09-11 | 株式会社东芝 | Medical information processing system and medical information processing apparatus |
| JP2013225248A (en) * | 2012-04-23 | 2013-10-31 | Nec Corp | Sound identification system, sound identification device, sound identification method, and program |
| CN105247428A (en) * | 2013-05-16 | 2016-01-13 | 松下电器（美国）知识产权公司 | Method for supplying information |
| CN105493451A (en) * | 2014-02-28 | 2016-04-13 | 夏普株式会社 | Audio system |
| CN106062869A (en) * | 2014-03-25 | 2016-10-26 | 夏普株式会社 | Interactive household-electrical-appliance system, server device, interactive household electrical appliance, method whereby household-electrical-appliance system performs interaction, and non-volatile computer-readable data recording medium having, stored thereon, program for executing said method on computer |
| CN106973176A (en) * | 2016-01-14 | 2017-07-21 | 株式会社东芝 | Image processing system |
| CN107149476A (en) * | 2016-03-03 | 2017-09-12 | 松下知识产权经营株式会社 | The control method of information terminal device, body are dynamic to determine device and program |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05203542A (en) * | 1992-01-24 | 1993-08-10 | Mitsubishi Heavy Ind Ltd | Method for diagnosing fault of apparatus |
| JP3294766B2 (en) * | 1996-06-10 | 2002-06-24 | 高砂熱学工業株式会社 | Abnormality diagnosis device and method |
-
2017
- 2017-10-03 JP JP2017193541A patent/JP2019066378A/en active Pending
-
2018
- 2018-08-29 CN CN201880062911.3A patent/CN111183340A/en active Pending
- 2018-08-29 WO PCT/JP2018/032021 patent/WO2019069592A1/en active Application Filing
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000268265A (en) * | 1999-03-15 | 2000-09-29 | Chuo Joho Kaihatsu Kk | Monitoring device utilizing microphone |
| JP2010134367A (en) * | 2008-12-08 | 2010-06-17 | Mitsubishi Electric Corp | Electric equipment |
| CN102190239A (en) * | 2010-02-16 | 2011-09-21 | 株式会社东芝 | Operation sound collection system and method |
| CN103294906A (en) * | 2012-02-27 | 2013-09-11 | 株式会社东芝 | Medical information processing system and medical information processing apparatus |
| JP2013225248A (en) * | 2012-04-23 | 2013-10-31 | Nec Corp | Sound identification system, sound identification device, sound identification method, and program |
| CN105247428A (en) * | 2013-05-16 | 2016-01-13 | 松下电器（美国）知识产权公司 | Method for supplying information |
| CN105493451A (en) * | 2014-02-28 | 2016-04-13 | 夏普株式会社 | Audio system |
| CN106062869A (en) * | 2014-03-25 | 2016-10-26 | 夏普株式会社 | Interactive household-electrical-appliance system, server device, interactive household electrical appliance, method whereby household-electrical-appliance system performs interaction, and non-volatile computer-readable data recording medium having, stored thereon, program for executing said method on computer |
| CN106973176A (en) * | 2016-01-14 | 2017-07-21 | 株式会社东芝 | Image processing system |
| CN107149476A (en) * | 2016-03-03 | 2017-09-12 | 松下知识产权经营株式会社 | The control method of information terminal device, body are dynamic to determine device and program |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019069592A1 (en) | 2019-04-11 |
| JP2019066378A (en) | 2019-04-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105518548A (en) | System, retrofit module and method for monitoring a current operational state of a program-controlled domestic appliance | |
| CN103941686B (en) | Sound control method and system | |
| US11516041B2 (en) | Method and device for event notification in home network system | |
| KR100683313B1 (en) | Method for alarming vibration or noise in home server | |
| CN104615001A (en) | Method and device for detecting internet of things functions of internet of things appliance | |
| KR102242961B1 (en) | Smart home network service control device and the control method | |
| CN111183340A (en) | Action sound comparing device | |
| CN110632854A (en) | Voice control method and device, voice control node and system and storage medium | |
| CN111183478B (en) | Household electrical appliance system | |
| JP4244738B2 (en) | Equipment monitoring and control system | |
| JP6267852B2 (en) | Information processing apparatus and information processing method | |
| JP2021092913A (en) | Notification control apparatus, notification control system, notification control method, and notification control program | |
| KR20200112433A (en) | Home Appliance and controlling method | |
| WO2019069597A1 (en) | Home electric system | |
| CN111164677A (en) | Household appliance system | |
| KR102163927B1 (en) | speech recognition appliance and a control method of the same | |
| US20210312929A1 (en) | System and method for digital assistant management | |
| JP2010062645A (en) | Display information transmitter | |
| US20170164126A1 (en) | Method using a loudspeaker comprising a module for generating a value representative of the internal operation of the loudspeaker | |
| JP2022080015A (en) | Electric apparatus, electric apparatus system and notification method of electric apparatus | |
| JP6318276B2 (en) | Information processing apparatus and information processing method | |
| JP2021068370A (en) | Information processor, information processing method, and program | |
| KR20210007582A (en) | a home appliance and a speech recognition system including the same | |
| CN114913609A (en) | Method and device for processing perception information and household electrical appliance | |
| KR20130075101A (en) | Home device network auto-configuration system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200519 |