WO2015182177A1

WO2015182177A1 - Electronic device and message system

Info

Publication number: WO2015182177A1
Application number: PCT/JP2015/054449
Authority: WO
Inventors: 永井出; 赤羽　俊夫; 正和河原; 昭広岡崎
Original assignee: シャープ株式会社
Priority date: 2014-05-28
Filing date: 2015-02-18
Publication date: 2015-12-03
Also published as: JP2015225258A; CN106233372B; JP6400337B2; CN106233372A

Abstract

The purpose of the present invention is to provide an electronic device and a message system capable of ensuring that a message is heard without requiring that a special operation for playing back the message be performed. The electronic device (household electrical appliance (10)) is provided with a speech unit (18) that performs a speaking action of producing speech at a predetermined probability when detecting the occurrence of a predetermined event which is treated as a trigger for producing speech, said predetermined event including a predetermined operation performed on the electronic device (household electrical appliance (10)). When a message to be played back is set, the speech unit (18) plays back the message as one of the utterances produced in the speaking action.

Description

Electronic equipment and message system

The present invention relates to an electronic device and a message system having a function of speaking when the occurrence of a predetermined event that triggers an utterance including a predetermined operation on the electronic device is detected.

When a user opens a door, pushes a button, or changes an operating state, a home appliance that already speaks by outputting a voice from the voice output device is already present. Such home appliances are connected to a server via a network and output sound received from the server.

For example, Patent Document 1 discloses a configuration in which a voice signal or a music signal received from a center server is selected and output in a refrigerator according to the operating status or environmental status of the refrigerator body. Further, in Patent Document 2, an adapter connected to a home appliance receives and stores audio data corresponding to a property from an application server, and outputs audio corresponding to the audio data from an audio output device of the home appliance. A configuration is disclosed.

On the other hand, a technique of registering a message in a home appliance (home electronic device) by voice via a network and playing it by operating the home appliance is common in an answering machine. For example, in Patent Document 3, a voice message is registered from a mobile phone or the like to a home appliance with a message function such as a refrigerator via a network, and when this message is played, the information is mailed to the mobile phone that registered the message. A configuration is disclosed. In the present specification, playing a message means playing the message by voice.

Japanese Patent Publication “Japanese Patent Laid-Open No. 2002-303482 (published on Oct. 18, 2002)” Japanese Patent Publication “Japanese Patent Laid-Open No. 2008-046424 (published on Feb. 28, 2008)” Japanese Patent Publication “JP 2003-78525 A (published March 14, 2003)”

However, the conventional technology for playing back registered messages on home appliances lacks ingenuity for listening to registered messages. Therefore, there is a problem that the message cannot be heard reliably. This will be described in detail.

In conventional technology, special operations such as pressing the play button provided on home appliances are required to listen to registered messages. Some home appliances have been devised to light up or blink a playback button in order to prompt an operation for listening to such a message. However, even in this case, even if the member can visually notify that the message is registered, the message cannot be heard unless the play button is operated. Therefore, members who do not know the operation for listening to the message (for example, a small child) or members who know the operation but do not operate the play button cannot hear the message.

The present invention has been made in view of the above problems, and an object of the present invention is to provide an electronic apparatus and a message system that can reliably listen to a message without performing a special operation for reproducing the message. There is.

In order to solve the above-described problem, an electronic device according to an aspect of the present invention performs a speaking operation that speaks when an occurrence of a predetermined event that triggers an utterance including a predetermined operation on the electronic device is detected. An electronic device including an utterance section to be performed, wherein the utterance section reproduces the message as one of utterances in the speaking operation when there is a message to be reproduced.

The electronic device according to one aspect of the present invention has an effect that the message can be surely heard without performing a special operation for reproducing the message.

It is a figure which shows schematic structure of the message system concerning one Embodiment of this invention. It is a figure which shows schematic structure of the cloud server in the said message system. It is a figure which shows schematic structure of the household appliance in the said message system. It is a figure which shows the speech probability and speech content for every event used as the trigger of speech in the speech operation | movement by the speech part of the said household appliance. It is a figure which shows the specific example of the utterance content other than a message in the talking operation | movement by the utterance part of the said household appliance. It is a figure which shows the specific example of the utterance content of the message in the talking operation | movement by the utterance part of the said household appliance. It is a message reproduction | regeneration timing chart in the talking operation | movement by the utterance part of the said household appliance. It is a figure which shows the event used as the trigger of the 1st message utterance in the talking operation | movement by the utterance part of the said household appliance. It is a figure which shows the probability of a message utterance in the talking operation | movement by the utterance part of the said household appliance. It is a figure which shows the probability of a message utterance in the talking operation | movement by the utterance part of the said household appliance. It is a message reproduction | regeneration timing chart in case the some message exists in the talking operation | movement by the speech part of the household appliance in the message system concerning the other form of implementation of this invention. It is a figure which shows the probability of the message utterance when the door is opened at the timing 1 shown in FIG. It is a figure which shows the probability of the message utterance at the time of the timing 2 shown in FIG. 11 in the talking operation | movement by the utterance part of the said household appliance. It is a figure which shows schematic structure of the household appliance in the message system concerning the further another form of implementation of this invention. In the message system concerning the further another form of implementation of this invention, it is a figure which shows schematic structure of a household appliance to the same message to several household appliances.

[Embodiment 1]
Hereinafter, an embodiment of the present invention will be described with reference to FIGS.

(Configuration of message system 100)
FIG. 1 is a diagram showing a schematic configuration of a message system 100 according to the present embodiment. As shown in FIG. 1, the message system 100 includes a home appliance (electronic device) 10 (10-1, 10-2, 10-3, 10-4) installed in a user's home 50 and a cloud server (voice provision). Server) 20 and communication terminal device 30 (30-1, 30-2, 30-3) are connected via a wide area communication network 62.

The home appliance 10 has a function of performing a talking operation that speaks when an occurrence of a predetermined event that triggers an utterance including a predetermined operation on the home appliance 10 is detected. The home appliance 10 is a so-called network home appliance that is connected to the wide-area communication network 62 and can be controlled via the wide-area communication network 62. In the present embodiment, a home appliance adapter 5 (5-1, 5-2, 5-3, 5) having a communication function portion that enables remote operation to a home appliance main body that does not have a connection function to the wide area communication network 62. 5-4) is illustrated as an example of the configuration of the network home appliance 10, but a configuration in which a communication function part is incorporated in the home appliance main body in advance may be used.

The cloud server 20 associates the communication terminal device 30 with the home appliance 10 (specifically, the home appliance adapter 5), and registers and manages the combination. By registering the combination in the cloud server 20, the communication terminal device 30 can remotely operate the associated home appliance 10 via the cloud server 20. Information regarding the home appliance 10 associated with itself is transmitted to the communication terminal device 30 via the cloud server 20.

The communication terminal device 30 can remotely control a plurality of home appliances 10 per unit. One home appliance 10 can be remotely operated by a plurality of communication terminal devices 30. Examples of such a communication terminal device 30 include a smartphone or a tablet terminal in which an application for remote operation is downloaded.

And in this Embodiment, the communication terminal device 30 has a message registration function, and can register the message which wants to reproduce | regenerate with the household appliance 10 by remote control. The registration location (save location) of the message voice data may be the cloud server 20, the home appliance 10, or both. In the present embodiment, the voice data of the message is temporarily stored in the cloud server 20, and the stored voice data is transmitted from the cloud server 20 to the home appliance 10 and stored in the home appliance 10. In addition, it preserve | saves in the household appliance 10 includes the case where it preserve | saves in the memory | storage part of the household appliance adapter 5.

On the other hand, a wireless LAN (Wireless Local Area Network), which is a narrow area communication network, is provided in the user home 50, and the relay station 40 of the wireless LAN is connected to a wide area communication network 62 including the Internet. The relay station 40 is a communication device such as a WiFi (registered trademark) router or a WiFi access point. In the present embodiment, a configuration including the Internet is exemplified as the wide area communication network 62, but a telephone line network, a mobile communication network, a CATV (CAble TeleVision) communication network, a satellite communication network, or the like can also be used.

The cloud server 20 and the home appliance 10 installed in the user's home 50 (specifically, the home appliance adapter 5) can communicate with each other via the wide area communication network 62 and the wireless LAN relay station 40. Further, the cloud server 20 and the communication terminal device 30 can communicate with each other via the wide area communication network 62. The communication terminal device 30 and the Internet in the wide area communication network 62 are connected by using 3G (3rd generation), LTE (Long Termination Evolution), a home or public WiFi access point, and the like. The home appliance 10 (specifically, the home appliance adapter 5) and the communication terminal device 30 are both wireless communication devices, and can communicate with each other via the relay station 40 without using the wide area communication network 62.

In FIG. 1, the home appliance 10 is exemplified by an air conditioner (air conditioner) 10-1, a microwave oven 10-2, a refrigerator 10-3, and a washing machine 10-4, and three communication terminal devices 30-1, Although 30-2 and 30-3 are illustrated, the types and the number of units are not limited to these. Further, the number of user homes 50 included in the message system 100 is not limited to this.

(Configuration of cloud server 20)
FIG. 2 is a block diagram showing a schematic configuration of the cloud server 20 in the message system 100. The cloud server 20 is a server that manages each home appliance 10, and includes a control unit 21, a storage unit 22, and a communication unit 23 as shown in FIG.

The control unit 21 is composed of a computer device including an arithmetic processing unit such as a CPU (Central Processing Unit) or a dedicated processor, and is a block that controls the operation of each unit of the cloud server 20.

The control unit 21 has a function as a voice providing unit 21a that provides the home appliance 10 with voice data used for a random utterance by a later-described utterance unit 18 (see FIG. 3) of the home appliance 10. The voice providing unit 21a prepares voice data to be provided to the home appliance 10 by creating voice data based on the voice synthesis function or selecting from voice data recorded in advance. Here, the control unit 21 uses data received from the communication terminal device 30 via the wide area communication network 62 or information (for example, weather information) acquired from other servers via the wide area communication network 62. Create or select audio data based on it. The control unit 21 transmits the prepared audio data to the home appliance 10 by controlling the communication unit 23.

When the control unit 21 receives a message voice registration request for the home appliance 10 from the communication terminal device 30 and receives voice data of a message (message voice) from the communication terminal device 30, the control unit 21 converts the voice data into voice data for random utterance. It transmits to the household appliance 10 similarly.

The storage unit 22 is a block that stores various information (data) used in the cloud server 20. The storage unit 22 includes data necessary for the control unit 21 to create and select audio data, voice data of messages received from the communication terminal device 30, state information indicating the state of the home appliance 10, and the like Are stored for each home appliance 10 (Data Base) 22a. The DB 22a enables individual control for each home appliance 10 from the cloud server 20.

The communication unit 23 is a block that performs mutual communication with the home appliance adapter 5 via the wide area communication network 62. The communication unit 23 also performs mutual communication with the communication terminal device 30 via the wide area communication network 62.

(Configuration of home appliance 10)
The home appliance 10 includes, for example, a refrigerator, an air conditioner (air conditioner), a washing machine, a cooking device such as a microwave oven and a rice cooker, an air purifier, a lighting device, a hot water supply device, a photographing device, various AV (Audio-Visual) devices, Various home robots (for example, cleaning robots, housework support robots, animal type robots, etc.).

The home appliance 10 receives various data including operation signals (commands) from the cloud server 20. Data received from the cloud server 20 includes data from the communication terminal device 30 in addition to data from the cloud server 20 itself. Further, the home appliance 10 transmits information related to the home appliance 10 to the cloud server 20.

FIG. 3 is a block diagram illustrating a schematic configuration of the home appliance 10 in the message system 100. As shown in FIG. 3, the home appliance 10 includes a control unit 11, a storage unit 12, a communication unit 13, an audio output device 14, an operation panel 15, a state detection unit 16, and a device main body unit 17.

The control unit 11 is a block that comprehensively controls the operation of each unit of the home appliance 10. For example, the control unit 11 includes a computer device including an arithmetic processing unit such as a CPU or a dedicated processor. The control unit 11 comprehensively controls the operation of the home appliance 10 by reading and executing a program for performing various controls in the home appliance 10 stored in the storage unit 12.

In addition, the control unit 11 has a function as the uttering unit 18 that performs a speaking operation that utters when an occurrence of a predetermined event that triggers an utterance including a predetermined operation on the home appliance 10 is detected. The utterance performed by the utterance unit 18 means that the voice data of the utterance content is read from the storage unit 12 and converted into a voice signal, the voice signal is output to the voice output device 14 and the voice corresponding to the voice data is output from the voice output device 14. Is output.

In the present embodiment, as a characteristic configuration of the home appliance 10, when there is a message to be reproduced, the utterance unit 18 reproduces the message as one of the utterances in the talking operation. More specifically, it is reproduced as one of random utterances in the talking operation. Random utterance is to randomly utter one of a plurality of types of audio data for random utterance. When there is a message, the message is uttered as one of the random utterances. Hereinafter, reproducing a message as one of utterances is referred to as a message utterance (message utterance). Further, in the present embodiment, the utterance unit 18 is configured to reproduce the same message a plurality of times at different times, and to change the frequency of reproducing the same message along the time axis. It has become. This will be described later.

The storage unit 12 is a block that stores various types of information used in the home appliance 10 and stores message voice data and random utterance voice data received from the cloud server 20. In the present embodiment, the storage unit 12 also stores voice data of basic utterance contents from the time of shipment of the home appliance body, and the utterance unit 18 receives voice data for random utterances received from the cloud server 20. Talking is performed using the voice data of the message and the voice data stored from the base. A predetermined event that triggers the utterance by the utterance unit 18, the probability of the utterance when the event occurs, selection of the utterance content, a specific example of the utterance content, and the like will be described later.

The communication unit 13 is a block that performs mutual communication with the cloud server 20 via the wide area communication network 62. In addition, in the case of the household appliance 10 networked by connecting the household appliance adapter 5 to a household appliance main body like this embodiment, in the control part 11 and the memory | storage part 12, the control part and memory | storage part with which the household appliance adapter 5 is provided. Is included. Moreover, the communication part 13 is provided in the household appliance adapter 5, and it is comprised so that mutual communication is possible between the household appliance main body and the household appliance adapter 5 by the connection by a USB (Universal (Serial) Bus) connector.

The operation panel 15 is a user interface that displays various types of information related to the home appliance 10 and enables input of instructions to the home appliance 10. The operation panel 15 is provided with a notification lamp 15a and an utterance button 15b. The notification lamp 15a is lit (or flashes) when there is content that the home appliance 10 should speak. The notification lamp 15a is also turned on when there is a message that has never been reproduced.

The utterance button 15b is a button that causes the utterance unit 18 to utter when pressed. By pressing the utterance button 15b while the notification lamp 15a is lit, it is possible to cause the utterance unit 18 to utter the content to be uttered. Since a message that has never been played is one of the contents to be generated, the message can be uttered by the utterance unit 18 by pressing the utterance button 15b. In order to efficiently notice the presence of a message to a member such as a family member, the lighting color or lighting pattern of the notification lamp 15a may be made different between the message and the content to be uttered other than the message. The notification lamp 15 a is turned off when the content to be uttered is uttered by the utterance unit 18.

On the other hand, by pressing the utterance button 15b while the notification lamp 15a is not lit, the utterance unit 18 can make a random utterance. However, during the message re-listening period from when the first message utterance is made until a certain time elapses, the utterance unit 18 does not perform random utterance but utters the message. This will be described later. Here, although provided separately, the notification lamp 15a and the speech button 15b may be configured integrally.

The state detection unit 16 is a block that detects the state of the home appliance 10. Examples of the state of the home appliance 10 include a setting state and an operating state. Further, the state of the home appliance 10 may include a state where the home appliance 10 is placed, that is, environmental information related to the surrounding environment.

(Message playback by utterance unit 10)
Below, a refrigerator is illustrated as the household appliance 10, and the message reproduction (message utterance) by the utterance part 18 is demonstrated in detail. In the case of the refrigerator, as an event that triggers the utterance in the talking operation, the opening / closing operation of a door (including a drawer storage such as a vegetable room or a freezing type), which is a basic operation for the refrigerator, is started. A pressing operation, abnormality detection by the state detection unit 16, and the like are set. Examples of the abnormality detection in the state detection unit 16 include an abnormality in the internal temperature and an abnormality in which the door remains open for a predetermined time. Among these, the door opening / closing operation and the speech button 15b pressing operation trigger the random speech.

When there is a message to be reproduced, the utterance unit 18 reproduces the message as one of the utterances in the talking operation. In this way, by reproducing the message as one of the utterances in the talking operation, the voice output device 14 provided in the refrigerator can be used to reliably hear the message without performing a special operation for message reproduction. Can. The utterance unit 18 reproduces the same message a plurality of times at different times. Thereby, a message can be heard to the several member which comprises groups, such as a family.

The utterance unit 18 utters according to a predetermined utterance probability X when detecting the occurrence of an event that triggers the utterance in the talking operation. The utterance probability X is a probability of uttering when an operation is performed, and is set in association with an event that triggers utterance. This will be described with reference to FIG. FIG. 4 is a diagram showing the utterance probability X and the utterance content for each event that triggers the utterance of the talking operation by the utterance unit 18.

As shown in FIG. 4, for example, in the operation of pressing the utterance button 15b, the utterance probability X is set to 100%. When the utterance probability is 100%, the utterance unit 18 always utters. The content of the utterance is the content to be uttered when the notification lamp 15a is lit (or flashing), and the message when there is a message. On the other hand, when the notification lamp 15a is not lit, random utterances are performed except for message utterances during the message re-reading period. When there is a message, the message is reproduced in a random utterance according to the message probability Y (frequency). The message probability (frequency) Y is the probability that the content of the message is uttered in a random utterance. In the message re-listening period from the first message utterance to the elapse of a predetermined time (for example, 2 minutes and 30 seconds), the utterance unit 18 utters the message even if the notification lamp 15a is not lit.

On the other hand, in the opening / closing operation of the refrigerator door, the utterance probability X is set to 100% when there is a message that has never been played back (there is an unplayed message), and there is a message that has not been played back once. If not (no message is not reproduced), for example, 10% is set. When there is an unreproduced message, the utterance unit 18 always utters a message. When there is no unreproduced message, the utterance unit 18 performs one random utterance for ten opening / closing operations. At this time, if there is a message, as described above, according to the message probability Y (frequency), the random utterance Play the message in.

Also, the utterance probability X is set to 100% when an abnormality in the internal temperature or an abnormality in which the door remains open for a predetermined time is detected. In this case, the utterance unit 18 utters content notifying abnormality as content to be uttered.

FIG. 5 is a diagram showing a specific example of the utterance contents other than the message in the talking operation by the utterance unit 18 of the refrigerator. As described above, the cloud server 20 creates or selects voice data of utterance contents based on information acquired from another server or the like via the wide area communication network 62 and provides it to the refrigerator. As shown in “seasonal food advice”, “weather topic”, etc., it is possible to utter utterances appropriate to the season and weather. In the random utterance, any one of a plurality of types of contents for random utterance is uttered at random.

On the other hand, FIG. 6 is a diagram showing a specific example of the message utterance content in the talking operation by the utterance unit 18 of the refrigerator. As shown in FIG. 6, at the time of the first message utterance and at the time of message utterance by operating the utterance button 15b, for example, the message is reproduced following the message that introduces the message “It is a message kept at ○ hour ○ minute” ( Type 1). On the other hand, at the time of the second and subsequent message utterances, for example, the message is reproduced following the message that indicates that it is not the first message reproduction, such as “This message has been deposited today, I will say it again” (type 2).

FIG. 7 is an example of a message reproduction timing chart in the utterance unit 18 of the refrigerator. As shown in FIG. 7, the message probability Y (frequency) is set to 100% until the first message utterance is performed. Thereby, the utterance part 18 always utters a message by random utterance. Also, until the first message utterance is made, the utterance probability X by opening and closing the door is exceptionally set to 100%. Thus, the utterance unit 18 always utters a message even when the door is opened or closed.

Fig. 8 shows the events that triggered the first message utterance. The event that triggers the first message utterance occurs when the door is opened in a state where no message has been played since the message has existed, or when the notification lamp 15a is lit (reproduced). This is a case in which the utterance button 15b is pressed. In this case, since it is the first playback, the type of message utterance is type 1 shown in FIG. When the first message utterance is performed, the notification lamp 15a is turned off.

When the utterance unit 18 performs the first message utterance, the utterance unit 18 always utters a message when the utterance button 15b is pressed with a certain time (for example, 2 minutes 30 seconds) from the first utterance as a message re-listening period. Thereby, even if the operator misses the first message utterance, the operator can rehearse the message by pressing the utterance button 15b. Note that the utterance probability X due to door opening and closing during this message re-reading period is set to 0%, and the utterance unit 18 does not perform random utterance even if the door is opened during this message re-listening period.

Returning to FIG. 7, when the message re-listening period (for example, 2 minutes and 30 seconds) determined from the first message utterance ends, the utterance unit 18 lowers the message probability Y slightly to, for example, 80%. Also, the probability of utterance by opening and closing the door is returned to, for example, 10%. As a result, the utterance unit 18 performs random utterances with a probability of once every 10 times when the door is opened and closed, and utters messages with a probability of 80% during random utterances (message utterance 1-1).

FIG. 9 shows the probability of message utterance in the state of utterance probability X10% and message probability Y80% due to door opening and closing. Note that the utterance probability due to the operation of the utterance button 15b is 100%. The utterance unit 18 performs random utterance with a probability of 100% when the utterance button 15b is operated and once every 10 times when the door is opened and closed. During the random utterance, the message is uttered with a probability of 80%, and the contents other than the message are uttered with a probability of 20% (random utterances a to c).

Returning to FIG. 7, when the utterance unit 18 performs the message utterance 1-1 in a random utterance by opening / closing the door or operating the utterance button 15b in a state where the message probability is Y80%, a certain time has elapsed since the message utterance 1-1 was performed The message probability Y is further reduced to, for example, 10% until (for example, 60 minutes) elapses. As a result, the utterance unit 18 performs random utterance with a probability of once in 10 times when the door is opened and closed for a fixed time, and utters a message with a probability of 10% during random utterance (message utterance 1-2). .

FIG. 10 shows the probability of message utterance in the state of utterance probability X10% and message probability Y10% due to door opening and closing. Note that the utterance probability due to the operation of the utterance button 15b is 100%. The utterance unit 18 performs random utterance with a probability of 100% when the utterance button 15b is operated and once every 10 times when the door is opened and closed. Then, during the random utterance, the message is uttered with a probability of 10%, and the contents other than the message are uttered with a probability of 90% (random utterances a to c).

When the applicant of the present application verifies how a user uses a refrigerator installed in a home or office, the same user (member) is likely to open and close the door continuously within a certain period (a certain time). For example, a drink bottle is taken out, poured into a cup and then returned, then food such as cake is taken out and the rest is returned. In addition, when the mother at home prepares a meal, the door is opened and closed to take out the ingredients, and the door is opened and closed to put the finished dish. Therefore, after the message utterance is performed with a high message probability, it is possible to avoid a situation in which the same user is repeatedly heard by repeatedly reducing the message probability Y.

The utterance unit 18 raises the message probability Y to 80% again after a certain time (for example, 60 minutes) has elapsed since the message probability Y was lowered to 10%. This is because the possibility that a user other than the user who listened to the message in the message utterance 1-1 will operate the refrigerator after a certain time has elapsed. By increasing the message probability Y again after a certain period of time, the message can be heard from other members who have not heard the message while avoiding the situation where the same message is repeatedly heard by the same member.

It is preferable to set the number of such adjustments (frequency adjustment) of the message probability Y according to the members of the family who want to hear the message. In the example of FIG. 7, the setting assumes three members. Set the three operators, the operator of the first message utterance (operator of message utterance 2-1), the operator of message utterance 2-1 and the operator of message utterance 3-1, to efficiently listen to the message. Yes. Then, after letting the operator of the message utterance 3-1 hear the message, the utterance unit 18 deletes the message when a certain time (for example, 60 minutes) elapses.

In the above-described example, when the message re-listening period (for example, 2 minutes 30 seconds) determined from the first message utterance ends, the utterance unit 18 sets the message probability Y from 100% to 80%, and thereafter The message probability Y is adjusted (frequency adjustment). In this case, the operator of the first message utterance and the operator of the message utterance 2-1 are likely to be the same member, and for the operator who does not know the function by re-listening the message by the operation of the utterance button 15b. There is an advantage that you can hear the message again.

On the other hand, when each member is familiar with the function of re-reading the message by operating the utterance button 15b, the following may be performed. That is, when the message re-listening period (for example, 2 minutes and 30 seconds) ends, the utterance unit 18 sets the message probability Y to a low value such as 10% from 100%, and then the first message utterance (or message listening). When a certain time (for example, 60 minutes) has elapsed since the correction, the value is increased to a high value, for example, 80%, and thereafter, the message probability Y is adjusted (frequency adjustment). This configuration reduces the possibility that the operator of the first message utterance and the operator of message 2-1 shown in FIG. 7 will be the same member, and the member who made the first message However, it is possible to effectively avoid the occurrence of situations such as repeatedly listening to messages.

In the above example, for example, 60 minutes is used, and the time for lowering the message probability Y in the frequency adjustment is set to be the same. However, this is also increased according to the lifestyle of the member, such as increasing the number of message utterances. It is preferable to set.

Further, in the present embodiment, the utterance unit 18 adjusts the message probability Y according to the utterance situation (frequency adjustment) and deletes the message. The utterance unit 18 can adjust the message probability Y including the utterance probability X, delete the message, and the like according to instructions from the cloud server 20.

In addition, when a message is registered by remote operation from the communication terminal device 30, it may be configured such that the time when the first playback is possible can be specified in advance or the time when the message is deleted can be specified. By specifying the time at which the first playback is possible according to the time at which the member who wants to hear the message returns, the member who wanted to hear the message can efficiently hear the message. In this case, it is preferable to delete the previous message and utter a new message when the previous message remains at the time when the first playback is possible. The time at which the message is erased can be specified, for example, 24 hours after the time when the first playback is possible.

[Embodiment 2]
Another embodiment of the present invention will be described with reference to FIGS. 3 and 11 to 13. For convenience of explanation, members having the same functions as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

In the message system 100 according to the first embodiment, only one message can be registered. In contrast, the message system of the second embodiment is configured to register a plurality of messages, and the utterance unit 18 ′ constructed in the control unit 11 ′ of the home appliance 10 ′ in the message system (see FIG. 3), The message probability Y (frequency) is adjusted (frequency adjustment) for each of a plurality of messages.

FIG. 11 shows an example of a message playback timing chart when there are a plurality of messages (messages A to C) by the utterance unit 18 '. When there is a message utterance for each of the messages A to C, the utterance unit 18 ′ adjusts the message probability Y (frequency) for a certain time (for example, 10%) and increases it again (for example, 80%) after the certain time has elapsed. .

FIG. 12 shows the probability of message utterance when the door is opened at timing 1 in FIG. Note that the utterance probability due to the operation of the utterance button 15b is 100%. The utterance unit 18 'performs random utterance with a probability of 100% when the utterance button 15b is operated and once every 10 times when the door is opened and closed. The message probability Y, which is the probability of uttering a message in the random utterance, uses the highest value among the messages A to C. At timing 1, using message probability Y80% of message A and message B, the message is uttered with a probability of 80%, and the content other than the message is uttered with the remaining 20%. Then, in uttering a message with a probability of 80% during random utterance, the message probability Y of message A and message B is set to 80%, and the message probability Y of message C is set to 10%. Message A and Message B are each uttered with a probability of 80 / (80 + 80 + 10) (about 0.470), and message C is uttered with a probability of 10 / (80 + 80 + 10) (about 0.058).

FIG. 13 shows the probability of message utterance when the door is opened at timing 2 in FIG. Note that the utterance probability due to the operation of the utterance button 15b is 100%. The utterance unit 18 'performs random utterance with a probability of 100% when the utterance button 15b is operated and once every 10 times when the door is opened and closed. In the random utterance, the message probability Y uses the highest value among the messages A to C. At timing 2, the message probabilities Y of messages A to C are all set to 10%, so the message is uttered with a probability of 10%, and the contents other than the message are uttered with the remaining 90%. Then, when uttering a message with a probability of 10% during random utterance, the utterance unit 18 'utters messages A to C with a probability of 10 / (10 + 10 + 10) (about 0.333).

It should be noted that a configuration in which a plurality of messages can be registered and a configuration in which the first playback time of a message can be set in advance at the time of registration can be combined. In that case, if the number of messages registered in the device reaches the limit when the start time of a new message arrives, the message with the closest end date and time is deleted and a new message is registered. Good.

[Embodiment 3]
Another embodiment of the present invention will be described with reference to FIG. For convenience of explanation, members having the same functions as those of the first and second embodiments are denoted by the same reference numerals and description thereof is omitted.

The message system 100 according to the first embodiment and the message system according to the second embodiment did not have a function of identifying the operator who reproduced the message. On the other hand, as shown in FIG. 14, in the home appliance 10 '' in the message system of the third embodiment, the person authentication unit 19 is mounted and the utterance unit 18 '' constructed in the control unit 11 '' The operator can be identified with reference to the operator discrimination result by the person authentication unit 19. Then, the utterance unit 18 '' is the same as the operator who generated the event that triggers the utterance when the operator who generated the event that triggered the utterance is the same as the operator who generated the event that triggered the previous message. The same message is not played back.

Specifically, when the utterance unit 18 '' determines that the operator who performed the operation this time is the same as the operator who previously performed the message utterance with reference to the operator's determination result by the person authentication unit 19 For the operation performed by the operator, the message operation is performed with the message probability Y set to 0% assuming that the message does not exist. Thereby, 100% becomes contents other than a message during random utterance.

In a configuration in which a plurality of messages can be registered, the utterance unit 18 '' refers to the operator's determination result by the person authentication unit 19, and the operator who performed the operation this time has performed the message utterance before. Is determined for each registered message. For example, if it is determined that the operator is the same as the operator who has already played the message A, the message A is not present and only the message B and the message C are present for the operation performed by the operator. Perform the operation.

For example, when the door is opened at the timing 1 in FIG. 11, the message probability Y of the message B is 80%, the message probability Y of the message C is 10%, and the message probability Y of the message A is 0% assuming that the message has already been spoken. Be treated. The utterance unit 18 ″ utters a message with a probability of 80% during random utterance using the message probability Y value 80% of the highest message B among the messages B and C, and the remaining 20% other than the message Speak the contents. When a message is uttered with a probability of 80% during random utterance, the probability of uttering message B is 80 / (80 + 10), and the probability of uttering message C is 10 / (80 + 10).

As the person authentication unit 19, a personal authentication system using a camera or a voice recognition (voice print, keyword) device, or a configuration in which a fingerprint authentication mechanism is built in the speech button 15b can be used. In addition, an authentication system such as an IC card can be used as long as it is configured to operate after authentication with an IC card or the like before using home appliances, such as an office.

[Embodiment 4]
In the first to third embodiments, the refrigerator is exemplified as the

home appliances

10, 10 ′, 10 ″, but here, home appliances other than the refrigerator will be described.

In the speaking operation, the operation of the utterance button can be said to be an event that triggers the message utterance common to each home appliance. In addition, it can be said that the basic operation that is indispensable to use an electronic device is an event that triggers message utterance. For example, in the case of a washing machine, operation start button operation (start / pause / end) and door (washing machine lid) opening / closing operation, and in the case of an air conditioner, remote control button operation (cooling / heating / automatic operation, etc.) In the case of a microwave oven or rice cooker, opening / closing of doors and lids, and operation start button operation (start / pause / end) correspond to the above events. In addition, in the case of an air purifier, the button operation (operation start / stop) of the remote controller, the button operation (operation start / stop) of the main body, and the like correspond to the above events.

Also, changes in the operating state of electronic devices and changes in the surroundings of electronic devices can be said to be events that trigger message utterances. For example, in the case of an air conditioner, a person is detected by an infrared sensor or a human sensor. In the case of an air purifier, when the dust sensor detects that the dust in the air has increased (the person does some activity in the room). It is estimated that the person has heard a message nearby).

For personal authentication, a personal authentication system using a camera or a voice recognition (voice print, keyword) device, or a configuration in which a fingerprint authentication mechanism is built in the utterance button 15b can be commonly used for each home appliance. Moreover, in the household appliance which has a driving | operation start button, the structure which incorporates a fingerprint authentication mechanism in a driving | operation start button can also be used. Further, an authentication system such as an IC (Integrated Circuit) card can be used as long as it is configured to operate after authentication with an IC card or the like before using home appliances, such as an office. Note that electric appliances that are operated after authentication with an IC card or the like before using home appliances include a paid coin laundry in an apartment, an office refrigerator, an office air conditioner, and the like.

Also, NFC (Near Field Communication) or IC (Integrated Circuit) that exchanges with local networks such as MAC (Media Access Control) address and UUID (Universally Unique Control) of wireless devices (smartphones, etc.) used by users A configuration in which authentication is performed by exchanging with a tag or the like can also be used for each home appliance.

In the case of a washing machine, the user is specified according to which preset is selected from the user setting presets of the driving course (the number of washings, the number of rinsings, the dehydration time, the presence / absence / time of drying, etc. can be set). It is also possible. In the case where the same preset is selected, it is assumed that the same user is operating, so that the same message is not spoken.

Similarly, in the case of a microwave oven, the user should be specified according to which preset has been selected from the user setting presets for the operation course (operating modes such as oven cooking, steaming cooking, and microwave oven, and operation time can be set). Is also possible. In the case where the same preset is selected, it is assumed that the same user is operating, so that the same message is not spoken.

[Embodiment 5]
Another embodiment of the present invention will be described with reference to FIG. For convenience of explanation, members having the same functions as those in Embodiments 1 to 4 are given the same reference numerals and explanation thereof is omitted.

In the message system of Embodiments 1 to 4, the configuration in which a message is reproduced by one of a plurality of home appliances 10 is exemplified. Here, a message system 101 that allows a plurality of home appliances 10 to reproduce the same message will be described.

As shown in FIG. 15, in the message system 101 of the fifth embodiment, the same message registered from the communication terminal device 30 can be reproduced in a plurality of home appliances 10 (10-1 to 10-4). . In FIG. 15, descriptions of the communication terminal device 30, the wide area communication network 62, the relay station 40, and the like are omitted.

In the message system 101, the utterance units 18 (18 ′, 18 ″) of the home appliances 10-1 to 10-4 are not synchronized with each other, and the message reproduction timing charts described in the first to fourth embodiments, respectively. To play a message as an utterance of a talking action. That is, each of the home appliances 10-1 to 10-4 can make the first message utterance and the second message utterance, and adjust the frequency of the message utterance.

For example, to explain using the message playback timing chart of FIG. 7 described above, when a message utterance is performed at the timing of message utterance 1-1 at home appliance 10-1, the home appliance 10-1 will continue to have a predetermined time thereafter. During this period, the message probability is reduced to 10%. However, the other home appliances 10-2 to 10-4 retain a message probability of 80%, and when a message utterance is made in each of the home appliances 10-2 to 10-4, the message probability is reduced to 10%. .

As described above, even in the same message, each home appliance 10 manages the playback timing of the message independently by operating a plurality of home appliances 10 installed in a home or office. This is because the user who listens to the message (the same message) from 10 is unlikely to be the same person.

Even if it is the same message, each home appliance 10 manages the reproduction timing of the message independently, so that a plurality of messages can be more reliably used by using the home appliance 10 having a speech function such as a refrigerator, an air conditioner, and a washing machine. Can be told to members of.

However, when there is a message utterance in one home appliance 10, it is also possible to reduce the probability that a message is uttered in another home appliance 10. In this case, although it is far from the purpose of surely listening to a message to a plurality of members, the message can be heard at a plurality of installed home appliances 10, and the message that has been heard once may be repeated continuously. There is a merit that it is low.

Further, in the message system 101 that can reproduce the same message by the plurality of home appliances 10 as described above, as shown in FIG. 15, the control unit 21 ′ causes the message utterance first time, message utterance 1-1, message utterance 2- A message deletion unit that counts the number of messages uttered with a high message probability Y such as 1 and orders the deletion of messages to all the home appliances 10 when the total number of utterances at each home appliance 10 reaches a predetermined value. A configuration combined with a cloud server 20 ′ capable of constructing 21′d is preferable. The predetermined value that serves as a standard for ordering message deletion is, for example, the number of family members or the number of members in the office.

Here, the same members can be counted by counting the number of message utterances, excluding the second message utterance, which is the first re-listening of message utterances, and message utterances 1-2, 2-2, etc. with low message probability Y It is possible to avoid counting repeated message utterances for. Thereby, when the utterance for the number of members (number of members) to be transmitted is completed, the message can be quickly deleted.

Further, as described in the fourth embodiment, when each home appliance 10 can identify the operator who has provided the person authentication unit 19 and has reproduced the message, the cloud server 20 ′ may include a home or office. Members who may listen to messages using each home appliance 10 in an environment where a plurality of home appliances 10 are installed are registered in advance, and the message deletion unit 21′d of the cloud server 20 ′ receives from each home appliance 10 Based on the information, when all the registered members have heard messages from any of the home appliances 10, it is also possible to order all the home appliances 10 to delete the message. For example, in the case of a home, when all family members other than the family member who registered the message hear the message, the corresponding message is deleted from all the home appliances 10. By adopting such a configuration, it is possible to make sure that messages are evenly and reliably heard by a plurality of members constituting a group such as a family.

[Embodiment 6]
The

control units

11, 11 ′, 11 ″ of the

home appliances

10, 10 ′, 10 ″ and the

control units

21, 21 ′ of the

cloud servers

20, 20 ′ described in the first to fourth embodiments are integrated circuits (ICs). It may be realized by a logic circuit (hardware) formed on a chip) or the like, or may be realized by software using a CPU (Central Processing Unit).

In the latter case, the

control units

11, 11 ′, 11 ″ of the

home appliances

10, 10 ′, 10 ″ and the

control units

21, 21 ′ of the

cloud servers

20, 20 ′ are software that realizes the respective functions. A CPU that executes program instructions, a ROM (Read Only） Memory) or a storage device in which the program and various data are recorded so as to be readable by a computer (or CPU) or a storage device (these are referred to as “recording media”), and the program is expanded RAM (Random Access Memory) and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

The present invention is not limited to the above-described embodiments, and various modifications are possible, and the present invention also relates to embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is included in the technical scope. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

[Summary]
The electronic device (home appliance 10) according to the first aspect of the present invention performs a speaking operation when an occurrence of a predetermined event that triggers an utterance including a predetermined operation on the electronic device (home appliance 10) is detected. In the electronic device (home appliance 10) provided with the utterance unit (18), when the message to be reproduced exists, the utterance unit (18) reproduces the message as one of the utterances in the speaking operation.

According to this, when there is a message to be reproduced, the utterance unit reproduces the message as one of the utterances in the talking operation, so that the message is not performed without performing a special operation for reproducing the message. Can be surely heard.

In the electronic device (home appliance 10) according to aspect 2 of the present invention, the utterance unit (18) further utters according to a predetermined probability when it detects the occurrence of an event that triggers the utterance in the talking operation. When there is a message that has never been reproduced, the utterance unit (18) always utters an event that triggers the utterance that has been detected for the first time after the message has existed. Even if the event is not set as described above, the message can be reproduced without fail by speaking.

In a configuration in which some utterance is made each time in the talking operation, the operator may feel noisy or annoying with respect to the talking operation, so that, for example, a setting is made to utter once in 10 times. It is preferable. However, even in that case, if there is a message that has never been played, the event that triggered the first occurrence of the message after the message has already been set is set to always speak. Even if it is not an event, it is possible to make the message heard more effectively by always speaking and replaying the message.

Moreover, in the electronic device (home appliance 10) according to aspect 3 of the present invention, it is preferable that the utterance unit (18) reproduces the same message a plurality of times at different times.

In the conventional technology, a message that has been played once is excluded from a target for prompting an operation for playing the message by blinking a reselection button. For this reason, it is difficult for multiple members to hear the same message. In addition, when a member other than the member intended by the messager reproduces the message first, there is a problem that the message intended by the messager cannot be heard.

However, according to this, since the same message is reproduced a plurality of times at different times, there is an effect that the message can be heard by a plurality of members constituting a group such as a family. You can ask multiple members of the organization.

In the electronic device according to aspect 4 of the present invention, it is preferable that the utterance unit (18) further changes the frequency of reproduction along the time axis when reproducing the same message a plurality of times. .

Specifically, each time the message is reproduced, the utterance unit (18) temporarily decreases the frequency of reproducing the message, and then adjusts the frequency to increase the frequency again after a predetermined time has elapsed. (Embodiment 5 of the present invention).

In electronic devices such as home appliances, it is easy for the same member to continuously generate an event that triggers utterance. Therefore, when the message is reproduced as described above, the message can be efficiently heard by a plurality of members by adjusting the frequency such that the reproduction frequency is once lowered and then raised again.

Moreover, the electronic device (home appliance 10) according to the aspect 6 of the present invention further includes an authentication unit (person authentication unit 19) that determines an operator who has performed an operation on the electronic device, and the utterance unit (18) includes: When reproducing the same message a plurality of times, the operator who has generated the event that triggered the utterance is referred to by referring to the operator's discrimination result by the authentication unit (person authentication unit 19). In the case where the operator is the same as the operator who generated the event that triggered the playback, the same message may not be played back.

According to this, it is possible to effectively avoid the problem of repeatedly listening to the same operator for the same message, and to efficiently transmit the message to a plurality of members.

In addition, the message system (100) according to the aspect 7 of the present invention performs a speaking operation that utters when a predetermined event that triggers an utterance is detected, including a predetermined operation on the electronic device (home appliance 10). A voice providing server (cloud server 20) that transmits and provides the content to be uttered to an electronic device (home appliance 10) provided with an utterance unit (18) to perform, and any electronic device according to each aspect of the present invention (Home appliance 10), and the voice providing server (cloud server 20) receives a registration request for a message reproduced in the electronic device (home appliance 10) from the communication terminal device (30), and from the communication terminal device. The transmitted message is transmitted to the electronic device (home appliance 10) as one of the contents to be uttered in the talking operation.

According to this, since it is possible to handle a message to be reproduced on an electric device using the voice providing server (cloud server 20), even if each electric device does not have a message registration function, it is a part of the talking operation. As a message can be played.

Moreover, the electronic device (home appliance 10), the voice providing server (cloud server 20), and the message system (100) according to each aspect of the present invention may be realized by a computer. In this case, the computer is connected to the electronic device ( The voice providing server (cloud server 20) and the message system (100) are realized by a computer by operating as each unit (software element) included in the home appliance 10), the voice providing server (cloud server 20), and the message system (100). A program and a computer-readable recording medium on which the program is recorded also fall within the scope of the present invention.

The present invention can be used for an electronic device having a speech unit that performs a speech operation that speaks when an occurrence of a predetermined event that triggers speech including a predetermined operation on the electronic device is detected.

5 Home Appliance Adapter 10-1, 10-2, 10-3, 10-4 Home Appliance (Electronic Equipment)
10, 10 ', 10 "home appliance (electronic equipment)
11, 11 ′, 11 ″ control unit 12 storage unit 13 communication unit 14 voice output device 15 operation panel

15a notification lamp

15b utterance button 16 state detection unit 17 device

main body unit

18, 18 ′, 18 ″ uttering unit 19 person authentication Department (Authentication Department)
20, 20 'cloud server (voice providing server)
21, 21 ′ control unit 21 a voice providing unit 21 ′ d message deletion unit 22 storage unit 23 communication unit 30-1, 30-2, 30-3 communication terminal device 40 relay station 50 user home 62 wide area communication network 100 message system

Claims

An electronic device having an utterance unit for performing a speaking operation that utters when detecting the occurrence of a predetermined event that triggers an utterance including a predetermined operation on the electronic device,
The utterance unit reproduces the message as one of utterances in the speaking operation when there is a message to be reproduced.
The utterance unit utters according to a predetermined probability when detecting the occurrence of an event that triggers the utterance in the speaking operation,
If the utterance part has a message that has never been played back, the event that is set so that the event that triggers the utterance that is detected for the first time after the message has existed is uttered without fail 2. The electronic apparatus according to claim 1, wherein the electronic device reproduces the message without fail by speaking.
The electronic device according to claim 1 or 2, wherein the utterance unit reproduces the same message a plurality of times at different times.
4. The electronic apparatus according to claim 3, wherein the utterance unit changes a frequency of reproducing the same message along a time axis.
Sends and provides utterance content to an electronic device with an utterance section that speaks when it detects the occurrence of a predetermined event that triggers the utterance, including predetermined operations on the electronic device A voice providing server,
An electronic device according to any one of claims 1 to 3,
The voice providing server receives a request for registration of a message reproduced in the electronic device from a communication terminal device, and transmits the message transmitted from the communication terminal device to the electronic device as one of contents to be uttered in a talking operation. A message system characterized by transmitting.